explaingit

arhxam/arhams-deeplearning-roadmap

Analysis updated 2026-05-18

1PythonAudience · researcherComplexity · 2/5LicenseSetup · easy

TLDR

A curated two week self study roadmap of videos and readings that teaches deep learning from a basic neural network up through pretraining and fine tuning a GPT style model.

Mindmap

mindmap
  root((DL Roadmap))
    What it does
      Structured lesson plan
      Video and reading tracks
      Hands on build tasks
    Tech stack
      Python
      NumPy
      Markdown lessons
    Use cases
      Self study deep learning
      Learning to pretrain a GPT
      Learning fine tuning methods
    Audience
      Students
      Self taught learners
      Aspiring ML engineers

Code map

Detail Auto

An interactive map of this repo's files and how they connect — its source is parsed live in your browser. Click Visualize to build it.

filefunction / class

What do people build with it?

USE CASE 1

Follow a structured two week path to learn deep learning from first principles.

USE CASE 2

Practice fixing bugs in a small from scratch NumPy neural network.

USE CASE 3

Learn how to pretrain and post train a GPT style language model step by step.

USE CASE 4

Study current fine tuning techniques like LoRA and DPO with linked resources.

What is it built with?

PythonNumPyMarkdown

How does it compare?

arhxam/arhams-deeplearning-roadmap0xustaz/streamgatea-bissell/unleash-lite
Stars111
LanguagePythonPythonPython
Setup difficultyeasyhardhard
Complexity2/54/54/5
Audienceresearcherdeveloperresearcher

Figures from each repo's GitHub metadata at analysis time.

How do you get it running?

Difficulty · easy Time to first run · 5min

Most lessons need no GPU, only the pretraining sections require renting cloud compute.

Free to use, share, and adapt, including for commercial purposes, as long as you keep the copyright notice.

In plain English

This repository is a curated two week self study plan for learning deep learning from the ground up. It is not a piece of software you install and run. Instead, it is a structured guide made of markdown lesson files that link out to existing videos, books, and courses from well known teachers such as Andrej Karpathy, 3Blue1Brown, and Sebastian Raschka. The path starts small: learners begin with a short, plain NumPy neural network, included in the repository, that recognizes handwritten digits, and are asked to understand and fix small intentional flaws in it. From there, each of about twelve lessons builds on the last, moving through backpropagation, basic language models, attention, building a small version of a GPT style model, and tokenization, before reaching pretraining a base model and then post training it with techniques like supervised fine tuning, direct preference optimization, and reinforcement learning for reasoning. The final lessons cover current fine tuning methods like LoRA and suggest a capstone project. Every lesson offers two parallel options: a primary video to watch, or a full written alternative covering the same material for someone who prefers reading. Each lesson follows the same pattern of stating a goal, explaining why it matters, linking resources, asking the learner to build something hands on, and ending with a checkpoint question to confirm understanding before moving on. The author states that every linked resource was checked to make sure it still works, rather than assumed from memory. A small included folder holds the reference handwritten digit recognizer mentioned above, written in plain NumPy without any deep learning framework. The rest of the repository is the lesson files themselves, plus a single combined file for anyone who prefers one long document. Most of the roadmap does not require a graphics card, though the sections on training larger models point learners toward renting cloud computing time. The project is released under the MIT license, which allows free use, sharing, and modification.

Copy-paste prompts

Prompt 1
Walk me through day one of this roadmap, starting with the reference NumPy neural network.
Prompt 2
Explain the two intentional flaws in reference-net/nn.py and help me fix them.
Prompt 3
Summarize what I need to know before starting the attention and Transformers lesson in this roadmap.
Prompt 4
Help me plan how to fit this two week roadmap around my current schedule.

Frequently asked questions

What is arhams-deeplearning-roadmap?

A curated two week self study roadmap of videos and readings that teaches deep learning from a basic neural network up through pretraining and fine tuning a GPT style model.

What language is arhams-deeplearning-roadmap written in?

Mainly Python. The stack also includes Python, NumPy, Markdown.

What license does arhams-deeplearning-roadmap use?

Free to use, share, and adapt, including for commercial purposes, as long as you keep the copyright notice.

How hard is arhams-deeplearning-roadmap to set up?

Setup difficulty is rated easy, with roughly 5min to a first successful run.

Who is arhams-deeplearning-roadmap for?

Mainly researcher.

Open on GitHub → Explain another repo

This repo across BitVibe Labs

Verify against the repo before relying on details.