#From-scratch

Showing 19 of 19 repositories tagged #from-scratch, ranked by stars

rasbt
rasbt
LLMs-from-scratch

Implement a ChatGPT-like LLM in PyTorch from scratch, step by step

Score
100
★ 98.7k ⑂ 15.2k +235/day
Jupyter Notebook
rohitg00
rohitg00
ai-engineering-from-scratch

Learn it. Build it. Ship it for others.

Score
0
★ 37.6k ⑂ 6.3k +282/day
Python
raiyanyahya
raiyanyahya
how-to-train-your-gpt

Build a modern LLM from scratch. Every line commented. Explained like we are five.

Score
100
★ 2.3k ⑂ 304 +8/day
Jupyter Notebook
keyvank
keyvank
femtoGPT

Pure Rust implementation of a minimal Generative Pretrained Transformer

Score
100
★ 934 ⑂ 66
Rust
fancyboi999
fancyboi999
ai-engineering-from-scratch-zh

Agent工程师最全学习路径 · 从零精通 AI 工程 · 20 阶段 503 课 · 中文全量翻译 + 配套站点 + 动画讲解视频 · 如何成为 AI Agent 工程师的修成指南

Score
75
★ 781 ⑂ 111 +82/day
Python
PhilippRados
PhilippRados
wrecc

A x86_64 C99 compiler written in Rust from scratch

Score
25
★ 476 ⑂ 15
Rust
sagi21805
sagi21805
LearnixOS

An OS which is all about learning!

Score
75
★ 269 ⑂ 9
Rust
admtrv
admtrv
objcurses

ncurses 3d object viewer

Score
0
★ 228 ⑂ 14
C++
mohammad-ghaderi
mohammad-ghaderi
mnist-asm-nn

A complete neural network built entirely in x86 assembly language that learns to recognize handwritten digits from the MNIST dataset. No frameworks, no high-level languages - just pure assembly - ~5.3× faster than NumPy

Score
100
★ 168 ⑂ 5 +1/day
Assembly
omaraflak
omaraflak
Medium-Python-Neural-Network

This code is part of my post on Medium.

Score
40
★ 114 ⑂ 45
Python
lucid-softworks
lucid-softworks
browser

A web browser written from scratch — a platform-agnostic Rust engine (networking, HTML/CSS parsing, DOM, style, layout, paint) with a thin native app shell per OS.

Score
50
★ 95 ⑂ 8
Rust
Enping-Hu
Enping-Hu
minimind-deep-dive

逐行对照 MiniMind 源码精读、并延伸到大模型技术体系的中文学习笔记 —— 预训练 / SFT / DPO / PPO / GRPO、训练机制、MiniMind2→3 版本对照、真实实验证据。

Score
50
★ 94 ⑂ 2 +4/day
Python
OceanPresentChao
OceanPresentChao
llm-corpus

从零搭建大模型知识库(Build LLM RAG Corpus from scratch)

Score
0
★ 89 ⑂ 9
Python
paolorechia
paolorechia
steeldb

A simple database built from scratch in Rust

Score
0
★ 86 ⑂ 9
Rust
JustVugg
JustVugg
nanoeuler

GPT-2-style LLM built from scratch in C/CUDA with hand-written backprop, BPE tokenizer, FlashAttention, pretraining, and SFT.

Score
25
★ 79 ⑂ 9 +1/day
Cuda
SirawitC
SirawitC
Transformer_from_scratch_pytorch

Build a transformer model from scratch using pytorch to understand its inner workings and gain hands-on experience with deep learning models in PyTorch.

Score
60
★ 67 ⑂ 12
Python
SorawitChok
SorawitChok
Neural-Network-from-scratch-in-Cpp

Build a Neural Network from scratch in C++ to deeply understand how it works, not just how to use it.

Score
20
★ 47 ⑂ 5
C++
danilop
danilop
micro-gpt-and-beyond

Build a GPT from scratch, one concept at a time, from pure Python to PyTorch, JAX, MLX, and production serving. Inspired by Andrej Karpathy's microGPT.

Score
80
★ 43 ⑂ 4 +1/day
Python
ribtoks
ribtoks
yannpp

Deep Neural Network from scratch in C++ for learning purposes

Score
0
★ 35 ⑂ 8
C++
Related Topics
#machine-learning#deep-learning#llm#neural-network#python#pytorch#rust#gpt#language-model#transformers#nlp#ai

© 2026 GitRepoTrend · GitHub repositories by topic · Updated weekly