rasbt/LLMs-from-scratch

Implement a ChatGPT-like LLM in PyTorch from scratch, step by step

Jupyter Notebook105K stars16K forks+824 today

Topics

#gpt#large-language-models#llm#python#pytorch#ai#artificial-intelligence#language-model#deep-learning#machine-learning#from-scratch#generative-ai#transformers#attention-mechanism#finetuning#instruction-tuning#natural-language-processing#pretraining#tokenizer

Star history

2026-08-23 → 2026-09-11+1.4K stars

Tracking

Last trending: 2026-05-14