Dev Radar
Support
LiveUpdated 2026-10-31 20:27 UTC

This 59K-star GitHub repo is basically an entire LLM engineering lab hiding inside one…

This 59K-star GitHub repo is basically an entire LLM engineering lab hiding inside one codebase. Andrej Karpathy built…

This is a dev post classified by AGK Intelligence as AI dev tools (a tool drop), kept by the Dev Radar because it carries real work, not commentary.

This 59K-star GitHub repo is basically an entire LLM engineering lab hiding inside one codebase. Andrej Karpathy built it so you can train a language model from scratch, understand every major stage, and actually talk to the model you trained. It's called nanochat. Unlike projects that begin with pretrained model weights, nanochat includes the training pipeline itself. You can follow the complete journey: → Train a BPE tokenizer from raw text → Build a Transformer using PyTorch → Pretrain the model on a large text dataset → Understand attention, RoPE, GQA, and normalization → Experiment wi

Posted by Tech with Mak (48.3k followers) 2 h ago · 18 likes · 1.1k views · view the original post on X. Kept by the Dev Radar as AI dev tools. Tools mentioned: nanochat.

More dev work like this

Every post is read and classified by AGK Intelligence: what it is, which market it belongs to, and whether the link is a real tool. 31.2k posts from 5k X accounts over the last 21 days, 8.9k tools, 12 markets. New posts are collected several times an hour and the full ranking is recomputed every hour — last update 2026-10-31 20:27 UTC. Full method.