Nanogpt

Educational GPT implementation in ~300 lines. Reproduces GPT-2 (124M) on OpenWebText. Clean, hackable code for learning transformers. By Andrej Karpathy. Perfect for understanding GPT architecture from scratch. Train on Shakespeare (CPU) or OpenWebText (multi-GPU).

bishal-pdMSFT Updated 0 repo stars

File contents

bishal-pdMSFT/msb-skills commit 14bfc75adf

Frequently asked questions

npx get-skill add bishal-pdmsft/nanogpt