Simon Willison’s Weblog

nanoGPT. “The simplest, fastest repository for training/finetuning medium-sized GPTs”—by Andrej Karpathy, in about 600 lines of Python.

Posted 2nd January 2023 at 11:27 pm

Recent articles

Comma v0.1 1T and 2T - 7B LLMs trained on openly licensed text - 7th June 2025
The last six months in LLMs, illustrated by pelicans on bicycles - 6th June 2025
Tips on prompting ChatGPT for UK technology secretary Peter Kyle - 3rd June 2025

andrej-karpathy 30 gpt-3 67 ai 1354 python 1155 generative-ai 1178 llms 1161

Monthly briefing

Sponsor me for $10/month and get a curated email digest of the month's most important LLM developments.

Pay me to send you less!

Sponsor & subscribe