Andrej Karpathy blog

12 Feb 2026

This is a brief guide to my new art project [microgpt](https://gist.github.com/karpathy/8627fe009c40f57531cb18360106ce95), a single file of 200 lines of pure Python with no dependencies that trains

14 Mar 2022

The Yann LeCun et al. (1989) paper [Backpropagation Applied to Handwritten Zip Code Recognition](http://yann.lecun.com/exdb/publis/pdf/lecun-89e.pdf) is I believe of some historical significance

21 Jun 2021

I find blockchain fascinating because it extends open source software development to open source + state. This seems to be a genuine/exciting innovation in computing paradigms; We don’t just get to

27 Mar 2021

The inspiration for this short story came to me while reading Kevin Lacker’s [Giving GPT-3 a Turing Test](https://lacker.io/ai/2020/07/06/giving-gpt-3-a-turing-test.html). It is probably worth it

11 Jun 2020

Throughout my life I never paid too much attention to health, exercise, diet or nutrition. I knew that you’re supposed to get some exercise and eat vegetables or something, but it stopped at that

25 Apr 2019

Some few weeks ago I [posted](https://twitter.com/karpathy/status/1013244313327681536?lang=en) a tweet on “the most common neural net mistakes”, listing a few common gotchas related to training

20 Jan 2018

The current state of this blog (with the last post 2 years ago) makes it look like I’ve disappeared. I’ve certainly become less active on blogs since I’ve joined Tesla, but whenever I do get a

7 Sep 2016

This guide is patterned after my [“Doing well in your courses”](http://cs.stanford.edu/people/karpathy/advice.html), a post I wrote a long time ago on some of the tips/tricks I’ve developed

31 May 2016

This is a long overdue blog post on Reinforcement Learning (RL). RL is hot! You may have noticed that computers can now automatically [learn to play ATARI

14 Nov 2015

The idea of writing a collection of short stories has been on my mind for a while. This post is my first ever half-serious attempt at a story, and what better way to kick things off than with a story