Bigram Character-level Language Model
This is a series of learning notes for the excellent online course Neural Networks: Zero to Hero created by Andrej Karpathy. Andrej’s official notebook for this lecture is on GitHub. In this lecture, Andrej shows two different approaches to generating characters. The first samples characters from a probability distribution built by counting; the second trains a neural network from scratch. The interesting part is where they end up, so let’s prepare the data first. ...