Building a transformer in Go: a night of increasingly interesting nonsense
A Go-native transformer almost works. Tokenizers, vocabulary, norms, cache initialization and attention all take their turn in a night of increasingly interesting nonsense.
Lynn Cole / 标签
cpu inference
A thread through the work.