Karpathy said a billion parameters is probably enough for the part of a model that actually thinks
This clip is from no priors, september 2024. it's going around again because an 8.8B model came out this week what he says in the first two minutes models waste capacity
You have reached the end of the archive
All of Claude Opus 5