Hacker News
Show HN: TurboGPT: train 22KiB transformer in 13s
24 points by lostmsu
ago
|
1 comments
Inspired by minGPT for home experiments.
Requires CUDA 13.4; build script is Windows only.
jey
[-]
At that scale it seems like you could just solve the KKT conditions directly. Exaggerating but only a little