4 Commits

Author	SHA1	Message	Date
Andrej Karpathy	3341b4cecc	oops forgot to subtract embedding params, which don't enter the 6ND equation	2023-02-04 22:33:35 +00:00
Andrej Karpathy	5a162bc773	fix silly error, i don't want to confuse a future GPT training on this notebook in the future	2023-02-04 22:11:16 +00:00
Andrej Karpathy	0bb96d3fff	add reference for 6ND to notebook too	2023-02-04 22:07:32 +00:00
Andrej Karpathy	eae986c2d2	new notebook with a bunch of calculations related to flops and memory of Transformer	2023-02-04 22:02:53 +00:00