Skip to content

person

Andrej Karpathy

AI researcher and educator; co-founded OpenAI, led Tesla's AI team, built open-source tools like nanoGPT, and founded AI education venture Eureka Labs.

Known aliases

  • Karpathy

Relationships

No evidence-backed relationships are recorded.

Current stories

build1 publisher

Size the model to the RAM you own before the 45-minute download

A 15M-parameter model streams English text on a 2007 PSP at about one token per second. That is the extreme end of a sizing rule. The harder half of that rule is checking whether the file that fits is a format its own maintainer recommends.

Publishers:dev.to

Reality

Evidence38
Adoption31
Hype gap+12
Incentives58
Confidence46
product1 publisher

Councils keep a quarter of the ideas only one model had

Rohit Krishnan cut the answers to 16 prompts into idea cards and rated them blind. The merge step, not the model choice, is where the rare material goes.

Publishers:substack.com

Reality

Evidence52
Adoption
Insufficient
Hype gap+8
Incentives38
Confidence45
build1 publisher

The $8 chip did not change. The memory layout did.

A 28.9-million-parameter model now runs on an ESP32-S3 that was topping out at 260K two years ago. The gain came from moving most of the weights into flash and reading 450 bytes per token.

Publishers:dev.to

Reality

Evidence55
Adoption24
Hype gap+20
Incentives32
Confidence47