Let's build GPT: from scratch, in code, spelled out
In this video, Andrej Karpathy demonstrates how to build a Generatively Pretrained Transformer (GPT), following the paper "Attention is All You Need" and OpenAI's GPT-2 / GPT-3, and much more. Make sure that you watch at least parts of it!
Andrej Karpathy demonstrates how to build a Generatively Pretrained Transformer (GPT) from scratch in code, following the paper Attention is All You Need and OpenAI's GPT-2 and GPT-3.
More from the studio
1:01:41SF DEMO NIGHT 🚀 (w/ The AI Collective)
Six startup teams present live AI demos spanning interactive avatars, executive communication, home services, autonomous-agent security, enterprise operations, and personal intelligence, followed by audience Q&A and community voting.
Dmytro Spodarets·Sep 18, 2026
17:58Interview with Keerti Melkote: Anyscale Azure Integration and the Future of Ray
At Ray Summit 2025, Dmytro Spodarets speaks with Keerti Melkote about Anyscale, Ray, and the new Azure integration. The interview covers enterprise AI workloads, GPU challenges, agentic systems, and the future of scalable AI infrastructure.
Dmytro Spodarets·Nov 24, 2025
38:39Manus vs OpenAI: How a Startup Is Beating the Giants in the AI Agent Race
Tao Zhang of Manus AI shares how the startup is taking on OpenAI in the agent race, revealing product insights, strategy, and the future of intelligent tools.
Dmytro Spodarets·Jul 21, 2025