Anthropic Head of Pretraining on Scaling Laws, Compute, and the Future of AI

Podcast: Y Combinator Startup Podcast (LS 51 · TOP 0.5% what is this?)
Episode: Anthropic Head of Pretraining on Scaling Laws, Compute, and the Future of AI
Pub date: 2025-10-01

Get Podcast Transcript →
powered by Listen411 - fast audio-to-text and summarization

Ever wonder what it actually takes to train a frontier AI model?YC General Partner Ankit Gupta sits down with Nick Joseph, Anthropic's Head of Pre-training, to explore the engineering challenges behind training Claude—from managing thousands of GPUs and debugging cursed bugs to balancing compute between pre-training and RL. We cover scaling laws, data strategies, team composition, and why the hardest problems in AI are often infrastructure problems, not ML problems.

The podcast and artwork embedded on this page are from Y Combinator, which is the property of its owner and not affiliated with or endorsed by Listen Notes, Inc.