Episode
Le Chaton Fat Just Broke the Internet...
- Published
- Jun 16, 2026
- Duration seconds
- 597
- Processing state
not_requested
Actions
POST https://stenobird.com/v1/public/podcasts/ai-news-today-julian-goldie-podcast-7573784/episodes/le-chaton-fat-just-broke-the-internet/transcription-requests
Idempotently request low-priority transcript generation for this episode.GET https://stenobird.com/podcast/ai-news-today-julian-goldie-podcast-7573784/le-chaton-fat-just-broke-the-internet.md
Read the agent-friendly Markdown representation of this episode resource.
Summary
Why AI Benchmarks are Fake (And How to Actually Test Models) A fake French AI model recently went viral for beating the industry's top benchmarks, proving how easy it is to manipulate performance data. This video explains why you should stop chasing hype-filled charts and start evaluating AI based on your own real-world business workflows. 00:00 - Intro: The Le Chatton Fat Joke 01:08 - Why AI Benchmarks Can Lie 02:42 - The Problem with Self-Reported Tests 04:18 - Real Work is the Only Benchmark 05:20 - How to Avoid AI Overwhelm 06:34 - The New Way to Evaluate AI 07:31 - 3 Key Takeaways for AI Testing 08:45 - Testing AI Systems Yourself