{"podcast":{"title":"Vanishing Gradients","slug":"vanishing-gradients-4989163","podcast_index_feed_id":4989163,"rss_url":"https://api.substack.com/feed/podcast/2632531.rss","website_url":"https://hugobowne.substack.com/podcast","image_url":"https://substackcdn.com/feed/podcast/2632531/e8d57d9d781f20857949c2678ef8c9c2.jpg","author":"Hugo Bowne-Anderson","episode_count":77,"summary":"a data podcast with hugo bowne-anderson","last_synced_at":null,"page_url":"https://stenobird.com/podcast/vanishing-gradients-4989163"},"episode":{"title":"Episode 56: DeepMind Just Dropped Gemma 270M... And Here’s Why It Matters","slug":"episode-56-deepmind-just-dropped-gemma-270m-and-here-s-why-it-matters","published_at":"2025-08-14T16:00:00+00:00","page_url":"https://stenobird.com/podcast/vanishing-gradients-4989163/episode-56-deepmind-just-dropped-gemma-270m-and-here-s-why-it-matters","show_page_url":"https://stenobird.com/podcast/vanishing-gradients-4989163","url":"https://hugobowne.substack.com/p/episode-56-deepmind-just-dropped-b08","audio_url":"https://api.substack.com/feed/podcast/181324512/5b48ac1b773f29b8b1ef9b2e681c2e89.mp3","summary":"While much of the AI world chases ever-larger models, Ravin Kumar (Google DeepMind) and his team build across the size spectrum, from billions of parameters down to this week’s release: Gemma 270M, the smallest member yet of the Gemma 3 open-weight family. At just 270 million parameters, a quarter the size of Gemma 1B, it’s designed for speed, efficiency, and fine-tuning. We explore what makes 270M special, where it fits alongside its billion-parameter siblings, and why you might reach for it in production even if you think “small” means “just for experiments.” We talk through: - Where 270M fits into the Gemma 3 lineup — and why it exists - On-device use cases where latency, privacy, and efficiency matter - How smaller models open up rapid, targeted fine-tuning - Running multiple models in parallel without heavyweight hardware - Why “small” models might drive the next big wave of AI adoption If you’ve ever wondered what you’d do with a model this size (or how to squeeze the most out of it) this episode will show you how small can punch far above its weight. LINKS Introducing Gemma 3 270M: The compact model for hyper-efficient AI (Google Developer Blog) ( https://developers.googleblog.com/en/introducing-gemma-3-270m/ ) Full Model Fine-Tune Guide using Hugging Face Transformers ( https://ai.google.dev/gemma/docs/core/huggingface_text_full_finetune ) The Gemma 270M model on HuggingFace ( https://huggingface.co/google/gemma-3-270m ) The Gemma 270M model on Ollama ( https://ollama.com/library/gemma3:270m ) Building AI Agents with Gemma 3, a workshop with Ravin and Hugo ( https://www.youtube.com/live/-IWstEStqok ) (Code here ( https://github.com/canyon289/ai_agent_basics )) From Images to Agents: Building and Evaluating Multimodal AI Workflows, a workshop with Ravin and Hugo…","meta_description":"While much of the AI world chases ever-larger models, Ravin Kumar (Google DeepMind) and his team build across the size spectrum, from billions of paramete…","key_points":[],"chapters":[],"topics":[],"duration_seconds":2741,"processing_state":"not_requested","actions":[{"name":"request_transcript","method":"POST","url":"https://stenobird.com/v1/public/podcasts/vanishing-gradients-4989163/episodes/episode-56-deepmind-just-dropped-gemma-270m-and-here-s-why-it-matters/transcription-requests","description":"Idempotently request low-priority transcript generation for this episode."},{"name":"read_markdown","method":"GET","url":"https://stenobird.com/podcast/vanishing-gradients-4989163/episode-56-deepmind-just-dropped-gemma-270m-and-here-s-why-it-matters.md","description":"Read the agent-friendly Markdown representation of this episode resource."}]}}