# Making AI Reliable is the Greatest Challenge of the 2020s // Alon Bochman // #312

Page: https://stenobird.com/podcast/mlops-community/making-ai-reliable-is-the-greatest-challenge-of-the-2020s-alon-bochman-312
Text version: https://stenobird.com/podcast/mlops-community/making-ai-reliable-is-the-greatest-challenge-of-the-2020s-alon-bochman-312.md
Podcast: [MLOps.community](https://stenobird.com/podcast/mlops-community)
Published: 2025-05-06T11:51:23+00:00
Episode link: https://podcasters.spotify.com/pod/show/mlops/episodes/Making-AI-Reliable-is-the-Greatest-Challenge-of-the-2020s--Alon-Bochman--312-e32euff
Audio file: https://anchor.fm/s/174cb1b8/podcast/play/102250415/https%3A%2F%2Fd3ctxlq1ktw2nl.cloudfront.net%2Fstaging%2F2025-4-6%2F399696439-44100-2-48a33567cc778.mp3
Processing state: processed
JSON: https://stenobird.com/v1/public/podcasts/mlops-community/episodes/making-ai-reliable-is-the-greatest-challenge-of-the-2020s-alon-bochman-312
Duration seconds: 3697

## Resource

Making AI Reliable is the Greatest Challenge of the 2020s // MLOps Podcast #312 with Alon Bochman, CEO of RagMetrics. Join the Community: https://go.mlops.community/YTJoinIn Get the newsletter: https://go.mlops.community/YTNewsletter Huge shout-out to RagMetrics for sponsoring this episode! // Abstract Demetrios talks with Alon Bochman, CEO of RagMetrics, about testing in machine learning systems. Alon stresses the value of empirical evaluation over influencer advice, highlights the need for evolving benchmarks, and shares how to effectively involve subject matter experts without technical barriers. They also discuss using LLMs as judges and measuring their alignment with human evaluators. // Bio Alon is a product leader with a fintech and adtech background, ex-Google, ex-Microsoft. Co-founded and sold a software company to Thomson Reuters for $30M, grew an AI consulting practice from 0 to over $ 1 Bn in 4 years. 20-year AI veteran, winner of three medals in model-building competitions. In a prior life, he was a top-performing hedge fund portfolio manager. Alon lives near NYC with his wife and two daughters. He is an avid reader, runner, and tennis player, an amateur piano player, and a retired chess player. // Related Links Website: ragmetrics.ai ~~~~~~~~ ✌️Connect With Us ✌️ ~~~~~~~ Catch all episodes, blogs, newsletters, and more: https://go.mlops.community/TYExplore Join our Slack community [ https://go.mlops.community/slack ] Follow us on X/Twitter [ @mlopscommunity ]( https://x.com/mlopscommunity ) or [LinkedIn]( https://go.mlops.community/linkedin )] Sign up for the next meetup: [ https://go.mlops.community/register ] MLOps Swag/Merch: [ https://shop.mlops.community/ ] Connect with Demetrios on LinkedIn: /dpbrinkm Connect with Alon on LinkedIn: /alonbochman Time…

## Actions

- request_transcript: `POST https://stenobird.com/v1/public/podcasts/mlops-community/episodes/making-ai-reliable-is-the-greatest-challenge-of-the-2020s-alon-bochman-312/transcription-requests` — Idempotently request low-priority transcript generation for this episode.
- read_markdown: `GET https://stenobird.com/podcast/mlops-community/making-ai-reliable-is-the-greatest-challenge-of-the-2020s-alon-bochman-312.md` — Read the agent-friendly Markdown representation of this episode resource.

A page view does not enqueue transcription. Agents should invoke `request_transcript` explicitly when they need this episode processed.

## Transcript

Full transcripts are not published on public pages unless there is a clear rights basis.