{"podcast":{"title":"TestGuild Automation Podcast","slug":"testguild-automation-podcast-318740","podcast_index_feed_id":318740,"rss_url":"https://testtalks.libsyn.com/rss","website_url":"https://testguild.com","image_url":"https://static.libsyn.com/p/assets/3/6/d/c/36dc54ea8c1f40d1d959afa2a1bf1c87/New_2023_Podcast_Covers_5.png","author":"Joe Colantonio","episode_count":596,"summary":"TestGuild Automation Podcast (formally Test Talks) is a weekly podcast hosted by Joe Colantonio, which geeks out on all things software test automation. TestGuild Automation covers news found in the testing space, reviews books about automation, and speaks with some of the thought leaders in the test automation field. We'll aim to interview some of today's most successful and inspiring software engineers, and test automation thought leaders.","last_synced_at":"2026-06-10T06:17:49.038208+00:00","page_url":"https://stenobird.com/podcast/testguild-automation-podcast-318740"},"episode":{"title":"AI Testing LLMs & RAG: What Testers Must Validate with Imran Ali","slug":"ai-testing-llms-rag-what-testers-must-validate-with-imran-ali","published_at":"2025-12-21T15:10:00+00:00","page_url":"https://stenobird.com/podcast/testguild-automation-podcast-318740/ai-testing-llms-rag-what-testers-must-validate-with-imran-ali","show_page_url":"https://stenobird.com/podcast/testguild-automation-podcast-318740","url":"https://testguild.com/podcast/automation/a572-imran/","audio_url":"https://traffic.libsyn.com/secure/testtalks/tgaImranAITestingLLMsRAGWhatTestersMustValidate572.mp3?dest-id=184057","summary":"AI is transforming how software is built, but testing AI systems requires an entirely new mindset. Don't miss AutomationGuild 2026 - Register Now: https://testguild.me/podag26 Use code TestGuildPod20 to get 20% off your ticket. In this episode, Joe Colantonio sits down with Imran Ali to break down what AI testing really looks like when you're dealing with LLMs, RAG pipelines, and autonomous QA workflows. You'll learn: Why traditional pass/fail testing breaks down with LLMs How to test non-deterministic AI outputs for consistency and accuracy Practical techniques for detecting hallucinations, grounding issues, and prompt injection risks How RAG systems change the way testers validate AI-powered applications Where AI delivers quick wins today—and where human validation still matters This conversation goes beyond hype and gets into real-world AI testing strategies QA teams are using right now to keep up with AI-generated code, faster release cycles, and DevOps velocity. If you're a tester, automation engineer, or QA leader wondering how AI changes your role,not replaces it,this episode is your roadmap.","meta_description":"AI is transforming how software is built, but testing AI systems requires an entirely new mindset. Don't miss AutomationGuild 2026 - Register Now: https:/…","key_points":[],"chapters":[],"topics":[],"duration_seconds":1976,"processing_state":"not_requested","actions":[{"name":"request_transcript","method":"POST","url":"https://stenobird.com/v1/public/podcasts/testguild-automation-podcast-318740/episodes/ai-testing-llms-rag-what-testers-must-validate-with-imran-ali/transcription-requests","description":"Idempotently request low-priority transcript generation for this episode."},{"name":"read_markdown","method":"GET","url":"https://stenobird.com/podcast/testguild-automation-podcast-318740/ai-testing-llms-rag-what-testers-must-validate-with-imran-ali.md","description":"Read the agent-friendly Markdown representation of this episode resource."}]}}