# AI Testing: How to Ensure Quality in Non-Deterministic Systems with Adam Sandman

Page: https://stenobird.com/podcast/testguild-automation-podcast-318740/ai-testing-how-to-ensure-quality-in-non-deterministic-systems-with-adam-sandman
Text version: https://stenobird.com/podcast/testguild-automation-podcast-318740/ai-testing-how-to-ensure-quality-in-non-deterministic-systems-with-adam-sandman.md
Podcast: [TestGuild Automation Podcast](https://stenobird.com/podcast/testguild-automation-podcast-318740)
Published: 2026-03-10T22:33:00+00:00
Episode link: https://testtalks.libsyn.com/ai-testing-how-to-ensure-quality-in-non-deterministic-systems-with-adam-sandman
Audio file: https://traffic.libsyn.com/secure/testtalks/tgaAdamAITestingHowtoEnsureQualityinNon-DeterministicSystems580.mp3?dest-id=184057
Processing state: not_requested
JSON: https://stenobird.com/v1/public/podcasts/testguild-automation-podcast-318740/episodes/ai-testing-how-to-ensure-quality-in-non-deterministic-systems-with-adam-sandman
Duration seconds: 2600

## Resource

How do you ensure software quality when the system you're testing doesn't give the same output twice? Go to https://links.testguild.com/inflectra and start your free 30-day trial, no credit card, no contract required. That's the core challenge facing every QA team building or testing AI-powered applications today and it's breaking all the rules we've relied on for decades. In this episode of the TestGuild Automation Podcast, I sit down with Adam Sandman, co-founder of Inflectra, to get into what non-deterministic AI testing actually means in practice, why traditional pass/fail testing no longer cuts it, and what quality professionals need to do differently right now. We cover: Why AI-generated code is raising the stakes for QA teams while budgets stay flat The fundamental difference between deterministic and non-deterministic systems — and why it changes everything about how you test How to set acceptable risk thresholds for AI systems (hint: it depends on whether you're building an e-commerce chatbot or an air traffic control system) Why testers who embrace AI as a tool — not a threat — will be the ones leading their organizations forward How a live demo failure at a conference inspired Inflectra's new non-deterministic testing tool, SureWire If you're a tester, QA manager, or automation engineer trying to figure out how to keep up with AI-driven development without losing your mind — or your job — this one's for you.

## Actions

- request_transcript: `POST https://stenobird.com/v1/public/podcasts/testguild-automation-podcast-318740/episodes/ai-testing-how-to-ensure-quality-in-non-deterministic-systems-with-adam-sandman/transcription-requests` — Idempotently request low-priority transcript generation for this episode.
- read_markdown: `GET https://stenobird.com/podcast/testguild-automation-podcast-318740/ai-testing-how-to-ensure-quality-in-non-deterministic-systems-with-adam-sandman.md` — Read the agent-friendly Markdown representation of this episode resource.

A page view does not enqueue transcription. Agents should invoke `request_transcript` explicitly when they need this episode processed.

## Transcript

Full transcripts are not published on public pages unless there is a clear rights basis.