Episode
JP Beeghly & Josh Maynard on AI quality: Train agents like junior employees, not magic tools
- Podcast
- Brilliant Commerce
- Published
- Feb 18, 2026
- Duration seconds
- 3144
- Processing state
not_requested
Actions
POST https://stenobird.com/v1/public/podcasts/brilliant-commerce-7086880/episodes/jp-beeghly-josh-maynard-on-ai-quality-train-agents-like-junior-employees-not-magic-tools/transcription-requests
Idempotently request low-priority transcript generation for this episode.GET https://stenobird.com/podcast/brilliant-commerce-7086880/jp-beeghly-josh-maynard-on-ai-quality-train-agents-like-junior-employees-not-magic-tools.md
Read the agent-friendly Markdown representation of this episode resource.
Summary
When JP Beeghly, Senior Manager of Martech at Sonos, asks Chord's Commerce Copilot more questions than anyone else in their customer base, it's not because he's looking for basic answers. He's stress-testing whether AI can handle the institutional knowledge that separates a generic query from a Sonos-specific insight. Joined by Josh Maynard, who recently shifted from CTO at Ruggable to GM, Global eCommerce, MrBeast, this conversation cuts through the AI hype to reveal what's actually working at scale. Both openly admit their organizations aren't doing enough to train AI properly. And that admission leads to the real conversation: how commerce operators are navigating the gap between AI's promise and the messy reality of implementation. Topics discussed: The context problem in enterprise AI. JP reveals how Chord's Copilot must reach across multiple data tables to answer seemingly simple campaign questions, highlighting why institutional knowledge and business-specific context matter more than raw data access. Josh emphasizes that without centralized, structured data, teams uploading different Excel files to ChatGPT will generate contradictory answers. Why dimensional modeling isn't dead. Despite initial hopes that LLMs could handle unstructured data, the conversation confirms that well-structured data architecture is now more critical than ever. LLMs need to write reliable SQL, which requires data models built specifically to support AI query patterns, not just traditional BI dashboards. Onboarding AI like you'd onboard junior employees. Rather than expecting immediate production-ready output, both leaders discuss treating AI tools as new hires who need access to systems, training on company-specific terminology, and gradual expansion of responsibilities. The parallel:…