# Arch Gateway: Add AI To Your Apps Without Custom Development

Page: https://stenobird.com/podcast/ai-engineering-podcast/arch-gateway-add-ai-to-your-apps-without-custom-development
Text version: https://stenobird.com/podcast/ai-engineering-podcast/arch-gateway-add-ai-to-your-apps-without-custom-development.md
Podcast: [AI Engineering Podcast](https://stenobird.com/podcast/ai-engineering-podcast)
Published: 2025-02-26T00:55:40+00:00
Episode link: https://www.aiengineeringpodcast.com/arch-prompt-gateway-episode-47
Audio file: https://op3.dev/e/dts.podtrac.com/redirect.mp3/serve.podhome.fm/episode/f6ff0caa-931b-4c08-bfdd-08dc7f5cd336/638761275952711729983b2955-7a34-4e7a-a197-473d4b3fb48dv1.mp3
Processing state: failed
JSON: https://stenobird.com/v1/public/podcasts/ai-engineering-podcast/episodes/arch-gateway-add-ai-to-your-apps-without-custom-development
Duration seconds: 1885

## Resource

Summary In this episode of the AI Engineering Podcast Adil Hafiz talks about the Arch project, a gateway designed to simplify the integration of AI agents into business systems. He discusses how the gateway uses Rust and Envoy to provide a unified interface for handling prompts and integrating large language models (LLMs), allowing developers to focus on core business logic rather than AI complexities. The conversation also touches on the target audience, challenges, and future directions for the project, including plans to develop a leading planning LLM and enhance agent interoperability. Announcements Hello and welcome to the AI Engineering Podcast, your guide to the fast-moving world of building scalable and maintainable AI systems Your host is Tobias Macey and today I'm interviewing Adil Hafeez about the Arch project, a gateway for your AI agents Interview Introduction How did you get involved in machine learning? Can you describe what Arch is and the story behind it? How do you think about the target audience for Arch and the types of problems/projects that they are responsible for? The general category of LLM gateways is largely oriented toward abstracting the specific model provider being called. What are the areas of overlap and differentiation in Arch? Many of the features in Arch are also available in AI frameworks (e.g. LangChain, LlamaIndex, etc.), such as request routing, guardrails, and tool calling. How do you think about the architectural tradeoffs of having that functionality in a gateway service? What is the workflow for someone building an application with Arch? Can you describe the architecture and components of the Arch gateway? With the pace of change in the AI/LLM ecosystem, how have you designed the Arch project to allow for rapid evolution and…

## Actions

- request_transcript: `POST https://stenobird.com/v1/public/podcasts/ai-engineering-podcast/episodes/arch-gateway-add-ai-to-your-apps-without-custom-development/transcription-requests` — Idempotently request low-priority transcript generation for this episode.
- read_markdown: `GET https://stenobird.com/podcast/ai-engineering-podcast/arch-gateway-add-ai-to-your-apps-without-custom-development.md` — Read the agent-friendly Markdown representation of this episode resource.

A page view does not enqueue transcription. Agents should invoke `request_transcript` explicitly when they need this episode processed.

## Transcript

Full transcripts are not published on public pages unless there is a clear rights basis.