# Building Real-World LLM Products with Fine-Tuning and More with Hamel Husain - #694

Page: https://stenobird.com/podcast/twiml-ai-podcast/building-real-world-llm-products-with-fine-tuning-and-more-with-hamel-husain-694
Text version: https://stenobird.com/podcast/twiml-ai-podcast/building-real-world-llm-products-with-fine-tuning-and-more-with-hamel-husain-694.md
Podcast: [The TWIML AI Podcast (formerly This Week in Machine Learning & Artificial Intelligence)](https://stenobird.com/podcast/twiml-ai-podcast)
Published: 2024-07-23T21:02:00+00:00
Episode link: https://twimlai.com/podcast/twimlai/building-real-world-llm-products-with-fine-tuning-and-more/
Audio file: https://pscrb.fm/rss/p/traffic.megaphone.fm/MLN5252789067.mp3?updated=1721769728
Processing state: failed
JSON: https://stenobird.com/v1/public/podcasts/twiml-ai-podcast/episodes/building-real-world-llm-products-with-fine-tuning-and-more-with-hamel-husain-694
Duration seconds: 4805

## Resource

Today, we're joined by Hamel Husain, founder of Parlance Labs, to discuss the ins and outs of building real-world products using large language models (LLMs). We kick things off discussing novel applications of LLMs and how to think about modern AI user experiences. We then dig into the key challenge faced by LLM developers—how to iterate from a snazzy demo or proof-of-concept to a working LLM-based application. We discuss the pros, cons, and role of fine-tuning LLMs and dig into when to use this technique. We cover the fine-tuning process, common pitfalls in evaluation—such as relying too heavily on generic tools and missing the nuances of specific use cases, open-source LLM fine-tuning tools like Axolotl, the use of LoRA adapters, and more. Hamel also shares insights on model optimization and inference frameworks and how developers should approach these tools. Finally, we dig into how to use systematic evaluation techniques to guide the improvement of your LLM application, the importance of data generation and curation, and the parallels to traditional software engineering practices. The complete show notes for this episode can be found at https://twimlai.com/go/694.

## Actions

- request_transcript: `POST https://stenobird.com/v1/public/podcasts/twiml-ai-podcast/episodes/building-real-world-llm-products-with-fine-tuning-and-more-with-hamel-husain-694/transcription-requests` — Idempotently request low-priority transcript generation for this episode.
- read_markdown: `GET https://stenobird.com/podcast/twiml-ai-podcast/building-real-world-llm-products-with-fine-tuning-and-more-with-hamel-husain-694.md` — Read the agent-friendly Markdown representation of this episode resource.

A page view does not enqueue transcription. Agents should invoke `request_transcript` explicitly when they need this episode processed.

## Transcript

Full transcripts are not published on public pages unless there is a clear rights basis.