Deploying Your Own Language Models - A Use Case Demo with Open Source Tools

Deploying Your Own Language Models - A Use Case Demo with Open Source Tools

Explore the process of building and deploying domain-specific language models using open source tools in this informative conference talk. Learn how to adapt pre-trained models and leverage libraries such as LangChain, Hugging Face, Kubernetes, Open Data Hub, and ModelMesh for a question-answering application. Gain insights into model serving, cost and performance optimization techniques, prompt engineering, fine-tuning, and ethical and legal considerations. Discover how to effectively utilize open source resources to create tailored language models that meet specific requirements while optimizing resource allocation.