Serving LLMs with MLflow - Phi-3-mini-4k-instruct Model

Serving LLMs with MLflow - Phi-3-mini-4k-instruct Model

Explore the process of creating a Python model in MLflow using the microsoft/Phi-3-mini-4k-instruct Large Language Model (LLM) in this 25-minute tutorial video. Learn how to save the model to an MLflow tracking server, load it, and perform inference on your local computer. Gain practical insights into MLOps and machine learning workflows as you follow along with the step-by-step demonstration. Access the accompanying code on GitHub to enhance your understanding and implement the techniques in your own projects.