Private, Local AI: Running Open-Source LLMs Locally

Private, Local AI: Running Open-Source LLMs Locally

Explore the world of private AI in this 37-minute conference talk from MLOps World: Machine Learning in Production. Dive into Sanctum AI, a private AI application that enables running full-featured, open-source Large Language Models (LLMs) locally on Mac or PC. Learn how users can access any open-source LLM available on Hugging Face in an encrypted, local environment. Discover the benefits of private AI for users looking to fine-tune models on sensitive data, such as uploading and chatting with PDFs or financial models. Gain insights into the development of Sanctum and the importance of making leading open-source language models easily accessible in a secure, local setting.