OpenAI Strawberry's Innards - How It Works and What Comes Next for OpenAI
Explore the inner workings of OpenAI Strawberry and gain insights into the future developments at OpenAI in this 20-minute video presentation. Delve into the evolution of AI models, starting from the bootstrapping of INSTRUCT models with basic GPT autocomplete, progressing to the creation of chatbots using INSTRUCT models, and finally advancing to the development of reasoning models based on chatbot technology. Learn about key milestones in AI research, including the STaR Bootstrapping Reasoning with Reasoning paper from March 2022, the Information Companion Chatbot project that predated ChatGPT by six months, and the Primitive Cognitive Architecture. Gain a comprehensive understanding of the step-by-step progression in AI development and get a glimpse into what the future holds for OpenAI and its innovative technologies.