Why Transformers Work
Explore the inner workings of machine learning algorithms used in Rasa, focusing on the transformer's role in replacing RNNs for natural language processing and dialogue handling. This technical talk from EuroPython 2020 delves into why transformers have become integral to many algorithms. Witness a live demonstration comparing typical LSTM errors with transformer performance, and gain insights through clear diagrams with minimal mathematical complexity. Learn about time series, word embeddings, attention mechanisms, transformer layers, and recurrent neural networks. Understand the advantages of transformer embeddings and see their practical application in a demo. Conclude with a Q&A session to address any lingering questions about this powerful machine learning technique.