Drop Your Decoder: Pre-training with Bag-of-Word Prediction for Dense Passage Retrieval

Drop Your Decoder: Pre-training with Bag-of-Word Prediction for Dense Passage Retrieval

Learn about an innovative approach to dense passage retrieval in this 15-minute conference talk from SIGIR 2024. Explore how pre-training with bag-of-word prediction can enhance retrieval performance by eliminating the need for a decoder component. Discover the technical implementation details and potential benefits of this streamlined approach presented at the Association for Computing Machinery's Special Interest Group on Information Retrieval conference.