Explore the process of building tools and frameworks for large-scale social media mining in this 46-minute talk by Dr. Juan M. Banda. Learn about the Social Media Mining Toolkit (SMMT) and its application in creating a massive COVID-19 Twitter dataset. Discover the challenges, lessons learned, and key decisions involved in developing and maintaining large-scale social media data gathering projects for NLP and machine learning research. Gain insights into the importance of standardization, scalable architecture, and iterative development in handling big data from social media platforms. Understand the benefits and cautions of using Twitter data, and explore the framework used for the COVID-19 data collection infrastructure.
Building Tools and Frameworks for Large-Scale Social Media Mining