VisionTasker - Mobile Task Automation Using Vision-Based UI Understanding and LLM Task Planning

VisionTasker - Mobile Task Automation Using Vision-Based UI Understanding and LLM Task Planning

Save Big on Coursera Plus. 7,000+ courses at $160 off. Limited Time Only! Grab it Watch a 12-minute conference talk from the 37th Annual ACM Symposium on User Interface Software and Technology (UIST 2024) exploring an innovative approach to mobile task automation that combines vision-based UI understanding with LLM task planning capabilities to streamline and enhance user interactions on mobile devices.