Researchers have developed Pro$^2$Assist, a new multimodal large language model system designed to offer continuous, step-aware proactive assistance for complex, long-horizon procedural tasks. Unlike previous assistants that are mostly reactive, Pro$^2$Assist uses data from AR glasses to perceive user actions and understand task progress in real-time. The system extracts procedural context from temporal dynamics and expert knowledge to infer user needs and provide timely guidance, outperforming existing methods in action understanding and proactive timing accuracy. AI
Summary written by gemini-2.5-flash-lite from 1 source. How we write summaries →
IMPACT This system demonstrates a step towards more proactive and context-aware AI assistants for complex, real-world tasks.
RANK_REASON The cluster describes a new research paper detailing a novel system and its evaluation. [lever_c_demoted from research: ic=1 ai=1.0]