Researchers have introduced PreScam, a new benchmark designed to help AI models understand and predict the progression of conversational scams. The benchmark, derived from over 177,000 user-submitted scam reports, categorizes scams into 20 types and annotates conversations with scammer tactics and victim responses. Initial evaluations reveal that while current models can identify some scam-related cues, they struggle to accurately predict when a scam is nearing completion or forecast specific scammer actions, indicating a gap between language fluency and true progression modeling. AI
Summary written by gemini-2.5-flash-lite from 1 source. How we write summaries →
IMPACT This benchmark could improve AI's ability to detect and potentially thwart evolving online scams.
RANK_REASON The cluster contains an academic paper introducing a new benchmark for AI research. [lever_c_demoted from research: ic=1 ai=1.0]