iPay framework uses multimodal AI for transit payment recognition

Researchers have developed iPay, a new framework for recognizing payment actions in transit surveillance footage. This system utilizes a multimodal mixture-of-experts architecture, combining RGB and skeleton data streams with a dual-attention fusion mechanism. An additional Spatial Difference Discriminator explicitly models hand-to-anchor motion to enhance discriminability. iPay achieved 83.45% recognition accuracy on a dataset of over 500 payment clips collected from real onboard transit surveillance, demonstrating its suitability for edge deployment. AI

Summary written by gemini-2.5-flash-lite from 1 source. How we write summaries →

IMPACT This multimodal AI framework offers improved accuracy for automated transit payment analysis, potentially enhancing fare auditing and passenger analytics in real-world surveillance scenarios.

RANK_REASON The cluster contains an academic paper detailing a new AI framework and its performance on a specific task. [lever_c_demoted from research: ic=1 ai=1.0]

Read on arXiv cs.CV →

• iPay
• RGB
• skeleton
• Graph convolutional networks
• Spatial Difference Discriminator

• paper
• product
• other