Can Voice Agents Handle Bilingual Customers? Benchmarking Frontier ASR on Code-Switched Speech
Hugging Face has developed a new benchmark and dataset to evaluate how automatic speech recognition (ASR) systems handle code-switched speech, a common practice among bilingual individuals. The benchmark focuses on four language pairs relevant to enterprise customer bases: Spanish-English, French-English, Canadian French-English, and German-English. The study reports results from seven ASR systems, with ElevenLabs Scribe V2, Gemini 3 Flash, and Assembly AI Universal 3-Pro emerging as top performers across various metrics. AI
IMPACT This benchmark will help improve voice agent performance for bilingual customer bases, leading to better user experiences and operational efficiency.