speech-recognition.
4 writings found
Latest Archives
Why Your ASR Model's Leaderboard Score Is Lying to You
High benchmark scores hide critical failures in speech recognition. The Monsoon dataset exposes why measuring accuracy matters less than measuring whose accuracy.
Why ASR Benchmarks Hide the Real Problem
Speech recognition leaderboards measure what's easy to measure, not what matters. A new dataset exposes how models fail differently across populations.
Why ASR Leaderboards Hide Bias Behind One Number
The Open ASR Leaderboard's new Monsoon dataset exposes how aggregate metrics mask disparities. What this means for building fair speech systems.
ASR Models Are Gaming Benchmarks, and We Finally Have Proof
Speech recognition models are optimizing for benchmarks rather than real-world accuracy. New research reveals how top performers memorize dataset-specific patterns instead of transcribing what they ac
Prev
Page 1 of 1 Next