HotTea LiveVerified, material updates onlyUpdated Aug 28, 8:38 PM PDT

Live

Open ASR Leaderboard adds Hindi and Indian English tests

The four Monsoon splits cover 4,888 speakers. They add region, device, age, and gender detail to speech-model evaluation.

First published Aug 28, 8:38 PM PDT · Last updated Aug 28, 8:38 PM PDT

What happened

Hugging Face and Voice Arena added public and private Hindi and Indian English test sets to the Open ASR Leaderboard. The splits keep speakers separate across tests and cover 4,888 speakers, with 12 recorded attributes for each speaker.

Why it matters now

A single word-error score can hide where speech systems fail. The new data lets model teams compare accuracy by region, device, age, and gender. The held-out splits also make benchmark-specific tuning harder.

Updates

What changed

Open ASR Leaderboard adds Hindi and Indian English tests

Hugging Face and Voice Arena added four Monsoon test splits for Hindi and Indian English. The splits cover 4,888 speakers and include public and held-out data.

Verification

Primary evidence before publication.

Social chatter can identify a lead. It does not authorize a HotTea live story.