Great at coding isn’t always great at voice! Meet Voice Standard Bench.
Models that are great at coding aren’t necessarily great at voice. So which LLM should run on your transcripts? Voice Standard Bench scores 50+ LLMs on the jobs voice products actually run: summarization, information extraction, text correction and dictation cleanup. Every task is tested on real transcripts at four lengths, from a 30-second voicemail to an hour-long meeting, with quality, speed and cost side by side. In this video I walk through the results, compare two models in the LLM Gateway playground, and show how to test the picks on your own audio. The benchmark is open source: clone