Definition

What Is Automatic Speech Recognition (ASR)?

VideoText editorial team. Updated September 13, 2026.

Direct definition

Automatic speech recognition (ASR) is software that maps an audio waveform to text without a human typing every word. Modern ASR systems are statistical or neural models trained on large collections of speech and transcripts.

The sections below explain how automatic speech recognition is used in transcription and subtitle work, what people often mix up, and which VideoText workflow applies when the next step is a file or review pass.

Key takeaways

  • ASR is the engine; a transcript is the document it helps produce.
  • Accuracy is condition-specific. Clean read speech is not the same as a noisy meeting.
  • Word error rate is the usual research metric, not a consumer “percent accurate” slogan.

How ASR works

An ASR system converts sound into features, then predicts a sequence of tokens or words. Training data and decoding rules determine how it handles accents, noise, and punctuation.

The 2022 Whisper paper showed that a model trained on 680,000 hours of weakly labeled web audio can be evaluated zero-shot on public test sets. That is a research result, not a promise about every real recording.

Why ASR matters

ASR makes it practical to draft transcripts and captions for long media. It does not, by itself, guarantee an accessible caption file. Organizations in 3Play’s 2024 survey still treated unedited automatic captions as insufficient.

Example

The same Whisper Large V2 checkpoint scored 2.7% WER on LibriSpeech Clean and 25.5% WER on CHiME-6 in the authors’ table — one model, two very different conditions.

The thing people often get wrong

“ASR accuracy” is not a single number. Always ask: which dataset, which language, which microphone, how many speakers, and was the text normalized?

What determines ASR quality in practice

Audio conditions first: microphone distance, background noise, reverberation and overlapping speech. Then how well the speaker’s accent and the subject vocabulary are represented in the training data.

Choice of system matters less than most comparisons suggest once the audio is clean. It matters considerably on difficult material, which is where published benchmarks rarely test.

What ASR does not do

It does not know who is speaking — that is diarization. It does not know whether a transcript meets a client style guide. And it has no way to flag that it invented text, which is why a review pass is not optional for work that will be published or relied on.

Treat the output as a draft that is usually right rather than a finished transcript, and target review at names, numbers and silence.

Frequently asked questions

Is ASR the same as transcription?
ASR is the recognition step. Transcription also includes formatting, speaker labels, and any human review.
Is ASR accurate enough to skip human review?
For internal search and navigation, often yes. For anything published, quoted or relied on, no — names, figures and invented spans need checking.
Why does ASR struggle with names?
Proper nouns are rare in training data and acoustically ambiguous, so the model falls back on more common words that sound similar.
Does ASR add punctuation?
Modern systems usually do, as a separate step. Its quality depends on how clearly the audio marks sentence boundaries.
How long does ASR take relative to the recording?
Batch systems typically run several times faster than real time, so an hour of audio finishes in minutes. Streaming runs at real time by definition, because it is following the speech as it happens.

Related terms

Sources

  1. OpenAI: Robust Speech Recognition via Large-Scale Weak Supervision
  2. W3C: Speech Recognition (MDN overview of the Web Speech API concept)

Related VideoText workflow