Definition

What Is a Confidence Score in Speech Recognition?

VideoText editorial team. Updated September 13, 2026.

Direct definition

A confidence score is the recognizer’s own estimate that a word or segment is correct. It is not an independent accuracy measurement and is not comparable across vendors without a shared calibration study.

The sections below explain how confidence score is used in transcription and subtitle work, what people often mix up, and which VideoText workflow applies when the next step is a file or review pass.

Key takeaways

  • High confidence can still be wrong, especially on names.
  • Do not average confidence scores from different APIs.
  • Use low-confidence spans as a review queue, not as a published accuracy rate.

How confidence is used

Some pipelines highlight low-confidence words for a human. That is a workflow heuristic. It does not replace word error rate on a labeled set.

The thing people often get wrong

Reporting “average confidence 0.94” as “94% accurate” confuses a model’s softmax with measured error.

What the number represents

A confidence score is the model’s own estimate of how likely its output is correct, usually per word or per segment. It is a property of the model, not an independent measurement, and different systems calculate it differently.

It is useful comparatively within one file — low-confidence spans are worth listening to first — and unreliable as an absolute claim about accuracy.

Using it well in review

Sort or highlight by confidence and start there. This finds genuine trouble spots such as proper nouns and crosstalk far faster than reading start to finish.

Do not use it as a delivery gate. A hallucination can carry high confidence precisely because the model produced fluent text, which is the case where the score is most misleading.

Frequently asked questions

Can I trust a 95% confidence score?
Treat it as a ranking signal rather than a probability of correctness. It tells you which parts to check first, not that the rest is right.
Why do proper nouns score low?
Names are rare in training data and often acoustically ambiguous, so the model has less basis for a confident choice. They are the highest-value target in review.
Do all systems report confidence the same way?
No. Scales and calculation methods vary, so scores are not comparable across systems.
Should low-confidence words be flagged in the delivered transcript?
Not usually. Confidence is a review aid, and a delivered transcript should read as finished text. Where a word genuinely could not be resolved, the convention is an inaudible tag rather than a confidence note.

Related terms

Sources

  1. NIST: Speech recognition evaluation concepts (Open Speech Analytic Technologies overview)

Related VideoText workflow