Whisper
OpenAI Whisper (ASR model)
OpenAI's open-source automatic speech recognition model. The de facto baseline for AI subtitle generation and the engine behind most modern caption tools.
In depth
Whisper is an encoder-decoder transformer trained by OpenAI on 680,000 hours of multilingual audio. It transcribes speech to text in 99 languages, translates non-English speech directly to English, and ships in five sizes (tiny → large) and a faster turbo variant. Most modern AI caption tools — including SoCaptions — call Whisper either through OpenAI's API or via self-hosted faster-whisper / whisper.cpp. Word error rates are typically 5–10% on clean English and competitive with proprietary engines on accented and multilingual audio.
When to use it
When you need transcription that handles accents, code-switching, technical vocabulary, and less-resourced languages reasonably well without per-minute pricing. Whisper is the default for anyone building a captions pipeline today.
Frequently asked
Is Whisper free to use?+
The model weights are open-source under MIT — you can self-host for the cost of compute. OpenAI's hosted API charges per audio minute. Most consumer caption tools wrap one or the other.
Does Whisper produce word-level timestamps?+
Vanilla Whisper outputs segment-level timestamps. Word-level timing requires the WhisperX pipeline or whisper-timestamped wrapper, which align Whisper output with a phoneme model. Most modern caption tools include this.
Which Whisper model size should I use?+
For consumer captions, large-v3 or turbo are the practical choices — they're accurate enough and run fast on a single GPU. tiny and base are too inaccurate for production captions; medium is a reasonable middle ground.
The process of identifying which speaker said which words in an audio recording. Critical for interviews, podcasts, and any multi-speaker content.
Timing data that marks the start and end of every word, not just every cue. The foundation for karaoke captions and word-by-word reveal animations.
An SRT file (.srt) is a plain-text subtitle file: numbered cues, each with a start and end time in HH:MM:SS,mmm format and the caption text, separated by blank lines. It is the most widely supported subtitle format, read by YouTube, VLC, Premiere, CapCut and almost every other player and editor.