Meta's omnilingual ASR: 1,693 languages, 17GB of VRAM, and a capacity problem instead of a vendor list
The 7.8B model covers 1,693 languages at 0.097 real-time factor. That converts a procurement shortlist into GPU-hours, and hands segmentation and alignment to whoever runs the pipeline.
The Engineer · Build desk
What happened
- Meta's omnilingual ASR model runs 7.8 billion parameters and covers 1,693 languages in one set of weights.
- Character error rate comes in under 10 for 78 percent of the covered languages.
- Inference needs about 17GB of VRAM and pulls a 30GB model file on first use, so a GPU is mandatory.
- Measured throughput is a 0.097 real-time factor on 30-second audio samples.
Why it matters
- What it costs cost Multilingual transcription becomes reserved GPU capacity rather than per-minute invoices, and idle card time lands on the operator's bill instead of the vendor's.
- What it limits constraint Subtitling and search products cannot consume this output directly; timing has to be reconstructed with your own alignment code before a transcript drives anything.
- Who has to decide decision Teams must choose between long-form input and the ability to fine-tune, because the two capabilities do not currently ship in the same variant.
- Who's exposed exposure Whoever runs the pipeline now owns the accuracy warranty per language, with no supplier to escalate to when a low-resource language comes back unusable.
A real-time factor of 0.097 is the figure that reaches a spreadsheet. Transcribing 1,000 hours of recorded audio costs roughly 97 GPU-hours [15], or about ten audio-hours per hour of card time [16]. That is forecastable, and it prices differently from per-minute vendor billing: the 17GB resident footprint is occupied whether the queue is full or empty [6], and the 30GB file pulled on first use is nearly twice that working set [18], which is a cold-start problem on autoscaled nodes rather than on one long-lived box.
The input cap does its damage at the joins. An audio hour is at least 90 segments and 89 internal boundaries [17], and each boundary is a place where, per the guide, splitting introduces artifacts that may need manual cleanup [c8b]. That cleanup tax scales with archive size, not with how many languages you support.
The tail is where the coverage number gets expensive. Character error rates below 10 for 78% of languages, across 1,693 of them, leaves about 372 languages above that line [14], and the guide is blunt that performance there degrades significantly and low-resource cases may produce unusable output [5]. Those are also the languages with no commercial alternative to fall back on, which is much of the point of the release [19]. Fine-tuning is the normal remedy for a language that lands badly, and the variant that accepts audio longer than 40 seconds, omniASR_LLM_Unlimited_7B_v2, is the one that currently cannot be fine-tuned [11]. The hardest material to transcribe is therefore the material where you have the least room to adapt the model and the most stitching to do.
Mechanically, this is a wav2vec2 front end with an LLM-based decoder, handling zero-shot and few-shot transcription without language-specific training [4], with an optional language conditioning input for ambiguous audio and support for batched inference [13]. The zero-shot property is what removes the per-language procurement step; it does not remove the per-language question, it relocates it.
Worth being precise about provenance. This comes from a beginner's guide to a Replicate deployment maintained by Subformer [1], which describes the 7B as Meta's recommended choice where accuracy matters more than speed [20] and cites training on more than 1.6M hours of audio [12]. The artifact that matters for anyone signing up to accuracy targets is the per-language CER table shipped as a CSV in the README [5]. A coverage count of 1,693 is a talking point. A CSV with one error rate per language is a document you can be held to, and reading it is now the diligence step that used to be a vendor's problem.
What to watch
- Fine-tuning support arriving for the unlimited-length variant, which would remove the long-audio versus adaptation trade-off entirely.
- Independent evaluation of the weakest 22 percent of languages on field recordings rather than benchmark clips.
- A smaller-footprint or quantised variant that fits commodity inference cards and changes the deployment maths.
Clarity's read
What the record supports and how the coverage leans. The claims behind it follow.
Reality
- Evidence36
- Adoption
- Not scored
- Hype gap+18
- Incentives62
- Confidence40
Claim ledger
Ranked by verification strength, evidence, and original report placement.
- [1]
A dev.to beginner's guide describes meta-omnilingual-asr-7b, Meta's omnilingual ASR model as maintained by Subformer on Replicate.
- [2]
The model has 7.8 billion parameters and supports 1,693 languages.
- [3]
Character error rates are below 10% for 78% of covered languages.
- [4]
The model combines wav2vec2 feature extraction with an LLM-based decoder to handle zero-shot and few-shot multilingual transcription without language-specific training.
- [5]
Performance on the remaining 22% of languages degrades significantly and low-resource languages with minimal training data may produce unusable output; the README includes per-language CER results in a CSV file to help evaluate expected performance before transcription.
- [6]
Inference requires approximately 17GB of VRAM and the model downloads a 30GB file on first use; this restricts deployment to systems with GPU access and rules out serverless environments without GPU acceleration.
- [7]
The model achieves near real-time performance at 0.097 real-time factor on 30-second audio samples.
- [8]
The standard LLM-ASR variants enforce a strict 40-second maximum audio length.
- [9]
Splitting longer recordings introduces transcription boundary artifacts that may require manual cleanup.
- [10]
The model outputs plain text transcription only, with no timestamps, speaker diarization, confidence scores or word-level alignments; applications needing timing must implement separate alignment logic.
- [11]
Audio longer than 40 seconds requires the unlimited-length variant omniASR_LLM_Unlimited_7B_v2, which has comparable accuracy but currently lacks fine-tuning support.
- [12]
The model was trained on more than 1.6 million hours of diverse audio data.
- [13]
The model offers an optional language conditioning input to guide transcription when audio is ambiguous, and supports batch processing.
- [14]
22% of 1,693 languages is about 372 languages whose character error rate is at or above 10.
- [15]
At 0.097 real-time factor, transcribing 1,000 hours of audio consumes about 97 GPU-hours.
- [16]
A 0.097 real-time factor is about 10.3 hours of audio processed per hour of GPU time.
- [17]
A 40-second input cap means one hour of audio is at least 90 segments and 89 internal boundaries.
- [18]
The 30GB first-use download is about 1.8 times the approximately 17GB resident VRAM footprint.
- [19]
Coverage includes hundreds of languages never previously supported by any commercial ASR system, with Quechua, Amharic and Sundanese cited as examples.
- [20]
The guide states the 7B variant is Meta's recommended choice for mission-critical transcription where maximum accuracy matters more than speed.
Get this ledger inside ChatGPT. Ask about any of our stories and the answer brings its figure, each claim’s verdict and the sources. Free, no account.
Sources
1 independent publisher whose own reporting we read for this story.
- dev.toA beginner's guide to the Meta-Omnilingual-Asr-7b model by Subformer on Replicate
1 article · August 23, 2026
Topics and entities
Follow any of these and your For You feed starts watching them — no settings page required.