A transcript is not a citation: Content Understanding's pitch to Foundry IQ users
Whisper into a blob container gives an agent quotable meetings with no speaker and no offset. Microsoft's answer arrives with two ingestion paths and one honest caveat about video.
The Engineer · Build desk
What happened
- Microsoft has folded Azure Content Understanding into Foundry IQ standard mode as of Build 2026, covering documents, audio, images and video.
- The write-up warns that Foundry IQ's extraction announcements emphasize documents, and that media support per region and API version needs verifying.
- Content Understanding is GA at API version 2025-11-01, and two preview versions were due to retire on 15 July 2026.
Why it matters
- constraint Media indexed as bare transcript stays background reading: nobody can defend an answer they cannot attribute to a speaker or point to at an offset.
- decision The .mp4 test decides scope before sprint planning does: either one property, or an orchestration layer you own and maintain.
- exposure Teams that build on the flag put their media ingestion on preview terms even though the extractor doing the work is generally available.
- cost Anyone who inherited code aimed at the retired preview versions now pays for a migration that was never on the roadmap.
A usable citation carries fields: who spoke, where in the file they spoke, and what was on the screen while they did [4]. Transcription returns the words and drops the rest, which is why the Whisper-into-blob route yields an index that can quote a meeting without placing it [3][4]. The failure lands on retrieval rather than generation. When the question is what was decided about the vendor migration, the discriminating signal is the speaker and the moment, and neither one is in the chunk [2][4].
Content Understanding's argument is that the extractor should emit that structure during ingestion, pairing Document Intelligence's layout work with LLM reasoning over the content [5], and since Build 2026 it can run inside Foundry IQ's standard mode instead of beside it [6].
That leaves the choice of door. Path A is a property: `contentExtractionMode` set to `standard` on a Blob, SharePoint or OneLake knowledge source, no orchestration code, shipped with the Foundry IQ 2026-05-01-preview release [7]. Path B is your own analyzer run, landing Markdown and extracted fields in blob storage for an ordinary knowledge source to index [8]. The caveat in the dev.to walkthrough is worth more than the tutorial around it: Microsoft's Foundry IQ extraction announcements lead with layout, tables, figures and document-embedded images, and it is Content Understanding's own documentation that names audio and video, so whether a blob source accepts an .mp4 in your region at your API version is something to test [14]. The author's advice is to try the flag first and fall back if it does not cover your media [12].
The version arithmetic makes that fallback less optional than it sounds. The extractor is GA at 2025-11-01 [10]. The retrieval side sits at 2026-05-01-preview for exactly the extraction features you came for [11]. Combine the two and the pipeline runs at preview support, because the weakest component sets the floor [13]. Path B at least keeps that preview surface out of your ingestion contract, since the artifact on disk is Markdown and fields, which an index will still accept when the flag's API version turns over.
Older code carries its own bill. The 2024-12-01-preview and 2025-05-01-preview APIs were slated to retire on July 15, 2026, and that date has passed [10].
Field quality, meanwhile, is a deployment decision rather than a service setting. Analyzers run on models you deploy in Foundry, and the write-up reports GPT-5.2 doing better on custom field extraction across mixed layouts, domain-specific language and multilingual content, with GPT-4.1 analyzers continuing unchanged [9]. If speaker labels and slide text are the fields you need indexed, that deployment is where their accuracy comes from.
What to watch
- Whether a blob knowledge source with contentExtractionMode=standard is documented as accepting audio and video, and in which regions.
- Whether Foundry IQ's content-extraction features leave 2026-05-01-preview for GA, closing the support mismatch with the extractor.
- Whether Microsoft's Foundry IQ extraction material starts naming audio and video ingestion rather than leading with layout, tables and figures.
Clarity's read
What the record supports and how the coverage leans. The claims behind it follow.
Reality
- Evidence30
- Adoption22
- Hype gap+8
- Incentives45
- Confidence33
Claim ledger
Ranked by verification strength, evidence, and original report placement.
- [1]
Organizations hold years of recorded meetings, support calls, training sessions, conference talks and screen recordings, and almost none of it is retrievable.
- [2]
The example given is the question "what did we decide about the vendor migration", whose answer sits inside a 47-minute recording nobody will scrub through.
- [3]
The reflex fix is to bolt a transcription service onto a RAG pipeline: run Whisper, dump the text into a blob container, index it.
- [4]
Such a transcript has no speakers, no timestamps that can be linked back to, no slide content and no distinction between a presenter reading a bullet and someone in the room disagreeing with it; the agent can quote the meeting but cannot say when it happened or who said it.
- [5]
Azure Content Understanding ingests documents, audio, images and video and extracts the most critical information to power well-grounded generative and agentic solutions, combining Document Intelligence's traditional AI with LLM-based content reasoning.
- [6]
As of Build 2026, Content Understanding is integrated with Foundry IQ standard mode for built-in content extraction inside Microsoft's retrieval and agent workflows.
- [7]
Path A is native extraction: setting the contentExtractionMode property to standard on file-based indexed knowledge sources (Azure Blob, SharePoint, OneLake) enables Content Understanding inside the ingestion pipeline with no orchestration code, and shipped in the Foundry IQ 2026-05-01-preview release, which focused on richer Content Understanding extraction and image serving for multimodal agentic retrieval.
- [8]
Path B is explicit analysis: you run Content Understanding yourself, write the resulting Markdown and fields to blob storage and point a normal knowledge source at that, which means more moving parts and complete control.
- [9]
Analyzers are powered by LLM and embedding models deployed in Foundry; GPT-5.2 improves custom field extraction enough to avoid prompt-engineering gymnastics on mixed layouts, domain-specific language and multilingual content, and analyzers built on GPT-4.1 continue to run unchanged.
- [10]
Content Understanding's GA API is 2025-11-01; the preview versions 2024-12-01-preview and 2025-05-01-preview were slated for retirement on July 15, 2026, a date that has now passed, so an inherited codebase targeting either is already broken or about to be.
- [11]
Foundry IQ is on 2026-05-01-preview for the content-extraction features, so you will be running a GA content service against a preview retrieval service and should plan support expectations accordingly.
- [12]
The author's recommendation is to test Path A first and build on Path B if Path A does not cover your media types, because Path B works regardless.
- [13]
A pipeline combining the GA extractor with Foundry IQ's content-extraction features runs at preview support overall, because the least-supported component governs.
- [14]
Microsoft's Foundry IQ extraction announcements emphasize document understanding (layout, tables, figures and document-embedded images) rather than audio and video ingestion, while Content Understanding standard mode itself is documented for documents, images, audio and video; whether a blob knowledge source will accept an .mp4 today, in a given region, at a given API version, is a question to answer with a five-minute test rather than an assumption.
Get this ledger inside ChatGPT. Ask about any of our stories and the answer brings its figure, each claim’s verdict and the sources. Free, no account.
Sources
1 independent publisher whose own reporting we read for this story.
- dev.toVideo and Audio as Knowledge Sources: Content Understanding into Microsoft Foundry IQ
1 article · August 24, 2026
Topics and entities
Follow any of these and your For You feed starts watching them — no settings page required.