Skip to content

Build Not yet confirmed elsewhere1 publisher 2 min read Published

A transcript is not a citation: Content Understanding's pitch to Foundry IQ users

Whisper into a blob container gives an agent quotable meetings with no speaker and no offset. Microsoft's answer arrives with two ingestion paths and one honest caveat about video.

The Engineer · Build desk

How we use AI Send a correction

What happened

  • Microsoft has folded Azure Content Understanding into Foundry IQ standard mode as of Build 2026, covering documents, audio, images and video.
  • The write-up warns that Foundry IQ's extraction announcements emphasize documents, and that media support per region and API version needs verifying.
  • Content Understanding is GA at API version 2025-11-01, and two preview versions were due to retire on 15 July 2026.

Why it matters

  • constraint Media indexed as bare transcript stays background reading: nobody can defend an answer they cannot attribute to a speaker or point to at an offset.
  • decision The .mp4 test decides scope before sprint planning does: either one property, or an orchestration layer you own and maintain.
  • exposure Teams that build on the flag put their media ingestion on preview terms even though the extractor doing the work is generally available.
  • cost Anyone who inherited code aimed at the retired preview versions now pays for a migration that was never on the roadmap.

A usable citation carries fields: who spoke, where in the file they spoke, and what was on the screen while they did [4]. Transcription returns the words and drops the rest, which is why the Whisper-into-blob route yields an index that can quote a meeting without placing it [3][4]. The failure lands on retrieval rather than generation. When the question is what was decided about the vendor migration, the discriminating signal is the speaker and the moment, and neither one is in the chunk [2][4].

Content Understanding's argument is that the extractor should emit that structure during ingestion, pairing Document Intelligence's layout work with LLM reasoning over the content [5], and since Build 2026 it can run inside Foundry IQ's standard mode instead of beside it [6].

That leaves the choice of door. Path A is a property: `contentExtractionMode` set to `standard` on a Blob, SharePoint or OneLake knowledge source, no orchestration code, shipped with the Foundry IQ 2026-05-01-preview release [7]. Path B is your own analyzer run, landing Markdown and extracted fields in blob storage for an ordinary knowledge source to index [8]. The caveat in the dev.to walkthrough is worth more than the tutorial around it: Microsoft's Foundry IQ extraction announcements lead with layout, tables, figures and document-embedded images, and it is Content Understanding's own documentation that names audio and video, so whether a blob source accepts an .mp4 in your region at your API version is something to test [14]. The author's advice is to try the flag first and fall back if it does not cover your media [12].

The version arithmetic makes that fallback less optional than it sounds. The extractor is GA at 2025-11-01 [10]. The retrieval side sits at 2026-05-01-preview for exactly the extraction features you came for [11]. Combine the two and the pipeline runs at preview support, because the weakest component sets the floor [13]. Path B at least keeps that preview surface out of your ingestion contract, since the artifact on disk is Markdown and fields, which an index will still accept when the flag's API version turns over.

Older code carries its own bill. The 2024-12-01-preview and 2025-05-01-preview APIs were slated to retire on July 15, 2026, and that date has passed [10].

Field quality, meanwhile, is a deployment decision rather than a service setting. Analyzers run on models you deploy in Foundry, and the write-up reports GPT-5.2 doing better on custom field extraction across mixed layouts, domain-specific language and multilingual content, with GPT-4.1 analyzers continuing unchanged [9]. If speaker labels and slide text are the fields you need indexed, that deployment is where their accuracy comes from.

What to watch

  • Whether a blob knowledge source with contentExtractionMode=standard is documented as accepting audio and video, and in which regions.
  • Whether Foundry IQ's content-extraction features leave 2026-05-01-preview for GA, closing the support mismatch with the extractor.
  • Whether Microsoft's Foundry IQ extraction material starts naming audio and video ingestion rather than leading with layout, tables and figures.

Clarity's read

What the record supports and how the coverage leans. The claims behind it follow.

Reality

Evidence30
Adoption22
Hype gap+8
Incentives45
Confidence33
Why these scores

Claim ledger

Ranked by verification strength, evidence, and original report placement.

  1. [1]

    Organizations hold years of recorded meetings, support calls, training sessions, conference talks and screen recordings, and almost none of it is retrievable.

    Reported SupportedView cited source
  2. [2]

    The example given is the question "what did we decide about the vendor migration", whose answer sits inside a 47-minute recording nobody will scrub through.

    Reported SupportedView cited source
  3. [3]

    The reflex fix is to bolt a transcription service onto a RAG pipeline: run Whisper, dump the text into a blob container, index it.

    Reported SupportedView cited source

Get this ledger inside ChatGPT. Ask about any of our stories and the answer brings its figure, each claim’s verdict and the sources. Free, no account.

Add to ChatGPTAdd to Claude

Sources

1 independent publisher whose own reporting we read for this story.

  1. dev.to

    1 article · August 24, 2026

    Video and Audio as Knowledge Sources: Content Understanding into Microsoft Foundry IQ

Share your take

Let Clarity write the post for you.

Signed-in readers get a short post drafted on this story in the register they choose — narrative, analytical, or a direct position — editable to the last word before it goes anywhere. The share buttons at the top of this story work without an account.

Topics and entities

Follow any of these and your For You feed starts watching them — no settings page required.

Topics

  • Azure AI retrieval and agent stackFollow
  • Citation anchors and grounding fidelityFollow
  • Multimodal RAG ingestionFollow
  • Preview versus GA lifecycle riskFollow

Entities

Loading related stories