Skip to content

BuildNot yet confirmed elsewhere1 publisher3 min readPublished

Streaming tool-call deltas turn a base-URL swap into a per-model parser project

Ten Chinese model variants now answer an OpenAI tool-calling payload well enough to return a valid response, which is the easy part. The streaming deltas and call arity behind it are where an agent migration spends its budget.

The Engineer · Build desk

How we use AISend a correction

Illustration accompanying Streaming tool-call deltas turn a base-URL swap into a per-model parser project
Generated illustration

What happened

  • A dev.to comparison run in August 2026 exercised ten production variants from DeepSeek, GLM, Qwen, Kimi and MiniMax, and found every one of them exposing an OpenAI-compatible /chat/completions tool-calling endpoint.
  • On the consolidated BenchLM tool-use suite updated on 21 August 2026, GLM-5.1 and MiniMax M3 both score 70.1, ahead of the GPT-5.5 baseline at 67.8.
  • Kimi K2.6 scores 60.5 on that same suite and has historically emitted non-standard streaming tool-call deltas, which the report says pushes teams into version-specific parsers.
  • OpenRouter, Requesty and Eden AI normalize the transport protocol only, so according to the comparison they leave schema and streaming mismatches between providers for you to handle.
  • Qwen3.7-Max sits between the leaders and GPT-5.5 at 68.8, but it is reachable only through Alibaba Cloud Model Studio in mainland China.

Why it matters

  • constraint For a buyer who cannot call an endpoint inside mainland China, the top of this table narrows to two models, and one of them needs custom extension-field parsing before it sees production traffic.
  • cost The saving is asserted as a fraction of the cost with no price attached, while the offsetting work is itemised down to the parser version and the MCP adapter, so the engineer who owns both pays in maintenance for a discount nobody has quantified.
  • decision Data control now has a visible exchange rate of roughly ten benchmark points, which makes self-hosting Kimi weights a deliberate accuracy purchase rather than a cost play.
  • contradiction The same report says a bare base-URL swap often returns a valid response and that migration needs per-model orchestration review; a team that reads only the first half ships an agent that returns 200s while mis-parsing its own tool calls.

Start with the parser, because that is where the migration budget goes. In an OpenAI-style stream, tool-call arguments arrive as incremental deltas that you accumulate per call index until the buffer parses as JSON. The comparison's finding is that some providers instead send a whole JSON object per chunk, which the author flags as having a large impact on your parser [9]. Kimi K2.6 is the named case: the standard payload is accepted, the deltas have historically been non-standard in some versions, and teams end up maintaining version-specific parsers [14].

Arity is the second divergence. Some providers emit only one tool call at a time rather than several in a single assistant turn [8]. An orchestrator written to fan out three calls from one turn and join the results does not fail loudly against such a provider. It serializes. Every tool call is another round trip in the loop [12], so that regression shows up in wall clock and nowhere else.

Now the table, which is a claim about someone else's workload. 70.1 against 67.8 is a 2.3-point margin, 3.4 percent relative [18]. For that to transfer, your tool schemas, your parallel-call pattern and your error-recovery paths have to resemble the harness: identical schemas and prompts across all ten variants, mock downstream services, GPT-5.5 as baseline, and recovery cases limited to malformed JSON, downstream exceptions and empty results [2]. This is one harness, self-reported in a dev.to comparison [3]. A 3.4 percent gap is the size that prompt wording and retry policy move on their own.

The Alibaba demonstration will get quoted more than it deserves. Qwen3.7-Max ran a single task unattended for 35 hours with 1,158 cumulative tool calls [17]. That is one call every 109 seconds [19]. The source presents it as evidence of context retention across long agent loops [17], which is the honest reading of it, and it is not a throughput result.

The cost side is the thinnest part of the report. Teams that budget for per-model adapters are said to reach tool-use accuracy at or above GPT-5.5 levels at a fraction of the cost [16], with no price published to check that against. What is specified is the work. MCP adapter quality varies enough between providers that you test each implementation [15]. MiniMax M3 introduces custom extension fields that require additional parsing before production [10]. DeepSeek, GLM and Qwen hand you the easy half, accepting OpenAI-format functions and tools schemas including tool_choice and multi-turn tool-result messages [7].

In my context that makes the base-URL swap worth an afternoon as a spike and worth nothing as a plan. It is the cheapest line in the diff, and the only one that works first try. The six dimensions the report actually scores, protocol compatibility through total integration effort [2], are the project.

What to watch

  • A BenchLM refresh after 21 August 2026, or a GPT-5.5 point release, either of which reorders a 2.3-point table.
  • Whether MiniMax documents its extension fields as a stable spec instead of a surface you parse at your own risk.
  • Whether any router starts advertising semantic normalization of streaming tool-call deltas rather than transport only.

Clarity's read

What the record supports and how the coverage leans. The claims behind it follow.

Reality

Evidence36
Adoption47
Hype gap+14
Incentives
Insufficient
Confidence43
Why these scores

Claim ledger

Ranked by verification strength, evidence, and original report placement.

  1. [1]

    Qwen3.7-Max scores 68.8 on the same suite but is only available through Alibaba Cloud Model Studio in mainland China.

  2. [2]

    All 10 variants were exercised with a unified harness using identical tool schemas, prompts and downstream mock services, with GPT-5.5 as the compatibility baseline, across six dimensions: API protocol compatibility, JSON payload schema fidelity, parallel tool-call support, streaming tool-call parsing, error recovery behavior (malformed JSON, downstream exceptions, empty results) and total integration effort.

  3. [3]

    The comparison was published on dev.to as a single systematic comparison drawing on DeepSeek API docs, Zhipu GLM API docs, Moonshot API docs, Alibaba Cloud Model Studio and Turing Post's Chinese LLMs in 2026 roundup.

Sources

1 independent publisher whose own reporting we read for this story.

  1. dev.to

    1 article · August 28, 2026

    Chinese LLM Tool Calling Compatibility: A Systematic Comparison (as of Aug 2026)

Share your take

Let Clarity write the post for you.

Signed-in readers get a short post drafted on this story in the register they choose — narrative, analytical, or a direct position — editable to the last word before it goes anywhere. The share buttons at the top of this story work without an account.

Topics and entities

Follow any of these and your For You feed starts watching them — no settings page required.

Topics

  • Tool-use benchmarksFollow
  • Chinese model providersFollow
  • Agent migration engineeringFollow
  • LLM tool-calling compatibilityFollow
  • Open-weight models and self-hostingFollow
  • Model routing layersFollow
Loading related stories