BuildNot yet confirmed elsewhere1 publisher3 min readPublished
Streaming tool-call deltas turn a base-URL swap into a per-model parser project
Ten Chinese model variants now answer an OpenAI tool-calling payload well enough to return a valid response, which is the easy part. The streaming deltas and call arity behind it are where an agent migration spends its budget.
The Engineer · Build desk

What happened
- A dev.to comparison run in August 2026 exercised ten production variants from DeepSeek, GLM, Qwen, Kimi and MiniMax, and found every one of them exposing an OpenAI-compatible /chat/completions tool-calling endpoint.
- On the consolidated BenchLM tool-use suite updated on 21 August 2026, GLM-5.1 and MiniMax M3 both score 70.1, ahead of the GPT-5.5 baseline at 67.8.
- Kimi K2.6 scores 60.5 on that same suite and has historically emitted non-standard streaming tool-call deltas, which the report says pushes teams into version-specific parsers.
- OpenRouter, Requesty and Eden AI normalize the transport protocol only, so according to the comparison they leave schema and streaming mismatches between providers for you to handle.
- Qwen3.7-Max sits between the leaders and GPT-5.5 at 68.8, but it is reachable only through Alibaba Cloud Model Studio in mainland China.
Why it matters
- constraint For a buyer who cannot call an endpoint inside mainland China, the top of this table narrows to two models, and one of them needs custom extension-field parsing before it sees production traffic.
- cost The saving is asserted as a fraction of the cost with no price attached, while the offsetting work is itemised down to the parser version and the MCP adapter, so the engineer who owns both pays in maintenance for a discount nobody has quantified.
- decision Data control now has a visible exchange rate of roughly ten benchmark points, which makes self-hosting Kimi weights a deliberate accuracy purchase rather than a cost play.
- contradiction The same report says a bare base-URL swap often returns a valid response and that migration needs per-model orchestration review; a team that reads only the first half ships an agent that returns 200s while mis-parsing its own tool calls.
Start with the parser, because that is where the migration budget goes. In an OpenAI-style stream, tool-call arguments arrive as incremental deltas that you accumulate per call index until the buffer parses as JSON. The comparison's finding is that some providers instead send a whole JSON object per chunk, which the author flags as having a large impact on your parser [9]. Kimi K2.6 is the named case: the standard payload is accepted, the deltas have historically been non-standard in some versions, and teams end up maintaining version-specific parsers [14].
Arity is the second divergence. Some providers emit only one tool call at a time rather than several in a single assistant turn [8]. An orchestrator written to fan out three calls from one turn and join the results does not fail loudly against such a provider. It serializes. Every tool call is another round trip in the loop [12], so that regression shows up in wall clock and nowhere else.
Now the table, which is a claim about someone else's workload. 70.1 against 67.8 is a 2.3-point margin, 3.4 percent relative [18]. For that to transfer, your tool schemas, your parallel-call pattern and your error-recovery paths have to resemble the harness: identical schemas and prompts across all ten variants, mock downstream services, GPT-5.5 as baseline, and recovery cases limited to malformed JSON, downstream exceptions and empty results [2]. This is one harness, self-reported in a dev.to comparison [3]. A 3.4 percent gap is the size that prompt wording and retry policy move on their own.
The Alibaba demonstration will get quoted more than it deserves. Qwen3.7-Max ran a single task unattended for 35 hours with 1,158 cumulative tool calls [17]. That is one call every 109 seconds [19]. The source presents it as evidence of context retention across long agent loops [17], which is the honest reading of it, and it is not a throughput result.
The cost side is the thinnest part of the report. Teams that budget for per-model adapters are said to reach tool-use accuracy at or above GPT-5.5 levels at a fraction of the cost [16], with no price published to check that against. What is specified is the work. MCP adapter quality varies enough between providers that you test each implementation [15]. MiniMax M3 introduces custom extension fields that require additional parsing before production [10]. DeepSeek, GLM and Qwen hand you the easy half, accepting OpenAI-format functions and tools schemas including tool_choice and multi-turn tool-result messages [7].
In my context that makes the base-URL swap worth an afternoon as a spike and worth nothing as a plan. It is the cheapest line in the diff, and the only one that works first try. The six dimensions the report actually scores, protocol compatibility through total integration effort [2], are the project.
What to watch
- A BenchLM refresh after 21 August 2026, or a GPT-5.5 point release, either of which reorders a 2.3-point table.
- Whether MiniMax documents its extension fields as a stable spec instead of a surface you parse at your own risk.
- Whether any router starts advertising semantic normalization of streaming tool-call deltas rather than transport only.
Clarity's read
What the record supports and how the coverage leans. The claims behind it follow.
Reality
- Evidence36
- Adoption47
- Hype gap+14
- Incentives
- Insufficient
- Confidence43
Claim ledger
Ranked by verification strength, evidence, and original report placement.
- [1]
Qwen3.7-Max scores 68.8 on the same suite but is only available through Alibaba Cloud Model Studio in mainland China.
- [2]
All 10 variants were exercised with a unified harness using identical tool schemas, prompts and downstream mock services, with GPT-5.5 as the compatibility baseline, across six dimensions: API protocol compatibility, JSON payload schema fidelity, parallel tool-call support, streaming tool-call parsing, error recovery behavior (malformed JSON, downstream exceptions, empty results) and total integration effort.
- [3]
The comparison was published on dev.to as a single systematic comparison drawing on DeepSeek API docs, Zhipu GLM API docs, Moonshot API docs, Alibaba Cloud Model Studio and Turing Post's Chinese LLMs in 2026 roundup.
- [4]
As of August 2026, all five major Chinese LLM families (DeepSeek, GLM, Qwen, Kimi, MiniMax), covering 10 production variants, expose OpenAI-style tool-calling endpoints, and every variant tested supported an OpenAI-compatible /chat/completions endpoint.
- [5]
A bare API base URL swap will often give a valid response, but migrating an existing GPT-based agent requires per-model parsing and orchestration review, not a one-line config change.
- [6]
Router layers OpenRouter, Requesty and Eden AI normalize the transport protocol, not the semantics of tool-call payloads, and will not fix schema or streaming incompatibilities.
- [7]
At the protocol level, DeepSeek, GLM and Qwen all accept OpenAI-format functions and tools schemas, including tool_choice and multi-turn tool-result messages.
- [8]
Parallel tool-call support diverges: some providers only emit one tool call at a time rather than multiple calls in a single assistant turn.
- [9]
Streaming tool-call handling diverges between sending incremental token deltas for tool calls and sending a whole JSON object per chunk, which the report says has a huge impact on the parser.
- [10]
MiniMax M3 is OpenAI-compatible for basic calls but introduces custom extension fields that require additional parsing, and the report advises reading the MiniMax API reference before production.
- [11]
Kimi K2's open weights and tool-calling-oriented architecture make it the most flexible self-hosted option (servable with vLLM, SGLang, KTransformers or TensorRT-LLM), with a benchmark gap of roughly 10 points versus GLM-5.1 and MiniMax M3 to weigh against data-control requirements.
- [12]
In an agent loop every tool call adds a round trip, so latency and throughput are not optional metrics.
- [13]
On the consolidated BenchLM tool-use suite updated 21 August 2026, GLM-5.1 and MiniMax M3 both score 70.1, ahead of GPT-5.5's 67.8.
- [14]
Kimi K2.6 scores 60.5 on the BenchLM tool-use suite and has historically produced non-standard streaming tool-call deltas in some versions, leading teams to build version-specific parsers.
- [15]
MCP server integration adapter quality varies significantly between providers, and the report advises testing each provider's implementation if MCP is the tool layer.
- [16]
Teams that budget for per-model adapters can hit tool-use accuracy at or above GPT-5.5 levels at a fraction of the cost, according to the report, which publishes no per-token prices.
- [17]
Alibaba's internal demonstration of Qwen3.7-Max showed a single task running unattended for 35 hours with 1,158 cumulative tool calls, which the report presents as evidence of context retention across long agent loops.
- [18]
The GLM-5.1 and MiniMax M3 lead over GPT-5.5 is 2.3 points, or about 3.4 percent relative to the GPT-5.5 baseline.
- [19]
The Qwen3.7-Max demonstration averages about one tool call every 109 seconds.
- [20]
Kimi K2.6 trails the two BenchLM leaders by 9.6 points on the tool-use suite.
Sources
1 independent publisher whose own reporting we read for this story.
- dev.toChinese LLM Tool Calling Compatibility: A Systematic Comparison (as of Aug 2026)
1 article · August 28, 2026
Topics and entities
Follow any of these and your For You feed starts watching them — no settings page required.
Topics
Entities
- KTransformersFollow
- TensorRT-LLMFollow
- Turing PostFollow
- DeployBaseFollow
- DeepSeekFollow
- Zhipu AIFollow
- GLM-5.1Follow
- Qwen3.7-MaxFollow
- Alibaba Cloud Model StudioFollow
- Moonshot AIFollow
- Kimi-K2Follow
- MiniMax M3Follow
- GPT-5.5Follow
- OpenAIFollow
- BenchLMFollow
- OpenRouterFollow
- RequestyFollow
- Eden AIFollow
- Model Context ProtocolFollow
- vLLMFollow
- SGLangFollow