BuildNot yet confirmed elsewhere1 publisher3 min readPublished
Nvidia's 88-core Vera bets agentic serving runs out of bandwidth before it runs out of cores
One SKU, one compute die, 1.2 TB/s of LPDDR5X, and benchmark wins over a 96-core EPYC. The comparison with AMD's Venice is being set on Nvidia's terms rather than on core counts.
The Engineer · Build desk

What happened
- At Hot Chips 2026 Nvidia added detail on Vera's spatial multithreading, its memory subsystem and the workloads it is aimed at.
- Vera ships as one 88-core SKU on a monolithic compute die, with an LPDDR5X subsystem reported at 1.2 TB/s over SOCAMM2.
- A SPEC CPU 2017 intrate chart shows Vera losing less performance to a second active thread than an unnamed traditional CPU.
Why it matters
- constraint With one SKU, the usual lever of matching core count to per-core software licensing or to a workload's thread profile is gone; buyers take 88 cores or buy elsewhere.
- capability If per-core loss under a second thread is predictable, schedulers can commit to tail-latency budgets on shared cores instead of overprovisioning to hide the worst case.
- decision Sizing arguments move to bandwidth per core, which changes what a fleet architect has to measure before signing off on a chiplet x86 alternative.
- exposure Procurement is being asked to price a part on proxy benchmarks that Nvidia itself concedes do not represent a full agentic chain, which puts the risk of the mismatch on the buyer.
Bandwidth per core is the number the slides leave for the reader to work out. Divide 1.2 TB/s by 88 cores and each core sits behind roughly 13.6 GB/s of memory bandwidth [16]. That figure, not the core count, is what a monolithic compute die and an LPDDR5X subsystem are built to protect [7][8].
The workloads Nvidia chose to publish reward cores. Kernel compilation and parallel headless browser instances both scale out, and Nvidia is running them against a part with eight more cores than Vera has [9][10][15]. Normalise the claims per core and the gap widens: 22 percent faster on a native AArch64 kernel build at 88 cores against 96 is about 33 percent more throughput per core, and the 24 percent browser-scaling win is about 35 percent [17][18]. Those are per-core and per-byte numbers dressed as socket numbers.
The cross-compile result is the one operators should read twice. Vera's advantage drops from 22 percent on a native AArch64 target to 14 percent when the target is x86 [10], which means roughly 7 percent of the win goes back to the toolchain when the fleet still builds x86 artefacts [19]. Agentic build chains that emit binaries for x86 hosts pay that back on every job.
Spatial multithreading is aimed at variance rather than peak. Nvidia splits core resources across two pipelines while still allowing data and cache to move between threads [3], and the SPEC CPU 2017 intrate demonstration measures a core alone, then with a second thread live [20]. Traditional SMT time-slices the resources and leaves gaps at branch prediction and decode; Nvidia's version still has threads contending, but degrades in a predictable way [4]. For a serving fleet, predictable degradation is worth more than a higher single-thread ceiling, because tail latency is what you have to provision against.
Which makes the missing comparator awkward. Nvidia did not say which "traditional CPU" the noisy-neighbour chart is measured against [20], so the single result supporting the architecture's most distinctive feature cannot be checked by anyone else. The 4.5x figure attached to the browser workflow deserves the same discipline: it comes from stripping GUI rendering, fonts and media decoding out of the browsing path [11], which is a property of the workload rather than of the silicon, and any CPU running the same trimmed path inherits it.
On Venice, the disclosed numbers do not exist. Tom's Hardware points to earlier coverage of how Vera stacks up against AMD's next-generation parts, but the comparisons Nvidia brought to Hot Chips 2026 are against the shipping 96-core EPYC 9655P [15]. So the like-for-like argument is being fought on ground Nvidia picked: one SKU [7], one compute die instead of compute chiplets [8], memory bandwidth, and consistency under load. Nvidia's own framing concedes the weakness in that ground, since it acknowledges agentic AI has no settled benchmark and that tasks such as compilation are proxies for chains that are long and inconsistent to measure [1][2]. A buyer comparing sockets in 2026 will be comparing a fixed 88-core part against a family, using benchmarks that stand in for the workload rather than being it.
What to watch
- Whether Nvidia names the "traditional CPU" in the SPEC CPU 2017 intrate noisy-neighbour comparison, or publishes numbers others can reproduce.
- Any head-to-head Vera versus AMD Venice figures on the same kernel compile and headless browser tests.
- Further Scalable Coherency Fabric detail, since the second-generation SCF was raised at Hot Chips without new disclosures.
Clarity's read
What the record supports and how the coverage leans. The claims behind it follow.
Reality
- Evidence38
- Adoption12
- Hype gap+33
- Incentives78
- Confidence44
Claim ledger
Ranked by verification strength, evidence, and original report placement.
- [1]
Nvidia says Vera is designed specifically for agentic AI workloads, a category still being defined in terms of performance benchmarking.
- [2]
Many CPU-intensive tasks such as code compilation serve as proxies for agentic workloads, but measuring performance across a full agentic chain is complex and inconsistent.
- [3]
Spatial multithreading separates core resources across two pipelines, though data and cache can move between threads as needed.
- [4]
With traditional SMT, resources are time-sliced between threads, leaving gaps between branch prediction and decode; Nvidia's spatial multithreading still has threads competing for in-core resources but handles neighbouring demand deterministically, giving a more consistent per-core downturn.
- [5]
Nvidia continued its Vera CPU disclosures at Hot Chips 2026, adding detail on spatial multithreading, the memory subsystem, and the workloads it is targeting.
- [6]
Vera is the first CPU with a custom Nvidia core, following Grace, which used a stock Arm design.
- [8]
Vera's key design differences against Nvidia's x86 competition are spatial multithreading, an LPDDR5X memory subsystem, and a monolithic compute die rather than compute chiplets.
- [9]
Nvidia says Vera runs 24% faster than the 96-core EPYC 9655P as headless browser instances scale.
- [10]
Nvidia claims Vera compiles the Linux kernel 22% faster than the 96-core EPYC 9655P with a native AArch64 target, and 14% faster when cross-compiling for x86.
- [11]
In Nvidia's example, agents can run through a browsing workflow 4.5x faster by cutting work such as GUI rendering, fonts and media decoding.
- [12]
Nvidia's Vera memory subsystem is reported as LPDDR5X delivering 1.2 TB/s via SOCAMM2.
- [13]
Nvidia's own slides call agentic AI the 'most complex computing workload in history'.
- [14]
Nvidia reiterated that the Olympus core in Vera is a wide design optimised for high single-core throughput, with a large branch prediction unit, a neural branch predictor and 10-wide decode.
- [15]
Tom's Hardware refers to earlier coverage of how Vera compares with AMD's next-generation Venice CPUs, while the Hot Chips 2026 performance comparisons it reports use the 96-core EPYC 9655P as the x86 comparator.
- [16]
1.2 TB/s of memory bandwidth spread across 88 cores is about 13.6 GB/s per core.
- [17]
A 22% socket-level lead on native AArch64 kernel compilation, achieved with 88 cores against 96, implies about 33% more throughput per core.
- [18]
A 24% socket-level lead on scaling headless browser instances, achieved with 88 cores against 96, implies about 35% more throughput per core.
- [19]
Moving from a native AArch64 kernel build to an x86 cross-compile gives back about 7% of Vera's claimed throughput advantage.
- [20]
Nvidia demonstrated the noisy-neighbour effect with SPEC CPU 2017 intrate, measuring single-core performance and then the same workload with a second thread active; it says Vera is less affected than a 'traditional CPU' but did not clarify which CPU it compared against.
Sources
1 independent publisher whose own reporting we read for this story.
Topics and entities
Follow any of these and your For You feed starts watching them — no settings page required.
Topics
- CPU MicroarchitectureFollow
- Vendor-reported benchmarksFollow
- Agentic AI InfrastructureFollow
- Arm vs x86 Server CPUsFollow
- Data Center Memory BandwidthFollow
- Power-Limited Data CentersFollow