lab

Simbian Research

Research group that publishes the Cyber Defense Benchmark, a test of AI model performance on security operations tasks such as threat hunting over raw logs.

Current clusters

build1 publisher

CrowdStrike's 98% and Simbian's 3.8% are measuring different SOC jobs

Microsoft and Omdia put the average security operations centre at close to 3,000 alerts a day with 42% never investigated, while a 2026 benchmark scored the best frontier model at 3.8% on finding malicious events in raw Windows logs.

Publishers:dev.to

Reality

Evidence38
Adoption45
Hype gap+30
Incentives80
Confidence40