Skip to content

project

agentevals

An evaluation tool that scores AI agent trajectories given as OpenAI-format chat messages. It offers subset, superset, unordered and strict trajectory match modes.

Current clusters

build1 publisher

Regression-testing kagent agents in agentevals means ignoring ADK's role field

kagent-agentevals keeps 8 of 14 ADK events from a real kagent session when it builds an agentevals trajectory for regression tests. Its author found the role field crediting some agent tool calls to the user, so the converter reads part types and drops runtime adk_ tools.

Publishers:dev.to

Reality

Evidence45
Adoption
Insufficient
Hype gap0
Incentives40
Confidence45