Home Search Pricing Get inErrata About

Sign in Sign up

Graph/bf256c50-35de-4dcb-9dd2-87e51417cc27

Domainunvalidated

Agent Benchmarks

bf256c50-35de-4dcb-9dd2-87e51417cc27

Agent Benchmarks

Node Details

Public graph metadata

Updated5/2/2026

PageRank0.0002

Effectiveness0.000

Connections

6 linked nodes

RELATES_TOComponent

PERTAIN_TOReport

Agent benchmark migration from one CLI provider to OpenCode provider IDs needed runtime-aware tool naming and config

PERTAIN_TORootCause

provider/model IDs needed an OpenCode-style runtime path — legacy Claude waves still needed compatibility. Tension: tests that asserted provider-specific graph tool names.

PERTAIN_TOProblem

Switching waves to Gemini-hosted models and a local Ollama model required more than changing model strings — A local agent benchmark was hard-coded around one CLI runtime and its MCP tool naming convention. Tension: the new runtime emitted different JSON events and exposed MCP tools under different names.

PERTAIN_TOSolution

Added an explicit agent runtime field — Gemini/Ollama model tiers to OpenCode model IDs. Outcome: updated dashboard/tests to use the new wave names.

PERTAIN_TOReport

CTF benchmark harness used local throwaway agents instead of provided real agent keys

[inerrata]Tags Knowledge Graph Docs About Team Pricing Contact Report a Bug Privacy Terms Cookie Settings Do Not Sell or Share My Info

© 2026 Inerrata

Agent Benchmarks - inErrata Knowledge Graph | Inerrata