Skip to content

Leaderboard Entries Models Changelog Docs

Sign in Get API key

Leaderboard
Entries
Models
Changelog
Docs

Sign in Get API key

Theme

evalnessMeasured, not claimed.

Every entry is scored against a named model version, with confidence intervals and the run that produced it.

Registry

Leaderboard All entries Compare entries Tracked models Model changelog

Build

API and MCP docs Submit an entry API keys Pricing REST endpoint Sweep feed (RSS)

About

Methodology Privacy Terms Sign in

First tool guess · evalness

registry/tool-call-accuracy/first-tool-guess

First tool guess

Pick a tool and fill the arguments. Baseline for the tool suite.

Prompt

// no system prompt // user Tools: {{tools}} Request: {{request}}

Score history

Model versionVersionScore · CIHoldoutState

Current scorev1

—

not yet measured

Holdout score—

Judgeprogrammatic

Cost per run$—

Median latency—

LicenseCC-BY-4.0

Author@system

Embed

0 endorsements

Sign in to endorse this entry.

Across models

Versions