registrystructured-json-extractionclaude-fable-5

Structured JSON extraction

Pull a typed object out of unstructured text without commentary, fences, or schema drift. Scored on exact match against the target schema.

CompareSubmit entry
Multi step reasoningRefusal adherenceStructured JSON extractionSummarization fidelityTool call accuracy
model minimax-m3model nemotron-3-ultra-550b-a55bmodel nemotron-3-super-120b-a12bmodel deepseek-v4-flash-0731model claude-fable-5model gpt-5.6-solmodel gemini-3.2-promodel llama-4.2-405bmodel claude-opus-4.8model mistral-large-35 entries · 240 cases
#EntryScore · 95% CI 60–99ValueHoldoutCostState
01strict-schema-anchor@marek · v4 · n=16894.093.1$1.85fresh02role-then-format@ilya · v2 · n=16891.790.3$1.85fresh03xml-fence-guard@dara · v2 · n=16888.787.5$1.85fresh04few-shot-triplet@nils · v1 · n=16884.583.3$1.85fresh05plain-instructionbaseline · v1 · n=16870.869.4$1.39fresh

Reading this board

Order
Entries are ordered by their public score on the selected model version. The interval bar shows the 95 percent confidence range, so two entries whose bars overlap are not meaningfully apart.
Holdout
Thirty percent of every suite is withheld and never published. A large gap between the public and holdout score is the signal that an entry was tuned to the visible cases.
Freshness
An entry is fresh while its newest run targets the current version of the selected model. Anything older is marked and queued for a rerun.