Few shot triplet

Three worked examples covering the flat, nested, and missing field cases. Costs more tokens than any other entry in this suite.

Prompt

// system Extract JSON from the input. Follow the pattern of these examples exactly. // user Examples: {{examples}} Now extract from: {{document}}

Model versionVersionScore · CIHoldoutState

deepseek-v4-flash-0731v183.3 60.8–94.283.3fresh

nemotron-3-super-120b-a12bv183.3 60.8–94.283.3fresh

deepseek-v4-flash-0731v183.3 60.8–94.283.3superseded

Current scorev1

83.3

95% CI 60.8 to 94.2 · n=18

Holdout score83.3

Judgeprogrammatic

Cost per run$0.000

Median latency6.8s

LicenseCC-BY-4.0

Author@nils