registrysummarization-fidelitysource-span-cite

Source span citation

Every summary sentence must carry the source span it came from. Nearly eliminates unsupported claims at the cost of readability.

Compare

Prompt

// system Summarize the source. After each sentence, cite the character span it derives from as [start:end]. Never write a sentence you cannot cite. // user {{source}}

Score history

Model versionVersionScore · CIHoldoutState
claude-opus-4.8v290.2 83.3–94.489.6fresh
gemini-3.2-prov288.4 81.1–93.187.5fresh
gpt-5.6-solv292.0 85.4–95.791.7fresh
mistral-large-3v283.9 76.0–89.683.3fresh
claude-fable-5v293.8 87.7–96.993.8fresh
llama-4.2-405bv279.5 71.1–85.979.2fresh
claude-fable-4v186.6 79.1–91.785.4superseded
current scorev2
90.2
95% CI 83.3 to 94.4 · n=112
Holdout score89.6
Judgemodel
Cost per run$1.294
Median latency2.0s
LicenseCC-BY-4.0
Author@marek
0 endorsements

Sign in to endorse this entry.

Across models

claude-opus-4.890.2fresh
gemini-3.2-pro88.4fresh
gpt-5.6-sol92.0fresh
mistral-large-383.9fresh
claude-fable-593.8fresh
llama-4.2-405b79.5fresh

Versions

v2Required spans on every sentence90.2
v1First submission86.6