Zapfino
Every model, every metric, in one table. Sort any column, filter by name. Runs that left their working directory are shown but never scored.
| model | solved | chars/17 | accuracy | best | frame | spatial | lev | L1 | L2 | L3 | blind | hinted | avg t | shell | ffmpeg | python | imgs | diffed | out tok | cost | fail | invalid |
|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|
| gpt-5.6/high | 2/18 | 2.33 | 17 | 0.56 | 0.56 | 0.18 | 7 | 0 | 0 | 3.78 | 0.89 | 1946s | 46.56 | 10.83 | 21.17 | 0 | 11 | 20,140 | — | 13 | 0 | |
| opus-5 | 2/18 | 1.89 | 17 | 1.89 | 1.89 | 0.11 | 5.67 | 0 | 0 | 3.78 | 0 | 1709s | 47.78 | 11.33 | 44.22 | 24.94 | 6 | 5,310 | $7.94 | 16 | 0 | |
| gpt-5.6/med | 1/18 | 1.67 | 17 | 0.39 | 0.28 | 0.17 | 4.67 | 0.17 | 0.17 | 0.44 | 2.89 | 1549s | 39.83 | 11.06 | 19.89 | 0 | 11 | 18,559 | — | 9 | 0 | |
| fable-5 | 0/6 | 0 | 0 | 0 | 0 | 0 | 0 | 0 | 0 | 0 | 0 | 1651s | 37 | 7 | 34 | 37.83 | 4 | 7,090 | $8.34 | 6 | 0 |
| model | blind chars | hinted chars | Δ | blind solved | hinted solved |
|---|---|---|---|---|---|
| gpt-5.6/high | 3.78 | 0.89 | -2.9 | 2/9 | 0/9 |
| opus-5 | 3.78 | 0 | -3.8 | 2/9 | 0/9 |
| gpt-5.6/med | 0.44 | 2.89 | +2.5 | 0/9 | 1/9 |
| fable-5 | 0 | 0 | 0 | 0/3 | 0/3 |