Zapfino
Every model, every metric, in one table. Sort any column, filter by name. Runs that left their working directory are shown but never scored.
| model | solved | chars/17 | accuracy | best | frame | spatial | lev | L1 | L2 | L3 | blind | hinted | avg t | shell | ffmpeg | python | imgs | diffed | out tok | cost | fail | invalid |
|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|
| opus-5 | 2/4 | 8.5 | 17 | 8.5 | 8.5 | 0.5 | 17 | 0 | 0 | 11.33 | 0 | 1390s | 45.75 | 6 | 41 | 22.25 | 2 | 23,895 | $7.94 | 2 | 0 | |
| gpt-5.6/high | 2/5 | 8.4 | 17 | 2 | 2 | 0.66 | 10.5 | 0 | — | 8.5 | 8 | 2325s | 67.4 | 20.2 | 8.8 | 0 | 3 | 72,505 | — | 0 | 0 | |
| gpt-5.6/med | 1/5 | 4.4 | 17 | 1 | 1 | 0.35 | 6.67 | 1 | 1 | 1.33 | 9 | 1476s | 57 | 21 | 16.4 | 0 | 5 | 46,878 | — | 0 | 0 | |
| fable-5 | 0/2 | 0 | 0 | 0 | 0 | 0 | 0 | — | 0 | 0 | 0 | 1352s | 33.5 | 9 | 28.5 | 31.5 | 1 | 21,269 | $8.34 | 2 | 0 |
| model | blind chars | hinted chars | Δ | blind solved | hinted solved |
|---|---|---|---|---|---|
| opus-5 | 11.33 | 0 | -11.3 | 2/3 | 0/1 |
| gpt-5.6/high | 8.5 | 8 | -0.5 | 2/4 | 0/1 |
| gpt-5.6/med | 1.33 | 9 | +7.7 | 0/3 | 1/2 |
| fable-5 | 0 | 0 | 0 | 0/1 | 0/1 |