The big win here is cost of cached tokens, which is half of GPT 6 Sol:
| RANK | MODEL | EFFORT | TASK | RESULT | TIME | TOKENS | API EQ |
|---|---|---|---|---|---|---|---|
| #1 | GPT-6.1-Sol | HIGH | DIGBENCH P-1 | WIN | 15m04s | 6.3M | ~$1.1536 |
| #1 | GPT-6.1-Sol | HIGH | DIGBENCH P-2 | WIN | 28m32s | 9.1M | ~$1.6296 |
| #2 | GPT-6-Sol | HIGH | DIGBENCH P-1 | WIN | 17m43s | 4.1M | ~$1.3431 |
| #2 | GPT-6-Sol | HIGH | DIGBENCH P-2 | WIN | 30m13s | 10.2M | ~$2.8227 |
Figures from the latest release of Codexometer: track your quota, usage, orchestrate sessions & benchmark models! - you can run these benchmarks for yourself …