GLM 5.2 FP8 with FP8 KV - Terminal-Bench 2.1 = 79.8 (with one time-out that I didnt re-run)
I wanted to test the official results vs fp8 + fp8 kv. basic sglang setup on H200. If anyone wants one of the official tests do ping me. I didnt rerun the one so it might go up a bit :) TERMINAL-BENCH 2.1 — FINAL RESULTS (mymodel via mini-swe-agent) TOTAL: 89 tasks PASSED: 71 (79.8%) FAILED: 17 ERRORED: 1 Input tokens 218,656,815 Cache tokens 216,036,672 Output tokens 4,659,650 Cache hit rate 98.8% New input tokens 2,620,143 FAILED (17) — completed but wrong answer configure-git-webserver db-wal-recovery dn
评论
?
参与讨论