← ChoreCode leaderboard · 20260706T163525Z
glm-5.2
glm-5.2:cloud
Stats
release-0.1.1| Model | glm-5.2:cloud |
| Accepted | 26/69 (38%) |
| Hard fail rate | 0% |
| $ / accepted chore | $0.0025 |
| $ / attempt | $0.0009 |
| Tokens / accepted chore | 1802 |
| Tokens in / out (total) | 15.4k / 31.4k |
| Mean latency | 5.9 s |
Cost is recorded input/output tokens multiplied by current OpenRouter pricing for the same model or weights.
Results by task
17 tasks| Task | Accepted | Hard fails | Failure reasons seen |
|---|---|---|---|
| bare-except-chore | 4/5 | 0 | patch_apply_failed |
| basic-function-off-by-one | 0/5 | 0 | patch_apply_failed |
| config-noop-chore | 5/5 | 0 | — |
| debug-cruft-chore | 2/5 | 0 | patch_apply_failed |
| dependency-conflict-chore | 0/3 | 0 | existing_tests_failed, hidden_tests_failed, smoke_failed, patch_apply_failed |
| dependency-existing-retry-chore | 0/3 | 0 | existing_tests_failed, hidden_tests_failed, smoke_failed, patch_apply_failed |
| dependency-stdlib-query-chore | 0/3 | 0 | patch_apply_failed |
| docstring-chore | 0/5 | 0 | patch_apply_failed |
| error-message-chore | 4/5 | 0 | patch_apply_failed |
| generated-cli-help-chore | 2/3 | 0 | patch_apply_failed |
| generated-client-field-chore | 2/3 | 0 | patch_apply_failed |
| nextflow-orchestration-chore | 0/3 | 0 | patch_apply_failed |
| project-manager-chore | 0/5 | 0 | patch_apply_failed |
| pyproject-edit-chore | 0/3 | 0 | patch_apply_failed |
| tiny-python-type-chore | 1/5 | 0 | patch_apply_failed |
| type-annotation-chore | 3/5 | 0 | patch_apply_failed |
| version-hallucination-chore | 3/3 | 0 | — |
Attempts
expand a row for the patch and logsbare-except-chore · rep 0 · accepted · 196→533 tok · $0.0010
no patch produced
bare-except-chore · rep 0 · accepted · 196→240 tok · $0.0005
no patch produced
bare-except-chore · rep 1 · patch_apply_failed · 196→162 tok · $0.00039
no patch produced
bare-except-chore · rep 1 · accepted · 196→760 tok · $0.0014
no patch produced
bare-except-chore · rep 2 · accepted · 196→986 tok · $0.0018
no patch produced
basic-function-off-by-one · rep 0 · patch_apply_failed · 186→131 tok · $0.00033
no patch produced
basic-function-off-by-one · rep 0 · patch_apply_failed · 186→131 tok · $0.00033
no patch produced
basic-function-off-by-one · rep 1 · patch_apply_failed · 186→123 tok · $0.00032
no patch produced
basic-function-off-by-one · rep 1 · patch_apply_failed · 186→131 tok · $0.00033
no patch produced
basic-function-off-by-one · rep 2 · patch_apply_failed · 186→154 tok · $0.00038
no patch produced
config-noop-chore · rep 0 · accepted · 190→232 tok · $0.0005
no patch produced
config-noop-chore · rep 0 · accepted · 190→198 tok · $0.00045
no patch produced
config-noop-chore · rep 1 · accepted · 190→126 tok · $0.00033
no patch produced
config-noop-chore · rep 1 · accepted · 190→169 tok · $0.00040
no patch produced
config-noop-chore · rep 2 · accepted · 190→165 tok · $0.00040
no patch produced
debug-cruft-chore · rep 0 · patch_apply_failed · 190→102 tok · $0.00029
no patch produced
debug-cruft-chore · rep 0 · patch_apply_failed · 190→137 tok · $0.00035
no patch produced
debug-cruft-chore · rep 1 · accepted · 190→722 tok · $0.0014
no patch produced
debug-cruft-chore · rep 1 · patch_apply_failed · 190→102 tok · $0.00029
no patch produced
debug-cruft-chore · rep 2 · accepted · 190→111 tok · $0.00030
no patch produced
dependency-conflict-chore · rep 0 · existing_tests_failed, hidden_tests_failed, smoke_failed · 267→383 tok · $0.0008
no patch produced
dependency-conflict-chore · rep 1 · patch_apply_failed · 267→461 tok · $0.0010
no patch produced
dependency-conflict-chore · rep 2 · patch_apply_failed · 267→308 tok · $0.0007
no patch produced
dependency-existing-retry-chore · rep 0 · existing_tests_failed, hidden_tests_failed, smoke_failed · 282→564 tok · $0.0012
no patch produced
dependency-existing-retry-chore · rep 1 · existing_tests_failed, hidden_tests_failed, smoke_failed · 282→528 tok · $0.0011
no patch produced
dependency-existing-retry-chore · rep 2 · patch_apply_failed · 282→683 tok · $0.0014
no patch produced
dependency-stdlib-query-chore · rep 0 · patch_apply_failed · 278→551 tok · $0.0011
no patch produced
dependency-stdlib-query-chore · rep 1 · patch_apply_failed · 278→2473 tok · $0.0045
no patch produced
dependency-stdlib-query-chore · rep 2 · patch_apply_failed · 278→906 tok · $0.0018
no patch produced
docstring-chore · rep 0 · patch_apply_failed · 152→540 tok · $0.0010
no patch produced
docstring-chore · rep 0 · patch_apply_failed · 152→160 tok · $0.00037
no patch produced
docstring-chore · rep 1 · patch_apply_failed · 152→122 tok · $0.00030
no patch produced
docstring-chore · rep 1 · patch_apply_failed · 152→127 tok · $0.00031
no patch produced
docstring-chore · rep 2 · patch_apply_failed · 152→150 tok · $0.00035
no patch produced
error-message-chore · rep 0 · accepted · 230→355 tok · $0.0008
no patch produced
error-message-chore · rep 0 · patch_apply_failed · 230→368 tok · $0.0008
no patch produced
error-message-chore · rep 1 · accepted · 230→1479 tok · $0.0027
no patch produced
error-message-chore · rep 1 · accepted · 230→335 tok · $0.0007
no patch produced
error-message-chore · rep 2 · accepted · 230→286 tok · $0.0006
no patch produced
generated-cli-help-chore · rep 0 · patch_apply_failed · 191→192 tok · $0.00044
no patch produced
generated-cli-help-chore · rep 1 · accepted · 191→206 tok · $0.00047
no patch produced
generated-cli-help-chore · rep 2 · accepted · 191→265 tok · $0.0006
no patch produced
generated-client-field-chore · rep 0 · patch_apply_failed · 235→296 tok · $0.0007
no patch produced
generated-client-field-chore · rep 1 · accepted · 235→167 tok · $0.00043
no patch produced
generated-client-field-chore · rep 2 · accepted · 235→237 tok · $0.0005
no patch produced
nextflow-orchestration-chore · rep 0 · patch_apply_failed · 434→626 tok · $0.0013
no patch produced
nextflow-orchestration-chore · rep 1 · patch_apply_failed · 434→980 tok · $0.0020
no patch produced
nextflow-orchestration-chore · rep 2 · patch_apply_failed · 434→924 tok · $0.0019
no patch produced
project-manager-chore · rep 0 · patch_apply_failed · 271→513 tok · $0.0011
no patch produced
project-manager-chore · rep 0 · patch_apply_failed · 271→369 tok · $0.0008
no patch produced
project-manager-chore · rep 1 · patch_apply_failed · 271→245 tok · $0.0006
no patch produced
project-manager-chore · rep 1 · patch_apply_failed · 271→575 tok · $0.0012
no patch produced
project-manager-chore · rep 2 · patch_apply_failed · 271→218 tok · $0.0005
no patch produced
pyproject-edit-chore · rep 0 · patch_apply_failed · 232→78 tok · $0.00027
no patch produced
pyproject-edit-chore · rep 1 · patch_apply_failed · 232→78 tok · $0.00027
no patch produced
pyproject-edit-chore · rep 2 · patch_apply_failed · 232→78 tok · $0.00027
no patch produced
tiny-python-type-chore · rep 0 · accepted · 222→308 tok · $0.0007
no patch produced
tiny-python-type-chore · rep 0 · patch_apply_failed · 166→189 tok · $0.00043
no patch produced
tiny-python-type-chore · rep 1 · patch_apply_failed · 222→6446 tok · $0.0115
no patch produced
tiny-python-type-chore · rep 1 · patch_apply_failed · 166→544 tok · $0.0011
no patch produced
tiny-python-type-chore · rep 2 · patch_apply_failed · 222→479 tok · $0.0010
no patch produced
type-annotation-chore · rep 0 · accepted · 183→139 tok · $0.00035
no patch produced
type-annotation-chore · rep 0 · patch_apply_failed · 183→142 tok · $0.00035
no patch produced
type-annotation-chore · rep 1 · accepted · 183→139 tok · $0.00035
no patch produced
type-annotation-chore · rep 1 · patch_apply_failed · 183→150 tok · $0.00037
no patch produced
type-annotation-chore · rep 2 · accepted · 183→186 tok · $0.00043
no patch produced
version-hallucination-chore · rep 0 · accepted · 222→190 tok · $0.00046
no patch produced
version-hallucination-chore · rep 1 · accepted · 222→157 tok · $0.00040
no patch produced
version-hallucination-chore · rep 2 · accepted · 222→132 tok · $0.00036
no patch produced