← ChoreCode leaderboard · 20260706T163525Z
minimax-m2.7
minimax-m2.7:cloud
Stats
release-0.1.1| Model | minimax-m2.7:cloud |
| Accepted | 12/69 (17%) |
| Hard fail rate | 3% |
| $ / accepted chore | $0.0044 |
| $ / attempt | $0.0008 |
| Tokens / accepted chore | 6925 |
| Tokens in / out (total) | 12.7k / 70.4k |
| Mean latency | 19.9 s |
Cost is recorded input/output tokens multiplied by current OpenRouter pricing for the same model or weights.
Results by task
17 tasks| Task | Accepted | Hard fails | Failure reasons seen |
|---|---|---|---|
| bare-except-chore | 0/5 | 0 | patch_apply_failed |
| basic-function-off-by-one | 0/5 | 0 | patch_apply_failed |
| config-noop-chore | 3/5 | 2 | hidden_tests_failed, unused_import_added |
| debug-cruft-chore | 1/5 | 0 | patch_apply_failed, hidden_tests_failed |
| dependency-conflict-chore | 0/3 | 0 | patch_apply_failed |
| dependency-existing-retry-chore | 0/3 | 0 | patch_apply_failed, existing_tests_failed, hidden_tests_failed, smoke_failed |
| dependency-stdlib-query-chore | 0/3 | 0 | patch_apply_failed |
| docstring-chore | 0/5 | 0 | patch_apply_failed, existing_tests_failed, hidden_tests_failed |
| error-message-chore | 3/5 | 0 | patch_apply_failed |
| generated-cli-help-chore | 2/3 | 0 | patch_apply_failed |
| generated-client-field-chore | 0/3 | 0 | patch_apply_failed |
| nextflow-orchestration-chore | 0/3 | 0 | patch_apply_failed |
| project-manager-chore | 0/5 | 0 | patch_apply_failed |
| pyproject-edit-chore | 0/3 | 0 | patch_apply_failed |
| tiny-python-type-chore | 2/5 | 0 | hidden_tests_failed, patch_apply_failed |
| type-annotation-chore | 1/5 | 0 | patch_apply_failed |
| version-hallucination-chore | 0/3 | 0 | patch_apply_failed |
Attempts
expand a row for the patch and logsbare-except-chore · rep 0 · patch_apply_failed · 0→603 tok · $0.00043
no patch produced
bare-except-chore · rep 0 · patch_apply_failed · 0→608 tok · $0.00044
no patch produced
bare-except-chore · rep 1 · patch_apply_failed · 0→366 tok · $0.00026
no patch produced
bare-except-chore · rep 1 · patch_apply_failed · 199→348 tok · $0.00029
no patch produced
bare-except-chore · rep 2 · patch_apply_failed · 0→367 tok · $0.00026
no patch produced
basic-function-off-by-one · rep 0 · patch_apply_failed · 187→320 tok · $0.00026
no patch produced
basic-function-off-by-one · rep 0 · patch_apply_failed · 187→325 tok · $0.00027
no patch produced
basic-function-off-by-one · rep 1 · patch_apply_failed · 187→333 tok · $0.00027
no patch produced
basic-function-off-by-one · rep 1 · patch_apply_failed · 187→314 tok · $0.00026
no patch produced
basic-function-off-by-one · rep 2 · patch_apply_failed · 187→550 tok · $0.00043
no patch produced
config-noop-chore · rep 0 · accepted · 187→407 tok · $0.00033
no patch produced
config-noop-chore · rep 0 · hidden_tests_failed, unused_import_added · 187→622 tok · $0.00048
no patch produced
config-noop-chore · rep 1 · accepted · 187→271 tok · $0.00023
no patch produced
config-noop-chore · rep 1 · accepted · 187→208 tok · $0.00018
no patch produced
config-noop-chore · rep 2 · hidden_tests_failed, unused_import_added · 187→382 tok · $0.00031
no patch produced
debug-cruft-chore · rep 0 · patch_apply_failed · 191→320 tok · $0.00026
no patch produced
debug-cruft-chore · rep 0 · patch_apply_failed · 191→200 tok · $0.00018
no patch produced
debug-cruft-chore · rep 1 · hidden_tests_failed · 191→284 tok · $0.00024
no patch produced
debug-cruft-chore · rep 1 · patch_apply_failed · 191→675 tok · $0.0005
no patch produced
debug-cruft-chore · rep 2 · accepted · 191→338 tok · $0.00028
no patch produced
dependency-conflict-chore · rep 0 · patch_apply_failed · 266→725 tok · $0.0006
no patch produced
dependency-conflict-chore · rep 1 · patch_apply_failed · 266→324 tok · $0.00028
no patch produced
dependency-conflict-chore · rep 2 · patch_apply_failed · 266→757 tok · $0.0006
no patch produced
dependency-existing-retry-chore · rep 0 · patch_apply_failed · 281→918 tok · $0.0007
no patch produced
dependency-existing-retry-chore · rep 1 · patch_apply_failed · 281→911 tok · $0.0007
no patch produced
dependency-existing-retry-chore · rep 2 · existing_tests_failed, hidden_tests_failed, smoke_failed · 281→1444 tok · $0.0011
no patch produced
dependency-stdlib-query-chore · rep 0 · patch_apply_failed · 276→569 tok · $0.00046
no patch produced
dependency-stdlib-query-chore · rep 1 · patch_apply_failed · 276→403 tok · $0.00034
no patch produced
dependency-stdlib-query-chore · rep 2 · patch_apply_failed · 276→526 tok · $0.00043
no patch produced
docstring-chore · rep 0 · patch_apply_failed · 154→428 tok · $0.00034
no patch produced
docstring-chore · rep 0 · existing_tests_failed, hidden_tests_failed · 0→403 tok · $0.00029
no patch produced
docstring-chore · rep 1 · patch_apply_failed · 0→990 tok · $0.0007
no patch produced
docstring-chore · rep 1 · patch_apply_failed · 0→465 tok · $0.00033
no patch produced
docstring-chore · rep 2 · patch_apply_failed · 154→361 tok · $0.00029
no patch produced
error-message-chore · rep 0 · accepted · 235→200 tok · $0.00019
no patch produced
error-message-chore · rep 0 · accepted · 235→390 tok · $0.00032
no patch produced
error-message-chore · rep 1 · accepted · 235→202 tok · $0.00019
no patch produced
error-message-chore · rep 1 · patch_apply_failed · 235→758 tok · $0.0006
no patch produced
error-message-chore · rep 2 · patch_apply_failed · 235→343 tok · $0.00029
no patch produced
generated-cli-help-chore · rep 0 · patch_apply_failed · 0→334 tok · $0.00024
no patch produced
generated-cli-help-chore · rep 1 · accepted · 0→314 tok · $0.00023
no patch produced
generated-cli-help-chore · rep 2 · accepted · 191→340 tok · $0.00028
no patch produced
generated-client-field-chore · rep 0 · patch_apply_failed · 236→574 tok · $0.00046
no patch produced
generated-client-field-chore · rep 1 · patch_apply_failed · 236→678 tok · $0.0005
no patch produced
generated-client-field-chore · rep 2 · patch_apply_failed · 236→478 tok · $0.00039
no patch produced
nextflow-orchestration-chore · rep 0 · patch_apply_failed · 432→34302 tok · $0.0248
no patch produced
nextflow-orchestration-chore · rep 1 · patch_apply_failed · 432→953 tok · $0.0008
no patch produced
nextflow-orchestration-chore · rep 2 · patch_apply_failed · 432→2897 tok · $0.0022
no patch produced
project-manager-chore · rep 0 · patch_apply_failed · 269→542 tok · $0.00044
no patch produced
project-manager-chore · rep 0 · patch_apply_failed · 269→440 tok · $0.00037
no patch produced
project-manager-chore · rep 1 · patch_apply_failed · 269→1415 tok · $0.0011
no patch produced
project-manager-chore · rep 1 · patch_apply_failed · 269→727 tok · $0.0006
no patch produced
project-manager-chore · rep 2 · patch_apply_failed · 269→705 tok · $0.0006
no patch produced
pyproject-edit-chore · rep 0 · patch_apply_failed · 228→158 tok · $0.00015
no patch produced
pyproject-edit-chore · rep 1 · patch_apply_failed · 0→177 tok · $0.00013
no patch produced
pyproject-edit-chore · rep 2 · patch_apply_failed · 0→305 tok · $0.00022
no patch produced
tiny-python-type-chore · rep 0 · accepted · 170→560 tok · $0.00043
no patch produced
tiny-python-type-chore · rep 0 · accepted · 224→492 tok · $0.00039
no patch produced
tiny-python-type-chore · rep 1 · hidden_tests_failed · 170→494 tok · $0.00039
no patch produced
tiny-python-type-chore · rep 1 · patch_apply_failed · 224→624 tok · $0.00049
no patch produced
tiny-python-type-chore · rep 2 · patch_apply_failed · 224→1002 tok · $0.0008
no patch produced
type-annotation-chore · rep 0 · patch_apply_failed · 181→309 tok · $0.00026
no patch produced
type-annotation-chore · rep 0 · patch_apply_failed · 181→251 tok · $0.00021
no patch produced
type-annotation-chore · rep 1 · patch_apply_failed · 181→370 tok · $0.00030
no patch produced
type-annotation-chore · rep 1 · accepted · 0→253 tok · $0.00018
no patch produced
type-annotation-chore · rep 2 · patch_apply_failed · 0→380 tok · $0.00027
no patch produced
version-hallucination-chore · rep 0 · patch_apply_failed · 0→344 tok · $0.00025
no patch produced
version-hallucination-chore · rep 1 · patch_apply_failed · 221→709 tok · $0.0006
no patch produced
version-hallucination-chore · rep 2 · patch_apply_failed · 221→279 tok · $0.00024
no patch produced