← ChoreCode leaderboard · 20260706T163525Z
minimax-m3
minimax-m3:cloud
Stats
release-0.1.1| Model | minimax-m3:cloud |
| Accepted | 28/69 (41%) |
| Hard fail rate | 0% |
| $ / accepted chore | $0.0038 |
| $ / attempt | $0.0015 |
| Tokens / accepted chore | 3858 |
| Tokens in / out (total) | 26.2k / 81.8k |
| Mean latency | 11.8 s |
Cost is recorded input/output tokens multiplied by current OpenRouter pricing for the same model or weights.
Results by task
17 tasks| Task | Accepted | Hard fails | Failure reasons seen |
|---|---|---|---|
| bare-except-chore | 0/5 | 0 | patch_apply_failed |
| basic-function-off-by-one | 2/5 | 0 | patch_apply_failed |
| config-noop-chore | 5/5 | 0 | — |
| debug-cruft-chore | 2/5 | 0 | patch_apply_failed |
| dependency-conflict-chore | 0/3 | 0 | patch_apply_failed |
| dependency-existing-retry-chore | 0/3 | 0 | patch_apply_failed, existing_tests_failed, hidden_tests_failed, smoke_failed |
| dependency-stdlib-query-chore | 0/3 | 0 | patch_apply_failed |
| docstring-chore | 2/5 | 0 | patch_apply_failed |
| error-message-chore | 4/5 | 0 | patch_apply_failed |
| generated-cli-help-chore | 1/3 | 0 | patch_apply_failed |
| generated-client-field-chore | 3/3 | 0 | — |
| nextflow-orchestration-chore | 3/3 | 0 | — |
| project-manager-chore | 1/5 | 0 | patch_apply_failed |
| pyproject-edit-chore | 0/3 | 0 | patch_apply_failed |
| tiny-python-type-chore | 4/5 | 0 | hidden_tests_failed, smoke_failed |
| type-annotation-chore | 1/5 | 0 | patch_apply_failed |
| version-hallucination-chore | 0/3 | 0 | patch_apply_failed |
Attempts
expand a row for the patch and logsbare-except-chore · rep 0 · patch_apply_failed · 355→175 tok · $0.00032
no patch produced
bare-except-chore · rep 0 · patch_apply_failed · 355→171 tok · $0.00031
no patch produced
bare-except-chore · rep 1 · patch_apply_failed · 355→703 tok · $0.0010
no patch produced
bare-except-chore · rep 1 · patch_apply_failed · 355→352 tok · $0.0005
no patch produced
bare-except-chore · rep 2 · patch_apply_failed · 355→176 tok · $0.00032
no patch produced
basic-function-off-by-one · rep 0 · accepted · 343→219 tok · $0.00037
no patch produced
basic-function-off-by-one · rep 0 · patch_apply_failed · 343→225 tok · $0.00037
no patch produced
basic-function-off-by-one · rep 1 · patch_apply_failed · 343→230 tok · $0.00038
no patch produced
basic-function-off-by-one · rep 1 · patch_apply_failed · 343→175 tok · $0.00031
no patch produced
basic-function-off-by-one · rep 2 · accepted · 343→184 tok · $0.00032
no patch produced
config-noop-chore · rep 0 · accepted · 343→206 tok · $0.00035
no patch produced
config-noop-chore · rep 0 · accepted · 343→5451 tok · $0.0066
no patch produced
config-noop-chore · rep 1 · accepted · 343→170 tok · $0.00031
no patch produced
config-noop-chore · rep 1 · accepted · 343→190 tok · $0.00033
no patch produced
config-noop-chore · rep 2 · accepted · 343→365 tok · $0.0005
no patch produced
debug-cruft-chore · rep 0 · patch_apply_failed · 347→347 tok · $0.0005
no patch produced
debug-cruft-chore · rep 0 · patch_apply_failed · 347→135 tok · $0.00027
no patch produced
debug-cruft-chore · rep 1 · patch_apply_failed · 347→141 tok · $0.00027
no patch produced
debug-cruft-chore · rep 1 · accepted · 347→175 tok · $0.00031
no patch produced
debug-cruft-chore · rep 2 · accepted · 347→655 tok · $0.0009
no patch produced
dependency-conflict-chore · rep 0 · patch_apply_failed · 422→515 tok · $0.0007
no patch produced
dependency-conflict-chore · rep 1 · patch_apply_failed · 422→458 tok · $0.0007
no patch produced
dependency-conflict-chore · rep 2 · patch_apply_failed · 422→216 tok · $0.00039
no patch produced
dependency-existing-retry-chore · rep 0 · patch_apply_failed · 437→1582 tok · $0.0020
no patch produced
dependency-existing-retry-chore · rep 1 · existing_tests_failed, hidden_tests_failed, smoke_failed · 437→7218 tok · $0.0088
no patch produced
dependency-existing-retry-chore · rep 2 · existing_tests_failed, hidden_tests_failed, smoke_failed · 437→1139 tok · $0.0015
no patch produced
dependency-stdlib-query-chore · rep 0 · patch_apply_failed · 432→552 tok · $0.0008
no patch produced
dependency-stdlib-query-chore · rep 1 · patch_apply_failed · 432→722 tok · $0.0010
no patch produced
dependency-stdlib-query-chore · rep 2 · patch_apply_failed · 432→1817 tok · $0.0023
no patch produced
docstring-chore · rep 0 · patch_apply_failed · 310→451 tok · $0.0006
no patch produced
docstring-chore · rep 0 · accepted · 310→301 tok · $0.00045
no patch produced
docstring-chore · rep 1 · patch_apply_failed · 310→303 tok · $0.00046
no patch produced
docstring-chore · rep 1 · accepted · 310→1405 tok · $0.0018
no patch produced
docstring-chore · rep 2 · patch_apply_failed · 310→247 tok · $0.00039
no patch produced
error-message-chore · rep 0 · accepted · 391→257 tok · $0.00043
no patch produced
error-message-chore · rep 0 · accepted · 391→200 tok · $0.00036
no patch produced
error-message-chore · rep 1 · accepted · 391→212 tok · $0.00037
no patch produced
error-message-chore · rep 1 · accepted · 391→186 tok · $0.00034
no patch produced
error-message-chore · rep 2 · patch_apply_failed · 391→266 tok · $0.00044
no patch produced
generated-cli-help-chore · rep 0 · accepted · 347→277 tok · $0.00044
no patch produced
generated-cli-help-chore · rep 1 · patch_apply_failed · 347→1180 tok · $0.0015
no patch produced
generated-cli-help-chore · rep 2 · patch_apply_failed · 347→1019 tok · $0.0013
no patch produced
generated-client-field-chore · rep 0 · accepted · 392→809 tok · $0.0011
no patch produced
generated-client-field-chore · rep 1 · accepted · 392→492 tok · $0.0007
no patch produced
generated-client-field-chore · rep 2 · accepted · 392→383 tok · $0.0006
no patch produced
nextflow-orchestration-chore · rep 0 · accepted · 588→15766 tok · $0.0191
no patch produced
nextflow-orchestration-chore · rep 1 · accepted · 588→9261 tok · $0.0113
no patch produced
nextflow-orchestration-chore · rep 2 · accepted · 588→11981 tok · $0.0146
no patch produced
project-manager-chore · rep 0 · patch_apply_failed · 425→265 tok · $0.00045
no patch produced
project-manager-chore · rep 0 · patch_apply_failed · 425→1079 tok · $0.0014
no patch produced
project-manager-chore · rep 1 · accepted · 425→1581 tok · $0.0020
no patch produced
project-manager-chore · rep 1 · patch_apply_failed · 425→285 tok · $0.00047
no patch produced
project-manager-chore · rep 2 · patch_apply_failed · 425→429 tok · $0.0006
no patch produced
pyproject-edit-chore · rep 0 · patch_apply_failed · 384→131 tok · $0.00027
no patch produced
pyproject-edit-chore · rep 1 · patch_apply_failed · 384→145 tok · $0.00029
no patch produced
pyproject-edit-chore · rep 2 · patch_apply_failed · 384→243 tok · $0.00041
no patch produced
tiny-python-type-chore · rep 0 · accepted · 380→814 tok · $0.0011
no patch produced
tiny-python-type-chore · rep 0 · accepted · 326→968 tok · $0.0013
no patch produced
tiny-python-type-chore · rep 1 · accepted · 326→978 tok · $0.0013
no patch produced
tiny-python-type-chore · rep 1 · accepted · 380→981 tok · $0.0013
no patch produced
tiny-python-type-chore · rep 2 · hidden_tests_failed, smoke_failed · 380→1595 tok · $0.0020
no patch produced
type-annotation-chore · rep 0 · accepted · 337→179 tok · $0.00032
no patch produced
type-annotation-chore · rep 0 · patch_apply_failed · 337→440 tok · $0.0006
no patch produced
type-annotation-chore · rep 1 · patch_apply_failed · 337→202 tok · $0.00034
no patch produced
type-annotation-chore · rep 1 · patch_apply_failed · 337→161 tok · $0.00029
no patch produced
type-annotation-chore · rep 2 · patch_apply_failed · 337→369 tok · $0.0005
no patch produced
version-hallucination-chore · rep 0 · patch_apply_failed · 377→679 tok · $0.0009
no patch produced
version-hallucination-chore · rep 1 · patch_apply_failed · 377→287 tok · $0.00046
no patch produced
version-hallucination-chore · rep 2 · patch_apply_failed · 377→358 tok · $0.0005
no patch produced