← ChoreCode leaderboard · 20260706T163525Z
kimi-k2.6
kimi-k2.6:cloud
Stats
release-0.1.1| Model | kimi-k2.6:cloud |
| Accepted | 43/69 (62%) |
| Hard fail rate | 1% |
| $ / accepted chore | $0.0237 |
| $ / attempt | $0.0147 |
| Tokens / accepted chore | 7224 |
| Tokens in / out (total) | 15.3k / 295.3k |
| Mean latency | 39.3 s |
Cost is recorded input/output tokens multiplied by current OpenRouter pricing for the same model or weights.
Results by task
17 tasks| Task | Accepted | Hard fails | Failure reasons seen |
|---|---|---|---|
| bare-except-chore | 3/5 | 0 | patch_apply_failed |
| basic-function-off-by-one | 5/5 | 0 | — |
| config-noop-chore | 5/5 | 0 | — |
| debug-cruft-chore | 2/5 | 0 | patch_apply_failed |
| dependency-conflict-chore | 1/3 | 0 | patch_apply_failed |
| dependency-existing-retry-chore | 0/3 | 0 | existing_tests_failed, hidden_tests_failed, smoke_failed |
| dependency-stdlib-query-chore | 2/3 | 0 | patch_apply_failed |
| docstring-chore | 3/5 | 0 | existing_tests_failed, hidden_tests_failed, smoke_failed |
| error-message-chore | 4/5 | 0 | patch_apply_failed |
| generated-cli-help-chore | 3/3 | 0 | — |
| generated-client-field-chore | 0/3 | 0 | patch_apply_failed |
| nextflow-orchestration-chore | 2/3 | 1 | forbidden_pattern, hidden_tests_failed, smoke_failed |
| project-manager-chore | 3/5 | 0 | patch_apply_failed |
| pyproject-edit-chore | 3/3 | 0 | — |
| tiny-python-type-chore | 2/5 | 0 | patch_apply_failed |
| type-annotation-chore | 3/5 | 0 | patch_apply_failed |
| version-hallucination-chore | 2/3 | 0 | patch_apply_failed |
Attempts
expand a row for the patch and logsbare-except-chore · rep 0 · accepted · 198→1740 tok · $0.0061
no patch produced
bare-except-chore · rep 0 · patch_apply_failed · 198→2441 tok · $0.0085
no patch produced
bare-except-chore · rep 1 · patch_apply_failed · 198→1991 tok · $0.0069
no patch produced
bare-except-chore · rep 1 · accepted · 198→1887 tok · $0.0066
no patch produced
bare-except-chore · rep 2 · accepted · 198→4714 tok · $0.0162
no patch produced
basic-function-off-by-one · rep 0 · accepted · 185→3787 tok · $0.0130
no patch produced
basic-function-off-by-one · rep 0 · accepted · 185→1845 tok · $0.0064
no patch produced
basic-function-off-by-one · rep 1 · accepted · 185→3179 tok · $0.0110
no patch produced
basic-function-off-by-one · rep 1 · accepted · 185→4969 tok · $0.0171
no patch produced
basic-function-off-by-one · rep 2 · accepted · 185→3569 tok · $0.0123
no patch produced
config-noop-chore · rep 0 · accepted · 188→1659 tok · $0.0058
no patch produced
config-noop-chore · rep 0 · accepted · 188→3492 tok · $0.0120
no patch produced
config-noop-chore · rep 1 · accepted · 188→4221 tok · $0.0145
no patch produced
config-noop-chore · rep 1 · accepted · 188→6782 tok · $0.0233
no patch produced
config-noop-chore · rep 2 · accepted · 188→2422 tok · $0.0084
no patch produced
debug-cruft-chore · rep 0 · accepted · 189→1790 tok · $0.0062
no patch produced
debug-cruft-chore · rep 0 · accepted · 189→3799 tok · $0.0131
no patch produced
debug-cruft-chore · rep 1 · patch_apply_failed · 189→2614 tok · $0.0090
no patch produced
debug-cruft-chore · rep 1 · patch_apply_failed · 189→1042 tok · $0.0037
no patch produced
debug-cruft-chore · rep 2 · patch_apply_failed · 189→1621 tok · $0.0057
no patch produced
dependency-conflict-chore · rep 0 · patch_apply_failed · 256→2209 tok · $0.0077
no patch produced
dependency-conflict-chore · rep 1 · accepted · 256→2165 tok · $0.0076
no patch produced
dependency-conflict-chore · rep 2 · patch_apply_failed · 256→3157 tok · $0.0109
no patch produced
dependency-existing-retry-chore · rep 0 · existing_tests_failed, hidden_tests_failed, smoke_failed · 278→7249 tok · $0.0249
no patch produced
dependency-existing-retry-chore · rep 1 · existing_tests_failed, hidden_tests_failed, smoke_failed · 278→5040 tok · $0.0174
no patch produced
dependency-existing-retry-chore · rep 2 · existing_tests_failed, hidden_tests_failed, smoke_failed · 278→4108 tok · $0.0142
no patch produced
dependency-stdlib-query-chore · rep 0 · accepted · 274→4112 tok · $0.0142
no patch produced
dependency-stdlib-query-chore · rep 1 · accepted · 274→4376 tok · $0.0151
no patch produced
dependency-stdlib-query-chore · rep 2 · patch_apply_failed · 274→2264 tok · $0.0079
no patch produced
docstring-chore · rep 0 · existing_tests_failed, hidden_tests_failed · 151→16384 tok · $0.0560
no patch produced
docstring-chore · rep 0 · existing_tests_failed, hidden_tests_failed, smoke_failed · 151→1837 tok · $0.0064
no patch produced
docstring-chore · rep 1 · accepted · 151→7474 tok · $0.0256
no patch produced
docstring-chore · rep 1 · accepted · 151→10497 tok · $0.0359
no patch produced
docstring-chore · rep 2 · accepted · 151→4650 tok · $0.0160
no patch produced
error-message-chore · rep 0 · patch_apply_failed · 234→1796 tok · $0.0063
no patch produced
error-message-chore · rep 0 · accepted · 234→2782 tok · $0.0096
no patch produced
error-message-chore · rep 1 · accepted · 234→1388 tok · $0.0049
no patch produced
error-message-chore · rep 1 · accepted · 234→2298 tok · $0.0080
no patch produced
error-message-chore · rep 2 · accepted · 234→1734 tok · $0.0061
no patch produced
generated-cli-help-chore · rep 0 · accepted · 189→3492 tok · $0.0120
no patch produced
generated-cli-help-chore · rep 1 · accepted · 189→3044 tok · $0.0105
no patch produced
generated-cli-help-chore · rep 2 · accepted · 189→2230 tok · $0.0077
no patch produced
generated-client-field-chore · rep 0 · patch_apply_failed · 231→2760 tok · $0.0096
no patch produced
generated-client-field-chore · rep 1 · patch_apply_failed · 231→3997 tok · $0.0138
no patch produced
generated-client-field-chore · rep 2 · patch_apply_failed · 231→5615 tok · $0.0193
no patch produced
nextflow-orchestration-chore · rep 0 · accepted · 432→12918 tok · $0.0443
no patch produced
nextflow-orchestration-chore · rep 1 · forbidden_pattern, hidden_tests_failed, smoke_failed · 432→14136 tok · $0.0485
no patch produced
nextflow-orchestration-chore · rep 2 · accepted · 432→12750 tok · $0.0438
no patch produced
project-manager-chore · rep 0 · accepted · 267→8496 tok · $0.0291
no patch produced
project-manager-chore · rep 0 · accepted · 267→3566 tok · $0.0123
no patch produced
project-manager-chore · rep 1 · patch_apply_failed · 267→1695 tok · $0.0060
no patch produced
project-manager-chore · rep 1 · accepted · 267→3031 tok · $0.0105
no patch produced
project-manager-chore · rep 2 · patch_apply_failed · 267→2624 tok · $0.0091
no patch produced
pyproject-edit-chore · rep 0 · accepted · 225→2620 tok · $0.0091
no patch produced
pyproject-edit-chore · rep 1 · accepted · 225→6394 tok · $0.0220
no patch produced
pyproject-edit-chore · rep 2 · accepted · 225→3704 tok · $0.0128
no patch produced
tiny-python-type-chore · rep 0 · patch_apply_failed · 167→2238 tok · $0.0077
no patch produced
tiny-python-type-chore · rep 0 · patch_apply_failed · 222→12239 tok · $0.0419
no patch produced
tiny-python-type-chore · rep 1 · patch_apply_failed · 167→16384 tok · $0.0560
no patch produced
tiny-python-type-chore · rep 1 · accepted · 222→1564 tok · $0.0055
no patch produced
tiny-python-type-chore · rep 2 · accepted · 222→2816 tok · $0.0097
no patch produced
type-annotation-chore · rep 0 · accepted · 182→3305 tok · $0.0114
no patch produced
type-annotation-chore · rep 0 · patch_apply_failed · 182→3996 tok · $0.0137
no patch produced
type-annotation-chore · rep 1 · accepted · 182→1920 tok · $0.0067
no patch produced
type-annotation-chore · rep 1 · accepted · 182→2463 tok · $0.0085
no patch produced
type-annotation-chore · rep 2 · patch_apply_failed · 182→1076 tok · $0.0038
no patch produced
version-hallucination-chore · rep 0 · accepted · 217→4142 tok · $0.0143
no patch produced
version-hallucination-chore · rep 1 · patch_apply_failed · 217→1867 tok · $0.0065
no patch produced
version-hallucination-chore · rep 2 · accepted · 217→3180 tok · $0.0110
no patch produced