← ChoreCode leaderboard · 20260706T163525Z
deepseek-v4-flash
deepseek-v4-flash:cloud
Stats
release-0.1.1| Model | deepseek-v4-flash:cloud |
| Accepted | 30/69 (43%) |
| Hard fail rate | 0% |
| $ / accepted chore | $0.00020 |
| $ / attempt | $0.000088 |
| Tokens / accepted chore | 1384 |
| Tokens in / out (total) | 15.3k / 26.2k |
| Mean latency | 2.5 s |
Cost is recorded input/output tokens multiplied by current OpenRouter pricing for the same model or weights.
Results by task
17 tasks| Task | Accepted | Hard fails | Failure reasons seen |
|---|---|---|---|
| bare-except-chore | 2/5 | 0 | patch_apply_failed |
| basic-function-off-by-one | 5/5 | 0 | — |
| config-noop-chore | 4/5 | 0 | patch_apply_failed |
| debug-cruft-chore | 0/5 | 0 | patch_apply_failed |
| dependency-conflict-chore | 1/3 | 0 | patch_apply_failed |
| dependency-existing-retry-chore | 0/3 | 0 | patch_apply_failed |
| dependency-stdlib-query-chore | 1/3 | 0 | patch_apply_failed |
| docstring-chore | 0/5 | 0 | patch_apply_failed |
| error-message-chore | 5/5 | 0 | — |
| generated-cli-help-chore | 2/3 | 0 | patch_apply_failed |
| generated-client-field-chore | 1/3 | 0 | patch_apply_failed |
| nextflow-orchestration-chore | 0/3 | 0 | patch_apply_failed |
| project-manager-chore | 0/5 | 0 | patch_apply_failed |
| pyproject-edit-chore | 0/3 | 0 | patch_apply_failed |
| tiny-python-type-chore | 2/5 | 0 | hidden_tests_failed, smoke_failed |
| type-annotation-chore | 4/5 | 0 | patch_apply_failed |
| version-hallucination-chore | 3/3 | 0 | — |
Attempts
expand a row for the patch and logsbare-except-chore · rep 0 · accepted · 190→426 tok · $0.000094
no patch produced
bare-except-chore · rep 0 · patch_apply_failed · 190→272 tok · $0.000066
no patch produced
bare-except-chore · rep 1 · accepted · 190→294 tok · $0.000070
no patch produced
bare-except-chore · rep 1 · patch_apply_failed · 190→278 tok · $0.000067
no patch produced
bare-except-chore · rep 2 · patch_apply_failed · 190→305 tok · $0.000072
no patch produced
basic-function-off-by-one · rep 0 · accepted · 179→238 tok · $0.000059
no patch produced
basic-function-off-by-one · rep 0 · accepted · 179→201 tok · $0.000052
no patch produced
basic-function-off-by-one · rep 1 · accepted · 179→202 tok · $0.000052
no patch produced
basic-function-off-by-one · rep 1 · accepted · 179→201 tok · $0.000052
no patch produced
basic-function-off-by-one · rep 2 · accepted · 179→224 tok · $0.000056
no patch produced
config-noop-chore · rep 0 · accepted · 182→193 tok · $0.000051
no patch produced
config-noop-chore · rep 0 · accepted · 182→214 tok · $0.000055
no patch produced
config-noop-chore · rep 1 · patch_apply_failed · 182→162 tok · $0.000046
no patch produced
config-noop-chore · rep 1 · accepted · 182→212 tok · $0.000055
no patch produced
config-noop-chore · rep 2 · accepted · 182→142 tok · $0.000042
no patch produced
debug-cruft-chore · rep 0 · patch_apply_failed · 188→142 tok · $0.000042
no patch produced
debug-cruft-chore · rep 0 · patch_apply_failed · 188→143 tok · $0.000043
no patch produced
debug-cruft-chore · rep 1 · patch_apply_failed · 188→135 tok · $0.000041
no patch produced
debug-cruft-chore · rep 1 · patch_apply_failed · 188→161 tok · $0.000046
no patch produced
debug-cruft-chore · rep 2 · patch_apply_failed · 188→138 tok · $0.000042
no patch produced
dependency-conflict-chore · rep 0 · accepted · 272→274 tok · $0.000074
no patch produced
dependency-conflict-chore · rep 1 · patch_apply_failed · 272→407 tok · $0.000098
no patch produced
dependency-conflict-chore · rep 2 · patch_apply_failed · 272→412 tok · $0.000099
no patch produced
dependency-existing-retry-chore · rep 0 · patch_apply_failed · 294→662 tok · $0.00015
no patch produced
dependency-existing-retry-chore · rep 1 · patch_apply_failed · 294→369 tok · $0.000093
no patch produced
dependency-existing-retry-chore · rep 2 · patch_apply_failed · 294→781 tok · $0.00017
no patch produced
dependency-stdlib-query-chore · rep 0 · patch_apply_failed · 284→277 tok · $0.000075
no patch produced
dependency-stdlib-query-chore · rep 1 · patch_apply_failed · 284→337 tok · $0.000086
no patch produced
dependency-stdlib-query-chore · rep 2 · accepted · 284→436 tok · $0.00010
no patch produced
docstring-chore · rep 0 · patch_apply_failed · 147→264 tok · $0.000061
no patch produced
docstring-chore · rep 0 · patch_apply_failed · 147→362 tok · $0.000078
no patch produced
docstring-chore · rep 1 · patch_apply_failed · 147→394 tok · $0.000084
no patch produced
docstring-chore · rep 1 · patch_apply_failed · 147→308 tok · $0.000069
no patch produced
docstring-chore · rep 2 · patch_apply_failed · 147→292 tok · $0.000066
no patch produced
error-message-chore · rep 0 · accepted · 229→243 tok · $0.000064
no patch produced
error-message-chore · rep 0 · accepted · 229→190 tok · $0.000055
no patch produced
error-message-chore · rep 1 · accepted · 229→242 tok · $0.000064
no patch produced
error-message-chore · rep 1 · accepted · 229→223 tok · $0.000061
no patch produced
error-message-chore · rep 2 · accepted · 229→249 tok · $0.000065
no patch produced
generated-cli-help-chore · rep 0 · accepted · 189→670 tok · $0.00014
no patch produced
generated-cli-help-chore · rep 1 · accepted · 189→347 tok · $0.000079
no patch produced
generated-cli-help-chore · rep 2 · patch_apply_failed · 189→471 tok · $0.00010
no patch produced
generated-client-field-chore · rep 0 · accepted · 229→420 tok · $0.000096
no patch produced
generated-client-field-chore · rep 1 · patch_apply_failed · 229→493 tok · $0.00011
no patch produced
generated-client-field-chore · rep 2 · patch_apply_failed · 229→646 tok · $0.00014
no patch produced
nextflow-orchestration-chore · rep 0 · patch_apply_failed · 440→680 tok · $0.00016
no patch produced
nextflow-orchestration-chore · rep 1 · patch_apply_failed · 440→1825 tok · $0.00037
no patch produced
nextflow-orchestration-chore · rep 2 · patch_apply_failed · 440→2281 tok · $0.00045
no patch produced
project-manager-chore · rep 0 · patch_apply_failed · 275→379 tok · $0.000093
no patch produced
project-manager-chore · rep 0 · patch_apply_failed · 275→339 tok · $0.000086
no patch produced
project-manager-chore · rep 1 · patch_apply_failed · 275→367 tok · $0.000091
no patch produced
project-manager-chore · rep 1 · patch_apply_failed · 275→291 tok · $0.000077
no patch produced
project-manager-chore · rep 2 · patch_apply_failed · 275→322 tok · $0.000083
no patch produced
pyproject-edit-chore · rep 0 · patch_apply_failed · 235→145 tok · $0.000047
no patch produced
pyproject-edit-chore · rep 1 · patch_apply_failed · 235→145 tok · $0.000047
no patch produced
pyproject-edit-chore · rep 2 · patch_apply_failed · 235→142 tok · $0.000047
no patch produced
tiny-python-type-chore · rep 0 · accepted · 215→296 tok · $0.000073
no patch produced
tiny-python-type-chore · rep 0 · hidden_tests_failed · 159→610 tok · $0.00012
no patch produced
tiny-python-type-chore · rep 1 · hidden_tests_failed · 159→496 tok · $0.00010
no patch produced
tiny-python-type-chore · rep 1 · accepted · 215→450 tok · $0.00010
no patch produced
tiny-python-type-chore · rep 2 · hidden_tests_failed, smoke_failed · 215→771 tok · $0.00016
no patch produced
type-annotation-chore · rep 0 · accepted · 178→269 tok · $0.000064
no patch produced
type-annotation-chore · rep 0 · patch_apply_failed · 178→323 tok · $0.000074
no patch produced
type-annotation-chore · rep 1 · accepted · 178→285 tok · $0.000067
no patch produced
type-annotation-chore · rep 1 · accepted · 178→252 tok · $0.000061
no patch produced
type-annotation-chore · rep 2 · accepted · 178→212 tok · $0.000054
no patch produced
version-hallucination-chore · rep 0 · accepted · 224→584 tok · $0.00013
no patch produced
version-hallucination-chore · rep 1 · accepted · 224→310 tok · $0.000076
no patch produced
version-hallucination-chore · rep 2 · accepted · 224→393 tok · $0.000091
no patch produced