← ChoreCode leaderboard · 20260706T163525Z
documentation
1 public chores · 16/43 accepted · 0 hard fails
Tasks
category coverage| Task | Title | Accepted | Hard fails |
|---|---|---|---|
| docstring-chore | Document slugify with a Google-style docstring | 16/43 (37%) | 0 |
Results
model × task| Task | Run config | Accepted | Hard fails |
|---|---|---|---|
| docstring-chore | deepseek-v4-flash | 0/5 | 0 |
| docstring-chore | deepseek-v4-pro | 1/5 | 0 |
| docstring-chore | gemma4-26b | 8/8 | 0 |
| docstring-chore | glm-5.2 | 0/5 | 0 |
| docstring-chore | kimi-k2.6 | 3/5 | 0 |
| docstring-chore | minimax-m2.7 | 0/5 | 0 |
| docstring-chore | minimax-m3 | 2/5 | 0 |
| docstring-chore | qwen3.6-27b | 2/5 | 0 |
Attempts
evidence for this categorydocstring-chore · deepseek-v4-flash · rep 0 · patch_apply_failed · 147→264 tok · $0.000061
no patch produced
docstring-chore · deepseek-v4-flash · rep 0 · patch_apply_failed · 147→362 tok · $0.000078
no patch produced
docstring-chore · deepseek-v4-flash · rep 1 · patch_apply_failed · 147→394 tok · $0.000084
no patch produced
docstring-chore · deepseek-v4-flash · rep 1 · patch_apply_failed · 147→308 tok · $0.000069
no patch produced
docstring-chore · deepseek-v4-flash · rep 2 · patch_apply_failed · 147→292 tok · $0.000066
no patch produced
docstring-chore · deepseek-v4-pro · rep 0 · patch_apply_failed · 147→274 tok · $0.00030
no patch produced
docstring-chore · deepseek-v4-pro · rep 0 · patch_apply_failed · 147→659 tok · $0.0006
no patch produced
docstring-chore · deepseek-v4-pro · rep 1 · accepted · 147→282 tok · $0.00031
no patch produced
docstring-chore · deepseek-v4-pro · rep 1 · existing_tests_failed, hidden_tests_failed, smoke_failed · 147→334 tok · $0.00035
no patch produced
docstring-chore · deepseek-v4-pro · rep 2 · patch_apply_failed · 147→319 tok · $0.00034
no patch produced
docstring-chore · gemma4-26b · rep 0 · accepted · 168→4539 tok · $0.0015
no patch produced
docstring-chore · gemma4-26b · rep 0 · accepted · 168→2817 tok · $0.0009
no patch produced
docstring-chore · gemma4-26b · rep 0 · accepted · 168→4175 tok · $0.0014
no patch produced
docstring-chore · gemma4-26b · rep 1 · accepted · 168→3538 tok · $0.0012
no patch produced
docstring-chore · gemma4-26b · rep 1 · accepted · 168→3660 tok · $0.0012
no patch produced
docstring-chore · gemma4-26b · rep 1 · accepted · 168→4655 tok · $0.0015
no patch produced
docstring-chore · gemma4-26b · rep 2 · accepted · 168→4558 tok · $0.0015
no patch produced
docstring-chore · gemma4-26b · rep 2 · accepted · 168→3463 tok · $0.0012
no patch produced
docstring-chore · glm-5.2 · rep 0 · patch_apply_failed · 152→540 tok · $0.0010
no patch produced
docstring-chore · glm-5.2 · rep 0 · patch_apply_failed · 152→160 tok · $0.00037
no patch produced
docstring-chore · glm-5.2 · rep 1 · patch_apply_failed · 152→122 tok · $0.00030
no patch produced
docstring-chore · glm-5.2 · rep 1 · patch_apply_failed · 152→127 tok · $0.00031
no patch produced
docstring-chore · glm-5.2 · rep 2 · patch_apply_failed · 152→150 tok · $0.00035
no patch produced
docstring-chore · kimi-k2.6 · rep 0 · existing_tests_failed, hidden_tests_failed · 151→16384 tok · $0.0560
no patch produced
docstring-chore · kimi-k2.6 · rep 0 · existing_tests_failed, hidden_tests_failed, smoke_failed · 151→1837 tok · $0.0064
no patch produced
docstring-chore · kimi-k2.6 · rep 1 · accepted · 151→7474 tok · $0.0256
no patch produced
docstring-chore · kimi-k2.6 · rep 1 · accepted · 151→10497 tok · $0.0359
no patch produced
docstring-chore · kimi-k2.6 · rep 2 · accepted · 151→4650 tok · $0.0160
no patch produced
docstring-chore · minimax-m2.7 · rep 0 · patch_apply_failed · 154→428 tok · $0.00034
no patch produced
docstring-chore · minimax-m2.7 · rep 0 · existing_tests_failed, hidden_tests_failed · 0→403 tok · $0.00029
no patch produced
docstring-chore · minimax-m2.7 · rep 1 · patch_apply_failed · 0→990 tok · $0.0007
no patch produced
docstring-chore · minimax-m2.7 · rep 1 · patch_apply_failed · 0→465 tok · $0.00033
no patch produced
docstring-chore · minimax-m2.7 · rep 2 · patch_apply_failed · 154→361 tok · $0.00029
no patch produced
docstring-chore · minimax-m3 · rep 0 · patch_apply_failed · 310→451 tok · $0.0006
no patch produced
docstring-chore · minimax-m3 · rep 0 · accepted · 310→301 tok · $0.00045
no patch produced
docstring-chore · minimax-m3 · rep 1 · patch_apply_failed · 310→303 tok · $0.00046
no patch produced
docstring-chore · minimax-m3 · rep 1 · accepted · 310→1405 tok · $0.0018
no patch produced
docstring-chore · minimax-m3 · rep 2 · patch_apply_failed · 310→247 tok · $0.00039
no patch produced
docstring-chore · qwen3.6-27b · rep 0 · patch_apply_failed · 157→2721 tok · $0.0066
no patch produced
docstring-chore · qwen3.6-27b · rep 0 · accepted · 157→1791 tok · $0.0043
no patch produced
docstring-chore · qwen3.6-27b · rep 1 · accepted · 157→1746 tok · $0.0042
no patch produced
docstring-chore · qwen3.6-27b · rep 1 · patch_apply_failed · 157→2613 tok · $0.0063
no patch produced
docstring-chore · qwen3.6-27b · rep 2 · patch_apply_failed · 157→1012 tok · $0.0025
no patch produced