← ChoreCode leaderboard · 20260706T163525Z
cruft_removal
1 public chores · 22/43 accepted · 1 hard fails
Tasks
category coverage| Task | Title | Accepted | Hard fails |
|---|---|---|---|
| debug-cruft-chore | Remove leftover debug output | 22/43 (51%) | 1 |
Results
model × task| Task | Run config | Accepted | Hard fails |
|---|---|---|---|
| debug-cruft-chore | deepseek-v4-flash | 0/5 | 0 |
| debug-cruft-chore | deepseek-v4-pro | 2/5 | 1 |
| debug-cruft-chore | gemma4-26b | 8/8 | 0 |
| debug-cruft-chore | glm-5.2 | 2/5 | 0 |
| debug-cruft-chore | kimi-k2.6 | 2/5 | 0 |
| debug-cruft-chore | minimax-m2.7 | 1/5 | 0 |
| debug-cruft-chore | minimax-m3 | 2/5 | 0 |
| debug-cruft-chore | qwen3.6-27b | 5/5 | 0 |
Attempts
evidence for this categorydebug-cruft-chore · deepseek-v4-flash · rep 0 · patch_apply_failed · 188→142 tok · $0.000042
no patch produced
debug-cruft-chore · deepseek-v4-flash · rep 0 · patch_apply_failed · 188→143 tok · $0.000043
no patch produced
debug-cruft-chore · deepseek-v4-flash · rep 1 · patch_apply_failed · 188→135 tok · $0.000041
no patch produced
debug-cruft-chore · deepseek-v4-flash · rep 1 · patch_apply_failed · 188→161 tok · $0.000046
no patch produced
debug-cruft-chore · deepseek-v4-flash · rep 2 · patch_apply_failed · 188→138 tok · $0.000042
no patch produced
debug-cruft-chore · deepseek-v4-pro · rep 0 · debug_output_left, forbidden_pattern, hidden_tests_failed · 188→204 tok · $0.00026
no patch produced
debug-cruft-chore · deepseek-v4-pro · rep 0 · accepted · 188→1637 tok · $0.0015
no patch produced
debug-cruft-chore · deepseek-v4-pro · rep 1 · patch_apply_failed · 188→195 tok · $0.00025
no patch produced
debug-cruft-chore · deepseek-v4-pro · rep 1 · patch_apply_failed · 188→254 tok · $0.00030
no patch produced
debug-cruft-chore · deepseek-v4-pro · rep 2 · accepted · 188→551 tok · $0.0006
no patch produced
debug-cruft-chore · gemma4-26b · rep 0 · accepted · 215→3536 tok · $0.0012
no patch produced
debug-cruft-chore · gemma4-26b · rep 0 · accepted · 215→1604 tok · $0.0005
no patch produced
debug-cruft-chore · gemma4-26b · rep 0 · accepted · 215→1591 tok · $0.0005
no patch produced
debug-cruft-chore · gemma4-26b · rep 1 · accepted · 215→2135 tok · $0.0007
no patch produced
debug-cruft-chore · gemma4-26b · rep 1 · accepted · 215→1737 tok · $0.0006
no patch produced
debug-cruft-chore · gemma4-26b · rep 1 · accepted · 215→1690 tok · $0.0006
no patch produced
debug-cruft-chore · gemma4-26b · rep 2 · accepted · 215→2070 tok · $0.0007
no patch produced
debug-cruft-chore · gemma4-26b · rep 2 · accepted · 215→1546 tok · $0.0005
no patch produced
debug-cruft-chore · glm-5.2 · rep 0 · patch_apply_failed · 190→102 tok · $0.00029
no patch produced
debug-cruft-chore · glm-5.2 · rep 0 · patch_apply_failed · 190→137 tok · $0.00035
no patch produced
debug-cruft-chore · glm-5.2 · rep 1 · accepted · 190→722 tok · $0.0014
no patch produced
debug-cruft-chore · glm-5.2 · rep 1 · patch_apply_failed · 190→102 tok · $0.00029
no patch produced
debug-cruft-chore · glm-5.2 · rep 2 · accepted · 190→111 tok · $0.00030
no patch produced
debug-cruft-chore · kimi-k2.6 · rep 0 · accepted · 189→1790 tok · $0.0062
no patch produced
debug-cruft-chore · kimi-k2.6 · rep 0 · accepted · 189→3799 tok · $0.0131
no patch produced
debug-cruft-chore · kimi-k2.6 · rep 1 · patch_apply_failed · 189→2614 tok · $0.0090
no patch produced
debug-cruft-chore · kimi-k2.6 · rep 1 · patch_apply_failed · 189→1042 tok · $0.0037
no patch produced
debug-cruft-chore · kimi-k2.6 · rep 2 · patch_apply_failed · 189→1621 tok · $0.0057
no patch produced
debug-cruft-chore · minimax-m2.7 · rep 0 · patch_apply_failed · 191→320 tok · $0.00026
no patch produced
debug-cruft-chore · minimax-m2.7 · rep 0 · patch_apply_failed · 191→200 tok · $0.00018
no patch produced
debug-cruft-chore · minimax-m2.7 · rep 1 · hidden_tests_failed · 191→284 tok · $0.00024
no patch produced
debug-cruft-chore · minimax-m2.7 · rep 1 · patch_apply_failed · 191→675 tok · $0.0005
no patch produced
debug-cruft-chore · minimax-m2.7 · rep 2 · accepted · 191→338 tok · $0.00028
no patch produced
debug-cruft-chore · minimax-m3 · rep 0 · patch_apply_failed · 347→347 tok · $0.0005
no patch produced
debug-cruft-chore · minimax-m3 · rep 0 · patch_apply_failed · 347→135 tok · $0.00027
no patch produced
debug-cruft-chore · minimax-m3 · rep 1 · patch_apply_failed · 347→141 tok · $0.00027
no patch produced
debug-cruft-chore · minimax-m3 · rep 1 · accepted · 347→175 tok · $0.00031
no patch produced
debug-cruft-chore · minimax-m3 · rep 2 · accepted · 347→655 tok · $0.0009
no patch produced
debug-cruft-chore · qwen3.6-27b · rep 0 · accepted · 198→1462 tok · $0.0036
no patch produced
debug-cruft-chore · qwen3.6-27b · rep 0 · accepted · 198→1922 tok · $0.0047
no patch produced
debug-cruft-chore · qwen3.6-27b · rep 1 · accepted · 198→721 tok · $0.0018
no patch produced
debug-cruft-chore · qwen3.6-27b · rep 1 · accepted · 198→719 tok · $0.0018
no patch produced
debug-cruft-chore · qwen3.6-27b · rep 2 · accepted · 198→1388 tok · $0.0034
no patch produced