← ChoreCode leaderboard · 20260706T163525Z
lint_hygiene
1 public chores · 32/43 accepted · 2 hard fails
Tasks
category coverage| Task | Title | Accepted | Hard fails |
|---|---|---|---|
| config-noop-chore | Clear the lint violation without weakening lint config | 32/43 (74%) | 2 |
Results
model × task| Task | Run config | Accepted | Hard fails |
|---|---|---|---|
| config-noop-chore | deepseek-v4-flash | 4/5 | 0 |
| config-noop-chore | deepseek-v4-pro | 2/5 | 0 |
| config-noop-chore | gemma4-26b | 7/8 | 0 |
| config-noop-chore | glm-5.2 | 5/5 | 0 |
| config-noop-chore | kimi-k2.6 | 5/5 | 0 |
| config-noop-chore | minimax-m2.7 | 3/5 | 2 |
| config-noop-chore | minimax-m3 | 5/5 | 0 |
| config-noop-chore | qwen3.6-27b | 1/5 | 0 |
Attempts
evidence for this categoryconfig-noop-chore · deepseek-v4-flash · rep 0 · accepted · 182→193 tok · $0.000051
no patch produced
config-noop-chore · deepseek-v4-flash · rep 0 · accepted · 182→214 tok · $0.000055
no patch produced
config-noop-chore · deepseek-v4-flash · rep 1 · patch_apply_failed · 182→162 tok · $0.000046
no patch produced
config-noop-chore · deepseek-v4-flash · rep 1 · accepted · 182→212 tok · $0.000055
no patch produced
config-noop-chore · deepseek-v4-flash · rep 2 · accepted · 182→142 tok · $0.000042
no patch produced
config-noop-chore · deepseek-v4-pro · rep 0 · accepted · 182→2239 tok · $0.0020
no patch produced
config-noop-chore · deepseek-v4-pro · rep 0 · patch_apply_failed · 182→1115 tok · $0.0010
no patch produced
config-noop-chore · deepseek-v4-pro · rep 1 · patch_apply_failed · 182→1279 tok · $0.0012
no patch produced
config-noop-chore · deepseek-v4-pro · rep 1 · accepted · 182→223 tok · $0.00027
no patch produced
config-noop-chore · deepseek-v4-pro · rep 2 · patch_apply_failed · 182→1088 tok · $0.0010
no patch produced
config-noop-chore · gemma4-26b · rep 0 · accepted · 205→220 tok · $0.000085
no patch produced
config-noop-chore · gemma4-26b · rep 0 · accepted · 205→249 tok · $0.000094
no patch produced
config-noop-chore · gemma4-26b · rep 0 · accepted · 205→233 tok · $0.000089
no patch produced
config-noop-chore · gemma4-26b · rep 1 · accepted · 205→251 tok · $0.000095
no patch produced
config-noop-chore · gemma4-26b · rep 1 · accepted · 205→236 tok · $0.000090
no patch produced
config-noop-chore · gemma4-26b · rep 1 · accepted · 205→250 tok · $0.000095
no patch produced
config-noop-chore · gemma4-26b · rep 2 · accepted · 205→249 tok · $0.000094
no patch produced
config-noop-chore · gemma4-26b · rep 2 · patch_apply_failed · 205→4903 tok · $0.0016
no patch produced
config-noop-chore · glm-5.2 · rep 0 · accepted · 190→232 tok · $0.0005
no patch produced
config-noop-chore · glm-5.2 · rep 0 · accepted · 190→198 tok · $0.00045
no patch produced
config-noop-chore · glm-5.2 · rep 1 · accepted · 190→126 tok · $0.00033
no patch produced
config-noop-chore · glm-5.2 · rep 1 · accepted · 190→169 tok · $0.00040
no patch produced
config-noop-chore · glm-5.2 · rep 2 · accepted · 190→165 tok · $0.00040
no patch produced
config-noop-chore · kimi-k2.6 · rep 0 · accepted · 188→1659 tok · $0.0058
no patch produced
config-noop-chore · kimi-k2.6 · rep 0 · accepted · 188→3492 tok · $0.0120
no patch produced
config-noop-chore · kimi-k2.6 · rep 1 · accepted · 188→4221 tok · $0.0145
no patch produced
config-noop-chore · kimi-k2.6 · rep 1 · accepted · 188→6782 tok · $0.0233
no patch produced
config-noop-chore · kimi-k2.6 · rep 2 · accepted · 188→2422 tok · $0.0084
no patch produced
config-noop-chore · minimax-m2.7 · rep 0 · accepted · 187→407 tok · $0.00033
no patch produced
config-noop-chore · minimax-m2.7 · rep 0 · hidden_tests_failed, unused_import_added · 187→622 tok · $0.00048
no patch produced
config-noop-chore · minimax-m2.7 · rep 1 · accepted · 187→271 tok · $0.00023
no patch produced
config-noop-chore · minimax-m2.7 · rep 1 · accepted · 187→208 tok · $0.00018
no patch produced
config-noop-chore · minimax-m2.7 · rep 2 · hidden_tests_failed, unused_import_added · 187→382 tok · $0.00031
no patch produced
config-noop-chore · minimax-m3 · rep 0 · accepted · 343→206 tok · $0.00035
no patch produced
config-noop-chore · minimax-m3 · rep 0 · accepted · 343→5451 tok · $0.0066
no patch produced
config-noop-chore · minimax-m3 · rep 1 · accepted · 343→170 tok · $0.00031
no patch produced
config-noop-chore · minimax-m3 · rep 1 · accepted · 343→190 tok · $0.00033
no patch produced
config-noop-chore · minimax-m3 · rep 2 · accepted · 343→365 tok · $0.0005
no patch produced
config-noop-chore · qwen3.6-27b · rep 0 · patch_apply_failed · 198→3513 tok · $0.0085
no patch produced
config-noop-chore · qwen3.6-27b · rep 0 · accepted · 198→3574 tok · $0.0086
no patch produced
config-noop-chore · qwen3.6-27b · rep 1 · patch_apply_failed · 198→2383 tok · $0.0058
no patch produced
config-noop-chore · qwen3.6-27b · rep 1 · patch_apply_failed · 198→2955 tok · $0.0071
no patch produced
config-noop-chore · qwen3.6-27b · rep 2 · patch_apply_failed · 198→3928 tok · $0.0095
no patch produced