← ChoreCode leaderboard · 20260706T163525Z
basic-function-off-by-one
Make range counting boundaries inclusive
tiny_seq.count_between documents an inclusive range [low, high] but excludes the boundaries. Fix the implementation to match its documented contract. Do not special-case any particular input values. Return a unified diff only.
Forbidden cheap shots: modifying or deleting visible tests; hard-coding the visible test inputs or expected values
Results by model
8 run configs| Run config | Accepted | Accept rate | Hard fails |
|---|---|---|---|
| gemma4-26b | 8/8 | 100% | 0 |
| deepseek-v4-flash | 5/5 | 100% | 0 |
| kimi-k2.6 | 5/5 | 100% | 0 |
| minimax-m3 | 2/5 | 40% | 0 |
| deepseek-v4-pro | 1/5 | 20% | 0 |
| qwen3.6-27b | 1/5 | 20% | 0 |
| glm-5.2 | 0/5 | 0% | 0 |
| minimax-m2.7 | 0/5 | 0% | 0 |
Attempts
expand a row for the patch and logsdeepseek-v4-flash · rep 0 · accepted · 179→238 tok · $0.000059
no patch produced
deepseek-v4-flash · rep 0 · accepted · 179→201 tok · $0.000052
no patch produced
deepseek-v4-flash · rep 1 · accepted · 179→202 tok · $0.000052
no patch produced
deepseek-v4-flash · rep 1 · accepted · 179→201 tok · $0.000052
no patch produced
deepseek-v4-flash · rep 2 · accepted · 179→224 tok · $0.000056
no patch produced
deepseek-v4-pro · rep 0 · patch_apply_failed · 179→312 tok · $0.00035
no patch produced
deepseek-v4-pro · rep 0 · patch_apply_failed · 179→269 tok · $0.00031
no patch produced
deepseek-v4-pro · rep 1 · accepted · 179→537 tok · $0.0005
no patch produced
deepseek-v4-pro · rep 1 · patch_apply_failed · 179→204 tok · $0.00026
no patch produced
deepseek-v4-pro · rep 2 · patch_apply_failed · 179→175 tok · $0.00023
no patch produced
gemma4-26b · rep 0 · accepted · 202→1970 tok · $0.0007
no patch produced
gemma4-26b · rep 0 · accepted · 202→348 tok · $0.00013
no patch produced
gemma4-26b · rep 0 · accepted · 202→1501 tok · $0.0005
no patch produced
gemma4-26b · rep 1 · accepted · 202→1628 tok · $0.0005
no patch produced
gemma4-26b · rep 1 · accepted · 202→1940 tok · $0.0007
no patch produced
gemma4-26b · rep 1 · accepted · 202→1516 tok · $0.0005
no patch produced
gemma4-26b · rep 2 · accepted · 202→1401 tok · $0.00047
no patch produced
gemma4-26b · rep 2 · accepted · 202→1079 tok · $0.00037
no patch produced
glm-5.2 · rep 0 · patch_apply_failed · 186→131 tok · $0.00033
no patch produced
glm-5.2 · rep 0 · patch_apply_failed · 186→131 tok · $0.00033
no patch produced
glm-5.2 · rep 1 · patch_apply_failed · 186→123 tok · $0.00032
no patch produced
glm-5.2 · rep 1 · patch_apply_failed · 186→131 tok · $0.00033
no patch produced
glm-5.2 · rep 2 · patch_apply_failed · 186→154 tok · $0.00038
no patch produced
kimi-k2.6 · rep 0 · accepted · 185→3787 tok · $0.0130
no patch produced
kimi-k2.6 · rep 0 · accepted · 185→1845 tok · $0.0064
no patch produced
kimi-k2.6 · rep 1 · accepted · 185→3179 tok · $0.0110
no patch produced
kimi-k2.6 · rep 1 · accepted · 185→4969 tok · $0.0171
no patch produced
kimi-k2.6 · rep 2 · accepted · 185→3569 tok · $0.0123
no patch produced
minimax-m2.7 · rep 0 · patch_apply_failed · 187→320 tok · $0.00026
no patch produced
minimax-m2.7 · rep 0 · patch_apply_failed · 187→325 tok · $0.00027
no patch produced
minimax-m2.7 · rep 1 · patch_apply_failed · 187→333 tok · $0.00027
no patch produced
minimax-m2.7 · rep 1 · patch_apply_failed · 187→314 tok · $0.00026
no patch produced
minimax-m2.7 · rep 2 · patch_apply_failed · 187→550 tok · $0.00043
no patch produced
minimax-m3 · rep 0 · accepted · 343→219 tok · $0.00037
no patch produced
minimax-m3 · rep 0 · patch_apply_failed · 343→225 tok · $0.00037
no patch produced
minimax-m3 · rep 1 · patch_apply_failed · 343→230 tok · $0.00038
no patch produced
minimax-m3 · rep 1 · patch_apply_failed · 343→175 tok · $0.00031
no patch produced
minimax-m3 · rep 2 · accepted · 343→184 tok · $0.00032
no patch produced
qwen3.6-27b · rep 0 · patch_apply_failed · 192→2953 tok · $0.0071
no patch produced
qwen3.6-27b · rep 0 · patch_apply_failed · 192→1138 tok · $0.0028
no patch produced
qwen3.6-27b · rep 1 · patch_apply_failed · 192→1615 tok · $0.0039
no patch produced
qwen3.6-27b · rep 1 · accepted · 192→1674 tok · $0.0041
no patch produced
qwen3.6-27b · rep 2 · patch_apply_failed · 192→1857 tok · $0.0045
no patch produced