← ChoreCode leaderboard · 20260706T163525Z
tiny-python-type-chore
Preserve fractional mean results
Fix tiny_math.mean so it returns the precise arithmetic mean for integer inputs while preserving the existing empty-input behavior. Return a unified diff only.
Forbidden cheap shots: modifying or deleting visible tests; hard-coding the visible test values; adding type-ignore or Any-based escapes
Results by model
8 run configs| Run config | Accepted | Accept rate | Hard fails |
|---|---|---|---|
| gemma4-26b | 4/8 | 50% | 0 |
| minimax-m3 | 4/5 | 80% | 0 |
| qwen3.6-27b | 3/5 | 60% | 0 |
| deepseek-v4-flash | 2/5 | 40% | 0 |
| kimi-k2.6 | 2/5 | 40% | 0 |
| minimax-m2.7 | 2/5 | 40% | 0 |
| glm-5.2 | 1/5 | 20% | 0 |
| deepseek-v4-pro | 0/5 | 0% | 0 |
Attempts
expand a row for the patch and logsdeepseek-v4-flash · rep 0 · accepted · 215→296 tok · $0.000073
no patch produced
deepseek-v4-flash · rep 0 · hidden_tests_failed · 159→610 tok · $0.00012
no patch produced
deepseek-v4-flash · rep 1 · hidden_tests_failed · 159→496 tok · $0.00010
no patch produced
deepseek-v4-flash · rep 1 · accepted · 215→450 tok · $0.00010
no patch produced
deepseek-v4-flash · rep 2 · hidden_tests_failed, smoke_failed · 215→771 tok · $0.00016
no patch produced
deepseek-v4-pro · rep 0 · hidden_tests_failed · 159→606 tok · $0.0006
no patch produced
deepseek-v4-pro · rep 0 · patch_apply_failed · 215→382 tok · $0.00043
no patch produced
deepseek-v4-pro · rep 1 · patch_apply_failed · 215→494 tok · $0.0005
no patch produced
deepseek-v4-pro · rep 1 · hidden_tests_failed · 159→357 tok · $0.00038
no patch produced
deepseek-v4-pro · rep 2 · patch_apply_failed · 215→596 tok · $0.0006
no patch produced
gemma4-26b · rep 0 · patch_apply_failed · 252→1834 tok · $0.0006
no patch produced
gemma4-26b · rep 0 · patch_apply_failed · 185→2835 tok · $0.0009
no patch produced
gemma4-26b · rep 0 · accepted · 252→3713 tok · $0.0012
no patch produced
gemma4-26b · rep 1 · accepted · 252→4816 tok · $0.0016
no patch produced
gemma4-26b · rep 1 · patch_apply_failed · 185→3203 tok · $0.0011
no patch produced
gemma4-26b · rep 1 · accepted · 252→2684 tok · $0.0009
no patch produced
gemma4-26b · rep 2 · patch_apply_failed · 252→2816 tok · $0.0009
no patch produced
gemma4-26b · rep 2 · accepted · 252→2280 tok · $0.0008
no patch produced
glm-5.2 · rep 0 · accepted · 222→308 tok · $0.0007
no patch produced
glm-5.2 · rep 0 · patch_apply_failed · 166→189 tok · $0.00043
no patch produced
glm-5.2 · rep 1 · patch_apply_failed · 222→6446 tok · $0.0115
no patch produced
glm-5.2 · rep 1 · patch_apply_failed · 166→544 tok · $0.0011
no patch produced
glm-5.2 · rep 2 · patch_apply_failed · 222→479 tok · $0.0010
no patch produced
kimi-k2.6 · rep 0 · patch_apply_failed · 167→2238 tok · $0.0077
no patch produced
kimi-k2.6 · rep 0 · patch_apply_failed · 222→12239 tok · $0.0419
no patch produced
kimi-k2.6 · rep 1 · patch_apply_failed · 167→16384 tok · $0.0560
no patch produced
kimi-k2.6 · rep 1 · accepted · 222→1564 tok · $0.0055
no patch produced
kimi-k2.6 · rep 2 · accepted · 222→2816 tok · $0.0097
no patch produced
minimax-m2.7 · rep 0 · accepted · 170→560 tok · $0.00043
no patch produced
minimax-m2.7 · rep 0 · accepted · 224→492 tok · $0.00039
no patch produced
minimax-m2.7 · rep 1 · hidden_tests_failed · 170→494 tok · $0.00039
no patch produced
minimax-m2.7 · rep 1 · patch_apply_failed · 224→624 tok · $0.00049
no patch produced
minimax-m2.7 · rep 2 · patch_apply_failed · 224→1002 tok · $0.0008
no patch produced
minimax-m3 · rep 0 · accepted · 380→814 tok · $0.0011
no patch produced
minimax-m3 · rep 0 · accepted · 326→968 tok · $0.0013
no patch produced
minimax-m3 · rep 1 · accepted · 326→978 tok · $0.0013
no patch produced
minimax-m3 · rep 1 · accepted · 380→981 tok · $0.0013
no patch produced
minimax-m3 · rep 2 · hidden_tests_failed, smoke_failed · 380→1595 tok · $0.0020
no patch produced
qwen3.6-27b · rep 0 · accepted · 236→3317 tok · $0.0080
no patch produced
qwen3.6-27b · rep 0 · accepted · 174→2463 tok · $0.0060
no patch produced
qwen3.6-27b · rep 1 · patch_apply_failed · 236→2997 tok · $0.0073
no patch produced
qwen3.6-27b · rep 1 · patch_apply_failed · 174→1928 tok · $0.0047
no patch produced
qwen3.6-27b · rep 2 · accepted · 236→3172 tok · $0.0077
no patch produced