← ChoreCode leaderboard · 20260706T163525Z
docstring-chore
Document slugify with a Google-style docstring
Add a Google-style docstring to tiny_docs.formatting.slugify: a one-line summary plus Args: and Returns: sections. Do not change the function's behavior. Return a unified diff only.
Forbidden cheap shots: modifying or deleting visible tests; assigning __doc__ dynamically instead of writing a docstring; changing slugify's behavior
Results by model
8 run configs| Run config | Accepted | Accept rate | Hard fails |
|---|---|---|---|
| gemma4-26b | 8/8 | 100% | 0 |
| kimi-k2.6 | 3/5 | 60% | 0 |
| minimax-m3 | 2/5 | 40% | 0 |
| qwen3.6-27b | 2/5 | 40% | 0 |
| deepseek-v4-pro | 1/5 | 20% | 0 |
| deepseek-v4-flash | 0/5 | 0% | 0 |
| glm-5.2 | 0/5 | 0% | 0 |
| minimax-m2.7 | 0/5 | 0% | 0 |
Attempts
expand a row for the patch and logsdeepseek-v4-flash · rep 0 · patch_apply_failed · 147→264 tok · $0.000061
no patch produced
deepseek-v4-flash · rep 0 · patch_apply_failed · 147→362 tok · $0.000078
no patch produced
deepseek-v4-flash · rep 1 · patch_apply_failed · 147→394 tok · $0.000084
no patch produced
deepseek-v4-flash · rep 1 · patch_apply_failed · 147→308 tok · $0.000069
no patch produced
deepseek-v4-flash · rep 2 · patch_apply_failed · 147→292 tok · $0.000066
no patch produced
deepseek-v4-pro · rep 0 · patch_apply_failed · 147→274 tok · $0.00030
no patch produced
deepseek-v4-pro · rep 0 · patch_apply_failed · 147→659 tok · $0.0006
no patch produced
deepseek-v4-pro · rep 1 · accepted · 147→282 tok · $0.00031
no patch produced
deepseek-v4-pro · rep 1 · existing_tests_failed, hidden_tests_failed, smoke_failed · 147→334 tok · $0.00035
no patch produced
deepseek-v4-pro · rep 2 · patch_apply_failed · 147→319 tok · $0.00034
no patch produced
gemma4-26b · rep 0 · accepted · 168→4539 tok · $0.0015
no patch produced
gemma4-26b · rep 0 · accepted · 168→2817 tok · $0.0009
no patch produced
gemma4-26b · rep 0 · accepted · 168→4175 tok · $0.0014
no patch produced
gemma4-26b · rep 1 · accepted · 168→3538 tok · $0.0012
no patch produced
gemma4-26b · rep 1 · accepted · 168→3660 tok · $0.0012
no patch produced
gemma4-26b · rep 1 · accepted · 168→4655 tok · $0.0015
no patch produced
gemma4-26b · rep 2 · accepted · 168→4558 tok · $0.0015
no patch produced
gemma4-26b · rep 2 · accepted · 168→3463 tok · $0.0012
no patch produced
glm-5.2 · rep 0 · patch_apply_failed · 152→540 tok · $0.0010
no patch produced
glm-5.2 · rep 0 · patch_apply_failed · 152→160 tok · $0.00037
no patch produced
glm-5.2 · rep 1 · patch_apply_failed · 152→122 tok · $0.00030
no patch produced
glm-5.2 · rep 1 · patch_apply_failed · 152→127 tok · $0.00031
no patch produced
glm-5.2 · rep 2 · patch_apply_failed · 152→150 tok · $0.00035
no patch produced
kimi-k2.6 · rep 0 · existing_tests_failed, hidden_tests_failed · 151→16384 tok · $0.0560
no patch produced
kimi-k2.6 · rep 0 · existing_tests_failed, hidden_tests_failed, smoke_failed · 151→1837 tok · $0.0064
no patch produced
kimi-k2.6 · rep 1 · accepted · 151→7474 tok · $0.0256
no patch produced
kimi-k2.6 · rep 1 · accepted · 151→10497 tok · $0.0359
no patch produced
kimi-k2.6 · rep 2 · accepted · 151→4650 tok · $0.0160
no patch produced
minimax-m2.7 · rep 0 · patch_apply_failed · 154→428 tok · $0.00034
no patch produced
minimax-m2.7 · rep 0 · existing_tests_failed, hidden_tests_failed · 0→403 tok · $0.00029
no patch produced
minimax-m2.7 · rep 1 · patch_apply_failed · 0→990 tok · $0.0007
no patch produced
minimax-m2.7 · rep 1 · patch_apply_failed · 0→465 tok · $0.00033
no patch produced
minimax-m2.7 · rep 2 · patch_apply_failed · 154→361 tok · $0.00029
no patch produced
minimax-m3 · rep 0 · patch_apply_failed · 310→451 tok · $0.0006
no patch produced
minimax-m3 · rep 0 · accepted · 310→301 tok · $0.00045
no patch produced
minimax-m3 · rep 1 · patch_apply_failed · 310→303 tok · $0.00046
no patch produced
minimax-m3 · rep 1 · accepted · 310→1405 tok · $0.0018
no patch produced
minimax-m3 · rep 2 · patch_apply_failed · 310→247 tok · $0.00039
no patch produced
qwen3.6-27b · rep 0 · patch_apply_failed · 157→2721 tok · $0.0066
no patch produced
qwen3.6-27b · rep 0 · accepted · 157→1791 tok · $0.0043
no patch produced
qwen3.6-27b · rep 1 · accepted · 157→1746 tok · $0.0042
no patch produced
qwen3.6-27b · rep 1 · patch_apply_failed · 157→2613 tok · $0.0063
no patch produced
qwen3.6-27b · rep 2 · patch_apply_failed · 157→1012 tok · $0.0025
no patch produced