← ChoreCode leaderboard · 20260706T163525Z
dependency_discipline
2 public chores · 5/48 accepted · 0 hard fails
Tasks
category coverage| Task | Title | Accepted | Hard fails |
|---|---|---|---|
| dependency-existing-retry-chore | Use the existing retry dependency | 0/24 (0%) | 0 |
| dependency-stdlib-query-chore | Decode query strings with the standard library | 5/24 (21%) | 0 |
Results
model × taskAttempts
evidence for this categorydependency-existing-retry-chore · deepseek-v4-flash · rep 0 · patch_apply_failed · 294→662 tok · $0.00015
no patch produced
dependency-existing-retry-chore · deepseek-v4-flash · rep 1 · patch_apply_failed · 294→369 tok · $0.000093
no patch produced
dependency-existing-retry-chore · deepseek-v4-flash · rep 2 · patch_apply_failed · 294→781 tok · $0.00017
no patch produced
dependency-stdlib-query-chore · deepseek-v4-flash · rep 0 · patch_apply_failed · 284→277 tok · $0.000075
no patch produced
dependency-stdlib-query-chore · deepseek-v4-flash · rep 1 · patch_apply_failed · 284→337 tok · $0.000086
no patch produced
dependency-stdlib-query-chore · deepseek-v4-flash · rep 2 · accepted · 284→436 tok · $0.00010
no patch produced
dependency-existing-retry-chore · deepseek-v4-pro · rep 0 · patch_apply_failed · 294→1403 tok · $0.0013
no patch produced
dependency-existing-retry-chore · deepseek-v4-pro · rep 1 · patch_apply_failed · 294→640 tok · $0.0007
no patch produced
dependency-existing-retry-chore · deepseek-v4-pro · rep 2 · patch_apply_failed · 294→1051 tok · $0.0010
no patch produced
dependency-stdlib-query-chore · deepseek-v4-pro · rep 0 · patch_apply_failed · 284→748 tok · $0.0008
no patch produced
dependency-stdlib-query-chore · deepseek-v4-pro · rep 1 · patch_apply_failed · 284→392 tok · $0.00046
no patch produced
dependency-stdlib-query-chore · deepseek-v4-pro · rep 2 · accepted · 284→514 tok · $0.0006
no patch produced
dependency-existing-retry-chore · gemma4-26b · rep 0 · existing_tests_failed, hidden_tests_failed, smoke_failed · 315→6441 tok · $0.0021
no patch produced
dependency-existing-retry-chore · gemma4-26b · rep 1 · existing_tests_failed, hidden_tests_failed, smoke_failed · 315→4424 tok · $0.0015
no patch produced
dependency-existing-retry-chore · gemma4-26b · rep 2 · existing_tests_failed, hidden_tests_failed, smoke_failed · 315→8253 tok · $0.0027
no patch produced
dependency-stdlib-query-chore · gemma4-26b · rep 0 · patch_apply_failed · 319→11394 tok · $0.0038
no patch produced
dependency-stdlib-query-chore · gemma4-26b · rep 1 · accepted · 319→9665 tok · $0.0032
no patch produced
dependency-stdlib-query-chore · gemma4-26b · rep 2 · patch_apply_failed · 319→2668 tok · $0.0009
no patch produced
dependency-existing-retry-chore · glm-5.2 · rep 0 · existing_tests_failed, hidden_tests_failed, smoke_failed · 282→564 tok · $0.0012
no patch produced
dependency-existing-retry-chore · glm-5.2 · rep 1 · existing_tests_failed, hidden_tests_failed, smoke_failed · 282→528 tok · $0.0011
no patch produced
dependency-existing-retry-chore · glm-5.2 · rep 2 · patch_apply_failed · 282→683 tok · $0.0014
no patch produced
dependency-stdlib-query-chore · glm-5.2 · rep 0 · patch_apply_failed · 278→551 tok · $0.0011
no patch produced
dependency-stdlib-query-chore · glm-5.2 · rep 1 · patch_apply_failed · 278→2473 tok · $0.0045
no patch produced
dependency-stdlib-query-chore · glm-5.2 · rep 2 · patch_apply_failed · 278→906 tok · $0.0018
no patch produced
dependency-existing-retry-chore · kimi-k2.6 · rep 0 · existing_tests_failed, hidden_tests_failed, smoke_failed · 278→7249 tok · $0.0249
no patch produced
dependency-existing-retry-chore · kimi-k2.6 · rep 1 · existing_tests_failed, hidden_tests_failed, smoke_failed · 278→5040 tok · $0.0174
no patch produced
dependency-existing-retry-chore · kimi-k2.6 · rep 2 · existing_tests_failed, hidden_tests_failed, smoke_failed · 278→4108 tok · $0.0142
no patch produced
dependency-stdlib-query-chore · kimi-k2.6 · rep 0 · accepted · 274→4112 tok · $0.0142
no patch produced
dependency-stdlib-query-chore · kimi-k2.6 · rep 1 · accepted · 274→4376 tok · $0.0151
no patch produced
dependency-stdlib-query-chore · kimi-k2.6 · rep 2 · patch_apply_failed · 274→2264 tok · $0.0079
no patch produced
dependency-existing-retry-chore · minimax-m2.7 · rep 0 · patch_apply_failed · 281→918 tok · $0.0007
no patch produced
dependency-existing-retry-chore · minimax-m2.7 · rep 1 · patch_apply_failed · 281→911 tok · $0.0007
no patch produced
dependency-existing-retry-chore · minimax-m2.7 · rep 2 · existing_tests_failed, hidden_tests_failed, smoke_failed · 281→1444 tok · $0.0011
no patch produced
dependency-stdlib-query-chore · minimax-m2.7 · rep 0 · patch_apply_failed · 276→569 tok · $0.00046
no patch produced
dependency-stdlib-query-chore · minimax-m2.7 · rep 1 · patch_apply_failed · 276→403 tok · $0.00034
no patch produced
dependency-stdlib-query-chore · minimax-m2.7 · rep 2 · patch_apply_failed · 276→526 tok · $0.00043
no patch produced
dependency-existing-retry-chore · minimax-m3 · rep 0 · patch_apply_failed · 437→1582 tok · $0.0020
no patch produced
dependency-existing-retry-chore · minimax-m3 · rep 1 · existing_tests_failed, hidden_tests_failed, smoke_failed · 437→7218 tok · $0.0088
no patch produced
dependency-existing-retry-chore · minimax-m3 · rep 2 · existing_tests_failed, hidden_tests_failed, smoke_failed · 437→1139 tok · $0.0015
no patch produced
dependency-stdlib-query-chore · minimax-m3 · rep 0 · patch_apply_failed · 432→552 tok · $0.0008
no patch produced
dependency-stdlib-query-chore · minimax-m3 · rep 1 · patch_apply_failed · 432→722 tok · $0.0010
no patch produced
dependency-stdlib-query-chore · minimax-m3 · rep 2 · patch_apply_failed · 432→1817 tok · $0.0023
no patch produced
dependency-existing-retry-chore · qwen3.6-27b · rep 0 · patch_apply_failed · 301→4977 tok · $0.0120
no patch produced
dependency-existing-retry-chore · qwen3.6-27b · rep 1 · patch_apply_failed · 301→4557 tok · $0.0110
no patch produced
dependency-existing-retry-chore · qwen3.6-27b · rep 2 · patch_apply_failed · 301→4910 tok · $0.0119
no patch produced
dependency-stdlib-query-chore · qwen3.6-27b · rep 0 · patch_apply_failed · 296→1987 tok · $0.0049
no patch produced
dependency-stdlib-query-chore · qwen3.6-27b · rep 1 · patch_apply_failed · 296→2318 tok · $0.0056
no patch produced
dependency-stdlib-query-chore · qwen3.6-27b · rep 2 · patch_apply_failed · 296→2973 tok · $0.0072
no patch produced