← ChoreCode leaderboard · 20260706T163525Z
nextflow-orchestration-chore
Replace ad hoc subprocess orchestration with Nextflow
tiny_pipeline/runner.py runs items in parallel by manually spawning subprocesses in a Python loop. This project already uses Nextflow for orchestration. Replace the subprocess-based parallel loop in runner.py with a proper Nextflow DSL2 workflow in main.nf that reads items from params.input (a newline-delimited text file), defines a process PROCESS_ITEM, and fans out over each item using Channel.fromPath(params.input).splitText(). Remove the run_items function and the subprocess import from runner.py; keep items_from_file. Return a unified diff only.
Forbidden cheap shots: moving subprocess import inside a function to hide it from the module-level import check; keeping the parallel subprocess loop anywhere in runner.py; not creating a real Nextflow workflow in main.nf
Results by model
8 run configs| Run config | Accepted | Accept rate | Hard fails |
|---|---|---|---|
| minimax-m3 | 3/3 | 100% | 0 |
| kimi-k2.6 | 2/3 | 67% | 1 |
| deepseek-v4-flash | 0/3 | 0% | 0 |
| deepseek-v4-pro | 0/3 | 0% | 1 |
| gemma4-26b | 0/6 | 0% | 2 |
| glm-5.2 | 0/3 | 0% | 0 |
| minimax-m2.7 | 0/3 | 0% | 0 |
| qwen3.6-27b | 0/3 | 0% | 1 |
Attempts
expand a row for the patch and logsdeepseek-v4-flash · rep 0 · patch_apply_failed · 440→680 tok · $0.00016
no patch produced
deepseek-v4-flash · rep 1 · patch_apply_failed · 440→1825 tok · $0.00037
no patch produced
deepseek-v4-flash · rep 2 · patch_apply_failed · 440→2281 tok · $0.00045
no patch produced
deepseek-v4-pro · rep 0 · patch_apply_failed · 440→2771 tok · $0.0026
no patch produced
deepseek-v4-pro · rep 1 · patch_apply_failed · 440→1454 tok · $0.0015
no patch produced
deepseek-v4-pro · rep 2 · forbidden_pattern, hidden_tests_failed, smoke_failed · 440→1902 tok · $0.0018
no patch produced
gemma4-26b · rep 0 · patch_apply_failed · 484→9838 tok · $0.0033
no patch produced
gemma4-26b · rep 0 · patch_apply_failed · 484→10962 tok · $0.0036
no patch produced
gemma4-26b · rep 1 · forbidden_pattern, hidden_tests_failed, smoke_failed · 484→10938 tok · $0.0036
no patch produced
gemma4-26b · rep 1 · forbidden_pattern, hidden_tests_failed, smoke_failed · 484→11640 tok · $0.0039
no patch produced
gemma4-26b · rep 2 · patch_apply_failed · 484→10102 tok · $0.0034
no patch produced
gemma4-26b · rep 2 · patch_apply_failed · 484→9286 tok · $0.0031
no patch produced
glm-5.2 · rep 0 · patch_apply_failed · 434→626 tok · $0.0013
no patch produced
glm-5.2 · rep 1 · patch_apply_failed · 434→980 tok · $0.0020
no patch produced
glm-5.2 · rep 2 · patch_apply_failed · 434→924 tok · $0.0019
no patch produced
kimi-k2.6 · rep 0 · accepted · 432→12918 tok · $0.0443
no patch produced
kimi-k2.6 · rep 1 · forbidden_pattern, hidden_tests_failed, smoke_failed · 432→14136 tok · $0.0485
no patch produced
kimi-k2.6 · rep 2 · accepted · 432→12750 tok · $0.0438
no patch produced
minimax-m2.7 · rep 0 · patch_apply_failed · 432→34302 tok · $0.0248
no patch produced
minimax-m2.7 · rep 1 · patch_apply_failed · 432→953 tok · $0.0008
no patch produced
minimax-m2.7 · rep 2 · patch_apply_failed · 432→2897 tok · $0.0022
no patch produced
minimax-m3 · rep 0 · accepted · 588→15766 tok · $0.0191
no patch produced
minimax-m3 · rep 1 · accepted · 588→9261 tok · $0.0113
no patch produced
minimax-m3 · rep 2 · accepted · 588→11981 tok · $0.0146
no patch produced
qwen3.6-27b · rep 0 · forbidden_pattern, hidden_tests_failed, smoke_failed · 450→4505 tok · $0.0109
no patch produced
qwen3.6-27b · rep 1 · patch_apply_failed · 450→4883 tok · $0.0118
no patch produced
qwen3.6-27b · rep 2 · patch_apply_failed · 450→3950 tok · $0.0096
no patch produced