← ChoreCode leaderboard · 20260706T163525Z

nextflow-orchestration-chore

Replace ad hoc subprocess orchestration with Nextflow

tiny_pipeline/runner.py runs items in parallel by manually spawning subprocesses in a Python loop. This project already uses Nextflow for orchestration. Replace the subprocess-based parallel loop in runner.py with a proper Nextflow DSL2 workflow in main.nf that reads items from params.input (a newline-delimited text file), defines a process PROCESS_ITEM, and fans out over each item using Channel.fromPath(params.input).splitText(). Remove the run_items function and the subprocess import from runner.py; keep items_from_file. Return a unified diff only.

Forbidden cheap shots: moving subprocess import inside a function to hide it from the module-level import check; keeping the parallel subprocess loop anywhere in runner.py; not creating a real Nextflow workflow in main.nf

Results by model

8 run configs
Run config Accepted Accept rate Hard fails
minimax-m3 3/3 100% 0
kimi-k2.6 2/3 67% 1
deepseek-v4-flash 0/3 0% 0
deepseek-v4-pro 0/3 0% 1
gemma4-26b 0/6 0% 2
glm-5.2 0/3 0% 0
minimax-m2.7 0/3 0% 0
qwen3.6-27b 0/3 0% 1

Attempts

expand a row for the patch and logs
deepseek-v4-flash · rep 0 · patch_apply_failed · 440→680 tok · $0.00016

no patch produced

deepseek-v4-flash · rep 1 · patch_apply_failed · 440→1825 tok · $0.00037

no patch produced

deepseek-v4-flash · rep 2 · patch_apply_failed · 440→2281 tok · $0.00045

no patch produced

deepseek-v4-pro · rep 0 · patch_apply_failed · 440→2771 tok · $0.0026

no patch produced

deepseek-v4-pro · rep 1 · patch_apply_failed · 440→1454 tok · $0.0015

no patch produced

deepseek-v4-pro · rep 2 · forbidden_pattern, hidden_tests_failed, smoke_failed · 440→1902 tok · $0.0018

no patch produced

gemma4-26b · rep 0 · patch_apply_failed · 484→9838 tok · $0.0033

no patch produced

gemma4-26b · rep 0 · patch_apply_failed · 484→10962 tok · $0.0036

no patch produced

gemma4-26b · rep 1 · forbidden_pattern, hidden_tests_failed, smoke_failed · 484→10938 tok · $0.0036

no patch produced

gemma4-26b · rep 1 · forbidden_pattern, hidden_tests_failed, smoke_failed · 484→11640 tok · $0.0039

no patch produced

gemma4-26b · rep 2 · patch_apply_failed · 484→10102 tok · $0.0034

no patch produced

gemma4-26b · rep 2 · patch_apply_failed · 484→9286 tok · $0.0031

no patch produced

glm-5.2 · rep 0 · patch_apply_failed · 434→626 tok · $0.0013

no patch produced

glm-5.2 · rep 1 · patch_apply_failed · 434→980 tok · $0.0020

no patch produced

glm-5.2 · rep 2 · patch_apply_failed · 434→924 tok · $0.0019

no patch produced

kimi-k2.6 · rep 0 · accepted · 432→12918 tok · $0.0443

no patch produced

kimi-k2.6 · rep 1 · forbidden_pattern, hidden_tests_failed, smoke_failed · 432→14136 tok · $0.0485

no patch produced

kimi-k2.6 · rep 2 · accepted · 432→12750 tok · $0.0438

no patch produced

minimax-m2.7 · rep 0 · patch_apply_failed · 432→34302 tok · $0.0248

no patch produced

minimax-m2.7 · rep 1 · patch_apply_failed · 432→953 tok · $0.0008

no patch produced

minimax-m2.7 · rep 2 · patch_apply_failed · 432→2897 tok · $0.0022

no patch produced

minimax-m3 · rep 0 · accepted · 588→15766 tok · $0.0191

no patch produced

minimax-m3 · rep 1 · accepted · 588→9261 tok · $0.0113

no patch produced

minimax-m3 · rep 2 · accepted · 588→11981 tok · $0.0146

no patch produced

qwen3.6-27b · rep 0 · forbidden_pattern, hidden_tests_failed, smoke_failed · 450→4505 tok · $0.0109

no patch produced

qwen3.6-27b · rep 1 · patch_apply_failed · 450→4883 tok · $0.0118

no patch produced

qwen3.6-27b · rep 2 · patch_apply_failed · 450→3950 tok · $0.0096

no patch produced