Hi community -
I’m having trouble figuring out what the best way might be to handle this in Nextflow and somehow i never came upon this issue before:
Let’s say I have process1, process2, and process3 where process2 is dependent on the output of process1 and process3 is dependent on the output of process2. And let’s say the input to process1 has 10 elements (so process1 gets executed 10 times).
What i’m looking to avoid is process1 running 10 times in a row without executing process2 and process3; I’d like process2 and process3 executed first before it moves onto the second call of process1.
Is there a feature that would handle this in Nextflow or a recommended best practice for dealing with this situation?
Best Regards,
Steve
Edit: I’m already hip to maxForks but it still doesn’t stop 10 sequential process1 calls. process1 is downloading a lot of data and i was hoping to have it deleted after some downstream stuff runs.