Connecting / Chaining existing Nextflow workflows in a meta workflow

Tips & Tricks
1

nf-core and the wider Nextflow community have written some amazing workflows. Occasionally, users ask if there’s a way to daisy-chain existing Nextflow workflows together in a single workflow. One way to go about it is to use a native process in Nextflow to run each workflow as it’s own process, using
channels to connect the outputs and inputs of the workflows.

GitHub - mahesh-panchal/nf-cascade: A proof of concept daisy-chaining Nextflow workflows is one implementation of how to do so. This example chains together nf-core/fetchngs into both nf-core/taxprofiler and nf-core/mag, and then nf-core/mag into nf-core/funcscan.

2 Likes
2

This looks very interesting, we have the same problem in our team. We are using prefect to orchestrate our workloads ( nextflow + other kind of jobs ). I will give this a try, thanks!