# The second process is not being executed frequently enough compare to the first process

**URL:** <https://community.seqera.io/t/the-second-process-is-not-being-executed-frequently-enough-compare-to-the-first-process/2114>\
**Category:** Ask for help\
**Tags:** nextflow\
**Created:** [May 7, 2025, 7:28am UTC](https://community.seqera.io/t/the-second-process-is-not-being-executed-frequently-enough-compare-to-the-first-process/2114 "2025-05-07T07:28:55Z")\
**Posts on this page:** 4\
**Page:** 1

<div class="post-metadata">

**Author:** ![CryALotz](https://dub1.discourse-cdn.com/flex013/user_avatar/community.seqera.io/cryalotz/32/1796_2.png) [@CryALotz](https://community.seqera.io/u/CryALotz)\
**Post date:** [May 7, 2025, 7:28am UTC](https://community.seqera.io/t/the-second-process-is-not-being-executed-frequently-enough-compare-to-the-first-process/2114/1 "2025-05-07T07:28:55Z")

</div>

Hello,

here is some part of my workflow:

```auto
    def input_channel = Channel.from(file_list)
        .filter { 
            def sampleId = it[0].toString()
                
            return !(filter_list.contains(sampleId))
        }

    def downloader_input = input_channel.map{
            tuple(it[0], it[1])
        }	

def cramfile = Downloader(downloader_input)

def downloaded_cram = cramfile.combine(input_channel, by: 0)

def check_sum_input = downloaded_cram
        .map{
            def sampleId = it[0]
            def file_path = it[1]
            def checksum = it[-1]
            tuple(sampleId, file_path, checksum)
        }

def check_result = Checksum(check_sum_input)

```

After running my Nextflow workflow, it seems to heavily prioritize the `Downloader` process. I noticed that although around 50 `Downloader` tasks have finished, only 2 downstream processes have been executed so far.

What I would prefer is for the pipeline to prioritize progressing through the entire workflow, rather than focusing mostly on the first process. How can I adjust the execution behavior to achieve this?

---

<div class="post-metadata">

**Author:** ![mahesh.binzerpanchal](https://dub1.discourse-cdn.com/flex013/user_avatar/community.seqera.io/mahesh.binzerpanchal/32/253_2.png) [@mahesh.binzerpanchal](https://community.seqera.io/u/mahesh.binzerpanchal)\
**Post date:** [May 7, 2025, 9:21am UTC](https://community.seqera.io/t/the-second-process-is-not-being-executed-frequently-enough-compare-to-the-first-process/2114/2 "2025-05-07T09:21:29Z")

</div>

You can use the `maxForks` directives to make sure there are cpus available for other processes to start. Nextflow will simply go through the script and fire off as many jobs as it can, and schedule them according to available resources (if not using an external scheduler). As long as `process.withName:Downloader.(maxForks * cpus)` is less than the available cpus, it’ll leave space for the remaining tasks to get in an execute.

---

<div class="post-metadata">

**Author:** ![CryALotz](https://dub1.discourse-cdn.com/flex013/user_avatar/community.seqera.io/cryalotz/32/1796_2.png) [@CryALotz](https://community.seqera.io/u/CryALotz)\
**Post date:** [May 8, 2025, 1:09am UTC](https://community.seqera.io/t/the-second-process-is-not-being-executed-frequently-enough-compare-to-the-first-process/2114/3 "2025-05-08T01:09:28Z")

</div>

I try to set `maxForks ` of Downloader less than other process

here some part of my `.config` file :

```auto
process {
  cache = 'lenient'
  executor = 'slurm'
  queue = 'memory'
  maxForks = 10
  withName: Downloader {
    maxForks = 1
  }

executor {
    queueSize = 20
}
}

```

It’s getting better, but still only around 50% of the completed `Downloader` tasks are triggering the downstream process.

A couple of things I think might be affecting this:

```auto
export NXF_OPTS='-Xms4g -Xmx8g'

```

and also channel is more than thousand.

---

<div class="post-metadata">

**Author:** ![mahesh.binzerpanchal](https://dub1.discourse-cdn.com/flex013/user_avatar/community.seqera.io/mahesh.binzerpanchal/32/253_2.png) [@mahesh.binzerpanchal](https://community.seqera.io/u/mahesh.binzerpanchal)\
**Post date:** [May 8, 2025, 6:48am UTC](https://community.seqera.io/t/the-second-process-is-not-being-executed-frequently-enough-compare-to-the-first-process/2114/4 "2025-05-08T06:48:57Z")

</div>

I think since you have some data on how long the processes are taking, you can probably refine that `maxForks` a bit more along with `cpus`/`memory` to get a better balance if you think it’s not optimal. Perhaps try with Seqera’s AI to see if it can read the `.nextflow.log` and achieve a better optimization profile.