Breaking down CPU-hours of Nextflow run across processes?

When a Nextflow run completes, it helpfully reports the total duration of the run in CPU-hours. For profiling and cost-optimization purposes, it would be great to know how that breaks down across different processes. Is there a way to do this?

The trace report and nextflow log report a number of helpful information fields for each process in the run (e.g. duration, cpus, %cpu, …) that look like they should be able to be combined in some way to do this, but I haven’t managed to figure out quite how…

It turns out that the product of realtime and cpus gives this information, and I was just parsing the contents of realtime incorrectly!

1 Like

This topic was automatically closed 7 days after the last reply. New replies are no longer allowed.