General question. I am trying to make the decision about which processes in my nextflow pipeline should utilize spot instances. As a part of this I would like to better understand how Nextflow logs spot instance interruptions? Is there specific information I can look for in the .command.log or trace…

Iam trying to make the decision about which processes in my nextflow pipeline should utilize spot instances. In theory, one should pick fault-tolerant workloads that can handle interruptions gracefully, or that are not expensive to fail. If you have an extremely long task that will cost a lot of …

Following up on Revant’s questions about spot instances & Nextflow, I have a few questions about how aws.batch.maxSpotAttempts works. If I set aws.batch.maxSpotAttempts to 0, launch a Nextflow pipeline run with AWS Batch, and then manually initiate a Spot Instance interruption ( AWS documentation …

AWS Batch: Spot Instance - How does Nextflow log an interruption?

Ask for help

mribeirodantas (Marcel Ribeiro-Dantas) February 4, 2025, 2:40am 4

Please do not ask new questions in other questions. I posted your reply as a new question authored by you here. I will close this topic now.

Topic		Replies	Views
How does aws.batch.maxSpotAttempts work? Ask for help nextflow , aws	1	138	February 4, 2025
Frequently failing runs using AWS Batch Spot Ask for help aws , platform	1	114	November 15, 2024
Enabling `-resume` and `-log` on AWS Batch Ask for help aws	1	87	September 18, 2024
Host EC2 Terminated Ask for help nextflow , platform	0	209	July 17, 2024
Timeout issue in nextflow process run on Azure batch Ask for help nextflow , multiqc	17	553	January 17, 2024

AWS Batch: Spot Instance - How does Nextflow log an interruption?

Related topics