Hi everyone,
Currently, I’m using trace.txt to get jobs’ status. This works well once tasks start executing. However, I’ve noticed that when jobs are still pending in the scheduler (for example, Slurm jobs in PD state due to cluster maintenance), trace.txt is empty since the jobs have not been started yet.
For example, squeue shows:
JOBID PARTITION NAME USER ST TIME NODES REASON
8313766 himem nf-CUTANDT cxt050 PD 0:00 1 ReqNodeNotAvail, Reserved for maintenance
Is there currently any way for Nextflow to query scheduler pending reasons?
Is there a recommended Nextflow way to monitor queued tasks without directly calling scheduler-specific commands such as squeue?
Thank you in advance for your help!
Cen