Automating my nextflow pipeline running on Azure batch

Hello everyone

i have been running my nextflow pipeline in Azure batch with sample fastq files stored in a ADLS storage container

Now i just need to automate this pipeline for the event whenever new samples are loaded in container specific directory

Can anyone guide me on this

The easiest way to do this would be with an Azure Function. You can configure an Azure Function to trigger once a file lands in Azure Blob storage, then kick off a Seqera platform hook (or indeed, any other API). It’s essentially free overheads and you will only pay for the very brief runtime which should be a few milliseconds.

Check out the Azure documentation for a Function triggered by a blob storage event here: Azure Blob storage trigger for Azure Functions | Microsoft Learn and the documentation for a Tower hook here:

1 Like