Hello everyone
i have been running my nextflow pipeline in Azure batch with sample fastq files stored in a ADLS storage container
Now i just need to automate this pipeline for the event whenever new samples are loaded in container specific directory
Can anyone guide me on this
The easiest way to do this would be with an Azure Function. You can configure an Azure Function to trigger once a file lands in Azure Blob storage, then kick off a Seqera platform hook (or indeed, any other API). It’s essentially free overheads and you will only pay for the very brief runtime which should be a few milliseconds.
Check out the Azure documentation for a Function triggered by a blob storage event here: Azure Blob storage trigger for Azure Functions | Microsoft Learn and the documentation for a Tower hook here: https://docs.seqera.io/platform/23.3.0/pipeline-actions/overview#tower-launch-hooks.