I have a process X that is failing when running with a bigger dataset. One of the inputs is a list of files like this:
input: path('*')
and the process writes a bunch of files as an output. The same process is working for similar data and at first I though it could be a memory issue because of the following error:
But when changing to the work dir and running bash .command.run
I get the following message:
ln: failed to create symbolic link 'primary-f0-r6-c1-z0.tiff': File exists
Any ideas/suggestions on how to troubleshoot? Already tried giving more resources but in principle that should not matter. Many thanks for any feedback/suggestions!