Hello,

I am using parallel to process a large amount of files. This morning I found that it has crashed during the night.

Here is the message I get:

parallel: This should not happen. You have found a bug.

Please contact <parallel@gnu.org> and include:

* The version number: 20161222

* The bugid: swap_activity_file-r

* The command line being run

* The files being read (put the files on a webserver if they are big)


The command was:

        parallel --bar --memfree 100G   \
                 --noswap -j 100%       \
                ./worker.sh :::: paths.csv

worker.sh does some pre-processing on the data and eventually launches a python script. It also redirects the error output with `2> foo.txt` when launching the python script if that is relevant.

paths.csv contains a list of file paths, one per line.

Unfortunately I am not a liberty to share the python script or the files being processed. I hope there is enough information here!

Happy to give more details if needed.
Thanks, and thanks for your work on this awesome tool!

-- Julien

Reply via email to