You may also want to update Parallel since the version you have is so
old.
Joe
Mar 7, 2022 11:02:21 Juan Sierra Pons <j...@elsotanillo.net>:
I would look for the oom killer in dmesg/journal logs
https://sdk.rackspace.com/support/how-to/linux-out-of-memory-killer/
Hope it helps
Best regards
El lun, 7 mar 2022 15:08, Julien Gamba <jul...@jgamba.eu> escribió:
Hello,
I am using parallel to process a large amount of files. This morning I
found that it has crashed during the night.
Here is the message I get:
parallel: This should not happen. You have found a bug.
Please contact <parallel@gnu.org> and include:
* The version number: 20161222
* The bugid: swap_activity_file-r
* The command line being run
* The files being read (put the files on a webserver if they are big)
The command was:
parallel --bar --memfree 100G \
--noswap -j 100% \
./worker.sh :::: paths.csv
worker.sh does some pre-processing on the data and eventually launches
a
python script. It also redirects the error output with `2> foo.txt`
when
launching the python script if that is relevant.
paths.csv contains a list of file paths, one per line.
Unfortunately I am not a liberty to share the python script or the
files
being processed. I hope there is enough information here!
Happy to give more details if needed.
Thanks, and thanks for your work on this awesome tool!
-- Julien
