Seems I have exceeded the limits of GNU Parallel. When I remove the log
and resume it runs fine. My job list is very big and so is the log:
[root@ceph-admin-prod1 work]# wc -l parallel.joblog
3701743 parallel.joblog
On Tue, Apr 12, 2022 at 10:59 AM Schweiss, Chip <c...@innovates.com> wrote:
> I'm using a parallel routine for running rsyncs I have used many times
> before, however, when running it today for the first time on a new system
> all runs hang with all the children processes in a zombie state. This is
> on CentOS 7.9.
>
> Any clues as to why this would be happening?
>
> [root@ceph-admin-prod1 sync_hcpdb]# ps -ef |grep rsync
> root 196618 196498 33 10:42 pts/56 00:03:49 perl
> /usr/local/bin/parallel --jobs 40 --resume --joblog
> /ceph/hcpdb/sync_hcpdb/work/parallel.joblog --retries 3 --progress
> /ceph/hcpdb/sync_hcpdb/99rsync_job.sh {}
> root 205121 196618 0 10:46 pts/56 00:00:00 [99rsync_job.sh]
> <defunct>
> root 205122 196618 0 10:46 pts/56 00:00:00 [99rsync_job.sh]
> <defunct>
> root 205132 196618 0 10:46 pts/56 00:00:00 [99rsync_job.sh]
> <defunct>
> root 205142 196618 0 10:46 pts/56 00:00:00 [99rsync_job.sh]
> <defunct>
> root 205146 196618 0 10:46 pts/56 00:00:00 [99rsync_job.sh]
> <defunct>
> root 205151 196618 0 10:46 pts/56 00:00:00 [99rsync_job.sh]
> <defunct>
> root 205164 196618 0 10:46 pts/56 00:00:00 [99rsync_job.sh]
> <defunct>
> root 205177 196618 0 10:46 pts/56 00:00:00 [99rsync_job.sh]
> <defunct>
> root 205216 196618 0 10:46 pts/56 00:00:00 [99rsync_job.sh]
> <defunct>
> root 205290 196618 0 10:46 pts/56 00:00:00 [99rsync_job.sh]
> <defunct>
> root 205309 196618 0 10:46 pts/56 00:00:00 [99rsync_job.sh]
> <defunct>
> root 205330 196618 0 10:46 pts/56 00:00:00 [99rsync_job.sh]
> <defunct>
> root 205337 196618 0 10:46 pts/56 00:00:00 [99rsync_job.sh]
> <defunct>
> root 205340 196618 0 10:46 pts/56 00:00:00 [99rsync_job.sh]
> <defunct>
> root 205345 196618 0 10:46 pts/56 00:00:00 [99rsync_job.sh]
> <defunct>
> root 205349 196618 0 10:46 pts/56 00:00:00 [99rsync_job.sh]
> <defunct>
> root 205355 196618 0 10:46 pts/56 00:00:00 [99rsync_job.sh]
> <defunct>
> root 205362 196618 0 10:46 pts/56 00:00:00 [99rsync_job.sh]
> <defunct>
> root 205370 196618 0 10:46 pts/56 00:00:00 [99rsync_job.sh]
> <defunct>
> root 205380 196618 0 10:46 pts/56 00:00:00 [99rsync_job.sh]
> <defunct>
> root 205392 196618 0 10:46 pts/56 00:00:00 [99rsync_job.sh]
> <defunct>
> root 205401 196618 0 10:46 pts/56 00:00:00 [99rsync_job.sh]
> <defunct>
> root 205410 196618 0 10:46 pts/56 00:00:00 [99rsync_job.sh]
> <defunct>
> root 205420 196618 0 10:46 pts/56 00:00:00 [99rsync_job.sh]
> <defunct>
> root 220866 127054 0 10:53 pts/1 00:00:00 grep --color=auto rsync
> [root@ceph-admin-prod1 sync_hcpdb]# /usr/local/bin/parallel --version
> GNU parallel 20220322
> Copyright (C) 2007-2022 Ole Tange, http://ole.tange.dk and Free Software
> Foundation, Inc.
> License GPLv3+: GNU GPL version 3 or later <
> https://gnu.org/licenses/gpl.html>
> This is free software: you are free to change and redistribute it.
> GNU parallel comes with no warranty.
>
> Web site: https://www.gnu.org/software/parallel
>
> When using programs that use GNU Parallel to process data for publication
> please cite as described in 'parallel --citation'.
>
>
>
