Seems I have exceeded the limits of GNU Parallel.  When I remove the log
and resume it runs fine.   My job list is very big and so is the log:

[root@ceph-admin-prod1 work]# wc -l parallel.joblog
3701743 parallel.joblog

On Tue, Apr 12, 2022 at 10:59 AM Schweiss, Chip <c...@innovates.com> wrote:

> I'm using a parallel routine for running rsyncs I have used many times
> before, however, when running it today for the first time on a new system
> all runs hang with all the children processes in a zombie state.   This is
> on CentOS 7.9.
>
> Any clues as to why this would be happening?
>
> [root@ceph-admin-prod1 sync_hcpdb]# ps -ef |grep rsync
> root     196618 196498 33 10:42 pts/56   00:03:49 perl
> /usr/local/bin/parallel --jobs 40 --resume --joblog
> /ceph/hcpdb/sync_hcpdb/work/parallel.joblog --retries 3 --progress
> /ceph/hcpdb/sync_hcpdb/99rsync_job.sh {}
> root     205121 196618  0 10:46 pts/56   00:00:00 [99rsync_job.sh]
> <defunct>
> root     205122 196618  0 10:46 pts/56   00:00:00 [99rsync_job.sh]
> <defunct>
> root     205132 196618  0 10:46 pts/56   00:00:00 [99rsync_job.sh]
> <defunct>
> root     205142 196618  0 10:46 pts/56   00:00:00 [99rsync_job.sh]
> <defunct>
> root     205146 196618  0 10:46 pts/56   00:00:00 [99rsync_job.sh]
> <defunct>
> root     205151 196618  0 10:46 pts/56   00:00:00 [99rsync_job.sh]
> <defunct>
> root     205164 196618  0 10:46 pts/56   00:00:00 [99rsync_job.sh]
> <defunct>
> root     205177 196618  0 10:46 pts/56   00:00:00 [99rsync_job.sh]
> <defunct>
> root     205216 196618  0 10:46 pts/56   00:00:00 [99rsync_job.sh]
> <defunct>
> root     205290 196618  0 10:46 pts/56   00:00:00 [99rsync_job.sh]
> <defunct>
> root     205309 196618  0 10:46 pts/56   00:00:00 [99rsync_job.sh]
> <defunct>
> root     205330 196618  0 10:46 pts/56   00:00:00 [99rsync_job.sh]
> <defunct>
> root     205337 196618  0 10:46 pts/56   00:00:00 [99rsync_job.sh]
> <defunct>
> root     205340 196618  0 10:46 pts/56   00:00:00 [99rsync_job.sh]
> <defunct>
> root     205345 196618  0 10:46 pts/56   00:00:00 [99rsync_job.sh]
> <defunct>
> root     205349 196618  0 10:46 pts/56   00:00:00 [99rsync_job.sh]
> <defunct>
> root     205355 196618  0 10:46 pts/56   00:00:00 [99rsync_job.sh]
> <defunct>
> root     205362 196618  0 10:46 pts/56   00:00:00 [99rsync_job.sh]
> <defunct>
> root     205370 196618  0 10:46 pts/56   00:00:00 [99rsync_job.sh]
> <defunct>
> root     205380 196618  0 10:46 pts/56   00:00:00 [99rsync_job.sh]
> <defunct>
> root     205392 196618  0 10:46 pts/56   00:00:00 [99rsync_job.sh]
> <defunct>
> root     205401 196618  0 10:46 pts/56   00:00:00 [99rsync_job.sh]
> <defunct>
> root     205410 196618  0 10:46 pts/56   00:00:00 [99rsync_job.sh]
> <defunct>
> root     205420 196618  0 10:46 pts/56   00:00:00 [99rsync_job.sh]
> <defunct>
> root     220866 127054  0 10:53 pts/1    00:00:00 grep --color=auto rsync
> [root@ceph-admin-prod1 sync_hcpdb]# /usr/local/bin/parallel --version
> GNU parallel 20220322
> Copyright (C) 2007-2022 Ole Tange, http://ole.tange.dk and Free Software
> Foundation, Inc.
> License GPLv3+: GNU GPL version 3 or later <
> https://gnu.org/licenses/gpl.html>
> This is free software: you are free to change and redistribute it.
> GNU parallel comes with no warranty.
>
> Web site: https://www.gnu.org/software/parallel
>
> When using programs that use GNU Parallel to process data for publication
> please cite as described in 'parallel --citation'.
>
>
>

Reply via email to