Re: [BackupPC-users] Problem with WakupSchedule and Backupplan

2021-04-27 Thread Greg Harris 
Ralph,

I have a feeling that those who know are going to want to see a list of the 
relevant settings to get a better grasp on how things are set.  However, I have 
a suspicion that you are on the right track.  If a backup is missed, then it is 
put into the queue and it will start as soon as it is able to.  You may be able 
to use the blackout hours to help.

Thanks,

Greg Harris

On Apr 27, 2021, at 6:50 AM, Ralph Sikau 
mailto:ra...@hassun.de>> wrote:

Hi,

I hope that somebody can help. I'm lost with the parameters of WakeupSchedule 
and Backupplan.
My Intention is that BackupPC wakes up once at 3 pm to do the nightly Jobs and 
the backup of a host shall start shortly before midnight and run from then 
throughout the following night.
Whatever I try the backup of the host always starts at 3 pm. Is that because 
the 
BackupPCNightlyPeriod
 is set to 8 so that on days without doing nightly jobs the host backup starts 
instead? What's wrong here?
I also tried to start the backup jobs as cron jobs. That didn't work either.

Thanks for any assistance.

Ralph
___
BackupPC-users mailing list
BackupPC-users@lists.sourceforge.net
List:https://lists.sourceforge.net/lists/listinfo/backuppc-users
Wiki:https://github.com/backuppc/backuppc/wiki
Project: https://backuppc.github.io/backuppc/

___
BackupPC-users mailing list
BackupPC-users@lists.sourceforge.net
List:https://lists.sourceforge.net/lists/listinfo/backuppc-users
Wiki:https://github.com/backuppc/backuppc/wiki
Project: https://backuppc.github.io/backuppc/

[BackupPC-users] Problem with WakupSchedule and Backupplan

2021-04-27 Thread Ralph Sikau 
Hi,

I hope that somebody can help. I'm lost with the parameters
of WakeupSchedule and Backupplan.
My Intention is that BackupPC wakes up once at 3 pm to do
the nightly Jobs and the backup of a host shall start
shortly before midnight and run from then throughout the
following night.
Whatever I try the backup of the host always starts at 3 pm.
Is that because the BackupPCNightlyPeriod is set to 8 so
that on days without doing nightly jobs the host backup
starts instead? What's wrong here?
I also tried to start the backup jobs as cron jobs. That
didn't work either. 

Thanks for any assistance.

Ralph
___
BackupPC-users mailing list
BackupPC-users@lists.sourceforge.net
List:https://lists.sourceforge.net/lists/listinfo/backuppc-users
Wiki:https://github.com/backuppc/backuppc/wiki
Project: https://backuppc.github.io/backuppc/

Re: [BackupPC-users] ZFS very slow with BackupPC_refCountUpdate

2021-04-27 Thread Ghislain Adnet 

Le 27/04/2021 à 11:14, Alexander Moisseev via BackupPC-users a écrit :

On 27.04.2021 11:31, Ghislain Adnet wrote:


so we have lots of z_rd_int but its 
/usr/share/backuppc/bin/BackupPC_refCountUpdate that do all the io.



Do you still have BackupPC v3 pool? It may relate to hardlinks.


no those are fresh backuppc4 install compiled from the git repo, perhaps my 
setting on


$Conf{BackupPCNightlyPeriod} = 8;
$Conf{PoolSizeNightlyUpdatePeriod} = 16;
$Conf{PoolNightlyDigestCheckPercent} = 10;
$Conf{RefCntFsck} = 1;

perhaps this is $Conf{PoolNightlyDigestCheckPercent} = 10;,
i revert to 1 and see if it is the thing that is the problem, anyway this does 
not have any effect off this sort on ext4 or btrfs.


--
cordialement,
Ghislain


___
BackupPC-users mailing list
BackupPC-users@lists.sourceforge.net
List:https://lists.sourceforge.net/lists/listinfo/backuppc-users
Wiki:https://github.com/backuppc/backuppc/wiki
Project: https://backuppc.github.io/backuppc/

Re: [BackupPC-users] ZFS very slow with BackupPC_refCountUpdate

2021-04-27 Thread Alexander Moisseev via BackupPC-users 

On 27.04.2021 11:31, Ghislain Adnet wrote:


so we have lots of z_rd_int but its 
/usr/share/backuppc/bin/BackupPC_refCountUpdate that do all the io.



Do you still have BackupPC v3 pool? It may relate to hardlinks.


___
BackupPC-users mailing list
BackupPC-users@lists.sourceforge.net
List:https://lists.sourceforge.net/lists/listinfo/backuppc-users
Wiki:https://github.com/backuppc/backuppc/wiki
Project: https://backuppc.github.io/backuppc/

Re: [BackupPC-users] ZFS very slow with BackupPC_refCountUpdate

2021-04-27 Thread Ghislain Adnet 

Le 25/04/2021 à 15:57, Robert Trevellyan a écrit :

Have you maxed out the RAM? ZFS needs lots of RAM for best performance.




seems the ram is

  totalusedfree  shared  buff/cache   available
Mem:   15Gi14Gi   164Mi   2.0Mi   1.3Gi   1.2Gi


MemTotal:   16290736 kB
MemFree: 1314804 kB
MemAvailable:2502204 kB

Buffers:   69072 kB
Cached:   716212 kB
SwapCached:14976 kB
Active:   634184 kB
Inactive: 485584 kB
Active(anon): 222572 kB
Inactive(anon):   122732 kB
Active(file): 411612 kB
Inactive(file):   362852 kB
Unevictable:   19008 kB
Mlocked:   19008 kB
SwapTotal:523260 kB
SwapFree: 291260 kB
Dirty:   204 kB
Writeback: 0 kB
AnonPages:341624 kB
Mapped:   114900 kB
Shmem:  2608 kB
KReclaimable: 755220 kB
Slab:   11797212 kB
SReclaimable: 755220 kB
SUnreclaim: 11041992 kB
KernelStack:6624 kB
PageTables: 7240 kB
NFS_Unstable:  0 kB
Bounce:0 kB
WritebackTmp:  0 kB
CommitLimit: 8668628 kB
Committed_AS:1794232 kB
VmallocTotal:   34359738367 kB
VmallocUsed:  826024 kB
VmallocChunk:  0 kB
Percpu:12480 kB
HardwareCorrupted: 0 kB
AnonHugePages: 0 kB
ShmemHugePages:0 kB
ShmemPmdMapped:0 kB
FileHugePages: 0 kB
FilePmdMapped: 0 kB
HugePages_Total:   0
HugePages_Free:0
HugePages_Rsvd:0
HugePages_Surp:0
Hugepagesize:   2048 kB
Hugetlb:   0 kB
DirectMap4k:13276068 kB
DirectMap2M: 3395584 kB
DirectMap1G: 2097152 kB


mostly used by arc.

Total DISK READ:12.39 M/s | Total DISK WRITE: 0.00 B/s
Current DISK READ:   6.39 M/s | Current DISK WRITE:   0.00 B/s
TID  PRIO  USER DISK READ  DISK WRITE  SWAPIN IO>COMMAND
4180940 be/6 1000112   295.24 K/s0.00 B/s  0.00 % 99.99 % perl 
/usr/share/backuppc/bin/BackupPC_refCountUpdate -m -s -c -P 10 -r 10-15
4180868 be/6 1000112 2.56 M/s0.00 B/s  0.00 % 99.99 % perl 
/usr/share/backuppc/bin/BackupPC_refCountUpdate -m -s -c -P 10 -r 5-9
4180931 be/6 1000112 4.21 M/s0.00 B/s  0.00 % 99.99 % perl 
/usr/share/backuppc/bin/BackupPC_refCountUpdate -m -s -c -P 10 -r 26-31
4180961 be/6 1000112  1058.09 K/s0.00 B/s  0.00 % 99.99 % perl 
/usr/share/backuppc/bin/BackupPC_refCountUpdate -m -s -c -P 10 -r 16-20
4180966 be/6 1000112  1239.63 K/s0.00 B/s  0.00 % 99.99 % perl 
/usr/share/backuppc/bin/BackupPC_refCountUpdate -m -s -c -P 10 -r 0-4
4180937 be/6 1000112 2.64 M/s0.00 B/s  0.00 % 99.99 % perl 
/usr/share/backuppc/bin/BackupPC_refCountUpdate -m -s -c -P 10 -r 21-25
884 be/0 root   40.34 K/s0.00 B/s  0.00 %  0.00 % [z_rd_int]
885 be/0 root   33.01 K/s0.00 B/s  0.00 %  0.00 % [z_rd_int]
886 be/0 root   89.86 K/s0.00 B/s  0.00 %  0.00 % [z_rd_int]
887 be/0 root   90.77 K/s0.00 B/s  0.00 %  0.00 % [z_rd_int]
888 be/0 root   85.27 K/s0.00 B/s  0.00 %  0.00 % [z_rd_int]
889 be/0 root   50.43 K/s0.00 B/s  0.00 %  0.00 % [z_rd_int]
890 be/0 root   27.51 K/s0.00 B/s  0.00 %  0.00 % [z_rd_int]
891 be/0 root   45.84 K/s0.00 B/s  0.00 %  0.00 % [z_rd_int]


%Cpu(s):  0.1 us,  0.7 sy,  0.2 ni, 56.1 id, 43.0 wa,  0.0 hi,  0.0 si,  0.0 st

4180961 1000112   30  10   47704  35532   4036 D   1.3   0.2   0:02.73 
/usr/bin/perl /usr/share/backuppc/bin/BackupPC_refCountUpdate -m -s -c -P 10 -r 
16-20
4180940 1000112   30  10   47744  35496   3968 D   1.0   0.2   0:03.24 
/usr/bin/perl /usr/share/backuppc/bin/BackupPC_refCountUpdate -m -s -c -P 10 -r 
10-15
884 root   0 -20   0  0  0 S   0.7   0.0 203:37.50 
[z_rd_int]
886 root   0 -20   0  0  0 S   0.7   0.0 203:44.14 
[z_rd_int]
887 root   0 -20   0  0  0 S   0.7   0.0 203:42.38 
[z_rd_int]
889 root   0 -20   0  0  0 S   0.7   0.0 203:39.86 
[z_rd_int]
891 root   0 -20   0  0  0 S   0.7   0.0 203:41.30 
[z_rd_int]
885 root   0 -20   0  0  0 S   0.3   0.0 203:41.32 
[z_rd_int]
888 root   0 -20   0  0  0 S   0.3   0.0 203:46.68 
[z_rd_int]
890 root   0 -20   0  0  0 S   0.3   0.0 203:41.32 
[z_rd_int]


so we have lots of z_rd_int but its 
/usr/share/backuppc/bin/BackupPC_refCountUpdate that do all the io.

--
cordialement,
Ghislain



___
BackupPC-users mailing list
BackupPC-users@lists.sourceforge.net
List:https://lists.sourceforge.net/lists/listinfo/backuppc-users
Wiki:https://github.com/backuppc/backuppc/wiki
Project: https://backuppc.github.io/backuppc/