Package: rsync
Version: 3.1.1-3
Severity: important
Dear Maintainer,
we use the following rsync call to create a daily incremental backup of
our servers:
rsync --delete --stats --numeric-ids -a -H -A -X
-e 'ssh -o BatchMode=yes'
--exclude-from=/some/file
--partial-dir=/mnt/.rsync-partial
--link-dest=/mnt/2015-09-14
10.0.0.99:/ /mnt/partial/
There is a Samba daemon running with "store dos attributes" = yes which
is needed to store the system/hidden attributes of Windows "desktop.ini"
files and creates the following xattrs:
# file: /home/test.user/test.txt
user.DOSATTRIB=0sMHgyMAAAAwADAAAAEQAAACAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAANzEdfAI79ABAAAAAAAAAAA=
One of our servers has 6M files with a complete size of 1.6 TB.
Without the -X option the rsync call takes about 1 hour,
with the -X option it takes 10 hours!!
Over the last year the rsync call took more and more time while Samba
was adding new xattrs.
The sending server has exactly 100% cpu load while running rsync while
the receiving server has only about 40%.
The problem appears with rsync 3.0.9-4 (wheezy) and 3.1.1-3 (squeeze).
Maybe this bug report from 2008 is related:
https://bugzilla.samba.org/show_bug.cgi?id=5324
-- System Information:
Debian Release: 7.9
APT prefers oldstable-updates
APT policy: (500, 'oldstable-updates'), (500, 'oldstable')
Architecture: i386 (x86_64)
Foreign Architectures: amd64
Kernel: Linux 3.14-0.bpo.2-amd64 (SMP w/8 CPU cores)
Locale: LANG=de_DE.UTF-8, LC_CTYPE=de_DE.UTF-8 (charmap=UTF-8)
Shell: /bin/sh linked to /bin/dash
Versions of packages rsync depends on:
ii base-files 7.1wheezy9
ii libacl1 2.2.51-8
ii libattr1 1:2.4.46-8
ii libc6 2.13-38+deb7u8
ii libpopt0 1.16-7
ii lsb-base 4.1+Debian8+deb7u1
rsync recommends no packages.
Versions of packages rsync suggests:
ii openssh-client 1:6.4p1-1~bpo70+1
ii openssh-server 1:6.4p1-1~bpo70+1
-- no debconf information
--
Mit freundlichen Grüßen,
Jörg Ludwig
IServ GmbH
Bültenweg 73
38106 Braunschweig
Telefon: 0531-2243666-0
Fax: 0531-2243666-9
Mobil: 0179-9101055
E-Mail: joerg.lud...@iserv.eu
Internet: www.iserv.eu
USt.-IdNr.: DE265149425