Package: rsync
Version: 3.1.1-3
Severity: important

Dear Maintainer,

we use the following rsync call to create a daily incremental backup of our servers:

rsync --delete --stats --numeric-ids -a -H -A -X
  -e 'ssh -o BatchMode=yes'
  --exclude-from=/some/file
  --partial-dir=/mnt/.rsync-partial
  --link-dest=/mnt/2015-09-14
  10.0.0.99:/ /mnt/partial/

There is a Samba daemon running with "store dos attributes" = yes which is needed to store the system/hidden attributes of Windows "desktop.ini" files and creates the following xattrs:

# file: /home/test.user/test.txt
user.DOSATTRIB=0sMHgyMAAAAwADAAAAEQAAACAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAANzEdfAI79ABAAAAAAAAAAA=

One of our servers has 6M files with a complete size of 1.6 TB.
Without the -X option the rsync call takes about 1 hour,
with the -X option it takes 10 hours!!

Over the last year the rsync call took more and more time while Samba was adding new xattrs. The sending server has exactly 100% cpu load while running rsync while the receiving server has only about 40%.
The problem appears with rsync 3.0.9-4 (wheezy) and 3.1.1-3 (squeeze).

Maybe this bug report from 2008 is related:
https://bugzilla.samba.org/show_bug.cgi?id=5324


-- System Information:
Debian Release: 7.9
  APT prefers oldstable-updates
  APT policy: (500, 'oldstable-updates'), (500, 'oldstable')
Architecture: i386 (x86_64)
Foreign Architectures: amd64

Kernel: Linux 3.14-0.bpo.2-amd64 (SMP w/8 CPU cores)
Locale: LANG=de_DE.UTF-8, LC_CTYPE=de_DE.UTF-8 (charmap=UTF-8)
Shell: /bin/sh linked to /bin/dash

Versions of packages rsync depends on:
ii  base-files  7.1wheezy9
ii  libacl1     2.2.51-8
ii  libattr1    1:2.4.46-8
ii  libc6       2.13-38+deb7u8
ii  libpopt0    1.16-7
ii  lsb-base    4.1+Debian8+deb7u1

rsync recommends no packages.

Versions of packages rsync suggests:
ii  openssh-client  1:6.4p1-1~bpo70+1
ii  openssh-server  1:6.4p1-1~bpo70+1

-- no debconf information


--
Mit freundlichen Grüßen,

Jörg Ludwig

IServ GmbH
Bültenweg 73
38106 Braunschweig

Telefon:     0531-2243666-0
Fax:         0531-2243666-9
Mobil:       0179-9101055
E-Mail:      joerg.lud...@iserv.eu
Internet:    www.iserv.eu
USt.-IdNr.:  DE265149425

Reply via email to