Your message dated Fri, 17 Mar 2017 15:17:53 +0000
with message-id <[email protected]>
and subject line Bug#799143: fixed in rsync 3.1.2-2
has caused the Debian Bug report #799143,
regarding rsync: --xattrs is extremely slow
to be marked as done.
This means that you claim that the problem has been dealt with.
If this is not the case it is now your responsibility to reopen the
Bug report if necessary, and/or fix the problem forthwith.
(NB: If you are a system administrator and have no idea what this
message is talking about, this may indicate a serious mail system
misconfiguration somewhere. Please contact [email protected]
immediately.)
--
799143: http://bugs.debian.org/cgi-bin/bugreport.cgi?bug=799143
Debian Bug Tracking System
Contact [email protected] with problems
--- Begin Message ---
Package: rsync
Version: 3.1.1-3
Severity: important
Dear Maintainer,
we use the following rsync call to create a daily incremental backup of
our servers:
rsync --delete --stats --numeric-ids -a -H -A -X
-e 'ssh -o BatchMode=yes'
--exclude-from=/some/file
--partial-dir=/mnt/.rsync-partial
--link-dest=/mnt/2015-09-14
10.0.0.99:/ /mnt/partial/
There is a Samba daemon running with "store dos attributes" = yes which
is needed to store the system/hidden attributes of Windows "desktop.ini"
files and creates the following xattrs:
# file: /home/test.user/test.txt
user.DOSATTRIB=0sMHgyMAAAAwADAAAAEQAAACAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAANzEdfAI79ABAAAAAAAAAAA=
One of our servers has 6M files with a complete size of 1.6 TB.
Without the -X option the rsync call takes about 1 hour,
with the -X option it takes 10 hours!!
Over the last year the rsync call took more and more time while Samba
was adding new xattrs.
The sending server has exactly 100% cpu load while running rsync while
the receiving server has only about 40%.
The problem appears with rsync 3.0.9-4 (wheezy) and 3.1.1-3 (squeeze).
Maybe this bug report from 2008 is related:
https://bugzilla.samba.org/show_bug.cgi?id=5324
-- System Information:
Debian Release: 7.9
APT prefers oldstable-updates
APT policy: (500, 'oldstable-updates'), (500, 'oldstable')
Architecture: i386 (x86_64)
Foreign Architectures: amd64
Kernel: Linux 3.14-0.bpo.2-amd64 (SMP w/8 CPU cores)
Locale: LANG=de_DE.UTF-8, LC_CTYPE=de_DE.UTF-8 (charmap=UTF-8)
Shell: /bin/sh linked to /bin/dash
Versions of packages rsync depends on:
ii base-files 7.1wheezy9
ii libacl1 2.2.51-8
ii libattr1 1:2.4.46-8
ii libc6 2.13-38+deb7u8
ii libpopt0 1.16-7
ii lsb-base 4.1+Debian8+deb7u1
rsync recommends no packages.
Versions of packages rsync suggests:
ii openssh-client 1:6.4p1-1~bpo70+1
ii openssh-server 1:6.4p1-1~bpo70+1
-- no debconf information
--
Mit freundlichen Grüßen,
Jörg Ludwig
IServ GmbH
Bültenweg 73
38106 Braunschweig
Telefon: 0531-2243666-0
Fax: 0531-2243666-9
Mobil: 0179-9101055
E-Mail: [email protected]
Internet: www.iserv.eu
USt.-IdNr.: DE265149425
--- End Message ---
--- Begin Message ---
Source: rsync
Source-Version: 3.1.2-2
We believe that the bug you reported is fixed in the latest version of
rsync, which is due to be installed in the Debian FTP archive.
A summary of the changes between this version and the previous one is
attached.
Thank you for reporting the bug, which will now be closed. If you
have further comments please address them to [email protected],
and the maintainer will reopen the bug report if appropriate.
Debian distribution maintenance software
pp.
Paul Slootman <[email protected]> (supplier of updated rsync package)
(This message was generated automatically at their request; if you
believe that there is a problem with it please contact the archive
administrators by mailing [email protected])
-----BEGIN PGP SIGNED MESSAGE-----
Hash: SHA256
Format: 1.8
Date: Fri, 17 Mar 2017 15:02:00 +0100
Source: rsync
Binary: rsync
Architecture: source amd64
Version: 3.1.2-2
Distribution: unstable
Urgency: medium
Maintainer: Paul Slootman <[email protected]>
Changed-By: Paul Slootman <[email protected]>
Description:
rsync - fast, versatile, remote (and local) file-copying tool
Closes: 749165 799143
Changes:
rsync (3.1.2-2) unstable; urgency=medium
.
* Added patch from upstream git to resolve temporary lines in --progress
output not being cleared.
closes:#749165
* Added patch from upstream git to speed up handling of xattrs.
closes:#799143
Checksums-Sha1:
46a1f9787bd1eeed1761d4cd5db27ed7ba46b116 1690 rsync_3.1.2-2.dsc
b621488571a3ddea6760141c5968394c684bf015 33892 rsync_3.1.2-2.debian.tar.xz
0b9afa3163c5a5c6ad3103100eeed311791e8bc3 4584 rsync_3.1.2-2_amd64.buildinfo
a0c35e8d2eb6f2c0aa7f65ce1594607deb3b0807 393520 rsync_3.1.2-2_amd64.deb
Checksums-Sha256:
4749c0d4c154b5da963da8b67239a1db91d93266f879f5a55855be992dfd619c 1690
rsync_3.1.2-2.dsc
a5e779c1c9a4764779c5cbee03fc469787154f4a56bcacfd34f20bd5ec52bf35 33892
rsync_3.1.2-2.debian.tar.xz
cd0137c6ba14494b45573d749506bf19e05ce3f92e2dc7c979cd7975b05515ab 4584
rsync_3.1.2-2_amd64.buildinfo
745049131f162ff45a6e115af06875d724bbb0ef6cf860ce61a16d0f6bcf088a 393520
rsync_3.1.2-2_amd64.deb
Files:
535a6cd05f45e4c0084263ad24b00d06 1690 net optional rsync_3.1.2-2.dsc
2ec16d34fd596236a0c528f9de1b51f6 33892 net optional rsync_3.1.2-2.debian.tar.xz
0647f1e31747b50ac1779f8498e3f2fe 4584 net optional
rsync_3.1.2-2_amd64.buildinfo
1af7d290fc38b6ec75a69aa2aaccd19a 393520 net optional rsync_3.1.2-2_amd64.deb
-----BEGIN PGP SIGNATURE-----
iQIzBAEBCAAdFiEEyfNP08AZcbxb9VhpMveNzq0RO4sFAljL7IgACgkQMveNzq0R
O4tVIxAAkOsGl7hSRWHJArwqBaG8MZBMr7fGzvCGB/tCBzP9WYapgxYxOozQVuZm
rDa/ZMGLUiGmR4gP3sfgCHUixVm90NSEf+kv3HMoxYRn802M34+U/c3BP48rHxjg
B/0QypCaxxW8gPZf/j5UBVkQzwPG00Qy+n2r1V9ue57vdQmCkSOqxTL+sFxsKl2y
BGp6vYZ70T02J/F3/yQ3zQSzKzWxy+I7P88X9dynzgZ0bo+lps45HlC3rJshCx/0
3eMSxSlOzW3/J6yX7z4/09nG4UZ0RoiiT1hjGIfkIxPMf7Icx8Tm2NDWrL22JdpA
79x3nvW0hEMoZJvH4NM+RcL18VBqWKKB0jpZXpdbnSK7NHtJ7AfVzuPKLEX4wKYQ
klkCBouFP4mS3XDgFzAXPK33wzfOtX8zSfVnP1rueJWLA3p+/3pAsHhPIiHm1RSM
Ea9RfMh95RRleZxSkgp8yLSR2WqI9eKNZPFp42ALYXgPTs297SSPsdKqUMB7PCBb
iCfmvRIcOphAwHhmuNccqmWjhVBPVhy1Wtu+6ual251cx9H7l6f25pqCVVwO/pgJ
inXf/OXhFnP4PTjHQP8V6nJ6xz8jk4PGA5QCmtyKJ4TSP4AyeVMfCc1QFFFymIiM
tnnukezUQqvpMcHu2fIbH0P3/gzvpckkro/mYZRo4i0I9tX0q3E=
=Q7ZM
-----END PGP SIGNATURE-----
--- End Message ---