rsync 3.2.3 possible bug on md5sum
Hi, I'm using rsync in a script to perform backups (using hardlink). It works very well. In my case I use an alternative output format to retrieve md5hash for every synced file so that I can save the hash and run an integrity check when needed. I use this because I noticed that the md5sum printed from rsync is like file md5sum and this avoid me to calculate md5 checksum for every downloaded file and I can save time (specially in the first backup on large dataset). Currently I use this command: rsyc -avElHA --out-format"%i||%n||%C" source dest (well, I have reduced the original command to this to see if the problem was generated by an option. The original command include ssh option and timeout and other option) The problem: I noticed that using rsync 3.2.3 (protocol version 31) the md5 hash does not correspond to the md5 file hash so if I run a check I got corrupted file alerts. My current backup machine runs Debian 11.1 with rsync 3.2.3 (installed from debian repository) and it works in pull. The following rsync version is related to remote host. What I tested (I tested only trasferring one file of ~30MB with the previous command): Sync from Debian 11.1 | problem found | rsync 3.2.3 Sync from RockyLinux 8.4 | problem not found | rsync 3.1.3 Sync from Debian 10.11 | problem not found | rsync 3.1.3 Sync from Slackware15 (current) | problem found | rsync 3.2.3 Sync file locally | problem found | rsync 3.2.3 So this happens only when the remote host has rsync 3.2.3 while with rsync 3.1.3 no problem. I don't know if this is a bug or a new behaviour of the protocol. Any help will be appreciated. Thank you in advance. Alessandro. -- Please use reply-all for most replies to avoid omitting the mailing list. To unsubscribe or change options: https://lists.samba.org/mailman/listinfo/rsync Before posting, read: http://www.catb.org/~esr/faqs/smart-questions.html
[SOLVED] Re: rsync 3.2.3 possible bug on md5sum
On 29/10/21 11:07, Alessandro Baggi wrote: Hi, I'm using rsync in a script to perform backups (using hardlink). It works very well. In my case I use an alternative output format to retrieve md5hash for every synced file so that I can save the hash and run an integrity check when needed. I use this because I noticed that the md5sum printed from rsync is like file md5sum and this avoid me to calculate md5 checksum for every downloaded file and I can save time (specially in the first backup on large dataset). Currently I use this command: rsyc -avElHA --out-format"%i||%n||%C" source dest (well, I have reduced the original command to this to see if the problem was generated by an option. The original command include ssh option and timeout and other option) The problem: I noticed that using rsync 3.2.3 (protocol version 31) the md5 hash does not correspond to the md5 file hash so if I run a check I got corrupted file alerts. My current backup machine runs Debian 11.1 with rsync 3.2.3 (installed from debian repository) and it works in pull. The following rsync version is related to remote host. What I tested (I tested only trasferring one file of ~30MB with the previous command): Sync from Debian 11.1 | problem found | rsync 3.2.3 Sync from RockyLinux 8.4 | problem not found | rsync 3.1.3 Sync from Debian 10.11 | problem not found | rsync 3.1.3 Sync from Slackware15 (current) | problem found | rsync 3.2.3 Sync file locally | problem found | rsync 3.2.3 So this happens only when the remote host has rsync 3.2.3 while with rsync 3.1.3 no problem. I don't know if this is a bug or a new behaviour of the protocol. Any help will be appreciated. Thank you in advance. Alessandro. Hi, This is not a BUG. I read the manual page and found --checksum-choice option. Setting this to md5 will solve the problem. Thank you for your time. -- Please use reply-all for most replies to avoid omitting the mailing list. To unsubscribe or change options: https://lists.samba.org/mailman/listinfo/rsync Before posting, read: http://www.catb.org/~esr/faqs/smart-questions.html
[SCM] The rsync repository. - branch master updated
The branch, master has been updated
via 80c64dc3 Fix the ability to read the user's numeric locale.
from be3d6c0f Update the NEWS.
https://git.samba.org/?p=rsync.git;a=shortlog;h=master
- Log -
commit 80c64dc3b3e82c84ea52528722ee2db1567ab4c1
Author: Wayne Davison
Date: Fri Oct 29 20:06:06 2021 -0700
Fix the ability to read the user's numeric locale.
---
Summary of changes:
main.c | 1 +
1 file changed, 1 insertion(+)
Changeset truncated at 500 lines:
diff --git a/main.c b/main.c
index 361dbc4e..013a0555 100644
--- a/main.c
+++ b/main.c
@@ -1761,6 +1761,7 @@ int main(int argc,char *argv[])
#if defined CONFIG_LOCALE && defined HAVE_SETLOCALE
setlocale(LC_CTYPE, "");
+ setlocale(LC_NUMERIC, "");
#endif
if (!parse_arguments(, (const char ***) )) {
--
The rsync repository.
___
rsync-cvs mailing list
rsync-cvs@lists.samba.org
https://lists.samba.org/mailman/listinfo/rsync-cvs
