[Desktop-packages] [Bug 662442] Re: restore fails with "librsync error 103 while in patch cycle"
*** This bug is a duplicate of bug 1252484 ***
https://bugs.launchpad.net/bugs/1252484
Hi,
I am not sure if this is related, but I am certainly hoping someone can
assist
I'm struggling to restore backups from an older installation of Ubuntu
to a new installation on Ubuntu 16.04. I get the following error when
trying to restore:
Failed with an unknown error Followed by:
Traceback (most recent call last):
File "/usr/bin/duplicity", line 1532, in
with_tempdir(main)
File "/usr/bin/duplicity", line 1526, in with_tempdir
fn()
File "/usr/bin/duplicity", line 1380, in main
do_backup(action)
File "/usr/bin/duplicity", line 1461, in do_backup
list_current(col_stats)
File "/usr/bin/duplicity", line 698, in list_current
for path in path_iter:
File "/usr/lib/python2.7/dist-packages/duplicity/diffdir.py", line 354, in
combine_path_iters
refresh_triple_list(triple_list)
File "/usr/lib/python2.7/dist-packages/duplicity/diffdir.py", line 341, in
refresh_triple_list
new_triple = get_triple(old_triple[1])
File "/usr/lib/python2.7/dist-packages/duplicity/diffdir.py", line 327, in
get_triple
path = path_iter_list[iter_index].next()
File "/usr/lib/python2.7/dist-packages/duplicity/diffdir.py", line 239, in
sigtar2path_iter
for tarinfo in tf:
File "/usr/lib/python2.7/tarfile.py", line 2508, in next
tarinfo = self.tarfile.next()
File "/usr/lib/python2.7/tarfile.py", line 2350, in next
raise ReadError("unexpected end of data")
ReadError: unexpected end of data
The backup completed successfully but I cannot get it to restore.
Thanks in advance!
--
You received this bug notification because you are a member of Desktop
Packages, which is subscribed to duplicity in Ubuntu.
https://bugs.launchpad.net/bugs/662442
Title:
restore fails with "librsync error 103 while in patch cycle"
Status in Duplicity:
Confirmed
Status in duplicity package in Ubuntu:
Confirmed
Bug description:
I'm doing a trial restore from an sftp backup, and it fails like so:
Writing
.bazaar/plugins/svn/backup.bzr/repository/packs/5e32df252c6c9b80b70d63cab2a52f1a.pack
of type reg
Deleting /tmp/duplicity-4I6eKU-tempdir/mktemp-B5f55D-4
Processed volume 2 of 2531
Running 'sftp -oServerAliveInterval=15 -oServerAliveCountMax=2 mbp@grace'
(attempt #1)
sftp command: 'get
"/backup/lithe/home_mbp.duplicity//duplicity-inc.20100210T222519Z.to.20100429T235919Z.vol2.difftar.gz"
"/tmp/duplicity-4I6eKU-tempdir/mktemp-7d1sNq-22"'
Writing .bazaar/plugins/svn/backup.bzr/repository/upload of type dir
..
Writing .byobu/status of type reg
Writing .byobu/windows of type reg
python: ERROR: (rs_file_copy_cb) unexpected eof on fd23
python: ERROR: (rs_job_complete) patch job failed: unexpected end of input
Traceback (most recent call last):
File "/home/mbp/work/duplicity/duplicity-bin", line 1245, in
with_tempdir(main)
File "/home/mbp/work/duplicity/duplicity-bin", line 1238, in with_tempdir
fn()
File "/home/mbp/work/duplicity/duplicity-bin", line 1192, in main
restore(col_stats)
File "/home/mbp/work/duplicity/duplicity-bin", line 539, in restore
restore_get_patched_rop_iter(col_stats)):
File "/home/mbp/work/duplicity/duplicity/patchdir.py", line 520, in
Write_ROPaths
for ropath in rop_iter:
File "/home/mbp/work/duplicity/duplicity/patchdir.py", line 493, in
integrate_patch_iters
final_ropath = patch_seq2ropath( normalize_ps( patch_seq ) )
File "/home/mbp/work/duplicity/duplicity/patchdir.py", line 473, in
patch_seq2ropath
misc.copyfileobj( current_file, tempfp )
File "/home/mbp/work/duplicity/duplicity/misc.py", line 166, in copyfileobj
buf = infp.read(blocksize)
File "/home/mbp/work/duplicity/duplicity/librsync.py", line 80, in read
self._add_to_outbuf_once()
File "/home/mbp/work/duplicity/duplicity/librsync.py", line 94, in
_add_to_outbuf_once
raise librsyncError(str(e))
librsyncError: librsync error 103 while in patch cycle
~/work/duplicity/duplicity-bin -v7 --no-encrypt restore ~/tmp/grace-
restore 30.59s user 5.18s system 49% cpu 1:11.81 total
Using the tip of the 0.6 branch on Ubuntu Maverick.
I think I've seen this once before too.
The 'unexpected eof' error suggests that one of the increment files
could be truncated, but that doesn't seem likely: I haven't had any
filesystem problems, and at the gzip level all of them seem to be ok.
To manage notifications about this bug go to:
https://bugs.launchpad.net/duplicity/+bug/662442/+subscriptions
--
Mailing list: https://launchpad.net/~desktop-packages
Post to : desktop-packages@lists.launchpad.net
Unsubscribe : https://launchpad.net/~desktop-packages
More help : https://help.launchpad.net/ListHelp
[Desktop-packages] [Bug 662442] Re: restore fails with librsync error 103 while in patch cycle
*** This bug is a duplicate of bug 1252484 *** https://bugs.launchpad.net/bugs/1252484 Good news! I've confirmed this is the same underlying issue as bug 1252484 (which I will mark this bug a duplicate of). This is just one of its symptoms. I've attached the file 'test5.sh' which when run like 'sh test5.sh' should reliably reproduce this exception. This bug has been fixed in duplicity trunk (and Ubuntu 13.10+). The fix will be in the upcoming duplicity 0.6.23 release. I've prepared fixes for older Ubuntu releases, but the updates need testers before they can be released to everyone. If you are an Ubuntu user of an older release, please go to bug 1252484 and follow the instructions for testing the update. Thanks! ** Attachment added: test5.sh https://bugs.launchpad.net/duplicity/+bug/662442/+attachment/3925044/+files/test5.sh ** This bug has been marked a duplicate of bug 1252484 Possible data loss when restarting in the middle of a deleted file -- You received this bug notification because you are a member of Desktop Packages, which is subscribed to duplicity in Ubuntu. https://bugs.launchpad.net/bugs/662442 Title: restore fails with librsync error 103 while in patch cycle Status in Duplicity - Bandwidth Efficient Encrypted Backup: Confirmed Status in “duplicity” package in Ubuntu: Confirmed Bug description: I'm doing a trial restore from an sftp backup, and it fails like so: Writing .bazaar/plugins/svn/backup.bzr/repository/packs/5e32df252c6c9b80b70d63cab2a52f1a.pack of type reg Deleting /tmp/duplicity-4I6eKU-tempdir/mktemp-B5f55D-4 Processed volume 2 of 2531 Running 'sftp -oServerAliveInterval=15 -oServerAliveCountMax=2 mbp@grace' (attempt #1) sftp command: 'get /backup/lithe/home_mbp.duplicity//duplicity-inc.20100210T222519Z.to.20100429T235919Z.vol2.difftar.gz /tmp/duplicity-4I6eKU-tempdir/mktemp-7d1sNq-22' Writing .bazaar/plugins/svn/backup.bzr/repository/upload of type dir .. Writing .byobu/status of type reg Writing .byobu/windows of type reg python: ERROR: (rs_file_copy_cb) unexpected eof on fd23 python: ERROR: (rs_job_complete) patch job failed: unexpected end of input Traceback (most recent call last): File /home/mbp/work/duplicity/duplicity-bin, line 1245, in module with_tempdir(main) File /home/mbp/work/duplicity/duplicity-bin, line 1238, in with_tempdir fn() File /home/mbp/work/duplicity/duplicity-bin, line 1192, in main restore(col_stats) File /home/mbp/work/duplicity/duplicity-bin, line 539, in restore restore_get_patched_rop_iter(col_stats)): File /home/mbp/work/duplicity/duplicity/patchdir.py, line 520, in Write_ROPaths for ropath in rop_iter: File /home/mbp/work/duplicity/duplicity/patchdir.py, line 493, in integrate_patch_iters final_ropath = patch_seq2ropath( normalize_ps( patch_seq ) ) File /home/mbp/work/duplicity/duplicity/patchdir.py, line 473, in patch_seq2ropath misc.copyfileobj( current_file, tempfp ) File /home/mbp/work/duplicity/duplicity/misc.py, line 166, in copyfileobj buf = infp.read(blocksize) File /home/mbp/work/duplicity/duplicity/librsync.py, line 80, in read self._add_to_outbuf_once() File /home/mbp/work/duplicity/duplicity/librsync.py, line 94, in _add_to_outbuf_once raise librsyncError(str(e)) librsyncError: librsync error 103 while in patch cycle ~/work/duplicity/duplicity-bin -v7 --no-encrypt restore ~/tmp/grace- restore 30.59s user 5.18s system 49% cpu 1:11.81 total Using the tip of the 0.6 branch on Ubuntu Maverick. I think I've seen this once before too. The 'unexpected eof' error suggests that one of the increment files could be truncated, but that doesn't seem likely: I haven't had any filesystem problems, and at the gzip level all of them seem to be ok. To manage notifications about this bug go to: https://bugs.launchpad.net/duplicity/+bug/662442/+subscriptions -- Mailing list: https://launchpad.net/~desktop-packages Post to : desktop-packages@lists.launchpad.net Unsubscribe : https://launchpad.net/~desktop-packages More help : https://help.launchpad.net/ListHelp
[Desktop-packages] [Bug 662442] Re: restore fails with librsync error 103 while in patch cycle
I still haven't found the source of this bug. But I have filed a branch [1] that is basically a glorified version of the patch in comment 6. This lets the rest of the restore continue when this error happens, though obviously without the problem file. (It will log an error about that file, so users will notice.) Hopefully that will reduce the severity of this bug, but we should keep this bug open for the original problem. [1] https://code.launchpad.net/~mterry/duplicity/catch-seq-copy- error/+merge/186106 -- You received this bug notification because you are a member of Desktop Packages, which is subscribed to duplicity in Ubuntu. https://bugs.launchpad.net/bugs/662442 Title: restore fails with librsync error 103 while in patch cycle Status in Duplicity - Bandwidth Efficient Encrypted Backup: Confirmed Status in “duplicity” package in Ubuntu: Confirmed Bug description: I'm doing a trial restore from an sftp backup, and it fails like so: Writing .bazaar/plugins/svn/backup.bzr/repository/packs/5e32df252c6c9b80b70d63cab2a52f1a.pack of type reg Deleting /tmp/duplicity-4I6eKU-tempdir/mktemp-B5f55D-4 Processed volume 2 of 2531 Running 'sftp -oServerAliveInterval=15 -oServerAliveCountMax=2 mbp@grace' (attempt #1) sftp command: 'get /backup/lithe/home_mbp.duplicity//duplicity-inc.20100210T222519Z.to.20100429T235919Z.vol2.difftar.gz /tmp/duplicity-4I6eKU-tempdir/mktemp-7d1sNq-22' Writing .bazaar/plugins/svn/backup.bzr/repository/upload of type dir .. Writing .byobu/status of type reg Writing .byobu/windows of type reg python: ERROR: (rs_file_copy_cb) unexpected eof on fd23 python: ERROR: (rs_job_complete) patch job failed: unexpected end of input Traceback (most recent call last): File /home/mbp/work/duplicity/duplicity-bin, line 1245, in module with_tempdir(main) File /home/mbp/work/duplicity/duplicity-bin, line 1238, in with_tempdir fn() File /home/mbp/work/duplicity/duplicity-bin, line 1192, in main restore(col_stats) File /home/mbp/work/duplicity/duplicity-bin, line 539, in restore restore_get_patched_rop_iter(col_stats)): File /home/mbp/work/duplicity/duplicity/patchdir.py, line 520, in Write_ROPaths for ropath in rop_iter: File /home/mbp/work/duplicity/duplicity/patchdir.py, line 493, in integrate_patch_iters final_ropath = patch_seq2ropath( normalize_ps( patch_seq ) ) File /home/mbp/work/duplicity/duplicity/patchdir.py, line 473, in patch_seq2ropath misc.copyfileobj( current_file, tempfp ) File /home/mbp/work/duplicity/duplicity/misc.py, line 166, in copyfileobj buf = infp.read(blocksize) File /home/mbp/work/duplicity/duplicity/librsync.py, line 80, in read self._add_to_outbuf_once() File /home/mbp/work/duplicity/duplicity/librsync.py, line 94, in _add_to_outbuf_once raise librsyncError(str(e)) librsyncError: librsync error 103 while in patch cycle ~/work/duplicity/duplicity-bin -v7 --no-encrypt restore ~/tmp/grace- restore 30.59s user 5.18s system 49% cpu 1:11.81 total Using the tip of the 0.6 branch on Ubuntu Maverick. I think I've seen this once before too. The 'unexpected eof' error suggests that one of the increment files could be truncated, but that doesn't seem likely: I haven't had any filesystem problems, and at the gzip level all of them seem to be ok. To manage notifications about this bug go to: https://bugs.launchpad.net/duplicity/+bug/662442/+subscriptions -- Mailing list: https://launchpad.net/~desktop-packages Post to : desktop-packages@lists.launchpad.net Unsubscribe : https://launchpad.net/~desktop-packages More help : https://help.launchpad.net/ListHelp
Re: [Desktop-packages] [Bug 662442] Re: restore fails with librsync error 103 while in patch cycle
The link to the source http://atoaudiovisual.com/x/duplicity_joiner.py seems to be broken On 6 September 2013 02:18, David Huss da...@huss.at wrote: For those who still want (or have to) to restore their backups by hand, I found a solution for me. The unpack-part is easy, the stich/join-part is not. So I wrote an application for that. More details here: http://blog.atoaudiovisual.com/2013/09/restore-broken-deja-dup-backup-hand/ -- You received this bug notification because you are subscribed to the bug report. https://bugs.launchpad.net/bugs/662442 Title: restore fails with librsync error 103 while in patch cycle To manage notifications about this bug go to: https://bugs.launchpad.net/duplicity/+bug/662442/+subscriptions -- Martin -- You received this bug notification because you are a member of Desktop Packages, which is subscribed to duplicity in Ubuntu. https://bugs.launchpad.net/bugs/662442 Title: restore fails with librsync error 103 while in patch cycle Status in Duplicity - Bandwidth Efficient Encrypted Backup: Confirmed Status in “duplicity” package in Ubuntu: Confirmed Bug description: I'm doing a trial restore from an sftp backup, and it fails like so: Writing .bazaar/plugins/svn/backup.bzr/repository/packs/5e32df252c6c9b80b70d63cab2a52f1a.pack of type reg Deleting /tmp/duplicity-4I6eKU-tempdir/mktemp-B5f55D-4 Processed volume 2 of 2531 Running 'sftp -oServerAliveInterval=15 -oServerAliveCountMax=2 mbp@grace' (attempt #1) sftp command: 'get /backup/lithe/home_mbp.duplicity//duplicity-inc.20100210T222519Z.to.20100429T235919Z.vol2.difftar.gz /tmp/duplicity-4I6eKU-tempdir/mktemp-7d1sNq-22' Writing .bazaar/plugins/svn/backup.bzr/repository/upload of type dir .. Writing .byobu/status of type reg Writing .byobu/windows of type reg python: ERROR: (rs_file_copy_cb) unexpected eof on fd23 python: ERROR: (rs_job_complete) patch job failed: unexpected end of input Traceback (most recent call last): File /home/mbp/work/duplicity/duplicity-bin, line 1245, in module with_tempdir(main) File /home/mbp/work/duplicity/duplicity-bin, line 1238, in with_tempdir fn() File /home/mbp/work/duplicity/duplicity-bin, line 1192, in main restore(col_stats) File /home/mbp/work/duplicity/duplicity-bin, line 539, in restore restore_get_patched_rop_iter(col_stats)): File /home/mbp/work/duplicity/duplicity/patchdir.py, line 520, in Write_ROPaths for ropath in rop_iter: File /home/mbp/work/duplicity/duplicity/patchdir.py, line 493, in integrate_patch_iters final_ropath = patch_seq2ropath( normalize_ps( patch_seq ) ) File /home/mbp/work/duplicity/duplicity/patchdir.py, line 473, in patch_seq2ropath misc.copyfileobj( current_file, tempfp ) File /home/mbp/work/duplicity/duplicity/misc.py, line 166, in copyfileobj buf = infp.read(blocksize) File /home/mbp/work/duplicity/duplicity/librsync.py, line 80, in read self._add_to_outbuf_once() File /home/mbp/work/duplicity/duplicity/librsync.py, line 94, in _add_to_outbuf_once raise librsyncError(str(e)) librsyncError: librsync error 103 while in patch cycle ~/work/duplicity/duplicity-bin -v7 --no-encrypt restore ~/tmp/grace- restore 30.59s user 5.18s system 49% cpu 1:11.81 total Using the tip of the 0.6 branch on Ubuntu Maverick. I think I've seen this once before too. The 'unexpected eof' error suggests that one of the increment files could be truncated, but that doesn't seem likely: I haven't had any filesystem problems, and at the gzip level all of them seem to be ok. To manage notifications about this bug go to: https://bugs.launchpad.net/duplicity/+bug/662442/+subscriptions -- Mailing list: https://launchpad.net/~desktop-packages Post to : desktop-packages@lists.launchpad.net Unsubscribe : https://launchpad.net/~desktop-packages More help : https://help.launchpad.net/ListHelp
[Desktop-packages] [Bug 662442] Re: restore fails with librsync error 103 while in patch cycle
For those who still want (or have to) to restore their backups by hand, I found a solution for me. The unpack-part is easy, the stich/join-part is not. So I wrote an application for that. More details here: http://blog.atoaudiovisual.com/2013/09/restore-broken-deja-dup-backup-hand/ -- You received this bug notification because you are a member of Desktop Packages, which is subscribed to duplicity in Ubuntu. https://bugs.launchpad.net/bugs/662442 Title: restore fails with librsync error 103 while in patch cycle Status in Duplicity - Bandwidth Efficient Encrypted Backup: Confirmed Status in “duplicity” package in Ubuntu: Confirmed Bug description: I'm doing a trial restore from an sftp backup, and it fails like so: Writing .bazaar/plugins/svn/backup.bzr/repository/packs/5e32df252c6c9b80b70d63cab2a52f1a.pack of type reg Deleting /tmp/duplicity-4I6eKU-tempdir/mktemp-B5f55D-4 Processed volume 2 of 2531 Running 'sftp -oServerAliveInterval=15 -oServerAliveCountMax=2 mbp@grace' (attempt #1) sftp command: 'get /backup/lithe/home_mbp.duplicity//duplicity-inc.20100210T222519Z.to.20100429T235919Z.vol2.difftar.gz /tmp/duplicity-4I6eKU-tempdir/mktemp-7d1sNq-22' Writing .bazaar/plugins/svn/backup.bzr/repository/upload of type dir .. Writing .byobu/status of type reg Writing .byobu/windows of type reg python: ERROR: (rs_file_copy_cb) unexpected eof on fd23 python: ERROR: (rs_job_complete) patch job failed: unexpected end of input Traceback (most recent call last): File /home/mbp/work/duplicity/duplicity-bin, line 1245, in module with_tempdir(main) File /home/mbp/work/duplicity/duplicity-bin, line 1238, in with_tempdir fn() File /home/mbp/work/duplicity/duplicity-bin, line 1192, in main restore(col_stats) File /home/mbp/work/duplicity/duplicity-bin, line 539, in restore restore_get_patched_rop_iter(col_stats)): File /home/mbp/work/duplicity/duplicity/patchdir.py, line 520, in Write_ROPaths for ropath in rop_iter: File /home/mbp/work/duplicity/duplicity/patchdir.py, line 493, in integrate_patch_iters final_ropath = patch_seq2ropath( normalize_ps( patch_seq ) ) File /home/mbp/work/duplicity/duplicity/patchdir.py, line 473, in patch_seq2ropath misc.copyfileobj( current_file, tempfp ) File /home/mbp/work/duplicity/duplicity/misc.py, line 166, in copyfileobj buf = infp.read(blocksize) File /home/mbp/work/duplicity/duplicity/librsync.py, line 80, in read self._add_to_outbuf_once() File /home/mbp/work/duplicity/duplicity/librsync.py, line 94, in _add_to_outbuf_once raise librsyncError(str(e)) librsyncError: librsync error 103 while in patch cycle ~/work/duplicity/duplicity-bin -v7 --no-encrypt restore ~/tmp/grace- restore 30.59s user 5.18s system 49% cpu 1:11.81 total Using the tip of the 0.6 branch on Ubuntu Maverick. I think I've seen this once before too. The 'unexpected eof' error suggests that one of the increment files could be truncated, but that doesn't seem likely: I haven't had any filesystem problems, and at the gzip level all of them seem to be ok. To manage notifications about this bug go to: https://bugs.launchpad.net/duplicity/+bug/662442/+subscriptions -- Mailing list: https://launchpad.net/~desktop-packages Post to : desktop-packages@lists.launchpad.net Unsubscribe : https://launchpad.net/~desktop-packages More help : https://help.launchpad.net/ListHelp
[Desktop-packages] [Bug 662442] Re: restore fails with librsync error 103 while in patch cycle
thx for the patch.. rescued my stuff successfully... now going for a more robust backup tool :) -- You received this bug notification because you are a member of Desktop Packages, which is subscribed to duplicity in Ubuntu. https://bugs.launchpad.net/bugs/662442 Title: restore fails with librsync error 103 while in patch cycle Status in Duplicity - Bandwidth Efficient Encrypted Backup: Confirmed Status in “duplicity” package in Ubuntu: Confirmed Bug description: I'm doing a trial restore from an sftp backup, and it fails like so: Writing .bazaar/plugins/svn/backup.bzr/repository/packs/5e32df252c6c9b80b70d63cab2a52f1a.pack of type reg Deleting /tmp/duplicity-4I6eKU-tempdir/mktemp-B5f55D-4 Processed volume 2 of 2531 Running 'sftp -oServerAliveInterval=15 -oServerAliveCountMax=2 mbp@grace' (attempt #1) sftp command: 'get /backup/lithe/home_mbp.duplicity//duplicity-inc.20100210T222519Z.to.20100429T235919Z.vol2.difftar.gz /tmp/duplicity-4I6eKU-tempdir/mktemp-7d1sNq-22' Writing .bazaar/plugins/svn/backup.bzr/repository/upload of type dir .. Writing .byobu/status of type reg Writing .byobu/windows of type reg python: ERROR: (rs_file_copy_cb) unexpected eof on fd23 python: ERROR: (rs_job_complete) patch job failed: unexpected end of input Traceback (most recent call last): File /home/mbp/work/duplicity/duplicity-bin, line 1245, in module with_tempdir(main) File /home/mbp/work/duplicity/duplicity-bin, line 1238, in with_tempdir fn() File /home/mbp/work/duplicity/duplicity-bin, line 1192, in main restore(col_stats) File /home/mbp/work/duplicity/duplicity-bin, line 539, in restore restore_get_patched_rop_iter(col_stats)): File /home/mbp/work/duplicity/duplicity/patchdir.py, line 520, in Write_ROPaths for ropath in rop_iter: File /home/mbp/work/duplicity/duplicity/patchdir.py, line 493, in integrate_patch_iters final_ropath = patch_seq2ropath( normalize_ps( patch_seq ) ) File /home/mbp/work/duplicity/duplicity/patchdir.py, line 473, in patch_seq2ropath misc.copyfileobj( current_file, tempfp ) File /home/mbp/work/duplicity/duplicity/misc.py, line 166, in copyfileobj buf = infp.read(blocksize) File /home/mbp/work/duplicity/duplicity/librsync.py, line 80, in read self._add_to_outbuf_once() File /home/mbp/work/duplicity/duplicity/librsync.py, line 94, in _add_to_outbuf_once raise librsyncError(str(e)) librsyncError: librsync error 103 while in patch cycle ~/work/duplicity/duplicity-bin -v7 --no-encrypt restore ~/tmp/grace- restore 30.59s user 5.18s system 49% cpu 1:11.81 total Using the tip of the 0.6 branch on Ubuntu Maverick. I think I've seen this once before too. The 'unexpected eof' error suggests that one of the increment files could be truncated, but that doesn't seem likely: I haven't had any filesystem problems, and at the gzip level all of them seem to be ok. To manage notifications about this bug go to: https://bugs.launchpad.net/duplicity/+bug/662442/+subscriptions -- Mailing list: https://launchpad.net/~desktop-packages Post to : desktop-packages@lists.launchpad.net Unsubscribe : https://launchpad.net/~desktop-packages More help : https://help.launchpad.net/ListHelp
