Re: [Duplicity-team] [Question #141176]: Resuming a failed backup with Assertion errors
Question #141176 on Duplicity changed: https://answers.launchpad.net/duplicity/+question/141176 skorqa posted a new comment: Hello, @vergueishon: This bug has been reported here: https://bugs.launchpad.net/ubuntu/+source/duplicity/+bug/633101 but there's no follow up as for now F -- You received this question notification because you are a member of duplicity-team, which is an answer contact for Duplicity. ___ Mailing list: https://launchpad.net/~duplicity-team Post to : duplicity-team@lists.launchpad.net Unsubscribe : https://launchpad.net/~duplicity-team More help : https://help.launchpad.net/ListHelp
Re: [Duplicity-team] [Question #141176]: Resuming a failed backup with Assertion errors
Question #141176 on Duplicity changed: https://answers.launchpad.net/duplicity/+question/141176 Fabio Ferrero proposed the following answer: I've installed 0.6.11 on debian lenny and, when I try to backup to S3, I got this: Upload 's3+http://icosaedrointerimit/var_www/duplicity-full.20110204T161611Z.vol1.difftar.gpg' failed (attempt #1, reason: error: (32, 'Broken pipe')) Backtrace of previous error: Traceback (innermost last): File /usr/local/lib/python2.5/site-packages/duplicity/backends/botobackend.py, line 199, in put 'x-amz-storage-class': storage_class}) File /usr/lib/pymodules/python2.5/boto/s3/key.py, line 498, in set_contents_from_filename self.set_contents_from_file(fp, headers, replace, cb, num_cb, policy) File /usr/lib/pymodules/python2.5/boto/s3/key.py, line 455, in set_contents_from_file self.send_file(fp, headers, cb, num_cb) File /usr/lib/pymodules/python2.5/boto/s3/key.py, line 367, in send_file self.name, headers, sender=sender) File /usr/lib/pymodules/python2.5/boto/s3/connection.py, line 342, in make_request data, host, auth_path, sender) File /usr/lib/pymodules/python2.5/boto/connection.py, line 459, in make_request return self._mexe(method, path, data, headers, host, sender) File /usr/lib/pymodules/python2.5/boto/connection.py, line 437, in _mexe raise e error: (32, 'Broken pipe') I've installed python-boto_1.9b-4_all.deb e python- support_1.0.10_all.deb from backports, backup on local file system seems to work well. I use this command: duplicity -v9 --encrypt-key=xxx --sign-key=xxx --s3-use-new-style --s3-european-buckets --full-if-older-than 1M --volsize 250 --name test_www /var/www s3+http://testit/test_www Can you help me? -- You received this question notification because you are a member of duplicity-team, which is an answer contact for Duplicity. ___ Mailing list: https://launchpad.net/~duplicity-team Post to : duplicity-team@lists.launchpad.net Unsubscribe : https://launchpad.net/~duplicity-team More help : https://help.launchpad.net/ListHelp
Re: [Duplicity-team] [Question #141176]: Resuming a failed backup with Assertion errors
Question #141176 on Duplicity changed: https://answers.launchpad.net/duplicity/+question/141176 Fabio Ferrero proposed the following answer: After 10 minutes, now seems that upload to S3 works ok... -- You received this question notification because you are a member of duplicity-team, which is an answer contact for Duplicity. ___ Mailing list: https://launchpad.net/~duplicity-team Post to : duplicity-team@lists.launchpad.net Unsubscribe : https://launchpad.net/~duplicity-team More help : https://help.launchpad.net/ListHelp
Re: [Duplicity-team] [Question #141176]: Resuming a failed backup with Assertion errors
Question #141176 on Duplicity changed: https://answers.launchpad.net/duplicity/+question/141176 edso proposed the following answer: On 26.01.2011 20:01, vergueishon wrote: Question #141176 on Duplicity changed: https://answers.launchpad.net/duplicity/+question/141176 vergueishon posted a new comment: Thanks, edso. I suspected that might be the best way to go. Sigh. Not sure whether to mark your reply as a solution? if you've got the time wait for an answer by the maintainer ken, the ticket will close itself eventually and no you didn't get a solution. hence no need to close the ticket. if not, please backup to another folder or download the erronous backup to somewhere local and create a bug ticket. we perhaps need the backup later to pin down the issue together with you. ..ede/duply.net -- You received this question notification because you are a member of duplicity-team, which is an answer contact for Duplicity. ___ Mailing list: https://launchpad.net/~duplicity-team Post to : duplicity-team@lists.launchpad.net Unsubscribe : https://launchpad.net/~duplicity-team More help : https://help.launchpad.net/ListHelp
Re: [Duplicity-team] [Question #141176]: Resuming a failed backup with Assertion errors
Question #141176 on Duplicity changed: https://answers.launchpad.net/duplicity/+question/141176 Kenneth Loafman proposed the following answer: Wed, Jan 26, 2011 at 1:12 PM, edso question141...@answers.launchpad.netwrote: Question #141176 on Duplicity changed: https://answers.launchpad.net/duplicity/+question/141176 edso proposed the following answer: On 26.01.2011 20:01, vergueishon wrote: Question #141176 on Duplicity changed: https://answers.launchpad.net/duplicity/+question/141176 vergueishon posted a new comment: Thanks, edso. I suspected that might be the best way to go. Sigh. Not sure whether to mark your reply as a solution? if you've got the time wait for an answer by the maintainer ken, the ticket will close itself eventually and no you didn't get a solution. hence no need to close the ticket. if not, please backup to another folder or download the erronous backup to somewhere local and create a bug ticket. we perhaps need the backup later to pin down the issue together with you. There have been a lot of fixes since 0.6.08b. I would suggest upgrading to 0.6.11 and trying that out before giving up. https://launchpad.net/duplicity/+download ...Thanks, ...Ken -- You received this question notification because you are a member of duplicity-team, which is an answer contact for Duplicity. ___ Mailing list: https://launchpad.net/~duplicity-team Post to : duplicity-team@lists.launchpad.net Unsubscribe : https://launchpad.net/~duplicity-team More help : https://help.launchpad.net/ListHelp
Re: [Duplicity-team] [Question #141176]: Resuming a failed backup with Assertion errors
Question #141176 on Duplicity changed: https://answers.launchpad.net/duplicity/+question/141176 vergueishon posted a new comment: Thanks for your help, guys. I re-attempted with 0.6.11, but same thing. I've cleared my cache and started a full backup. I'll do my best to keep the data around for your reference, but no promises! -- You received this question notification because you are a member of duplicity-team, which is an answer contact for Duplicity. ___ Mailing list: https://launchpad.net/~duplicity-team Post to : duplicity-team@lists.launchpad.net Unsubscribe : https://launchpad.net/~duplicity-team More help : https://help.launchpad.net/ListHelp
Re: [Duplicity-team] [Question #141176]: Resuming a failed backup with Assertion errors
Question #141176 on Duplicity changed:
https://answers.launchpad.net/duplicity/+question/141176
Status: Open = Answered
Kenneth Loafman proposed the following answer:
Move the local cache from ~/.cache/duplicity to ~/.cache/duplicity-save and
restart the incremental.
If that works, remove ~/.cache/duplicity-save completely. You won't need it
again.
If that does not work, use -v9 in the duplicity command and save the log.
Please post the first 200 lines and the last 200 lines of the run. Munge
any personal information, but be very careful not to modify the format of
the logging.
...Ken
On Wed, Jan 12, 2011 at 9:30 AM, vergueishon
question141...@answers.launchpad.net wrote:
Question #141176 on Duplicity changed:
https://answers.launchpad.net/duplicity/+question/141176
Description changed to:
My first incremental backup failed roughly 60GB into the upload. This
was due to my router dying on me, thus no internet connection. Here is
the log of that backup, including all (including the final) connection
failure errors:
r...@myserver:~$ sudo /usr/local/scr/duplicity2s3
Local and Remote metadata are synchronized, no sync needed.
Last full backup date: Thu Dec 16 19:37:21 2010
exit^[Upload 's3+
http://myserver/duplicity-inc.20101217T013721Z.to.20101217T020338Z.vol504.difftar.gpg'
failed (attempt #1, reason: error: [Errno 32] Broken pipe)
Upload 's3+
http://myserver/duplicity-inc.20101217T013721Z.to.20101217T020338Z.vol989.difftar.gpg'
failed (attempt #1, reason: error: [Errno 32] Broken pipe)
Upload 's3+
http://myserver/duplicity-inc.20101217T013721Z.to.20101217T020338Z.vol1351.difftar.gpg'
failed (attempt #1, reason: error: [Errno 32] Broken pipe)
Upload 's3+
http://myserver/duplicity-inc.20101217T013721Z.to.20101217T020338Z.vol1351.difftar.gpg'
failed (attempt #2, reason: error: [Errno 32] Broken pipe)
sudUpload 's3+
http://myserver/duplicity-inc.20101217T013721Z.to.20101217T020338Z.vol1651.difftar.gpg'
failed (attempt #1, reason: gaierror: [Errno -3] Temporary failure in name
resolution)
sUpload 's3+
http://myserver/duplicity-inc.20101217T013721Z.to.20101217T020338Z.vol1768.difftar.gpg'
failed (attempt #1, reason: gaierror: [Errno -3] Temporary failure in name
resolution)
Upload 's3+
http://myserver/duplicity-inc.20101217T013721Z.to.20101217T020338Z.vol1768.difftar.gpg'
failed (attempt #2, reason: gaierror: [Errno -3] Temporary failure in name
resolution)
Upload 's3+
http://myserver/duplicity-inc.20101217T013721Z.to.20101217T020338Z.vol1768.difftar.gpg'
failed (attempt #3, reason: gaierror: [Errno -3] Temporary failure in name
resolution)
Upload 's3+
http://myserver/duplicity-inc.20101217T013721Z.to.20101217T020338Z.vol1768.difftar.gpg'
failed (attempt #4, reason: gaierror: [Errno -3] Temporary failure in n
ame resolution)
Upload 's3+
http://myserver/duplicity-inc.20101217T013721Z.to.20101217T020338Z.vol1768.difftar.gpg'
failed (attempt #5, reason: gaierror: [Errno -3] Temporary failure in n
ame resolution)
Giving up trying to upload s3+
http://myserver/duplicity-inc.20101217T013721Z.to.20101217T020338Z.vol1768.difftar.gpgafter
5 attempts
BackendException: Error uploading s3+
http://myserver/duplicity-inc.20101217T013721Z.to.20101217T020338Z.vol1768.difftar.gpg
Now, when I try to resume the upload, I get:
r...@myserver:~$ /usr/local/scr/duplicity2s3
Local and Remote metadata are synchronized, no sync needed.
Traceback (most recent call last):
File /usr/bin/duplicity, line 1239, in module
with_tempdir(main)
File /usr/bin/duplicity, line 1232, in with_tempdir
fn()
File /usr/bin/duplicity, line 1137, in main
globals.archive_dir).set_values()
File /usr/lib/python2.6/dist-packages/duplicity/collections.py, line
681, in set_values
self.get_backup_chains(partials + backend_filename_list)
File /usr/lib/python2.6/dist-packages/duplicity/collections.py, line
804, in get_backup_chains
map(add_to_sets, filename_list)
File /usr/lib/python2.6/dist-packages/duplicity/collections.py, line
794, in add_to_sets
if set.add_filename(filename):
File /usr/lib/python2.6/dist-packages/duplicity/collections.py, line 89,
in add_filename
self.set_manifest(filename)
File /usr/lib/python2.6/dist-packages/duplicity/collections.py, line
118, in set_manifest
remote_filename)
AssertionError: ('duplicity-full.20101217T013721Z.manifest.gpg',
'duplicity-full.20101217T013721Z.manifest.gpg')
Is there any way to fix this and resume the backup?
--
You received this question notification because you are a member of
duplicity-team, which is an answer contact for Duplicity.
___
Mailing list:
https://launchpad.net/~duplicity-teamhttps://launchpad.net/%7Eduplicity-team
Post to : duplicity-team@lists.launchpad.net
Unsubscribe :
https://launchpad.net/~duplicity-teamhttps://launchpad.net/%7Eduplicity-team
More help : https://help.launchpad.net/ListHelp
--
You
Re: [Duplicity-team] [Question #141176]: Resuming a failed backup with Assertion errors
Question #141176 on Duplicity changed:
https://answers.launchpad.net/duplicity/+question/141176
Status: Answered = Open
vergueishon is still having a problem:
Tried moving the cache, same error:
r...@myserver:~$ /usr/local/scr/duplicity2s3
Synchronizing remote metadata to local cache...
Copying duplicity-full-signatures.20101217T013721Z.sigtar to local cache.
Copying duplicity-full.20101217T013721Z.manifest to local cache.
Traceback (most recent call last):
File /usr/bin/duplicity, line 1239, in module
with_tempdir(main)
File /usr/bin/duplicity, line 1232, in with_tempdir
fn()
File /usr/bin/duplicity, line 1137, in main
globals.archive_dir).set_values()
File /usr/lib/python2.6/dist-packages/duplicity/collections.py, line 681,
in set_values
self.get_backup_chains(partials + backend_filename_list)
File /usr/lib/python2.6/dist-packages/duplicity/collections.py, line 804,
in get_backup_chains
map(add_to_sets, filename_list)
File /usr/lib/python2.6/dist-packages/duplicity/collections.py, line 794,
in add_to_sets
if set.add_filename(filename):
File /usr/lib/python2.6/dist-packages/duplicity/collections.py, line 89, in
add_filename
self.set_manifest(filename)
File /usr/lib/python2.6/dist-packages/duplicity/collections.py, line 118,
in set_manifest
remote_filename)
AssertionError: ('duplicity-full.20101217T013721Z.manifest.gpg',
'duplicity-full.20101217T013721Z.manifest.gpg')
So, here is the first and last 200 lines output with -v9:
Using archive dir: /home/me/.cache/duplicity/1341cba2b333f71a897f639c295ab8ce
Using backup name: 1341cba2b333f71a897f639c295ab8ce
Import of duplicity.backends.giobackend Succeeded
Import of duplicity.backends.botobackend Succeeded
Import of duplicity.backends.webdavbackend Succeeded
Import of duplicity.backends.sshbackend Succeeded
Import of duplicity.backends.ftpbackend Succeeded
Import of duplicity.backends.hsibackend Succeeded
Import of duplicity.backends.tahoebackend Succeeded
Import of duplicity.backends.cloudfilesbackend Succeeded
Import of duplicity.backends.rsyncbackend Succeeded
Import of duplicity.backends.imapbackend Succeeded
Import of duplicity.backends.localbackend Succeeded
Main action: inc
duplicity 0.6.08b (March 11, 2010)
Args: /usr/bin/duplicity -v9 --encrypt-key=F3EE4FEC --sign-key=F3EE4FEC
--include /backups/farguel --include /backups/myserver/gpictures --include
/backups/myserver/root --exclude ** /backups s3+http://myserver
Linux myserver 2.6.32-24-server #43-Ubuntu SMP Thu Sep 16 16:05:42 UTC 2010
x86_64
/usr/bin/python 2.6.5 (r265:79063, Apr 16 2010, 13:57:41)
[GCC 4.4.3]
Using temporary directory /tmp/duplicity-r02mAL-tempdir
Registering (mkstemp) temporary file
/tmp/duplicity-r02mAL-tempdir/mkstemp-n8ldkS-1
Temp has 48061829120 available, backup will use approx 34078720.
Listing s3+http://myserver
Listed s3+http://myserver/backups
Listed s3+http://myserver/duplicity-full-signatures.20101217T013721Z.sigtar.gpg
Listed s3+http://myserver/duplicity-full.20101217T013721Z.manifest.gpg
Listed s3+http://myserver/duplicity-full.20101217T013721Z.vol1.difftar.gpg
Listed s3+http://myserver/duplicity-full.20101217T013721Z.vol2.difftar.gpg
Listed s3+http://myserver/duplicity-full.20101217T013721Z.vol3.difftar.gpg
Listed
s3+http://myserver/duplicity-inc.20101217T013721Z.to.20101217T020338Z.vol1.difftar.gpg
Listed
s3+http://myserver/duplicity-inc.20101217T013721Z.to.20101217T020338Z.vol10.difftar.gpg
Listed
s3+http://myserver/duplicity-inc.20101217T013721Z.to.20101217T020338Z.vol100.difftar.gpg
Listed
s3+http://myserver/duplicity-inc.20101217T013721Z.to.20101217T020338Z.vol1000.difftar.gpg
Listed
s3+http://myserver/duplicity-inc.20101217T013721Z.to.20101217T020338Z.vol1001.difftar.gpg
Listed
s3+http://myserver/duplicity-inc.20101217T013721Z.to.20101217T020338Z.vol1002.difftar.gpg
Listed
s3+http://myserver/duplicity-inc.20101217T013721Z.to.20101217T020338Z.vol1003.difftar.gpg
Listed
s3+http://myserver/duplicity-inc.20101217T013721Z.to.20101217T020338Z.vol1004.difftar.gpg
Listed
s3+http://myserver/duplicity-inc.20101217T013721Z.to.20101217T020338Z.vol1005.difftar.gpg
Listed
s3+http://myserver/duplicity-inc.20101217T013721Z.to.20101217T020338Z.vol1006.difftar.gpg
Listed
s3+http://myserver/duplicity-inc.20101217T013721Z.to.20101217T020338Z.vol1007.difftar.gpg
Listed
s3+http://myserver/duplicity-inc.20101217T013721Z.to.20101217T020338Z.vol1008.difftar.gpg
Listed
s3+http://myserver/duplicity-inc.20101217T013721Z.to.20101217T020338Z.vol1009.difftar.gpg
Listed
s3+http://myserver/duplicity-inc.20101217T013721Z.to.20101217T020338Z.vol101.difftar.gpg
Listed
s3+http://myserver/duplicity-inc.20101217T013721Z.to.20101217T020338Z.vol1010.difftar.gpg
Listed
