[Bug 1875937] Re: Download of vol1 in validate_encryption_settings() fails when using S3 glacier
Sorry - mixed my words - as you can see it's failing on an attempt to retreive the remote *signatures* file, not the manifest file. The manifest is stored in standard class; the signatures file is stored in DEEP_ARCHIVE class. -- You received this bug notification because you are a member of Ubuntu Bugs, which is subscribed to Ubuntu. https://bugs.launchpad.net/bugs/1875937 Title: Download of vol1 in validate_encryption_settings() fails when using S3 glacier To manage notifications about this bug go to: https://bugs.launchpad.net/duplicity/+bug/1875937/+subscriptions -- ubuntu-bugs mailing list ubuntu-bugs@lists.ubuntu.com https://lists.ubuntu.com/mailman/listinfo/ubuntu-bugs
[Bug 1875937] Re: Download of vol1 in validate_encryption_settings() fails when using S3 glacier
My incremental job uses the same parameters as the full, and it fails on glacier/deep because duplicity tries to pull the remote manifest and can't retrieve it - here's what I run: duplicity /mnt/backup/src boto3+s3://BUCKETNAME/FOLDERNAME --file-prefix-archive archive-$(hostna me -f)- --file-prefix-manifest manifest-$(hostname -f)- --file-prefix-signature signature-$(hostname -f)- --s3-use-deep-archive ...and here's the output: Synchronizing remote metadata to local cache... Copying signature-backup.HOSTNAME.com-duplicity-full-signatures.20200830T050003Z.sigtar.gpg to local cache. Attempt 1 failed. ClientError: An error occurred (InvalidObjectState) when calling the GetObject operation: The operation is not valid for the object's storage class It tries 4 more attempts and then fails completely. I'm still not following the logic here anyways - wouldn't it be better to store the signature files as as a standard class file, and allow the metadata sync to proceed as usual...rather than just disabling metadata sync for non-standard storage classes? The implementation seems to be inconsistent across AWS storage classes, and I can't get incrementals to work at all with glacier deep. -- You received this bug notification because you are a member of Ubuntu Bugs, which is subscribed to Ubuntu. https://bugs.launchpad.net/bugs/1875937 Title: Download of vol1 in validate_encryption_settings() fails when using S3 glacier To manage notifications about this bug go to: https://bugs.launchpad.net/duplicity/+bug/1875937/+subscriptions -- ubuntu-bugs mailing list ubuntu-bugs@lists.ubuntu.com https://lists.ubuntu.com/mailman/listinfo/ubuntu-bugs
[Bug 1875937] Re: Download of vol1 in validate_encryption_settings() fails when using S3 glacier
It seems to be working as it should. When you do the incremental are you specifying the storage class or using IA? We check to see if --s3 -use-deep-archive or --s3-use-glacier is used and don't run validate_encryption_settings() if either is set. -- You received this bug notification because you are a member of Ubuntu Bugs, which is subscribed to Ubuntu. https://bugs.launchpad.net/bugs/1875937 Title: Download of vol1 in validate_encryption_settings() fails when using S3 glacier To manage notifications about this bug go to: https://bugs.launchpad.net/duplicity/+bug/1875937/+subscriptions -- ubuntu-bugs mailing list ubuntu-bugs@lists.ubuntu.com https://lists.ubuntu.com/mailman/listinfo/ubuntu-bugs
[Bug 1875937] Re: Download of vol1 in validate_encryption_settings() fails when using S3 glacier
This is not fixed in 8.14 - glacier and glacier deep mode save the signature files in glacier/deep storage class, and --s3-use-ia stores BOTH the manifest and signature files in the IA storage class. -- You received this bug notification because you are a member of Ubuntu Bugs, which is subscribed to Ubuntu. https://bugs.launchpad.net/bugs/1875937 Title: Download of vol1 in validate_encryption_settings() fails when using S3 glacier To manage notifications about this bug go to: https://bugs.launchpad.net/duplicity/+bug/1875937/+subscriptions -- ubuntu-bugs mailing list ubuntu-bugs@lists.ubuntu.com https://lists.ubuntu.com/mailman/listinfo/ubuntu-bugs
[Bug 1875937] Re: Download of vol1 in validate_encryption_settings() fails when using S3 glacier
** Changed in: duplicity Status: Fix Committed => Fix Released -- You received this bug notification because you are a member of Ubuntu Bugs, which is subscribed to Ubuntu. https://bugs.launchpad.net/bugs/1875937 Title: Download of vol1 in validate_encryption_settings() fails when using S3 glacier To manage notifications about this bug go to: https://bugs.launchpad.net/duplicity/+bug/1875937/+subscriptions -- ubuntu-bugs mailing list ubuntu-bugs@lists.ubuntu.com https://lists.ubuntu.com/mailman/listinfo/ubuntu-bugs
[Bug 1875937] Re: Download of vol1 in validate_encryption_settings() fails when using S3 glacier
** Changed in: duplicity (Ubuntu) Status: New => Fix Committed ** Changed in: duplicity (Ubuntu) Importance: Undecided => Low -- You received this bug notification because you are a member of Ubuntu Bugs, which is subscribed to Ubuntu. https://bugs.launchpad.net/bugs/1875937 Title: Download of vol1 in validate_encryption_settings() fails when using S3 glacier To manage notifications about this bug go to: https://bugs.launchpad.net/duplicity/+bug/1875937/+subscriptions -- ubuntu-bugs mailing list ubuntu-bugs@lists.ubuntu.com https://lists.ubuntu.com/mailman/listinfo/ubuntu-bugs
[Bug 1875937] Re: Download of vol1 in validate_encryption_settings() fails when using S3 glacier
** Changed in: duplicity Status: Triaged => Fix Committed ** Changed in: duplicity Milestone: None => 0.8.14 -- You received this bug notification because you are a member of Ubuntu Bugs, which is subscribed to Ubuntu. https://bugs.launchpad.net/bugs/1875937 Title: Download of vol1 in validate_encryption_settings() fails when using S3 glacier To manage notifications about this bug go to: https://bugs.launchpad.net/duplicity/+bug/1875937/+subscriptions -- ubuntu-bugs mailing list ubuntu-bugs@lists.ubuntu.com https://lists.ubuntu.com/mailman/listinfo/ubuntu-bugs
[Bug 1875937] Re: Download of vol1 in validate_encryption_settings() fails when using S3 glacier
Yes, this is clear as per design of the glacier storage backend. However, the problem ist not the restore action, the problem is that when duplicity wants to restart a backup (because e.g. the upload failed recently) it wants to download the latest archive to verify the use of the same keys. This is not possible with glacier and therefore if the upload of a backup to glacier fails the backup can never be continued. -- You received this bug notification because you are a member of Ubuntu Bugs, which is subscribed to Ubuntu. https://bugs.launchpad.net/bugs/1875937 Title: Download of vol1 in validate_encryption_settings() fails when using S3 glacier To manage notifications about this bug go to: https://bugs.launchpad.net/duplicity/+bug/1875937/+subscriptions -- ubuntu-bugs mailing list ubuntu-bugs@lists.ubuntu.com https://lists.ubuntu.com/mailman/listinfo/ubuntu-bugs
[Bug 1875937] Re: Download of vol1 in validate_encryption_settings() fails when using S3 glacier
When using boto3, glacier restore is not supported yet. You'll need to download the backup to a local drive and restore from there. ** Changed in: duplicity Status: New => Triaged ** Changed in: duplicity Importance: Undecided => Low -- You received this bug notification because you are a member of Ubuntu Bugs, which is subscribed to Ubuntu. https://bugs.launchpad.net/bugs/1875937 Title: Download of vol1 in validate_encryption_settings() fails when using S3 glacier To manage notifications about this bug go to: https://bugs.launchpad.net/duplicity/+bug/1875937/+subscriptions -- ubuntu-bugs mailing list ubuntu-bugs@lists.ubuntu.com https://lists.ubuntu.com/mailman/listinfo/ubuntu-bugs
[Bug 1875937] Re: Download of vol1 in validate_encryption_settings() fails when using S3 glacier
** Also affects: ubuntu Importance: Undecided Status: New ** No longer affects: ubuntu ** Also affects: duplicity (Ubuntu) Importance: Undecided Status: New -- You received this bug notification because you are a member of Ubuntu Bugs, which is subscribed to Ubuntu. https://bugs.launchpad.net/bugs/1875937 Title: Download of vol1 in validate_encryption_settings() fails when using S3 glacier To manage notifications about this bug go to: https://bugs.launchpad.net/duplicity/+bug/1875937/+subscriptions -- ubuntu-bugs mailing list ubuntu-bugs@lists.ubuntu.com https://lists.ubuntu.com/mailman/listinfo/ubuntu-bugs
