*** This bug is a duplicate of bug 1720159 ***
    https://bugs.launchpad.net/bugs/1720159

Hi,
my report looks different but syslog reports memory error and when I set up a 
fresh S3 bucket
test works just fine with the same credentials so this must be duplicity 
related.

- It does the same with version 0.7.14 as well as the latest stable 0.7.17
- Cache purge workaround did not work
- also worth mentioning it ONLY happens when I do FULL backup. For some reason 
incrementals work.
- I am on debian jessie

root@urdongo:~/bin# /usr/local/bin/duplicity full -vd --full-if-older-than 30D 
--s3-use-new-style --s3-european-buckets 
--include='/home/zoltan/backups/dup-s3-backup' --exclude=** / 
s3://s3.eu-west-2.amazonaws.com/backup-urdongo/
Using archive dir: /root/.cache/duplicity/d34b7e48840fd480561c555df1d9c5ef
Using backup name: d34b7e48840fd480561c555df1d9c5ef
GPG binary is gpg, version 1.4.18
Import of duplicity.backends.acdclibackend Succeeded
Import of duplicity.backends.azurebackend Succeeded
Import of duplicity.backends.b2backend Succeeded
Import of duplicity.backends.botobackend Succeeded
Import of duplicity.backends.cfbackend Succeeded
Import of duplicity.backends.dpbxbackend Failed: No module named dropbox
Import of duplicity.backends.gdocsbackend Succeeded
Import of duplicity.backends.giobackend Succeeded
Import of duplicity.backends.hsibackend Succeeded
Import of duplicity.backends.hubicbackend Succeeded
Import of duplicity.backends.imapbackend Succeeded
Import of duplicity.backends.lftpbackend Succeeded
Import of duplicity.backends.localbackend Succeeded
Import of duplicity.backends.mediafirebackend Succeeded
Import of duplicity.backends.megabackend Succeeded
Import of duplicity.backends.multibackend Succeeded
Import of duplicity.backends.ncftpbackend Succeeded
Import of duplicity.backends.onedrivebackend Succeeded
Import of duplicity.backends.par2backend Succeeded
Import of duplicity.backends.pydrivebackend Succeeded
Import of duplicity.backends.rsyncbackend Succeeded
Import of duplicity.backends.ssh_paramiko_backend Succeeded
Import of duplicity.backends.ssh_pexpect_backend Succeeded
Import of duplicity.backends.swiftbackend Succeeded
Import of duplicity.backends.sxbackend Succeeded
Import of duplicity.backends.tahoebackend Succeeded
Import of duplicity.backends.webdavbackend Succeeded
Using temporary directory /tmp/duplicity-0MoyQC-tempdir
Traceback (innermost last):
  File "/usr/local/bin/duplicity", line 1555, in <module>
    with_tempdir(main)
  File "/usr/local/bin/duplicity", line 1541, in with_tempdir
    fn()
  File "/usr/local/bin/duplicity", line 1380, in main
    action = commandline.ProcessCommandLine(sys.argv[1:])
  File "/usr/local/lib/python2.7/dist-packages/duplicity/commandline.py", line 
1140, in ProcessCommandLine
    backup, local_pathname = set_backend(args[0], args[1])
  File "/usr/local/lib/python2.7/dist-packages/duplicity/commandline.py", line 
1015, in set_backend
    globals.backend = backend.get_backend(bend)
  File "/usr/local/lib/python2.7/dist-packages/duplicity/backend.py", line 223, 
in get_backend
    obj = get_backend_object(url_string)
  File "/usr/local/lib/python2.7/dist-packages/duplicity/backend.py", line 209, 
in get_backend_object
    return factory(pu)
  File 
"/usr/local/lib/python2.7/dist-packages/duplicity/backends/_boto_single.py", 
line 166, in __init__
    self.resetConnection()
  File 
"/usr/local/lib/python2.7/dist-packages/duplicity/backends/_boto_single.py", 
line 188, in resetConnection
    self.conn = get_connection(self.scheme, self.parsed_url, self.storage_uri)
  File 
"/usr/local/lib/python2.7/dist-packages/duplicity/backends/_boto_single.py", 
line 99, in get_connection
    is_secure=(not globals.s3_unencrypted_connection))
  File "/usr/local/lib/python2.7/dist-packages/boto/storage_uri.py", line 117, 
in connect
    **connection_args)
  File "/usr/local/lib/python2.7/dist-packages/boto/s3/connection.py", line 
194, in __init__
    validate_certs=validate_certs, profile_name=profile_name)
  File "/usr/local/lib/python2.7/dist-packages/boto/connection.py", line 569, 
in __init__
    host, config, self.provider, self._required_auth_capability())
  File "/usr/local/lib/python2.7/dist-packages/boto/auth.py", line 1021, in 
get_auth_handler
    'Check your credentials' % (len(names), str(names)))
 NoAuthHandlerFound: No handler was ready to authenticate. 1 handlers were 
checked. ['S3HmacAuthV4Handler'] Check your credentials

-- 
You received this bug notification because you are a member of Desktop
Packages, which is subscribed to duplicity in Ubuntu.
https://bugs.launchpad.net/bugs/1722454

Title:
  Duplicity fails with MemoryError

Status in Duplicity:
  New
Status in duplicity package in Ubuntu:
  Confirmed

Bug description:
  Running the following command:

  /usr/bin/python /usr/bin/duplicity collection-status
  --exclude=/mnt/jabba/juergh/backup/gollum
  --include=/home/juergh/.cache/deja-dup/metadata --exclude=/home/juergh
  /.uk-pkg --exclude=/home/juergh/Music --exclude=/home/juergh/debug
  --exclude=/home/juergh/canonical/cve-matrix/cve-matrix/cve-tracker
  --exclude=/home/juergh/canonical/cve-matrix/cve-autotriage
  --exclude=/home/juergh/Desktop --exclude=/home/juergh/.cache
  --exclude=/home/juergh/tmp --exclude=/home/juergh/git
  --exclude=/home/juergh/Downloads
  --exclude=/home/juergh/.local/share/Trash
  --exclude=/home/juergh/.cache/deja-dup/tmp
  --exclude=/home/juergh/.thumbnails --exclude=/home/juergh/.cache/deja-
  dup --exclude=/home/juergh/.cache --include=/home/juergh
  --exclude=/sys --exclude=/run --exclude=/proc --exclude=/var/tmp
  --exclude=/tmp --exclude=** --gio
  file:///mnt/jabba/juergh/backup/gollum --no-encryption --verbosity=9
  --gpg-options=--no-use-agent --archive-dir=/home/juergh/.cache/deja-
  dup --tempdir=/home/juergh/.cache/deja-dup/tmp --log-fd=19

  results in:

  Traceback (most recent call last):
    File "/usr/bin/duplicity", line 1546, in <module>
      with_tempdir(main)
    File "/usr/bin/duplicity", line 1540, in with_tempdir
      fn()
    File "/usr/bin/duplicity", line 1391, in main
      do_backup(action)
    File "/usr/bin/duplicity", line 1416, in do_backup
      globals.archive_dir).set_values()
    File "/usr/lib/python2.7/dist-packages/duplicity/collections.py", line 710, 
in set_values
      self.get_backup_chains(partials + backend_filename_list)
    File "/usr/lib/python2.7/dist-packages/duplicity/collections.py", line 836, 
in get_backup_chains
      add_to_sets(f)
    File "/usr/lib/python2.7/dist-packages/duplicity/collections.py", line 824, 
in add_to_sets
      if set.add_filename(filename):
    File "/usr/lib/python2.7/dist-packages/duplicity/collections.py", line 101, 
in add_filename
      self.set_manifest(filename)
    File "/usr/lib/python2.7/dist-packages/duplicity/collections.py", line 148, 
in set_manifest
      self.set_files_changed()
    File "/usr/lib/python2.7/dist-packages/duplicity/collections.py", line 128, 
in set_files_changed
      mf = self.get_manifest()
    File "/usr/lib/python2.7/dist-packages/duplicity/collections.py", line 250, 
in get_manifest
      return self.get_local_manifest()
    File "/usr/lib/python2.7/dist-packages/duplicity/collections.py", line 224, 
in get_local_manifest
      return manifest.Manifest().from_string(manifest_buffer)
    File "/usr/lib/python2.7/dist-packages/duplicity/manifest.py", line 215, in 
from_string
      vi = VolumeInfo().from_string(match.group(1))
    File "/usr/lib/python2.7/dist-packages/duplicity/manifest.py", line 383, in 
from_string
      linelist = s.strip().split("\n")
  MemoryError

  ProblemType: Bug
  DistroRelease: Ubuntu 17.10
  Package: duplicity 0.7.12-1ubuntu1
  ProcVersionSignature: Ubuntu 4.13.0-12.13-generic 4.13.3
  Uname: Linux 4.13.0-12-generic x86_64
  ApportVersion: 2.20.7-0ubuntu2
  Architecture: amd64
  CurrentDesktop: GNOME
  Date: Tue Oct 10 08:05:45 2017
  InstallationDate: Installed on 2017-05-25 (137 days ago)
  InstallationMedia: Ubuntu-GNOME 17.04 "Zesty Zapus" - Release amd64 (20170412)
  SourcePackage: duplicity
  UpgradeStatus: No upgrade log present (probably fresh install)

To manage notifications about this bug go to:
https://bugs.launchpad.net/duplicity/+bug/1722454/+subscriptions

-- 
Mailing list: https://launchpad.net/~desktop-packages
Post to     : desktop-packages@lists.launchpad.net
Unsubscribe : https://launchpad.net/~desktop-packages
More help   : https://help.launchpad.net/ListHelp

Reply via email to