[Bug 989496] Re: UnicodeDecodeError: 'utf8' codec can't decode byte 0xd1 in position 117
** No longer affects: ubuntu -- You received this bug notification because you are a member of Ubuntu Bugs, which is subscribed to Ubuntu. https://bugs.launchpad.net/bugs/989496 Title: UnicodeDecodeError: 'utf8' codec can't decode byte 0xd1 in position 117 To manage notifications about this bug go to: https://bugs.launchpad.net/duplicity/+bug/989496/+subscriptions -- ubuntu-bugs mailing list ubuntu-bugs@lists.ubuntu.com https://lists.ubuntu.com/mailman/listinfo/ubuntu-bugs
[Bug 989496] Re: UnicodeDecodeError: 'utf8' codec can't decode byte 0xd1 in position 117
** Changed in: duplicity (Ubuntu) Assignee: (unassigned) = Michael Terry (mterry) -- You received this bug notification because you are a member of Ubuntu Bugs, which is subscribed to Ubuntu. https://bugs.launchpad.net/bugs/989496 Title: UnicodeDecodeError: 'utf8' codec can't decode byte 0xd1 in position 117 To manage notifications about this bug go to: https://bugs.launchpad.net/duplicity/+bug/989496/+subscriptions -- ubuntu-bugs mailing list ubuntu-bugs@lists.ubuntu.com https://lists.ubuntu.com/mailman/listinfo/ubuntu-bugs
[Bug 989496] Re: UnicodeDecodeError: 'utf8' codec can't decode byte 0xd1 in position 117
I think there are at least two things going on here. 1) The way duplicity is currently using it, gettext will return strings in whatever codeset the translation file happens to define. Which is hard to predict. If it is returned as unicode (not utf8, but actual wide byte unicode), then we get the 'ascii' codec can't decode message. This can be forced by using the unicode=True flag for gettext.install. And it can be fixed by using the codeset='utf8' flag instead. 2) Filenames may not be in utf8. I think this is actually a pretty rare thing, but I'm betting we don't handle it well and it leads to 'utf8' codec can't decode messages. Looking further. I seem to be getting situation #1 in more cases than I would naively expect (like, no translation file at all). -- You received this bug notification because you are a member of Ubuntu Bugs, which is subscribed to Ubuntu. https://bugs.launchpad.net/bugs/989496 Title: UnicodeDecodeError: 'utf8' codec can't decode byte 0xd1 in position 117 To manage notifications about this bug go to: https://bugs.launchpad.net/duplicity/+bug/989496/+subscriptions -- ubuntu-bugs mailing list ubuntu-bugs@lists.ubuntu.com https://lists.ubuntu.com/mailman/listinfo/ubuntu-bugs
[Bug 989496] Re: UnicodeDecodeError: 'utf8' codec can't decode byte 0xd1 in position 117
Thanks Andreas, with this help i found out that indeed the character ä causes the problem. It wasn't only one conflicting file (with some weird character in it's name) but all other occurrences of ä cause it too. It's quite a common character in my our language and i cannot really live with out it. -- You received this bug notification because you are a member of Ubuntu Bugs, which is subscribed to Ubuntu. https://bugs.launchpad.net/bugs/989496 Title: UnicodeDecodeError: 'utf8' codec can't decode byte 0xd1 in position 117 To manage notifications about this bug go to: https://bugs.launchpad.net/duplicity/+bug/989496/+subscriptions -- ubuntu-bugs mailing list ubuntu-bugs@lists.ubuntu.com https://lists.ubuntu.com/mailman/listinfo/ubuntu-bugs
[Bug 989496] Re: UnicodeDecodeError: 'utf8' codec can't decode byte 0xd1 in position 117
The ä character in itself should not be a problem. It's probably not in the right encoding, but you don't see the problem because the text editor you used to read the file (gedit?) has automatically chosen the right encoding. You can open the text in LibreOffice and select UTF-8 for encoding to make sure the characters are correct. If that's not the case, install the convmv package and use it to convert the invalid filenames to UTF-8. You have to know the encoding the filenames are using. Testing several settings is possible without any risk for the files as long as you do not add the --notest option. -- You received this bug notification because you are a member of Ubuntu Bugs, which is subscribed to Ubuntu. https://bugs.launchpad.net/bugs/989496 Title: UnicodeDecodeError: 'utf8' codec can't decode byte 0xd1 in position 117 To manage notifications about this bug go to: https://bugs.launchpad.net/duplicity/+bug/989496/+subscriptions -- ubuntu-bugs mailing list ubuntu-bugs@lists.ubuntu.com https://lists.ubuntu.com/mailman/listinfo/ubuntu-bugs
[Bug 989496] Re: UnicodeDecodeError: 'utf8' codec can't decode byte 0xd1 in position 117
Andreas Klust wrote (#18) I was able to track the problem down to one file in my home directory with a character that is not conforming to UTF-8. I wonder if you could share how you found out the files that Duplicity chokes on? After having my backup -system disfunctional for two months, i would love to rename some files as a workaround to the bug. Duplicity itself (well, i use Deja-Dup interface) gives just an unknown error and the details don't unfortunately pin it down to which character string is causing the conflict. Cheers. -- You received this bug notification because you are a member of Ubuntu Bugs, which is subscribed to Ubuntu. https://bugs.launchpad.net/bugs/989496 Title: UnicodeDecodeError: 'utf8' codec can't decode byte 0xd1 in position 117 To manage notifications about this bug go to: https://bugs.launchpad.net/duplicity/+bug/989496/+subscriptions -- ubuntu-bugs mailing list ubuntu-bugs@lists.ubuntu.com https://lists.ubuntu.com/mailman/listinfo/ubuntu-bugs
Re: [Bug 989496] Re: UnicodeDecodeError: 'utf8' codec can't decode byte 0xd1 in position 117
** * Dear customer, This is an automatic answer. Please Resend your email with cc to support.et...@cavsystems.co.il * -- *Thank you eTops Support Cav systems ___ * * * On Mon, Sep 3, 2012 at 1:01 PM, Mace 989...@bugs.launchpad.net wrote: Andreas Klust wrote (#18) I was able to track the problem down to one file in my home directory with a character that is not conforming to UTF-8. I wonder if you could share how you found out the files that Duplicity chokes on? After having my backup -system disfunctional for two months, i would love to rename some files as a workaround to the bug. Duplicity itself (well, i use Deja-Dup interface) gives just an unknown error and the details don't unfortunately pin it down to which character string is causing the conflict. Cheers. -- You received this bug notification because you are subscribed to the bug report. https://bugs.launchpad.net/bugs/989496 Title: UnicodeDecodeError: 'utf8' codec can't decode byte 0xd1 in position 117 Status in Duplicity - Bandwidth Efficient Encrypted Backup: Confirmed Status in One Hundred Paper Cuts: Confirmed Status in Ubuntu: Invalid Status in “duplicity” package in Ubuntu: Triaged Bug description: Backup failed (unknown error)... deja-dup/ubuntuone Traceback (most recent call last): File /usr/bin/duplicity, line 1403, in module with_tempdir(main) File /usr/bin/duplicity, line 1396, in with_tempdir fn() File /usr/bin/duplicity, line 1366, in main full_backup(col_stats) File /usr/bin/duplicity, line 491, in full_backup bytes_written = dummy_backup(tarblock_iter) File /usr/bin/duplicity, line 197, in dummy_backup while tarblock_iter.next(): File /usr/lib/python2.7/dist-packages/duplicity/diffdir.py, line 507, in next result = self.process(self.input_iter.next(), size) File /usr/lib/python2.7/dist-packages/duplicity/diffdir.py, line 188, in get_delta_iter for new_path, sig_path in collated: File /usr/lib/python2.7/dist-packages/duplicity/diffdir.py, line 281, in collate2iters for relem1 in riter1: File /usr/lib/python2.7/dist-packages/duplicity/selection.py, line 187, in Iterate log.Debug(_(Selecting %s) % subpath.name) UnicodeDecodeError: 'utf8' codec can't decode byte 0xd1 in position 117: invalid continuation byte ProblemType: Bug DistroRelease: Ubuntu 12.04 Package: deja-dup 22.0-0ubuntu2 ProcVersionSignature: Ubuntu 3.2.0-24.37-generic 3.2.14 Uname: Linux 3.2.0-24-generic x86_64 ApportVersion: 2.0.1-0ubuntu6 Architecture: amd64 Date: Fri Apr 27 11:49:30 2012 InstallationMedia: Ubuntu 10.04 LTS Lucid Lynx - Release amd64 (20100429) ProcEnviron: TERM=xterm PATH=(custom, no user) LANG=ru_UA.UTF-8 SHELL=/bin/bash SourcePackage: deja-dup UpgradeStatus: No upgrade log present (probably fresh install) modified.conffile..etc.xdg.autostart.deja.dup.monitor.desktop: [modified] mtime.conffile..etc.xdg.autostart.deja.dup.monitor.desktop: 2012-02-14T14:17:23.600015 To manage notifications about this bug go to: https://bugs.launchpad.net/duplicity/+bug/989496/+subscriptions -- You received this bug notification because you are a member of Ubuntu Bugs, which is subscribed to Ubuntu. https://bugs.launchpad.net/bugs/989496 Title: UnicodeDecodeError: 'utf8' codec can't decode byte 0xd1 in position 117 To manage notifications about this bug go to: https://bugs.launchpad.net/duplicity/+bug/989496/+subscriptions -- ubuntu-bugs mailing list ubuntu-bugs@lists.ubuntu.com https://lists.ubuntu.com/mailman/listinfo/ubuntu-bugs
[Bug 989496] Re: UnicodeDecodeError: 'utf8' codec can't decode byte 0xd1 in position 117
Maybe you should run duplicity with --verbose and find what's the problematic file from the last path that was printed. The wrong file must be right after the one that triggered the bug. -- You received this bug notification because you are a member of Ubuntu Bugs, which is subscribed to Ubuntu. https://bugs.launchpad.net/bugs/989496 Title: UnicodeDecodeError: 'utf8' codec can't decode byte 0xd1 in position 117 To manage notifications about this bug go to: https://bugs.launchpad.net/duplicity/+bug/989496/+subscriptions -- ubuntu-bugs mailing list ubuntu-bugs@lists.ubuntu.com https://lists.ubuntu.com/mailman/listinfo/ubuntu-bugs
[Bug 989496] Re: UnicodeDecodeError: 'utf8' codec can't decode byte 0xd1 in position 117
Hm, let me rephrase it: the wrong file must be right after the one that was printed when the bug was triggered (since it's the last one that was successful). -- You received this bug notification because you are a member of Ubuntu Bugs, which is subscribed to Ubuntu. https://bugs.launchpad.net/bugs/989496 Title: UnicodeDecodeError: 'utf8' codec can't decode byte 0xd1 in position 117 To manage notifications about this bug go to: https://bugs.launchpad.net/duplicity/+bug/989496/+subscriptions -- ubuntu-bugs mailing list ubuntu-bugs@lists.ubuntu.com https://lists.ubuntu.com/mailman/listinfo/ubuntu-bugs
[Bug 989496] Re: UnicodeDecodeError: 'utf8' codec can't decode byte 0xd1 in position 117
Hello Mace, to find the file causing the trouble in my case, I added a few lines to the duplicity source code. The error message tells you the python source file and line number where the error occurs: File /usr/lib/python2.7/dist-packages/duplicity/selection.py, line 187, in Iterate log.Debug(_(Selecting %s) % subpath.name) I added the following lines just before the call to log.debug (line 187 in this example. You will have to adapt it a little depending on the exact error message and arguments passed to log.debug.): dbgFile = open(/tmp/debug.log, 'a') dbgFile.write(%s\n % subpath.name) dbgFile.close() The last filename written to the log file /tmp/debug.log after duplicity fails is the one causing the trouble. -- You received this bug notification because you are a member of Ubuntu Bugs, which is subscribed to Ubuntu. https://bugs.launchpad.net/bugs/989496 Title: UnicodeDecodeError: 'utf8' codec can't decode byte 0xd1 in position 117 To manage notifications about this bug go to: https://bugs.launchpad.net/duplicity/+bug/989496/+subscriptions -- ubuntu-bugs mailing list ubuntu-bugs@lists.ubuntu.com https://lists.ubuntu.com/mailman/listinfo/ubuntu-bugs
[Bug 989496] Re: UnicodeDecodeError: 'utf8' codec can't decode byte 0xd1 in position 117
This is what I get: ... selection.py, line 187, in Iterate log.Debug(_(Selecting %s) % subpath.name) UnicodeDecodeError: 'utf8' codec can't decode byte 0xe4 in position 43: invalid continuation byte if this is of any help -- You received this bug notification because you are a member of Ubuntu Bugs, which is subscribed to Ubuntu. https://bugs.launchpad.net/bugs/989496 Title: UnicodeDecodeError: 'utf8' codec can't decode byte 0xd1 in position 117 To manage notifications about this bug go to: https://bugs.launchpad.net/duplicity/+bug/989496/+subscriptions -- ubuntu-bugs mailing list ubuntu-bugs@lists.ubuntu.com https://lists.ubuntu.com/mailman/listinfo/ubuntu-bugs
[Bug 989496] Re: UnicodeDecodeError: 'utf8' codec can't decode byte 0xd1 in position 117
I was able to track the problem down to one file in my home directory with a character that is not conforming to UTF-8. I believe the basic problem is that Linux file names can be made up from arbitrary bytes. Python tries to decode the binary bytes depending on the local encoding. Consequently, you need the same files AND locale configuration to reproduce the error. In my case, the filename contained a hex code F1 which is not valid UTF-8. The file is very old and is likely from a time when I used a different character encoding than UTF-8. The general problem is described in PEP 383: http://www.python.org/dev/peps/pep-0383/ . PEP 383 also proposes a solution for Python 3 but not for Python 2. See also http://www.dwheeler.com/essays/fixing-unix-linux-filenames.html for further insight in the general problem. -- You received this bug notification because you are a member of Ubuntu Bugs, which is subscribed to Ubuntu. https://bugs.launchpad.net/bugs/989496 Title: UnicodeDecodeError: 'utf8' codec can't decode byte 0xd1 in position 117 To manage notifications about this bug go to: https://bugs.launchpad.net/duplicity/+bug/989496/+subscriptions -- ubuntu-bugs mailing list ubuntu-bugs@lists.ubuntu.com https://lists.ubuntu.com/mailman/listinfo/ubuntu-bugs
[Bug 989496] Re: UnicodeDecodeError: 'utf8' codec can't decode byte 0xd1 in position 117
I'm getting an decoding error too; it's similar, but different than the title of this particular bug. My error message is: File /usr/lib/python2.7/dist-packages/duplicity/selection.py, line 187, in Iterate log.Debug(_(Selecting %s) % subpath.name) UnicodeDecodeError: 'ascii' codec can't decode byte 0xc3 in position 44: ordinal not in range(128) * lsb_release -d Description:Ubuntu quantal (development branch) * dpkg-query -W deja-dup duplicity deja-dup 23.2-0ubuntu1 duplicity0.6.19-0ubuntu1 -- You received this bug notification because you are a member of Ubuntu Bugs, which is subscribed to Ubuntu. https://bugs.launchpad.net/bugs/989496 Title: UnicodeDecodeError: 'utf8' codec can't decode byte 0xd1 in position 117 To manage notifications about this bug go to: https://bugs.launchpad.net/duplicity/+bug/989496/+subscriptions -- ubuntu-bugs mailing list ubuntu-bugs@lists.ubuntu.com https://lists.ubuntu.com/mailman/listinfo/ubuntu-bugs
[Bug 989496] Re: UnicodeDecodeError: 'utf8' codec can't decode byte 0xd1 in position 117
** Also affects: deja-dup (Ubuntu) Importance: Undecided Status: New -- You received this bug notification because you are a member of Ubuntu Bugs, which is subscribed to Ubuntu. https://bugs.launchpad.net/bugs/989496 Title: UnicodeDecodeError: 'utf8' codec can't decode byte 0xd1 in position 117 To manage notifications about this bug go to: https://bugs.launchpad.net/duplicity/+bug/989496/+subscriptions -- ubuntu-bugs mailing list ubuntu-bugs@lists.ubuntu.com https://lists.ubuntu.com/mailman/listinfo/ubuntu-bugs
[Bug 989496] Re: UnicodeDecodeError: 'utf8' codec can't decode byte 0xd1 in position 117
Status changed to 'Confirmed' because the bug affects multiple users. ** Changed in: ubuntu Status: New = Confirmed -- You received this bug notification because you are a member of Ubuntu Bugs, which is subscribed to Ubuntu. https://bugs.launchpad.net/bugs/989496 Title: UnicodeDecodeError: 'utf8' codec can't decode byte 0xd1 in position 117 To manage notifications about this bug go to: https://bugs.launchpad.net/duplicity/+bug/989496/+subscriptions -- ubuntu-bugs mailing list ubuntu-bugs@lists.ubuntu.com https://lists.ubuntu.com/mailman/listinfo/ubuntu-bugs
[Bug 989496] Re: UnicodeDecodeError: 'utf8' codec can't decode byte 0xd1 in position 117
** Package changed: deja-dup (Ubuntu) = ubuntu ** Changed in: ubuntu Status: New = Invalid ** Changed in: duplicity Status: Triaged = Confirmed -- You received this bug notification because you are a member of Ubuntu Bugs, which is subscribed to Ubuntu. https://bugs.launchpad.net/bugs/989496 Title: UnicodeDecodeError: 'utf8' codec can't decode byte 0xd1 in position 117 To manage notifications about this bug go to: https://bugs.launchpad.net/duplicity/+bug/989496/+subscriptions -- ubuntu-bugs mailing list ubuntu-bugs@lists.ubuntu.com https://lists.ubuntu.com/mailman/listinfo/ubuntu-bugs
[Bug 989496] Re: UnicodeDecodeError: 'utf8' codec can't decode byte 0xd1 in position 117
** Changed in: duplicity (Ubuntu) Status: Confirmed = Triaged ** Changed in: duplicity Status: Confirmed = Triaged ** Changed in: duplicity (Ubuntu) Importance: Undecided = Medium -- You received this bug notification because you are a member of Ubuntu Bugs, which is subscribed to Ubuntu. https://bugs.launchpad.net/bugs/989496 Title: UnicodeDecodeError: 'utf8' codec can't decode byte 0xd1 in position 117 To manage notifications about this bug go to: https://bugs.launchpad.net/duplicity/+bug/989496/+subscriptions -- ubuntu-bugs mailing list ubuntu-bugs@lists.ubuntu.com https://lists.ubuntu.com/mailman/listinfo/ubuntu-bugs
[Bug 989496] Re: UnicodeDecodeError: 'utf8' codec can't decode byte 0xd1 in position 117
The affected places where log.Debug might get called with an invalid encoded filename could use unicode() with replace or ignore. But it is likely that it will cause another similar error further down in the processing then still, when the filename gets used again. Duplicity should make sure to use the invalid encoded filename when backing up the file, and restore it given the original filename. I think that the different cases reported here should get added as separate test cases to Duplicity first, so that proper fixes for them can be added then to make the tests pass. -- You received this bug notification because you are a member of Ubuntu Bugs, which is subscribed to Ubuntu. https://bugs.launchpad.net/bugs/989496 Title: UnicodeDecodeError: 'utf8' codec can't decode byte 0xd1 in position 117 To manage notifications about this bug go to: https://bugs.launchpad.net/duplicity/+bug/989496/+subscriptions -- ubuntu-bugs mailing list ubuntu-bugs@lists.ubuntu.com https://lists.ubuntu.com/mailman/listinfo/ubuntu-bugs
[Bug 989496] Re: UnicodeDecodeError: 'utf8' codec can't decode byte 0xd1 in position 117
** Also affects: hundredpapercuts Importance: Undecided Status: New -- You received this bug notification because you are a member of Ubuntu Bugs, which is subscribed to Ubuntu. https://bugs.launchpad.net/bugs/989496 Title: UnicodeDecodeError: 'utf8' codec can't decode byte 0xd1 in position 117 To manage notifications about this bug go to: https://bugs.launchpad.net/duplicity/+bug/989496/+subscriptions -- ubuntu-bugs mailing list ubuntu-bugs@lists.ubuntu.com https://lists.ubuntu.com/mailman/listinfo/ubuntu-bugs
[Bug 989496] Re: UnicodeDecodeError: 'utf8' codec can't decode byte 0xd1 in position 117
** Changed in: hundredpapercuts Status: New = Confirmed -- You received this bug notification because you are a member of Ubuntu Bugs, which is subscribed to Ubuntu. https://bugs.launchpad.net/bugs/989496 Title: UnicodeDecodeError: 'utf8' codec can't decode byte 0xd1 in position 117 To manage notifications about this bug go to: https://bugs.launchpad.net/duplicity/+bug/989496/+subscriptions -- ubuntu-bugs mailing list ubuntu-bugs@lists.ubuntu.com https://lists.ubuntu.com/mailman/listinfo/ubuntu-bugs
[Bug 989496] Re: UnicodeDecodeError: 'utf8' codec can't decode byte 0xd1 in position 117
** Changed in: duplicity Status: New = Confirmed -- You received this bug notification because you are a member of Ubuntu Bugs, which is subscribed to Ubuntu. https://bugs.launchpad.net/bugs/989496 Title: UnicodeDecodeError: 'utf8' codec can't decode byte 0xd1 in position 117 To manage notifications about this bug go to: https://bugs.launchpad.net/duplicity/+bug/989496/+subscriptions -- ubuntu-bugs mailing list ubuntu-bugs@lists.ubuntu.com https://lists.ubuntu.com/mailman/listinfo/ubuntu-bugs
[Bug 989496] Re: UnicodeDecodeError: 'utf8' codec can't decode byte 0xd1 in position 117
Looks pretty silly to me: the bug happens merely because the file name is printed to the logs? Better skip printing the name, possibly with a warning, than getting a program that does not work. ;-) -- You received this bug notification because you are a member of Ubuntu Bugs, which is subscribed to Ubuntu. https://bugs.launchpad.net/bugs/989496 Title: UnicodeDecodeError: 'utf8' codec can't decode byte 0xd1 in position 117 To manage notifications about this bug go to: https://bugs.launchpad.net/duplicity/+bug/989496/+subscriptions -- ubuntu-bugs mailing list ubuntu-bugs@lists.ubuntu.com https://lists.ubuntu.com/mailman/listinfo/ubuntu-bugs
[Bug 989496] Re: UnicodeDecodeError: 'utf8' codec can't decode byte 0xd1 in position 117
I have the same problem. I think it is because some of my files have arabic names (in arabic script). I have alse noticed that if I make the backup into a local file system, everything function perfectly. I hope it can help. I use Ubuntu 12.04. -- You received this bug notification because you are a member of Ubuntu Bugs, which is subscribed to Ubuntu. https://bugs.launchpad.net/bugs/989496 Title: UnicodeDecodeError: 'utf8' codec can't decode byte 0xd1 in position 117 To manage notifications about this bug go to: https://bugs.launchpad.net/duplicity/+bug/989496/+subscriptions -- ubuntu-bugs mailing list ubuntu-bugs@lists.ubuntu.com https://lists.ubuntu.com/mailman/listinfo/ubuntu-bugs
[Bug 989496] Re: UnicodeDecodeError: 'utf8' codec can't decode byte 0xd1 in position 117
I have the same problem, very similar error message. It started right after I upgraded from Ubuntu 11.10 to 12.04. -- You received this bug notification because you are a member of Ubuntu Bugs, which is subscribed to Ubuntu. https://bugs.launchpad.net/bugs/989496 Title: UnicodeDecodeError: 'utf8' codec can't decode byte 0xd1 in position 117 To manage notifications about this bug go to: https://bugs.launchpad.net/duplicity/+bug/989496/+subscriptions -- ubuntu-bugs mailing list ubuntu-bugs@lists.ubuntu.com https://lists.ubuntu.com/mailman/listinfo/ubuntu-bugs
[Bug 989496] Re: UnicodeDecodeError: 'utf8' codec can't decode byte 0xd1 in position 117
Status changed to 'Confirmed' because the bug affects multiple users. ** Changed in: duplicity (Ubuntu) Status: New = Confirmed -- You received this bug notification because you are a member of Ubuntu Bugs, which is subscribed to Ubuntu. https://bugs.launchpad.net/bugs/989496 Title: UnicodeDecodeError: 'utf8' codec can't decode byte 0xd1 in position 117 To manage notifications about this bug go to: https://bugs.launchpad.net/duplicity/+bug/989496/+subscriptions -- ubuntu-bugs mailing list ubuntu-bugs@lists.ubuntu.com https://lists.ubuntu.com/mailman/listinfo/ubuntu-bugs
[Bug 989496] Re: UnicodeDecodeError: 'utf8' codec can't decode byte 0xd1 in position 117
Hello, I've got pretty much the same problem also on precise 64 bit, with deja- dup 22.0. Traceback (most recent call last): File /usr/bin/duplicity, line 1403, in module with_tempdir(main) File /usr/bin/duplicity, line 1396, in with_tempdir fn() File /usr/bin/duplicity, line 1276, in main globals.archive_dir).set_values() File /usr/lib/python2.7/dist-packages/duplicity/collections.py, line 691, in set_values self.get_backup_chains(partials + backend_filename_list) File /usr/lib/python2.7/dist-packages/duplicity/collections.py, line 814, in get_backup_chains map(add_to_sets, filename_list) File /usr/lib/python2.7/dist-packages/duplicity/collections.py, line 808, in add_to_sets log.Debug(_(File %s is not part of a known set; creating new set) % (filename,)) UnicodeDecodeError: 'ascii' codec can't decode byte 0xe2 in position 23: ordinal not in range(128) Cheers, Vv -- You received this bug notification because you are a member of Ubuntu Bugs, which is subscribed to Ubuntu. https://bugs.launchpad.net/bugs/989496 Title: UnicodeDecodeError: 'utf8' codec can't decode byte 0xd1 in position 117 To manage notifications about this bug go to: https://bugs.launchpad.net/duplicity/+bug/989496/+subscriptions -- ubuntu-bugs mailing list ubuntu-bugs@lists.ubuntu.com https://lists.ubuntu.com/mailman/listinfo/ubuntu-bugs
[Bug 989496] Re: UnicodeDecodeError: 'utf8' codec can't decode byte 0xd1 in position 117
Dido from this topic (in greek language): http://forum.ubuntu- gr.org/viewtopic.php?f=5t=23165 File /usr/lib/python2.7/dist-packages/duplicity/selection.py, line 187, in Iterate log.Debug(_(Selecting %s) % subpath.name) UnicodeDecodeError: 'utf8' codec can't decode byte 0x95 in position 45: invalid start byte -- You received this bug notification because you are a member of Ubuntu Bugs, which is subscribed to Ubuntu. https://bugs.launchpad.net/bugs/989496 Title: UnicodeDecodeError: 'utf8' codec can't decode byte 0xd1 in position 117 To manage notifications about this bug go to: https://bugs.launchpad.net/duplicity/+bug/989496/+subscriptions -- ubuntu-bugs mailing list ubuntu-bugs@lists.ubuntu.com https://lists.ubuntu.com/mailman/listinfo/ubuntu-bugs
[Bug 989496] Re: UnicodeDecodeError: 'utf8' codec can't decode byte 0xd1 in position 117
The problem is with the filename encoding you have. Please check if any
files or folders have weird characters that look like these: �
This is an example in python:
unicode('\x95','utf-8')
Traceback (most recent call last):
File stdin, line 1, in module
UnicodeDecodeError: 'utf8' codec can't decode byte 0x95 in position 0: invalid
start byte
This seems to work (but haven't tested it with duplicity):
unicode('\x95','utf-8', replace)
u'\ufffd'
unicode('\xd1','utf-8', 'replace')
u'\ufffd'
The developers could use either replace or ignore, but I don't know
which one suits the purpose best. Or even use try ... except
UnicodeDecodeError and skip these files/folders for that matter.
--
You received this bug notification because you are a member of Ubuntu
Bugs, which is subscribed to Ubuntu.
https://bugs.launchpad.net/bugs/989496
Title:
UnicodeDecodeError: 'utf8' codec can't decode byte 0xd1 in position
117
To manage notifications about this bug go to:
https://bugs.launchpad.net/duplicity/+bug/989496/+subscriptions
--
ubuntu-bugs mailing list
ubuntu-bugs@lists.ubuntu.com
https://lists.ubuntu.com/mailman/listinfo/ubuntu-bugs
[Bug 989496] Re: UnicodeDecodeError: 'utf8' codec can't decode byte 0xd1 in position 117
The problem is with the filename encoding you have. I mean... I think that's the problem, I'm not 100% sure. :) -- You received this bug notification because you are a member of Ubuntu Bugs, which is subscribed to Ubuntu. https://bugs.launchpad.net/bugs/989496 Title: UnicodeDecodeError: 'utf8' codec can't decode byte 0xd1 in position 117 To manage notifications about this bug go to: https://bugs.launchpad.net/duplicity/+bug/989496/+subscriptions -- ubuntu-bugs mailing list ubuntu-bugs@lists.ubuntu.com https://lists.ubuntu.com/mailman/listinfo/ubuntu-bugs
[Bug 989496] Re: UnicodeDecodeError: 'utf8' codec can't decode byte 0xd1 in position 117
I have a confirmation from the greek forum (mentioned above) that it is indeed the filename. The member of the forum that reported this has renamed the files and now the program is working as expected. -- You received this bug notification because you are a member of Ubuntu Bugs, which is subscribed to Ubuntu. https://bugs.launchpad.net/bugs/989496 Title: UnicodeDecodeError: 'utf8' codec can't decode byte 0xd1 in position 117 To manage notifications about this bug go to: https://bugs.launchpad.net/duplicity/+bug/989496/+subscriptions -- ubuntu-bugs mailing list ubuntu-bugs@lists.ubuntu.com https://lists.ubuntu.com/mailman/listinfo/ubuntu-bugs
[Bug 989496] Re: UnicodeDecodeError: 'utf8' codec can't decode byte 0xd1 in position 117
File names are ok. Exclude all the directories. Backup only configuration files and directories - rename nonsense! How to keep a log scan? Crashes and there is no way to look at what the catalog/file. -- You received this bug notification because you are a member of Ubuntu Bugs, which is subscribed to Ubuntu. https://bugs.launchpad.net/bugs/989496 Title: UnicodeDecodeError: 'utf8' codec can't decode byte 0xd1 in position 117 To manage notifications about this bug go to: https://bugs.launchpad.net/duplicity/+bug/989496/+subscriptions -- ubuntu-bugs mailing list ubuntu-bugs@lists.ubuntu.com https://lists.ubuntu.com/mailman/listinfo/ubuntu-bugs
[Bug 989496] Re: UnicodeDecodeError: 'utf8' codec can't decode byte 0xd1 in position 117
program should backup everything, does not it matter to check the encoding... -- You received this bug notification because you are a member of Ubuntu Bugs, which is subscribed to Ubuntu. https://bugs.launchpad.net/bugs/989496 Title: UnicodeDecodeError: 'utf8' codec can't decode byte 0xd1 in position 117 To manage notifications about this bug go to: https://bugs.launchpad.net/duplicity/+bug/989496/+subscriptions -- ubuntu-bugs mailing list ubuntu-bugs@lists.ubuntu.com https://lists.ubuntu.com/mailman/listinfo/ubuntu-bugs
[Bug 989496] Re: UnicodeDecodeError: 'utf8' codec can't decode byte 0xd1 in position 117
-- You received this bug notification because you are a member of Ubuntu Bugs, which is subscribed to Ubuntu. https://bugs.launchpad.net/bugs/989496 Title: UnicodeDecodeError: 'utf8' codec can't decode byte 0xd1 in position 117 To manage notifications about this bug go to: https://bugs.launchpad.net/ubuntu/+source/deja-dup/+bug/989496/+subscriptions -- ubuntu-bugs mailing list ubuntu-bugs@lists.ubuntu.com https://lists.ubuntu.com/mailman/listinfo/ubuntu-bugs
[Bug 989496] Re: UnicodeDecodeError: 'utf8' codec can't decode byte 0xd1 in position 117
Ken, this looks new to me. The path may not be utf8? ** Also affects: duplicity Importance: Undecided Status: New -- You received this bug notification because you are a member of Ubuntu Bugs, which is subscribed to Ubuntu. https://bugs.launchpad.net/bugs/989496 Title: UnicodeDecodeError: 'utf8' codec can't decode byte 0xd1 in position 117 To manage notifications about this bug go to: https://bugs.launchpad.net/duplicity/+bug/989496/+subscriptions -- ubuntu-bugs mailing list ubuntu-bugs@lists.ubuntu.com https://lists.ubuntu.com/mailman/listinfo/ubuntu-bugs
Re: [Bug 989496] Re: UnicodeDecodeError: 'utf8' codec can't decode byte 0xd1 in position 117
Looks like subpath.name is UTF8 but can't be decoded to ASCII for printing. We do not handle Unicode correctly, especially for printing. In Python 2 the console is ASCII, so everything has to be decoded for ASCII. Yes, it's a new bug. On Fri, Apr 27, 2012 at 8:12 AM, Michael Terry michael.te...@canonical.comwrote: Ken, this looks new to me. The path may not be utf8? ** Also affects: duplicity Importance: Undecided Status: New -- You received this bug notification because you are subscribed to Duplicity. https://bugs.launchpad.net/bugs/989496 Title: UnicodeDecodeError: 'utf8' codec can't decode byte 0xd1 in position 117 Status in Duplicity - Bandwidth Efficient Encrypted Backup: New Status in “deja-dup” package in Ubuntu: New Bug description: Backup failed (unknown error)... deja-dup/ubuntuone Traceback (most recent call last): File /usr/bin/duplicity, line 1403, in module with_tempdir(main) File /usr/bin/duplicity, line 1396, in with_tempdir fn() File /usr/bin/duplicity, line 1366, in main full_backup(col_stats) File /usr/bin/duplicity, line 491, in full_backup bytes_written = dummy_backup(tarblock_iter) File /usr/bin/duplicity, line 197, in dummy_backup while tarblock_iter.next(): File /usr/lib/python2.7/dist-packages/duplicity/diffdir.py, line 507, in next result = self.process(self.input_iter.next(), size) File /usr/lib/python2.7/dist-packages/duplicity/diffdir.py, line 188, in get_delta_iter for new_path, sig_path in collated: File /usr/lib/python2.7/dist-packages/duplicity/diffdir.py, line 281, in collate2iters for relem1 in riter1: File /usr/lib/python2.7/dist-packages/duplicity/selection.py, line 187, in Iterate log.Debug(_(Selecting %s) % subpath.name) UnicodeDecodeError: 'utf8' codec can't decode byte 0xd1 in position 117: invalid continuation byte ProblemType: Bug DistroRelease: Ubuntu 12.04 Package: deja-dup 22.0-0ubuntu2 ProcVersionSignature: Ubuntu 3.2.0-24.37-generic 3.2.14 Uname: Linux 3.2.0-24-generic x86_64 ApportVersion: 2.0.1-0ubuntu6 Architecture: amd64 Date: Fri Apr 27 11:49:30 2012 InstallationMedia: Ubuntu 10.04 LTS Lucid Lynx - Release amd64 (20100429) ProcEnviron: TERM=xterm PATH=(custom, no user) LANG=ru_UA.UTF-8 SHELL=/bin/bash SourcePackage: deja-dup UpgradeStatus: No upgrade log present (probably fresh install) modified.conffile..etc.xdg.autostart.deja.dup.monitor.desktop: [modified] mtime.conffile..etc.xdg.autostart.deja.dup.monitor.desktop: 2012-02-14T14:17:23.600015 To manage notifications about this bug go to: https://bugs.launchpad.net/duplicity/+bug/989496/+subscriptions -- You received this bug notification because you are a member of Ubuntu Bugs, which is subscribed to Ubuntu. https://bugs.launchpad.net/bugs/989496 Title: UnicodeDecodeError: 'utf8' codec can't decode byte 0xd1 in position 117 To manage notifications about this bug go to: https://bugs.launchpad.net/duplicity/+bug/989496/+subscriptions -- ubuntu-bugs mailing list ubuntu-bugs@lists.ubuntu.com https://lists.ubuntu.com/mailman/listinfo/ubuntu-bugs
[Bug 989496] Re: UnicodeDecodeError: 'utf8' codec can't decode byte 0xd1 in position 117
** Package changed: deja-dup (Ubuntu) = duplicity (Ubuntu) -- You received this bug notification because you are a member of Ubuntu Bugs, which is subscribed to Ubuntu. https://bugs.launchpad.net/bugs/989496 Title: UnicodeDecodeError: 'utf8' codec can't decode byte 0xd1 in position 117 To manage notifications about this bug go to: https://bugs.launchpad.net/duplicity/+bug/989496/+subscriptions -- ubuntu-bugs mailing list ubuntu-bugs@lists.ubuntu.com https://lists.ubuntu.com/mailman/listinfo/ubuntu-bugs
