[issue10600] surrogateescape'd paths not readable on Windows XP.
New submission from Campbell Barton ideasma...@gmail.com: Attached is a script which works in linux but not windows XP 32bit with Python 3.1.3. The problem is that the path can be written to when specified as bytes but when escaped it fails. -- components: IO files: utf8_surrogateescape.py messages: 123022 nosy: ideasman42 priority: normal severity: normal status: open title: surrogateescape'd paths not readable on Windows XP. versions: Python 3.1 Added file: http://bugs.python.org/file19896/utf8_surrogateescape.py ___ Python tracker rep...@bugs.python.org http://bugs.python.org/issue10600 ___ ___ Python-bugs-list mailing list Unsubscribe: http://mail.python.org/mailman/options/python-bugs-list/archive%40mail-archive.com
[issue10600] surrogateescape'd paths not readable on Windows XP.
Campbell Barton ideasma...@gmail.com added the comment: note, this bug was reported to me by a user running windows 7, 64bits. -- ___ Python tracker rep...@bugs.python.org http://bugs.python.org/issue10600 ___ ___ Python-bugs-list mailing list Unsubscribe: http://mail.python.org/mailman/options/python-bugs-list/archive%40mail-archive.com
[issue10600] surrogateescape'd paths not readable on Windows XP.
STINNER Victor victor.stin...@haypocalc.com added the comment: Use surrogateescape error handler to decode a Windows path is not a good idea. On Windows, the problem is not to decode a path (ANSI = wide char), but to encode a path (wide char = ANSI) to use a function expecting bytes path encoded to the ANSI code page. surrogateescape is only useful on the *decode* operation, to store undecodable bytes in special characters. Why do you decode a Windows path using UTF-8? UTF-8 is not used, by default, as an ANSI code page. But first, what do you manipulate bytes path on Windows? If you would like a portable program supporting UNIX/BSD (bytes) and Windows (unicode) paths with a single type, you should use str instead of bytes, because Unicode (with surrogateescape) is a superset of bytes. Python 3.2 has os.fsencode() and os.fsdecode() functions to do that easily (to decode/encode UNIX/BSD paths). -- nosy: +haypo ___ Python tracker rep...@bugs.python.org http://bugs.python.org/issue10600 ___ ___ Python-bugs-list mailing list Unsubscribe: http://mail.python.org/mailman/options/python-bugs-list/archive%40mail-archive.com
[issue10600] surrogateescape'd paths not readable on Windows XP.
Campbell Barton ideasma...@gmail.com added the comment: This bug is with blender3d, were the paths are stored internally in C as simple char arrays - bytes. We could expose all path names as bytes too through our C/python API, this would at least be a 1:1 mapping, however Id prefer using strings if possible. Since blender projects need to be portable - compress entire projects and run on different systems, we cant ensure the native fs encoding is used. So surrogateescape seems to work very well, except for this one case I've run into, windows only. -- ___ Python tracker rep...@bugs.python.org http://bugs.python.org/issue10600 ___ ___ Python-bugs-list mailing list Unsubscribe: http://mail.python.org/mailman/options/python-bugs-list/archive%40mail-archive.com
[issue10600] surrogateescape'd paths not readable on Windows XP.
Martin v. Löwis mar...@v.loewis.de added the comment: This is not a bug. You can't expect that using an arbitrary codec (such as UTF-8) with the surrogateescape code, and expect to be able that opening the file will be able to produce the correct filename. This won't work on Unix, in the general case, either. The surrogateescape code will work correctly in this setup only when used with the filesystem encoding. -- nosy: +loewis resolution: - invalid status: open - closed ___ Python tracker rep...@bugs.python.org http://bugs.python.org/issue10600 ___ ___ Python-bugs-list mailing list Unsubscribe: http://mail.python.org/mailman/options/python-bugs-list/archive%40mail-archive.com
