[issue10416] UnicodeDecodeError when 2to3 is run on a dir with numpy .npy files

[Benjamin Peterson]

Benjamin Peterson  added the comment:

r86464

--
resolution:  -> fixed
status: open -> closed

___
Python tracker 

___
___
Python-bugs-list mailing list
Unsubscribe: 
http://mail.python.org/mailman/options/python-bugs-list/archive%40mail-archive.com

[issue10416] UnicodeDecodeError when 2to3 is run on a dir with numpy .npy files

[Georg Brandl]

Changes by Georg Brandl :


--
assignee:  -> benjamin.peterson
nosy: +benjamin.peterson

___
Python tracker 

___
___
Python-bugs-list mailing list
Unsubscribe: 
http://mail.python.org/mailman/options/python-bugs-list/archive%40mail-archive.com

[issue10416] UnicodeDecodeError when 2to3 is run on a dir with numpy .npy files

[Zbyszek Szmek]

New submission from Zbyszek Szmek :

1. 2to3 should work only only files ending with '.py', but it takes
   anything which has a dot and ends with 'py'. I'm having trouble
   with numpy .npy files.
2. 2to3 tries to decode the file and fails with traceback that is not useful:
   the name of the failing file is not given.

A patch is attached.

% ls *.npy|head -n1
S_18_7000_899811b572b309161cbb34f185b82fb618ed81da.npy

% 2to3-3.2 /usr/local/bin/2to3-3.2 .
RefactoringTool: Skipping implicit fixer: buffer
RefactoringTool: Skipping implicit fixer: idioms
RefactoringTool: Skipping implicit fixer: set_literal
RefactoringTool: Skipping implicit fixer: ws_comma
Traceback (most recent call last):
  File "/usr/local/bin/2to3-3.2", line 6, in 
sys.exit(main("lib2to3.fixes"))
  File "/usr/local/lib/python3.2/lib2to3/main.py", line 172, in main
options.processes)
  File "/usr/local/lib/python3.2/lib2to3/refactor.py", line 699, in refactor
items, write, doctests_only)
  File "/usr/local/lib/python3.2/lib2to3/refactor.py", line 294, in refactor
self.refactor_dir(dir_or_file, write, doctests_only)
  File "/usr/local/lib/python3.2/lib2to3/refactor.py", line 313, in refactor_dir
self.refactor_file(fullname, write, doctests_only)
  File "/usr/local/lib/python3.2/lib2to3/refactor.py", line 740, in 
refactor_file
*args, **kwargs)
  File "/usr/local/lib/python3.2/lib2to3/refactor.py", line 335, in 
refactor_file
input, encoding = self._read_python_source(filename)
  File "/usr/local/lib/python3.2/lib2to3/refactor.py", line 331, in 
_read_python_source
return _from_system_newlines(f.read()), encoding
  File "/usr/local/lib/python3.2/codecs.py", line 300, in decode
(result, consumed) = self._buffer_decode(data, self.errors, final)
UnicodeDecodeError: 'utf8' codec can't decode byte 0x93 in position 0: invalid 
start byte

--
components: 2to3 (2.x to 3.0 conversion tool)
files: diff.diff
keywords: patch
messages: 121188
nosy: zbysz
priority: normal
severity: normal
status: open
title: UnicodeDecodeError when 2to3 is run on a dir with numpy .npy files
type: crash
versions: Python 3.2
Added file: http://bugs.python.org/file19605/diff.diff

___
Python tracker 

___
___
Python-bugs-list mailing list
Unsubscribe: 
http://mail.python.org/mailman/options/python-bugs-list/archive%40mail-archive.com