[issue15809] 2.7 IDLE console uses incorrect encoding.

[Pradyun Gedam]

Change by Pradyun Gedam :


--
nosy:  -pradyunsg

___
Python tracker 

___
___
Python-bugs-list mailing list
Unsubscribe: 
https://mail.python.org/mailman/options/python-bugs-list/archive%40mail-archive.com

[issue15809] 2.7 IDLE console uses incorrect encoding.

[Serhiy Storchaka]

Serhiy Storchaka added the comment:

It would be nice to add configuration option for IDLE Shell encoding and 
highlight non-encodable characters in Shell and Editor. But this feature is 
needed mainly for 2.7.

--
resolution:  -> fixed
stage: patch review -> resolved
status: open -> closed

___
Python tracker 

___
___
Python-bugs-list mailing list
Unsubscribe: 
https://mail.python.org/mailman/options/python-bugs-list/archive%40mail-archive.com

[issue15809] 2.7 IDLE console uses incorrect encoding.

[R. David Murray]

Changes by R. David Murray :


--
nosy:  -r.david.murray

___
Python tracker 

___
___
Python-bugs-list mailing list
Unsubscribe: 
https://mail.python.org/mailman/options/python-bugs-list/archive%40mail-archive.com

[issue15809] 2.7 IDLE console uses incorrect encoding.

[fireattack]

fireattack added the comment:

Any update on this?

--

___
Python tracker 

___
___
Python-bugs-list mailing list
Unsubscribe: 
https://mail.python.org/mailman/options/python-bugs-list/archive%40mail-archive.com

[issue15809] 2.7 IDLE console uses incorrect encoding.

[Ned Deily]

Changes by Ned Deily :


--
nosy:  -ned.deily

___
Python tracker 

___
___
Python-bugs-list mailing list
Unsubscribe: 
https://mail.python.org/mailman/options/python-bugs-list/archive%40mail-archive.com

[issue15809] 2.7 IDLE console uses incorrect encoding.

[Terry J. Reedy]

Terry J. Reedy added the comment:

Serhiy, unless you are planning to do something more, please close this.  The 
extended extended maintenance period for 2.7 is mainly for build and security 
issues, and I don't expect to do any more 2.7-only patches.

--

___
Python tracker 

___
___
Python-bugs-list mailing list
Unsubscribe: 
https://mail.python.org/mailman/options/python-bugs-list/archive%40mail-archive.com

[issue15809] 2.7 IDLE console uses incorrect encoding.

[烈之斩]

Changes by Benjamin Peng (烈之斩) human.p...@gmail.com:


--
nosy: +Benjamin Peng (烈之斩)

___
Python tracker rep...@bugs.python.org
http://bugs.python.org/issue15809
___
___
Python-bugs-list mailing list
Unsubscribe: 
https://mail.python.org/mailman/options/python-bugs-list/archive%40mail-archive.com

[issue15809] 2.7 IDLE console uses incorrect encoding.

[Roundup Robot]

Roundup Robot added the comment:

New changeset 247f003b42ea by Serhiy Storchaka in branch '2.7':
Issue #15809: IDLE shell now uses locale encoding instead of Latin1 for
https://hg.python.org/cpython/rev/247f003b42ea

--
nosy: +python-dev

___
Python tracker rep...@bugs.python.org
http://bugs.python.org/issue15809
___
___
Python-bugs-list mailing list
Unsubscribe: 
https://mail.python.org/mailman/options/python-bugs-list/archive%40mail-archive.com

[issue15809] 2.7 IDLE console uses incorrect encoding.

[Terry J. Reedy]

Terry J. Reedy added the comment:

#19625, with a bit of discussion, was closed as a duplicate of this issue.

--

___
Python tracker rep...@bugs.python.org
http://bugs.python.org/issue15809
___
___
Python-bugs-list mailing list
Unsubscribe: 
https://mail.python.org/mailman/options/python-bugs-list/archive%40mail-archive.com

[issue15809] 2.7 IDLE console uses incorrect encoding.

[Serhiy Storchaka]

Serhiy Storchaka added the comment:

Only ufix_utf8 (with the utf-8 encoding of stdin/stdout/stderr) and ufix_locale 
(with hacked tracebacks) make sense.

--

___
Python tracker rep...@bugs.python.org
http://bugs.python.org/issue15809
___
___
Python-bugs-list mailing list
Unsubscribe: 
https://mail.python.org/mailman/options/python-bugs-list/archive%40mail-archive.com

[issue15809] 2.7 IDLE console uses incorrect encoding.

[Serhiy Storchaka]

Serhiy Storchaka added the comment:

When someone reads file in locale encoding (either as str or unicode in 2.7), 
he gets printable result. When someone lists directory, he gets printable 
result (str or unicode). When someone enter string literal (either str or 
unicode) in interactive mode, he gets printable result. This is expected 
behavior. And this means that default encoding for text files, filesystem 
encoding and encoding used in interactive Python (or IDLE console) should be 
the same, locale encoding.

 Irdb said As a Windows user, currently I can't print u'йцук' in interactive 
 mode and get an Unsupported characters in input error because my default 
 system encoding (cp1256) can't encode Russian.)

This is different issue. It would be better if IDLE will filter pasted text and 
replace unencodable characters or underscore them with wavy red line.

--

___
Python tracker rep...@bugs.python.org
http://bugs.python.org/issue15809
___
___
Python-bugs-list mailing list
Unsubscribe: 
https://mail.python.org/mailman/options/python-bugs-list/archive%40mail-archive.com

[issue15809] 2.7 IDLE console uses incorrect encoding.

[Terry J. Reedy]

Terry J. Reedy added the comment:

I wonder if we should consider extracting the body of
if isinstance(source, types.UnicodeType):
as a function, call it ufix_latin1; add one or more alterntives, ufix_utf8, 
ufix_locale, ufix_irdb(?); keep ufix_latin1 as default; but switch to an 
alternative according to an Idle command line switch (or environmental 
variable?)?

--

___
Python tracker rep...@bugs.python.org
http://bugs.python.org/issue15809
___
___
Python-bugs-list mailing list
Unsubscribe: 
https://mail.python.org/mailman/options/python-bugs-list/archive%40mail-archive.com

[issue15809] 2.7 IDLE console uses incorrect encoding.

[Serhiy Storchaka]

Serhiy Storchaka added the comment:

Alternative solution is to force UTF-8 in IDLE console. But I think this will 
be more surprising, especially for Windows users.

--

___
Python tracker rep...@bugs.python.org
http://bugs.python.org/issue15809
___
___
Python-bugs-list mailing list
Unsubscribe: 
https://mail.python.org/mailman/options/python-bugs-list/archive%40mail-archive.com

[issue15809] 2.7 IDLE console uses incorrect encoding.

[Terry J. Reedy]

Terry J. Reedy added the comment:

Idle 3.x has Martin's patch, except that the 'if' clause is merely commented 
out rather than removed. (Perhaps someone wanted to test the removal first.  It 
should now be deleted.)

My 2.7 Idle has Default Source Encoding ... [x] None. Since there is nothing 
for this in either config-main.def, I presume it is the default -- at least for 
Windows. But Martin says it is not relevant.

'Surprising' suggests that you think or know that doing the same in 2.7 might 
introduce other discrepancies from console behavior. I am reluctant to do that, 
though it is possible that it might make Idle *better* than the console.

I would definitely be reluctant to do something more wide-ranging than your 
patch without extensive tests, and even that patch should have some tests, some 
of which pass now and continue to pass, and other that fail now and pass with 
the patch.

Irdb said As a Windows user, currently I can't print u'йцук' in interactive 
mode and get an Unsupported characters in input error because my default 
system encoding (cp1256) can't encode Russian.)

Idle 2.7
 u'йцук'
Unsupported characters in input

Console 2.7
 u''
u''
 u''[0] == '?'
True

--

___
Python tracker rep...@bugs.python.org
http://bugs.python.org/issue15809
___
___
Python-bugs-list mailing list
Unsubscribe: 
https://mail.python.org/mailman/options/python-bugs-list/archive%40mail-archive.com

[issue15809] 2.7 IDLE console uses incorrect encoding.

[Martin v . Löwis]

Changes by Martin v. Löwis mar...@v.loewis.de:


--
nosy:  -loewis

___
Python tracker rep...@bugs.python.org
http://bugs.python.org/issue15809
___
___
Python-bugs-list mailing list
Unsubscribe: 
https://mail.python.org/mailman/options/python-bugs-list/archive%40mail-archive.com

[issue15809] 2.7 IDLE console uses incorrect encoding.

[Terry J. Reedy]

Terry J. Reedy added the comment:

It took me awhile to re-recognize Это из консоли: as 'made in konsole'.
I agree that the discrepancy between Idle shell and console is a bug relative 
to a general goal of having them work as nearly the same as possible and 
sensible.

 This bug is critical for non-ASCII-only users of IDLE.

This bug, like many others involving non-Ascii chars, has already been fixed in 
3.x, though it is not only a 2 versus 3 issue. Given that there are technical 
limits to imitating the console, we could have closed this issue as already 
fixed, wont fix in 2.7, upgrade to a version that has the fix.  However, 
since this is also a within 2.7, console versus Idle issue, improvement would 
be good.

The +coding cookie, -1 line hack induces a non-obvious dependency between files 
that I think should be documented by comments such as
# run.cleanup_traceback() compensates for added line
# compensation for coding cookie added in pyshel..runsource()

I think it ok to push less than perfect patches that make definite improvements 
and do not preclude possibly better patches in the future.  I have not seen any 
comment from alex whether this fixes his particular example on his machine, but 
if you are convinced that this fixes some problems and only causes a micro 
slowdown of working uses, go ahead.

--
title: IDLE console uses incorrect encoding. - 2.7 IDLE  console uses 
incorrect encoding.

___
Python tracker rep...@bugs.python.org
http://bugs.python.org/issue15809
___
___
Python-bugs-list mailing list
Unsubscribe: 
https://mail.python.org/mailman/options/python-bugs-list/archive%40mail-archive.com