[issue30672] PEP 538: Unexpected locale behaviour on *BSD (including Mac OS X)

[STINNER Victor]

Change by STINNER Victor :


--
nosy:  -vstinner

___
Python tracker 

___
___
Python-bugs-list mailing list
Unsubscribe: 
https://mail.python.org/mailman/options/python-bugs-list/archive%40mail-archive.com

[issue30672] PEP 538: Unexpected locale behaviour on *BSD (including Mac OS X)

[Nick Coghlan]

Nick Coghlan  added the comment:

Removing issue assignment, as I'm not actively investigating this.

--
assignee: ncoghlan -> 

___
Python tracker 

___
___
Python-bugs-list mailing list
Unsubscribe: 
https://mail.python.org/mailman/options/python-bugs-list/archive%40mail-archive.com

[issue30672] PEP 538: Unexpected locale behaviour on *BSD (including Mac OS X)

[Nick Coghlan]

Nick Coghlan  added the comment:

(Removed the patch keyword, as the linked PR was for an old change that didn't 
cover the remaining test issues)

--

___
Python tracker 

___
___
Python-bugs-list mailing list
Unsubscribe: 
https://mail.python.org/mailman/options/python-bugs-list/archive%40mail-archive.com

[issue30672] PEP 538: Unexpected locale behaviour on *BSD (including Mac OS X)

[Nick Coghlan]

Nick Coghlan  added the comment:

There are a couple of cases that the C locale coercion tests skip because I 
don't (or didn't) know what they *should* do:

* 
https://github.com/python/cpython/blob/24dc2f8c56697f9ee51a4887cf0814b6600c1815/Lib/test/test_c_locale_coercion.py#L262
 (skips the "LANG=UTF-8" test)
* 
https://github.com/python/cpython/blob/24dc2f8c56697f9ee51a4887cf0814b6600c1815/Lib/test/test_c_locale_coercion.py#L37
 (only adds "POSIX" to the expected C locale equivalents list on non-Android 
Linux systems)

With the interpreter explicitly checking for "POSIX" now, at least the latter 
special case could potentially be removed, with "POSIX" just always being part 
of the EXPECTED_C_LOCALE_EQUIVALENTS list. (It was only removed because it used 
to break on FreeBSD and Mac OS X)

I don't think we ever figured out why the "LANG=UTF-8" case didn't work the way 
we expected, so I suspect where going to need to keep that skip for now.

--

___
Python tracker 

___
___
Python-bugs-list mailing list
Unsubscribe: 
https://mail.python.org/mailman/options/python-bugs-list/archive%40mail-archive.com

[issue30672] PEP 538: Unexpected locale behaviour on *BSD (including Mac OS X)

[STINNER Victor]

STINNER Victor  added the comment:

Since this issue has been created, I deeply reworked the Python Initialization 
with the PEP 587, and I made many changes related to locales and the UTF-8 Mode 
(PEP 540). What's the status of this issue?

--
nosy: +vstinner

___
Python tracker 

___
___
Python-bugs-list mailing list
Unsubscribe: 
https://mail.python.org/mailman/options/python-bugs-list/archive%40mail-archive.com

[issue30672] PEP 538: Unexpected locale behaviour on *BSD (including Mac OS X)

[STINNER Victor]

Change by STINNER Victor :


--
nosy:  -vstinner

___
Python tracker 

___
___
Python-bugs-list mailing list
Unsubscribe: 
https://mail.python.org/mailman/options/python-bugs-list/archive%40mail-archive.com

[issue30672] PEP 538: Unexpected locale behaviour on *BSD (including Mac OS X)

[Nick Coghlan]

Change by Nick Coghlan :


--
keywords: +patch
pull_requests: +9033
stage: test needed -> patch review

___
Python tracker 

___
___
Python-bugs-list mailing list
Unsubscribe: 
https://mail.python.org/mailman/options/python-bugs-list/archive%40mail-archive.com

[issue30672] PEP 538: Unexpected locale behaviour on *BSD (including Mac OS X)

[Nick Coghlan]

Nick Coghlan  added the comment:

Putting back to normal, as the difference between the C locale and the POSIX 
locale is that you never get the latter by default - you have to explicitly 
request it.

The underlying fix for this is in the PR for bpo-34589.

--
dependencies: +Py_Initialize() and Py_Main() should not enable C locale coercion
priority: critical -> normal

___
Python tracker 

___
___
Python-bugs-list mailing list
Unsubscribe: 
https://mail.python.org/mailman/options/python-bugs-list/archive%40mail-archive.com

[issue30672] PEP 538: Unexpected locale behaviour on *BSD (including Mac OS X)

[Nick Coghlan]

Nick Coghlan  added the comment:

The locale module has its own extra layer of oddities that I don't personally 
understand - #29571 and #20087 are another couple of issues along those lines.

--

___
Python tracker 

___
___
Python-bugs-list mailing list
Unsubscribe: 
https://mail.python.org/mailman/options/python-bugs-list/archive%40mail-archive.com

[issue30672] PEP 538: Unexpected locale behaviour on *BSD (including Mac OS X)

[Ned Deily]

Ned Deily  added the comment:

Thanks for the headsup, Nick.  BTW, some of the discussion in languishing 
Issue18378 might be relevant here.

--

___
Python tracker 

___
___
Python-bugs-list mailing list
Unsubscribe: 
https://mail.python.org/mailman/options/python-bugs-list/archive%40mail-archive.com

[issue30672] PEP 538: Unexpected locale behaviour on *BSD (including Mac OS X)

[Nick Coghlan]

Nick Coghlan  added the comment:

Ned, I'd forgotten about the part of this issue which amounts to "Check for 
'POSIX' as a locale coercion trigger in addition to 'C', as not every platform 
aliases the former to the latter the way glibc does".

So while I don't think this is really a release blocker (as you have to 
explicitly request the POSIX locale to encounter the discrepancy, and I think 
fixing it in 3.7.1 would be OK), I *am* bumping it up to "critical", as I think 
it would be better to resolve this for 3.7.0b4 rather than letting it linger 
further.

--
priority: normal -> critical

___
Python tracker 

___
___
Python-bugs-list mailing list
Unsubscribe: 
https://mail.python.org/mailman/options/python-bugs-list/archive%40mail-archive.com

[issue30672] PEP 538: Unexpected locale behaviour on *BSD (including Mac OS X)

[Nick Coghlan]

Nick Coghlan  added the comment:

As discussed in https://bugs.python.org/issue32238 and 
https://mail.python.org/pipermail/python-dev/2017-December/151105.html, I now 
think the right answer for the POSIX case is to ensure the legacy locale 
detection logic always treats that the same way as it does the C locale.

LANG=UTF-8 I'm still not sure about - as I understand it, that's a partial 
locale that only defines LC_CTYPE, which may be why the libc implementation 
ignores it if you try to set it as a general category default.

--

___
Python tracker 

___
___
Python-bugs-list mailing list
Unsubscribe: 
https://mail.python.org/mailman/options/python-bugs-list/archive%40mail-archive.com

[issue30672] PEP 538: Unexpected locale behaviour on *BSD (including Mac OS X)

[Nick Coghlan]

Changes by Nick Coghlan :


--
assignee:  -> ncoghlan

___
Python tracker 

___
___
Python-bugs-list mailing list
Unsubscribe: 
https://mail.python.org/mailman/options/python-bugs-list/archive%40mail-archive.com

[issue30672] PEP 538: Unexpected locale behaviour on *BSD (including Mac OS X)

[Nick Coghlan]

Nick Coghlan added the comment:

Flagging issue 30647 as a dependency, since the problem with breaking 
nl_langinfo will need to be fixed before these tests can be re-enabled.

--
dependencies: +CODESET error on AMD64 FreeBSD 10.x Shared 3.x caused by the PEP 
538

___
Python tracker 

___
___
Python-bugs-list mailing list
Unsubscribe: 
https://mail.python.org/mailman/options/python-bugs-list/archive%40mail-archive.com

[issue30672] PEP 538: Unexpected locale behaviour on *BSD (including Mac OS X)

[Nick Coghlan]

Nick Coghlan added the comment:

It seems the "POSIX is not just an alias for the C locale" behaviour is 
inherited from *BSD, rather than being specific to Mac OS X: 
http://buildbot.python.org/all/builders/AMD64%20FreeBSD%20CURRENT%20Debug%20custom/builds/12/steps/test/logs/stdio

--
title: PEP 538: Unexpected locale behaviour on Mac OS X -> PEP 538: Unexpected 
locale behaviour on *BSD (including Mac OS X)

___
Python tracker 

___
___
Python-bugs-list mailing list
Unsubscribe: 
https://mail.python.org/mailman/options/python-bugs-list/archive%40mail-archive.com