[issue36791] sum() relies on C signed overflow behaviour

[Serhiy Storchaka]

Change by Serhiy Storchaka :


--
keywords: +patch
pull_requests: +12995
stage:  -> patch review

___
Python tracker 

___
___
Python-bugs-list mailing list
Unsubscribe: 
https://mail.python.org/mailman/options/python-bugs-list/archive%40mail-archive.com

[issue36791] sum() relies on C signed overflow behaviour

[Serhiy Storchaka]

New submission from Serhiy Storchaka :

sum() assumes that an arithmetic operation on signed longs will wrap modulo 
2**(bits_in_long) on overflow.  However, signed overflow causes undefined 
behaviour according  to the C standards (e.g., C99 6.5, para. 5), and gcc is 
known to assume that signed overflow never occurs in correct code, and to make 
use of this assumption when optimizing.

See also issue7406.

--
components: Interpreter Core
messages: 341374
nosy: mark.dickinson, rhettinger, serhiy.storchaka
priority: normal
severity: normal
status: open
title: sum() relies on C signed overflow behaviour
type: behavior
versions: Python 3.7, Python 3.8

___
Python tracker 

___
___
Python-bugs-list mailing list
Unsubscribe: 
https://mail.python.org/mailman/options/python-bugs-list/archive%40mail-archive.com

[issue36656] Allow os.symlink(src, target, force=True) to prevent race conditions

[Tom Hale]

Tom Hale  added the comment:

Yes, but by default (because of difficulty) people won't check for this case:

1. I delete existing symlink in order to recreate it
2. Attacker watching symlink finds it deleted and recreates it
3. I try to create symlink, and an unexpected exception is raised

--

___
Python tracker 

___
___
Python-bugs-list mailing list
Unsubscribe: 
https://mail.python.org/mailman/options/python-bugs-list/archive%40mail-archive.com

[issue36778] test_site.StartupImportTests.test_startup_imports fails if default code page is not cp1252

[STINNER Victor]

STINNER Victor  added the comment:

cp65001 is *not* utf-8: Microsoft decided to handle surrogates differently
for some reasons.

--

___
Python tracker 

___
___
Python-bugs-list mailing list
Unsubscribe: 
https://mail.python.org/mailman/options/python-bugs-list/archive%40mail-archive.com

[issue36774] f-strings: Add a !d conversion for ease of debugging

[Steven D'Aprano]

Steven D'Aprano  added the comment:

> Steven: We shouldn't block this immediately useful feature from going 
> in for f-strings on waiting for some much broader first class access 
> to expressions feature.  !d would be practical today.

I hear you, and after giving it much more thought I agree.

--

___
Python tracker 

___
___
Python-bugs-list mailing list
Unsubscribe: 
https://mail.python.org/mailman/options/python-bugs-list/archive%40mail-archive.com

[issue34155] email.utils.parseaddr mistakenly parse an email

[Windson Yang]

Windson Yang  added the comment:

Frome the answer from Alnitak 
(https://stackoverflow.com/questions/12355858/how-many-symbol-can-be-in-an-email-address).
 Maybe we should raise an error when the address has multiple @ in it.

--

___
Python tracker 

___
___
Python-bugs-list mailing list
Unsubscribe: 
https://mail.python.org/mailman/options/python-bugs-list/archive%40mail-archive.com

[issue33777] dummy_threading: .is_alive method returns True after execution has completed

[Jeffrey Kintscher]

Jeffrey Kintscher  added the comment:

I also see inconsistent behaviorbetween the enumerate() functions in threading 
and dummy_threading:


Python 3.7.3 (default, May  1 2019, 00:00:47) 
[Clang 10.0.1 (clang-1001.0.46.4)] on darwin
Type "help", "copyright", "credits" or "license" for more information.
>>> from threading import Thread
>>> from threading import enumerate
>>> enumerate()
[<_MainThread(MainThread, started 4618048960)>]
>>> def f(): print('foo')
... 
>>> t = Thread(target=f)
>>> enumerate()
[<_MainThread(MainThread, started 4618048960)>]
>>> t.start()
foo
>>> enumerate()
[<_MainThread(MainThread, started 4618048960)>]
>>> t.is_alive()
False
>>> enumerate()
[<_MainThread(MainThread, started 4618048960)>]
>>> t.join()
>>> enumerate()
[<_MainThread(MainThread, started 4618048960)>]


Python 3.7.3 (default, May  1 2019, 00:00:47) 
[Clang 10.0.1 (clang-1001.0.46.4)] on darwin
Type "help", "copyright", "credits" or "license" for more information.
>>> from dummy_threading import Thread
>>> from dummy_threading import enumerate
>>> enumerate()
[<_MainThread(MainThread, started 1)>]
>>> def f(): print('foo')
... 
>>> t = Thread(target=f)
>>> enumerate()
[<_MainThread(MainThread, started 1)>]
>>> t.start()
foo
>>> enumerate()
[]
>>> t.is_alive()
True
>>> enumerate()
[]
>>> t.join()
>>> enumerate()
[<_DummyThread(Dummy-2, started daemon 1)>]

--

___
Python tracker 

___
___
Python-bugs-list mailing list
Unsubscribe: 
https://mail.python.org/mailman/options/python-bugs-list/archive%40mail-archive.com

[issue33777] dummy_threading: .is_alive method returns True after execution has completed

[Jeffrey Kintscher]

Jeffrey Kintscher  added the comment:

This behavior still exists in 3.7.3:

Python 3.7.3 (default, May  1 2019, 00:00:47) 
[Clang 10.0.1 (clang-1001.0.46.4)] on darwin
Type "help", "copyright", "credits" or "license" for more information.
>>> from dummy_threading import Thread
>>> def f(): print('foo')
... 
>>> t = Thread(target=f)
>>> t.start()
foo
>>> t.is_alive()
True
>>> t.join()
>>> t.is_alive()
False


It is inconsistent with the threading module behavior (which matches the 2.x 
behavior):


Python 3.7.3 (default, May  1 2019, 00:00:47) 
[Clang 10.0.1 (clang-1001.0.46.4)] on darwin
Type "help", "copyright", "credits" or "license" for more information.
>>> from threading import Thread
>>> def f(): print('foo')
... 
>>> t = Thread(target=f)
>>> t.start()
foo
>>> t.is_alive()
False
>>> t.join()
>>> t.is_alive()
False

I would classify this as a bug since the documentation claims the 
dummy_threading module is supposed to be a drop-in replacement for the 
threading module.

--
nosy: +websurfer5

___
Python tracker 

___
___
Python-bugs-list mailing list
Unsubscribe: 
https://mail.python.org/mailman/options/python-bugs-list/archive%40mail-archive.com

[issue34155] email.utils.parseaddr mistakenly parse an email

[jpic]

jpic  added the comment:

The pull request has been updated to mimic net/mail's behavior rather than
trying to workaround user input.

Before:

>>> email.message_from_string('From: a...@malicious.org@important.com',
policy=email.policy.default)['from'].addresses
(Address(display_name='', username='a', domain='malicious.org'),)

>>> parseaddr('a...@malicious.org@important.com')
('', 'a...@malicious.org')

After:

>>> email.message_from_string('From: a...@malicious.org@important.com',
policy=email.policy.default)['from'].addresses
(Address(display_name='', username='', domain=''),)

>>> parseaddr('a...@malicious.org@important.com')
('', 'a@')

I like what I saw under the hood, please feel free to hack me for other
tasks in the email stdlib.

--

___
Python tracker 

___
___
Python-bugs-list mailing list
Unsubscribe: 
https://mail.python.org/mailman/options/python-bugs-list/archive%40mail-archive.com

[issue36790] test_asyncio fails with application verifier!

[Karthikeyan Singaravelan]

Change by Karthikeyan Singaravelan :


--
nosy: +asvetlov, yselivanov

___
Python tracker 

___
___
Python-bugs-list mailing list
Unsubscribe: 
https://mail.python.org/mailman/options/python-bugs-list/archive%40mail-archive.com

[issue36790] test_asyncio fails with application verifier!

[Alexander Riccio]

Alexander Riccio  added the comment:

Hmm, proceeding a bit further pointed to finish_recv in windows_events.py

--
Added file: https://bugs.python.org/file48299/python_invalid_handle.PNG

___
Python tracker 

___
___
Python-bugs-list mailing list
Unsubscribe: 
https://mail.python.org/mailman/options/python-bugs-list/archive%40mail-archive.com

[issue36790] test_asyncio fails with application verifier!

[Alexander Riccio]

New submission from Alexander Riccio :

I compiled PCBuild Debug x64 from an updated clone of upstream, and when 
running the testsuite under Application Verifier with handle verification, the 
test triggers an invalid handle access by passing an invalid overlapped handle 
to CancelIoEx with this code: Py_CancelIoEx(self->handle, >overlapped) 
(where self->handle appears to be the offending variable).

I have no idea who's calling _overlapped.cancel, and a quick spelunking through 
the codebase only confuses me more.

--
components: Tests
files: python_test_invalid_handle_failure.TXT
messages: 341365
nosy: Alexander Riccio
priority: normal
severity: normal
status: open
title: test_asyncio fails with application verifier!
versions: Python 3.8
Added file: 
https://bugs.python.org/file48298/python_test_invalid_handle_failure.TXT

___
Python tracker 

___
___
Python-bugs-list mailing list
Unsubscribe: 
https://mail.python.org/mailman/options/python-bugs-list/archive%40mail-archive.com

[issue36789] Unicode HOWTO incorrectly states that UTF-8 contains no zero bytes

[Andrew Svetlov]

Andrew Svetlov  added the comment:

This is right for 99.99% cases: utf8 doesn't encode any character except 
explicit zero with zero bytes.

UTF-16 for example encodes 'a' as b'\xff\xfea\x00'

--
nosy: +asvetlov

___
Python tracker 

___
___
Python-bugs-list mailing list
Unsubscribe: 
https://mail.python.org/mailman/options/python-bugs-list/archive%40mail-archive.com

[issue36789] Unicode HOWTO incorrectly states that UTF-8 contains no zero bytes

[mbiggs]

New submission from mbiggs :

In the Unicode HOWTO: http://docs.python.org/3.3/howto/unicode.html

It says the following:


"UTF-8 has several convenient properties:
(...)
2. A Unicode string is turned into a sequence of bytes containing no embedded 
zero bytes. This avoids byte-ordering issues, and means UTF-8 strings can be 
processed by C functions such as strcpy() and sent through protocols that can’t 
handle zero bytes."

This is not right.  UTF-8 uses the zero byte to represent the Unicode codepoint 
U+ (the ASCII NULL character).  This is a valid character in UTF-8 and is 
handled just fine by python's UTF-8 string encoding/decoding.

--
assignee: docs@python
components: Documentation
messages: 341363
nosy: docs@python, mbiggs
priority: normal
severity: normal
status: open
title: Unicode HOWTO incorrectly states that UTF-8 contains no zero bytes
versions: Python 2.7, Python 3.5, Python 3.6, Python 3.7, Python 3.8

___
Python tracker 

___
___
Python-bugs-list mailing list
Unsubscribe: 
https://mail.python.org/mailman/options/python-bugs-list/archive%40mail-archive.com

[issue34155] email.utils.parseaddr mistakenly parse an email

[jpic]

jpic  added the comment:

I haven't found this specific case in an RFC, but checked Go's net/mail
library behavior and it just considers it broken:

$ cat mail.go
package main
import "fmt"
import "net/mail"
func main() {
fmt.Println(({}).Parse("a...@example.com"))
fmt.Println(({}).Parse("a...@malicious.org@example.com
"))
}

$ go run mail.go
 
 mail: expected single address, got "@example.com"

That would fix the security issue but not the whole ticket.

--

___
Python tracker 

___
___
Python-bugs-list mailing list
Unsubscribe: 
https://mail.python.org/mailman/options/python-bugs-list/archive%40mail-archive.com

[issue36788] Add clamp() function to builtins

[Steven D'Aprano]

Steven D'Aprano  added the comment:

I doubt this is important enough to go into builtins, the only practical 
use-case I know of for this function is with numbers, so this could go in the 
math module.

But putting that aside, there are some other problems:

- it isn't clear that clamp() is meaningful for anything that could possibly 
need a key function;

- the behaviour you have for iterable arguments is inconsistent with the 
existing behaviour of min(max(x, a), b):

min(max('a string', 'd'), 'm')
=> returns 'd' not ['d', 'd', 'm', 'm', 'm', 'i', 'm', 'g']

- your iterable behaviour is easily done with a comprehension and doesn't need 
to be supported by the function itself

[clamp(x, a, b) for x in values]

- what do you intend clamp() to do with NAN arguments?

- for numbers, it is sometimes useful to do one-sided clamping, e.g. clamp(x, 
-1, ∞).

You should read over this thread here:

https://mail.python.org/pipermail/python-ideas/2016-July/041262.html

--
nosy: +steven.daprano

___
Python tracker 

___
___
Python-bugs-list mailing list
Unsubscribe: 
https://mail.python.org/mailman/options/python-bugs-list/archive%40mail-archive.com

[issue36787] Python3 regresison: String formatting of None object

[Eric V. Smith]

Eric V. Smith  added the comment:

This behavior isn't going to change. As Zach says, if you want to convert any 
value to a string, use !s. We want to fail as soon as possible: if a class 
(such as NoneType) doesn't implement __format__, then trying to format an 
instance with a format spec that doesn't apply to it should be an error. If you 
want to support strings or None, then it's your job to ensure the conversion.

As issue7994 says, one of the big drivers of this change (I'll argue it's 
really a bugfix) was that you could never add __format__ to  class if it didn't 
previously have one. Or if you did, it would have to support at least the 
string format spec, since there might be code that formatted it with "^10", for 
example.

As things currently stand, we could add __format__ to NoneType and have "T/F" 
mean convert to "True" or "False". If NoneTypes were already format-able with 
"^10", this change wouldn't be possible.

--
assignee:  -> eric.smith
resolution:  -> not a bug
stage:  -> resolved
status: open -> closed

___
Python tracker 

___
___
Python-bugs-list mailing list
Unsubscribe: 
https://mail.python.org/mailman/options/python-bugs-list/archive%40mail-archive.com

[issue36788] Add clamp() function to builtins

[TheComet]

TheComet  added the comment:

I have implemented it on my branch here: 
https://github.com/TheComet/cpython/blob/fix-issue-36788/Python/bltinmodule.c

It still needs further testing and I haven't leak checked it properly.

--

___
Python tracker 

___
___
Python-bugs-list mailing list
Unsubscribe: 
https://mail.python.org/mailman/options/python-bugs-list/archive%40mail-archive.com

[issue36788] Add clamp() function to builtins

[TheComet]

New submission from TheComet :

It would be nice to have a clamp() builtin in addition to min() and max() so 
one can type e.g. "clamp(value, 2, 5)" instead of having to type 
"min(max(value, 5), 2)".

--
components: Library (Lib)
messages: 341358
nosy: TheComet
priority: normal
severity: normal
status: open
title: Add clamp() function to builtins
type: enhancement

___
Python tracker 

___
___
Python-bugs-list mailing list
Unsubscribe: 
https://mail.python.org/mailman/options/python-bugs-list/archive%40mail-archive.com

[issue34155] email.utils.parseaddr mistakenly parse an email

[Roundup Robot]

Change by Roundup Robot :


--
keywords: +patch
pull_requests: +12994
stage:  -> patch review

___
Python tracker 

___
___
Python-bugs-list mailing list
Unsubscribe: 
https://mail.python.org/mailman/options/python-bugs-list/archive%40mail-archive.com

[issue36787] Python3 regresison: String formatting of None object

[Zachary Ware]

Zachary Ware  added the comment:

You can use `!s` to be sure that the object is a string:

>>> '{!s:^10}'.format(None)
'   None   '

I think it's unlikely the behavior of NoneType.__format__ will be changed, but 
I'm adding Eric Smith to make that determination as the maintainer of 
str.format.

See issue7994 for the background on the change that produced this behavior.

--
nosy: +eric.smith, zach.ware
versions: +Python 3.8

___
Python tracker 

___
___
Python-bugs-list mailing list
Unsubscribe: 
https://mail.python.org/mailman/options/python-bugs-list/archive%40mail-archive.com

[issue36787] Python3 regresison: String formatting of None object

[Gawain Bolton]

Gawain Bolton  added the comment:

Note: I have a patch which fixes this.

--

___
Python tracker 

___
___
Python-bugs-list mailing list
Unsubscribe: 
https://mail.python.org/mailman/options/python-bugs-list/archive%40mail-archive.com

[issue36787] Python3 regresison: String formatting of None object

[Gawain Bolton]

New submission from Gawain Bolton :

Python 2.7.16 (default, Apr  6 2019, 01:42:57)
[GCC 8.3.0] on linux2
Type "help", "copyright", "credits" or "license" for more information.  
  
>>> print('{:^10}'.format(None))
   None

However this does not work with Python3:
Python 3.7.3 (default, Apr  3 2019, 05:39:12)
[GCC 8.3.0] on linux
Type "help", "copyright", "credits" or "license" for more information.  
  
>>> print('{:^10}'.format(None))
Traceback (most recent call last):
  File "", line 1, in 
TypeError: unsupported format string passed to NoneType.__format__

Given that the None type is output as a string, it makes sense for  
 string formatting options to be 
usable with it.  It also makes code 
 less fragile and avoids having to write special cases for when 
values 
could be None.

--
components: Library (Lib)
messages: 341355
nosy: Gawain Bolton
priority: normal
severity: normal
status: open
title: Python3 regresison: String formatting of None object
type: behavior

___
Python tracker 

___
___
Python-bugs-list mailing list
Unsubscribe: 
https://mail.python.org/mailman/options/python-bugs-list/archive%40mail-archive.com

[issue36758] configured libdir not correctly passed to Python executable

[Xavier de Gaye]

Xavier de Gaye  added the comment:

I can reproduce the problem.

The Makefile uses LIBDIR as set by configure to install the libraries and this 
is not consistent with Modules/getpath.c that finds the locations of the 
libraries (see the detailed comments at the top of the source file) without 
searching for LIBDIR.

The work around is to use PYTHONHOME.
Michael is right and ./configure should at least issue a warning when --libdir 
is used.

--
nosy: +xdegaye

___
Python tracker 

___
___
Python-bugs-list mailing list
Unsubscribe: 
https://mail.python.org/mailman/options/python-bugs-list/archive%40mail-archive.com

[issue14440] Close background process if IDLE closes abnormally.

[Andrew Svetlov]

Andrew Svetlov  added the comment:

outdated

--
resolution:  -> out of date
stage: needs patch -> resolved
status: open -> closed

___
Python tracker 

___
___
Python-bugs-list mailing list
Unsubscribe: 
https://mail.python.org/mailman/options/python-bugs-list/archive%40mail-archive.com

[issue32309] Implement asyncio.run_in_executor shortcut

[Andrew Svetlov]

Andrew Svetlov  added the comment:

In Python 3.7 loop.run_in_executor() is the only user-faced method that 
requires a loop.

asyncio.ThreadPool() sounds great. Maybe thread group can provide better api.

But for Python 3.8 adding `run_in_executor` top-level function looks the only 
easy and obvious way to help people getting rid of explicit loop usage.

Yuri, what do you think?

--

___
Python tracker 

___
___
Python-bugs-list mailing list
Unsubscribe: 
https://mail.python.org/mailman/options/python-bugs-list/archive%40mail-archive.com

[issue36786] "make install" should run compileall in parallel

[Antoine Pitrou]

Change by Antoine Pitrou :


--
keywords: +patch
pull_requests: +12993
stage: needs patch -> patch review

___
Python tracker 

___
___
Python-bugs-list mailing list
Unsubscribe: 
https://mail.python.org/mailman/options/python-bugs-list/archive%40mail-archive.com

[issue35148] cannot activate a venv environment on a Swiss German windows

[Eryk Sun]

Change by Eryk Sun :


--
resolution:  -> duplicate
stage: patch review -> resolved
status: open -> closed
superseder:  -> venv activate.bat reset codepage fails on windows 10

___
Python tracker 

___
___
Python-bugs-list mailing list
Unsubscribe: 
https://mail.python.org/mailman/options/python-bugs-list/archive%40mail-archive.com

[issue28238] In xml.etree.ElementTree findall() can't search all elements in a namespace

[Stefan Behnel]

Change by Stefan Behnel :


--
resolution:  -> fixed
stage: patch review -> resolved
status: open -> closed

___
Python tracker 

___
___
Python-bugs-list mailing list
Unsubscribe: 
https://mail.python.org/mailman/options/python-bugs-list/archive%40mail-archive.com

[issue28238] In xml.etree.ElementTree findall() can't search all elements in a namespace

[Stefan Behnel]

Stefan Behnel  added the comment:


New changeset 47541689ccea79dfcb055c6be5800b13fcb6bdd2 by Stefan Behnel in 
branch 'master':
bpo-28238: Implement "{*}tag" and "{ns}*" wildcard tag selection support for 
ElementPath, and extend the surrounding tests and docs. (GH-12997)
https://github.com/python/cpython/commit/47541689ccea79dfcb055c6be5800b13fcb6bdd2


--

___
Python tracker 

___
___
Python-bugs-list mailing list
Unsubscribe: 
https://mail.python.org/mailman/options/python-bugs-list/archive%40mail-archive.com

[issue36785] Implement PEP 574

[Antoine Pitrou]

Change by Antoine Pitrou :


--
assignee:  -> pitrou

___
Python tracker 

___
___
Python-bugs-list mailing list
Unsubscribe: 
https://mail.python.org/mailman/options/python-bugs-list/archive%40mail-archive.com

[issue36785] Implement PEP 574

[Antoine Pitrou]

Change by Antoine Pitrou :


--
keywords: +patch
pull_requests: +12992
stage: needs patch -> patch review

___
Python tracker 

___
___
Python-bugs-list mailing list
Unsubscribe: 
https://mail.python.org/mailman/options/python-bugs-list/archive%40mail-archive.com

[issue36786] "make install" should run compileall in parallel

[Antoine Pitrou]

New submission from Antoine Pitrou :

Title says it all.  Currently, "make install" will bytecode-compile Python 
sources sequentially even though compileall supports doing it in parallel.

--
components: Build
messages: 341350
nosy: pitrou
priority: normal
severity: normal
stage: needs patch
status: open
title: "make install" should run compileall in parallel
type: enhancement
versions: Python 3.8

___
Python tracker 

___
___
Python-bugs-list mailing list
Unsubscribe: 
https://mail.python.org/mailman/options/python-bugs-list/archive%40mail-archive.com

[issue36785] Implement PEP 574

[Antoine Pitrou]

New submission from Antoine Pitrou :

Now that PEP 574 (Pickle protocol 5 with out-of-band data) has been accepted, 
it should be implemented.

--
components: Extension Modules, Library (Lib)
messages: 341349
nosy: ncoghlan, pitrou
priority: normal
severity: normal
stage: needs patch
status: open
title: Implement PEP 574
type: enhancement
versions: Python 3.8

___
Python tracker 

___
___
Python-bugs-list mailing list
Unsubscribe: 
https://mail.python.org/mailman/options/python-bugs-list/archive%40mail-archive.com

[issue33882] doc Mention breakpoint() in debugger-related FAQ

[miss-islington]

Change by miss-islington :


--
pull_requests: +12991

___
Python tracker 

___
___
Python-bugs-list mailing list
Unsubscribe: 
https://mail.python.org/mailman/options/python-bugs-list/archive%40mail-archive.com

[issue33882] doc Mention breakpoint() in debugger-related FAQ

[Éric Araujo]

Éric Araujo  added the comment:


New changeset cf48e55f7f7718482fa712552f0cbc0aea1c826f by Éric Araujo (Andre 
Delfino) in branch 'master':
bpo-33882: mention breakpoint() in debugger-related FAQ (GH-7759)
https://github.com/python/cpython/commit/cf48e55f7f7718482fa712552f0cbc0aea1c826f


--
nosy: +eric.araujo

___
Python tracker 

___
___
Python-bugs-list mailing list
Unsubscribe: 
https://mail.python.org/mailman/options/python-bugs-list/archive%40mail-archive.com

[issue27409] List socket.SO_*, SCM_*, MSG_*, IPPROTO_* symbols

[Zachary Ware]

Change by Zachary Ware :


--
Removed message: https://bugs.python.org/msg341325

___
Python tracker 

___
___
Python-bugs-list mailing list
Unsubscribe: 
https://mail.python.org/mailman/options/python-bugs-list/archive%40mail-archive.com

[issue17667] Windows: build with "build_pgo.bat -2" fails to optimize python.dll

[Zachary Ware]

Change by Zachary Ware :


Removed file: https://bugs.python.org/file48296/27409.pdf

___
Python tracker 

___
___
Python-bugs-list mailing list
Unsubscribe: 
https://mail.python.org/mailman/options/python-bugs-list/archive%40mail-archive.com

[issue36783] No documentation for _FromXandFold C API functions

[Paul Ganssle]

Paul Ganssle  added the comment:

This ticket should be reserved for the mentored sprint.

--
assignee: docs@python -> Mariatta

___
Python tracker 

___
___
Python-bugs-list mailing list
Unsubscribe: 
https://mail.python.org/mailman/options/python-bugs-list/archive%40mail-archive.com

[issue35947] Update libffi_msvc to current version of libffi

[Paul Monson]

Change by Paul Monson :


--
stage: patch review -> resolved
status: open -> closed

___
Python tracker 

___
___
Python-bugs-list mailing list
Unsubscribe: 
https://mail.python.org/mailman/options/python-bugs-list/archive%40mail-archive.com

[issue36782] Add tests for the datetime C API

[Paul Ganssle]

Paul Ganssle  added the comment:

This ticket should be reserved for the mentored sprint.

--
assignee:  -> Mariatta
nosy: +Mariatta

___
Python tracker 

___
___
Python-bugs-list mailing list
Unsubscribe: 
https://mail.python.org/mailman/options/python-bugs-list/archive%40mail-archive.com

[issue36509] Add iot layout for windows iot containers

[Paul Monson]

Change by Paul Monson :


--
stage: patch review -> resolved
status: open -> closed

___
Python tracker 

___
___
Python-bugs-list mailing list
Unsubscribe: 
https://mail.python.org/mailman/options/python-bugs-list/archive%40mail-archive.com

[issue24638] asyncio "loop argument must agree with future" error message could be improved

[Andrew Svetlov]

Andrew Svetlov  added the comment:


New changeset 4737b923df6fbdb9e2bf3fdccea2112270556e0a by Andrew Svetlov 
(Zackery Spytz) in branch 'master':
bpo-24638: Improve the error message in asyncio.ensure_future() (#12848)
https://github.com/python/cpython/commit/4737b923df6fbdb9e2bf3fdccea2112270556e0a


--

___
Python tracker 

___
___
Python-bugs-list mailing list
Unsubscribe: 
https://mail.python.org/mailman/options/python-bugs-list/archive%40mail-archive.com

[issue36613] asyncio._wait() don't remove callback in case of exception

[miss-islington]

miss-islington  added the comment:


New changeset 769ac7e7b809dfc60abd0d7e6f020c6ffe06a6c0 by Miss Islington (bot) 
in branch '3.7':
bpo-36613: call remove_done_callback if exception (GH-12800)
https://github.com/python/cpython/commit/769ac7e7b809dfc60abd0d7e6f020c6ffe06a6c0


--

___
Python tracker 

___
___
Python-bugs-list mailing list
Unsubscribe: 
https://mail.python.org/mailman/options/python-bugs-list/archive%40mail-archive.com

[issue24638] asyncio "loop argument must agree with future" error message could be improved

[Andrew Svetlov]

Change by Andrew Svetlov :


--
resolution:  -> fixed
stage: patch review -> resolved
status: open -> closed

___
Python tracker 

___
___
Python-bugs-list mailing list
Unsubscribe: 
https://mail.python.org/mailman/options/python-bugs-list/archive%40mail-archive.com

[issue36613] asyncio._wait() don't remove callback in case of exception

[Andrew Svetlov]

Change by Andrew Svetlov :


--
resolution:  -> fixed
stage: patch review -> resolved
status: open -> closed
versions:  -Python 3.6

___
Python tracker 

___
___
Python-bugs-list mailing list
Unsubscribe: 
https://mail.python.org/mailman/options/python-bugs-list/archive%40mail-archive.com

[issue36613] asyncio._wait() don't remove callback in case of exception

[miss-islington]

Change by miss-islington :


--
pull_requests: +12990

___
Python tracker 

___
___
Python-bugs-list mailing list
Unsubscribe: 
https://mail.python.org/mailman/options/python-bugs-list/archive%40mail-archive.com

[issue36613] asyncio._wait() don't remove callback in case of exception

[miss-islington]

miss-islington  added the comment:


New changeset c1964e9e2177eabe821f3e4243be8b99e0d2d542 by Miss Islington (bot) 
(gescheit) in branch 'master':
bpo-36613: call remove_done_callback if exception (GH-12800)
https://github.com/python/cpython/commit/c1964e9e2177eabe821f3e4243be8b99e0d2d542


--
nosy: +miss-islington

___
Python tracker 

___
___
Python-bugs-list mailing list
Unsubscribe: 
https://mail.python.org/mailman/options/python-bugs-list/archive%40mail-archive.com

[issue36341] bind() on AF_UNIX socket may fail in tests run as non-root

[miss-islington]

miss-islington  added the comment:


New changeset 4461d704e23a13dfbe78ea3020e4cbeff4b68dc2 by Miss Islington (bot) 
(xdegaye) in branch 'master':
bpo-36341: Fix tests calling bind() on AF_UNIX sockets (GH-12399)
https://github.com/python/cpython/commit/4461d704e23a13dfbe78ea3020e4cbeff4b68dc2


--
nosy: +miss-islington

___
Python tracker 

___
___
Python-bugs-list mailing list
Unsubscribe: 
https://mail.python.org/mailman/options/python-bugs-list/archive%40mail-archive.com

[issue36341] bind() on AF_UNIX socket may fail in tests run as non-root

[Andrew Svetlov]

Change by Andrew Svetlov :


--
resolution:  -> fixed
stage: patch review -> resolved
status: open -> closed

___
Python tracker 

___
___
Python-bugs-list mailing list
Unsubscribe: 
https://mail.python.org/mailman/options/python-bugs-list/archive%40mail-archive.com

[issue36512] future_factory argument for Thread/ProcessPoolExecutor

[Andrew Svetlov]

Andrew Svetlov  added the comment:

What is your use case?

--
nosy: +asvetlov

___
Python tracker 

___
___
Python-bugs-list mailing list
Unsubscribe: 
https://mail.python.org/mailman/options/python-bugs-list/archive%40mail-archive.com

[issue34214] Pylint recusion stack overflow abort

[Jeroen Demeyer]

Jeroen Demeyer  added the comment:

What seems to be happening is a recursion error while handling a recursion 
error. Essentially

>>> def f():
... try:
... f()
... except:
... f()
... 
>>> f()
Fatal Python error: Cannot recover from stack overflow.

So unless I'm missing something here, I don't see why this should be considered 
a CPython bug.

--

___
Python tracker 

___
___
Python-bugs-list mailing list
Unsubscribe: 
https://mail.python.org/mailman/options/python-bugs-list/archive%40mail-archive.com

[issue36777] unittest discover throws TypeError on empty packages

[Karthikeyan Singaravelan]

Karthikeyan Singaravelan  added the comment:

I opened issue36784 for reference leak in the initial report along with a 
reproducer that is reproducible on master branch without my changes.

--

___
Python tracker 

___
___
Python-bugs-list mailing list
Unsubscribe: 
https://mail.python.org/mailman/options/python-bugs-list/archive%40mail-archive.com

[issue36784] __import__ with empty folder after importlib.invalidate_caches causes reference leak

[Karthikeyan Singaravelan]

New submission from Karthikeyan Singaravelan :

I originally hit upon this with issue36777 where I have used 
support.script_helper.make_script which calls importlib.invalidate_caches and 
then trying to use __import__ on an empty folder causes reference leak. I tried 
3.8 to 3.5 and it exists on each version. A sample script as below. I tried 
using try finally instead of DirsOnSysPath in doubt and it still causes leak. I 
couldn't find any issues on search and let me know if I am using something in 
an incorrect manner.

import importlib
import unittest
import os, sys
import os.path
from test import support

def test_importlib_cache():

with support.temp_dir() as path:
dirname, basename = os.path.split(path)
os.mkdir(os.path.join(path, 'test2'))
importlib.invalidate_caches()

with support.DirsOnSysPath(dirname):
__import__("{basename}.test2".format(basename=basename))


class Tests(unittest.TestCase):

def test_bug(self):
for _ in range(10):
test_importlib_cache()

➜  cpython git:(master) ✗ ./python.exe -m test -R 3:3 test_import_bug
Run tests sequentially
0:00:00 load avg: 1.56 [1/1] test_import_bug
beginning 6 repetitions
123456
..
test_import_bug leaked [980, 980, 980] references, sum=2940
test_import_bug leaked [370, 370, 370] memory blocks, sum=1110
test_import_bug failed

== Tests result: FAILURE ==

1 test failed:
test_import_bug

Total duration: 1 sec 529 ms
Tests result: FAILURE


I also tried __import__('test1.test2') instead of 
__import__("{basename}.test2".format(basename=basename)) and the program 
doesn't cause reference leak. Moving importlib.invalidate_caches() above 
support.temp_dir() also causes leak so I guess it's not something to do with 
temporary directories that are cleaned up after tests.

➜  cpython git:(master) ✗ mkdir -p test1/test2
➜  cpython git:(master) ✗ ./python.exe -m test -R 3:3 test_import_bug
Run tests sequentially
0:00:00 load avg: 1.97 [1/1] test_import_bug
beginning 6 repetitions
123456
..
test_import_bug passed

== Tests result: SUCCESS ==

1 test OK.

Total duration: 557 ms
Tests result: SUCCESS

--
components: Library (Lib)
messages: 341338
nosy: brett.cannon, eric.snow, ncoghlan, xtreak
priority: normal
severity: normal
status: open
title: __import__ with empty folder after importlib.invalidate_caches causes 
reference leak
type: behavior
versions: Python 3.7, Python 3.8

___
Python tracker 

___
___
Python-bugs-list mailing list
Unsubscribe: 
https://mail.python.org/mailman/options/python-bugs-list/archive%40mail-archive.com

[issue36783] No documentation for _FromXandFold C API functions

[Paul Ganssle]

Change by Paul Ganssle :


--
nosy: +Mariatta, cheryl.sabella

___
Python tracker 

___
___
Python-bugs-list mailing list
Unsubscribe: 
https://mail.python.org/mailman/options/python-bugs-list/archive%40mail-archive.com

[issue36783] No documentation for _FromXandFold C API functions

[Paul Ganssle]

New submission from Paul Ganssle :

In Python 3.6, Time_FromTimeAndFold and PyDateTime_FromDateAndTimeAndFold were 
added as part of the PEP 495 implementation, but no documentation was added for 
the C API portions of this change: 
https://docs.python.org/3.7/c-api/datetime.html

The functions were added to this portion of the C API capsule: 
https://github.com/python/cpython/blob/master/Include/datetime.h#L173

Macros are here: 
https://github.com/python/cpython/blob/master/Include/datetime.h#L222

These functions should be documented, with `..versionadded:: 3.6`

--
assignee: docs@python
components: Documentation
keywords: easy
messages: 341337
nosy: docs@python, p-ganssle
priority: low
severity: normal
status: open
title: No documentation for _FromXandFold C API functions
versions: Python 3.8, Python 3.9

___
Python tracker 

___
___
Python-bugs-list mailing list
Unsubscribe: 
https://mail.python.org/mailman/options/python-bugs-list/archive%40mail-archive.com

[issue36782] Add tests for the datetime C API

[Paul Ganssle]

New submission from Paul Ganssle :

A decent fraction of the datetime C API has no tests. If we had tests, we could 
have prevented bpo #36025, which was a regression in the FromTimestamp method.

I would like to open this issue to suggest the addition of tests for the full 
interface, to prevent further regressions here.

To write a test, first add a wrapper function in the _testcapimodule module: 
https://github.com/python/cpython/blob/master/Modules/_testcapimodule.c#L2218

Then test that function here: 
https://github.com/python/cpython/blob/master/Lib/test/datetimetester.py#L5821

See an example at GH PR 11922: https://github.com/python/cpython/pull/11922

I recommend testing *both* the version of the function accessed by the Macro 
(e.g. PyDate_FromTimestamp) and from the C API capsule (e.g. 
PyDateTimeApi->FromTimestamp), since projects access these functions in both 
ways.

C API Documentation is here: https://docs.python.org/3/c-api/datetime.html


Currently untested:

- PyDate_FromDate / PyDateTimeAPI->Date_FromDate
- PyDateTime_FromDateAndTime / PyDateTimeAPI->DateTime_FromDateAndTime
- PyDateTime_FromDateAndTimeAndFold / 
PyDateTimeAPI->DateTime_FromDateAndTimeAndFold
- PyTime_FromTime -> PyDateTimeAPI->Time_FromTime
- PyTime_FromTimeAndFold -> PyDateTime->Time_FromTimeAndFold
- PyDelta_FromDSU / PyDateTime->Delta_FromDelta

Untested macros with no corresponding API module:

- PyDateTime_DATE_GET_YEAR
- PyDateTime_DATE_GET_MONTH
- PyDateTime_DATE_GET_DAY
- PyDateTime_DATE_GET_HOUR
- PyDateTime_DATE_GET_MINUTE
- PyDateTime_DATE_GET_SECOND
- PyDateTime_DATE_GET_MICROSECOND

- PyDateTime_DELTA_GET_DAYS
- PyDateTime_DELTA_GET_SECONDS
- PyDateTime_DELTA_GET_MICROSECONDS

I can spawn smaller issues for this if that's preferred, but I figured we'd 
start with this big meta-issue.

--
components: Tests
keywords: easy
messages: 341336
nosy: p-ganssle
priority: low
severity: normal
status: open
title: Add tests for the datetime C API
type: enhancement
versions: Python 3.8, Python 3.9

___
Python tracker 

___
___
Python-bugs-list mailing list
Unsubscribe: 
https://mail.python.org/mailman/options/python-bugs-list/archive%40mail-archive.com

[issue36782] Add tests for the datetime C API

[Eric N. Vander Weele]

Change by Eric N. Vander Weele :


--
nosy: +ericvw

___
Python tracker 

___
___
Python-bugs-list mailing list
Unsubscribe: 
https://mail.python.org/mailman/options/python-bugs-list/archive%40mail-archive.com

[issue34214] Pylint recusion stack overflow abort

[Jeroen Demeyer]

Jeroen Demeyer  added the comment:

FYI: this one-liner installs the crashing versions:

pip3 install git+https://github.com/nickdrozd/astroid.git@crash 
git+https://github.com/nickdrozd/pylint.git@crash

--
nosy: +jdemeyer

___
Python tracker 

___
___
Python-bugs-list mailing list
Unsubscribe: 
https://mail.python.org/mailman/options/python-bugs-list/archive%40mail-archive.com

[issue36743] Docs: Descript __get__ signature defined differently across the docs

[Jeroen Demeyer]

Jeroen Demeyer  added the comment:

> Perhaps the datamodel docs can be clarified to note that callers are allowed 
> to omit the third argument

That's not true in general, only when __get__ is a slot wrapper (i.e. for 
classes implemented in C). When __get__ is a Python function, nothing special 
is done, it's just a Python function.

--

___
Python tracker 

___
___
Python-bugs-list mailing list
Unsubscribe: 
https://mail.python.org/mailman/options/python-bugs-list/archive%40mail-archive.com

[issue36743] Docs: Descript __get__ signature defined differently across the docs

[Jeroen Demeyer]

Jeroen Demeyer  added the comment:

Personally, I have always found "instance" and "owner" very confusing names for 
these arguments. If you want to change the documentation, I would recommend 
changing those names too. Better names would be "obj" and "cls" or something 
like that.

--
nosy: +jdemeyer

___
Python tracker 

___
___
Python-bugs-list mailing list
Unsubscribe: 
https://mail.python.org/mailman/options/python-bugs-list/archive%40mail-archive.com

[issue34848] range.index only takes one argument when it's documented as taking the usual 3

[miss-islington]

Change by miss-islington :


--
pull_requests: +12989

___
Python tracker 

___
___
Python-bugs-list mailing list
Unsubscribe: 
https://mail.python.org/mailman/options/python-bugs-list/archive%40mail-archive.com

[issue36774] f-strings: Add a !d conversion for ease of debugging

[Eric V. Smith]

Eric V. Smith  added the comment:

!= would be my preference, but it can't work. f'{0!=1}' is already legal.

I'm not crazy about !!. I think that will be too confusing.

--

___
Python tracker 

___
___
Python-bugs-list mailing list
Unsubscribe: 
https://mail.python.org/mailman/options/python-bugs-list/archive%40mail-archive.com

[issue36774] f-strings: Add a !d conversion for ease of debugging

[Serhiy Storchaka]

Serhiy Storchaka  added the comment:

This conversion is very special. For all other conversions 
{value:!c:format_spec} is equivalent to format(conv(value), format_spec), but 
not this conversion. It is also specific for f-strings, and is not particularly 
useful in format strings.

Would not be better to use more special syntax for it? For example "!=" or 
"!!"? Letters can be reserved for future "normal" conversions. It may be we 
even allowed to register new converters by name.

--

___
Python tracker 

___
___
Python-bugs-list mailing list
Unsubscribe: 
https://mail.python.org/mailman/options/python-bugs-list/archive%40mail-archive.com

[issue36780] Interpreter exit blocks waiting for futures of shut-down ThreadPoolExecutors

[SilentGhost]

Change by SilentGhost :


--
nosy: +bquinlan, pitrou
type:  -> behavior
versions:  -Python 3.9

___
Python tracker 

___
___
Python-bugs-list mailing list
Unsubscribe: 
https://mail.python.org/mailman/options/python-bugs-list/archive%40mail-archive.com

[issue36781] Optimize sum() for bools

[Serhiy Storchaka]

New submission from Serhiy Storchaka :

To count the number of items that satisfy certain condition you can use either

sum(1 for x in data if pred(x))

or

sum(pred(x) for x in data)

where pred(x) is a boolean expression.

The latter case is shorter but slower. There are two causes for this:

1. The generator expression needs to generate more items, not only when pred(x) 
is true, but also when pred(x) is false.

2. sum() is optimized for integers and floats, but not for bools.

The first cause is out of the scope of this issue, but sum() can optimized for 
bools.

$ ./python -m timeit -s "a = [True] * 10**6" -- "sum(a)"
Unpatched:  10 loops, best of 5: 22.3 msec per loop
Patched:50 loops, best of 5: 6.26 msec per loop

$ ./python -m timeit -s "a = list(range(10**6))" -- "sum(x % 2 == 0 for x in a)"
Unpatched:  5 loops, best of 5: 89.8 msec per loop
Patched:5 loops, best of 5: 67.5 msec per loop

$ ./python -m timeit -s "a = list(range(10**6))" -- "sum(1 for x in a if x % 2 
== 0)"
5 loops, best of 5: 53.9 msec per loop

--
components: Interpreter Core
messages: 341330
nosy: rhettinger, serhiy.storchaka
priority: normal
severity: normal
status: open
title: Optimize sum() for bools
type: performance
versions: Python 3.8

___
Python tracker 

___
___
Python-bugs-list mailing list
Unsubscribe: 
https://mail.python.org/mailman/options/python-bugs-list/archive%40mail-archive.com

[issue36780] Interpreter exit blocks waiting for futures of shut-down ThreadPoolExecutors

[Hrvoje Nikšić]

New submission from Hrvoje Nikšić :

At interpreter shutdown, Python waits for all pending futures of all executors 
to finish. There seems to be no way to disable the wait for pools that have 
been explicitly shut down with pool.shutdown(wait=False). The attached script 
demonstrates the issue.

In our code the futures are running blocking network calls that can be canceled 
by the user. The cancel action automatically cancels the pending futures and 
informs the running ones that they should exit. The remaining futures are those 
whose callables are "stuck" in network calls with long or infinite timeouts, 
such as reading from a non-responding network filesystem. Since those can't be 
interrupted, we use pool.shutdown(wait=False) to disown the whole pool. This 
works nicely, until the application exit, at which point it blocks trying to 
wait for the pending futures to finish. This can take an arbitrary amount of 
time, possibly never finishing.

A similar question has come up on StackOverflow, with the only answer 
recommending to unregister concurrent.futures.thread._python_exit: 
https://stackoverflow.com/q/48350257/1600898 . We are ourselves using a similar 
hack, but we would like to contribute a proper way to disown an executor.

The current behavior is explicitly documented, so presumably it can't be 
(easily) changed, but we could add a "disown" keyword argument to shutdown(), 
or a new disown() method, which would serve to explicitly disable the waiting. 
If this is considered desirable, I will create a pull request.

--
components: Library (Lib)
files: pool-shutdown
messages: 341329
nosy: hniksic
priority: normal
severity: normal
status: open
title: Interpreter exit blocks waiting for futures of shut-down 
ThreadPoolExecutors
versions: Python 3.7, Python 3.8, Python 3.9
Added file: https://bugs.python.org/file48297/pool-shutdown

___
Python tracker 

___
___
Python-bugs-list mailing list
Unsubscribe: 
https://mail.python.org/mailman/options/python-bugs-list/archive%40mail-archive.com

[issue36774] f-strings: Add a !d conversion for ease of debugging

[Eric V. Smith]

Eric V. Smith  added the comment:

The most recent version of the patch implements the conditional repr/format 
behavior. I'm pretty happy with it.

Other than docs, I think this is done. I'm going to discuss it with a few more 
people at PyCon, then commit it.

There's a slight optimization I'm considering (pre-append the '=' to the 
expression text at compile time, instead of at runtime), but I'll do that 
later, if ever.

--

___
Python tracker 

___
___
Python-bugs-list mailing list
Unsubscribe: 
https://mail.python.org/mailman/options/python-bugs-list/archive%40mail-archive.com

[issue27682] wsgiref BaseHandler / SimpleHandler can raise additional errors when handling an error

[wkoot]

Change by wkoot :


--
nosy: +wkoot

___
Python tracker 

___
___
Python-bugs-list mailing list
Unsubscribe: 
https://mail.python.org/mailman/options/python-bugs-list/archive%40mail-archive.com

[issue35070] test_posix fails on macOS 10.14 Mojave

[Dave Page]

Dave Page  added the comment:

The submitted patch from websurfer5 resolves the issue for me.

--

___
Python tracker 

___
___
Python-bugs-list mailing list
Unsubscribe: 
https://mail.python.org/mailman/options/python-bugs-list/archive%40mail-archive.com

[issue36779] time.tzname returns empty string on Windows if default codepage is a Unicode codepage

[SilentGhost]

Change by SilentGhost :


--
components: +Windows
nosy: +paul.moore, steve.dower, tim.golden, zach.ware
stage:  -> test needed
type:  -> behavior
versions: +Python 3.7, Python 3.8

___
Python tracker 

___
___
Python-bugs-list mailing list
Unsubscribe: 
https://mail.python.org/mailman/options/python-bugs-list/archive%40mail-archive.com

[issue17667] Windows: build with "build_pgo.bat -2" fails to optimize python.dll

[Martha Simons]

Change by Martha Simons :


Added file: https://bugs.python.org/file48296/27409.pdf

___
Python tracker 

___
___
Python-bugs-list mailing list
Unsubscribe: 
https://mail.python.org/mailman/options/python-bugs-list/archive%40mail-archive.com

[issue30485] Element.findall(path, dict) doesn't insert null namespace

[Stefan Behnel]

Change by Stefan Behnel :


--
resolution:  -> fixed
stage: patch review -> resolved
status: open -> closed

___
Python tracker 

___
___
Python-bugs-list mailing list
Unsubscribe: 
https://mail.python.org/mailman/options/python-bugs-list/archive%40mail-archive.com

[issue36778] test_site.StartupImportTests.test_startup_imports fails if default code page is not cp1252

[Inada Naoki]

Inada Naoki  added the comment:

@Victor It seems you added cp65001 as Windows-only encoding in bpo-13216.

How do you think about removing cp65001 encoding, and add 'cp65001' -> 'utf_8' 
alias which is available on all platforms?

--
nosy: +vstinner

___
Python tracker 

___
___
Python-bugs-list mailing list
Unsubscribe: 
https://mail.python.org/mailman/options/python-bugs-list/archive%40mail-archive.com

[issue27409] List socket.SO_*, SCM_*, MSG_*, IPPROTO_* symbols

[Martha Simons]

Martha Simons  added the comment:

That patch was never updated nor comitted, but it sounds like this kind of 
addition might be https://goo.gl/LhppLn  acceptable.

--
nosy: +Martha Simons

___
Python tracker 

___
___
Python-bugs-list mailing list
Unsubscribe: 
https://mail.python.org/mailman/options/python-bugs-list/archive%40mail-archive.com