[issue40138] Windows implementation of os.waitpid() truncates the exit status (status << 8)

[STINNER Victor]

STINNER Victor  added the comment:

Ok, os.waitpid() is now fixed in 3.7, 3.8 and master branches, and 
os.waitstatus_to_exitcode() is fixed in master.

--
resolution:  -> fixed
stage: patch review -> resolved
status: open -> closed
versions: +Python 3.7, Python 3.8

___
Python tracker 

___
___
Python-bugs-list mailing list
Unsubscribe: 
https://mail.python.org/mailman/options/python-bugs-list/archive%40mail-archive.com

[issue40138] Windows implementation of os.waitpid() truncates the exit status (status << 8)

[miss-islington]

miss-islington  added the comment:


New changeset de5dcfa3bcabf52e43468a2b088ed71b5e5c4503 by Miss Islington (bot) 
in branch '3.7':
bpo-40138: Fix Windows os.waitpid() for large exit code (GH-19654)
https://github.com/python/cpython/commit/de5dcfa3bcabf52e43468a2b088ed71b5e5c4503


--

___
Python tracker 

___
___
Python-bugs-list mailing list
Unsubscribe: 
https://mail.python.org/mailman/options/python-bugs-list/archive%40mail-archive.com

[issue40138] Windows implementation of os.waitpid() truncates the exit status (status << 8)

[STINNER Victor]

STINNER Victor  added the comment:


New changeset b07350901cac9197aef41855d8a4d56533636b91 by Victor Stinner in 
branch '3.8':
bpo-40138: Fix Windows os.waitpid() for large exit code (GH-19654)
https://github.com/python/cpython/commit/b07350901cac9197aef41855d8a4d56533636b91


--

___
Python tracker 

___
___
Python-bugs-list mailing list
Unsubscribe: 
https://mail.python.org/mailman/options/python-bugs-list/archive%40mail-archive.com

[issue40138] Windows implementation of os.waitpid() truncates the exit status (status << 8)

[miss-islington]

Change by miss-islington :


--
nosy: +miss-islington
nosy_count: 2.0 -> 3.0
pull_requests: +18981
pull_request: https://github.com/python/cpython/pull/19655

___
Python tracker 

___
___
Python-bugs-list mailing list
Unsubscribe: 
https://mail.python.org/mailman/options/python-bugs-list/archive%40mail-archive.com

[issue40138] Windows implementation of os.waitpid() truncates the exit status (status << 8)

[STINNER Victor]

Change by STINNER Victor :


--
pull_requests: +18980
pull_request: https://github.com/python/cpython/pull/19654

___
Python tracker 

___
___
Python-bugs-list mailing list
Unsubscribe: 
https://mail.python.org/mailman/options/python-bugs-list/archive%40mail-archive.com

[issue40138] Windows implementation of os.waitpid() truncates the exit status (status << 8)

[STINNER Victor]

STINNER Victor  added the comment:


New changeset 9bee32b34e4fb3e67a88bf14d38153851d4c4598 by Victor Stinner in 
branch 'master':
bpo-40138: Fix Windows os.waitpid() for large exit code (GH-19637)
https://github.com/python/cpython/commit/9bee32b34e4fb3e67a88bf14d38153851d4c4598


--

___
Python tracker 

___
___
Python-bugs-list mailing list
Unsubscribe: 
https://mail.python.org/mailman/options/python-bugs-list/archive%40mail-archive.com

[issue40138] Windows implementation of os.waitpid() truncates the exit status (status << 8)

[STINNER Victor]

Change by STINNER Victor :


--
keywords: +patch
pull_requests: +18962
stage:  -> patch review
pull_request: https://github.com/python/cpython/pull/19637

___
Python tracker 

___
___
Python-bugs-list mailing list
Unsubscribe: 
https://mail.python.org/mailman/options/python-bugs-list/archive%40mail-archive.com

[issue40138] Windows implementation of os.waitpid() truncates the exit status (status << 8)

[Karthikeyan Singaravelan]

Change by Karthikeyan Singaravelan :


--
nosy: +eryksun

___
Python tracker 

___
___
Python-bugs-list mailing list
Unsubscribe: 
https://mail.python.org/mailman/options/python-bugs-list/archive%40mail-archive.com

[issue40138] Windows implementation of os.waitpid() truncates the exit status (status << 8)

[STINNER Victor]

New submission from STINNER Victor :

On Windows, the exit code is a 32-bit value. It may or may not signed depending 
on the function.

Unsigned in the Windows native API:

BOOL TerminateProcess(HANDLE hProcess, UINT uExitCode);
BOOL GetExitCodeProcess(HANDLE hProcess, LPDWORD lpExitCode);

Signed in the POSIX API:

intptr_t _cwait(int *termstat, intptr_t procHandle, int action);

Problem: os.waitpid() uses "status << 8" which can overflow; status is an int.

static PyObject *
os_waitpid_impl(PyObject *module, intptr_t pid, int options)
{
int status;
(...)
/* shift the status left a byte so this is more like the POSIX waitpid */
return Py_BuildValue(_Py_PARSE_INTPTR "i", res, status << 8);
}

int64_t or uint64_t should be used, or a Python object should be used, to avoid 
the overflow.

I just added os.waitstatus_to_exitcode() in bpo-40094 which simply does "status 
>> 8" on Windows. Currently, this function casts the argument to a C int and so 
is limited to INT_MAX. It should also be adapted to handle values larger than 
INT_MAX.

By the way, I'm not sure how to handle values larger than INT_MAX. The POSIX 
API of Windows uses a signed integer, and so convert such value as a negative 
value. But the native Windows API uses unsigned numbers.

It seems like using unsigned number would be better.

--

By the way, currently os.waitstatus_to_exitcode() ignores the lower 8 bits of 
the status. Maybe it should raise an error if lower 8 bits are not zero, and 
maybe also raise an exception if the number is negative?


--

See also interesting comments by Eryk Sun in bpo-40094 about this problem.

--
components: Library (Lib)
messages: 365498
nosy: vstinner
priority: normal
severity: normal
status: open
title: Windows implementation of os.waitpid() truncates the exit status (status 
<< 8)
versions: Python 3.9

___
Python tracker 

___
___
Python-bugs-list mailing list
Unsubscribe: 
https://mail.python.org/mailman/options/python-bugs-list/archive%40mail-archive.com