Change by Barry A. Warsaw :
--
title: High Sierra hang when using multi-processing -> macOS crashes after fork
with no exec
___
Python tracker
<https://bugs.python.org/issu
Barry A. Warsaw added the comment:
issue35219 is where I've run into this problem. I'm still trying to figure out
all the details in my own case, but I can confirm that setting the environment
variable does not always help.
--
___
Python tracker
Change by Barry A. Warsaw :
--
versions: +Python 3.6, Python 3.7, Python 3.8
___
Python tracker
<https://bugs.python.org/issue33725>
___
___
Python-bugs-list m
Barry A. Warsaw added the comment:
I am going to dupe this to 33725 after all.
--
resolution: -> duplicate
superseder: -> High Sierra hang when using multi-processing
___
Python tracker
<https://bugs.python.org/i
Barry A. Warsaw added the comment:
Nope, actually double fork doesn't work. It's misleading because in my
testing, the first invocation of the process causes the core dump, but
subsequent runs do not.
--
___
Python tracker
<ht
Barry A. Warsaw added the comment:
I'm still testing this solution, but it looks like if you set the environment
variable, and then double fork, the granchild won't crash. Roughly:
os.putenv('OBJC_DISABLE_INITIALIZE_FORK_SAFETY', 'YES')
pid = os.fork()
if pid == 0:
subpid = os.fork
Barry A. Warsaw added the comment:
Based on my testing, the environment variable has to be set before the parent
process starts. Neither os.environ nor os.putenv seem to do the trick.
--
___
Python tracker
<https://bugs.python.org/issue35
Barry A. Warsaw added the comment:
I've done a fair bit of testing and it seems rather inconsistent as to whether
either of these work when added right before an explicit call to `os.fork()`:
os.environ['OBJC_DISABLE_INITIALIZE_FORK_SAFETY'] = 'YES'
ctyles.cdll.LoadLibrary('/System/Library
Barry A. Warsaw added the comment:
On Nov 10, 2018, at 04:50, Ivan Pozdeev wrote:
> In its .pth file, each such package will import the hook's module (which will
> cause the hook to be installed on the first import) and "register" its
> namespaces and/or dependencie
Barry A. Warsaw added the comment:
I'm not sure whether it's a duplicate or not, since in my case it doesn't hang,
but instead core dumps. It's seems like the reasoning given in the Ruby bug is
relevant to Python too, so maybe we should adopt the same workaround. For our
internal projects
Change by Barry A. Warsaw :
--
nosy: +barry
___
Python tracker
<https://bugs.python.org/issue33725>
___
___
Python-bugs-list mailing list
Unsubscribe:
Barry A. Warsaw added the comment:
On Nov 12, 2018, at 13:34, Pablo Galindo Salgado wrote:
> Apparently setting the env variable OBJC_DISABLE_INITIALIZE_FORK_SAFETY=YES
> should fix some fork-related changes. Have you tried already doing this? Does
> it change the behaviour of t
Barry A. Warsaw added the comment:
That should of course be 10.14 Mojave.
--
___
Python tracker
<https://bugs.python.org/issue35219>
___
___
Python-bugs-list m
Change by Barry A. Warsaw :
--
title: macOS 10.14 High Sierra crashes in multiprocessing -> macOS 10.14 Mojave
crashes in multiprocessing
___
Python tracker
<https://bugs.python.org/issu
New submission from Barry A. Warsaw :
As we're beginning to roll out macOS 10.14 High Sierra, we're seeing an
increase in core files inside /cores. This can consume a ton of disk space if
you have coredumps enabled. I don't have a short reproducer yet, but we
believe this is related
Change by Barry A. Warsaw :
--
nosy: +barry
___
Python tracker
<https://bugs.python.org/issue35181>
___
___
Python-bugs-list mailing list
Unsubscribe:
Barry A. Warsaw added the comment:
I've now updated my personal machine to Mojave and cannot reproduce the
failure. I'm going to chalk this one up to some weird corporate active
directory or whatnot weirdness. I'd still love to know why the code in Python
works differently
Barry A. Warsaw added the comment:
Wonderful
--
___
Python tracker
<https://bugs.python.org/issue35070>
___
___
Python-bugs-list mailing list
Unsubscribe:
Barry A. Warsaw added the comment:
Yep, stepping through Python with lldb, that's what's happening. I know one of
my coworkers has been able to reproduce it. I'll chime in next once I upgrade
my personal machine and can try it there, since I know it isn't on AD
Barry A. Warsaw added the comment:
I really have no idea what's going on. I've looked at posixmodule.c and tried
to reproduce as best I can in a standalone C program.
In both cases getgroups(0, NULL) returns 15. In the standalone version, when I
then call getgroups(15, grouplist), I again
Barry A. Warsaw added the comment:
gcc -Wno-unused-result -Wsign-compare -Wunreachable-code -DNDEBUG -g -fwrapv
-O3 -Wall -v -std=c99 -Wextra -Wno-unused-result -Wno-unused-parameter
-Wno-missing-field-initializers -Wstrict-prototypes
-Werror=implicit-function-declaration -I. -I
Barry A. Warsaw added the comment:
% gcc -v gg.c
Apple LLVM version 10.0.0 (clang-1000.11.45.2)
Target: x86_64-apple-darwin18.0.0
Thread model: posix
InstalledDir:
/Applications/Xcode.app/Contents/Developer/Toolchains/XcodeDefault.xctoolchain/usr/bin
"/Applications/Xcode.app/Con
Barry A. Warsaw added the comment:
Yes, I've rebooted :) I've modified your C program a little and here's the
code and output.
#include
#include
#include
int main()
{
gid_t grouplist[32];
int n;
int gidsetsize;
for (gidsetsize = 0; gidsetsize < 22; ++gidsets
Barry A. Warsaw added the comment:
We're wondering if it could be a weird interaction with Active Directory. This
is my work laptop, so it's all integrated with LDAP and whatnot. I don't have
Mojave on my personal laptop yet (maybe this weekend). I'm guessing that
whatever corporate
Barry A. Warsaw added the comment:
On Oct 25, 2018, at 13:17, Ned Deily wrote:
>
> OK. When you asy "every version of Python 3", are those all versions you've
> built yourself? If so, what ./configure arguments do you use?
Yes, built myself from source (both .tar.gz and
Barry A. Warsaw added the comment:
Seems to fail for me with every version of Python 3 on Mojave. In master, it’s
test_getgroups().
> Ned Deily added the comment:
>
> $ sw_vers
> ProductName: Mac OS X
> ProductVersion: 10.14
> BuildVersion: 18A391
Mine i
New submission from Barry A. Warsaw :
It looks like macOS 10.14 Mojave has changed the return value for getgroups().
On 10.13 it returns the set of GIDs give by `id -G` but afaict on 10.14 it
returns only the primary GID.
$ python3 -c "import os; print(os.getgroups())"
[101]
$
Change by Barry A. Warsaw :
--
title: test_posix -> test_posix fails on macOS 10.14 Mojave
___
Python tracker
<https://bugs.python.org/issue35070>
___
___
Py
Barry A. Warsaw added the comment:
This is a nice approach to the problem. I completely agree that we cannot
change `is` semantics. I'm okay with leaving it to checkers to catch `== None`.
--
___
Python tracker
<https://bugs.python.
Change by Barry A. Warsaw :
--
assignee: -> nnja
___
Python tracker
<https://bugs.python.org/issue25812>
___
___
Python-bugs-list mailing list
Unsubscrib
Change by Barry A. Warsaw :
--
nosy: +barry
___
Python tracker
<https://bugs.python.org/issue25812>
___
___
Python-bugs-list mailing list
Unsubscribe:
Change by Barry A. Warsaw :
--
versions: +Python 3.8 -Python 3.5, Python 3.6
___
Python tracker
<https://bugs.python.org/issue25812>
___
___
Python-bugs-list m
Barry A. Warsaw added the comment:
New changeset 5a5ce064b3baadcb79605c5a42ee3d0aee57cdfc by Barry Warsaw (Zackery
Spytz) in branch 'master':
bpo-5950: Support reading zips with comments in zipimport (#9548)
https://github.com/python/cpython/commit/5a5ce064b3baadcb79605c5a42ee3d0aee57cdfc
Change by Barry A. Warsaw :
--
components: +Library (Lib) -Interpreter Core
resolution: -> fixed
stage: patch review -> resolved
status: open -> closed
___
Python tracker
<https://bugs.python.o
Barry A. Warsaw added the comment:
Hi Serhiy. I'm curious whether this is a pure clean up or if there are actual
problems you're trying to fix.
* I'm okay with using _PyObject_GetBuiltin() but it does bother me in general
to use too many non-public (and thus undocumented) APIs. It makes
Change by Barry A. Warsaw :
--
nosy: -barry
___
Python tracker
<https://bugs.python.org/issue34694>
___
___
Python-bugs-list mailing list
Unsubscribe:
Change by Barry A. Warsaw :
--
nosy: +barry
___
Python tracker
<https://bugs.python.org/issue34726>
___
___
Python-bugs-list mailing list
Unsubscribe:
Change by Barry A. Warsaw :
--
keywords: +patch
pull_requests: +8750
stage: -> patch review
___
Python tracker
<https://bugs.python.org/issue34632>
___
___
Py
New submission from Barry A. Warsaw :
https://importlib_metadata.rtfd.org
We're fleshing out the API and implementation in the standalone library, but
once we're confident of the API and semantics, we will want to port this into
Python 3.8.
--
assignee: barry
components: Library
Barry A. Warsaw added the comment:
Not sure if I'll have time before the core sprints to check the implementation
with shiv, but I can give it a try then. Do you mind waiting until then?
--
___
Python tracker
<https://bugs.python.org/issue25
Barry A. Warsaw added the comment:
https://docs.python.org/3/reference/import.html#regular-packages
Regular packages have __init__.py files and namespace packages do not.
"Implicit non-namespace packages" aren't really A Thing.
This design choice is deliberate; namespac
Barry A. Warsaw added the comment:
Agreed it should be non-public, but can we please call it sys._is_interned()?
--
nosy: +barry
___
Python tracker
<https://bugs.python.org/issue34
Change by Barry A. Warsaw :
--
nosy: +barry
___
Python tracker
<https://bugs.python.org/issue34296>
___
___
Python-bugs-list mailing list
Unsubscribe:
Barry A. Warsaw added the comment:
AFAICT, that future only works in the REPL.
--
___
Python tracker
<https://bugs.python.org/issue34084>
___
___
Python-bug
Barry A. Warsaw added the comment:
On Jul 5, 2018, at 14:23, Ivan Pozdeev wrote:
>
> Ivan Pozdeev added the comment:
>
>> They are very difficult to debug because they're processed too early.
>
> .pth's are processed by site.py, so no more difficult than site/sitecus
Barry A. Warsaw added the comment:
It's a convenient API. I think originally I may have just don't effectively a
getattr on the imported module, but I don't remember (and don't have original
implementation handy - thanks, rebase!)
I don't have particularly strong feelings on the matter
Barry A. Warsaw added the comment:
I think we'll clearly need a PEP for this clean up. I'd like to see a separate
"preload" feature as well, especially one that is deterministic and happens
before site.py. Not sure if that should be one
Barry A. Warsaw added the comment:
On Jun 23, 2018, at 20:21, Nick Coghlan wrote:
>
> Only exposing a `forced_hash_seed` (and hiding randomly generated ones as
> `forced_hash_seed=None`) seems reasonable though, since those can already be
> read from os.environ anyway.
On
Barry A. Warsaw added the comment:
On Jun 23, 2018, at 18:56, Nick Coghlan wrote:
>
> My request (wearing my "BDFL-delegate for packaging interoperability
> standards" hat) is that proponents of the change resist the temptation to
> view the problem that way :)
&g
Change by Barry A. Warsaw :
--
keywords: +patch
pull_requests: +7475
stage: needs patch -> patch review
___
Python tracker
<https://bugs.python.org/issu
Barry A. Warsaw added the comment:
Although I guess that would require modifications to lcg_urandom(). I don't
feel qualified to change that function.
--
___
Python tracker
<https://bugs.python.org/issue33
Barry A. Warsaw added the comment:
There are lots of problems with pth files, although arbitrary code execution is
probably the most egregious. They are also notoriously difficult to debug, and
happen before any control is given to user code. They certainly are
unnecessary for namespace
Barry A. Warsaw added the comment:
We could make the hash_seed 64 bits.
--
___
Python tracker
<https://bugs.python.org/issue33919>
___
___
Python-bugs-list m
Barry A. Warsaw added the comment:
Nosying Nick. I agree there's some overlap with Python startup restructuring,
but it feels kind of orthogonal too. I really am only exposing (some elements)
of that structure to Python.
What might be interesting though would be if we want to expose
Barry A. Warsaw added the comment:
I think there's another thing I'd like to change, and it seems like it's "just"
an implementation detail. In _Py_HashRandomization_Init(), if use_hash_seed is
0, then we directly inject the random bits into the buffer, and then there's no
hash_
Barry A. Warsaw added the comment:
Thanks for the hint! I had a feeling there had to be an API to get at it, but
I couldn’t find it. Maybe we should start documenting the Python Secret
Underscore API? :)
On Jun 22, 2018, at 00:04, STINNER Victor wrote:
>
> _PyCoreConfig *core_
New submission from Barry A. Warsaw :
pth files are evil. They are very difficult to debug because they're processed
too early. They usually contain globs of inscrutable code. Exceptions in pth
files can get swallowed in some cases. They are loaded in indeterminate order.
They are also
Barry A. Warsaw added the comment:
I think the basic implementation problem is that by the time you get to
get_hash_info() in sysmodule.c, you no longer have access to the _PyCoreConfig
object, nor the _PyMain object that it's generally attached
Barry A. Warsaw added the comment:
On Jun 20, 2018, at 13:28, Christian Heimes wrote:
>
> Christian Heimes added the comment:
>
> hash_seed and use_hash_seed could be added to sys.hash_info. This would be
> the first place I'd look for the information. After al
New submission from Barry A. Warsaw :
The _PyCoreConfig structure in pystate.h has some interesting fields that I
don't think are exposed anywhere else to Python-land. I was particularly
interested recently in hash_seed and use_hash_seed. I'm thinking that it may
be useful to expose
Barry A. Warsaw added the comment:
"It's complicated" :) But technically speaking they are all separate projects,
so while there is synergy, CPython itself *imports* some of those to provide
various tasks, but it doesn't lead their development. You'll find a lot of the
same play
Change by Barry A. Warsaw :
--
nosy: +barry
___
Python tracker
<https://bugs.python.org/issue33901>
___
___
Python-bugs-list mailing list
Unsubscribe:
Barry A. Warsaw added the comment:
This really isn't enough information to know exactly what's going on in your
case, but there are things that are known to be slow for CLI startups.
Probably the biggest contributor is pkg_resources. Of course, that's a third
party library that's popular
Emanuel Barry added the comment:
Nice initiative! I like the idea of moving towards more inclusive
documentation; as an addition, I would recommend using they/them/their instead
- it's less clumsy to read (also, singular they is perfectly valid English) and
includes everyone, even those who
> happened. :)
As interesting as it is to see the way applications transform user input into
filenames its does not affect the API that python presents.
Barry
--
https://mail.python.org/mailman/listinfo/python-list
> On 11 Jun 2018, at 01:28, Steven D'Aprano
> wrote:
>
> On Sun, 10 Jun 2018 22:09:39 +0100, Barry Scott wrote:
>
>> Singling out os.path.exists as a special case I do think is reasonable.
>> All functions that take paths need to have a consistent response to da
eback (most recent call last):
File "", line 1, in
ValueError: embedded null character
>>>
Singling out os.path.exists as a special case I do think is reasonable.
All functions that take paths need to have a consistent response to data that
is impossible to pass to the OS.
When it is impossible to get the OS to see all of the users data I'm not sure
what else is reasonable for python
to do then what it already does not NUL.
With the exception that I do not think this is documented and the docs should
be fixed.
Barry
--
https://mail.python.org/mailman/listinfo/python-list
nt
to supoort and read its .spec file.
I see on fedora that the way they install packages that are from pypi makes it
possible to use pip list to see them.
Barry
--
https://mail.python.org/mailman/listinfo/python-list
Change by Barry A. Warsaw :
--
resolution: -> fixed
stage: patch review -> resolved
status: open -> closed
___
Python tracker
<https://bugs.python.or
Change by Barry A. Warsaw :
--
resolution: -> fixed
stage: patch review -> resolved
status: open -> closed
___
Python tracker
<https://bugs.python.or
Change by Barry A. Warsaw :
--
keywords: +patch
pull_requests: +7137
stage: needs patch -> patch review
___
Python tracker
<https://bugs.python.org/issu
Barry A. Warsaw added the comment:
I think the regression is caused by the fix for bpo-23835
https://bugs.python.org/issue23835
--
___
Python tracker
<https://bugs.python.org/issue33
Barry A. Warsaw added the comment:
I think this introduced a regression in 3.7. See bpo-33802
https://bugs.python.org/issue33802
--
keywords: +3.7regression -patch
nosy: +barry
priority: normal -> deferred blocker
resolution: fixed ->
stage: resolved ->
status: close
New submission from Barry A. Warsaw :
This looks like a serious regression in 3.7. @ned.deily - I'm marking this as
a release blocker, but feel free of course to downgrade it.
Run the following as
$ python3.6 badconfig.py
Hey, it works!
$ python3.7 badconfig.py
Traceback (most recent call
Change by Barry A. Warsaw :
--
resolution: -> fixed
stage: patch review -> resolved
status: open -> closed
___
Python tracker
<https://bugs.python.or
Barry A. Warsaw added the comment:
New changeset e135032ffa08ad66caea8205488e037da85d2bf8 by Barry Warsaw (Miss
Islington (bot)) in branch '3.7':
bpo-33755: Fix importlib.resources isolation tests (GH-7412) (#7434)
https://github.com/python/cpython/commit
Barry A. Warsaw added the comment:
New changeset ac1ee1badade69d5cd6d8b9112281f121183e7c0 by Barry Warsaw in
branch 'master':
bpo-33755: Fix importlib.resources isolation tests (#7412)
https://github.com/python/cpython/commit/ac1ee1badade69d5cd6d8b9112281f121183e7c0
Change by Barry A. Warsaw :
--
keywords: +patch
pull_requests: +7037
stage: -> patch review
___
Python tracker
<https://bugs.python.org/issue33755>
___
___
Py
Barry A. Warsaw added the comment:
It's too late for 3.7, but something like this could be an interesting
enhancement for 3.8. I'm not so sure about the name of the suggested parameter
since it seems more about recording successful deliveries in addition to the
normally failed deliveries
Barry A. Warsaw added the comment:
Looks like a sys.modules leak. I'm working on a branch.
--
___
Python tracker
<https://bugs.python.org/issue33755>
___
___
> On 1 Jun 2018, at 14:23, Paul Moore wrote:
>
> On 1 June 2018 at 13:15, Barry Scott wrote:
>> I think the reason for the \0 check is that if the string is passed to the
>> operating system with the \0 you can get surprising results.
>>
>> If \0 was not che
Barry A. Warsaw added the comment:
I can take a look at this tomorrow.
--
___
Python tracker
<https://bugs.python.org/issue33755>
___
___
Python-bugs-list mailin
Change by Barry A. Warsaw :
--
assignee: -> barry
___
Python tracker
<https://bugs.python.org/issue33755>
___
___
Python-bugs-list mailing list
Unsubscrib
s because a posix system only sees '/home'.
Surely ValueError is reasonable?
Once you know that all of the string you provided is given to the operating
system it can then do whatever checks it sees fit to and return a suitable
result.
As an aside Windows has lots of special filenames that you have to know about
if you are writting robust file handling. AUX, COM1, \this\is\also\COM1 etc.
Barry
>
>
> Marko
--
https://mail.python.org/mailman/listinfo/python-list
Barry A. Warsaw added the comment:
+1 - I'm actually surprise it's still there. ;) Given that the docs have a big
red warning to avoid these in Python 3, let's start the process of removal.
Don't forget to also deprecate ldgettext(), lngettext(), and ldngettext()
https://docs.python.org/3
Change by Barry A. Warsaw <ba...@python.org>:
--
nosy: +barry
___
Python tracker <rep...@bugs.python.org>
<https://bugs.python.org/issue33649>
___
__
Barry A. Warsaw <ba...@python.org> added the comment:
> Did you try to use regex which has this feature? For short strings and simple
> patterns there may be no benefit.
In my use case, it’s not possible, since the problematic API is glob.iglob()
through multiple lev
Barry A. Warsaw <ba...@python.org> added the comment:
I'm reopening this bug even though it's been long closed and even though the
attached patch is no longer relevant.
We recently found a degenerative performance problem with entrypoints and
threads. As the number of threads inc
Change by Barry A. Warsaw <ba...@python.org>:
--
nosy: +barry
___
Python tracker <rep...@bugs.python.org>
<https://bugs.python.org/issue33619>
___
__
Barry A. Warsaw <ba...@python.org> added the comment:
New changeset 6417d33633a3979d996015e52e4ff6c7a88e93e5 by Barry Warsaw (Miss
Islington (bot)) in branch '3.7':
bpo-33537: Add an __all__ to importlib.resources (GH-6920) (#6941)
https://github.com/python/cpython/
Barry A. Warsaw <ba...@python.org> added the comment:
Honestly, I don't think there's a strong argument for a CLI option. I'm
perfectly happy with just an environment variable.
--
___
Python tracker <rep...@bugs.python.org>
<https://
Barry A. Warsaw <ba...@python.org> added the comment:
New changeset 0ed66df5242138fc599b4735749e55f953d9a1e4 by Barry Warsaw in
branch 'master':
bpo-33537: Add an __all__ to importlib.resources (#6920)
https://github.com/python/cpython/commit/0ed66df5242138fc599b4735749e55f953
Barry A. Warsaw <ba...@python.org> added the comment:
On May 17, 2018, at 08:14, Nick Coghlan <rep...@bugs.python.org> wrote:
>
> If we did add an option, then a named -X option would probably make the most
> sense.
+1
--
__
Barry A. Warsaw <ba...@python.org> added the comment:
On May 15, 2018, at 22:58, Carl Meyer <rep...@bugs.python.org> wrote:
> Our use case includes a webserver process that embeds Python; I'm not sure if
> we could pass a CLI arg to it or not.
I think you pretty
Barry A. Warsaw <ba...@python.org> added the comment:
On May 16, 2018, at 16:48, Eric V. Smith <rep...@bugs.python.org> wrote:
> Do you really want to add a __init__ to each of the 500 classes?
Well, of course *I* do, but I’m weird like that.
> That is, the base class could
Barry A. Warsaw <ba...@python.org> added the comment:
On May 16, 2018, at 16:09, Eric V. Smith <rep...@bugs.python.org> wrote:
>
> I think the concern is:
>
> from dataclasses import *
>
> class B:
>def __init__(self, a, b, c):
># do somethin
Barry A. Warsaw <ba...@python.org> added the comment:
New changeset 0c62e09774e445a185fd192524454ce697ca123b by Barry Warsaw (Miss
Islington (bot)) in branch '3.7':
bpo-32216: Update dataclasses documentation (GH-6913) (#6918)
https://github.com/python/cpython/
Change by Barry A. Warsaw <ba...@python.org>:
--
pull_requests: +6589
___
Python tracker <rep...@bugs.python.org>
<https://bugs.python.org/issue33537>
___
_
Change by Barry A. Warsaw <ba...@python.org>:
--
assignee: -> barry
___
Python tracker <rep...@bugs.python.org>
<https://bugs.python.org/issue33537>
___
__
Barry A. Warsaw <ba...@python.org> added the comment:
Thanks, I will add an __all__
_zipimport_get_resource_reader gets called from C and it's the way we
trampoline from the inscrutable zipimport.c into something we can more
reasonably implement the ResourceReader API. There's a c
801 - 900 of 3390 matches
Mail list logo
