[issue26732] multiprocessing sentinel resource leak

Kevin Quick added the comment: Hi Antoine, > ... an implementation detail rather than a documented feature I understand your desire, but this is a leaky abstraction and I would still suggest that it should be more clear that the fork method will inherit *all* resources from the parent,

[issue26732] multiprocessing sentinel resource leak

Steve Holden added the comment: IIRC sockets can be marked as inheritable or not. It seems to me it would be a useful enhancement to allow the same determination for the pipes. -- nosy: +holdenweb ___ Python tracker

[issue26732] multiprocessing sentinel resource leak

Antoine Pitrou added the comment: Kevin: > Regarding your comment regarding the behavior being expected with the "fork" > method, I would suggest a documentation modification in the description of > the fork method to add something to the effect of "All resources of the > parent are

[issue26732] multiprocessing sentinel resource leak

Antoine Pitrou added the comment: Victor, you can try to backport the fix, it should be interesting, though I suspect you will run into conflicts :-) -- ___ Python tracker

[issue26732] multiprocessing sentinel resource leak

STINNER Victor added the comment: Antoine: Do you want to backport your change 896145d9d266ee2758cfcd7691238cbc1f9e1ab8 to Python 3.6? If yes, don't forget to include my fix 302bbbe9ba5c72559913e2ea006c921f698a729d for Windows (bpo-31009). If you prefer, I can handle the backport. --

[issue26732] multiprocessing sentinel resource leak

Kevin Quick added the comment: Thank you for the fix, pitrou! Regarding your comment regarding the behavior being expected with the "fork" method, I would suggest a documentation modification in the description of the fork method to add something to the effect of "All resources of the parent

[issue26732] multiprocessing sentinel resource leak

STINNER Victor added the comment: By the way, 3.6 is marked as affected, but the change wasn't backported to 3.6? -- ___ Python tracker ___

[issue26732] multiprocessing sentinel resource leak

STINNER Victor added the comment: The newly added test now hangs on almost all Windows buildbots, see: http://bugs.python.org/issue31009#msg299050 -- resolution: fixed -> status: closed -> open ___ Python tracker

[issue26732] multiprocessing sentinel resource leak

Antoine Pitrou added the comment: New changeset 896145d9d266ee2758cfcd7691238cbc1f9e1ab8 by Antoine Pitrou in branch 'master': bpo-26732: fix too many fds in processes started with the "forkserver" method (#2813)

[issue26732] multiprocessing sentinel resource leak

Changes by Antoine Pitrou : -- resolution: -> fixed stage: patch review -> resolved status: open -> closed ___ Python tracker ___

[issue26732] multiprocessing sentinel resource leak

Changes by Antoine Pitrou : -- stage: needs patch -> patch review ___ Python tracker ___ ___

[issue26732] multiprocessing sentinel resource leak

Changes by Antoine Pitrou : -- pull_requests: +2865 ___ Python tracker ___ ___

[issue26732] multiprocessing sentinel resource leak

Antoine Pitrou added the comment: This is expected with the "fork" method, but also happens with the "forkserver" method. -- nosy: +pitrou stage: -> needs patch versions: +Python 3.6, Python 3.7 -Python 3.5 ___ Python tracker

[issue26732] multiprocessing sentinel resource leak

Changes by Camilla Montonen : -- nosy: +Winterflower ___ Python tracker ___ ___

[issue26732] multiprocessing sentinel resource leak

STINNER Victor added the comment: I confirm the issue with Python 3.6 on Linux. File descriptors of the parent process: haypo@selma$ ls -l /proc/31564/fd/ lrwx--. 1 haypo haypo 64 13 avril 00:55 0 -> /dev/pts/0 lrwx--. 1 haypo haypo 64 13 avril 00:55 1 -> /dev/pts/0 lr-x--. 1 haypo

[issue26732] multiprocessing sentinel resource leak

Changes by SilentGhost : -- nosy: +jnoller, sbt ___ Python tracker ___ ___

[issue26732] multiprocessing sentinel resource leak

Changes by Davin Potts : -- nosy: +davin ___ Python tracker ___ ___

[issue26732] multiprocessing sentinel resource leak

Kevin Quick added the comment: (Sorry, an unnamed pipe, but a pipe nonetheless.) -- ___ Python tracker ___

[issue26732] multiprocessing sentinel resource leak

New submission from Kevin Quick: The sentinel creates a named pipe, but the parent's end of the pipe is inherited by subsequently created children. import multiprocessing,signal,sys def sproc(x): signal.pause() for each in range(int(sys.argv[1])): multiprocessing.Process(target=sproc,