[issue28708] Low FD_SETSIZE limit on Windows

2019-06-05 Thread Andrei Zene
Andrei Zene added the comment: We would also need this limit to be raised. We are using a server that was implemented using tornado, and tornado uses select.select. > It looks like Modules/selectmodule.c already has the handling for when this > gets large (and we really want t

[issue28708] Low FD_SETSIZE limit on Windows

2019-06-05 Thread Andrei Zene
Change by Andrei Zene : -- keywords: +patch pull_requests: +13719 stage: -> patch review pull_request: https://github.com/python/cpython/pull/13842 ___ Python tracker <https://bugs.python.org/issu

[issue28708] Low FD_SETSIZE limit on Windows

2019-06-05 Thread Andrei Zene
Andrei Zene added the comment: > Would it be possible to make FD_SETSIZE configurable at runtime, at least on > Windows? IMHO it would be a better approach. That would be awesome, but it doesn't look like it would be possible. As I have already pointed out in my previous comment:

[issue28708] Low FD_SETSIZE limit on Windows

2019-06-06 Thread Andrei Zene
Andrei Zene added the comment: Awesome work Victor! Thanks! I'll give it a try. One thing I see mising though (if I understand well) is the allocation of three fd_sets (I posted a comment on github regarding that). Those fd_sets are currently allocated on stack and the array they contain

[issue28708] Low FD_SETSIZE limit on Windows

2019-06-14 Thread Andrei Zene
Andrei Zene added the comment: That's actually a great explanation Nathaniel. Thanks for putting that all together. -- ___ Python tracker <https://bugs.python.org/issue28

[issue28708] Low FD_SETSIZE limit on Windows

2019-06-10 Thread Andrei Zene
Andrei Zene added the comment: I have updated PR 13842(https://github.com/python/cpython/pull/13842) to dynamically alocate the fd_sets on windows. I did some testing on windows with the following two paterns: 1. 1 transient clients: (open connection, send message, close connection) 2

[issue44871] Threading memory leak

2021-08-09 Thread Andrei Zene
New submission from Andrei Zene : In an application where we were handling incoming requests in new threads, we noticed that the memory usage grew over time. After trying to understand what's going on, i was able to reproduce this with a smaller python script that i've attached. What we do