[issue37193] Memory leak while running TCP/UDPServer with socketserver.ThreadingMixIn

STINNER Victor added the comment: I marked bpo-37389 as a duplicate of this issue: """ msg346410 - (view) Author: Daniel W Forsyth (d...@dataforge.on.ca) Date: 2019-06-24 14:53 After putting a basic ThreadingUDPServer under load (500 messages per/second) I noticed that after a

[issue37389] Memory Leak - ThreadingUDPServer

Daniel W Forsyth added the comment: The only way I could figure out to control it was to do this in a thread; for thread in server._threads: # type: Thread if not thread.is_alive(): server._threads.remove(thread) Shouldn't the server process do this when t

[issue37389] Memory Leak - ThreadingUDPServer

STINNER Victor added the comment: This issue is a duplicate of bpo-37193. -- nosy: +vstinner resolution: -> duplicate stage: -> resolved status: open -> closed superseder: -> Memory leak while running TCP/UDPServer with socketserver.ThreadingMixIn _

[issue37389] Memory Leak - ThreadingUDPServer

New submission from Daniel W Forsyth : After putting a basic ThreadingUDPServer under load (500 messages per/second) I noticed that after a night it was consuming a lot of RAM given it does nothing with the data. On inception, I noticed the _thread count inside the server was growing forever

[issue36974] Implement PEP 590

Change by miss-islington : -- pull_requests: +14163 pull_request: https://github.com/python/cpython/pull/14342 ___ Python tracker ___ __

[issue37388] unknown error handlers should be reported early

Change by STINNER Victor : -- keywords: +patch pull_requests: +14162 stage: -> patch review pull_request: https://github.com/python/cpython/pull/14341 ___ Python tracker ___ _

[issue37388] unknown error handlers should be reported early

Change by STINNER Victor : -- nosy: +inada.naoki, serhiy.storchaka ___ Python tracker ___ ___ Python-bugs-list mailing list Unsubscr

[issue37388] unknown error handlers should be reported early

STINNER Victor added the comment: Getting an error handler is expensive compared to the time to encode text/decode bytes. Python loads the error handler lazily to provide best performances. Text codecs are performance critical for Python. If we add a check, it should only be enabled in devel

[issue37124] test_msilib is potentially leaking references and memory blocks

STINNER Victor added the comment: I backported Pablo's fix to 2.7 and 3.7 to attempt to fix Windows Refleak 2.7 and Windows Refleak 3.7 buildbots. -- resolution: -> fixed stage: patch review -> resolved status: open -> closed ___ Python tracker <

[issue37388] unknown error handlers should be reported early

New submission from Miro Hrončok : I was just bit by specifying an nonexisitng error handler for bytes.decode() without noticing. Consider this code: >>> 'a'.encode('cp1250').decode('utf-8', errors='Boom, Shaka Laka, Boom!') 'a' Nobody notices that the error handler doesn't exist. However:

[issue37124] test_msilib is potentially leaking references and memory blocks

STINNER Victor added the comment: New changeset 6cbff564f00fbe17b5443f6986a44ce116d32aee by Victor Stinner in branch '2.7': bpo-37124: Fix reference leak in test_msilib (GH-13750) (GH-14340) https://github.com/python/cpython/commit/6cbff564f00fbe17b5443f6986a44ce116d32aee -- __

[issue37221] PyCode_New API change breaks backwards compatibility policy

STINNER Victor added the comment: > That means we're back to either breaking Cython compatibility with CPython > master until the release is cut Yeah, that was my plan: merge PR 13959 "just before" beta2, and try to get a Cython release ASAP. The best case would be to get a Cython release w

[issue36732] test_asyncio: test_huge_content_recvinto() fails randomly

STINNER Victor added the comment: The failing test was added by: commit 74387926072abf338a4c1cec1bf0501fc65bbee5 Author: Andrew Svetlov Date: Mon Nov 12 19:00:22 2018 +0200 bpo-30064: Refactor sock_* asyncio API (#10419) -- ___ Python track

[issue36732] test_asyncio: test_huge_content_recvinto() fails randomly

STINNER Victor added the comment: We get a ConnectionResetError exception thanks to IocpProactor.recv() callback: def finish_recv(trans, key, ov): try: return ov.getresult() except OSError as exc: if exc.winerror in (_overlapped.E

[issue37387] test_compileall fails randomly on Windows when tests are run in parallel

New submission from STINNER Victor : I'm not sure that it's a good practice to rewrite .pyc files of the stdlib while tests are run in parallel. Maybe the test should copy all .py files of the stdlib into a temporary directory and work there, to not impact other tests run in parallel. Exampl

[issue31098] test target of Makefile always run tests in parallel mode

STINNER Victor added the comment: I close the issue as "not a bug". Reopen if you disagree. IMHO it's a bad practice to run tests sequentially: a test can change th behavior of the following test. Spawning a new process per test file is safer. Even if we are working hard to fix all side effe

[issue31098] test target of Makefile always run tests in parallel mode

STINNER Victor added the comment: To run tests sequentially, you can run regrtest using: ./python -m test I don't use "make test". -- ___ Python tracker ___

[issue7946] Convoy effect with I/O bound threads and New GIL

Omer Katz added the comment: Celery 5 is going async and in order to isolate the main event loop from task execution, the tasks are going to be executed in a different thread with it's own event loop. This thread may or may not be CPU bound. The main thread is I/O bound. This patch should h

[issue31088] regrtest.py: "${test_file_name} skipped" message printed twice for each ${test_file_name}

STINNER Victor added the comment: To be clear: the output is expected, it was a deliberate choice. I close the issue. -- resolution: -> not a bug stage: -> resolved status: open -> closed ___ Python tracker _

[issue32246] test_regrtest alters the execution environment on Android

STINNER Victor added the comment: This issue should be fixed by bpo-32252: commit 48d4dd974f0c8d47c54990eedd322b96b19c60ec Author: Victor Stinner Date: Mon Dec 11 13:57:12 2017 +0100 bpo-32252: Fix faulthandler_suppress_crash_report() (#4794) Fix faulthandler_suppress_crash_re

[issue15629] Add to regrtest the ability to run Lib and Doc doctests

STINNER Victor added the comment: The issue has been fixed by bpo-35240. commit a22df4896f6b83c8741203118790ae281716bca5 Author: Victor Stinner Date: Wed Nov 28 10:24:08 2018 +0100 bpo-35240: Add "doctest" job to Travis CI (GH-10753) Create a new "doctest" job in Travis CI to

[issue34556] Add --upgrade to venv module

Cooper Lees added the comment: That’s very disappointing. I had the very small PR ready to merge ~3 weeks before beta1. I now have to wait ~1.5years to be able to use this anywhere that I won’t be back porting it. I am happy to be on the hook and forward fix anything it causes, but as a new

[issue37181] fix test_regrtest failures on Windows arm64

STINNER Victor added the comment: I see two merged changes, so I close the issue. I don't think that ARM64 is supported on Python 3.7 and older. -- nosy: +vstinner resolution: -> fixed stage: patch review -> resolved status: open -> closed ___ Pyt

[issue37359] test_regrtest: test_list_cases() fails on x86 Gentoo Installed with X 3.x

STINNER Victor added the comment: I am not 100% sure that my change will fix the following warning on x86 Gentoo Installed with X 3.x, but I'm quite confident :-) RuntimeWarning: tests may fail, unable to create temporary directory '/buildbot/tmp/tmpdir/test_python_28144': [Errno 17] File ex

[issue37359] test_regrtest: test_list_cases() fails on x86 Gentoo Installed with X 3.x

STINNER Victor added the comment: cleantest was also run on Windows buildbots. Example a Windows 2.7 buildbot: https://buildbot.python.org/all/#/builders/70/builds/415 D:\buildarea\2.7.ware-win81-release.nondebug\build>"D:\buildarea\2.7.ware-win81-release.nondebug\build\PCbuild\amd64\python"

[issue37334] Add a cancel method to asyncio Queues

Martin Teichmann added the comment: Given the reactions I gather "close" is a better name for the method, so I changed it accordingly. In the current implementation, items that had been put on the queue but not processed yet still get processed after the close, and I think this is the desir

[issue37359] test_regrtest: test_list_cases() fails on x86 Gentoo Installed with X 3.x

STINNER Victor added the comment: cleantest was run successfully on the 4 Fedora workers: 3.x: https://buildbot.python.org/all/#/builders/185/builds/641 3.8: https://buildbot.python.org/all/#/builders/218/builds/98 3.7: https://buildbot.python.org/all/#/builders/181/builds/168 2.7: https://bui

[issue37221] PyCode_New API change breaks backwards compatibility policy

Nick Coghlan added the comment: In reviewing https://github.com/cython/cython/pull/3009, Jeroen pointed out that my symbol checking idea wouldn't actually work, since the preprocessor can only see preprocessor definitions, not compiler symbols. If we're going to rely on a preprocessor defini

[issue37250] C files generated by Cython set tp_print to 0: PyTypeObject.tp_print removed

Nick Coghlan added the comment: There's also the question of complying with our own deprecation policy, as the approval to ditch tp_print API compatibility in PEP 590 relied on the fact that it has been deprecated since Python 3.0. However, it turns out the associated programmatic deprecatio

[issue36732] test_asyncio: test_huge_content_recvinto() fails randomly

Andrew Svetlov added the comment: There is an interesting discussion: https://stackoverflow.com/questions/14499593/can-the-infamous-error-netname-deleted-error-be-considered-an-error-at-all "[WinError 64] The specified network name is no longer available" is raised on pending reads from clos

[issue37384] Compiling Python 3.7.3 from source and getting all sorts of errors on Debian?

Eryk added the comment: I am unsure, the uuid issue is already solved I was just saying that before I changed the uuid module I didn't get the 'failed to build curses' error, I am unsure of the difference I guess both, basically I am trying to make it as complete of an installation as possib

[issue37371] Optimize and refactor readline().

Shlomi Fish added the comment: @Serhiy: I used https://github.com/shlomif/freecell-pro-0fc-deals/blob/master/collect-stats.py . -- ___ Python tracker ___

[issue37124] test_msilib is potentially leaking references and memory blocks

miss-islington added the comment: New changeset c9015a7228029bb22fa581b31c4c1ebdc2882814 by Miss Islington (bot) in branch '3.7': bpo-37124: Fix reference leak in test_msilib (GH-13750) https://github.com/python/cpython/commit/c9015a7228029bb22fa581b31c4c1ebdc2882814 -- nosy: +miss-

[issue33694] test_asyncio: test_start_tls_server_1() fails on Python on x86 Windows7 3.7 and 3.x

Change by STINNER Victor : -- pull_requests: +14161 pull_request: https://github.com/python/cpython/pull/14336 ___ Python tracker ___ __

[issue37386] [EASY] test_io: test_large_file_ops() failed on AMD64 Windows7 SP1 3.x with: [Errno 28] No space left on device

Change by STINNER Victor : -- components: +Tests versions: +Python 2.7, Python 3.7, Python 3.8, Python 3.9 ___ Python tracker ___ __

[issue37386] [EASY] test_io: test_large_file_ops() failed on AMD64 Windows7 SP1 3.x with: [Errno 28] No space left on device

New submission from STINNER Victor : The fix seems to be simple: skip the test if write() fails with errno.ENOSPC: "OSError: [Errno 28] No space left on device". AMD64 Windows7 SP1 3.x: https://buildbot.python.org/all/#/builders/40/builds/2628

[issue37359] test_regrtest: test_list_cases() fails on x86 Gentoo Installed with X 3.x

miss-islington added the comment: New changeset 5779898a1f2e959d4064c34ab3c655f785795322 by Miss Islington (bot) in branch '3.7': bpo-37359: Fix regrtest --cleanup (GH-14336) https://github.com/python/cpython/commit/5779898a1f2e959d4064c34ab3c655f785795322 -- __

[issue37359] test_regrtest: test_list_cases() fails on x86 Gentoo Installed with X 3.x

miss-islington added the comment: New changeset 366dac99c0c0c416a37874140696f59178db4e43 by Miss Islington (bot) in branch '3.8': bpo-37359: Fix regrtest --cleanup (GH-14336) https://github.com/python/cpython/commit/366dac99c0c0c416a37874140696f59178db4e43 -- nosy: +miss-islington

[issue36456] task.cancel unbound recursion

Change by Guido Imperiale : -- nosy: +crusaderky ___ Python tracker ___ ___ Python-bugs-list mailing list Unsubscribe: https://mail

[issue37124] test_msilib is potentially leaking references and memory blocks

Change by STINNER Victor : -- pull_requests: +14160 pull_request: https://github.com/python/cpython/pull/14340 ___ Python tracker ___ __

[issue37124] test_msilib is potentially leaking references and memory blocks

Change by miss-islington : -- pull_requests: +14159 stage: -> patch review pull_request: https://github.com/python/cpython/pull/14339 ___ Python tracker ___ __

[issue37385] test_multiprocessing fails on AMD64 FreeBSD CURRENT Shared 2.7

STINNER Victor added the comment: See also bpo-28724: Add method send_io, recv_io to the socket module. -- nosy: +nanjekyejoannah, pablogsal ___ Python tracker ___ ___

[issue37385] test_multiprocessing fails on AMD64 FreeBSD CURRENT Shared 2.7

New submission from STINNER Victor : AMD64 FreeBSD CURRENT Shared 2.7: https://buildbot.python.org/all/#/builders/169/builds/146 0:02:22 load avg: 3.64 [119/404/1] test_multiprocessing failed Process Process-16: Traceback (most recent call last): File "/usr/home/buildbot/python/2.7.koobs-fre

[issue28724] Add method send_io, recv_io to the socket module.

STINNER Victor added the comment: See also bpo-37385: "test_multiprocessing fails on AMD64 FreeBSD CURRENT Shared 2.7". -- nosy: +vstinner ___ Python tracker ___

[issue37359] test_regrtest: test_list_cases() fails on x86 Gentoo Installed with X 3.x

STINNER Victor added the comment: I deployed the new buildbot configuration. New builds should run "make cleanup" (Unix) or "python -m test --cleanup" (Windows) on Python 2.7, 3.7, 3.8 and master, but not on custom branches. -- ___ Python tracker

[issue37359] test_regrtest: test_list_cases() fails on x86 Gentoo Installed with X 3.x

Change by miss-islington : -- pull_requests: +14158 pull_request: https://github.com/python/cpython/pull/14338 ___ Python tracker ___ __

[issue37359] test_regrtest: test_list_cases() fails on x86 Gentoo Installed with X 3.x

STINNER Victor added the comment: New changeset 9d55bf440cd0b8b06509318d7676c0744147c5b2 by Victor Stinner in branch '2.7': bpo-37359: Add --cleanup option to python3 -m test (GH-14332) (GH-14333) https://github.com/python/cpython/commit/9d55bf440cd0b8b06509318d7676c0744147c5b2 --

[issue37359] test_regrtest: test_list_cases() fails on x86 Gentoo Installed with X 3.x

STINNER Victor added the comment: New changeset 9bbf4d7083a819cbcee2a6cd3df2802d4c50f734 by Victor Stinner in branch 'master': bpo-37359: Fix regrtest --cleanup (GH-14336) https://github.com/python/cpython/commit/9bbf4d7083a819cbcee2a6cd3df2802d4c50f734 -- _

[issue37359] test_regrtest: test_list_cases() fails on x86 Gentoo Installed with X 3.x

Change by miss-islington : -- pull_requests: +14157 pull_request: https://github.com/python/cpython/pull/14337 ___ Python tracker ___ __

[issue37347] Reference-counting problem in sqlite

Aleksandr Balezin added the comment: At my point of view, dererencing from sqlite destructor has next flaws: - relying on external library which can has bugs - using different routine for reference-counting(complicates code) - loosing support for old sqlite version Of cause, if it's necessary

[issue37250] C files generated by Cython set tp_print to 0: PyTypeObject.tp_print removed

Petr Viktorin added the comment: 1. If sdist consumers will need to regenerate an sdist? They would need to compile from the source, e.g. clone from Git and make an sdist (or install) from that. 2. How many sdist consumers will likely be impacted? I don't know. Depends on how fast people mi

[issue37359] test_regrtest: test_list_cases() fails on x86 Gentoo Installed with X 3.x

Change by STINNER Victor : -- pull_requests: +14156 pull_request: https://github.com/python/cpython/pull/14336 ___ Python tracker ___ __

[issue37384] Compiling Python 3.7.3 from source and getting all sorts of errors on Debian?

Christian Heimes added the comment: Could you please file separate issues for each problem? The curses and uuid issues are probably unrelated. The curses issue seems to be caused by a problem with C code coverage profiling. Are you trying to build Python with PGO or profiling? -- no

[issue37359] test_regrtest: test_list_cases() fails on x86 Gentoo Installed with X 3.x

STINNER Victor added the comment: New changeset 2ec4545ebe49c62fdc60b0cf627e3aabe1bca037 by Victor Stinner in branch '3.8': bpo-37359: Add --cleanup option to python3 -m test (GH-14332) (GH-14334) https://github.com/python/cpython/commit/2ec4545ebe49c62fdc60b0cf627e3aabe1bca037 --

[issue37359] test_regrtest: test_list_cases() fails on x86 Gentoo Installed with X 3.x

STINNER Victor added the comment: New changeset 20ad3310d4f3dec1318a85e66963581501eeb634 by Victor Stinner in branch '3.7': bpo-37359: Add --cleanup option to python3 -m test (GH-14332) (GH-14335) https://github.com/python/cpython/commit/20ad3310d4f3dec1318a85e66963581501eeb634 --

[issue37373] Configuration of windows event loop for libraries

STINNER Victor added the comment: Ben: > Concretely, this is a concern for Tornado (which requires add_reader()) and > applications in the scientific python community (including Jupyter) which > depend on it. If you need add_reader/add_writer in Python 3.8, you can switch the default event

[issue37384] Compiling Python 3.7.3 from source and getting all sorts of errors on Debian?

New submission from Eryk : So I am trying to compile python 3.7.3 on debian 9.9, got all the libraries installed and previously I was getting an uuid module error which was then fixed by finding this 'tweak': --- Modules/_uuidmodule.c.orig +++ Modules/_uuidmodule.c @@ -3,8 +3,7 @@ #include "P

[issue37363] Additional PEP578 hooks

Christian Heimes added the comment: I'll add hooks to ssl module for wrap_socket and wrap_bio. -- ___ Python tracker ___ ___ Python

[issue36974] Implement PEP 590

Petr Viktorin added the comment: New changeset a8b27e623d75377aabe50df27e97cab4e81a174a by Petr Viktorin (Jeroen Demeyer) in branch 'master': bpo-36974: inherit tp_vectorcall_offset unconditionally (GH-13858) https://github.com/python/cpython/commit/a8b27e623d75377aabe50df27e97cab4e81a174a

[issue37226] Asyncio Fatal Error on SSL Transport - IndexError Deque Index Out Of Range

Ben Brown added the comment: Hi is there any update on this issue, were you able to replicate the error with the minimal example I provided or is there any additional information I can provide. -- ___ Python tracker

[issue37383] call count in not registered in AsyncMock till the coroutine is awaited

New submission from Karthikeyan Singaravelan : I noticed this while working on https://github.com/aio-libs/aiosmtpd/issues/167 where an async function was mocked that now returns an AsyncMock instead of MagicMock. The tests seem to look for call_args, mock_calls etc in the synchronous API wit

[issue37359] test_regrtest: test_list_cases() fails on x86 Gentoo Installed with X 3.x

STINNER Victor added the comment: I created https://github.com/python/buildmaster-config/pull/98 to cleanup tests in buildbots. -- ___ Python tracker ___

[issue37359] test_regrtest: test_list_cases() fails on x86 Gentoo Installed with X 3.x

Change by STINNER Victor : -- pull_requests: +14155 pull_request: https://github.com/python/cpython/pull/14335 ___ Python tracker ___ __

[issue37359] test_regrtest: test_list_cases() fails on x86 Gentoo Installed with X 3.x

Change by STINNER Victor : -- pull_requests: +14154 pull_request: https://github.com/python/cpython/pull/14334 ___ Python tracker ___ __

[issue37359] test_regrtest: test_list_cases() fails on x86 Gentoo Installed with X 3.x

Change by STINNER Victor : -- pull_requests: +14153 pull_request: https://github.com/python/cpython/pull/14333 ___ Python tracker ___ __

[issue37359] test_regrtest: test_list_cases() fails on x86 Gentoo Installed with X 3.x

STINNER Victor added the comment: New changeset 47fbc4e45b35b3111e2d947a66490a43ac21d363 by Victor Stinner in branch 'master': bpo-37359: Add --cleanup option to python3 -m test (GH-14332) https://github.com/python/cpython/commit/47fbc4e45b35b3111e2d947a66490a43ac21d363 --

[issue37345] Add formal support for UDPLITE protocol

Change by Andrew Svetlov : -- resolution: -> fixed stage: patch review -> resolved status: open -> closed ___ Python tracker ___ __

[issue37345] Add formal support for UDPLITE protocol

miss-islington added the comment: New changeset 2ac3bab2a6e1f9e17fc0c58a26e8425bb93cb0f5 by Miss Islington (bot) (Gabe Appleton) in branch 'master': bpo-37345: Add formal UDPLITE support (GH-14258) https://github.com/python/cpython/commit/2ac3bab2a6e1f9e17fc0c58a26e8425bb93cb0f5 --

[issue37373] Configuration of windows event loop for libraries

Andrew Svetlov added the comment: I don't like to have not required parts like thread pool, time handlers, and the exception handler executed in the auxiliary thread. What's about an alternative proposal: embed into ProactorEventLoop not entire SelectorEventLoop but selectors.SelectSelector

[issue37359] test_regrtest: test_list_cases() fails on x86 Gentoo Installed with X 3.x

Change by STINNER Victor : -- keywords: +patch pull_requests: +14152 stage: -> patch review pull_request: https://github.com/python/cpython/pull/14332 ___ Python tracker ___ _

[issue37382] Improve conditional check for test_gdb

Change by Jeroen Demeyer : -- keywords: +patch pull_requests: +14151 stage: -> patch review pull_request: https://github.com/python/cpython/pull/14331 ___ Python tracker ___ _

[issue37382] Improve conditional check for test_gdb

Jeroen Demeyer added the comment: The tests FAIL when CPython is compiled with "-O0 -g0" (without optimizations, without debug info) but tests PASS when compiled with "-O3 -g", showing that the check for "-g" is the right one. -- ___ Python tracke

[issue20177] Derby #8: Convert 28 sites to Argument Clinic across 2 files

Change by Jeroen Demeyer : -- pull_requests: +14150 pull_request: https://github.com/python/cpython/pull/14330 ___ Python tracker ___ __

[issue37382] Improve conditional check for test_gdb

New submission from Jeroen Demeyer : Many tests in test_gdb are not run if python_is_optimized() is true. However, it's not entirely clear why we have this condition. For example, on my system, with the default CPython configuration, Python *is* optimized but still all gdb tests pass if I art

[issue37097] python_is_optimized() false negatives

Jeroen Demeyer added the comment: Never mind, I probably tested wrong here. -- resolution: -> works for me stage: -> resolved status: open -> closed ___ Python tracker ___ _

[issue37348] Optimize PyUnicode_FromString for short ASCII strings

Inada Naoki added the comment: This optimization is only for short strings. There is no significant difference for long and non-ASCII strings. ``` # 1000 ASCII $ ./python -m pyperf timeit --compare-to=./python-master -s 'b=b"f"*1000' -- 'b.decode()' python-master: . 196 n

<    1   2