[issue39116] StreamReader.readexactly() raises GeneratorExit on ProactorEventLoop

twisteroid ambassador added the comment: Well this is unexpected, the same code running on Linux is throwing GeneratorExit-related mysterious exceptions as well. I'm not sure whether this is the same problem, but this one has a clearer traceback. I will attach the full error log

[issue39116] StreamReader.readexactly() raises GeneratorExit on ProactorEventLoop

twisteroid ambassador added the comment: I have attached a script that should be able to reproduces this problem. It's not a minimal reproduction, but hopefully easy enough to trigger. The script is a SOCKS5 proxy server listening on localhost:1080. In its current form it does not need any

[issue39116] StreamReader.readexactly() raises GeneratorExit on ProactorEventLoop

Change by twisteroid ambassador : -- versions: +Python 3.9 ___ Python tracker <https://bugs.python.org/issue39116> ___ ___ Python-bugs-list mailing list Unsub

[issue39116] StreamReader.readexactly() raises GeneratorExit on ProactorEventLoop

twisteroid ambassador added the comment: This problem still exists on Python 3.9 and latest Windows 10. I tried to catch the GeneratorExit and turn it into a normal Exception, and things only got weirder from here. Often several lines later another await statement would raise another

[issue39116] StreamReader.readexactly() raises GeneratorExit on ProactorEventLoop

New submission from twisteroid ambassador : I have been getting these strange exception since Python 3.8 on my Windows 10 machine. The external symptoms are many errors like "RuntimeError: aclose(): asynchronous generator is already running" and "Task was destroyed but

[issue35545] asyncio.base_events.create_connection doesn't handle scoped IPv6 addresses

twisteroid ambassador added the comment: With regards to the failing test, it looks like the test basically boils down to testing whether loop.getaddrinfo('fe80::1%1', 80, type=socket.SOCK_STREAM) returns (, , *, *, ('fe80::1', 80, 0, 1)). This feels like a dangerous assumption to make

[issue35545] asyncio.base_events.create_connection doesn't handle scoped IPv6 addresses

twisteroid ambassador added the comment: AFAIK the reason why scope id is required for IPv6 is that every IPv6 interfaces has its own link-local address, and all these addresses are in the same subnet, so without an additional scope id there’s no way to tell from which interface an address can

[issue36636] Inner exception is not being raised using asyncio.gather

twisteroid ambassador added the comment: The difference is because you grabbed and print()ed the exception themselves in Script 2, while in Script 1 you let Python's built-in unhandled exception handler (sys.excepthook) print the traceback for you. If you want a traceback, then you need

[issue32776] asyncio SIGCHLD scalability problems

twisteroid ambassador added the comment: The child watchers are documented now, see here: https://docs.python.org/3/library/asyncio-policy.html#process-watchers Sounds like FastChildWatcher https://docs.python.org/3/library/asyncio-policy.html#asyncio.FastChildWatcher is exactly what you

[issue36069] asyncio: create_connection cannot handle IPv6 link-local addresses anymore (linux)

twisteroid ambassador added the comment: Duplicate of issue35545, I believe. -- nosy: +twisteroid ambassador ___ Python tracker <https://bugs.python.org/issue36

[issue30782] Allow limiting the number of concurrent tasks in asyncio.as_completed

twisteroid ambassador added the comment: I feel like once you lay out all the requirements: taking futures from an (async) generator, limiting the number of concurrent tasks, getting completed tasks to one consumer "as completed", and an implicit requirement that back pre

[issue35945] Cannot distinguish between subtask cancellation and running task cancellation

twisteroid ambassador added the comment: I wrote a recipe on this idea: https://gist.github.com/twisteroidambassador/f35c7b17d4493d492fe36ab3e5c92202 Untested, feel free to use it at your own risk. -- ___ Python tracker <https://bugs.python.

[issue35945] Cannot distinguish between subtask cancellation and running task cancellation

twisteroid ambassador added the comment: There is a way to distinguish whether a task is being cancelled from the "inside" or "outside", like this: async def task1func(): task2 = asyncio.create_task(task2func()) try: await asyncio.wait((tas

[issue35545] asyncio.base_events.create_connection doesn't handle scoped IPv6 addresses

twisteroid ambassador added the comment: Oh wait, there's also this in asyncio docs for loop.sock_connect: Changed in version 3.5.2: address no longer needs to be resolved. sock_connect will try to check if the address is already resolved by calling socket.inet_pton

[issue35545] asyncio.base_events.create_connection doesn't handle scoped IPv6 addresses

twisteroid ambassador added the comment: I just noticed that in the socket module, an AF_INET address tuple is allowed to have an unresolved host name. Quote: A pair (host, port) is used for the AF_INET address family, where host is a string representing either a hostname in Internet domain

[issue35545] asyncio.base_events.create_connection doesn't handle scoped IPv6 addresses

twisteroid ambassador added the comment: Hi Emmanuel, Are you referring to my PR 11403? I don't see where IPv6 uses separate parameters. -- ___ Python tracker <https://bugs.python.org/issue35

[issue35545] asyncio.base_events.create_connection doesn't handle scoped IPv6 addresses

Change by twisteroid ambassador : -- pull_requests: +10786, 10787, 10788, 10789 ___ Python tracker <https://bugs.python.org/issue35545> ___ ___ Python-bugs-list m

[issue33678] selector_events.BaseSelectorEventLoop.sock_connect should preserve socket type

Change by twisteroid ambassador : -- pull_requests: +10790, 10791 stage: -> patch review ___ Python tracker <https://bugs.python.org/issue33678> ___ ___ Py

[issue33678] selector_events.BaseSelectorEventLoop.sock_connect should preserve socket type

Change by twisteroid ambassador : -- pull_requests: +10790 stage: -> patch review ___ Python tracker <https://bugs.python.org/issue33678> ___ ___ Python-

[issue35545] asyncio.base_events.create_connection doesn't handle scoped IPv6 addresses

Change by twisteroid ambassador : -- pull_requests: +10786 ___ Python tracker <https://bugs.python.org/issue35545> ___ ___ Python-bugs-list mailing list Unsub

[issue35545] asyncio.base_events.create_connection doesn't handle scoped IPv6 addresses

Change by twisteroid ambassador : -- pull_requests: +10786, 10787, 10788 ___ Python tracker <https://bugs.python.org/issue35545> ___ ___ Python-bugs-list mailin

[issue35545] asyncio.base_events.create_connection doesn't handle scoped IPv6 addresses

Change by twisteroid ambassador : -- pull_requests: +10786, 10787 ___ Python tracker <https://bugs.python.org/issue35545> ___ ___ Python-bugs-list mailin

[issue33678] selector_events.BaseSelectorEventLoop.sock_connect should preserve socket type

twisteroid ambassador added the comment: Looks like this bug is also cause by using _ensure_resolved() more than once for a given host+port, so it can probably be fixed together with https://bugs.python.org/issue35545 . Masking sock.type should not be necessary anymore since https

[issue35545] asyncio.base_events.create_connection doesn't handle scoped IPv6 addresses

twisteroid ambassador added the comment: Also I believe it's a good idea to change the arguments of _ensure_resolved() from (address, *, ...) to (host, port, *, ...), and go through all its usages, making sure we're not mixing host + port with address tuples everywhere in asyncio

[issue35545] asyncio.base_events.create_connection doesn't handle scoped IPv6 addresses

twisteroid ambassador added the comment: I think the root cause of this bug is a bit of confusion. The "customer-facing" asyncio API, create_connection(), takes two arguments: host and port. The lower-level API that actually deal with connecting sockets, sock

[issue35302] create_connection with local_addr misses valid socket bindings

twisteroid ambassador added the comment: I don't have a Mac, so I have not tested Ronald's workaround. Assuming it works, we will have to either i) implement platform-specific behavior and only apply IPV6_V6ONLY on macOS for each AF_INET6 socket created, or ii) apply it to all AF_INET6

[issue35302] create_connection with local_addr misses valid socket bindings

Change by twisteroid ambassador : -- keywords: +patch pull_requests: +10471 stage: -> patch review ___ Python tracker <https://bugs.python.org/issu

[issue35302] create_connection with local_addr misses valid socket bindings

twisteroid ambassador added the comment: IMO macOS is at fault here, for even allowing an IPv6 socket to bind to an IPv4 address. ;-) I have given some thought about this issue when writing my happy eyeballs library. My current solution is closest to Neil's first suggestion, i.e. each pair

[issue34769] _asyncgen_finalizer_hook running in wrong thread

Change by twisteroid ambassador : -- pull_requests: +9174 ___ Python tracker <https://bugs.python.org/issue34769> ___ ___ Python-bugs-list mailing list Unsub

[issue34769] _asyncgen_finalizer_hook running in wrong thread

twisteroid ambassador added the comment: I’m now convinced that the bug we’re fixing and the original bug with debug mode off are two separate bugs. With the fix in place and debug mode off, I’m still seeing the original buggy behavior. Bummer. In my actual program, I have an async

[issue34769] _asyncgen_finalizer_hook running in wrong thread

Change by twisteroid ambassador : -- keywords: +patch pull_requests: +9099 stage: -> patch review ___ Python tracker <https://bugs.python.org/issu

[issue34769] _asyncgen_finalizer_hook running in wrong thread

twisteroid ambassador added the comment: I'll open a PR with your diff soon, but I don't have a reliable unit test yet. Also, it does not seem to fix the old problem with debug mode off. :-( I had hoped that the problem with debug mode off is nothing more than _asyncgen_finalizer_hook

[issue34769] _asyncgen_finalizer_hook running in wrong thread

twisteroid ambassador added the comment: I have finally managed to reproduce this one reliably. The issue happens when i) async generators are not finalized immediately and must be garbage collected in the future, and ii) the garbage collector happens to run in a different thread than

[issue34769] _asyncgen_finalizer_hook running in wrong thread

New submission from twisteroid ambassador : When testing my happy eyeballs library, I occasionally run into issues with async generators seemingly not finalizing. After setting loop.set_debug(True), I have been seeing log entries like these: Exception ignored in: Traceback (most recent

[issue33833] ProactorEventLoop raises AssertionError

twisteroid ambassador added the comment: As an aside, I'm wondering whether it makes sense to add a blanket "assert exception handler has not been called" condition to ProactorEventLoop's tests, or even other asyncio tests. It looks like ProactorEventLoop is more prone to

[issue33833] ProactorEventLoop raises AssertionError

twisteroid ambassador added the comment: No problem. Running the attached test script on latest master, Windows 10 1803, several errors like this are logged: Exception in callback _ProactorBaseWritePipeTransport._loop_writing(<_OverlappedF...events.py:479>) handle: ) c

[issue31647] asyncio: StreamWriter write_eof() after close raises mysterious AttributeError

twisteroid ambassador added the comment: Well, I opened the PR, it shows up here, but there's no reviewer assigned. -- ___ Python tracker <https://bugs.python.org/issue31

[issue31647] asyncio: StreamWriter write_eof() after close raises mysterious AttributeError

Change by twisteroid ambassador : -- pull_requests: +7571 ___ Python tracker <https://bugs.python.org/issue31647> ___ ___ Python-bugs-list mailing list Unsub

[issue31647] asyncio: StreamWriter write_eof() after close raises mysterious AttributeError

twisteroid ambassador added the comment: Turns out my typo when preparing the pull request had another victim: the changelog entries in documentation currently links to the wrong issue. I'll make a PR to fix that typo; since it's just documentation, hopefully it can still get into Python

[issue33833] ProactorEventLoop raises AssertionError

Change by twisteroid ambassador : -- pull_requests: +7500 ___ Python tracker <https://bugs.python.org/issue33833> ___ ___ Python-bugs-list mailing list Unsub

[issue33834] Test for ProactorEventLoop logs InvalidStateError

New submission from twisteroid ambassador : When running the built-in regression tests, although test_sendfile_close_peer_in_the_middle_of_receiving on ProactorEventLoop completes successfully, an InvalidStateError is logged. Console output below

[issue33833] ProactorEventLoop raises AssertionError

Change by twisteroid ambassador : -- keywords: +patch pull_requests: +7251 stage: -> patch review ___ Python tracker <https://bugs.python.org/issu

[issue33833] ProactorEventLoop raises AssertionError

Change by twisteroid ambassador : -- type: -> behavior ___ Python tracker <https://bugs.python.org/issue33833> ___ ___ Python-bugs-list mailing list Un

[issue33833] ProactorEventLoop raises AssertionError

New submission from twisteroid ambassador : Sometimes when a socket transport under ProactorEventLoop is writing while the peer closes the connection, asyncio logs an AssertionError. Attached is a script that fairly reliably reproduces the behavior on my computer. This is caused

[issue33530] Implement Happy Eyeball in asyncio

Change by twisteroid ambassador : -- pull_requests: +6867 ___ Python tracker <https://bugs.python.org/issue33530> ___ ___ Python-bugs-list mailing list Unsub

[issue31647] asyncio: StreamWriter write_eof() after close raises mysterious AttributeError

Change by twisteroid ambassador <twisteroid.ambassa...@gmail.com>: -- keywords: +patch pull_requests: +6785 stage: -> patch review ___ Python tracker <rep...@bugs.python.org> <https://bugs.pyt

[issue31467] cElementTree behaves differently compared to ElementTree

Change by twisteroid ambassador <twisteroid.ambassa...@gmail.com>: -- pull_requests: +6786 ___ Python tracker <rep...@bugs.python.org> <https://bugs.python

[issue31647] asyncio: StreamWriter write_eof() after close raises mysterious AttributeError

twisteroid ambassador <twisteroid.ambassa...@gmail.com> added the comment: I was about to write a long comment asking what the appropriate behavior should be, but then saw that _ProactorSocketTransport already handles the same issue properly, so I will just change _SelectorSocketTra

[issue31467] cElementTree behaves differently compared to ElementTree

Change by twisteroid ambassador <twisteroid.ambassa...@gmail.com>: -- pull_requests: +6783 ___ Python tracker <rep...@bugs.python.org> <https://bugs.python

[issue33630] test_posix: TestPosixSpawn fails on PPC64 Fedora 3.x

Change by twisteroid ambassador <twisteroid.ambassa...@gmail.com>: -- keywords: +patch pull_requests: +6734 stage: -> patch review ___ Python tracker <rep...@bugs.python.org> <https://bugs.pyt

[issue33530] Implement Happy Eyeball in asyncio

Change by twisteroid ambassador <twisteroid.ambassa...@gmail.com>: -- keywords: +patch pull_requests: +6733 stage: -> patch review ___ Python tracker <rep...@bugs.python.org> <https://bugs.pyt

[issue33530] Implement Happy Eyeball in asyncio

New submission from twisteroid ambassador <twisteroid.ambassa...@gmail.com>: Add a Happy Eyeballs implementation to asyncio, based on work in https://github.com/twisteroidambassador/async_stagger . Current plans: - Add 2 keyword arguments to loop.create_connection and asyncio.open_conn

[issue33413] asyncio.gather should not use special Future

twisteroid ambassador <twisteroid.ambassa...@gmail.com> added the comment: I would like to comment on the last observation about current_task().cancel(). I also ran into this corner case recently. When a task is cancelled from outside, by virtue of there *being something outside

[issue31647] asyncio: StreamWriter write_eof() after close raises mysterious AttributeError

Change by twisteroid ambassador <twisteroid.ambassa...@gmail.com>: -- nosy: +giampaolo.rodola, haypo ___ Python tracker <rep...@bugs.python.org> <https://bugs.python

[issue31647] asyncio: StreamWriter write_eof() after close raises mysterious AttributeError

twisteroid ambassador <twisteroid.ambassa...@gmail.com> added the comment: This issue is somewhat related to issue27223, in that both are caused by using self._sock after it has already been assigned None when the connection is closed. It seems like Transports in general may need

[issue31647] asyncio: StreamWriter write_eof() after close raises mysterious AttributeError

New submission from twisteroid ambassador <twisteroid.ambassa...@gmail.com>: Currently, if one attempts to do write_eof() on a StreamWriter after the underlying transport is already closed, an AttributeError is raised: Traceback (most recent call last): File "\scratch_3.p

[issue31176] Is a UDP transport also a ReadTransport/WriteTransport?

New submission from twisteroid ambassador: In docs / Library Reference / asyncio / Transports and Protocols, it is mentioned that "asyncio currently implements transports for TCP, UDP, SSL, and subprocess pipes. The methods available on a transport depend on the transport’s kind.&quo