Re: [Async-sig] New blog post: Notes on structured concurrency, or: Go statement considered harmful

2018-04-25 Thread Antoine Pitrou
On Wed, 25 Apr 2018 02:24:15 -0700 Nathaniel Smith wrote: > Hi all, > > I just posted another essay on concurrent API design: > > https://vorpus.org/blog/notes-on-structured-concurrency-or-go-statement-considered-harmful/ > > This is the one that finally gets at the core reasons why Trio exists

Re: [Async-sig] asyncio.Lock equivalent for multiple processes

2018-04-17 Thread Antoine Pitrou
Indeed, it seems to fit my problem. > > The small latest problem I have is that we have string names for locks, > but advisory locks accept only integers. > Nevertheless, it isn't a problem, I will do a mapping between names and > integers. > > Yours. > > -- >

Re: [Async-sig] Blog post: Timeouts and cancellation for humans

2018-01-15 Thread Antoine Pitrou
Hi, On Thu, 11 Jan 2018 02:09:29 -0800 Nathaniel Smith wrote: > Hi all, > > Folks here might be interested in this new blog post: > > https://vorpus.org/blog/timeouts-and-cancellation-for-humans/ > > It's a detailed discussion of pitfalls and design-tradeoffs in APIs > for timeout and cancell

Re: [Async-sig] Asyncio loop instrumentation

2017-12-31 Thread Antoine Pitrou
On Sun, 31 Dec 2017 18:32:21 +0100 Pau Freixes wrote: > > These new implementation of the load method - remember that it returns > a load factor between 0.0 and 1.0 that inform you about how bussy is > your loop - What does it mean exactly? Is it the ratio of CPU time over wall clock time? Depe

Re: [Async-sig] APIs for high-bandwidth large I/O?

2017-10-23 Thread Antoine Pitrou
Hi Ludovic, Le 22/10/2017 à 18:51, Ludovic Gasc a écrit : To my understanding, some AsyncIO libraries, like aiohttp, don't use Streams API of AsyncIO and implement a specific implementation, especially to have a full control on the buffers: based on the information provided inside the proto

Re: [Async-sig] APIs for high-bandwidth large I/O?

2017-10-21 Thread Antoine Pitrou
tests were run using: > https://gist.github.com/pitrou/719e73c1df51e817d618186833a6e2cc > > Cheers, > Dave > > > On Oct 18, 2017, at 1:04 PM, Antoine Pitrou wrote: > > > > > > Hi, > > > > I am currently looking into ways to optimize large data tr

[Async-sig] APIs for high-bandwidth large I/O?

2017-10-18 Thread Antoine Pitrou
Hi, I am currently looking into ways to optimize large data transfers for a distributed computing framework (https://github.com/dask/distributed/). We are using Tornado but the question is more general, as it turns out that certain kinds of API are an impediment to such optimizations. To put th

Re: [Async-sig] SansIO (Was: PEP: asynchronous generators)

2016-08-11 Thread Antoine Pitrou
Hi, > However, I think we can safely say that the Python community has not > effectively done this over our twenty-plus year lifetime. I'd like to offer a couple remarks here: 1) implementing a protocol usually goes beyond parsing (which, it's true, can easily be done "sans IO"). 2) many non-t