Re: [python-tulip] xml-rpc Server with asyncio

2014-09-26 Thread Ludovic Gasc
Hi, Thank you a lot for this library, we had in our schedule to do the same thing, also based on aiohttp. We will use your library for our next development. BTW, not interested by the server part, now all of our clients asked for REST/JSON only, even Java developers. For now, we're testing

Re: [python-tulip] Upgrading asyncio 3.4.1 module on top of Python 3.4.0

2014-10-25 Thread Ludovic Gasc
You can use pythonz: https://github.com/saghul/pythonz to install quickly a specific version of Python, along side with your python system. We use that, it works like a charm. -- Ludovic Gasc On Fri, Oct 24, 2014 at 7:35 PM, Gustavo Carneiro gjcarne...@gmail.com wrote: I have Python 3.4.0

[python-tulip] Need advices to understand some counter-intuitive performance issues with AsyncIO

2015-01-24 Thread Ludovic Gasc
Hi, I've a strange behaviour with AsyncIO: more I try to improve the performances, more it's slow. I certainly missed something in AsyncIO, or maybe you have some tips other than try and benchmark for each change. For example, this is two coroutines to update data from PostgreSQL, executed by

Re: [python-tulip] CPython bugs

2015-02-03 Thread Ludovic Gasc
Jessie will be released very soon with 3.4.2 version :-\ Ludovic Gasc (GMLudo) On 3 Feb 2015 13:59, Victor Stinner victor.stin...@gmail.com wrote: Hi, The development of asyncio and trollius helped to identify and fix different bugs in CPython. You may be interested to know them to maybe

[python-tulip] New release of API-Hour

2015-01-18 Thread Ludovic Gasc
Hi, I've did a new release of API-Hour based on your comments you sent me privately. As a remember, API-Hour helps you to create AsyncIO (HTTP, SSH) daemons, with multiprocessing pattern included. The changes: 1. An all-in-one Python script example, to test quickly API-Hour without

Re: [python-tulip] Proposal: make coroutines stand out in the asyncio docs.

2015-02-12 Thread Ludovic Gasc
Thank you Victor for your reactivity, it's ok for me. Ludovic Gasc (GMLudo) On 12 Feb 2015 23:00, Victor Stinner victor.stin...@gmail.com wrote: Hi, I added :py:coroutinefunction: and :py:coroutinemethod: commands in the pyspecifics.py extensions of CPython documentation. I modified

Re: [python-tulip] Bugfixes in the ProactorEventLoop

2015-01-27 Thread Ludovic Gasc
Hi, Thank you Victor. I've a development in few weeks on Windows, I'll use that with Qt for rendering. Regards. Ludovic Gasc (GMLudo) On 27 Jan 2015 18:10, Victor Stinner victor.stin...@gmail.com wrote: Hi, The ProactorEventLoop still lacks some features: UDP and signal handling. https

Re: [python-tulip] Re: Benchmark Python Web production stack: Nginx with uWSGI, Meinheld and API-Hour

2015-03-12 Thread Ludovic Gasc
impact on the numbers. And, even if somebody find a big error, I'm pretty sure I won't be alone to do this error on production. If you go to PyCON-US this year, we will discuss directly face-to-face, it will be easier. Kind regards. -- Ludovic Gasc On Wed, Mar 11, 2015 at 11:36 PM, Antoine Pitrou

Re: [python-tulip] Benchmark Python Web production stack: Nginx with uWSGI, Meinheld and API-Hour

2015-03-13 Thread Ludovic Gasc
Good suggestion, I've tried that on round 1, but it was worse. With the round 5, should be more relevant, I will try that. Ludovic Gasc (GMLudo) On 12 Mar 2015 14:12, INADA Naoki songofaca...@gmail.com wrote: I think API-Hour uses connection pool for PostgreSQL, right? DB connection has

Re: [python-tulip] Benchmark Python Web production stack: Nginx with uWSGI, Meinheld and API-Hour

2015-03-13 Thread Ludovic Gasc
On Fri, Mar 13, 2015 at 8:35 AM, INADA Naoki songofaca...@gmail.com wrote: IMO, When I really needs high performance (1000~ req/(sec*cores)), I use Go in these days. From my point of view, Python is the best language to write business logic. I hope to continue to find solutions to

Re: [python-tulip] Benchmark Python Web production stack: Nginx with uWSGI, Meinheld and API-Hour

2015-03-13 Thread Ludovic Gasc
On Fri, Mar 13, 2015 at 10:50 AM, Victor Stinner victor.stin...@gmail.com wrote: 2015-03-13 10:07 GMT+01:00 Ludovic Gasc gml...@gmail.com: Yes, I've the same hope with PyPy because I've seen benchmarks like this: https://twitter.com/oberstet/status/550741713762136064 Did you follow the URL

Re: [python-tulip] Benchmark Python Web production stack: Nginx with uWSGI, Meinheld and API-Hour

2015-03-13 Thread Ludovic Gasc
, FrameworkBenchmarks will hit more and it will use wrk2, it should change some values. Ludovic Gasc (GMLudo) On 12 Mar 2015 20:40, INADA Naoki songofaca...@gmail.com wrote: Yes, I know PyPy, while I use C or Cython heavily when I want performance. I've setuped PyPy on http://www.techempower.com

Re: [python-tulip] Re: Benchmark Python Web production stack: Nginx with uWSGI, Meinheld and API-Hour

2015-03-12 Thread Ludovic Gasc
If you have another nginx config file to propose, I'll happy to relaunch a round. For nginx part, I've taken some deployment config files from the Web. -- Ludovic Gasc On Thu, Mar 12, 2015 at 1:04 PM, Victor Stinner victor.stin...@gmail.com wrote: 2015-03-11 23:36 GMT+01:00 Antoine Pitrou

Re: [python-tulip] Benchmark Python Web production stack: Nginx with uWSGI, Meinheld and API-Hour

2015-03-25 Thread Ludovic Gasc
: 25.39MB In pure AsyncIO, it's still slower than WGSI+Meinheld, but more closer in term of results. Maybe the difference should be because Meinheld is coded in C, where AsyncIO is in pure Python. -- Ludovic Gasc (GMLudo) http://www.gmludo.eu/ On Fri, Mar 13, 2015 at 10:07 AM, Ludovic Gasc gml

Re: [python-tulip] Status of AsyncIO support on PyPy3.3

2015-03-28 Thread Ludovic Gasc
://127.0.0.1:8009/json If you have any issue, you can contact me directly. Sent from Outlook http://taps.io/outlookmobile On Thu, Mar 26, 2015 at 4:36 PM -0700, Ludovic Gasc gml...@gmail.com wrote: Since two weeks, I'm trying to use AsyncIO on top of PyPy3.3 From my experience, two

Re: [python-tulip] Macro-benchmark with Django, Flask and AsyncIO (aiohttp.web+API-Hour)

2015-03-01 Thread Ludovic Gasc
server. About Nginx as frontend and process/threads comparison, I must finish to implement unix sockets and threads worker in API-Hour before to test. Regards. -- Ludovic Gasc On Fri, Feb 27, 2015 at 1:12 AM, Ludovic Gasc gml...@gmail.com wrote: Hi all, I'm trying to address all remarks before

[python-tulip] Re: Thread safety

2015-02-25 Thread Ludovic Gasc
On Wednesday, February 25, 2015 at 2:43:54 PM UTC+1, Victor Stinner wrote: Maybe we should modify asyncio.Queue and asyncio.Lock to make them thread-safe? For me, it's the ideal scenario, but: 1. I have no idea if it's complicated 2. If it should reduce performances when you don't use

Re: [python-tulip] Macro-benchmark with Django, Flask and AsyncIO (aiohttp.web+API-Hour)

2015-02-25 Thread Ludovic Gasc
Web application. -- Ludovic Gasc On Wed, Feb 25, 2015 at 4:20 PM, INADA Naoki songofaca...@gmail.com wrote: It's not benchmark for sync vs async. It is keep-alive vs non keep-alive. gunicorn's default (sync) worker is designed as backend server. It means it requires reverse proxy like

Re: [python-tulip] Macro-benchmark with Django, Flask and AsyncIO (aiohttp.web+API-Hour)

2015-02-26 Thread Ludovic Gasc
On Thu, Feb 26, 2015 at 8:19 AM, Aymeric Augustin aymeric.augus...@polytechnique.org wrote: On 26 févr. 2015, at 00:00, Antoine Pitrou solip...@pitrou.net wrote: On Wed, 25 Feb 2015 23:44:33 +0100 Ludovic Gasc gml...@gmail.com wrote: I've disabled keep_alive in api_hour, I quickly

Re: [python-tulip] Macro-benchmark with Django, Flask and AsyncIO (aiohttp.web+API-Hour)

2015-02-26 Thread Ludovic Gasc
On 26 Feb 2015 12:01, INADA Naoki songofaca...@gmail.com wrote: What's the difference between my benchmark and a server that receives a lot of requests ? For you, this use case doesn't happen on production ? Or you maybe you have a tip to avoid that ? First, I don't use Gunicorn's

[python-tulip] Macro-benchmark with Django, Flask and AsyncIO (aiohttp.web+API-Hour)

2015-02-25 Thread Ludovic Gasc
Hi guys, I'm permitted to send you this e-mail because some people has discussed on this mailing-list about AsyncIO benchmarks. I've published an improved version of my benchmarks: http://blog.gmludo.eu/2015/02/macro-benchmark-with-django-flask-and-asyncio.html Moreover, to reduce the risk to

[python-tulip] Status of AsyncIO support on PyPy3.3

2015-03-26 Thread Ludovic Gasc
that the PyPy dev team goal is more to be fully compliant with CPython 3.3 than have the best performances. Finally, if you are interested in to help PyPy project but you have no time, you can donate money: http://pypy.org/py3donate.html I've did a recurring donation for the PyPy project. -- Ludovic Gasc

Re: [python-tulip] Writing Redis in Python with asyncio: Part 1

2015-03-26 Thread Ludovic Gasc
implementation falls down. -- Ludovic Gasc (GMLudo) http://www.gmludo.eu/ On Thu, Mar 26, 2015 at 11:51 PM, Luca Sbardella luca.sbarde...@gmail.com wrote: On 26 March 2015 at 17:14, Victor Stinner victor.stin...@gmail.com wrote: James Saryerwinnie wrote an article: http://jamesls.com/writing

Re: [python-tulip] Re: Need advices to understand some counter-intuitive performance issues with AsyncIO

2015-01-29 Thread Ludovic Gasc
Thank you Jonathan and Andrew, it's more clear to me. I'm digging with time counters in source code to try to find a good compromise. Regards. -- Ludovic Gasc On Thu, Jan 29, 2015 at 5:10 PM, Andrew Svetlov andrew.svet...@gmail.com wrote: Task creation requires one extra event loop iteration

Re: [python-tulip] aiotest: a testing library on top of unittest for asyncio

2015-05-11 Thread Ludovic Gasc
present on PyPI: https://pypi.python.org/pypi/aiotest I should suggest to rename your library to avoid comprehension errors from newcomers. Have a nice night. -- Ludovic Gasc (GMLudo) http://www.gmludo.eu/ 2015-05-11 22:37 GMT+02:00 Martin Richard martius...@gmail.com: Hi, I would like

[python-tulip] Re: Cleanly shutting down a streams server

2015-05-11 Thread Ludovic Gasc
I've maybe something interesting to you. I don't remember exactly the issue, but I had a similar issue in API-Hour with the worker. I've taken some ideas/source code from gunicorn aiohttp worker and aiohttp worker to do that: https://github.com/Eyepea/API-Hour/blob/master/api_hour/worker.py#L45

Re: [python-tulip] aiotest: a testing library on top of unittest for asyncio

2015-05-12 Thread Ludovic Gasc
I've added your library: https://github.com/python/asyncio/wiki/ThirdParty#unit-testing BTW, you should also post on: http://asyncio.org/ -- Ludovic Gasc (GMLudo) http://www.gmludo.eu/ 2015-05-12 9:09 GMT+02:00 Martin Richard martius...@gmail.com: Ah, too bad I didn't check that before

[python-tulip] tulip wiki migration

2015-04-11 Thread Ludovic Gasc
Hi, At least to me, the most important wiki page of Tulip project was: http://code.google.com/p/tulip/wiki/ThirdParty With the Github migration, this wiki page has been gone. The performances list page was also interesting. Personnally, I've followed both pages via RSS feeds to follow AsyncIO

Re: [python-tulip] tulip wiki migration

2015-04-11 Thread Ludovic Gasc
Ok, I can help to do that. Ludovic Gasc (GMLudo) http://www.gmludo.eu/ On 11 Apr 2015 13:02, Guido van Rossum gu...@python.org wrote: The wiki pages are preserved in the wiki branch of the repo. If you want to help putting them back in the github wiki slot I can give you repo access. On Apr

Re: [python-tulip] Is async object creation supported?

2015-05-16 Thread Ludovic Gasc
It's simple to use and understand. Regards. -- Ludovic Gasc (GMLudo) http://www.gmludo.eu/ 2015-05-16 22:48 GMT+02:00 Alex Gaynor alex.gay...@gmail.com: Glyph's answer matches my experience. To add another reason though, remember back to when I was new to Python, I too wanted to figure out

Re: [python-tulip] [ANN] uasyncio - lean asyncio-like library

2015-06-21 Thread Ludovic Gasc
, be my guest. Have a nice week-end. -- Ludovic Gasc (GMLudo) http://www.gmludo.eu/ 2015-06-21 11:09 GMT+02:00 Paul Sokolovsky pmis...@gmail.com: Hello Ludovic, On Sun, 21 Jun 2015 08:20:52 +0200 Ludovic Gasc gml...@gmail.com wrote: Hi Paul, It's pretty interesting. Thanks. I've

Re: [python-tulip] [ANN] uasyncio - lean asyncio-like library

2015-06-21 Thread Ludovic Gasc
Hi Paul, It's pretty interesting. I've a question: do you test your daemons with wrk instead of ab? Could you test with the values: wrk -t8 -c256 -d1m ? I'm interested in to integrate uasyncio and picoweb in FrameworkBenchmarks: https://www.techempower.com/benchmarks/ Regards. Ludovic Gasc

Re: [python-tulip] Customizing Server.close() and wait_closed()

2015-08-19 Thread Ludovic Gasc
2015-08-10 19:23 GMT+02:00 Aymeric Augustin aymeric.augus...@polytechnique.org: Hello Guido, On 10 août 2015, at 15:32, Guido van Rossum gu...@python.org wrote: Folks, can we stop the testy interaction? Oops — sorry about that. I'm also sorry, to reread my e-mail after 10 days, it was

Re: [python-tulip] Customizing Server.close() and wait_closed()

2015-08-10 Thread Ludovic Gasc
2015-08-10 14:59 GMT+02:00 Aymeric Augustin aymeric.augus...@polytechnique.org: On 10 août 2015, at 11:38, Ludovic Gasc gml...@gmail.com wrote: I don't know all implementation details, however, we use on production for several daemons this implementation: http://aiohttp.readthedocs.org/en

[python-tulip] Wiki update of AsyncIO libraries

2015-07-18 Thread Ludovic Gasc
Hi, Is everybody who has written an AsyncIO library/tool could verify that the library is present on our toolbox wiki page: https://github.com/python/asyncio/wiki/ThirdParty ? If not, please to send me an e-mail directly. FYI, I'll print this page to show it during the EuroPython poster

Re: [python-tulip] Re: Wiki update of AsyncIO libraries

2015-07-19 Thread Ludovic Gasc
to retweet: https://twitter.com/GMLudo/status/622884954058457088 Or create an original tweet, be my guest ;-) See you tomorrow. -- Ludovic Gasc (GMLudo) http://www.gmludo.eu/ 2015-07-19 5:04 GMT+02:00 A. Jesse Jiryu Davis je...@emptysquare.net: Andrew Svetlov and I are adapting Motor, my asynchronous

[python-tulip] initial SIP protocol support for AsyncIO

2015-07-21 Thread Ludovic Gasc
Hello everybody, I'm proud to announce a new AsyncIO library to support SIP protocol: aiosip https://github.com/Eyepea/aiosip FYI, SIP is the protocol the most used in the telecom field. For now, unit tests and documentation are lacking, however, this library is used and tested in real

Re: [python-tulip] aiosmtpd - SMTP and LMTP server for asyncio 1.0a1

2015-10-23 Thread Ludovic Gasc
. -- Ludovic Gasc (GMLudo) http://www.gmludo.eu/ 2015-10-20 15:44 GMT+02:00 Barry Warsaw <war...@gmail.com>: > Several of us got together a few weeks ago both physically and virtually > to work on an asyncio version of smtpd.py from the standard library. We're > now ready to ann

[python-tulip] FrameworkBenchmarks Round 11 results are available

2015-12-28 Thread Ludovic Gasc
Hi everybody, For now, I can't contribute like I want because I'm handling a lot of personal and professional changes. However, I continue to keep an eye. FrameworkBenchmarks Round 11 results are available: https://www.techempower.com/benchmarks/#section=data-r11=peak=fortune=1kw If you don't

Re: [python-tulip] Re: FrameworkBenchmarks Round 11 results are available

2016-02-14 Thread Ludovic Gasc
Hi Yury, Thanks for the remark, I'll test with two different machines during the next week. Have a nice day. -- Ludovic Gasc (GMLudo) http://www.gmludo.eu/ 2016-02-14 20:42 GMT+01:00 Yury Selivanov <yseliva...@gmail.com>: > Hi Ludovic, > > I’m usually highly sceptical ab

Re: [python-tulip] How can selectors module support EPOLLEXCLUSIVE ?

2016-04-04 Thread Ludovic Gasc
Hi Naoki, It seems very interesting, thank you for your contribution. To me, it makes sense to merge this feature. Have a nice day. -- Ludovic Gasc (GMLudo) http://www.gmludo.eu/ 2016-04-01 14:49 GMT+02:00 Naoki INADA <songofaca...@gmail.com>: > Hi, async programmers. > > Lin

Re: [python-tulip] uvloop

2016-05-05 Thread Ludovic Gasc
appears on the top of httptools, I'll integrate that for FrameworkBenchmarks, to confirm theses numbers and have more implementation to compare. Maybe, see you at EuroPython ? Have a nice week. -- Ludovic Gasc (GMLudo) http://www.gmludo.eu/ 2016-05-04 0:43 GMT+02:00 Yury Selivanov <yseliva

[python-tulip] Status of asyncio.readthedocs.io ?

2016-10-14 Thread Ludovic Gasc
/asyncio-doc/graphs/contributors Have a nice week. PS: No answer before Sunday = approved by people in the mailing-lists ;-) -- Ludovic Gasc (GMLudo) http://www.gmludo.eu/

[python-tulip] Re: Status of asyncio.readthedocs.io ?

2016-11-01 Thread Ludovic Gasc
e workshop. Have a nice day. PS: If you have some tips and tricks to animate AsyncIO workshops, I'm interested in. -- Ludovic Gasc (GMLudo) http://www.gmludo.eu/ 2016-10-14 17:12 GMT+02:00 Ludovic Gasc <gml...@gmail.com>: > Hi everybody, > > For me, http://asyncio.readthedocs

Re: [python-tulip] Python 3.6b2 will have C implemented Future

2016-10-10 Thread Ludovic Gasc
, if somebody's else has a new extra tip to improve efficiency, don't hesitate to drop me an e-mail or open an issue. Have a nice week. -- Ludovic Gasc (GMLudo) http://www.gmludo.eu/ 2016-10-09 8:06 GMT+02:00 Naoki INADA <songofaca...@gmail.com>: > Hi. > > I've just pushed C

Re: [python-tulip] UNIX socket and SOCK_DGRAM

2017-08-15 Thread Ludovic Gasc
On Wednesday, February 19, 2014 at 4:55:03 PM UTC+1, Guido van Rossum wrote: > > Because that would require duplicating the logic in > create_datagram_endpoint(), which is totally separate (all the way down to > the I/O callbacks). > > Feel free to add a feature request to the tracker for this

Re: [python-tulip] UNIX socket and SOCK_DGRAM

2017-08-17 Thread Ludovic Gasc
ooks like a real use case and proof that UNIX sockets used as datagrams are actually used. If you submit a PR (to CPython -- the separate asyncio repo is dead) it should be possible to get this into Python 3.7. On Tue, Aug 15, 2017 at 3:52 PM, Ludovic Gasc <gml...@gmail.com> wrote: > On Wed

Re: [python-tulip] UNIX socket and SOCK_DGRAM

2017-08-22 Thread Ludovic Gasc
, Ludovic Gasc wrote: > > Except if the implementation is a candy for somebody's else (please raise > your hand ;-) ), I will follow the official process to contribute in > CPython to add that. > > Thanks Guido for your response. > > Le 17 août 2017 06:40, "Guido van Rossu

Re: [python-tulip] Asyncio + file logging has sense?

2018-04-08 Thread Ludovic Gasc
question for logging, the easiest way to avoid to block the event loop is to delegate to a local rsyslog or journald: Even if the storage has an issue, it won't block your daemon for logging. Have a nice week. -- Ludovic Gasc (GMLudo) 2018-04-04 19:31 GMT+02:00 Andrew Svetlov <andrew.svet...@gmail.

[python-tulip] Re: [Async-sig] asyncio.Lock equivalent for multiple processes

2018-04-17 Thread Ludovic Gasc
hat succeeds, resolves the future using > loop.call_soon_threadsafe(). > I'm omitting implementation details, like what if Future is leaked > (discarded before it's resolved), how release is orchestrated, etc. > The key point is that offloading locking to a dedicated thread allows

Re: [python-tulip] Re: asyncio.Lock equivalent for multiple processes

2018-04-17 Thread Ludovic Gasc
l do a mapping between names and integers. Yours. -- Ludovic Gasc (GMLudo) 2018-04-17 13:41 GMT+02:00 Antoine Pitrou <solip...@pitrou.net>: > On Tue, 17 Apr 2018 13:34:47 +0200 > Ludovic Gasc <gml...@gmail.com> wrote: > > Hi Nickolai, > > > > Thanks for your sug

Re: [python-tulip] asyncio.Lock equivalent for multiple processes

2018-04-17 Thread Ludovic Gasc
. If somebody is using aioredlock in his project, I'm interested by feedbacks. Have a nice week. -- Ludovic Gasc (GMLudo) 2018-04-17 7:19 GMT+02:00 Roberto Martínez <robertomartin...@gmail.com>: > > Hi, > > I don't know if there is a third party solution for this. > >

Re: [python-tulip] asyncio.Lock equivalent for multiple processes

2018-04-17 Thread Ludovic Gasc
beginning to end and the other systems aren't idempotent at all, it's "old-school" proprietary systems, good luck to change that ;-) Regards. -- Ludovic Gasc (GMLudo) 2018-04-17 12:46 GMT+02:00 Nickolai Novik <nickolaino...@gmail.com>: > Hi, redis lock has own limitations and de

[python-tulip] asyncio.Lock equivalent for multiple processes

2018-04-16 Thread Ludovic Gasc
responses. -- Ludovic Gasc (GMLudo)