Taras, On Mon, Jun 4, 2012 at 5:00 PM, Taras <ox...@oxdef.info> wrote: > Andres, > geventhttpclient looks very fast HTTP client! > Did you also try Twisted? Can you make simple comparison in req/s for: > > 1. currently used in w3af solution (urllib+threads) > 2. geventhttpclient > 3. Twisted
I tried Twisted, not good compared with what geventhttpclient has to offer. > >> During the last hours I've been trying to find a faster HTTP >> client to integrate into w3af, and also performed some experiments >> [0]. After testing some implementations, clients, programming >> methodologies, etc. It seems that I've found the winner: >> geventhttpclient [1]. >> >> With my tests with different methods I was only able to achieve >> ~650 req/s , but according to geventhttpclient's home page it can >> achieve ~4000 req/s (when tested in my environment it was around ~3500 >> req/s). This is VERY impressive. >> >> There are some bad things about this library, like the C code used >> for parsing the HTTP response which could bring some issues to Windows >> users; and its dependency on gevent which adds one more dependency to >> w3af; but with such a huge perf enhancement... I don't care ;) > > geventhttpclient hasn't package even in Debian/Ubuntu :( Yep, it's a very new library, only released a couple of months ago, > Only gevent bindings for Python: > > $ aptitude search gevent > p python-gevent With that + geventhttpclient's code (which can be used without the HTTP response parser and thus making it a pure-python library) we should be ok. I'll finish the error handling stuff and then I'm starting with some experiments with this library to see what we can get. > >> >> Has someone researched on the topic of fast HTTP clients? Opinions? >> Ideas? >> >> [0] >> http://sourceforge.net/apps/trac/w3af/browser/extras/measure_http?rev=5041 >> [1] https://github.com/gwik/geventhttpclient >> >> Regards, > > > > -- > Taras > http://oxdef.info -- Andrés Riancho Project Leader at w3af - http://w3af.org/ Web Application Attack and Audit Framework Twitter: @w3af GPG: 0x93C344F3 ------------------------------------------------------------------------------ Live Security Virtual Conference Exclusive live event will cover all the ways today's security and threat landscape has changed and how IT managers can respond. Discussions will include endpoint security, mobile security and the latest in malware threats. http://www.accelacomm.com/jaw/sfrnl04242012/114/50122263/ _______________________________________________ W3af-develop mailing list W3af-develop@lists.sourceforge.net https://lists.sourceforge.net/lists/listinfo/w3af-develop
