That was ab. The output below is from the logger. I ran it again and created a gist of the bench output for:
ab -n 1000 -c 100 http://127.0.0.1:4001/api/test/ https://gist.github.com/dgoldie/015d2e4a7735126edb81ef3029a9eaa0 I forget how to read this.... On Thursday, June 9, 2016 at 11:32:07 PM UTC-7, Matt Hornsby wrote: > > Thanks Doug - what do your numbers look like when you hit it with > something like ab or wrk for the load testing? Phoenix outputs some amazing > numbers to the console, like you listed before, but when I try to actually > hit the api with one of the aforementioned tools, or simply through chrome > - it still comes back in 8-40 milliseconds. > > Appreciate your quick reply, and your help. > > > On Thursday, June 9, 2016 at 11:18:11 PM UTC-7, Doug Goldie wrote: >> >> I was thinking the same thing. >> >> So I took a hello_phoenix app I have laying around and compiled it for >> production. >> >> before the api call took 26ms. >> after >> >> 23:10:19.497 request_id=me5p9o26becunto6chjloa7oghiq7ek5 [info] GET >> /api/test/ >> >> 23:10:19.497 request_id=me5p9o26becunto6chjloa7oghiq7ek5 [info] Sent 200 >> in 46µs >> >> 23:10:19.497 request_id=c6qs9s938de0eku6jb8hcpvak1cal9fn [info] GET >> /api/test/ >> >> 23:10:19.497 request_id=c6qs9s938de0eku6jb8hcpvak1cal9fn [info] Sent 200 >> in 63µs >> >> 23:10:19.497 request_id=avqgtd3tgo6q9bs6prm3jmud8cojic6o [info] GET >> /api/test/ >> >> 23:10:19.497 request_id=n67rqmpkc5kfjgb28ocqhs0e4odfrj7b [info] GET >> /api/test/ >> >> 23:10:19.497 request_id=avqgtd3tgo6q9bs6prm3jmud8cojic6o [info] Sent 200 >> in 48µs >> >> 23:10:19.497 request_id=n67rqmpkc5kfjgb28ocqhs0e4odfrj7b [info] Sent 200 >> in 74µs >> >> >> >> and...on my Mac >> >> I didn't shut anything down :) >> >> >> Good Luck, >> >> >> -doug. >> >> On Thursday, June 9, 2016 at 11:13:45 PM UTC-7, Louis Pilfold wrote: >>> >>> Hello! >>> >>> Perhaps a silly question, but are you running the application in the >>> production environment when performance testing it? >>> >>> Cheers, >>> Louis >>> On 10 Jun 2016 06:20, "Matt Hornsby" <[email protected]> wrote: >>> >>>> Hi all - I could use some help. I am currently evaluating Elixir and >>>> Phoenix for a performance-critical application for a Fortune 500 company. >>>> This could be another great case study for Elixir and Phoenix if I can >>>> show >>>> that it can meet our needs. Initial performance testing looked phenomenal, >>>> but I am running into some performance concerns that will force me to >>>> abandon this tech stack entirely if I cannot make the case. >>>> >>>> The setup: an out-of-the box phoenix app using mix phoenix.new. No >>>> ecto. Returning a static json response. Basically a hello-world app. >>>> The hardware >>>> >>>> - Macbook Pro, 16gb, 8 core, 2.5ghz, running elixir/phoenix >>>> natively, and also using docker container >>>> - Amazon EC2 T2.Medium running Elixir Docker image >>>> >>>> The tests: used ab, wrk, siege, artillery, curl with a variety of >>>> configurations. Up to 100 concurrent connections. Not super scientific, i >>>> know... but >>>> >>>> No matter what I try, Phoenix logs out impressive numbers to stdout - >>>> generally on the order of 150-300 microseconds. However, none of the load >>>> testing tooling agrees. No matter the hardware or load test configuration, >>>> I see around 20-40 ms response times. The goal for the services that I am >>>> designing is 20ms and several thousand requests per second. The load tests >>>> that Chris McCord and others have published suggest that I should be able >>>> to expect 3ms or less when running localhost, but i'm not seeing anything >>>> close to that. >>>> >>>> Would anyone be willing to work with me to look at some options here? >>>> I'd be incredibly grateful. Don't make me go back to Java, please :) >>>> >>>> -- >>>> You received this message because you are subscribed to the Google >>>> Groups "elixir-lang-talk" group. >>>> To unsubscribe from this group and stop receiving emails from it, send >>>> an email to [email protected]. >>>> To view this discussion on the web visit >>>> https://groups.google.com/d/msgid/elixir-lang-talk/6a625e85-8c8d-43c7-9c1b-a204db09307a%40googlegroups.com >>>> >>>> <https://groups.google.com/d/msgid/elixir-lang-talk/6a625e85-8c8d-43c7-9c1b-a204db09307a%40googlegroups.com?utm_medium=email&utm_source=footer> >>>> . >>>> For more options, visit https://groups.google.com/d/optout. >>>> >>> -- You received this message because you are subscribed to the Google Groups "elixir-lang-talk" group. To unsubscribe from this group and stop receiving emails from it, send an email to [email protected]. To view this discussion on the web visit https://groups.google.com/d/msgid/elixir-lang-talk/60fb2700-d695-4af6-8c84-697b0f41acea%40googlegroups.com. For more options, visit https://groups.google.com/d/optout.
