Just a quick note from someone that tried (and failed) to get acceptable performance numbers from Elixir.
You should check into wrk2 instead of wrk1 for your testing. The reason being that wrk1 has a "coordinated omission" problem whereby the tool and the service accidently conspire to produce nicer numbers! Wrk2 will send traffic at a steady rate instead of "when it can", which often results in drastically different numbers. I was seeing latency in the seconds at the 99th percentile with wrk2 and a quick test with just plug. When we tested our own scala based service internally we went from seeing 100ms at 100% to 9 minutes with wrk2, so it was quite an eye opener! On Fri, Jun 10, 2016 at 1:20 AM, Matt Hornsby <[email protected]> wrote: > Hi all - I could use some help. I am currently evaluating Elixir and > Phoenix for a performance-critical application for a Fortune 500 company. > This could be another great case study for Elixir and Phoenix if I can show > that it can meet our needs. Initial performance testing looked phenomenal, > but I am running into some performance concerns that will force me to > abandon this tech stack entirely if I cannot make the case. > > The setup: an out-of-the box phoenix app using mix phoenix.new. No ecto. > Returning a static json response. Basically a hello-world app. > The hardware > > - Macbook Pro, 16gb, 8 core, 2.5ghz, running elixir/phoenix natively, > and also using docker container > - Amazon EC2 T2.Medium running Elixir Docker image > > The tests: used ab, wrk, siege, artillery, curl with a variety of > configurations. Up to 100 concurrent connections. Not super scientific, i > know... but > > No matter what I try, Phoenix logs out impressive numbers to stdout - > generally on the order of 150-300 microseconds. However, none of the load > testing tooling agrees. No matter the hardware or load test configuration, > I see around 20-40 ms response times. The goal for the services that I am > designing is 20ms and several thousand requests per second. The load tests > that Chris McCord and others have published suggest that I should be able > to expect 3ms or less when running localhost, but i'm not seeing anything > close to that. > > Would anyone be willing to work with me to look at some options here? I'd > be incredibly grateful. Don't make me go back to Java, please :) > > -- > You received this message because you are subscribed to the Google Groups > "elixir-lang-talk" group. > To unsubscribe from this group and stop receiving emails from it, send an > email to [email protected]. > To view this discussion on the web visit > https://groups.google.com/d/msgid/elixir-lang-talk/6a625e85-8c8d-43c7-9c1b-a204db09307a%40googlegroups.com > <https://groups.google.com/d/msgid/elixir-lang-talk/6a625e85-8c8d-43c7-9c1b-a204db09307a%40googlegroups.com?utm_medium=email&utm_source=footer> > . > For more options, visit https://groups.google.com/d/optout. > -- You received this message because you are subscribed to the Google Groups "elixir-lang-talk" group. To unsubscribe from this group and stop receiving emails from it, send an email to [email protected]. To view this discussion on the web visit https://groups.google.com/d/msgid/elixir-lang-talk/CAPfZVDbjSw3kSkkrE4pScWFdTp8wbA6wx_68e5oehGQZLeKsVA%40mail.gmail.com. For more options, visit https://groups.google.com/d/optout.
