Re: Performance Benchmarking Beam

2016-12-12 Thread Stephen Sisk
Thanks for your work on this Jason! Perfkit looks like a great option. I'm excited to see performance testing for Beam coming together. Since one of the benefits of using perfkit is that it can spin up data stores for IO testing in various environment, we should look into whether we can re-use tha

Re: Performance Benchmarking Beam

2016-12-10 Thread Jean-Baptiste Onofré
Cool ! Please use the mailing list and Jira to sync effort. Thanks, Regards JB On 12/10/2016 05:00 PM, Otávio Carvalho wrote: Awesome, Jason! I am also interested in contribute to this effort by building/porting streaming microbenchmarks to Beam. I will make contact in the following weeks.

Re: Performance Benchmarking Beam

2016-12-10 Thread Otávio Carvalho
Awesome, Jason! I am also interested in contribute to this effort by building/porting streaming microbenchmarks to Beam. I will make contact in the following weeks. Regards, Otavio. 2016-12-09 15:11 GMT-02:00 Jean-Baptiste Onofré : > Happy to help too ;) > > @Jason, as discussed together, I wi

Re: Performance Benchmarking Beam

2016-12-09 Thread Jean-Baptiste Onofré
Happy to help too ;) @Jason, as discussed together, I will send my config (Marathon JSON, Dockerfile, ...), I'm so sorry to be late on this. Regards JB On 12/09/2016 05:59 PM, Amit Sela wrote: This is great Jason! Let me know if / how I can assist with Spark, or generally. Thanks, Amit On

Re: Performance Benchmarking Beam

2016-12-09 Thread Amit Sela
This is great Jason! Let me know if / how I can assist with Spark, or generally. Thanks, Amit On Thu, Dec 8, 2016 at 9:01 PM Jason Kuster wrote: > Hey all, > > So as I mentioned on Stephen's IO Testing thread a few days ago I've been > doing a bunch of investigating into performance testing fr

Performance Benchmarking Beam

2016-12-08 Thread Jason Kuster
Hey all, So as I mentioned on Stephen's IO Testing thread a few days ago I've been doing a bunch of investigating into performance testing frameworks. I've put all my thoughts into a doc here and I'd love to hear thoughts about my investigation and what I'm proposing going forward. https://docs.g