Thank you Etienne! This looks great. I hope we can get other languages to have benchmarks at this level soon enough.
Ahmet On Thu, Jul 12, 2018 at 1:45 PM, Ismaël Mejía <ieme...@gmail.com> wrote: > That’s great to see in action, great work Etienne! > > Is there any document on how to integrate ‘stuff’ into the dashboards? > I think this is worth having for people willing to do so like Kai or > Andrew. Are there any docs on this? or maybe Lukasz Gajowy know ? > On Thu, Jul 12, 2018 at 9:04 PM Andrew Pilloud <apill...@google.com> > wrote: > > > > This is great, should make performance work much easier! I'm going to > get the Beam SQL Nexmark jobs publishing as well. (Opened > https://issues.apache.org/jira/browse/BEAM-4774 to track.) I might take > on the Dataflow runner as well if no one else volunteers. > > > > I am curious as to why you have two separate graphs for runtime and > count rather then graphing runtime/count to get the throughput rate for > each run? Or should that be a third graph? Looks like it would just be a > small tweak to the query in perfkit. > > > > Andrew > > > > On Thu, Jul 12, 2018 at 11:40 AM Pablo Estrada <pabl...@google.com> > wrote: > >> > >> This is really cool Etienne : ) thanks for working on this. > >> Our of curiosity, do you know how often the tests run on each runner? > >> > >> Best > >> -P. > >> > >> On Thu, Jul 12, 2018 at 2:15 AM Romain Manni-Bucau < > rmannibu...@gmail.com> wrote: > >>> > >>> Awesome Etienne, this is really important for the (user) community to > have that visibility since it is one of the most important aspect of the > Beam's quality, kudo! > >>> > >>> > >>> Romain Manni-Bucau > >>> @rmannibucau | Blog | Old Blog | Github | LinkedIn | Book > >>> > >>> > >>> Le jeu. 12 juil. 2018 à 10:59, Jean-Baptiste Onofré <j...@nanthrax.net> > a écrit : > >>>> > >>>> It's really great to have these dashboards and integration in Jenkins > ! > >>>> > >>>> Thanks Etienne for driving this ! > >>>> > >>>> Regards > >>>> JB > >>>> > >>>> On 11/07/2018 15:13, Etienne Chauchot wrote: > >>>> > > >>>> > Hi guys, > >>>> > > >>>> > I'm glad to announce that the CI of Beam has much improved ! Indeed > >>>> > Nexmark is now included in the perfkit dashboards. > >>>> > > >>>> > At each commit on master, nexmark suites are run and plots are > created > >>>> > on the graphs. > >>>> > > >>>> > I've created 2 kind of dashboards: > >>>> > - one for performances (run times of the queries) > >>>> > - one for the size of the output PCollection (which should be > constant) > >>>> > > >>>> > There are dashboards for these runners: > >>>> > - spark > >>>> > - flink > >>>> > - direct runner > >>>> > > >>>> > Each dashboard contains: > >>>> > - graphs in batch mode > >>>> > - graphs in streaming mode > >>>> > - graphs for the 13 queries. > >>>> > > >>>> > That gives more than a hundred of graphs (my right finger hurts > after so > >>>> > many clics on the mouse :) ). It is detailed that much so that > anyone > >>>> > can focus on the area they have interest in. > >>>> > Feel free to also create new dashboards with more aggregated data. > >>>> > > >>>> > Thanks to Lukasz and Cham for reviewing my PRs and showing how to > use > >>>> > perfkit dashboards. > >>>> > > >>>> > Dashboards are there: > >>>> > > >>>> > https://apache-beam-testing.appspot.com/explore?dashboard= > 5084698770407424 > >>>> > https://apache-beam-testing.appspot.com/explore?dashboard= > 5699257587728384 > >>>> > <https://apache-beam-testing.appspot.com/explore?dashboard= > 5138380291571712>https://apache-beam-testing.appspot. > com/explore?dashboard=5138380291571712 > >>>> > > >>>> > https://apache-beam-testing.appspot.com/explore?dashboard= > 5099379773931520 > >>>> > https://apache-beam-testing.appspot.com/explore?dashboard= > 5731568492478464 > >>>> > https://apache-beam-testing.appspot.com/explore?dashboard= > 5163657986048000 > >>>> > > >>>> > > >>>> > Enjoy, > >>>> > > >>>> > Etienne > >>>> > > >>>> > > >>>> > >>>> -- > >>>> Jean-Baptiste Onofré > >>>> jbono...@apache.org > >>>> http://blog.nanthrax.net > >>>> Talend - http://www.talend.com > >> > >> -- > >> Got feedback? go/pabloem-feedback >
