Re: [RFC] Gather JMH performance metrics in Beam community-metrics

2022-07-12 Thread Luke Cwik via dev
This sounds great. Since every language has a benchmarking tool, we can start with JMH and expand from there. A key point is that we will want to dedicate a Jenkins machine exclusively to this when the microbenchmarks are running, otherwise we will have other competing Jenkins jobs using up CPU

Re: [RFC] Gather JMH performance metrics in Beam community-metrics

2022-07-12 Thread Moritz Mack
Sorry Robert, I should have mentioned … that’s the Java Microbenchmark Harness. So this is all about the Java SDK. Currently there’s benchmarks for the fn-harness and some benchmarks for core are in progress. Cheers On 12.07.22, 17:50, "Robert Burke" wrote: I'm all for additional performance

Re: [RFC] Gather JMH performance metrics in Beam community-metrics

2022-07-12 Thread Robert Burke
I'm all for additional performance benchmarks! But what does JMH stand for? On Tue, Jul 12, 2022, 7:54 AM Moritz Mack wrote: > Hi all, > > > > This is a very short proposal to start running JMH benchmarks periodically > and store benchmark results so we can start monitoring performance trends

[RFC] Gather JMH performance metrics in Beam community-metrics

2022-07-12 Thread Moritz Mack
Hi all, This is a very short proposal to start running JMH benchmarks periodically and store benchmark results so we can start monitoring performance trends on the community metrics dashboards over time. Comments most welcome! https://s.apache.org/nvi9g Best regards, Moritz As a recipient

Re: Beam Community Metrics

2019-02-19 Thread Mikhail Gryzykhin
and I need to sign in? > > I think I see what's going on. When I hit > https://s.apache.org/beam-community-metrics-infra I see a list of > "Recently viewed dashboards" which you won't have on first pageview. > > To see the available dashboards and navigate to them, find the drop

Re: Beam Community Metrics

2019-02-19 Thread Scott Wegner
> Also blank for me. Maybe Kenn and I need to sign in? I think I see what's going on. When I hit https://s.apache.org/beam-community-metrics-infra I see a list of "Recently viewed dashboards" which you won't have on first pageview. To see the available dashboards and navigate

Re: Beam Community Metrics

2019-02-19 Thread Brian Hulette
> I previously wrote a page for the wiki: > https://cwiki.apache.org/confluence/display/BEAM/Community+Metrics . I > chose the wiki over website because Community Metrics is Beam > contributor-focused (as opposed to for Beam users), and not tied to a > release. If it would fit bett

Re: Beam Community Metrics

2019-02-19 Thread Scott Wegner
> I think it would be good to have a build infra section under https://beam.apache.org/contribute/ that contains the dashboard link and other related information. I previously wrote a page for the wiki: https://cwiki.apache.org/confluence/display/BEAM/Community+Metrics . I chose the wiki o

Re: Beam Community Metrics

2019-02-16 Thread Kenneth Knowles
done this summer by Mikhail, >> > Udi, and Huygaa to visualize and track some project/community health >> > metrics for Beam. Specifically, they've helped to build dashboards for: >> > * Test suite health (pre-commit speed, post-commit reliability) >> > * Pull

Re: Beam Community Metrics

2019-02-16 Thread Thomas Weise
> > * Pull Request health (code review latency, PR load per reviewer) > > > > Check it out here: https://s.apache.org/beam-community-metrics, and > > please leave feedback on this thread or under our umbrella JIRA item: > > BEAM-5862. > > > > There's some

Re: Beam Community Metrics

2018-10-29 Thread Maximilian Michels
latency, PR load per reviewer) Check it out here: https://s.apache.org/beam-community-metrics, and please leave feedback on this thread or under our umbrella JIRA item: BEAM-5862. There's some new infrastructure behind this which is hosted alongside our Jenkins resources on Google Cloud. I want

Beam Community Metrics

2018-10-25 Thread Scott Wegner
(code review latency, PR load per reviewer) Check it out here: https://s.apache.org/beam-community-metrics, and please leave feedback on this thread or under our umbrella JIRA item: BEAM-5862. There's some new infrastructure behind this which is hosted alongside our Jenkins resources on Google