Re: [DISCUSSION] Tracking & Visualizing various metrics of the Beam community

[Mikhail Gryzykhin]

Hi,

The UI looks cool and powerful. I'm not sure about using the devstats
service, since it only has github statistics as I can understand. I would
prefer to have single entry point for all of our dashboards: build stats,
eng metrics, tests, project health metrics, etc.

However, devstats uses grafana underneath. If we can utilize grafana for UI
and host all of our dashboards there, it would be great. If we can extend
devstats to show our project-specific metrics as well, that would be good.
If not, we can look into hosting grafana or utilizing their cloud solution
if they provide support for opensource.

Alternatively, we can look into utilizing Kibana, but I'm not clear if it
is best option for visualizing metrics. Grafana seem to be more oriented
towards our usecase.

--Mikhail

Have feedback ?


On Tue, Aug 7, 2018 at 1:00 PM Huygaa Batsaikhan  wrote:

> Thanks Udi, I am working on spinning up a test instance.
>
> On Tue, Aug 7, 2018 at 11:31 AM Udi Meiri  wrote:
>
>> These tables look very cool!
>>
>> I certainly don't object to using tools made by another organization. The
>> only issue might be compatibility with our process.
>>
>> From my understanding of the Kubernetes review process, they use Github's
>> tagging feature to specify PR statuses such as LGTM and approval.
>> Random example: https://github.com/kubernetes/kubernetes/pull/67089
>> I'm not sure that statistics such as pr-time-to-approve-and-merge would
>> be captured at all on apache/beam since we don't use these tags.
>>
>> I would definitely like to see how useful this tool is regardless, and
>> since it doesn't seem to require any special permissions it should be
>> simple to set up a test instance.
>>
>>
>> On Tue, Aug 7, 2018 at 11:24 AM Huygaa Batsaikhan 
>> wrote:
>>
>>> tl;dr - is there any objections to trying out DevStats tool created by
>>> CNCF?
>>>
>>> On Mon, Aug 6, 2018 at 3:43 PM Huygaa Batsaikhan 
>>> wrote:
>>>
 Continuing the discussion
 
 about improving Beam code review, I am looking into visualizing various
 helpful Beam community metrics such as code velocity, reviewer load, and
 new contributor's engagement.

 So far, I found DevStats
 , an
 open source (github ) dashboarding
 tool used by Kubernetes, seems to provide almost everything we need. For
 example, they have dashboards for metrics such as:

-

Time to approve or merge

-

PR Time to engagement

-

New and Episodic PR contributors

 
-

PR reviews by contributor

-

Company statistics

 It would be really cool if we can try it out for Beam. I don't have
 much experience using open source projects. From what I understand:
 DevStats is developed by CNCF  and they manage
 their incubator projects' dashboard. Since Beam is not part of the CNCF, in
 order to use DevStats, we have to fork the project and maintain it
 ourselves.

 1. What do you think about using DevStats for Beam? Do you know how it
 is usually done?
 2. If you are not sure about DevStats, do you know any other tool which
 could help us track & visualize Beam metrics?

 Thanks, Huygaa

>>>

Re: [DISCUSSION] Tracking & Visualizing various metrics of the Beam community

[Huygaa Batsaikhan]

Thanks Udi, I am working on spinning up a test instance.

On Tue, Aug 7, 2018 at 11:31 AM Udi Meiri  wrote:

> These tables look very cool!
>
> I certainly don't object to using tools made by another organization. The
> only issue might be compatibility with our process.
>
> From my understanding of the Kubernetes review process, they use Github's
> tagging feature to specify PR statuses such as LGTM and approval.
> Random example: https://github.com/kubernetes/kubernetes/pull/67089
> I'm not sure that statistics such as pr-time-to-approve-and-merge would be
> captured at all on apache/beam since we don't use these tags.
>
> I would definitely like to see how useful this tool is regardless, and
> since it doesn't seem to require any special permissions it should be
> simple to set up a test instance.
>
>
> On Tue, Aug 7, 2018 at 11:24 AM Huygaa Batsaikhan 
> wrote:
>
>> tl;dr - is there any objections to trying out DevStats tool created by
>> CNCF?
>>
>> On Mon, Aug 6, 2018 at 3:43 PM Huygaa Batsaikhan 
>> wrote:
>>
>>> Continuing the discussion
>>> 
>>> about improving Beam code review, I am looking into visualizing various
>>> helpful Beam community metrics such as code velocity, reviewer load, and
>>> new contributor's engagement.
>>>
>>> So far, I found DevStats
>>> , an
>>> open source (github ) dashboarding
>>> tool used by Kubernetes, seems to provide almost everything we need. For
>>> example, they have dashboards for metrics such as:
>>>
>>>-
>>>
>>>Time to approve or merge
>>>
>>>-
>>>
>>>PR Time to engagement
>>>
>>>-
>>>
>>>New and Episodic PR contributors
>>>
>>> 
>>>-
>>>
>>>PR reviews by contributor
>>>
>>>-
>>>
>>>Company statistics
>>>
>>> It would be really cool if we can try it out for Beam. I don't have
>>> much experience using open source projects. From what I understand:
>>> DevStats is developed by CNCF  and they manage
>>> their incubator projects' dashboard. Since Beam is not part of the CNCF, in
>>> order to use DevStats, we have to fork the project and maintain it
>>> ourselves.
>>>
>>> 1. What do you think about using DevStats for Beam? Do you know how it
>>> is usually done?
>>> 2. If you are not sure about DevStats, do you know any other tool which
>>> could help us track & visualize Beam metrics?
>>>
>>> Thanks, Huygaa
>>>
>>

Re: [DISCUSSION] Tracking & Visualizing various metrics of the Beam community

[Udi Meiri]

These tables look very cool!

I certainly don't object to using tools made by another organization. The
only issue might be compatibility with our process.

>From my understanding of the Kubernetes review process, they use Github's
tagging feature to specify PR statuses such as LGTM and approval.
Random example: https://github.com/kubernetes/kubernetes/pull/67089
I'm not sure that statistics such as pr-time-to-approve-and-merge would be
captured at all on apache/beam since we don't use these tags.

I would definitely like to see how useful this tool is regardless, and
since it doesn't seem to require any special permissions it should be
simple to set up a test instance.


On Tue, Aug 7, 2018 at 11:24 AM Huygaa Batsaikhan  wrote:

> tl;dr - is there any objections to trying out DevStats tool created by
> CNCF?
>
> On Mon, Aug 6, 2018 at 3:43 PM Huygaa Batsaikhan 
> wrote:
>
>> Continuing the discussion
>> 
>> about improving Beam code review, I am looking into visualizing various
>> helpful Beam community metrics such as code velocity, reviewer load, and
>> new contributor's engagement.
>>
>> So far, I found DevStats
>> , an
>> open source (github ) dashboarding
>> tool used by Kubernetes, seems to provide almost everything we need. For
>> example, they have dashboards for metrics such as:
>>
>>-
>>
>>Time to approve or merge
>>
>>-
>>
>>PR Time to engagement
>>
>>-
>>
>>New and Episodic PR contributors
>>
>> 
>>-
>>
>>PR reviews by contributor
>>
>>-
>>
>>Company statistics
>>
>> It would be really cool if we can try it out for Beam. I don't have much
>> experience using open source projects. From what I understand: DevStats is
>> developed by CNCF  and they manage their incubator
>> projects' dashboard. Since Beam is not part of the CNCF, in order to use
>> DevStats, we have to fork the project and maintain it ourselves.
>>
>> 1. What do you think about using DevStats for Beam? Do you know how it is
>> usually done?
>> 2. If you are not sure about DevStats, do you know any other tool which
>> could help us track & visualize Beam metrics?
>>
>> Thanks, Huygaa
>>
>


smime.p7s
Description: S/MIME Cryptographic Signature

Re: [DISCUSSION] Tracking & Visualizing various metrics of the Beam community

[Huygaa Batsaikhan]

tl;dr - is there any objections to trying out DevStats tool created by CNCF?

On Mon, Aug 6, 2018 at 3:43 PM Huygaa Batsaikhan  wrote:

> Continuing the discussion
> 
> about improving Beam code review, I am looking into visualizing various
> helpful Beam community metrics such as code velocity, reviewer load, and
> new contributor's engagement.
>
> So far, I found DevStats
> , an
> open source (github ) dashboarding
> tool used by Kubernetes, seems to provide almost everything we need. For
> example, they have dashboards for metrics such as:
>
>-
>
>Time to approve or merge
>
>-
>
>PR Time to engagement
>
>-
>
>New and Episodic PR contributors
>
> 
>-
>
>PR reviews by contributor
>
>-
>
>Company statistics
>
> It would be really cool if we can try it out for Beam. I don't have much
> experience using open source projects. From what I understand: DevStats is
> developed by CNCF  and they manage their incubator
> projects' dashboard. Since Beam is not part of the CNCF, in order to use
> DevStats, we have to fork the project and maintain it ourselves.
>
> 1. What do you think about using DevStats for Beam? Do you know how it is
> usually done?
> 2. If you are not sure about DevStats, do you know any other tool which
> could help us track & visualize Beam metrics?
>
> Thanks, Huygaa
>