RE: BVT Results Google Page -
You are right Remi, it is kind of an env issue because the runs pick up servers at random. I will see to minimize that variability to get consistent results. Let's see, -Original Message- From: Remi Bergsma [mailto:rberg...@schubergphilis.com] Sent: Thursday, January 14, 2016 4:09 PM To: dev@cloudstack.apache.org Subject: Re: BVT Results Google Page - Hi Raja, Jan 12/13/14 should be the same as there were no commits to master after the 11th of January. I have seen this before, some tests fail without a change. When you run them again, they might succeed. Investigating the actual errors/exceptions might show what’s going on. Regards, Remi On 14/01/16 11:17, "Daan Hoogland" wrote: >I like this initial shot at it Raja. As an added request, I would like >to see some logic in the colors. Now it seems 90% is a threshold and >this obscures that the coverage went down from monday to tuesday on >xenserver basiczone. Also Xenserver with advanced zonegrew to the >highest coverage level on wednesday but that is not visible either. >Actually I think only 100% should be green. What do you think? > >On Thu, Jan 14, 2016 at 11:03 AM, Sebastien Goasguen >wrote: > >> >> > On Jan 14, 2016, at 10:49 AM, Raja Pullela >> > >> wrote: >> > >> > Please take a look - ACS Master BVT Dashboard - >> https://docs.google.com/spreadsheets/d/17i_Bd78SrKoLnu0cFpwXbC0R-YKBT >> qs9sOw15hQLP3o/pubhtml >> > >> >> > I am still trying to find a way to upload the test results related >> > to >> these runs. >> > >> >> 1-There is a python module called gspread that makes it easy to >> upload to a spreadsheet like this. just write a bit of code. >> >> 2-Personnaly I would flip the rows and columns, so that you can just >> append a new date as a row. >> >> 3-seems you are linking to citrite network which clearly will be >> unreachable to everyone. >> >> 4-the % is nice, but we need the actual results to see what the >> #$%$#^ happened in the test. >> >> > Best, >> > Raja >> > >> >> > > >-- >Daan
Re: BVT Results Google Page -
Hi Raja, Jan 12/13/14 should be the same as there were no commits to master after the 11th of January. I have seen this before, some tests fail without a change. When you run them again, they might succeed. Investigating the actual errors/exceptions might show what’s going on. Regards, Remi On 14/01/16 11:17, "Daan Hoogland" wrote: >I like this initial shot at it Raja. As an added request, I would like to >see some logic in the colors. Now it seems 90% is a threshold and this >obscures that the coverage went down from monday to tuesday on xenserver >basiczone. Also Xenserver with advanced zonegrew to the highest coverage >level on wednesday but that is not visible either. Actually I think only >100% should be green. What do you think? > >On Thu, Jan 14, 2016 at 11:03 AM, Sebastien Goasguen >wrote: > >> >> > On Jan 14, 2016, at 10:49 AM, Raja Pullela >> wrote: >> > >> > Please take a look - ACS Master BVT Dashboard - >> https://docs.google.com/spreadsheets/d/17i_Bd78SrKoLnu0cFpwXbC0R-YKBTqs9sOw15hQLP3o/pubhtml >> > >> >> > I am still trying to find a way to upload the test results related to >> these runs. >> > >> >> 1-There is a python module called gspread that makes it easy to upload to >> a spreadsheet like this. just write a bit of code. >> >> 2-Personnaly I would flip the rows and columns, so that you can just >> append a new date as a row. >> >> 3-seems you are linking to citrite network which clearly will be >> unreachable to everyone. >> >> 4-the % is nice, but we need the actual results to see what the #$%$#^ >> happened in the test. >> >> > Best, >> > Raja >> > >> >> > > >-- >Daan
Re: BVT Results Google Page -
no presure Raja. I just think it might be somewhat leading to color on a threshold other then 100%. On Thu, Jan 14, 2016 at 11:25 AM, Raja Pullela wrote: > @seb - yes, will try to update this and will also remove the links. > > @daan - colors - 90+ above is green etc - occasionally couple of tests > keeps failing and will pass in the next run - this is partly attributes to > the test env I am using as well. The other orange color is because I have > some pending work to be done to integrate few tests that got added. I > agree we should make 100% as green. > > Will need to little time close on this - please bear with me while this > get this streamlined! > > Cheers, > Raja > -Original Message- > From: Daan Hoogland [mailto:daan.hoogl...@gmail.com] > Sent: Thursday, January 14, 2016 3:48 PM > To: dev > Subject: Re: BVT Results Google Page - > > I like this initial shot at it Raja. As an added request, I would like to > see some logic in the colors. Now it seems 90% is a threshold and this > obscures that the coverage went down from monday to tuesday on xenserver > basiczone. Also Xenserver with advanced zonegrew to the highest coverage > level on wednesday but that is not visible either. Actually I think only > 100% should be green. What do you think? > > On Thu, Jan 14, 2016 at 11:03 AM, Sebastien Goasguen > wrote: > > > > > > On Jan 14, 2016, at 10:49 AM, Raja Pullela > > wrote: > > > > > > Please take a look - ACS Master BVT Dashboard - > > https://docs.google.com/spreadsheets/d/17i_Bd78SrKoLnu0cFpwXbC0R-YKBTq > > s9sOw15hQLP3o/pubhtml > > > > > > > > I am still trying to find a way to upload the test results related > > > to > > these runs. > > > > > > > 1-There is a python module called gspread that makes it easy to upload > > to a spreadsheet like this. just write a bit of code. > > > > 2-Personnaly I would flip the rows and columns, so that you can just > > append a new date as a row. > > > > 3-seems you are linking to citrite network which clearly will be > > unreachable to everyone. > > > > 4-the % is nice, but we need the actual results to see what the #$%$#^ > > happened in the test. > > > > > Best, > > > Raja > > > > > > > > > > -- > Daan > -- Daan
RE: BVT Results Google Page -
@seb - yes, will try to update this and will also remove the links. @daan - colors - 90+ above is green etc - occasionally couple of tests keeps failing and will pass in the next run - this is partly attributes to the test env I am using as well. The other orange color is because I have some pending work to be done to integrate few tests that got added. I agree we should make 100% as green. Will need to little time close on this - please bear with me while this get this streamlined! Cheers, Raja -Original Message- From: Daan Hoogland [mailto:daan.hoogl...@gmail.com] Sent: Thursday, January 14, 2016 3:48 PM To: dev Subject: Re: BVT Results Google Page - I like this initial shot at it Raja. As an added request, I would like to see some logic in the colors. Now it seems 90% is a threshold and this obscures that the coverage went down from monday to tuesday on xenserver basiczone. Also Xenserver with advanced zonegrew to the highest coverage level on wednesday but that is not visible either. Actually I think only 100% should be green. What do you think? On Thu, Jan 14, 2016 at 11:03 AM, Sebastien Goasguen wrote: > > > On Jan 14, 2016, at 10:49 AM, Raja Pullela > wrote: > > > > Please take a look - ACS Master BVT Dashboard - > https://docs.google.com/spreadsheets/d/17i_Bd78SrKoLnu0cFpwXbC0R-YKBTq > s9sOw15hQLP3o/pubhtml > > > > > I am still trying to find a way to upload the test results related > > to > these runs. > > > > 1-There is a python module called gspread that makes it easy to upload > to a spreadsheet like this. just write a bit of code. > > 2-Personnaly I would flip the rows and columns, so that you can just > append a new date as a row. > > 3-seems you are linking to citrite network which clearly will be > unreachable to everyone. > > 4-the % is nice, but we need the actual results to see what the #$%$#^ > happened in the test. > > > Best, > > Raja > > > > -- Daan
Re: BVT Results Google Page -
I like this initial shot at it Raja. As an added request, I would like to see some logic in the colors. Now it seems 90% is a threshold and this obscures that the coverage went down from monday to tuesday on xenserver basiczone. Also Xenserver with advanced zonegrew to the highest coverage level on wednesday but that is not visible either. Actually I think only 100% should be green. What do you think? On Thu, Jan 14, 2016 at 11:03 AM, Sebastien Goasguen wrote: > > > On Jan 14, 2016, at 10:49 AM, Raja Pullela > wrote: > > > > Please take a look - ACS Master BVT Dashboard - > https://docs.google.com/spreadsheets/d/17i_Bd78SrKoLnu0cFpwXbC0R-YKBTqs9sOw15hQLP3o/pubhtml > > > > > I am still trying to find a way to upload the test results related to > these runs. > > > > 1-There is a python module called gspread that makes it easy to upload to > a spreadsheet like this. just write a bit of code. > > 2-Personnaly I would flip the rows and columns, so that you can just > append a new date as a row. > > 3-seems you are linking to citrite network which clearly will be > unreachable to everyone. > > 4-the % is nice, but we need the actual results to see what the #$%$#^ > happened in the test. > > > Best, > > Raja > > > > -- Daan
Re: BVT Results Google Page -
> On Jan 14, 2016, at 10:49 AM, Raja Pullela wrote: > > Please take a look - ACS Master BVT Dashboard - > https://docs.google.com/spreadsheets/d/17i_Bd78SrKoLnu0cFpwXbC0R-YKBTqs9sOw15hQLP3o/pubhtml > > I am still trying to find a way to upload the test results related to these > runs. > 1-There is a python module called gspread that makes it easy to upload to a spreadsheet like this. just write a bit of code. 2-Personnaly I would flip the rows and columns, so that you can just append a new date as a row. 3-seems you are linking to citrite network which clearly will be unreachable to everyone. 4-the % is nice, but we need the actual results to see what the #$%$#^ happened in the test. > Best, > Raja >
