Re: [openstack-dev] [openstack-operators][tc][tags] Rally tags

2015-09-22 Thread Roman Vasilets
As for me two ideal candidates for tags are "works-in-rally" and
"covered-by-rally". Other sound ugly. But this two are meaningful and
ingenious names.


On Mon, Sep 21, 2015 at 11:13 PM, Boris Pavlovic  wrote:

> Thierry,
>
> Okay great I will propose patches.
>
> Best regards,
> Boris Pavlovic
>
> On Mon, Sep 21, 2015 at 1:14 AM, Thierry Carrez 
> wrote:
>
>> Boris Pavlovic wrote:
>> > I have few ideas about the rally tags:
>> >
>> > - covered-by-rally
>> >It means that there are official (inside the rally repo) plugins for
>> > testing of particular project
>> >
>> > - has-rally-gates
>> >It means that Rally is run against every patch proposed to the
>> project
>> >
>> > - certified-by-rally [wip]
>> >As well we are starting working on certification
>> > task: https://review.openstack.org/#/c/225176/5
>> >which will be the standard way to check whatever cloud is ready for
>> > production based on volume, performance & scale testing.
>> >
>> > Thoughts?
>>
>> Hi Boris,
>>
>> The "next-tags" workgroup at the Technical Committee came up with a
>> number of families where I think your proposed tags could fit:
>>
>> http://lists.openstack.org/pipermail/openstack-dev/2015-July/070651.html
>>
>> The "integration" family of tags defines cross-project support. We want
>> to have tags that say that a specific service has a horizon dashboard
>> plugin, or a devstack integration, or heat templates... So I would say
>> that the "covered-by-rally" tag could be part of that family
>> ('integration:rally' maybe ?). We haven't defined our first tag in that
>> family yet: sdague was working on the devstack ones[1] as a template for
>> the family but that effort stalled a bit:
>>
>> https://review.openstack.org/#/c/203785/
>>
>> As far as the 'has-rally-gates' tag goes, that would be part of the 'QA'
>> family ("qa:has-rally-gates" for example).
>>
>> So I think those totally make sense as upstream-maintained tags and are
>> perfectly aligned with the families we already had in mind but haven't
>> had time to push yet. Feel free to propose those tags to the governance
>> repository. An example of such submission lives at:
>>
>> https://review.openstack.org/#/c/207467/
>>
>> The 'certified-by-rally' tag is a bit farther away I think (less
>> objective and needs your certification program to be set up first). You
>> should start with the other two.
>>
>> --
>> Thierry Carrez (ttx)
>>
>> __
>> OpenStack Development Mailing List (not for usage questions)
>> Unsubscribe:
>> openstack-dev-requ...@lists.openstack.org?subject:unsubscribe
>> http://lists.openstack.org/cgi-bin/mailman/listinfo/openstack-dev
>>
>
>
> __
> OpenStack Development Mailing List (not for usage questions)
> Unsubscribe: openstack-dev-requ...@lists.openstack.org?subject:unsubscribe
> http://lists.openstack.org/cgi-bin/mailman/listinfo/openstack-dev
>
>
__
OpenStack Development Mailing List (not for usage questions)
Unsubscribe: openstack-dev-requ...@lists.openstack.org?subject:unsubscribe
http://lists.openstack.org/cgi-bin/mailman/listinfo/openstack-dev


Re: [openstack-dev] [openstack-operators][tc][tags] Rally tags

2015-09-21 Thread Boris Pavlovic
Thierry,

Okay great I will propose patches.

Best regards,
Boris Pavlovic

On Mon, Sep 21, 2015 at 1:14 AM, Thierry Carrez 
wrote:

> Boris Pavlovic wrote:
> > I have few ideas about the rally tags:
> >
> > - covered-by-rally
> >It means that there are official (inside the rally repo) plugins for
> > testing of particular project
> >
> > - has-rally-gates
> >It means that Rally is run against every patch proposed to the project
> >
> > - certified-by-rally [wip]
> >As well we are starting working on certification
> > task: https://review.openstack.org/#/c/225176/5
> >which will be the standard way to check whatever cloud is ready for
> > production based on volume, performance & scale testing.
> >
> > Thoughts?
>
> Hi Boris,
>
> The "next-tags" workgroup at the Technical Committee came up with a
> number of families where I think your proposed tags could fit:
>
> http://lists.openstack.org/pipermail/openstack-dev/2015-July/070651.html
>
> The "integration" family of tags defines cross-project support. We want
> to have tags that say that a specific service has a horizon dashboard
> plugin, or a devstack integration, or heat templates... So I would say
> that the "covered-by-rally" tag could be part of that family
> ('integration:rally' maybe ?). We haven't defined our first tag in that
> family yet: sdague was working on the devstack ones[1] as a template for
> the family but that effort stalled a bit:
>
> https://review.openstack.org/#/c/203785/
>
> As far as the 'has-rally-gates' tag goes, that would be part of the 'QA'
> family ("qa:has-rally-gates" for example).
>
> So I think those totally make sense as upstream-maintained tags and are
> perfectly aligned with the families we already had in mind but haven't
> had time to push yet. Feel free to propose those tags to the governance
> repository. An example of such submission lives at:
>
> https://review.openstack.org/#/c/207467/
>
> The 'certified-by-rally' tag is a bit farther away I think (less
> objective and needs your certification program to be set up first). You
> should start with the other two.
>
> --
> Thierry Carrez (ttx)
>
> __
> OpenStack Development Mailing List (not for usage questions)
> Unsubscribe: openstack-dev-requ...@lists.openstack.org?subject:unsubscribe
> http://lists.openstack.org/cgi-bin/mailman/listinfo/openstack-dev
>
__
OpenStack Development Mailing List (not for usage questions)
Unsubscribe: openstack-dev-requ...@lists.openstack.org?subject:unsubscribe
http://lists.openstack.org/cgi-bin/mailman/listinfo/openstack-dev


Re: [openstack-dev] [openstack-operators][tc][tags] Rally tags

2015-09-21 Thread Thierry Carrez
Boris Pavlovic wrote:
> I have few ideas about the rally tags: 
> 
> - covered-by-rally
>It means that there are official (inside the rally repo) plugins for
> testing of particular project
> 
> - has-rally-gates
>It means that Rally is run against every patch proposed to the project 
> 
> - certified-by-rally [wip]
>As well we are starting working on certification
> task: https://review.openstack.org/#/c/225176/5
>which will be the standard way to check whatever cloud is ready for
> production based on volume, performance & scale testing. 
> 
> Thoughts? 

Hi Boris,

The "next-tags" workgroup at the Technical Committee came up with a
number of families where I think your proposed tags could fit:

http://lists.openstack.org/pipermail/openstack-dev/2015-July/070651.html

The "integration" family of tags defines cross-project support. We want
to have tags that say that a specific service has a horizon dashboard
plugin, or a devstack integration, or heat templates... So I would say
that the "covered-by-rally" tag could be part of that family
('integration:rally' maybe ?). We haven't defined our first tag in that
family yet: sdague was working on the devstack ones[1] as a template for
the family but that effort stalled a bit:

https://review.openstack.org/#/c/203785/

As far as the 'has-rally-gates' tag goes, that would be part of the 'QA'
family ("qa:has-rally-gates" for example).

So I think those totally make sense as upstream-maintained tags and are
perfectly aligned with the families we already had in mind but haven't
had time to push yet. Feel free to propose those tags to the governance
repository. An example of such submission lives at:

https://review.openstack.org/#/c/207467/

The 'certified-by-rally' tag is a bit farther away I think (less
objective and needs your certification program to be set up first). You
should start with the other two.

-- 
Thierry Carrez (ttx)

__
OpenStack Development Mailing List (not for usage questions)
Unsubscribe: openstack-dev-requ...@lists.openstack.org?subject:unsubscribe
http://lists.openstack.org/cgi-bin/mailman/listinfo/openstack-dev


[openstack-dev] [openstack-operators][tc][tags] Rally tags

2015-09-20 Thread Boris Pavlovic
Hi stackers,

Rally project is becoming more and more used by Operators to check that
live OpenStack clouds perform well and that they are ready for production.

Results of PAO OPS meeting showed that there are interest in Rally related
tags for projects:
http://www.gossamer-threads.com/lists/openstack/operators/49466

3) "works in rally" - new tag suggestion
> There was general interest in asking the Rally team to consider making a
> "works in rally" tag, since the rally tests were deemed 'good'.


I have few ideas about the rally tags:

- covered-by-rally
   It means that there are official (inside the rally repo) plugins for
testing of particular project

- has-rally-gates
   It means that Rally is run against every patch proposed to the project

- certified-by-rally [wip]
   As well we are starting working on certification task:
https://review.openstack.org/#/c/225176/5
   which will be the standard way to check whatever cloud is ready for
production based on volume, performance & scale testing.


Thoughts?


Best regards,
Boris Pavlovic
__
OpenStack Development Mailing List (not for usage questions)
Unsubscribe: openstack-dev-requ...@lists.openstack.org?subject:unsubscribe
http://lists.openstack.org/cgi-bin/mailman/listinfo/openstack-dev