Re: [openstack-dev] [oslo][pbr] getting 0.11 out the door. Maybe even 1.0

2015-04-20 Thread Thomas Goirand



On 04/20/2015 12:10 PM, Victor Stinner wrote:

If there's nothing majorly wrong mid-L, I'd like to release 1.0.0 just
to get us into 'ok its stable' mentality.


I read that many packages modify the source code of libraries and
applications to avoid a dependency to pbr at runtime. What's the
status of this issue? Is pbr still used/required to get the version
of a package a runtime?


Yes, a lot. And even worse: in many cases, pbr isn't even declared in 
the requirements.txt, and I had to double check for the facts myself.



I'm not sure that it's an issue in pbr itself. Maybe applications
should be fixed instead.


The issue is that nobody used oslo.version, and it vanished. Anyway, pbr 
is actually very small, so I don't think it's an issue.


On 04/20/2015 02:22 PM, Victor Stinner wrote:
 I read somewhere that pkg_resources may also be used to get the
 version.

That's correct, and I don't understand why we're not using that.

On 04/20/2015 09:25 PM, Robert Collins wrote:
 Firstly, pbr has no runtime dep on pip - it doesn't import it. So you
 don't need pip installed when an installed package uses pbr to get its
 version.

Why does requirements.txt of PBR has pip then?

Cheers,

Thomas Goirand (zigo)

__
OpenStack Development Mailing List (not for usage questions)
Unsubscribe: openstack-dev-requ...@lists.openstack.org?subject:unsubscribe
http://lists.openstack.org/cgi-bin/mailman/listinfo/openstack-dev


Re: [openstack-dev] [oslo][pbr] getting 0.11 out the door. Maybe even 1.0

2015-04-20 Thread Robert Collins
On 21 April 2015 at 09:27, Thomas Goirand z...@debian.org wrote:


 On 04/20/2015 12:10 PM, Victor Stinner wrote:

 If there's nothing majorly wrong mid-L, I'd like to release 1.0.0 just
 to get us into 'ok its stable' mentality.


 I read that many packages modify the source code of libraries and
 applications to avoid a dependency to pbr at runtime. What's the
 status of this issue? Is pbr still used/required to get the version
 of a package a runtime?


 Yes, a lot. And even worse: in many cases, pbr isn't even declared in the
 requirements.txt, and I had to double check for the facts myself.

 I'm not sure that it's an issue in pbr itself. Maybe applications
 should be fixed instead.


 The issue is that nobody used oslo.version, and it vanished. Anyway, pbr is
 actually very small, so I don't think it's an issue.

 On 04/20/2015 02:22 PM, Victor Stinner wrote:
 I read somewhere that pkg_resources may also be used to get the
 version.

 That's correct, and I don't understand why we're not using that.

 On 04/20/2015 09:25 PM, Robert Collins wrote:
 Firstly, pbr has no runtime dep on pip - it doesn't import it. So you
 don't need pip installed when an installed package uses pbr to get its
 version.

 Why does requirements.txt of PBR has pip then?

Because if you do 'python setup.py install' in a pbr repo it will
*run* pip today to install requirements.
But this doesn't apply to packagers, because they will be using the overrides.
The packaging of pbr on a distro that doesn't package pip should just
ignore that requirement today.

In future - 0.12 probably - we'll remove that entry from
requirements.txt, but we need to get a release of master done first.
-Rob

-- 
Robert Collins rbtcoll...@hp.com
Distinguished Technologist
HP Converged Cloud

__
OpenStack Development Mailing List (not for usage questions)
Unsubscribe: openstack-dev-requ...@lists.openstack.org?subject:unsubscribe
http://lists.openstack.org/cgi-bin/mailman/listinfo/openstack-dev


Re: [openstack-dev] [Zaqar] Call for adoption (or exclusion?)

2015-04-20 Thread Angus Salkeld
On Tue, Apr 21, 2015 at 8:38 AM, Fox, Kevin M kevin@pnnl.gov wrote:

  As an Op, a few things that come to mind in that category are:
  * RDO packaging (stated earlier). If its not easy to install, its not
 going to be deployed as much. I haven't installed it yet, because I haven't
 had time to do much other then yum install it...
  * Horizon UI
  * Heat Resources. (Some basic stuff like create/delete queue to go along
 with the stack. also link #1 below)


Here you go:
https://github.com/openstack/heat/tree/master/contrib/heat_zaqar



 Horizon has a discovery aspect to it. If users don't know a service is
 available, its hard for them to use it. Even with the most simple UI of
 Create/Delete/List queues, discovery is handled. The user knows it exists,
 and can look for documentation on how to make it work, can ask an admin how
 to use it, or start poking at the cli for advanced features.

 Thanks,
 Kevin

 1. https://blueprints.launchpad.net/heat/+spec/software-config-zaqar
  --
 *From:* Vipul Sabhaya [vip...@gmail.com]
 *Sent:* Monday, April 20, 2015 1:39 PM
 *To:* OpenStack Development Mailing List (not for usage questions)

 *Subject:* Re: [openstack-dev] [Zaqar] Call for adoption (or exclusion?)



 On Mon, Apr 20, 2015 at 12:07 PM, Fox, Kevin M kevin@pnnl.gov wrote:

 Another parallel is Manilla vs Swift. Both provides something like a
 share for users to store files.

 The former is a multitenant api to provision non multitenant file shares.
 The latter is a multitenant api to provide file sharing.

 Cue is a multitenant api to provision non multitenant queues.
 Zaqar is an api for a multitenant queueing system.

 They are complimentary services.


  Agreed, it’s not an either/or, there is room for both.  While Cue could
 provision Zaqar, it doesn’t make sense, since it is already multi-tenant.
 As has been said, Cue’s goal is to bring non-multi-tenant message brokers
 to the cloud.

  On the question of adoption, what confuses me is why the measurement of
 success of a project is whether other OpenStack services are integrating or
 not.  Zaqar exposes an API that seems best fit for application workloads
 running on an OpenStack cloud.  The question should be raised to operators
 as to what’s preventing them from running Zaqar in their public cloud,
 distro, or whatever.

  Looking at other services that we consider to be successful, such as
 Trove, we did not attempt to integrate with other OpenStack projects.
 Rather, we solved the concerns that operators had.



 Thanks,
 Kevin
 
 From: Ryan Brown [rybr...@redhat.com]
 Sent: Monday, April 20, 2015 11:38 AM
 To: openstack-dev@lists.openstack.org
 Subject: Re: [openstack-dev] [Zaqar] Call for adoption (or exclusion?)

 On 04/20/2015 02:22 PM, Michael Krotscheck wrote:
  What's the difference between openstack/zaqar and stackforge/cue?
  Looking at the projects, it seems like zaqar is a ground-up
  implementation of a queueing system, while cue is a provisioning api for
  queuing systems that could include zaqar, but could also include rabbit,
  zmq, etc...
 
  If my understanding of the projects is correct, the latter is far more
  versatile, and more in line with similar openstack approaches like
  trove. Is there a use case nuance I'm not aware of that warrants
  duplicating efforts? Because if not, one of the two should be retired
  and development focused on the other.
 
  Note: I do not have a horse in this race. I just feel it's strange that
  we're building a thing that can be provisioned by the other thing.
 

 Well, with Trove you can provision databases, but the MagnetoDB project
 still provides functionality that trove won't.


 The Trove : MagnetoDB and Cue : Zaqar comparison fits well.

 Trove provisions one instance of X (some database) per tenant, where
 MagnetoDB is one instance (collection of hosts to do database things)
 that serves many tenants.

 Cue's goal is I have a not-very-multitenant message bus (rabbit, or
 whatever) and makes that multitenant by provisioning one per tenant,
 while Zaqar has a single install (of as many machines as needed) to
 support messaging for all cloud tenants. This enables great stuff like
 cross-tenant messaging, better physical resource utilization in
 sparse-tenant cases, etc.

 As someone who wants to adopt Zaqar, I'd really like to see it continue
 as a project because it provides things other message broker approaches
 don't.

 --
 Ryan Brown / Software Engineer, Openstack / Red Hat, Inc.

 __
 OpenStack Development Mailing List (not for usage questions)
 Unsubscribe:
 openstack-dev-requ...@lists.openstack.org?subject:unsubscribe
 http://lists.openstack.org/cgi-bin/mailman/listinfo/openstack-dev

 __
 OpenStack Development Mailing List (not for usage questions)
 Unsubscribe:

Re: [openstack-dev] [Zaqar] Call for adoption (or exclusion?)

2015-04-20 Thread Fei Long Wang
Thanks Kevin, all good suggestions. Re Horizon UI, yes, we even have a
blueprint to track that, but seems the owner didn't complete it. FWIW, I
would suggest to put it on the todo list of L.

[1] https://blueprints.launchpad.net/zaqar/+spec/marconi-horizon-integration

On 21/04/15 10:38, Fox, Kevin M wrote:
 As an Op, a few things that come to mind in that category are:
  * RDO packaging (stated earlier). If its not easy to install, its not
 going to be deployed as much. I haven't installed it yet, because I
 haven't had time to do much other then yum install it...
  * Horizon UI
  * Heat Resources. (Some basic stuff like create/delete queue to go
 along with the stack. also link #1 below)

 Horizon has a discovery aspect to it. If users don't know a service is
 available, its hard for them to use it. Even with the most simple UI
 of Create/Delete/List queues, discovery is handled. The user knows it
 exists, and can look for documentation on how to make it work, can ask
 an admin how to use it, or start poking at the cli for advanced features.

 Thanks,
 Kevin

 1. https://blueprints.launchpad.net/heat/+spec/software-config-zaqar
 
 *From:* Vipul Sabhaya [vip...@gmail.com]
 *Sent:* Monday, April 20, 2015 1:39 PM
 *To:* OpenStack Development Mailing List (not for usage questions)
 *Subject:* Re: [openstack-dev] [Zaqar] Call for adoption (or exclusion?)



 On Mon, Apr 20, 2015 at 12:07 PM, Fox, Kevin M kevin@pnnl.gov
 mailto:kevin@pnnl.gov wrote:

 Another parallel is Manilla vs Swift. Both provides something like
 a share for users to store files.

 The former is a multitenant api to provision non multitenant file
 shares.
 The latter is a multitenant api to provide file sharing.

 Cue is a multitenant api to provision non multitenant queues.
 Zaqar is an api for a multitenant queueing system.

 They are complimentary services.


 Agreed, it’s not an either/or, there is room for both.  While Cue
 could provision Zaqar, it doesn’t make sense, since it is already
 multi-tenant.  As has been said, Cue’s goal is to bring
 non-multi-tenant message brokers to the cloud.

 On the question of adoption, what confuses me is why the measurement
 of success of a project is whether other OpenStack services are
 integrating or not.  Zaqar exposes an API that seems best fit for
 application workloads running on an OpenStack cloud.  The question
 should be raised to operators as to what’s preventing them from
 running Zaqar in their public cloud, distro, or whatever.

 Looking at other services that we consider to be successful, such as
 Trove, we did not attempt to integrate with other OpenStack projects. 
 Rather, we solved the concerns that operators had.

  

 Thanks,
 Kevin
 
 From: Ryan Brown [rybr...@redhat.com mailto:rybr...@redhat.com]
 Sent: Monday, April 20, 2015 11:38 AM
 To: openstack-dev@lists.openstack.org
 mailto:openstack-dev@lists.openstack.org
 Subject: Re: [openstack-dev] [Zaqar] Call for adoption (or exclusion?)

 On 04/20/2015 02:22 PM, Michael Krotscheck wrote:
  What's the difference between openstack/zaqar and stackforge/cue?
  Looking at the projects, it seems like zaqar is a ground-up
  implementation of a queueing system, while cue is a provisioning
 api for
  queuing systems that could include zaqar, but could also include
 rabbit,
  zmq, etc...
 
  If my understanding of the projects is correct, the latter is
 far more
  versatile, and more in line with similar openstack approaches like
  trove. Is there a use case nuance I'm not aware of that warrants
  duplicating efforts? Because if not, one of the two should be
 retired
  and development focused on the other.
 
  Note: I do not have a horse in this race. I just feel it's
 strange that
  we're building a thing that can be provisioned by the other thing.
 

 Well, with Trove you can provision databases, but the MagnetoDB
 project
 still provides functionality that trove won't.


 The Trove : MagnetoDB and Cue : Zaqar comparison fits well.

 Trove provisions one instance of X (some database) per tenant, where
 MagnetoDB is one instance (collection of hosts to do database
 things)
 that serves many tenants.

 Cue's goal is I have a not-very-multitenant message bus (rabbit, or
 whatever) and makes that multitenant by provisioning one per tenant,
 while Zaqar has a single install (of as many machines as needed) to
 support messaging for all cloud tenants. This enables great stuff like
 cross-tenant messaging, better physical resource utilization in
 sparse-tenant cases, etc.

 As someone who wants to adopt Zaqar, I'd really like to see it
 continue
 as a project because it provides things other message broker
 

Re: [openstack-dev] [all][code quality] Voting coverage job (-1 if coverage get worse after patch)

2015-04-20 Thread Ian Wells
On 20 April 2015 at 07:40, Boris Pavlovic bo...@pavlovic.me wrote:

 Dan,

 IMHO, most of the test coverage we have for nova's neutronapi is more
 than useless. It's so synthetic that it provides no regression
 protection, and often requires significantly more work than the change
 that is actually being added. It's a huge maintenance burden with very
 little value, IMHO. Good tests for that code would be very valuable of
 course, but what is there now is not.
 I think there are cases where going from 90 to 91% mean adding a ton of
 extra spaghetti just to satisfy a bot, which actually adds nothing but
 bloat to maintain.


 Let's not mix the bad unit tests in Nova with the fact that code should be
 fully covered by well written unit tests.
 This big task can be split into 2 smaller tasks:
 1) Bot that will check that we are covering new code by tests and don't
 introduce regressions


http://en.wikipedia.org/wiki/Code_coverage

You appear to be talking about statement coverage, which is one of the
weaker coverage metrics.

if a:
thing

gets 100% statement coverage if a is true, so I don't need to test when a
is false (which would be at a minimum decision coverage).

I wonder if the focus is wrong.  Maybe helping devs is better than making
more gate jobs, for starters; and maybe overall coverage is not a great
metric when you're changing 100 lines in 100,000.  If you were thinking
instead to provide coverage *tools* that were easy for developers to use,
that would be a different question.  As a dev, I would not be terribly
interested in finding that I've improved overall test coverage from 90.1%
to 90.2%, but I might be *very* interested to know that I got 100% decision
(or even boolean) coverage on the specific lines of the feature I just
added by running just the unit tests that exercise it.
-- 
Ian.
__
OpenStack Development Mailing List (not for usage questions)
Unsubscribe: openstack-dev-requ...@lists.openstack.org?subject:unsubscribe
http://lists.openstack.org/cgi-bin/mailman/listinfo/openstack-dev


[openstack-dev] [puppet] bug triage day

2015-04-20 Thread Emilien Macchi
Hi,

We have around 142 bugs without fix for now in our modules [1].
Some folks in our group raised an idea where we could do a bug triage
day sometimes.

I've created an etherpad so we can have a list of people interested to
participate [2] in this work.

Feel free to bring your name, and we will come up with details tomorrow
during our weekly meeting.

Thanks,

[1] http://goo.gl/Xnw0Cg
[2] https://etherpad.openstack.org/p/puppet-bug-triage
-- 
Emilien Macchi



signature.asc
Description: OpenPGP digital signature
__
OpenStack Development Mailing List (not for usage questions)
Unsubscribe: openstack-dev-requ...@lists.openstack.org?subject:unsubscribe
http://lists.openstack.org/cgi-bin/mailman/listinfo/openstack-dev


Re: [openstack-dev] [Zaqar] Call for adoption (or exclusion?)

2015-04-20 Thread Steve Baker

On 21/04/15 11:01, Angus Salkeld wrote:



On Tue, Apr 21, 2015 at 8:38 AM, Fox, Kevin M kevin@pnnl.gov 
mailto:kevin@pnnl.gov wrote:


As an Op, a few things that come to mind in that category are:
 * RDO packaging (stated earlier). If its not easy to install, its
not going to be deployed as much. I haven't installed it yet,
because I haven't had time to do much other then yum install it...
 * Horizon UI
 * Heat Resources. (Some basic stuff like create/delete queue to
go along with the stack. also link #1 below)


Here you go:
https://github.com/openstack/heat/tree/master/contrib/heat_zaqar
One thing we need to do in Vancouver is come up with criteria for moving 
resources from contrib into the main tree. Previously this was whether 
the project was integrated. As a starter I would suggest something like:

1. project is in the openstack git namespace
2. the client library is synced with global-requirements.txt
3. the resources are complete enough to be useful in template authoring

We need to think about potential for integration testing in the gate too.


Horizon has a discovery aspect to it. If users don't know a
service is available, its hard for them to use it. Even with the
most simple UI of Create/Delete/List queues, discovery is handled.
The user knows it exists, and can look for documentation on how to
make it work, can ask an admin how to use it, or start poking at
the cli for advanced features.

Thanks,
Kevin

1. https://blueprints.launchpad.net/heat/+spec/software-config-zaqar

*From:* Vipul Sabhaya [vip...@gmail.com mailto:vip...@gmail.com]
*Sent:* Monday, April 20, 2015 1:39 PM
*To:* OpenStack Development Mailing List (not for usage questions)

*Subject:* Re: [openstack-dev] [Zaqar] Call for adoption (or
exclusion?)



On Mon, Apr 20, 2015 at 12:07 PM, Fox, Kevin M kevin@pnnl.gov
mailto:kevin@pnnl.gov wrote:

Another parallel is Manilla vs Swift. Both provides something
like a share for users to store files.

The former is a multitenant api to provision non multitenant
file shares.
The latter is a multitenant api to provide file sharing.

Cue is a multitenant api to provision non multitenant queues.
Zaqar is an api for a multitenant queueing system.

They are complimentary services.


Agreed, it’s not an either/or, there is room for both.  While Cue
could provision Zaqar, it doesn’t make sense, since it is already
multi-tenant.  As has been said, Cue’s goal is to bring
non-multi-tenant message brokers to the cloud.

On the question of adoption, what confuses me is why the
measurement of success of a project is whether other OpenStack
services are integrating or not.  Zaqar exposes an API that seems
best fit for application workloads running on an OpenStack cloud. 
The question should be raised to operators as to what’s preventing

them from running Zaqar in their public cloud, distro, or whatever.

Looking at other services that we consider to be successful, such
as Trove, we did not attempt to integrate with other OpenStack
projects. Rather, we solved the concerns that operators had.

Thanks,
Kevin

From: Ryan Brown [rybr...@redhat.com mailto:rybr...@redhat.com]
Sent: Monday, April 20, 2015 11:38 AM
To: openstack-dev@lists.openstack.org
mailto:openstack-dev@lists.openstack.org
Subject: Re: [openstack-dev] [Zaqar] Call for adoption (or
exclusion?)

On 04/20/2015 02:22 PM, Michael Krotscheck wrote:
 What's the difference between openstack/zaqar and
stackforge/cue?
 Looking at the projects, it seems like zaqar is a ground-up
 implementation of a queueing system, while cue is a
provisioning api for
 queuing systems that could include zaqar, but could also
include rabbit,
 zmq, etc...

 If my understanding of the projects is correct, the latter
is far more
 versatile, and more in line with similar openstack
approaches like
 trove. Is there a use case nuance I'm not aware of that warrants
 duplicating efforts? Because if not, one of the two should
be retired
 and development focused on the other.

 Note: I do not have a horse in this race. I just feel it's
strange that
 we're building a thing that can be provisioned by the other
thing.


Well, with Trove you can provision databases, but the
MagnetoDB project
still provides functionality that trove won't.


The Trove : MagnetoDB and Cue : Zaqar comparison fits well.

Trove provisions one instance of X (some 

Re: [openstack-dev] [api] Minor changes to API

2015-04-20 Thread Ian Wells
On 20 April 2015 at 13:02, Kevin L. Mitchell kevin.mitch...@rackspace.com
wrote:

 On Mon, 2015-04-20 at 13:57 -0600, Chris Friesen wrote:
   However, minor changes like that could still possibly break clients
 that are not
   expecting them.  For example, a client that uses the json response as
 arguments
   to a method via **kwargs would start seeing TypeErrors for unexpected
 arguments.
 
  Isn't this what microversions were intended to solve?

 Yes.

  I'm relatively recent with OpenStack, so I don't have the history.  Did
 anyone
  ever consider explicitly allowing new attributes to be added to
 responses?

 The problem is advertising that this information is available.


There are some cases where that's not necessary: a call returns a JSON
dict.  If, when the dict does not contain the key, some backward compatible
behaviour is assumed, then you are in fact 100% backward compatible.

There are other more ambiguous cases, such as setting an attribute that
doesn't exist in some cases and getting a failure response; there it's nice
to be able to tell in advance via a detection call what to expect.

Anyway, I've been bitten by not knowing the unwritten rules so I do agree
we could use a policy.

That's
 why, in the past, nova required a new extension even if all you were
 doing was adding an attribute, and that's why we want a new microversion
 nowadays.


Depends on your  project.  For Neutron:

- some IPv6 changes introduced new (settable) subnet attributes without a
bump in version; these were merged in and are now released in Juno
- the recent VLAN and MTU changes introduced new network attributes without
a bump in version; these were certainly argued about as a break with
backward compatibility (and eventually became extensions, though for other
reasons than simply that one)
- extensions in Neutron can be used to add attributes without changing the
core interface; extension detection APIs exist to make planning easier

It would be nice to have a consistent policy here; it would make future
decision making easier and it would make it easier to write specs if we
knew what was expected and the possible implementations weren't up for
(quite so much) debate.  For different reasons, Neutron extensions are also
not favoured, so there's no clear cut choice to make.
-- 
Ian.
__
OpenStack Development Mailing List (not for usage questions)
Unsubscribe: openstack-dev-requ...@lists.openstack.org?subject:unsubscribe
http://lists.openstack.org/cgi-bin/mailman/listinfo/openstack-dev


Re: [openstack-dev] [api] Minor changes to API

2015-04-20 Thread Matthew Treinish
On Mon, Apr 20, 2015 at 03:10:40PM -0700, Ian Wells wrote:
 On 20 April 2015 at 13:02, Kevin L. Mitchell kevin.mitch...@rackspace.com
 wrote:
 
  On Mon, 2015-04-20 at 13:57 -0600, Chris Friesen wrote:
However, minor changes like that could still possibly break clients
  that are not
expecting them.  For example, a client that uses the json response as
  arguments
to a method via **kwargs would start seeing TypeErrors for unexpected
  arguments.
  
   Isn't this what microversions were intended to solve?
 
  Yes.
 
   I'm relatively recent with OpenStack, so I don't have the history.  Did
  anyone
   ever consider explicitly allowing new attributes to be added to
  responses?
 
  The problem is advertising that this information is available.
 
 
 There are some cases where that's not necessary: a call returns a JSON
 dict.  If, when the dict does not contain the key, some backward compatible
 behaviour is assumed, then you are in fact 100% backward compatible.
 
 There are other more ambiguous cases, such as setting an attribute that
 doesn't exist in some cases and getting a failure response; there it's nice
 to be able to tell in advance via a detection call what to expect.
 
 Anyway, I've been bitten by not knowing the unwritten rules so I do agree
 we could use a policy.
 
 That's
  why, in the past, nova required a new extension even if all you were
  doing was adding an attribute, and that's why we want a new microversion
  nowadays.
 
 
 Depends on your  project.  For Neutron:
 
 - some IPv6 changes introduced new (settable) subnet attributes without a
 bump in version; these were merged in and are now released in Juno
 - the recent VLAN and MTU changes introduced new network attributes without
 a bump in version; these were certainly argued about as a break with
 backward compatibility (and eventually became extensions, though for other
 reasons than simply that one)
 - extensions in Neutron can be used to add attributes without changing the
 core interface; extension detection APIs exist to make planning easier
 
 It would be nice to have a consistent policy here; it would make future
 decision making easier and it would make it easier to write specs if we
 knew what was expected and the possible implementations weren't up for
 (quite so much) debate.  For different reasons, Neutron extensions are also
 not favoured, so there's no clear cut choice to make.

Uhm, there is: https://wiki.openstack.org/wiki/APIChangeGuidelines
and if you read that adding attrs without advertising it (using an
extension, microversion, or whatever) is not an allowed change. Just adding
things without a new extension or microversion makes the end user story terrible
because it puts the burden completely on the user to try and figure out which 
version 2 (or whatever it currently is marked as) of the api the cloud they're
using speaks. Think about it if it were a library, that just started adding
things to it's interfaces without bumping any version. Even if it was a
backwards compatible addition you would still expect the version to increment to
indicate that the new stuff was there and available for use.


-Matt Treinish


pgpgK3_wSwOQj.pgp
Description: PGP signature
__
OpenStack Development Mailing List (not for usage questions)
Unsubscribe: openstack-dev-requ...@lists.openstack.org?subject:unsubscribe
http://lists.openstack.org/cgi-bin/mailman/listinfo/openstack-dev


Re: [openstack-dev] [all][code quality] Voting coverage job (-1 if coverage get worse after patch)

2015-04-20 Thread Joshua Harlow
It'd be nice to having something like https://coveralls.io/features 
which afaik just reports back on pull requests (and doesn't try to 
enforce much of anything, aka non-voting).


For example: https://github.com/aliles/funcsigs/pull/13

In general it'd be neat if we could more easily interconnect into these 
kind of github.com interconnects (for lack of better words) somehow, but 
I'm not sure if any such interconnect exists (something that translates 
gerrit reviews into a format these systems can understand and post back 
to?).


Ian Wells wrote:

On 20 April 2015 at 07:40, Boris Pavlovic bo...@pavlovic.me
mailto:bo...@pavlovic.me wrote:

Dan,

IMHO, most of the test coverage we have for nova's neutronapi is
more
than useless. It's so synthetic that it provides no regression
protection, and often requires significantly more work than the
change
that is actually being added. It's a huge maintenance burden
with very
little value, IMHO. Good tests for that code would be very
valuable of
course, but what is there now is not.
I think there are cases where going from 90 to 91% mean adding a
ton of
extra spaghetti just to satisfy a bot, which actually adds
nothing but
bloat to maintain.


Let's not mix the bad unit tests in Nova with the fact that code
should be fully covered by well written unit tests.
This big task can be split into 2 smaller tasks:
1) Bot that will check that we are covering new code by tests and
don't introduce regressions


http://en.wikipedia.org/wiki/Code_coverage

You appear to be talking about statement coverage, which is one of the
weaker coverage metrics.

 if a:
 thing

gets 100% statement coverage if a is true, so I don't need to test when
a is false (which would be at a minimum decision coverage).

I wonder if the focus is wrong.  Maybe helping devs is better than
making more gate jobs, for starters; and maybe overall coverage is not a
great metric when you're changing 100 lines in 100,000.  If you were
thinking instead to provide coverage *tools* that were easy for
developers to use, that would be a different question.  As a dev, I
would not be terribly interested in finding that I've improved overall
test coverage from 90.1% to 90.2%, but I might be *very* interested to
know that I got 100% decision (or even boolean) coverage on the specific
lines of the feature I just added by running just the unit tests that
exercise it.
--
Ian.


__
OpenStack Development Mailing List (not for usage questions)
Unsubscribe: openstack-dev-requ...@lists.openstack.org?subject:unsubscribe
http://lists.openstack.org/cgi-bin/mailman/listinfo/openstack-dev


__
OpenStack Development Mailing List (not for usage questions)
Unsubscribe: openstack-dev-requ...@lists.openstack.org?subject:unsubscribe
http://lists.openstack.org/cgi-bin/mailman/listinfo/openstack-dev


[openstack-dev] MySQL charset collation for `db sync` commands

2015-04-20 Thread Emilien Macchi
Hi,

I notified Glance (and probably other projects) are running the db_sync
with 'utf8_general_ci' by default.

* Can we change it? I've looked in Glance  oslo.db, I've not seen anything.
* Can we configure it to stop enforcing this collation? Some deployments
are running 'utf8_unicode_ci'
* why 'utf8_general_ci' ? I've seen it's less accurate at sorting, but
faster.

Please tell me if I'm wrong and if we can already change it somewhere in
configuration.

If you are interested by my exact context, it affects our Puppet
modules: https://bugs.launchpad.net/puppet-glance/+bug/1446375

Thank you,
-- 
Emilien Macchi



signature.asc
Description: OpenPGP digital signature
__
OpenStack Development Mailing List (not for usage questions)
Unsubscribe: openstack-dev-requ...@lists.openstack.org?subject:unsubscribe
http://lists.openstack.org/cgi-bin/mailman/listinfo/openstack-dev


[openstack-dev] [tripleo] Adventures in QuintupleO

2015-04-20 Thread Steve Baker
I've been spending some time getting quintupleo working on top of a Juno 
RDO OpenStack. I'm at a point now where I think it is worth putting 
effort into making it easy for anyone to try this.


Ben Nemec has done the hard work of proving this is possible[1] 
resulting in the repo he uses to bring up an environment which behaves 
like a baremetal env[2]


I'd like to build on this to create a new upstream repo aimed at setting 
up an environment which is ready for undercloud and overcloud installation.


For rdo-management, using it would be documented in its own section of 
the Setup chapter[3]


Ben's heat templates bring up BMC and baremetal nodes. I've been 
extending those to also define the undercloud network and a bare 
undercloud node ready for undercloud installation (or optionally an 
image-based undercloud).  Another future enhancement could be to figure 
out how to use only a single nova server serve all of the BMC requests 
(possibly with one server having a neutron port per baremetal it is 
managing)


This will still require patching the nethercloud until we can find a way 
of upstreaming those changes. The repo can at least be where those 
patches live for now.


So my questions for now would be:

What should the repo be called? quintuplo-setup?

Where should it live? git openstack in the openstack namespace? github 
rdo-management?


[1] http://blog.nemebean.com/tags/quintupleo
[2] https://github.com/cybertron/tripleo-scripts
[3] 
https://repos.fedorapeople.org/repos/openstack-m/instack-undercloud/html/setup.html



__
OpenStack Development Mailing List (not for usage questions)
Unsubscribe: openstack-dev-requ...@lists.openstack.org?subject:unsubscribe
http://lists.openstack.org/cgi-bin/mailman/listinfo/openstack-dev


[openstack-dev] PyCon-AU Openstack miniconf CFP open

2015-04-20 Thread Robert Collins
Hi everybody - I'd like to call attention to the PyCon-AU OpenStack miniconf.

http://2015.pycon-au.org/cfp

Pycon-au is an excellent conference, and the OpenStack miniconf is now
in its third year - we're really getting into the swing of things.

Please submit a paper to the main conference CFP - we'll be pulling
from the that to select talks.

Brisbane is a beautiful city, the venue is great - and so is the weather.

If you've any questions about whether to submit or not, please ping me
or Joshua Hesketh - we're organising the miniconf together and can
provide guidance.

Cheers,
Rob

-- 
Robert Collins rbtcoll...@hp.com
Distinguished Technologist
HP Converged Cloud

__
OpenStack Development Mailing List (not for usage questions)
Unsubscribe: openstack-dev-requ...@lists.openstack.org?subject:unsubscribe
http://lists.openstack.org/cgi-bin/mailman/listinfo/openstack-dev


Re: [openstack-dev] [all][code quality] Voting coverage job (-1 if coverage get worse after patch)

2015-04-20 Thread Boris Pavlovic
Ian,



If you were thinking instead to provide coverage *tools* that were easy for
 developers to use,


Hm, seems like you missed the point. This gate job can be run like unit
tests tox -e cover. That will point you on the missing lines that are
introduced in your patch.

  As a dev, I would not be terribly interested in finding that I've
 improved overall test coverage from 90.1% to 90.2%


It is not the goal of the job that I add. Job checks that your patch don't
introduce code that is not covered by unit test (that is all).


but I might be *very* interested to know that I got 100% decision (or even
 boolean) coverage on the specific lines of the feature I just added by
 running just the unit tests that exercise it.


And this is exactly what tox -e cover does and job that run tox -e cover
in gates.

Best regards,
Boris Pavlovic


On Tue, Apr 21, 2015 at 3:28 AM, Ian Wells ijw.ubu...@cack.org.uk wrote:

 On 20 April 2015 at 07:40, Boris Pavlovic bo...@pavlovic.me wrote:

 Dan,

 IMHO, most of the test coverage we have for nova's neutronapi is more
 than useless. It's so synthetic that it provides no regression
 protection, and often requires significantly more work than the change
 that is actually being added. It's a huge maintenance burden with very
 little value, IMHO. Good tests for that code would be very valuable of
 course, but what is there now is not.
 I think there are cases where going from 90 to 91% mean adding a ton of
 extra spaghetti just to satisfy a bot, which actually adds nothing but
 bloat to maintain.


 Let's not mix the bad unit tests in Nova with the fact that code should
 be fully covered by well written unit tests.
 This big task can be split into 2 smaller tasks:
 1) Bot that will check that we are covering new code by tests and don't
 introduce regressions


 http://en.wikipedia.org/wiki/Code_coverage

 You appear to be talking about statement coverage, which is one of the
 weaker coverage metrics.

 if a:
 thing

 gets 100% statement coverage if a is true, so I don't need to test when a
 is false (which would be at a minimum decision coverage).

 I wonder if the focus is wrong.  Maybe helping devs is better than making
 more gate jobs, for starters; and maybe overall coverage is not a great
 metric when you're changing 100 lines in 100,000.  If you were thinking
 instead to provide coverage *tools* that were easy for developers to use,
 that would be a different question.  As a dev, I would not be terribly
 interested in finding that I've improved overall test coverage from 90.1%
 to 90.2%, but I might be *very* interested to know that I got 100% decision
 (or even boolean) coverage on the specific lines of the feature I just
 added by running just the unit tests that exercise it.
 --
 Ian.



 __
 OpenStack Development Mailing List (not for usage questions)
 Unsubscribe: openstack-dev-requ...@lists.openstack.org?subject:unsubscribe
 http://lists.openstack.org/cgi-bin/mailman/listinfo/openstack-dev


__
OpenStack Development Mailing List (not for usage questions)
Unsubscribe: openstack-dev-requ...@lists.openstack.org?subject:unsubscribe
http://lists.openstack.org/cgi-bin/mailman/listinfo/openstack-dev


Re: [openstack-dev] [Zaqar] Call for adoption (or exclusion?)

2015-04-20 Thread Vipul Sabhaya
On Mon, Apr 20, 2015 at 12:07 PM, Fox, Kevin M kevin@pnnl.gov wrote:

 Another parallel is Manilla vs Swift. Both provides something like a share
 for users to store files.

 The former is a multitenant api to provision non multitenant file shares.
 The latter is a multitenant api to provide file sharing.

 Cue is a multitenant api to provision non multitenant queues.
 Zaqar is an api for a multitenant queueing system.

 They are complimentary services.


Agreed, it’s not an either/or, there is room for both.  While Cue could
provision Zaqar, it doesn’t make sense, since it is already multi-tenant.
As has been said, Cue’s goal is to bring non-multi-tenant message brokers
to the cloud.

On the question of adoption, what confuses me is why the measurement of
success of a project is whether other OpenStack services are integrating or
not.  Zaqar exposes an API that seems best fit for application workloads
running on an OpenStack cloud.  The question should be raised to operators
as to what’s preventing them from running Zaqar in their public cloud,
distro, or whatever.

Looking at other services that we consider to be successful, such as Trove,
we did not attempt to integrate with other OpenStack projects.  Rather, we
solved the concerns that operators had.



 Thanks,
 Kevin
 
 From: Ryan Brown [rybr...@redhat.com]
 Sent: Monday, April 20, 2015 11:38 AM
 To: openstack-dev@lists.openstack.org
 Subject: Re: [openstack-dev] [Zaqar] Call for adoption (or exclusion?)

 On 04/20/2015 02:22 PM, Michael Krotscheck wrote:
  What's the difference between openstack/zaqar and stackforge/cue?
  Looking at the projects, it seems like zaqar is a ground-up
  implementation of a queueing system, while cue is a provisioning api for
  queuing systems that could include zaqar, but could also include rabbit,
  zmq, etc...
 
  If my understanding of the projects is correct, the latter is far more
  versatile, and more in line with similar openstack approaches like
  trove. Is there a use case nuance I'm not aware of that warrants
  duplicating efforts? Because if not, one of the two should be retired
  and development focused on the other.
 
  Note: I do not have a horse in this race. I just feel it's strange that
  we're building a thing that can be provisioned by the other thing.
 

 Well, with Trove you can provision databases, but the MagnetoDB project
 still provides functionality that trove won't.


 The Trove : MagnetoDB and Cue : Zaqar comparison fits well.

 Trove provisions one instance of X (some database) per tenant, where
 MagnetoDB is one instance (collection of hosts to do database things)
 that serves many tenants.

 Cue's goal is I have a not-very-multitenant message bus (rabbit, or
 whatever) and makes that multitenant by provisioning one per tenant,
 while Zaqar has a single install (of as many machines as needed) to
 support messaging for all cloud tenants. This enables great stuff like
 cross-tenant messaging, better physical resource utilization in
 sparse-tenant cases, etc.

 As someone who wants to adopt Zaqar, I'd really like to see it continue
 as a project because it provides things other message broker approaches
 don't.

 --
 Ryan Brown / Software Engineer, Openstack / Red Hat, Inc.

 __
 OpenStack Development Mailing List (not for usage questions)
 Unsubscribe: openstack-dev-requ...@lists.openstack.org?subject:unsubscribe
 http://lists.openstack.org/cgi-bin/mailman/listinfo/openstack-dev

 __
 OpenStack Development Mailing List (not for usage questions)
 Unsubscribe: openstack-dev-requ...@lists.openstack.org?subject:unsubscribe
 http://lists.openstack.org/cgi-bin/mailman/listinfo/openstack-dev

__
OpenStack Development Mailing List (not for usage questions)
Unsubscribe: openstack-dev-requ...@lists.openstack.org?subject:unsubscribe
http://lists.openstack.org/cgi-bin/mailman/listinfo/openstack-dev


Re: [openstack-dev] [keystone] keystone middleware package changing release method in Liberty

2015-04-20 Thread Robert Collins
On 20 April 2015 at 04:54, Morgan Fainberg morgan.fainb...@gmail.com wrote:

 Could you enlarge on what 'coordinating the requirements' means?


 This is simply a choice to adhere to the global-requirements for a given
 release (e.g. Liberty) that nova (and other projects) adhere to. We won't be
 doing a release when we feel like it we will be doing a standard
 mile-stone tag for (example) L1, L2, L3, and Liberty final. We will then
 maintain the backport for stable/Liberty for the life of the release.

I'm confused ;). In a couple of ways.

Firstly, gloal-requirements and release-schedule are two different
dimensions. They connect in that some changes to global-requirements
are coordinated with the 6-month release schedule, but its a fairly
open relation: you can release whenever you like (like Swift does) and
still coordinate with global-requirements.

Secondly, how will e.g. nova depend on new functionality in
keystonemiddleware? I presume you'll make nova depend on the L1
release after its done, and block consuming the new functionality
until the middleware has released?
...
 Today middleware is released independent of everything (like a client) but
 since it is tightly coupled to a set of requirements using 1.5.x with Juno
 is challenging, since there is a requirements mismatch. Today the only way
 you know what versions work is by either looking at release dates or by
 trial/error (or examining requirements). I think it is far better to release
 middleware like a server project to more clearly indicate release schedule
 and compatibility.

Whats the coupling there? More specifically, is it 'the middleware
needs other components that don't have stable APIs' or, as I
suspect,is it really https://github.com/pypa/pip/issues/988 (and
associated glitches) - which I'm fixing as we speak...

Generally in dependency relationships semver should be enough: I'm
very worried that you seem to be saying that semver *does not* work
here, and I want to understand the details (independent of whatever
keystonemiddleware does), so that work on pbr and other parts of our
release process is fully informed.

 Knowing that 1.3.x receives backports (and tied to Juno), but 1.4.x doesn't
 because it was released between Juno and kilo, and 1.5.x does again (and is
 tied to kilo) is just a poor experience for our deployers. I don't want to
 have to name some release LTS of keystonemiddleware, let's  release in a way
 that make sense for how it is used.

But all three are compatible based on their version: anything that
worked with 1.3 should work with 1.5. Why doesn't it?

 Details of the version numbers will be hashed out at the summit and the
 release management team. (E.g do we move to a 2015.x.x model? Do we
 increment the X per release in semver, or the 'y'?) This part is not yet
 determined and requires some discussion.

Indeed.

-Rob



-- 
Robert Collins rbtcoll...@hp.com
Distinguished Technologist
HP Converged Cloud

__
OpenStack Development Mailing List (not for usage questions)
Unsubscribe: openstack-dev-requ...@lists.openstack.org?subject:unsubscribe
http://lists.openstack.org/cgi-bin/mailman/listinfo/openstack-dev


Re: [openstack-dev] [third-party][infra] Third-Party CI Operators: Let's use a common CI Solution!

2015-04-20 Thread Sukhdev Kapur
Hi Ramy,

While I agree, in principal, with this line of thinking and goal, my
concern will be how much extra work is it going to create for existing CI
owners?
Our Ci system has been stable for a long time, and we put in a good amount
of effort to get it to that point. Our CI is not based upon zuul framework.
Zuul was still under discussion at the time when we put together our CI. We
use Jenkins as front end, along with Gerrit triggers, and AWS for
posting/preserving results/log.  We have dedicated back-end servers for
 testing.

My paranoia at this point will be to learn a new framework, risk breaking
things and taking a huge effort to get things stabilized - without much
additional ROI.
Am I overreacting here or does my argument makes sense?

I wonder how many folks will be in that camp?

Sukhdev




On Sun, Apr 19, 2015 at 10:17 PM, Asselin, Ramy ramy.asse...@hp.com wrote:

  All Third-Party CI operators:



 We’ve got 85 Third Party CI systems registered in the wiki[1], all of them
 running a variety of closed  open-source solutions.

 Instead of individually maintaining all those similar solutions, let’s
 join together and collectively maintain a single solution.



 If that sounds good to you, there’s an Infra-spec that’s been approved [2]
 to refactor much of what the Infrastructure team uses for the upstream
 “Jenkins” CI to be more easily reusable by many of us.



 We’ve got stories defined [3], and a few patches submitted. We’re using
 the gerrit-topic “downstream-puppet” [4].



 For example, we’ve got the first part under review for the “Log Server”,
 which creates your own version of http://logs.openstack.org/



 If anyone is interested in migrating towards a common solution, reply, or
 ping me IRC (asselin) on Freenode #openstack-infra, or join some of the
 third party ci meetings [5].



 Thanks!

 Ramy



 [1] https://wiki.openstack.org/wiki/ThirdPartySystems

 [2]
 http://specs.openstack.org/openstack-infra/infra-specs/specs/openstackci.html

 [3] https://storyboard.openstack.org/#!/story/2000101

 [4] https://review.openstack.org/#/q/topic:downstream-puppet,n,z

 [5]
 https://wiki.openstack.org/wiki/Meetings/ThirdParty#Weekly_Third_Party_meetings





 __
 OpenStack Development Mailing List (not for usage questions)
 Unsubscribe: openstack-dev-requ...@lists.openstack.org?subject:unsubscribe
 http://lists.openstack.org/cgi-bin/mailman/listinfo/openstack-dev


__
OpenStack Development Mailing List (not for usage questions)
Unsubscribe: openstack-dev-requ...@lists.openstack.org?subject:unsubscribe
http://lists.openstack.org/cgi-bin/mailman/listinfo/openstack-dev


[openstack-dev] [devstack][octavia] Loading one devstack plugin from another devstack plugin.

2015-04-20 Thread Al Miller
Hi Devstack people,

I have developed two devstack plugins (for neutron-lbaas and octavia), and I 
think I am stretching the capabilities of the devstack plugin architecture.

Neutron-lbaas is the load balancer framework for OpenStack.  By default it uses 
a fairly simple haproxy-based agent to actually perform its load balancing 
tasks.  It has a devstack plugin that works well, all I need to do is add the 
appropriate enable_plugin and enable_service lines to my local.conf and the 
plugin code sets up everything nicely.  So far so good.

Octavia is a reference implementation (currently in stackforge) that will plug 
in to neutron-lbaas and provide scalable, HA-capable load balancing agents 
above and beyond the default implementation.  I have also written a devstack 
plugin for Octavia, and it also works reasonably well (I still need to finish 
up a few loose ends in it).   That plugin works well too, by adding the 
appropriate enable_plugin and enable_service entries to local.conf.

So adding this:

enable_plugin neutron-lbaas https://git.openstack.org/openstack/neutron-lbaas
enable_plugin octavia https://git.openstack.org/stackforge/octavia
enable_service q-lbaasv2
enable_service octavia
enable_service o-cw
enable_service o-hk
enable_service o-hw

to my local.conf results in a working lbaasv2/Octavia devstack.

Now what I would like to do is automate as much of this Octavia-specific 
information as possible in neutron-lbaas.   In principle, if I could specify

enable_plugin neutron-lbaas https://git.openstack.org/openstack/neutron-lbaas
enable_service q-lbaasv2
enable_service octavia

All there remaining knowledge could be written into neutron-lbaas/devstack.  So 
I tried this, and added code to the neutron-lbaas plugin.sh that enabled the 
Octavia plugin and services.

I have tried running enable_plugin octavia   from various points in the 
neutron_lbaas/devstack/plugin.sh, but it appears that by the time we begin 
loading plugins it is too late to be doing this.  Does this seem like something 
that could be made to work, or does it sound too fragile, dangerous, etc?

I would appreciate any comments.

Thanks,

Al



__
OpenStack Development Mailing List (not for usage questions)
Unsubscribe: openstack-dev-requ...@lists.openstack.org?subject:unsubscribe
http://lists.openstack.org/cgi-bin/mailman/listinfo/openstack-dev


Re: [openstack-dev] [api] Minor changes to API

2015-04-20 Thread Ian Wells
On 20 April 2015 at 15:23, Matthew Treinish mtrein...@kortar.org wrote:

 On Mon, Apr 20, 2015 at 03:10:40PM -0700, Ian Wells wrote:
  It would be nice to have a consistent policy here; it would make future
  decision making easier and it would make it easier to write specs if we
  knew what was expected and the possible implementations weren't up for
  (quite so much) debate.  For different reasons, Neutron extensions are
 also
  not favoured, so there's no clear cut choice to make.

 Uhm, there is: https://wiki.openstack.org/wiki/APIChangeGuidelines
 and if you read that adding attrs without advertising it (using an
 extension, microversion, or whatever) is not an allowed change.


It is also not an unallowed change (given that there's a section that
appears to define what an unallowed attribute change is).  The page reads
very awkwardly.

Whatever your preference might be, I think it's best we lose the
ambiguity.  And perhaps advertise that page a little more widely, actually
- I hadn't come across it in my travels.  And perhaps improve its air of
authority: rules on this subject should probably live somewhere in a repo
so that it's clear there's consensus for changes.  Currently anyone can
change it for any reason, and two years after the last substantive change
it's hard to say who even knew it was being changed, let alone whether they
agreed.

Just adding
 things without a new extension or microversion makes the end user story
 terrible
 because it puts the burden completely on the user to try and figure out
 which
 version 2 (or whatever it currently is marked as) of the api the cloud
 they're
 using speaks. Think about it if it were a library, that just started adding
 things to it's interfaces without bumping any version. Even if it was a
 backwards compatible addition you would still expect the version to
 increment to
 indicate that the new stuff was there and available for use.


I appreciate your point and I'd be happy for that to be more obviously our
position.

The issue that the MTU change hit was the conflict between this general
principle and the consensus in its project.  Neutron's core team was giving
a strong 'no more extensions' vibe at the last summit, Neutron hasn't got
microversioning, and the content of that document is two years old and
apparently not very widely known by reviewers as well as me.  No choice
would have been right.

So again, how about we fix that document up and put it somewhere where it
receives a bit more control and attention?
-- 
Ian.
__
OpenStack Development Mailing List (not for usage questions)
Unsubscribe: openstack-dev-requ...@lists.openstack.org?subject:unsubscribe
http://lists.openstack.org/cgi-bin/mailman/listinfo/openstack-dev


Re: [openstack-dev] [puppet] bug triage day

2015-04-20 Thread Matt Fischer
I think this is a good idea. We'd need an etherpad or may I suggest google
spreadsheet of the bugs so people can pick them off, especially since we're
all on different TZs and many of us will not be able to dedicate the full 8
hours to it.

On Mon, Apr 20, 2015 at 3:20 PM, Emilien Macchi emil...@redhat.com wrote:

 Hi,

 We have around 142 bugs without fix for now in our modules [1].
 Some folks in our group raised an idea where we could do a bug triage
 day sometimes.

 I've created an etherpad so we can have a list of people interested to
 participate [2] in this work.

 Feel free to bring your name, and we will come up with details tomorrow
 during our weekly meeting.

 Thanks,

 [1] http://goo.gl/Xnw0Cg
 [2] https://etherpad.openstack.org/p/puppet-bug-triage
 --
 Emilien Macchi

 --

 To unsubscribe from this group and stop receiving emails from it, send an
 email to puppet-openstack+unsubscr...@puppetlabs.com.

__
OpenStack Development Mailing List (not for usage questions)
Unsubscribe: openstack-dev-requ...@lists.openstack.org?subject:unsubscribe
http://lists.openstack.org/cgi-bin/mailman/listinfo/openstack-dev


Re: [openstack-dev] [Zaqar] Call for adoption (or exclusion?)

2015-04-20 Thread Fox, Kevin M
As an Op, a few things that come to mind in that category are:
 * RDO packaging (stated earlier). If its not easy to install, its not going to 
be deployed as much. I haven't installed it yet, because I haven't had time to 
do much other then yum install it...
 * Horizon UI
 * Heat Resources. (Some basic stuff like create/delete queue to go along with 
the stack. also link #1 below)

Horizon has a discovery aspect to it. If users don't know a service is 
available, its hard for them to use it. Even with the most simple UI of 
Create/Delete/List queues, discovery is handled. The user knows it exists, and 
can look for documentation on how to make it work, can ask an admin how to use 
it, or start poking at the cli for advanced features.

Thanks,
Kevin

1. https://blueprints.launchpad.net/heat/+spec/software-config-zaqar

From: Vipul Sabhaya [vip...@gmail.com]
Sent: Monday, April 20, 2015 1:39 PM
To: OpenStack Development Mailing List (not for usage questions)
Subject: Re: [openstack-dev] [Zaqar] Call for adoption (or exclusion?)



On Mon, Apr 20, 2015 at 12:07 PM, Fox, Kevin M 
kevin@pnnl.govmailto:kevin@pnnl.gov wrote:
Another parallel is Manilla vs Swift. Both provides something like a share for 
users to store files.

The former is a multitenant api to provision non multitenant file shares.
The latter is a multitenant api to provide file sharing.

Cue is a multitenant api to provision non multitenant queues.
Zaqar is an api for a multitenant queueing system.

They are complimentary services.


Agreed, it’s not an either/or, there is room for both.  While Cue could 
provision Zaqar, it doesn’t make sense, since it is already multi-tenant.  As 
has been said, Cue’s goal is to bring non-multi-tenant message brokers to the 
cloud.

On the question of adoption, what confuses me is why the measurement of success 
of a project is whether other OpenStack services are integrating or not.  Zaqar 
exposes an API that seems best fit for application workloads running on an 
OpenStack cloud.  The question should be raised to operators as to what’s 
preventing them from running Zaqar in their public cloud, distro, or whatever.

Looking at other services that we consider to be successful, such as Trove, we 
did not attempt to integrate with other OpenStack projects.  Rather, we solved 
the concerns that operators had.


Thanks,
Kevin

From: Ryan Brown [rybr...@redhat.commailto:rybr...@redhat.com]
Sent: Monday, April 20, 2015 11:38 AM
To: openstack-dev@lists.openstack.orgmailto:openstack-dev@lists.openstack.org
Subject: Re: [openstack-dev] [Zaqar] Call for adoption (or exclusion?)

On 04/20/2015 02:22 PM, Michael Krotscheck wrote:
 What's the difference between openstack/zaqar and stackforge/cue?
 Looking at the projects, it seems like zaqar is a ground-up
 implementation of a queueing system, while cue is a provisioning api for
 queuing systems that could include zaqar, but could also include rabbit,
 zmq, etc...

 If my understanding of the projects is correct, the latter is far more
 versatile, and more in line with similar openstack approaches like
 trove. Is there a use case nuance I'm not aware of that warrants
 duplicating efforts? Because if not, one of the two should be retired
 and development focused on the other.

 Note: I do not have a horse in this race. I just feel it's strange that
 we're building a thing that can be provisioned by the other thing.


Well, with Trove you can provision databases, but the MagnetoDB project
still provides functionality that trove won't.


The Trove : MagnetoDB and Cue : Zaqar comparison fits well.

Trove provisions one instance of X (some database) per tenant, where
MagnetoDB is one instance (collection of hosts to do database things)
that serves many tenants.

Cue's goal is I have a not-very-multitenant message bus (rabbit, or
whatever) and makes that multitenant by provisioning one per tenant,
while Zaqar has a single install (of as many machines as needed) to
support messaging for all cloud tenants. This enables great stuff like
cross-tenant messaging, better physical resource utilization in
sparse-tenant cases, etc.

As someone who wants to adopt Zaqar, I'd really like to see it continue
as a project because it provides things other message broker approaches
don't.

--
Ryan Brown / Software Engineer, Openstack / Red Hat, Inc.

__
OpenStack Development Mailing List (not for usage questions)
Unsubscribe: 
openstack-dev-requ...@lists.openstack.org?subject:unsubscribehttp://openstack-dev-requ...@lists.openstack.org?subject:unsubscribe
http://lists.openstack.org/cgi-bin/mailman/listinfo/openstack-dev

__
OpenStack Development Mailing List (not for usage questions)
Unsubscribe: 

Re: [openstack-dev] [heat] is cloudwatch really deprecated?

2015-04-20 Thread Angus Salkeld
On Tue, Apr 21, 2015 at 12:33 PM, x Lyn xuanlangj...@gmail.com wrote:

 Since cloudwatch is deprecated, is there any plan to remove it away from
 codes? Or still has some functions depend on this service?


No plans as yet, but all you have to do is not run the binary (heat-api-cw).



 2015-04-18 2:29 GMT+08:00 Zane Bitter zbit...@redhat.com:

 On 17/04/15 13:54, Matt Fischer wrote:

 On Fri, Apr 17, 2015 at 11:03 AM, Zane Bitter zbit...@redhat.com
 mailto:zbit...@redhat.com wrote:

 On 17/04/15 12:46, Matt Fischer wrote:

 The wiki for Using Cloudwatch states:

 This feature will be deprecated or removed during the Havana
 cycle as
 we move to using Ceilometer as a metric/alarm service instead.
 [1]

 However it seems that cloudwatch is still being developed.


 It doesn't seem that way to me, and without at least some kind of
 hint I'm not in a position to speculate on why it might seem that
 way to you.

 So is it deprecated or not?


 Yes, it's very deprecated.

 In fact, we should go ahead and disable it in the default config.

 - ZB


 I was just looking at the dates in the commit log for the cloudwatch
 folder and seeing things from 2015. If it's truly deprecated, that's
 great, I'll remove it from my environment.


 OK, that's what I looked at too, and there were a lot of recent changes
 but they all appeared to be global cleanups that went across the whole Heat
 codebase. The last thing that looked like active development was in July
 2013. You definitely won't regret removing it ;)


So before we get too excited, ceilometer AFAIK does not have a native guest
client that doesn't use a token.
ATM heat-api-cw bounces metrics to ceilometer that were associated with
ceilometer alarms.

-Angus


 cheers,
 Zane.


 __
 OpenStack Development Mailing List (not for usage questions)
 Unsubscribe:
 openstack-dev-requ...@lists.openstack.org?subject:unsubscribe
 http://lists.openstack.org/cgi-bin/mailman/listinfo/openstack-dev



 __
 OpenStack Development Mailing List (not for usage questions)
 Unsubscribe: openstack-dev-requ...@lists.openstack.org?subject:unsubscribe
 http://lists.openstack.org/cgi-bin/mailman/listinfo/openstack-dev


__
OpenStack Development Mailing List (not for usage questions)
Unsubscribe: openstack-dev-requ...@lists.openstack.org?subject:unsubscribe
http://lists.openstack.org/cgi-bin/mailman/listinfo/openstack-dev


Re: [openstack-dev] Regarding openstack swift implementation

2015-04-20 Thread Madhuri Rai
Hi,

You can go through below link to get started.

http://docs.openstack.org/developer/swift/development_saio.html


Thanks
Madhuri Kumari

On Tue, Apr 21, 2015 at 2:09 PM, Subbulakshmi Subha 
subbulakshmisubh...@gmail.com wrote:

 Hi,
 I am trying to simulate openstack swift.could you please help me with
 getting started.what are all the details I should be knowing to store
 objects on swift?

 __
 OpenStack Development Mailing List (not for usage questions)
 Unsubscribe: openstack-dev-requ...@lists.openstack.org?subject:unsubscribe
 http://lists.openstack.org/cgi-bin/mailman/listinfo/openstack-dev


__
OpenStack Development Mailing List (not for usage questions)
Unsubscribe: openstack-dev-requ...@lists.openstack.org?subject:unsubscribe
http://lists.openstack.org/cgi-bin/mailman/listinfo/openstack-dev


Re: [openstack-dev] Fwd: Integration Gerrit with Launchpad

2015-04-20 Thread Andreas Jaeger

On 04/21/2015 03:45 AM, Kaneko Takehiro wrote:

Andreas,

Our project repository matches the project in Launchpad but the bug
status doesn't change(Triaged = In Progress).

Bug: https://bugs.launchpad.net/python-rack/+bug/1446058
Gerrit: https://review.openstack.org/#/c/175272/


that first change was send before the project-config change went in - 
and AFAIK our scripts only change to in progress on the *first* change.


But once your patch merges, it should close it nevertheless,

Andreas
--
 Andreas Jaeger aj@{suse.com,opensuse.org} Twitter/Identica: jaegerandi
  SUSE LINUX GmbH, Maxfeldstr. 5, 90409 Nürnberg, Germany
   GF: Felix Imendörffer, Jane Smithard, Jennifer Guild, Dilip Upmanyu,
   Graham Norton, HRB 21284 (AG Nürnberg)
GPG fingerprint = 93A3 365E CE47 B889 DF7F  FED1 389A 563C C272 A126


__
OpenStack Development Mailing List (not for usage questions)
Unsubscribe: openstack-dev-requ...@lists.openstack.org?subject:unsubscribe
http://lists.openstack.org/cgi-bin/mailman/listinfo/openstack-dev


Re: [openstack-dev] [heat] is cloudwatch really deprecated?

2015-04-20 Thread x Lyn
Since cloudwatch is deprecated, is there any plan to remove it away from
codes? Or still has some functions depend on this service?

2015-04-18 2:29 GMT+08:00 Zane Bitter zbit...@redhat.com:

 On 17/04/15 13:54, Matt Fischer wrote:

 On Fri, Apr 17, 2015 at 11:03 AM, Zane Bitter zbit...@redhat.com
 mailto:zbit...@redhat.com wrote:

 On 17/04/15 12:46, Matt Fischer wrote:

 The wiki for Using Cloudwatch states:

 This feature will be deprecated or removed during the Havana
 cycle as
 we move to using Ceilometer as a metric/alarm service instead.
 [1]

 However it seems that cloudwatch is still being developed.


 It doesn't seem that way to me, and without at least some kind of
 hint I'm not in a position to speculate on why it might seem that
 way to you.

 So is it deprecated or not?


 Yes, it's very deprecated.

 In fact, we should go ahead and disable it in the default config.

 - ZB


 I was just looking at the dates in the commit log for the cloudwatch
 folder and seeing things from 2015. If it's truly deprecated, that's
 great, I'll remove it from my environment.


 OK, that's what I looked at too, and there were a lot of recent changes
 but they all appeared to be global cleanups that went across the whole Heat
 codebase. The last thing that looked like active development was in July
 2013. You definitely won't regret removing it ;)

 cheers,
 Zane.


 __
 OpenStack Development Mailing List (not for usage questions)
 Unsubscribe: openstack-dev-requ...@lists.openstack.org?subject:unsubscribe
 http://lists.openstack.org/cgi-bin/mailman/listinfo/openstack-dev

__
OpenStack Development Mailing List (not for usage questions)
Unsubscribe: openstack-dev-requ...@lists.openstack.org?subject:unsubscribe
http://lists.openstack.org/cgi-bin/mailman/listinfo/openstack-dev


Re: [openstack-dev] Regarding openstack swift implementation

2015-04-20 Thread Subbulakshmi Subha
I want to simulate it one javasim,so I want to know how are objects stored
in the partitions in swift.I computed the md5 hash of the objects url, n
the medium of storage is hashmap,so I want to know how doea it store it
there?is there any algorithm for it?
On 21-Apr-2015 10:59 AM, Madhuri Rai madhuri.ra...@gmail.com wrote:

 Hi,

 You can go through below link to get started.

 http://docs.openstack.org/developer/swift/development_saio.html


 Thanks
 Madhuri Kumari

 On Tue, Apr 21, 2015 at 2:09 PM, Subbulakshmi Subha 
 subbulakshmisubh...@gmail.com wrote:

 Hi,
 I am trying to simulate openstack swift.could you please help me with
 getting started.what are all the details I should be knowing to store
 objects on swift?

 __
 OpenStack Development Mailing List (not for usage questions)
 Unsubscribe:
 openstack-dev-requ...@lists.openstack.org?subject:unsubscribe
 http://lists.openstack.org/cgi-bin/mailman/listinfo/openstack-dev



 __
 OpenStack Development Mailing List (not for usage questions)
 Unsubscribe: openstack-dev-requ...@lists.openstack.org?subject:unsubscribe
 http://lists.openstack.org/cgi-bin/mailman/listinfo/openstack-dev


__
OpenStack Development Mailing List (not for usage questions)
Unsubscribe: openstack-dev-requ...@lists.openstack.org?subject:unsubscribe
http://lists.openstack.org/cgi-bin/mailman/listinfo/openstack-dev


Re: [openstack-dev] [OpenStack-Infra][cinder] Could you please re-consider Oracle ZFSSA iSCSI Driver

2015-04-20 Thread Diem Tran

Hi Mike,

Could you please take a look at the results and consider re-integrating 
the driver? We the Oracle ZFSSA team would like to target the Kilo RC 
deadline if possible.


Thank you,
Diem.


On 4/20/15 3:47 PM, Diem Tran wrote:

Hi Mike,

Oracle ZFSSA iSCSI CI is now reporting test results. It is configured 
to run against the ZFSSA iSCSI driver. You can see the results here:

https://review.openstack.org/#/q/reviewer:%22Oracle+ZFSSA+CI%22,n,z

Below are some patchsets that the CI reports:
https://review.openstack.org/#/c/168424/
https://review.openstack.org/#/c/168419/
https://review.openstack.org/#/c/175247/
https://review.openstack.org/#/c/175077/
https://review.openstack.org/#/c/163706/


I would like to kindly request you and the core team to get the Oracle 
ZFSSA iSCSI driver re-integrated back to the Cinder code base. If 
there is anything else you need from the CI and the driver, please do 
let me know.


Thank you,
Diem.



__
OpenStack Development Mailing List (not for usage questions)
Unsubscribe: openstack-dev-requ...@lists.openstack.org?subject:unsubscribe
http://lists.openstack.org/cgi-bin/mailman/listinfo/openstack-dev


Re: [openstack-dev] [neutron] [docs] Networking Guide Doc Day - April 23rd

2015-04-20 Thread Guo, Ruijing
Hi, Edgar

Some docs are still in private branch. Can we move to public branch for 
reviewing  submitting patches?

Thanks,
-Ruijing

From: Edgar Magana [mailto:edgar.mag...@workday.com]
Sent: Saturday, April 18, 2015 2:25 AM
To: OpenStack Development Mailing List (not for usage questions)
Subject: [openstack-dev] [neutron] [docs] Networking Guide Doc Day - April 23rd

Hello Folks,

I would like to invite all available contributors to help us to complete the 
OpenStack Networking Guide.

We are having a Networking Doc Day on April 23rd in order to review the current 
guide and make a big push on its content.
Let's use both the Neutron and Docs IRC channels:
#openstack-neutron
#openstack-doc

All the expected content is being described in the TOC:
https://wiki.openstack.org/wiki/NetworkingGuide/TOC

Information for Doc contributors in here:
https://wiki.openstack.org/wiki/Documentation/HowTo#Edit_OpenStack_RST_and.2For_DocBook_documentation

We have prepared an etherpad to coordinate who is doing what:
https://etherpad.openstack.org/p/networking-guide

There are so many ways you can contribute:

  *   Assign to yourself one of the available chapters
  *   Review the current content and open bugs if needed
  *   Review the existing gerrit commit if you are familiar with the information
  *   Be available on IRC to answer some questions about configuration details 
or functionality
  *   Cheering at the contributors!
Do not hesitate in contacting me for any questions.

Cheers!

Edgar Magana
IRC: emagana
emag...@gmail.commailto:emag...@gmail.com
edgar.mag...@workday.commailto:edgar.mag...@workday.com
__
OpenStack Development Mailing List (not for usage questions)
Unsubscribe: openstack-dev-requ...@lists.openstack.org?subject:unsubscribe
http://lists.openstack.org/cgi-bin/mailman/listinfo/openstack-dev


[openstack-dev] Regarding openstack swift implementation

2015-04-20 Thread Subbulakshmi Subha
Hi,
I am trying to simulate openstack swift.could you please help me with
getting started.what are all the details I should be knowing to store
objects on swift?
__
OpenStack Development Mailing List (not for usage questions)
Unsubscribe: openstack-dev-requ...@lists.openstack.org?subject:unsubscribe
http://lists.openstack.org/cgi-bin/mailman/listinfo/openstack-dev


Re: [openstack-dev] Fwd: Integration Gerrit with Launchpad

2015-04-20 Thread Kaneko Takehiro
Andreas,

Our project repository matches the project in Launchpad but the bug status
doesn't change(Triaged = In Progress).

Bug: https://bugs.launchpad.net/python-rack/+bug/1446058
Gerrit: https://review.openstack.org/#/c/175272/

The following change has been merged.(
https://review.openstack.org/#/c/175294/)

Send a patch for project-config repo, file gerrit/projects.yaml and add to
 your project:

groups:

   python-rack


Thanks.

2015-04-20 16:56 GMT+09:00 Kaneko Takehiro myphone...@gmail.com:

 Andreas,

 I missed it.
 Thanks for your help.

 Takehiro

 2015-04-20 16:40 GMT+09:00 Andreas Jaeger a...@suse.com:

 On 04/20/2015 09:26 AM, Kaneko Takehiro wrote:

 Hi,

 I'm managing a stackforge project and want to integrate Gerrit with
 Launchpad.

 Links;
Git: https://git.openstack.org/cgit/stackforge/rack/
Launchpad: https://launchpad.net/python-rack

 Project name 'rack' is duplicated in Launchpad so I named our project
 'python-rack'.
 How can I integrate Gerrit with Launchpad in this case?


 Send a patch for project-config repo, file gerrit/projects.yaml and add
 to your project:
 groups:
python-rack

 Btw. this is documented in our infra manual:

 http://docs.openstack.org/infra/manual/creators.html#add-the-project-to-the-master-project-list

 Andreas
 --
  Andreas Jaeger aj@{suse.com,opensuse.org} Twitter/Identica: jaegerandi
   SUSE LINUX GmbH, Maxfeldstr. 5, 90409 Nürnberg, Germany
GF: Felix Imendörffer, Jane Smithard, Jennifer Guild, Dilip Upmanyu,
Graham Norton, HRB 21284 (AG Nürnberg)
 GPG fingerprint = 93A3 365E CE47 B889 DF7F  FED1 389A 563C C272 A126


 __
 OpenStack Development Mailing List (not for usage questions)
 Unsubscribe:
 openstack-dev-requ...@lists.openstack.org?subject:unsubscribe
 http://lists.openstack.org/cgi-bin/mailman/listinfo/openstack-dev



__
OpenStack Development Mailing List (not for usage questions)
Unsubscribe: openstack-dev-requ...@lists.openstack.org?subject:unsubscribe
http://lists.openstack.org/cgi-bin/mailman/listinfo/openstack-dev


Re: [openstack-dev] [OpenStack-Infra][cinder] Could you please re-consider Oracle ZFSSA iSCSI Driver

2015-04-20 Thread Joe Gordon
On Mon, Apr 20, 2015 at 1:18 PM, Duncan Thomas duncan.tho...@gmail.com
wrote:

 Hi Diem

 It appears the CI failed to pass on any of the 5 reviews you linked to.
 Are there any examples of the CI passing?


I don't see any passing runs in the last 20 comments left by 'Oracle ZFSSA
CI'

http://paste.openstack.org/show/204933/  (generated with
https://github.com/jogo/lastcomment)


 On 20 April 2015 at 20:47, Diem Tran diem.t...@oracle.com wrote:

 Hi Mike,

 Oracle ZFSSA iSCSI CI is now reporting test results. It is configured to
 run against the ZFSSA iSCSI driver. You can see the results here:
 https://review.openstack.org/#/q/reviewer:%22Oracle+ZFSSA+CI%22,n,z

 Below are some patchsets that the CI reports:
 https://review.openstack.org/#/c/168424/
 https://review.openstack.org/#/c/168419/
 https://review.openstack.org/#/c/175247/
 https://review.openstack.org/#/c/175077/
 https://review.openstack.org/#/c/163706/


 I would like to kindly request you and the core team to get the Oracle
 ZFSSA iSCSI driver re-integrated back to the Cinder code base. If there is
 anything else you need from the CI and the driver, please do let me know.

 Thank you,
 Diem.

 __
 OpenStack Development Mailing List (not for usage questions)
 Unsubscribe:
 openstack-dev-requ...@lists.openstack.org?subject:unsubscribe
 http://lists.openstack.org/cgi-bin/mailman/listinfo/openstack-dev




 --
 Duncan Thomas

 __
 OpenStack Development Mailing List (not for usage questions)
 Unsubscribe: openstack-dev-requ...@lists.openstack.org?subject:unsubscribe
 http://lists.openstack.org/cgi-bin/mailman/listinfo/openstack-dev


__
OpenStack Development Mailing List (not for usage questions)
Unsubscribe: openstack-dev-requ...@lists.openstack.org?subject:unsubscribe
http://lists.openstack.org/cgi-bin/mailman/listinfo/openstack-dev


Re: [openstack-dev] [all][code quality] Voting coverage job (-1 if coverage get worse after patch)

2015-04-20 Thread Boris Pavlovic
Morgan,

Thank you for your input. I improved coverage job in this patch:
https://review.openstack.org/#/c/175557/1

Now:
* It is based on missing lines and not coverage percentage.
* It shows nice messages and coverage diffs:

   Allowed to introduce missing lines : 8
   Missing lines in master: 649
   Missing lines in proposed change   : 669

   NameStmts   Miss
Branch BrMiss  Cover
   @@ -43 +43 @@
   -rally/benchmark/processing/utils   52  0
  30  198.780%
   +rally/benchmark/processing/utils   52 20
  30 1557.317%
   @@ -190 +190 @@
   -TOTAL9400649
228439491.073%
   +TOTAL9400669
228440890.782%

   Please write more unit tests, we should keep our test coverage :(


Best regards,
Boris Pavlovic

On Mon, Apr 20, 2015 at 9:11 PM, Hayes, Graham graham.ha...@hp.com wrote:

 On 20/04/15 18:01, Clint Byrum wrote:
  Excerpts from Boris Pavlovic's message of 2015-04-18 18:30:02 -0700:
  Hi stackers,
 
  Code coverage is one of the very important metric of overall code
 quality
  especially in case of Python. It's quite important to ensure that code
 is
  covered fully with well written unit tests.
 
  One of the nice thing is coverage job.
 
  In Rally we are running it against every check which allows us to get
  detailed information about
  coverage before merging patch:
 
 http://logs.openstack.org/84/175084/1/check/rally-coverage/c61d5e1/cover/
 
  This helped Rally core team to automate checking that new/changed code
 is
  covered by unit tests and we raised unit test coverage from ~78% to
 almost
  91%.
 
  But it produces few issues:
  1) 9k nitpicking - core reviewers have to put -1 if something is not
  covered by unit tests
  2) core team scaling issues - core team members spend a lot of time just
  checking that whole code is covered by unit test and leaving messages
 like
  this should be covered by unit test
  3) not friendly community - it's not nice to get on your code -1 from
  somebody that is asking just to write unit tests
  4) coverage regressions - sometimes we accidentally accept patches that
  reduce coverage
 
  To resolve this issue I improved a bit coverage job in Rally project,
 and
  now it compares master vs master + patch coverage. If new coverage is
 less
  than master job is marked as -1.
 
  Here is the patch for job enhancement:
  https://review.openstack.org/#/c/174645/
 
  Here is coverage job in action:
  patch https://review.openstack.org/#/c/174677/
  job message
 
 http://logs.openstack.org/77/174677/4/check/rally-coverage/ba49c90/console.html#_2015-04-17_15_57_17_695
 
 
  The link to the important line was key, because without it, just clicking
  through from the review was incomprehensible to me. Can I suggest some
  whitespace or bordering so we can see where the error is easily?
 
  Anyway, interesting thoughts from everyone. I have to agree with those
  that say this isn't reliable enough to make it vote. Non-voting would be
  interesting though, if it gave a clear score difference, and a diff of
  the two coverage reports. I think this is more useful as an automated
  pointer to how things probably should be, but sometimes it's entirely
  o-k to regress this number a few points.
 
  Also graphing this over time in a post-commit job seems like a
 no-brainer.


 Designate has started doing this - it is still a WIP as we continue
 tweaking settings, but we have a dashboard here -

 http://sonar.designate-ci.com/

 
 
 __
  OpenStack Development Mailing List (not for usage questions)
  Unsubscribe:
 openstack-dev-requ...@lists.openstack.org?subject:unsubscribe
  http://lists.openstack.org/cgi-bin/mailman/listinfo/openstack-dev
 


 __
 OpenStack Development Mailing List (not for usage questions)
 Unsubscribe: openstack-dev-requ...@lists.openstack.org?subject:unsubscribe
 http://lists.openstack.org/cgi-bin/mailman/listinfo/openstack-dev

__
OpenStack Development Mailing List (not for usage questions)
Unsubscribe: openstack-dev-requ...@lists.openstack.org?subject:unsubscribe
http://lists.openstack.org/cgi-bin/mailman/listinfo/openstack-dev


Re: [openstack-dev] [OpenStack-Infra][cinder] Could you please re-consider Oracle ZFSSA iSCSI Driver

2015-04-20 Thread Duncan Thomas
Hi Diem

It appears the CI failed to pass on any of the 5 reviews you linked to. Are
there any examples of the CI passing?

On 20 April 2015 at 20:47, Diem Tran diem.t...@oracle.com wrote:

 Hi Mike,

 Oracle ZFSSA iSCSI CI is now reporting test results. It is configured to
 run against the ZFSSA iSCSI driver. You can see the results here:
 https://review.openstack.org/#/q/reviewer:%22Oracle+ZFSSA+CI%22,n,z

 Below are some patchsets that the CI reports:
 https://review.openstack.org/#/c/168424/
 https://review.openstack.org/#/c/168419/
 https://review.openstack.org/#/c/175247/
 https://review.openstack.org/#/c/175077/
 https://review.openstack.org/#/c/163706/


 I would like to kindly request you and the core team to get the Oracle
 ZFSSA iSCSI driver re-integrated back to the Cinder code base. If there is
 anything else you need from the CI and the driver, please do let me know.

 Thank you,
 Diem.

 __
 OpenStack Development Mailing List (not for usage questions)
 Unsubscribe: openstack-dev-requ...@lists.openstack.org?subject:unsubscribe
 http://lists.openstack.org/cgi-bin/mailman/listinfo/openstack-dev




-- 
Duncan Thomas
__
OpenStack Development Mailing List (not for usage questions)
Unsubscribe: openstack-dev-requ...@lists.openstack.org?subject:unsubscribe
http://lists.openstack.org/cgi-bin/mailman/listinfo/openstack-dev


Re: [openstack-dev] [oslo][policy][neutron] oslo.policy API is not powerful enough to switch Neutron to it

2015-04-20 Thread Adam Young

On 04/17/2015 08:45 AM, Ihar Hrachyshka wrote:

-BEGIN PGP SIGNED MESSAGE-
Hash: SHA1

Hi,

tl;dr neutron has special semantics for policy targets that relies on
private symbols from oslo.policy, and it's impossible to introduce
this semantics into oslo.policy itself due to backwards compatibility
concerns, meaning we need to expose some more symbols as part of
public API for the library to facilitate neutron switch to it.

===

oslo.policy was graduated during Kilo [1]. Neutron considered the
switch to it [2], but failed to achieve it because some library
symbols that were originally public (or at least looked like public)
in policy.py from oslo-incubator, became private in oslo.policy.
Specifically, Neutron policy code [3] relies on the following symbols
that are now hidden inside oslo_policy._checks (note the underscore in
the name of the module that suggests we cannot use the module directly):

- - RoleCheck
- - RuleCheck
- - AndCheck

Those symbols are used for the following matters:
(all the relevant neutron code is in neutron/policy.py)

1. debug logging in case policy does not authorize an action
(RuleCheck, AndCheck) [log_rule_list]

2. filling in admin context with admin roles (RoleCheck, RuleCheck,
AndCheck/OrCheck internals) [get_admin_roles]

3. aggregating core, attribute and subattribute policies (RuleCheck,
AndCheck) [_prepare_check]
If we make the checks public, is that sufficient?  I have no problem 
with most of these being public.
The only one that is Keystone specific is the Role check, which I would 
like to rework.  Instead of RoleCheck, can you build on top of  the 
newly submitted ability to do List checks?


https://review.openstack.org/#/c/169045/3/oslo_policy/_checks.py,cm


Rule, And, Or, Not and Generic checks are building blocks for other 
logic, and should be public.





== 1. debug logging in case policy does not authorize an action ==

Neutron logs rules that failed to match if policy module does not
authorize an action. Not sure whether Neutron developers really want
to have those debug logs, and whether we cannot just kill them to
avoid this specific usage of private symbols; though it also seems
that we could easily use __str__ that is present for all types of
Checks instead. So it does not look like a blocker for the switch.


== 2. filling in admin context with admin roles ==

Admin context object is filled with .roles attribute that is a list of
roles considered granting admin permissions [4]. The attribute would
then be used by plugins that would like to do explicit policy checks.
As per Salvatore, this attribute can probably be dropped now that all
plugins and services don't rely on it (Salvatore mentioned lbaas
mixins as the ones that previously relied on it, but are now not doing
it since service split from neutron tree (?)).

The problem with dropping the .roles attribute from context object in
Liberty is that we, as a responsible upstream with lots of plugins
maintained out-of-tree (see the ongoing vendor decomposition effort)
would need to support the attribute while it's marked as deprecated
for at least one cycle, meaning that if we don't get those oslo.policy
internals we rely on in Liberty, we would need to postpone the switch
till Mizzle, or rely on private symbols during the switch (while a new
release of oslo.policy can easily break us).

(BTW the code to extract admin roles is not really robust and has
bugs, f.e. it does not handle AndChecks that could be used in
context_is_admin. In theory, 'and' syntax would mean that both roles
are needed to claim someone is an admin, while the code to extract
admin roles handles 'and' the same way as 'or'. For the deprecation
time being, we may need to document this limitation.)


== 3. aggregating core, attribute and subattribute policies ==

That's the most interesting issue.

For oslo.policy, policies are described as target: rule, where rule
is interpreted as per registered checks, while target is opaque to the
library.

Neutron extended the syntax for target as:
target[:attribute[:subattribute]].

If attribute is present in a policy entry, it applies to target iff
attribute is set, and 'enforce_policy' is set in attribute map for the
attribute in question, and target is not read-only (=its name does not
start from get_).

If subattribute is present, the rule applies to target if 'validate'
is set in attribute map for the attribute, and its type is dict, plus
all the requirements for :attribute described above.

Note that those rules are *aggregated* into single matching rule with
AndCheck, so f.e. if action is create_network, and provider is set in
target, then the actual rule validated would be all the rules for
create_network, create_network:provider, and e.g.
create_network:provider:physical_network, joined into single rule with
AndCheck (meaning, target should conform to all of those requirements).

This stands for a significant extension of original oslo.policy intent.

Originally, I thought 

Re: [openstack-dev] [keystone] keystone middleware package changing release method in Liberty

2015-04-20 Thread Robert Collins
On 21 April 2015 at 03:24, Sean Dague s...@dague.net wrote:
 On 04/20/2015 11:20 AM, Morgan Fainberg wrote:
...
 Re publishing milestones: TBD. I wanted to discuss that with release
 management team and see if that made sense. I believe it does make
 sense, but have not determined that for sure.

 The reason I ask about releases, is that I'd like to keep the upstream
 gating release based (so it would consume the milestones) and not git
 HEAD based, because otherwise we're requiring code from an unreleased
 library, which lead us into some weird places.

Yes, that was exactly my concern.

-Rob

-- 
Robert Collins rbtcoll...@hp.com
Distinguished Technologist
HP Converged Cloud

__
OpenStack Development Mailing List (not for usage questions)
Unsubscribe: openstack-dev-requ...@lists.openstack.org?subject:unsubscribe
http://lists.openstack.org/cgi-bin/mailman/listinfo/openstack-dev


Re: [openstack-dev] [nova] Dropping DB Downgrades, need Turbo Hipster tests updated

2015-04-20 Thread Sean Dague
Awesome, thanks Josh.

On 04/20/2015 07:14 AM, Joshua Hesketh wrote:
 Hi Sean,
 
 Thanks for your work on this. I'll take a closer look tomorrow and remove the 
 downgrade testing from turbo-hipster in line with the TC decision.
 
 Cheers,
 Josh
 
 From: Sean Dague s...@dague.net
 Sent: Monday, 20 April 2015 8:38 PM
 To: OpenStack Development Mailing List
 Subject: [openstack-dev] [nova] Dropping DB Downgrades, need Turbo Hipster 
 tests updated
 
 This proposed patch to drop the db downgrades in Nova master is making
 Turbo Hipster face plant - https://review.openstack.org/#/c/175010/
 
 It appears that turbo hipster is walking all the way up, then walking
 back down through migrations, which clearly, is no longer a thing.
 
 It would be nice to merge this patch sooner rather than later, so would
 be great if Turbo hipster could function on migrations without
 downgrades RSN.
 
 -Sean
 
 --
 Sean Dague
 http://dague.net
 
 __
 OpenStack Development Mailing List (not for usage questions)
 Unsubscribe: openstack-dev-requ...@lists.openstack.org?subject:unsubscribe
 http://lists.openstack.org/cgi-bin/mailman/listinfo/openstack-dev
 
 
 Rackspace Hosting Australia PTY LTD a company registered in the state of 
 Victoria, Australia (company registered number ACN 153 275 524) whose 
 registered office is at Level 1, 37 Pitt Street, Sydney, NSW 2000, Australia. 
 Rackspace Hosting Australia PTY LTD privacy policy can be viewed at 
 www.rackspace.com.au/company/legal-privacy-statement.php - This e-mail 
 message may contain confidential or privileged information intended for the 
 recipient. Any dissemination, distribution or copying of the enclosed 
 material is prohibited. If you receive this transmission in error, please 
 notify us immediately by e-mail at ab...@rackspace.com and delete the 
 original message. Your cooperation is appreciated.
 
 __
 OpenStack Development Mailing List (not for usage questions)
 Unsubscribe: openstack-dev-requ...@lists.openstack.org?subject:unsubscribe
 http://lists.openstack.org/cgi-bin/mailman/listinfo/openstack-dev
 


-- 
Sean Dague
http://dague.net

__
OpenStack Development Mailing List (not for usage questions)
Unsubscribe: openstack-dev-requ...@lists.openstack.org?subject:unsubscribe
http://lists.openstack.org/cgi-bin/mailman/listinfo/openstack-dev


Re: [openstack-dev] [third-party][infra] Third-Party CI Operators: Let's use a common CI Solution!

2015-04-20 Thread Jay Pipes

You rock, Ramy. Seriously, awesome work.

-jay

On 04/20/2015 01:17 AM, Asselin, Ramy wrote:

All Third-Party CI operators:

We’ve got 85 Third Party CI systems registered in the wiki[1], all of
them running a variety of closed  open-source solutions.

Instead of individually maintaining all those similar solutions, let’s
join together and collectively maintain a single solution.

If that sounds good to you, there’s an Infra-spec that’s been approved
[2] to refactor much of what the Infrastructure team uses for the
upstream “Jenkins” CI to be more easily reusable by many of us.

We’ve got stories defined [3], and a few patches submitted. We’re using
the gerrit-topic “downstream-puppet” [4].

For example, we’ve got the first part under review for the “Log Server”,
which creates your own version of http://logs.openstack.org/

If anyone is interested in migrating towards a common solution, reply,
or ping me IRC (asselin) on Freenode #openstack-infra, or join some of
the third party ci meetings [5].

Thanks!

Ramy

[1] https://wiki.openstack.org/wiki/ThirdPartySystems

[2]
http://specs.openstack.org/openstack-infra/infra-specs/specs/openstackci.html

[3] https://storyboard.openstack.org/#!/story/2000101

[4] https://review.openstack.org/#/q/topic:downstream-puppet,n,z

[5]
https://wiki.openstack.org/wiki/Meetings/ThirdParty#Weekly_Third_Party_meetings



__
OpenStack Development Mailing List (not for usage questions)
Unsubscribe: openstack-dev-requ...@lists.openstack.org?subject:unsubscribe
http://lists.openstack.org/cgi-bin/mailman/listinfo/openstack-dev



__
OpenStack Development Mailing List (not for usage questions)
Unsubscribe: openstack-dev-requ...@lists.openstack.org?subject:unsubscribe
http://lists.openstack.org/cgi-bin/mailman/listinfo/openstack-dev


Re: [openstack-dev] [neutron] [QoS] weekly meeting - update

2015-04-20 Thread Ihar Hrachyshka
-BEGIN PGP SIGNED MESSAGE-
Hash: SHA256

On 04/20/2015 12:20 PM, Miguel Angel Ajo Pelayo wrote:
 Thank you Irena,
 
 I believe this last minute change deserves an explanation, I asked 
 Irena to write to the list on my behalf (thank you!).
 
 I got a surgery to one of my kids scheduled on Wednesday (it’s
 something very mild near the ear), also it’s holiday for a few of
 the participants that were intending to join.

I hope your kid (and you) will be well.

 
 I hope it works for most of you, otherwise we will all be available
 on next Wednesday 29th as planned.

Note that the proposed time conflicts with general neutron meeting.
/Ihar
-BEGIN PGP SIGNATURE-
Version: GnuPG v2

iQEcBAEBCAAGBQJVNQK/AAoJEC5aWaUY1u578PcIAL7FkO+wSV4AdkcjIrFNbrcX
aHmbV9pYYkUf3GTrBfqBzJ37XqApSCrFinZPpg7vrDfp1TLxvWXBoh8HhBrJUiv3
ItqEGpixotKcuT06E0QSm76p6ZkIFffy68Iudj1dX1bLVuDa7VU59jcBxo9H3EMQ
Ei4Vtvf3M1a8wPZV+FHcySzkjrLNJNlgUCHOy/h5JCWC26nGxKHciFYxXz82HQpQ
V6o2d+tyLAkJnkIkmbUuRfOLoZaBFwc7ortS1CEt00fMux6EyoNmuhouBZxoUp84
IKZsSDea8QRciHFot1mUA4cF9Up1vFiNuy9K3FOh8VuNCxzc2Un0sGtjIP6zdb0=
=Poy8
-END PGP SIGNATURE-

__
OpenStack Development Mailing List (not for usage questions)
Unsubscribe: openstack-dev-requ...@lists.openstack.org?subject:unsubscribe
http://lists.openstack.org/cgi-bin/mailman/listinfo/openstack-dev


[openstack-dev] [mistral] Mistral Kilo RC1 released!

2015-04-20 Thread Renat Akhmerov
Hi all,

Another milestone of Mistral (Kilo RC1) is released!

Below are the links to Mistral and Mistral Client release pages where you can 
find downloadables and info about fixed bugs.

Mistral: https://launchpad.net/mistral/kilo/kilo-rc1 
https://launchpad.net/mistral/kilo/kilo-rc1
Mistral Client: https://launchpad.net/python-mistralclient/kilo/kilo-rc1 
https://launchpad.net/python-mistralclient/kilo/kilo-rc1

Thanks

Renat Akhmerov
@ Mirantis Inc.



__
OpenStack Development Mailing List (not for usage questions)
Unsubscribe: openstack-dev-requ...@lists.openstack.org?subject:unsubscribe
http://lists.openstack.org/cgi-bin/mailman/listinfo/openstack-dev


Re: [openstack-dev] [oslo][pbr] getting 0.11 out the door. Maybe even 1.0

2015-04-20 Thread Ihar Hrachyshka
-BEGIN PGP SIGNED MESSAGE-
Hash: SHA256

On 04/20/2015 02:22 PM, Victor Stinner wrote:
 I believe Redhat patch it out. I don't think they should need
 to, since we have explicit knobs for distros to use.
 
 pbr pulls pip which we don't want in RHEL. Example of patches in
 RDO:
 
 https://github.com/redhat-openstack/nova/commit/a19939c8f9a7b84b8a4d71
3fe3d26949e5664089

 
https://github.com/redhat-openstack/python-keystoneclient/commit/e02d529
a87aef8aaca0616c8ee81de224bf1f52a
 https://github.com/redhat-openstack/neutron/commit/85302b75362df302703
83e3a373e60e81b1b2384

 
(well, it's always the same change)

AFAIK Delorean (aka RDO/master) stopped doing it. The approach remains
for RHEL-OSP to avoid python-pbr (and python-pip) dependencies. That
said, I am not sure we should do it in RHEL-OSP too. If RHEL does not
want to see python-pip in their repos, then RHEL-OSP could ship it
with its repositories (?).

I think you should reach Alan Pevec on the matter since he is involved
in pbr cleanup.

/Ihar
-BEGIN PGP SIGNATURE-
Version: GnuPG v2

iQEcBAEBCAAGBQJVNPOfAAoJEC5aWaUY1u57HqUIALdQ+GsUQA9Nc+0nLuUBLM49
nOQtsIqp8giNfO2o897ll1uM93VD4io5fLXaNrp6K7jKba6e6bjlCRPjybuwbAQD
gNrfZzB4ZAUMVDj4o4Ftl/kwnS1ijx1EoRV/D7YWgzU0VF//qVyBHxZNv8+TdV/U
pF/ij5ZJi5TdnBO8QpIo91GmEFvR0ibhWNxCoEbOjdpSDcHUtfYNqR3pX/8mGk4d
tGn3hN1mijvUPgcnHfv9aoh4KAti6sGMcVHgFZ4lq1ihvoRGUCOfh9tPGeZwqcrj
K+znsfsZC6sq11h4pZUZ6ZZ3QKqyCJ/xLxuR23ThnXKi3mzQG99rhnRvoxTdOPc=
=7WTq
-END PGP SIGNATURE-

__
OpenStack Development Mailing List (not for usage questions)
Unsubscribe: openstack-dev-requ...@lists.openstack.org?subject:unsubscribe
http://lists.openstack.org/cgi-bin/mailman/listinfo/openstack-dev


[openstack-dev] [mistral] Mistral team meeting reminder - 04/20/2015

2015-04-20 Thread Renat Akhmerov
This is a reminder about a team meeting today that we’ll hold at 
#openstack-mistral at 16.20 UTC.

Agenda:
Review action items
Current status (progress, issues, roadblocks, further plans)
What's left to do in Kilo? (critical bugs, docs etc.)
Open discussion

[0] https://wiki.openstack.org/wiki/Meetings/MistralAgenda 
https://wiki.openstack.org/wiki/Meetings/MistralAgenda 

Renat Akhmerov
@ Mirantis Inc.



__
OpenStack Development Mailing List (not for usage questions)
Unsubscribe: openstack-dev-requ...@lists.openstack.org?subject:unsubscribe
http://lists.openstack.org/cgi-bin/mailman/listinfo/openstack-dev


Re: [openstack-dev] [oslo][pbr] getting 0.11 out the door. Maybe even 1.0

2015-04-20 Thread Victor Stinner
 I don't think its a bug in the applications.

swift gets its version using pkg_resources, or falls back to pbr:
https://github.com/openstack/swift/blob/master/swift/__init__.py

I mean that other applications may do something similar?

Victor

__
OpenStack Development Mailing List (not for usage questions)
Unsubscribe: openstack-dev-requ...@lists.openstack.org?subject:unsubscribe
http://lists.openstack.org/cgi-bin/mailman/listinfo/openstack-dev


Re: [openstack-dev] [oslo][pbr] getting 0.11 out the door. Maybe even 1.0

2015-04-20 Thread Ryan Brown
On 04/20/2015 08:22 AM, Victor Stinner wrote:
 I believe Redhat patch it out. I don't think they should need to,
 since we have explicit knobs for distros to use.
 
 pbr pulls pip which we don't want in RHEL. Example of patches in RDO:
 
 https://github.com/redhat-openstack/nova/commit/a19939c8f9a7b84b8a4d713fe3d26949e5664089
 https://github.com/redhat-openstack/python-keystoneclient/commit/e02d529a87aef8aaca0616c8ee81de224bf1f52a
 https://github.com/redhat-openstack/neutron/commit/85302b75362df30270383e3a373e60e81b1b2384
 (well, it's always the same change)
 
 Can't we enhance pbr to build (source/wheel) distributions of applications 
 which don't depend on pbr? Basically implement these patches in pbr?
 
 I read somewhere that pkg_resources may also be used to get the version.
 

You're absolutely correct, here's a quick snippet to get the version as
a string:

import pkg_resources
pkg_resources.get_distribution('nova').version

Where, of course, s/nova/any-package-name/

-- 
Ryan Brown / Software Engineer, Openstack / Red Hat, Inc.

__
OpenStack Development Mailing List (not for usage questions)
Unsubscribe: openstack-dev-requ...@lists.openstack.org?subject:unsubscribe
http://lists.openstack.org/cgi-bin/mailman/listinfo/openstack-dev


Re: [openstack-dev] [third-party][infra] Third-Party CI Operators: Let's use a common CI Solution!

2015-04-20 Thread Anita Kuno
On 04/20/2015 03:19 AM, Jaume Devesa wrote:
 Hi Ramy,
 
 Soon I'll be the responsible of the Midokura's third-party CI, which has been
 mute for a while because a flaky physical resources that our sys admins
 couldn't take care because they are overloaded of work...
 
 Count on me!
I do hope luqas will still be available some times, he has been so
proactive. It has been wonderful to work with him. I'm looking forward
to getting to know you as well, Jaume.

Thanks Asselin, for kicking off this thread, you have been doing
wonderful work here. It is great to see you have reached this place. I
am really looking forward to your work continuing, making installing and
maintaining a ci easier for both operators and for infra.

Thank you,
Anita.
 
 On Mon, 20 Apr 2015 05:17, Asselin, Ramy wrote:
 All Third-Party CI operators:

 We’ve got 85 Third Party CI systems registered in the wiki[1], all of them 
 running a variety of closed  open-source solutions.
 Instead of individually maintaining all those similar solutions, let’s join 
 together and collectively maintain a single solution.

 If that sounds good to you, there’s an Infra-spec that’s been approved [2] 
 to refactor much of what the Infrastructure team uses for the upstream 
 “Jenkins” CI to be more easily reusable by many of us.

 We’ve got stories defined [3], and a few patches submitted. We’re using the 
 gerrit-topic “downstream-puppet” [4].

 For example, we’ve got the first part under review for the “Log Server”, 
 which creates your own version of http://logs.openstack.org/

 If anyone is interested in migrating towards a common solution, reply, or 
 ping me IRC (asselin) on Freenode #openstack-infra, or join some of the 
 third party ci meetings [5].

 Thanks!
 Ramy

 [1] https://wiki.openstack.org/wiki/ThirdPartySystems
 [2] 
 http://specs.openstack.org/openstack-infra/infra-specs/specs/openstackci.html
 [3] https://storyboard.openstack.org/#!/story/2000101
 [4] https://review.openstack.org/#/q/topic:downstream-puppet,n,z
 [5] 
 https://wiki.openstack.org/wiki/Meetings/ThirdParty#Weekly_Third_Party_meetings


 
 __
 OpenStack Development Mailing List (not for usage questions)
 Unsubscribe: openstack-dev-requ...@lists.openstack.org?subject:unsubscribe
 http://lists.openstack.org/cgi-bin/mailman/listinfo/openstack-dev
 
 


__
OpenStack Development Mailing List (not for usage questions)
Unsubscribe: openstack-dev-requ...@lists.openstack.org?subject:unsubscribe
http://lists.openstack.org/cgi-bin/mailman/listinfo/openstack-dev


Re: [openstack-dev] [neutron][L3] IPAM alternate refactoring

2015-04-20 Thread Salvatore Orlando
On 19 April 2015 at 02:23, Jay Pipes jaypi...@gmail.com wrote:

 On 04/13/2015 12:39 PM, Carl Baldwin wrote:

 On Mon, Apr 13, 2015 at 8:44 AM, Pavel Bondar pbon...@infoblox.com
 wrote:

 Hi,

 I made some investigation on the topic[1] and see several issues on this
 way.

 1. Plugin's create_port() is wrapped up in top level transaction for
 create floating ip case[2], so it becomes more complicated to do IPAM
 calls outside main db transaction.


 Is it time to look at breaking the bond between a floating and a port?


 IMO, yes.


I already expressed my opinion on the matter in [1].
But I think you should stay focused on a viable strategy for taking IPAM
out of db_base_plugin_v2 and not make this another gargantuan task.




I think the only reason that a port is created to back a floating IP
 is for IPAM because IP addresses are only reserved by creating a port
 with it.

 I'm sure this won't be very easy but I think it is worth a look to see
 what will be involved.


 Why can't port creation be done entirely separately from assigning some
 *thing* -- i.e. a floating IP -- to that port?

 The creation of a port can be done in a separate DB transaction.
 Assignment of said port ID to a floating IP resource can be done in a
 separate DB transaction (or external IPAM system call).


The current logic makes non trivial to split transactions for port and
floating IP creation. Since at the end of day I hope we'll converge to a
consensus where that port isn't needed, I hope it will be not too difficult
to do the IPAM transactions separately and then pass to the operation which
creates the floating IP the IP address which was allocated for it on the
external network.



 Trying to trace the DB transaction scope through all the mess of mixin
 classes in Neutron is, well, extremely mind-boggling.


It is actually not that mind blogging... in general every method
corresponds to a single ginormous transaction without savepoints. What is
mindbloggin is following the evolution of said transaction across mixings
and understanding the myriad of point where it can abort.



 Best,
 -jay



[1]
http://lists.openstack.org/pipermail/openstack-dev/2014-January/024323.html



 __
 OpenStack Development Mailing List (not for usage questions)
 Unsubscribe: openstack-dev-requ...@lists.openstack.org?subject:unsubscribe
 http://lists.openstack.org/cgi-bin/mailman/listinfo/openstack-dev

__
OpenStack Development Mailing List (not for usage questions)
Unsubscribe: openstack-dev-requ...@lists.openstack.org?subject:unsubscribe
http://lists.openstack.org/cgi-bin/mailman/listinfo/openstack-dev


Re: [openstack-dev] [all][code quality] Voting coverage job (-1 if coverage get worse after patch)

2015-04-20 Thread Jay Pipes

On 04/20/2015 07:13 AM, Sean Dague wrote:

On 04/18/2015 09:30 PM, Boris Pavlovic wrote:

Hi stackers,

Code coverage is one of the very important metric of overall code
quality especially in case of Python. It's quite important to ensure
that code is covered fully with well written unit tests.

One of the nice thing is coverage job.

In Rally we are running it against every check which allows us to get
detailed information about
coverage before merging patch:
http://logs.openstack.org/84/175084/1/check/rally-coverage/c61d5e1/cover/

This helped Rally core team to automate checking that new/changed code
is covered by unit tests and we raised unit test coverage from ~78% to
almost 91%.

But it produces few issues:
1) 9k nitpicking - core reviewers have to put -1 if something is not
covered by unit tests
2) core team scaling issues - core team members spend a lot of time just
checking that whole code is covered by unit test and leaving messages
like this should be covered by unit test
3) not friendly community - it's not nice to get on your code -1 from
somebody that is asking just to write unit tests
4) coverage regressions - sometimes we accidentally accept patches that
reduce coverage

To resolve this issue I improved a bit coverage job in Rally project,
and now it compares master vs master + patch coverage. If new coverage
is less than master job is marked as -1.

Here is the patch for job enhancement:
https://review.openstack.org/#/c/174645/

Here is coverage job in action:
patch https://review.openstack.org/#/c/174677/
job message
http://logs.openstack.org/77/174677/4/check/rally-coverage/ba49c90/console.html#_2015-04-17_15_57_17_695


Honestly, I'm suspicious of approaches like this. While 90% coverage is
clearly better than 0% coverage, it's not clear that 91% coverage is
always better than 90% coverage. Especially when you talk about larger
and more complex code bases.


Well, I think there are very few cases where *less* coverage is better.


I actually firmly feel that #3 is wrong. I think it's a lot better to
have an early conversation with people about unit tests that need to be
written when they don't submit any. Because I think it's a lot less
friendly to have someone iterate 10 patches to figure out how to pass a
bot's idea of good tests, and then have a reviewer say it's wrong.


This I completely agree with. Asking for unit tests is a common thing, 
and if done early in the review process, is not a non-friendly thing. 
It's just matter of fact. And if the comment is given with some example 
unit test code -- or a pointer to a unit test that could be used as an 
example -- even better. It grows the submitter.



Honestly, coverage for projects seems to me to be more of an analog
measure that would be good to graph over time and make sure it's not
regression, but personally I think the brownian motion of individual
patches seems like it's not a great idea to gate on every single patch.
I personally would be -1 for adding this to projects that I have +2 on.


I certainly am not opposed to introducing coverage regression jobs that 
produce a history of coverage. I would not personally support them being 
a blocking/gate job, though.


Best,
-jay

__
OpenStack Development Mailing List (not for usage questions)
Unsubscribe: openstack-dev-requ...@lists.openstack.org?subject:unsubscribe
http://lists.openstack.org/cgi-bin/mailman/listinfo/openstack-dev


Re: [openstack-dev] [puppet] Welcome to Puppet 4.0

2015-04-20 Thread Gaël Chamoulaud
On 19/Apr/2015 .::. 14:18, Emilien Macchi wrote:
 We are adding Puppet 4.0 unit testing jobs support as non-voting for
 now: https://review.openstack.org/175145
 
 The workflow will be:
 * have the non-voting jobs in check pipeline
 * make the test work for our modules

First, rspec-puppet have to support Puppet 4.0.
Hunter already proposed a PR for that [1]!

 * patch project-config to add the job in gate too, and drop the
 non-voting tag
 
 Since we are already checking Puppet 4.x lint, I'm confident to have the
 jobs voting very soon.

[1] - https://github.com/rodjek/rspec-puppet/pull/265
[2] - https://github.com/rodjek/rspec-puppet/issues/263

Best Regards, Gaël.

-- 
Gaël Chamoulaud
Openstack Engineering
Mail: [gchamoul|gael] at redhat dot com
IRC: strider/gchamoul (Red Hat), gchamoul (Freenode)
GnuPG Key ID: 7F4B301
C75F 15C2 A7FD EBC3 7B2D CE41 0077 6A4B A7F4 B301

Freedom...Courage...Commitment...Accountability


signature.asc
Description: PGP signature
__
OpenStack Development Mailing List (not for usage questions)
Unsubscribe: openstack-dev-requ...@lists.openstack.org?subject:unsubscribe
http://lists.openstack.org/cgi-bin/mailman/listinfo/openstack-dev


Re: [openstack-dev] [oslo][pbr] getting 0.11 out the door. Maybe even 1.0

2015-04-20 Thread Victor Stinner
 I believe Redhat patch it out. I don't think they should need to,
 since we have explicit knobs for distros to use.

pbr pulls pip which we don't want in RHEL. Example of patches in RDO:

https://github.com/redhat-openstack/nova/commit/a19939c8f9a7b84b8a4d713fe3d26949e5664089
https://github.com/redhat-openstack/python-keystoneclient/commit/e02d529a87aef8aaca0616c8ee81de224bf1f52a
https://github.com/redhat-openstack/neutron/commit/85302b75362df30270383e3a373e60e81b1b2384
(well, it's always the same change)

Can't we enhance pbr to build (source/wheel) distributions of applications 
which don't depend on pbr? Basically implement these patches in pbr?

I read somewhere that pkg_resources may also be used to get the version.

Victor

__
OpenStack Development Mailing List (not for usage questions)
Unsubscribe: openstack-dev-requ...@lists.openstack.org?subject:unsubscribe
http://lists.openstack.org/cgi-bin/mailman/listinfo/openstack-dev


Re: [openstack-dev] [keystone] keystoneclient stable/icehouse broken

2015-04-20 Thread Ihar Hrachyshka
-BEGIN PGP SIGNED MESSAGE-
Hash: SHA1

On 04/20/2015 12:34 AM, Brant Knudson wrote:
 
 
 On Sun, Apr 19, 2015 at 3:07 PM, Brant Knudson b...@acm.org 
 mailto:b...@acm.org wrote:
 
 
 Ever since the stable/icehouse branch was created for 
 python-keystoneclient it's been broken. There are a couple of
 issues:
 
 1) The gate-python-keystoneclient-python34 job is failing with the 
 error ERROR: InterpreterNotFound: python3.4. I don't know why
 it's not available. Maybe python3 needs to be installed on the
 instance or maybe the job should not be run for stable/icehouse. No
 fix has been proposed for this as far as I know. I'll need some
 help from infra to figure it out.
 
 
 For this one, the job was just removed via an infra change, see 
 https://review.openstack.org/#/c/175235/ .

Should we make it global for all clients?
/Ihar
-BEGIN PGP SIGNATURE-
Version: GnuPG v2

iQEcBAEBAgAGBQJVNLg2AAoJEC5aWaUY1u57TeoIALuFs9uy69I/p6HcIVQc2R6I
0z8aidrbRZsOPsCHIB7V0Xg3zXx9Okxwn+ykuYLHUyyMFPnT+sGPbOCBYVuWxCWb
CrP4AKUqdBJC3uvKY3bpxMEe5n4N/IGnEPNPuDmag+mNDh8oy15e1QITlVEIft5f
nWOvxZMzztOp0yx/N6bbXlcN9/8FkbK58vP2M6sIKy3Tnt0Ndl30U/IP/1RwJbuT
oQcAAAUiNmFExzDrOZXdEs6ZRuGZTOrU+W61SJXF0mhrTh0TxS/7dYY4w6QWDqMq
VmYDlHEYUeGKu5y7Gl2Rxy9hWXm0GxF5/CZwzI0647uuPS723Zd8HEBMTvxJjQQ=
=cUVP
-END PGP SIGNATURE-

__
OpenStack Development Mailing List (not for usage questions)
Unsubscribe: openstack-dev-requ...@lists.openstack.org?subject:unsubscribe
http://lists.openstack.org/cgi-bin/mailman/listinfo/openstack-dev


Re: [openstack-dev] [opentack-dev][meetings] Proposing changes in Rally meetings

2015-04-20 Thread Mikhail Dubov
Hi Boris,

thanks for your proposal.

As for the agenda, I really think it's important to have it in advance. How
are we going to prepare it? Google docs? Who is going to be responsible for
that?

As for the meeting time, I'm ok with 15:00 UTC, as well as with some
earlier time that would satisfy Yair.

As for the meeting days, I think that having two meetings on two days in a
row (Monday-Tuesday) may be a bit too tough. What if we make one meeting on
Tuesday and the other on Thursday? Like the first one near the beginning of
the week, and the other towards the end of the week.

Best wishes,
Mikhail

Best regards,
Mikhail Dubov

Engineering OPS
Mirantis, Inc.
E-Mail: mdu...@mirantis.com
Skype: msdubov

On Sun, Apr 19, 2015 at 8:28 AM, Yair Fried yfr...@redhat.com wrote:



 --

 *From: *Aleksandr Maretskiy amarets...@mirantis.com
 *To: *Andrey Kurilin akuri...@mirantis.com
 *Cc: *Boris Pavlovic bo...@pavlovic.me, OpenStack Development
 Mailing List openstack-dev@lists.openstack.org, yfr...@redhat.com,
 yingjun li yingjun...@kylin-cloud.com, Mikhail Dubov 
 msdu...@gmail.com, Oleg Anufriev oanufr...@mirantis.com, Roman
 Vasilets rvasil...@mirantis.com, Sergey Skripnick 
 sskripn...@mirantis.com
 *Sent: *Saturday, April 18, 2015 1:00:55 PM
 *Subject: *Re: [opentack-dev][meetings] Proposing changes in Rally
 meetings

 Agreed with everything, but I think it would be a bit better if move one
 meeting from Monday to another day (Andrey K. is right)


 On Fri, Apr 17, 2015 at 5:35 PM, Andrey Kurilin akuri...@mirantis.com
 wrote:

   - We should start making agenda for each meeting and publish it to
 Rally wiki

 +1

 +1



  * Second is release management meeting, where we are discussing
 priorities for
current  next release. So core team will know what to review
 first.

 It would be nice to post list of high priority patches to etherpad or
 google docs after each meeting



   - Move meetings from #openstack-meeting to #openstack-rally chat.

 doesn't matter for me:)

 As long as the records are kept.



- We should adjust better time for current Rally team.

 yeah. Current time is not good:( +1 for 15:00 UTC

 I'd like even earlier, but if it works for everyone else, I'll make the
 effort.



   - Do meetings every Monday and Wednesday

 Monday?) Monday is very hard day...



 On Fri, Apr 17, 2015 at 4:26 PM, Boris Pavlovic bo...@pavlovic.me
 wrote:

 Rally team,


 I would like to propose next changes in Rally meetings:

   - We should start making agenda for each meeting and publish it to
 Rally wiki

   - We should do 2 meeting per week:

  * First is regular meeting (like we have now) where we are
 discussing everything
  * Second is release management meeting, where we are discussing
 priorities for
current  next release. So core team will know what to review
 first.

 Seems like the 2nd meeting is mainly for core, so maybe we can set a
 better(earlier) time for it among a smaller group?


   - Move meetings from #openstack-meeting to #openstack-rally chat.

   - We should adjust better time for current Rally team. Like at the
 moment it is too late
  for few of cores in Rally. it's 17:00 UTC and I would like to
 suggest to make at 15:00 UTC.

   - Do meetings every Monday and Wednesday


 Thoughts ?

 Best regards,
 Boris Pavlovic




 --
 Best regards,
 Andrey Kurilin.




 __
 OpenStack Development Mailing List (not for usage questions)
 Unsubscribe: openstack-dev-requ...@lists.openstack.org?subject:unsubscribe
 http://lists.openstack.org/cgi-bin/mailman/listinfo/openstack-dev


__
OpenStack Development Mailing List (not for usage questions)
Unsubscribe: openstack-dev-requ...@lists.openstack.org?subject:unsubscribe
http://lists.openstack.org/cgi-bin/mailman/listinfo/openstack-dev


[openstack-dev] [Rally] Rally release management changes and future worfklow

2015-04-20 Thread Mikhail Dubov
Hi all,

as some of you probably know, Rally has recently adopted a release-based
software development model. The latest release is 0.0.3 (appeared on Apr
14).

We have set as our goal to have a new release every 2-3 weeks. Since this
is quite ambitious and not so easy to achieve, we are also going to set up
a certain release management process:

   - We are going to have a special IRC meeting at *#openstack-rally* for
   release discussions. At this weekly meeting, we will discuss the goals for
   the next release, as well as the progress on them.
   - The features that are to be implemented in the next release will be
   posted in a special Google doc
   
https://docs.google.com/document/d/1TX5zpYcTX8AXm-K_h1lzUNVCMvbRgsjUKU-dEYNWLY8/edit?usp=sharing.
   This doc is open for anyone to view  comment. For code reviewers, this
   document should serve as a link to the patches with the highest priority.
   - Bugs on Launchpad https://bugs.launchpad.net/rally will be used as
   well to indicate issues that are to be fixed in the next release.
   - The release process will be managed by Mikhail Dubov, a Rally core
   reviewer from Mirantis.


Best regards,
Mikhail Dubov

Engineering OPS
Mirantis, Inc.
E-Mail: mdu...@mirantis.com
Skype: msdubov
__
OpenStack Development Mailing List (not for usage questions)
Unsubscribe: openstack-dev-requ...@lists.openstack.org?subject:unsubscribe
http://lists.openstack.org/cgi-bin/mailman/listinfo/openstack-dev


[openstack-dev] [taskflow][glance][debian] Issue with ordereddict

2015-04-20 Thread stuart . mclaren

Hi,

Debian are hitting this issue https://bugs.launchpad.net/glance/+bug/1445827.

Currently glance and glance_store include ordereddict in their
requirements.txt.  Since Glance no longer gates on py26 I think it should
be ok to remove that requirement from glance and glance_store
 (both repos have stable branches) which should partially fix the issue.

taskflow also seems to have this dependency:

 $ cat ./.tox/py27/lib/python2.7/site-packages/taskflow-0.7.1.dist-info/  
METADATA|grep order
 Requires-Dist: ordereddict

but, unlike glance, it still gates on py26. As I understand it, removing
this from taskflow's requirements would cause its py26 gate job to
start failing.

I'm interested in suggestions from the taskflow folks on what the best
thing to do here is.

Thanks,

-Stuart

__
OpenStack Development Mailing List (not for usage questions)
Unsubscribe: openstack-dev-requ...@lists.openstack.org?subject:unsubscribe
http://lists.openstack.org/cgi-bin/mailman/listinfo/openstack-dev


Re: [openstack-dev] TC candidacy

2015-04-20 Thread Tristan Cacqueray
confirmed

On 04/20/2015 05:56 AM, Thierry Carrez wrote:
 Hello list,
 
 I'm announcing my candidacy for the Technical Committee elections.
 
 I have been serving as the chair of the Technical Committee since its
 inception, but I think we are at a critical point in the evolution of
 the role of the Technical Committee, and if you allow it, I'd like to be
 around to help drive us through this transition.
 
 In particular, I'd like the Technical Committee to push in 3 new
 directions during the Liberty cycle:
 
 
 1. Step out of the way
 
 As I explained on [1], I think over the last cycles the TC pushed the
 regulation and ask for permission cursor so far we actually start
 preventing things from happening. I'd like us to come back to a point
 where our community is more trusted by default, where it asks more for
 forgiveness and less for permission. So I'd like the Technical Committee
 to look into its processes and see where it can remove itself from the
 action pipeline, and retreat back to being an appeals board should a
 problem arise.
 
 [1] http://ttx.re/stepping-out-of-the-way.html
 
 
 2. Start addressing real issues
 
 I think it is part of the role of the Technical Committee members to
 detect, investigate and help solving issues in our development
 community. As we grow, we can't expect every member to know everything
 about every project in OpenStack. But each member should be able to dive
 into specific project(s) and report issues to the group. Subgroups of
 members should be able to work together on proposing plans to solve
 long-standing issues. That means spending more than one hour per week on
 TC matters, which is why I'd like us to give preference in TC elections
 to candidates who have enough time on their hands, as explained on [2].
 
 [2] http://ttx.re/tech-committee-candidates.html
 
 
 3. Push toward both ends of the scale space
 
 Taking a step back on those last 5 years, I think the natural forces
 behind OpenStack development made us cover the middle-tier of usage
 quite well: reasonably large private IaaS systems (~10k VMs) with a need
 for extra features and accepting the resulting complexity. They did not
 make us cover the hyper-scale end (public clouds with millions of VMs in
 a very active usage pattern) that well, because that end
 is a specific use case that needs specific trade-offs, and not so many
 users need/push those. And it did not make us cover the basic system
 end, where people want to deploy a base IaaS compute system without
 bells and whistles, and without a team of 100 admins, most of them SDN
 specialists.
 
 Our development ecosystem won't naturally go and cover those use cases
 (lack of business and/or market), but those are essential long-term. We
 all need extremely-large OpenStack public clouds to burst hybrid
 workloads to. And we all need people to be able to experiment with
 OpenStack in POCs, labs and universities. This is the two directions I
 want to encourage in the near future.
 
 
 More generally, I think it is the role of the Technical Committee
 members to provide a long-term vision. To influence where we are going,
 beyond where the market forces push us. To inspire our developers to
 work (or support work) to cover areas that their employer might not
 immediately care about in the short term. To make OpenStack better and
 more universal in the long run.
 
 Thanks for your consideration,
 




signature.asc
Description: OpenPGP digital signature
__
OpenStack Development Mailing List (not for usage questions)
Unsubscribe: openstack-dev-requ...@lists.openstack.org?subject:unsubscribe
http://lists.openstack.org/cgi-bin/mailman/listinfo/openstack-dev


[openstack-dev] [Zaqar] Call for adoption (or exclusion?)

2015-04-20 Thread Flavio Percoco

Greetings,

I'd like my first action as Zaqar's PTL to be based on reflections and
transparency with regards to what our past has been, to what our
present is and to what our future could be as a project and community.
Therefore, I'm sending this call for adoption and support before
taking other actions (also mentioned below).

The summit is very close and the Zaqar team is looking forward to it.

The upcoming summit represents an important opportunity for Zaqar to
integrate with other projects. In the previous summits - since
Icehouse's - we've been collecting feedback from the community. We've
worked on addressing the many use-cases, we've worked on addressing
the concerns raised by the community and we've also kept moving
towards reaching the project's goals.

As you all know, the project has gone through many ups and downs.
We've had some failures in the past and we've also had successes, as
a project and as a team. Nevertheless, we've got to the point where it
doesn't make much sense to keep pushing new features to the project
until it gains adoption. Therefore, I'd like to take advantage of the
workshop slots and invite people from other projects to help us/guide
us through a hacking session on their projects so we can help with the
adoption. The current adoption of Zaqar consist in:

- 1 company reachingunning it in production
- 1 planning to do it soon
- RDO support

Unfortunately, the above is certainly not enough for a project to
succeed and it makes the time and effort spent on the project not
worth it. It's been more than 2 years since we kicked the project off
and it's time for it to show some results. The current problem seems
to be that many people want the project but no one wants to be the
first in adopting Zaqar (which kind of invalidates the premises of the
Big tent).

In summary, this is a call for adoption before we call it a nice
adventure and ask for the project to be excluded from the OpenStack
organization based on the lack of adoption and contributions.

If you think it's worth it, speak up. Either way, thanks for the
support and for reading thus far.

On behalf of the Zaqar team,
Flavio

--
@flaper87
Flavio Percoco


pgpYJfTYIMlv6.pgp
Description: PGP signature
__
OpenStack Development Mailing List (not for usage questions)
Unsubscribe: openstack-dev-requ...@lists.openstack.org?subject:unsubscribe
http://lists.openstack.org/cgi-bin/mailman/listinfo/openstack-dev


Re: [openstack-dev] [all][Zaqar] Call for adoption (or exclusion?)

2015-04-20 Thread Flavio Percoco

Tagging as `[all]`, sorry about that!

On 20/04/15 14:54 +0200, Flavio Percoco wrote:

Greetings,

I'd like my first action as Zaqar's PTL to be based on reflections and
transparency with regards to what our past has been, to what our
present is and to what our future could be as a project and community.
Therefore, I'm sending this call for adoption and support before
taking other actions (also mentioned below).

The summit is very close and the Zaqar team is looking forward to it.

The upcoming summit represents an important opportunity for Zaqar to
integrate with other projects. In the previous summits - since
Icehouse's - we've been collecting feedback from the community. We've
worked on addressing the many use-cases, we've worked on addressing
the concerns raised by the community and we've also kept moving
towards reaching the project's goals.

As you all know, the project has gone through many ups and downs.
We've had some failures in the past and we've also had successes, as
a project and as a team. Nevertheless, we've got to the point where it
doesn't make much sense to keep pushing new features to the project
until it gains adoption. Therefore, I'd like to take advantage of the
workshop slots and invite people from other projects to help us/guide
us through a hacking session on their projects so we can help with the
adoption. The current adoption of Zaqar consist in:

- 1 company reachingunning it in production
- 1 planning to do it soon
- RDO support

Unfortunately, the above is certainly not enough for a project to
succeed and it makes the time and effort spent on the project not
worth it. It's been more than 2 years since we kicked the project off
and it's time for it to show some results. The current problem seems
to be that many people want the project but no one wants to be the
first in adopting Zaqar (which kind of invalidates the premises of the
Big tent).

In summary, this is a call for adoption before we call it a nice
adventure and ask for the project to be excluded from the OpenStack
organization based on the lack of adoption and contributions.

If you think it's worth it, speak up. Either way, thanks for the
support and for reading thus far.

On behalf of the Zaqar team,
Flavio

--
@flaper87
Flavio Percoco





__
OpenStack Development Mailing List (not for usage questions)
Unsubscribe: openstack-dev-requ...@lists.openstack.org?subject:unsubscribe
http://lists.openstack.org/cgi-bin/mailman/listinfo/openstack-dev



--
@flaper87
Flavio Percoco


pgp4jv4YE2K41.pgp
Description: PGP signature
__
OpenStack Development Mailing List (not for usage questions)
Unsubscribe: openstack-dev-requ...@lists.openstack.org?subject:unsubscribe
http://lists.openstack.org/cgi-bin/mailman/listinfo/openstack-dev


Re: [openstack-dev] [neutron] [QoS] weekly meeting - update

2015-04-20 Thread Miguel Angel Ajo Pelayo
Thank you Irena,

   I believe this last minute change deserves an explanation, I asked Irena to
write to the list on my behalf (thank you!).

   I got a surgery to one of my kids scheduled on Wednesday (it’s something
very mild near the ear), also it’s holiday for a few of the participants that 
were intending
to join.

  I hope it works for most of you, otherwise we will all be available on next 
Wednesday 29th
as planned.

   Best regards,
Miguel Ángel.

 On 20/4/2015, at 12:03, Irena Berezovsky irenab@gmail.com wrote:
 
 Hi,
 
 This week neutron QoS meeting will take place on Tuesday, April 21 at 14:00 
 UTC on #openstack-meeting-3.
 
 Next week, the meeting is back to its original slot: Wed at 14:00 UTC on 
 #openstack-meeting-3.
 
 Please join if you are interested.
 
 __
 OpenStack Development Mailing List (not for usage questions)
 Unsubscribe: openstack-dev-requ...@lists.openstack.org?subject:unsubscribe
 http://lists.openstack.org/cgi-bin/mailman/listinfo/openstack-dev

Miguel Angel Ajo



__
OpenStack Development Mailing List (not for usage questions)
Unsubscribe: openstack-dev-requ...@lists.openstack.org?subject:unsubscribe
http://lists.openstack.org/cgi-bin/mailman/listinfo/openstack-dev


Re: [openstack-dev] [nova] Dropping DB Downgrades, need Turbo Hipster tests updated

2015-04-20 Thread Joshua Hesketh
Hi Sean,

Thanks for your work on this. I'll take a closer look tomorrow and remove the 
downgrade testing from turbo-hipster in line with the TC decision.

Cheers,
Josh

From: Sean Dague s...@dague.net
Sent: Monday, 20 April 2015 8:38 PM
To: OpenStack Development Mailing List
Subject: [openstack-dev] [nova] Dropping DB Downgrades, need Turbo Hipster 
tests updated

This proposed patch to drop the db downgrades in Nova master is making
Turbo Hipster face plant - https://review.openstack.org/#/c/175010/

It appears that turbo hipster is walking all the way up, then walking
back down through migrations, which clearly, is no longer a thing.

It would be nice to merge this patch sooner rather than later, so would
be great if Turbo hipster could function on migrations without
downgrades RSN.

-Sean

--
Sean Dague
http://dague.net

__
OpenStack Development Mailing List (not for usage questions)
Unsubscribe: openstack-dev-requ...@lists.openstack.org?subject:unsubscribe
http://lists.openstack.org/cgi-bin/mailman/listinfo/openstack-dev


Rackspace Hosting Australia PTY LTD a company registered in the state of 
Victoria, Australia (company registered number ACN 153 275 524) whose 
registered office is at Level 1, 37 Pitt Street, Sydney, NSW 2000, Australia. 
Rackspace Hosting Australia PTY LTD privacy policy can be viewed at 
www.rackspace.com.au/company/legal-privacy-statement.php - This e-mail message 
may contain confidential or privileged information intended for the recipient. 
Any dissemination, distribution or copying of the enclosed material is 
prohibited. If you receive this transmission in error, please notify us 
immediately by e-mail at ab...@rackspace.com and delete the original message. 
Your cooperation is appreciated.

__
OpenStack Development Mailing List (not for usage questions)
Unsubscribe: openstack-dev-requ...@lists.openstack.org?subject:unsubscribe
http://lists.openstack.org/cgi-bin/mailman/listinfo/openstack-dev


Re: [openstack-dev] Fwd: Integration Gerrit with Launchpad

2015-04-20 Thread Andreas Jaeger

On 04/20/2015 09:26 AM, Kaneko Takehiro wrote:

Hi,

I'm managing a stackforge project and want to integrate Gerrit with
Launchpad.

Links;
   Git: https://git.openstack.org/cgit/stackforge/rack/
   Launchpad: https://launchpad.net/python-rack

Project name 'rack' is duplicated in Launchpad so I named our project
'python-rack'.
How can I integrate Gerrit with Launchpad in this case?


Send a patch for project-config repo, file gerrit/projects.yaml and add 
to your project:

groups:
   python-rack

Btw. this is documented in our infra manual:
http://docs.openstack.org/infra/manual/creators.html#add-the-project-to-the-master-project-list

Andreas
--
 Andreas Jaeger aj@{suse.com,opensuse.org} Twitter/Identica: jaegerandi
  SUSE LINUX GmbH, Maxfeldstr. 5, 90409 Nürnberg, Germany
   GF: Felix Imendörffer, Jane Smithard, Jennifer Guild, Dilip Upmanyu,
   Graham Norton, HRB 21284 (AG Nürnberg)
GPG fingerprint = 93A3 365E CE47 B889 DF7F  FED1 389A 563C C272 A126


__
OpenStack Development Mailing List (not for usage questions)
Unsubscribe: openstack-dev-requ...@lists.openstack.org?subject:unsubscribe
http://lists.openstack.org/cgi-bin/mailman/listinfo/openstack-dev


Re: [openstack-dev] Fwd: Integration Gerrit with Launchpad

2015-04-20 Thread Kaneko Takehiro
Andreas,

I missed it.
Thanks for your help.

Takehiro

2015-04-20 16:40 GMT+09:00 Andreas Jaeger a...@suse.com:

 On 04/20/2015 09:26 AM, Kaneko Takehiro wrote:

 Hi,

 I'm managing a stackforge project and want to integrate Gerrit with
 Launchpad.

 Links;
Git: https://git.openstack.org/cgit/stackforge/rack/
Launchpad: https://launchpad.net/python-rack

 Project name 'rack' is duplicated in Launchpad so I named our project
 'python-rack'.
 How can I integrate Gerrit with Launchpad in this case?


 Send a patch for project-config repo, file gerrit/projects.yaml and add to
 your project:
 groups:
python-rack

 Btw. this is documented in our infra manual:

 http://docs.openstack.org/infra/manual/creators.html#add-the-project-to-the-master-project-list

 Andreas
 --
  Andreas Jaeger aj@{suse.com,opensuse.org} Twitter/Identica: jaegerandi
   SUSE LINUX GmbH, Maxfeldstr. 5, 90409 Nürnberg, Germany
GF: Felix Imendörffer, Jane Smithard, Jennifer Guild, Dilip Upmanyu,
Graham Norton, HRB 21284 (AG Nürnberg)
 GPG fingerprint = 93A3 365E CE47 B889 DF7F  FED1 389A 563C C272 A126


 __
 OpenStack Development Mailing List (not for usage questions)
 Unsubscribe: openstack-dev-requ...@lists.openstack.org?subject:unsubscribe
 http://lists.openstack.org/cgi-bin/mailman/listinfo/openstack-dev

__
OpenStack Development Mailing List (not for usage questions)
Unsubscribe: openstack-dev-requ...@lists.openstack.org?subject:unsubscribe
http://lists.openstack.org/cgi-bin/mailman/listinfo/openstack-dev


Re: [openstack-dev] [release] release critical oslo.messaging changes

2015-04-20 Thread Thierry Carrez
Sean Dague wrote:
 Proposed actions are to do both of:
 
 - oslo.messaging release with heartbeats off by default (simulates 1.8.0
 behavior before the heartbeat code landed)
 - oslo.messaging requiring py-amqp = 1.4.0, so that if you enable the
 heartbeating, at least you are protected from the known bug

+1

Library releases are still blocked due to master requirements being
borked, but that should be solved soon now.

Regards,

-- 
Thierry Carrez (ttx)

__
OpenStack Development Mailing List (not for usage questions)
Unsubscribe: openstack-dev-requ...@lists.openstack.org?subject:unsubscribe
http://lists.openstack.org/cgi-bin/mailman/listinfo/openstack-dev


Re: [openstack-dev] [opentack-dev][meetings] Proposing changes in Rally meetings

2015-04-20 Thread Roman Vasilets
Hi,
Agree with all proposes. But maybe it's make sense to do a bigger interval
between mitings to make as much as possible work for the next meting.  For
example Monday/Thursday. Its not principal for me.

-Thanks, Roman Vasilets.

On Fri, Apr 17, 2015 at 4:26 PM, Boris Pavlovic bo...@pavlovic.me wrote:

 Rally team,


 I would like to propose next changes in Rally meetings:

   - We should start making agenda for each meeting and publish it to Rally
 wiki

   - We should do 2 meeting per week:

  * First is regular meeting (like we have now) where we are discussing
 everything

  * Second is release management meeting, where we are discussing
 priorities for
current  next release. So core team will know what to review
 first.

   - Move meetings from #openstack-meeting to #openstack-rally chat.

   - We should adjust better time for current Rally team. Like at the
 moment it is too late
  for few of cores in Rally. it's 17:00 UTC and I would like to suggest
 to make at 15:00 UTC.

   - Do meetings every Monday and Wednesday


 Thoughts ?


 Best regards,
 Boris Pavlovic

__
OpenStack Development Mailing List (not for usage questions)
Unsubscribe: openstack-dev-requ...@lists.openstack.org?subject:unsubscribe
http://lists.openstack.org/cgi-bin/mailman/listinfo/openstack-dev


Re: [openstack-dev] [oslo][pbr] getting 0.11 out the door. Maybe even 1.0

2015-04-20 Thread Victor Stinner
 If there's nothing majorly wrong mid-L, I'd like to release 1.0.0 just
 to get us into 'ok its stable' mentality.

I read that many packages modify the source code of libraries and applications 
to avoid a dependency to pbr at runtime. What's the status of this issue? Is 
pbr still used/required to get the version of a package a runtime?

I'm not sure that it's an issue in pbr itself. Maybe applications should be 
fixed instead.

(Sorry if it was already discussed and I missed the conclusion.)

Victor

__
OpenStack Development Mailing List (not for usage questions)
Unsubscribe: openstack-dev-requ...@lists.openstack.org?subject:unsubscribe
http://lists.openstack.org/cgi-bin/mailman/listinfo/openstack-dev


Re: [openstack-dev] [keystone] keystone middleware package changing release method in Liberty

2015-04-20 Thread Sean Dague
On 04/19/2015 12:54 PM, Morgan Fainberg wrote:
 
 
 On Sunday, April 19, 2015, Robert Collins robe...@robertcollins.net
 mailto:robe...@robertcollins.net wrote:
 
 On 18 April 2015 at 15:20, Morgan Fainberg
 morgan.fainb...@gmail.com javascript:; wrote:
  Hi everyone,
 
  I wanted to communicate to the community that the Keystone
 development team has determined that keystonemiddleware package
 should no longer be released in the same manner as the client
 libraries. Instead we will be releasing keystonemiddleware in the
 same manner as Keystone, in the coordinated style.
 
  There are a number of reasons but the largest factor is
 coordinating the requirements. Since keystonemiddleware runs in the
 process space / interpreter for the services (e.g. Nova) there is no
 expectation that the version of keystonemiddleware from Juno will
 run in Liberty nova (or vice versa).
 
  With this in mind we will be updating all of the testing and
 gating to make keystonemiddleware conform in the same manner as the
 services that utilize it. This change will start with the Liberty
 release cycle. Kilo and previous releases of OpenStack will continue
 to rely on the 1.x.x semver releases that mirror the stable/xxx
 branches of keystonemiddleware.
 
  Version numbers and other choices related to this change will be
 discussed with the Release Management team and updated during the
 Liberty cycle. This will not impact or change our support plans for
 the kilo or Juno releases / associated versions of
 keystonemiddleware. (Full support and maintenance is planned for the
 lifespan of Juno and Kilo releases).[1]
 
  Please feel free to respond in this thread or speak with us on IRC
 if you have questions of concerns about this change.
 
 So how will one match versions between CD deployed Nova and
 keystonemiddleware? You won't be able to specify what versions work
 and don't, will you?
 
 This concerns me precisely because it runs in the process - there's an
 expectation of API stability across external API's, but internally
 things tend to be rather more rocky. In TripleO we regularly ran into
 servers depending on un-released client library changes, for instance.
 
 This will be better than that was, but only because its being
 explicitly documented as such.
 
 Could you enlarge on what 'coordinating the requirements' means?
 
 
 This is simply a choice to adhere to the global-requirements for a given
 release (e.g. Liberty) that nova (and other projects) adhere to. We
 won't be doing a release when we feel like it we will be doing a
 standard mile-stone tag for (example) L1, L2, L3, and Liberty final. We
 will then maintain the backport for stable/Liberty for the life of the
 release. 
 
 Those doing CD (or near CD) should be unaffected unless we do something
 terrible and broken (which could happen but warrants an immediate
 fix/revert). Keystonemiddleware thankfully has almost no public APIs
 it receives a header,
 Validates the token, then returns headers (the public part) to the
 underlying service. The expectation is CD deployed should work *unless*
 one of the two projects suddenly has a dependency conflict. Obviously
 middleware needs to see testing with minimum versions from
 global-requirements not just maximums (like all projects need). 
 
 Today middleware is released independent of everything (like a client)
 but since it is tightly coupled to a set of requirements using 1.5.x
 with Juno is challenging, since there is a requirements mismatch. Today
 the only way you know what versions work is by either looking at release
 dates or by trial/error (or examining requirements). I think it is far
 better to release middleware like a server project to more clearly
 indicate release schedule and compatibility. 
 
 Knowing that 1.3.x receives backports (and tied to Juno), but 1.4.x
 doesn't because it was released between Juno and kilo, and 1.5.x does
 again (and is tied to kilo) is just a poor experience for our deployers.
 I don't want to have to name some release LTS of keystonemiddleware,
 let's  release in a way that make sense for how it is used. 
 
 Details of the version numbers will be hashed out at the summit and the
 release management team. (E.g do we move to a 2015.x.x model? Do we
 increment the X per release in semver, or the 'y'?) This part is not yet
 determined and requires some discussion.

Ok, specific scenario question:

I have Neutron API, Nova API, and Cinder API on one API controller box
in Kilo.

What is the expected upgrade strategy?

Will L1, L2, L3 publish to pypi?

-Sean

-- 
Sean Dague
http://dague.net

__
OpenStack Development Mailing List (not for usage questions)
Unsubscribe: openstack-dev-requ...@lists.openstack.org?subject:unsubscribe

Re: [openstack-dev] [Nova][Neutron] Linuxbridge as the default in DevStack [was: Status of the nova-network to Neutron migration work]

2015-04-20 Thread Kevin Benton
Yes. Totally agree. I hate it that I have to spend a giant amount of
effort on one of my clouds to get a working network to my VMs when on
the other cloud I get a VM that can talk to the network.
Guess which one I think should be the default behavior?

Whichever one you choose to deploy with Neutron! Neutron supports a bunch
of topologies based on vlans, flat networks, overlays, tenant routers,
shared networks, etc. There is no 'default' in this regard.

From what I've gathered from these emails, the use case you want is no
floating IPs and no tenant routers (what I understood you to be referring
to as 'SDN'). If that's the case, just create a few networks with the
provider attributes you are interested in and you're done.

So what I keep trying to say is that there should be an easy and sane
way for me to get a non-natted VM connected to a network that can route
packets and I should not need to know anything about the advanced
network options available to me, because as a person who just wants a vm
that can talk to a network, I'm the default case.

neutron net-create MYNET --shared --provider:network_type vlan
--provider:physical_network PHYSNET --provider:segmentation_id VLAN_ID

Or replace the network type with 'flat' if you don't want any VLAN
tagging. This
is also possible via the 'networks' tab in the Horizon UI.

Please let me know if I've misunderstood what you want. The fact that you
aren't interested in floating IPs makes your use case easy. The only one we
are having difficulty supporting is the nova network style use case where
floating IPs are used with regular networks and no tenant routers.

But we're not going to get there by ignoring the needs of the people who
want to boot vms that can talk to the network by default. If we're only
focusing on the people who want to do fancy network things, and not
serving the needs of the people who want to do simple network things -
then all we're doing is trading one set of limitations for a second set
of limitations, and we're switching which set of people we're excluding
from the party.

We're not talking about ignoring the needs of these users though. The use
of Linux bridge vs. OVS would not be tenant-facing. The API would still
support all of the things we have been discussing so far (including
floating IPs). The vswitch is just an implementation detail not exposed at
the API level.

What would be impacted is the ability for the cloud administrator to
troubleshoot connectivity or use tooling they are comfortable with if they
have a back-ground with Linux bridge vs. OVS. This point has been made
clear.

On Sat, Apr 18, 2015 at 9:42 AM, Monty Taylor mord...@inaugust.com wrote:

 On 04/18/2015 10:44 AM, Fox, Kevin M wrote:
  Replying inline.
 
  -Original Message- From: Monty Taylor
  [mailto:mord...@inaugust.com] Sent: Friday, April 17, 2015 7:53 PM
  To: openstack-dev@lists.openstack.org Subject: Re: [openstack-dev]
  [Nova][Neutron] Linuxbridge as the default in DevStack [was: Status
  of the nova-network to Neutron migration work]
 
  On 04/17/2015 06:48 PM, Rochelle Grober wrote:
  I know the DevStack issue seems to be solved, but I had to
  respond.inline
 
  From: Fox, Kevin M [mailto:kevin@pnnl.gov] Sent: Friday,
  April 17, 2015 12:28 To: OpenStack Development Mailing List (not
  for usage questions) Subject: Re: [openstack-dev] [Nova][Neutron]
  Linuxbridge as the default in DevStack [was: Status of the
  nova-network to Neutron migration work]
 
  No, the complaints from ops I have heard even internally, which
  I think is being echo'd here is I understand how linux bridge
  works, I don't opensvswitch. and I don't want to be bothered to
  learn to debug openvswitch because I don't think we need it.
 
  If linux bridge had feature parity with openvswitch, then it
  would be a reasonable argument or if the users truly didn't need
  the extra features provided by openvswitch/naas. I still assert
  though, that linux bridge won't get feature parity with
  openvswitch and the extra features are actually critical to users
  (DVR/NaaS), so its worth switching to opevnswitch and learning
  how to debug it. Linux Bridge is a nonsolution at this point.
 
  I'm sorry, but with all due respect - I believe that sounds very
  much like sticking fingers in ears and not paying attention to the
  very real needs of users.
 
  No, when you have complex software, with multiple classes of users,
  it is almost impossible to please all your users, in every way. Sime
  times, you must make hard decisions to make one users experience a
  little less good for the benefit of the whole community. /me channels
  Spock here...
 
  If it makes the Ops life a little harder, but for every Op that has
  to learn how to debug openvswitch, 100 users don't have to deal with
  the difference between nova-network and neutron api's and software
  built on top of OpensStack that only works with one of them, I think
  that's worth the tradeoff. Its unfortunate, 

Re: [openstack-dev] [opentack-dev][meetings] Proposing changes in Rally meetings

2015-04-20 Thread Mikhail Dubov
Sorry, I have incorrectly read the proposed meeting days. Meetings of
Monday and Wednesday are okay, but I agree with Roman that Monday/Thursday
would be a bit better.

Best regards,
Mikhail Dubov

Engineering OPS
Mirantis, Inc.
E-Mail: mdu...@mirantis.com
Skype: msdubov

On Mon, Apr 20, 2015 at 12:39 PM, Roman Vasilets rvasil...@mirantis.com
wrote:

 Hi,
 Agree with all proposes. But maybe it's make sense to do a bigger interval
 between mitings to make as much as possible work for the next meting.  For
 example Monday/Thursday. Its not principal for me.

 -Thanks, Roman Vasilets.

 On Fri, Apr 17, 2015 at 4:26 PM, Boris Pavlovic bo...@pavlovic.me wrote:

 Rally team,


 I would like to propose next changes in Rally meetings:

   - We should start making agenda for each meeting and publish it to
 Rally wiki

   - We should do 2 meeting per week:

  * First is regular meeting (like we have now) where we are
 discussing everything

  * Second is release management meeting, where we are discussing
 priorities for
current  next release. So core team will know what to review
 first.

   - Move meetings from #openstack-meeting to #openstack-rally chat.

   - We should adjust better time for current Rally team. Like at the
 moment it is too late
  for few of cores in Rally. it's 17:00 UTC and I would like to
 suggest to make at 15:00 UTC.

   - Do meetings every Monday and Wednesday


 Thoughts ?


 Best regards,
 Boris Pavlovic



 __
 OpenStack Development Mailing List (not for usage questions)
 Unsubscribe: openstack-dev-requ...@lists.openstack.org?subject:unsubscribe
 http://lists.openstack.org/cgi-bin/mailman/listinfo/openstack-dev


__
OpenStack Development Mailing List (not for usage questions)
Unsubscribe: openstack-dev-requ...@lists.openstack.org?subject:unsubscribe
http://lists.openstack.org/cgi-bin/mailman/listinfo/openstack-dev


[openstack-dev] [nova] Dropping DB Downgrades, need Turbo Hipster tests updated

2015-04-20 Thread Sean Dague
This proposed patch to drop the db downgrades in Nova master is making
Turbo Hipster face plant - https://review.openstack.org/#/c/175010/

It appears that turbo hipster is walking all the way up, then walking
back down through migrations, which clearly, is no longer a thing.

It would be nice to merge this patch sooner rather than later, so would
be great if Turbo hipster could function on migrations without
downgrades RSN.

-Sean

-- 
Sean Dague
http://dague.net

__
OpenStack Development Mailing List (not for usage questions)
Unsubscribe: openstack-dev-requ...@lists.openstack.org?subject:unsubscribe
http://lists.openstack.org/cgi-bin/mailman/listinfo/openstack-dev


Re: [openstack-dev] [neutron] Prefix delegation using dibbler client

2015-04-20 Thread Ihar Hrachyshka
-BEGIN PGP SIGNED MESSAGE-
Hash: SHA256

UPD: dibbler packages are now available in all Fedora updates
repositories, starting from Fedora 20, plus EPEL7.

Packages are called: dibbler-[client|docs|requestor|relay|server].

Specifically, you can locate them at:
http://download.eng.brq.redhat.com/pub/fedora/linux/updates/21/x86_64/d/

Please report any bugs with the package at bugzilla.redhat.com.

/Ihar

On 03/11/2015 05:29 PM, John Davidge (jodavidg) wrote:
 I am pleased to say that we are now in a good position with this
 patch. The necessary DHCPv6 client changes have been made available
 in the latest release of Dibbler (1.0.1) and we’re getting some
 much appreciated assistance from Ihar and Thomas in having this new
 version packaged for wide availability - thanks guys.
 
 We’ve updated the patch to include tests and it's been brought
 up-to-date with the latest L3 agent refactoring changes. It is no
 longer WIP and we would very much appreciate your reviews and
 feedback.
 
 https://review.openstack.org/#/c/158697/
 
 
 Cheers,
 
 John
 
 
 
 
 On 24/02/2015 17:40, John Davidge (jodavidg) jodav...@cisco.com
 wrote:
 
 Hello all,
 
 We now have a work-in-progress patch up for review:
 
 https://review.openstack.org/#/c/158697/
 
 
 Feedback on our approach is much appreciated.
 
 Many thanks,
 
 John Davidge OpenStack@Cisco
 
 
 
 
 On 20/02/2015 18:28, Ihar Hrachyshka ihrac...@redhat.com
 wrote:
 
 Those are good news!
 
 I commented on the pull request. Briefly, we can fetch from git,
 but would prefer an official release.
 
 Thanks, /Ihar
 
 On 02/19/2015 11:26 PM, Robert Li (baoli) wrote:
 Hi Kyle, Ihar,
 
 It looks promising to have our patch upstreamed. Please
 take a look at this pull request
 
 https://github.com/tomaszmrugalski/dibbler/pull/26#issuecomment-75
144912

 
.
 Most importantly, Tomek asked if it’s sufficient to have
 the code up in his master branch. I guess you guys may be
 able to help answer that question since I’m not familiar
 with openstack release process.
 
 Cheers, Robert
 
 On 2/13/15, 12:16 PM, Kyle Mestery mest...@mestery.com 
 mailto:mest...@mestery.com wrote:
 
 On Fri, Feb 13, 2015 at 10:57 AM, John Davidge (jodavidg) 
 jodav...@cisco.com mailto:jodav...@cisco.com wrote:
 
 Hi Ihar,
 
 To answer your questions in order:
 
 1. Yes, you are understanding the intention correctly.
 Dibbler doesn¹t currently support client restart, as doing
 so causes all existing delegated prefixes to be released
 back to the PD server. All subnets belonging to the router
 would potentially receive a new cidr every time a subnet is
 added/removed.
 
 2. Option 2 cannot be implemented using the current version
 of dibbler, but it can be done using the version we have
 modified. Option 3 could possibly be done with the current
 version of dibbler, but with some major limitations - only
 one single router namespace would be supported.
 
 Once the dibbler changes linked below are reviewed and
 finalised we will only need to merge a single patch into
 the upstream dibbler repo. No further patches are
 anticipated.
 
 Yes, you are correct that dibbler is not needed unless
 prefix delegation is enabled by the deployer. It is
 intended as an optional feature that can be easily disabled
 (and probably will be by default). A test to check for the
 correct dibbler version would certainly be necessary.
 
 Testing in the gate will be an issue until the new version
 of dibbler is merged and packaged in the various distros.
 I¹m not sure if there is a way to avoid this problem,
 unless we have devstack install from our updated repo while
 we wait.
 
 To me, this seems like a pretty huge problem. We can't
 expect distributions to package side-changes to upstream
 projects. The correct way to solve this problem is to work
 to get the changes required in the dependent packages
 upstream into those projects first (dibbler, in this case),
 and then propose the changes into Neutron to make use of
 those changes. I don't see how we can proceed with this
 work until the issues around dibbler has been resolved.
 
 
 John Davidge OpenStack@Cisco
 
 
 
 
 On 13/02/2015 16:01, Ihar Hrachyshka
 ihrac...@redhat.com mailto:ihrac...@redhat.com wrote:
 
 Thanks for the write-up! See inline.
 
 On 02/13/2015 04:34 PM, Robert Li (baoli) wrote:
 Hi,
 
 while trying to integrate dibbler client with neutron to
 support PD, we countered a few issues with the dibbler
 client (and server). With a neutron router, we have the
 qg-xxx interface that is connected to the public network,
 on which a dhcp server is running on the delegating
 router. For each subnet with PD enabled, a router port
 will be created in the neutron router. As a result, a new
 PD request will be sent that asks for a prefix from the
 delegating router. Keep in mind that the subnet is added 
 into the router dynamically.
 
 We thought about the following options:
 
 1. use a single dibbler client to support the above
 requirement. This means, the 

Re: [openstack-dev] [oslo][pbr] getting 0.11 out the door. Maybe even 1.0

2015-04-20 Thread Robert Collins
On 20 April 2015 at 22:10, Victor Stinner vstin...@redhat.com wrote:
 If there's nothing majorly wrong mid-L, I'd like to release 1.0.0 just
 to get us into 'ok its stable' mentality.

 I read that many packages modify the source code of libraries and 
 applications to avoid a dependency to pbr at runtime. What's the status of 
 this issue? Is pbr still used/required to get the version of a package a 
 runtime?

I believe Redhat patch it out. I don't think they should need to,
since we have explicit knobs for distros to use.

There is a raised concern about performance from the keystone CLI
thread, but I've not seen any followup to confirm that it was indeed
testing an *installed* CLI, not one running out of git.

 I'm not sure that it's an issue in pbr itself. Maybe applications should be 
 fixed instead.

I don't think its a bug in the applications.

Maybe someone from RedHat can file a bug on pbr describing what goes wrong?

-Rob


-- 
Robert Collins rbtcoll...@hp.com
Distinguished Technologist
HP Converged Cloud

__
OpenStack Development Mailing List (not for usage questions)
Unsubscribe: openstack-dev-requ...@lists.openstack.org?subject:unsubscribe
http://lists.openstack.org/cgi-bin/mailman/listinfo/openstack-dev


Re: [openstack-dev] [oslo][policy][neutron] oslo.policy API is not powerful enough to switch Neutron to it

2015-04-20 Thread Ihar Hrachyshka
-BEGIN PGP SIGNED MESSAGE-
Hash: SHA1

On 04/17/2015 07:49 PM, Salvatore Orlando wrote:
 == 2. filling in admin context with admin roles ==
 
 Admin context object is filled with .roles attribute that is a list
 of roles considered granting admin permissions [4]. The attribute
 would then be used by plugins that would like to do explicit policy
 checks. As per Salvatore, this attribute can probably be dropped
 now that all plugins and services don't rely on it (Salvatore
 mentioned lbaas mixins as the ones that previously relied on it,
 but are now not doing it since service split from neutron tree
 (?)).
 
 The problem with dropping the .roles attribute from context object
 in Liberty is that we, as a responsible upstream with lots of
 plugins maintained out-of-tree (see the ongoing vendor
 decomposition effort) would need to support the attribute while
 it's marked as deprecated for at least one cycle, meaning that if
 we don't get those oslo.policy internals we rely on in Liberty, we
 would need to postpone the switch till Mizzle, or rely on private
 symbols during the switch (while a new release of oslo.policy can
 easily break us).
 
 (BTW the code to extract admin roles is not really robust and has 
 bugs, f.e. it does not handle AndChecks that could be used in 
 context_is_admin. In theory, 'and' syntax would mean that both
 roles are needed to claim someone is an admin, while the code to
 extract admin roles handles 'and' the same way as 'or'. For the
 deprecation time being, we may need to document this limitation.)
 
 
 Roles are normally populated by the keystone middleware. I'm not
 sure whether we want to drop them altogether from the context,
 but I would expect the policy engine to use them even after
 switching to oslo.policy - Plugins should never leverage this
 kind of information. I am indeede tempted to drop roles and other
 AAA-related info from the context when it's dispatched to the
 plugin. This should be done carefully - beyond breaking some
 plugins it might also impact the notifiers we use to communicate
 with nova.
 
 The function which artificially populates roles in the context
 was built for artificial contextes, which in some cases were
 created by plugins performing db operations at startup. I would
 check if we still have this requirement, and if not remove the
 function.
 

Ouch, I failed in wording above (ETOOMANYWORDS?). I only meant
dropping explicit admin role population from the context object. If
there are any reasons to drop the whole attribute, they are irrelevant
to oslo.policy adoption discussion, and are worth a separate thread,
if at all. Thanks for keeping me honest on the non-sense above!

 
 
 == 3. aggregating core, attribute and subattribute policies ==
 

[...]

 Policies on subattributes are an abomination of nature and they
 should go.

Not sure they can easily go now, without breaking existing setups. I
wouldn't require existing deployments to convert their policies unless
we are completely locked otherwise.

 The problem however is that this needs first a rethink about
 some API extensions - namely the one for external gateway modes. 
 However, as you say we can't reablockedlly do without policies on
 attributes at the moment. Policies like the following:
 
 create_subnetpool:shared: rule:admin_only
 
 Led us to implement [1], which uses the symbols which were now
 made private.

You probably forgot to define [1] in your email. At least [1] in the
original email seems irrelevant to attribute matching in neutron.

 That logic is specific for Neutron, which adds semantic value to
 the policy target. As Ihar says, imposing this on all the other
 projects might not be welcome and in some cases break the project
 themselves.
 
 
 So the question to oslo.policy maintainers is: whether all that is 
 said above makes sense, and if so, whether we may now consider 
 exposing those private symbols (+ maybe OrCheck, NotCheck, and
 other primitives that are logically bound to AndCheck) as part of
 public API. If community agrees with my analysis and justification
 for the change, I am happy to propose a patch that would do just
 that.
 
 
 Making this possilbe would be the quickest path for Neutron. 
 However if the oslo_policy team took this decision it must have
 been for a solid design reasoning. It is tough to ask to revise a
 design decision for a single user of a library. Unfortunately a
 particular Neutron developer took the liberty of playing with
 authZ policies - I bet he was even proud of what he did: leaving 
 the project with more technical debt. That particular developer
 should be dealt with appropriately, but this is another story.
 

Do we need a separate neutron-troika gerrit group to handle those cases?

 I think that the only alternative to making those symbols public
 in oslo_policy is for Neutron to perform attribute and
 sub-attribute authZ checks in a different fashion (perhaps an
 additional engine). This will be a backward 

[openstack-dev] [oslo][pbr] getting 0.11 out the door. Maybe even 1.0

2015-04-20 Thread Robert Collins
So, we've fixed up the semver logic.

I went through the review backlog and merged the stuff that was good.

One thing in particular was problematic - prompting me to put up
https://review.openstack.org/#/c/174646/ - the commit this backs out
added per-platform requirements.txt files, which in light of both the
related discussions - one for environment markers, and one for
stopping using them for install_requires, seems like a bad idea to me.

We're working through the ecosystem changes needed to use environment
markers pervasively right now, which is a straight forward process, I
suspect it will take a month or so to get there, but not much longer.

So - I'd like to propose that we release 0.11 as soon as the servers
have been released and L is properly open - so that we've the whole
release to deal with any fallout.

If there's nothing majorly wrong mid-L, I'd like to release 1.0.0 just
to get us into 'ok its stable' mentality.

-Rob

-- 
Robert Collins rbtcoll...@hp.com
Distinguished Technologist
HP Converged Cloud

__
OpenStack Development Mailing List (not for usage questions)
Unsubscribe: openstack-dev-requ...@lists.openstack.org?subject:unsubscribe
http://lists.openstack.org/cgi-bin/mailman/listinfo/openstack-dev


Re: [openstack-dev] [oslo][policy][neutron] oslo.policy API is not powerful enough to switch Neutron to it

2015-04-20 Thread Salvatore Orlando
On 20 April 2015 at 10:03, Ihar Hrachyshka ihrac...@redhat.com wrote:

 -BEGIN PGP SIGNED MESSAGE-
 Hash: SHA1

 On 04/17/2015 07:49 PM, Salvatore Orlando wrote:
  == 2. filling in admin context with admin roles ==
 
  Admin context object is filled with .roles attribute that is a list
  of roles considered granting admin permissions [4]. The attribute
  would then be used by plugins that would like to do explicit policy
  checks. As per Salvatore, this attribute can probably be dropped
  now that all plugins and services don't rely on it (Salvatore
  mentioned lbaas mixins as the ones that previously relied on it,
  but are now not doing it since service split from neutron tree
  (?)).
 
  The problem with dropping the .roles attribute from context object
  in Liberty is that we, as a responsible upstream with lots of
  plugins maintained out-of-tree (see the ongoing vendor
  decomposition effort) would need to support the attribute while
  it's marked as deprecated for at least one cycle, meaning that if
  we don't get those oslo.policy internals we rely on in Liberty, we
  would need to postpone the switch till Mizzle, or rely on private
  symbols during the switch (while a new release of oslo.policy can
  easily break us).
 
  (BTW the code to extract admin roles is not really robust and has
  bugs, f.e. it does not handle AndChecks that could be used in
  context_is_admin. In theory, 'and' syntax would mean that both
  roles are needed to claim someone is an admin, while the code to
  extract admin roles handles 'and' the same way as 'or'. For the
  deprecation time being, we may need to document this limitation.)
 
 
  Roles are normally populated by the keystone middleware. I'm not
  sure whether we want to drop them altogether from the context,
  but I would expect the policy engine to use them even after
  switching to oslo.policy - Plugins should never leverage this
  kind of information. I am indeede tempted to drop roles and other
  AAA-related info from the context when it's dispatched to the
  plugin. This should be done carefully - beyond breaking some
  plugins it might also impact the notifiers we use to communicate
  with nova.
 
  The function which artificially populates roles in the context
  was built for artificial contextes, which in some cases were
  created by plugins performing db operations at startup. I would
  check if we still have this requirement, and if not remove the
  function.
 

 Ouch, I failed in wording above (ETOOMANYWORDS?). I only meant
 dropping explicit admin role population from the context object. If
 there are any reasons to drop the whole attribute, they are irrelevant
 to oslo.policy adoption discussion, and are worth a separate thread,
 if at all. Thanks for keeping me honest on the non-sense above!


Nah it was me being ambiguous in my reply.
We need roles in the context. Otherwise most policy checks would not be
applicable anymore.
I was making a point that a function that loads and stores them in context
generated with
operation like get_admin_context or ContextBase.elevated is not needed
anymore.
Indeed there is a note in the code pointing that out [1].
And here's the patch for doing it [2] (needs some more work)

[1]
http://git.openstack.org/cgit/openstack/neutron/tree/neutron/policy.py#n472
[2] https://review.openstack.org/#/c/175238/1




 
 
  == 3. aggregating core, attribute and subattribute policies ==
 

 [...]

  Policies on subattributes are an abomination of nature and they
  should go.

 Not sure they can easily go now, without breaking existing setups. I
 wouldn't require existing deployments to convert their policies unless
 we are completely locked otherwise.


Sure. That was just the personal opinion of the developer who was asked to
introduce them.


  The problem however is that this needs first a rethink about
  some API extensions - namely the one for external gateway modes.
  However, as you say we can't reablockedlly do without policies on
  attributes at the moment. Policies like the following:
 
  create_subnetpool:shared: rule:admin_only
 
  Led us to implement [1], which uses the symbols which were now
  made private.

 You probably forgot to define [1] in your email. At least [1] in the
 original email seems irrelevant to attribute matching in neutron.


I was pointing out this (no reference to avoid confusion):
http://git.openstack.org/cgit/openstack/neutron/tree/neutron/policy.py#n152


  That logic is specific for Neutron, which adds semantic value to
  the policy target. As Ihar says, imposing this on all the other
  projects might not be welcome and in some cases break the project
  themselves.
 
 
  So the question to oslo.policy maintainers is: whether all that is
  said above makes sense, and if so, whether we may now consider
  exposing those private symbols (+ maybe OrCheck, NotCheck, and
  other primitives that are logically bound to AndCheck) as part of
  public API. If community agrees with my analysis 

Re: [openstack-dev] [third-party][infra] Third-Party CI Operators: Let's use a common CI Solution!

2015-04-20 Thread Jaume Devesa
Hi Ramy,

Soon I'll be the responsible of the Midokura's third-party CI, which has been
mute for a while because a flaky physical resources that our sys admins
couldn't take care because they are overloaded of work...

Count on me!

On Mon, 20 Apr 2015 05:17, Asselin, Ramy wrote:
 All Third-Party CI operators:
 
 We’ve got 85 Third Party CI systems registered in the wiki[1], all of them 
 running a variety of closed  open-source solutions.
 Instead of individually maintaining all those similar solutions, let’s join 
 together and collectively maintain a single solution.
 
 If that sounds good to you, there’s an Infra-spec that’s been approved [2] to 
 refactor much of what the Infrastructure team uses for the upstream “Jenkins” 
 CI to be more easily reusable by many of us.
 
 We’ve got stories defined [3], and a few patches submitted. We’re using the 
 gerrit-topic “downstream-puppet” [4].
 
 For example, we’ve got the first part under review for the “Log Server”, 
 which creates your own version of http://logs.openstack.org/
 
 If anyone is interested in migrating towards a common solution, reply, or 
 ping me IRC (asselin) on Freenode #openstack-infra, or join some of the third 
 party ci meetings [5].
 
 Thanks!
 Ramy
 
 [1] https://wiki.openstack.org/wiki/ThirdPartySystems
 [2] 
 http://specs.openstack.org/openstack-infra/infra-specs/specs/openstackci.html
 [3] https://storyboard.openstack.org/#!/story/2000101
 [4] https://review.openstack.org/#/q/topic:downstream-puppet,n,z
 [5] 
 https://wiki.openstack.org/wiki/Meetings/ThirdParty#Weekly_Third_Party_meetings
 
 

 __
 OpenStack Development Mailing List (not for usage questions)
 Unsubscribe: openstack-dev-requ...@lists.openstack.org?subject:unsubscribe
 http://lists.openstack.org/cgi-bin/mailman/listinfo/openstack-dev


-- 
Jaume Devesa
Software Engineer at Midokura

__
OpenStack Development Mailing List (not for usage questions)
Unsubscribe: openstack-dev-requ...@lists.openstack.org?subject:unsubscribe
http://lists.openstack.org/cgi-bin/mailman/listinfo/openstack-dev


[openstack-dev] TC candidacy

2015-04-20 Thread Thierry Carrez
Hello list,

I'm announcing my candidacy for the Technical Committee elections.

I have been serving as the chair of the Technical Committee since its
inception, but I think we are at a critical point in the evolution of
the role of the Technical Committee, and if you allow it, I'd like to be
around to help drive us through this transition.

In particular, I'd like the Technical Committee to push in 3 new
directions during the Liberty cycle:


1. Step out of the way

As I explained on [1], I think over the last cycles the TC pushed the
regulation and ask for permission cursor so far we actually start
preventing things from happening. I'd like us to come back to a point
where our community is more trusted by default, where it asks more for
forgiveness and less for permission. So I'd like the Technical Committee
to look into its processes and see where it can remove itself from the
action pipeline, and retreat back to being an appeals board should a
problem arise.

[1] http://ttx.re/stepping-out-of-the-way.html


2. Start addressing real issues

I think it is part of the role of the Technical Committee members to
detect, investigate and help solving issues in our development
community. As we grow, we can't expect every member to know everything
about every project in OpenStack. But each member should be able to dive
into specific project(s) and report issues to the group. Subgroups of
members should be able to work together on proposing plans to solve
long-standing issues. That means spending more than one hour per week on
TC matters, which is why I'd like us to give preference in TC elections
to candidates who have enough time on their hands, as explained on [2].

[2] http://ttx.re/tech-committee-candidates.html


3. Push toward both ends of the scale space

Taking a step back on those last 5 years, I think the natural forces
behind OpenStack development made us cover the middle-tier of usage
quite well: reasonably large private IaaS systems (~10k VMs) with a need
for extra features and accepting the resulting complexity. They did not
make us cover the hyper-scale end (public clouds with millions of VMs in
a very active usage pattern) that well, because that end
is a specific use case that needs specific trade-offs, and not so many
users need/push those. And it did not make us cover the basic system
end, where people want to deploy a base IaaS compute system without
bells and whistles, and without a team of 100 admins, most of them SDN
specialists.

Our development ecosystem won't naturally go and cover those use cases
(lack of business and/or market), but those are essential long-term. We
all need extremely-large OpenStack public clouds to burst hybrid
workloads to. And we all need people to be able to experiment with
OpenStack in POCs, labs and universities. This is the two directions I
want to encourage in the near future.


More generally, I think it is the role of the Technical Committee
members to provide a long-term vision. To influence where we are going,
beyond where the market forces push us. To inspire our developers to
work (or support work) to cover areas that their employer might not
immediately care about in the short term. To make OpenStack better and
more universal in the long run.

Thanks for your consideration,

-- 
Thierry Carrez (ttx)

__
OpenStack Development Mailing List (not for usage questions)
Unsubscribe: openstack-dev-requ...@lists.openstack.org?subject:unsubscribe
http://lists.openstack.org/cgi-bin/mailman/listinfo/openstack-dev


Re: [openstack-dev] [opentack-dev][meetings] Proposing changes in Rally meetings

2015-04-20 Thread Sergey Skripnick


  - We should start making agenda for each meeting and publish it to 
Rally wiki


+1


  - We should do 2 meeting per week:



We can do both things in one meeting.


__
OpenStack Development Mailing List (not for usage questions)
Unsubscribe: openstack-dev-requ...@lists.openstack.org?subject:unsubscribe
http://lists.openstack.org/cgi-bin/mailman/listinfo/openstack-dev


[openstack-dev] Fwd: Integration Gerrit with Launchpad

2015-04-20 Thread Kaneko Takehiro
Hi,

I'm managing a stackforge project and want to integrate Gerrit with
Launchpad.

Links;
  Git: https://git.openstack.org/cgit/stackforge/rack/
  Launchpad: https://launchpad.net/python-rack

Project name 'rack' is duplicated in Launchpad so I named our project
'python-rack'.
How can I integrate Gerrit with Launchpad in this case?

Thanks.
__
OpenStack Development Mailing List (not for usage questions)
Unsubscribe: openstack-dev-requ...@lists.openstack.org?subject:unsubscribe
http://lists.openstack.org/cgi-bin/mailman/listinfo/openstack-dev


Re: [openstack-dev] [packaging][neutron] --config-dir vs. --config-file

2015-04-20 Thread Ihar Hrachyshka
-BEGIN PGP SIGNED MESSAGE-
Hash: SHA1

Nah, pointing --config-dir, either as one or as one of many arguments,
is just plain wrong. We want to have a way to set different
configuration values for different services, so merging all
configuration files into single pile of Neutron Configuration is not
something we should consider.

On 04/17/2015 11:17 PM, Kevin Benton wrote:
 Great! I was just worried that it was going to become one
 --config-dir option that pointed to /etc/neutron or something.
 
 On Fri, Apr 17, 2015 at 7:13 AM, Ihar Hrachyshka
 ihrac...@redhat.com mailto:ihrac...@redhat.com wrote:
 
 On 04/13/2015 09:45 PM, Kevin Benton wrote:
 What is the order of priority between the same option defined in 
 two files with --config-dir?
 
 Should be alphabetically sorted, but it's not yet defined in 
 documentation. I've sent a patch for this: 
 https://review.openstack.org/174883
 
 
 With '--config-file' args it seemed that it was that the latter 
 ones took priority over the earlier ones. So an admin previously 
 had the ability to abuse that by putting all of the desired
 global settings in one of the earlier loaded configs and then add
 some node-specific overrides to the ones loaded later.
 
 It's not actually an abuse, but behaviour that is guaranteed by
 public library documentation, and it's fine to rely on it.
 
 
 Will there still be the ability to do that with RDO?
 
 Nothing changes for users who do not want to use conf.d directory
 and instead store their configuration in upstream config files
 (like neutron.conf or l3_agent.ini). RDO/neutron only *extends* 
 possibilities to configure services with the new conf.d feature.
 
 The order of configuration storages as they are currently loaded
 in RDO/neutron services is the same for all of them, and can be
 checked in any systemd service file:
 
 https://github.com/openstack-packages/neutron/blob/f20-master/neutron-
me

 
tadata-agent.service#L8
 https://github.com/openstack-packages/neutron/blob/f20-master/neutron
- -me

 
tadata-agent.service#L8
 
 The way it's defined there, conf.d beats all other configuration 
 files. But if you don't buy the new approach, you just don't have
 any files inside the directory to beat your conventional
 configuration.
 
 
 On Mon, Apr 13, 2015 at 8:25 AM, Ihar Hrachyshka 
 ihrac...@redhat.com mailto:ihrac...@redhat.com
 mailto:ihrac...@redhat.com mailto:ihrac...@redhat.com wrote:
 
 Hi,
 
 RDO/master (aka Delorean) moved neutron l3 agent to this 
 configuration scheme, configuring l3 (and vpn) agent with 
 --config-dir [1][2][3].
 
 We also provided a way to configure neutron services without
 ever touching a single configuration file from the package [4]
 where each service has a config-dir located under 
 /etc/neutron/conf.d/service-name that can be populated by
 *.conf files that will be automatically read by services during
 startup.
 
 All other distributions are welcome to follow the path. Please 
 don't introduce your own alternative to /etc/neutron/conf.d/... 
 directory to avoid unneeded platform dependent differences in 
 deployment tools.
 
 As for devstack, it's not really feasible to introduce such a 
 change there (at least from my perspective), so it's downstream 
 only.
 
 [1]: 
 https://github.com/openstack-packages/neutron/blob/f20-master/opensta
c

 
k-
 
 
 neutron.spec#L602
 https://github.com/openstack-packages/neutron/blob/f20-master/openst
a

 
ck-
 
 
 neutron.spec#L602
 [2]: 
 https://github.com/openstack-packages/neutron/blob/f20-master/neutron
- -

 
l3
 https://github.com/openstack-packages/neutron/blob/f20-master/neutron
- -

 
l3
 
 
 -agent.service#L8
 [3]: 
 https://github.com/openstack-packages/neutron-vpnaas/blob/f20-master/
o

 
pe
 
 
 nstack-neutron-vpnaas.spec#L97
 https://github.com/openstack-packages/neutron-vpnaas/blob/f20-master
/

 
ope
 
 
 nstack-neutron-vpnaas.spec#L97
 [4]: https://review.gerrithub.io/#/c/229162/
 
 Thanks, /Ihar
 
 On 03/13/2015 03:11 PM, Ihar Hrachyshka wrote:
 Hi all,
 
 (I'm starting a new [packaging] tag in this mailing list to 
 reach out people who are packaging our software in
 distributions and whatnot.)
 
 Neutron vendor split [1] introduced situations where the set
 of configuration files for L3/VPN agent is not stable and
 depends on which packages are installed in the system.
 Specifically, fwaas_driver.ini file is now shipped in
 neutron_fwaas tarball (openstack-neutron-fwaas package in RDO),
 and so --config-file=/etc/neutron/fwaas_driver.ini argument
 should be passed to L3/VPN agent *only* when the new package
 with the file is installed.
 
 In devstack, we solve the problem by dynamically generating
 CLI arguments list based on which services are configured in 
 local.conf [2]. It's not a viable approach in proper 
 distribution packages though, where we usually hardcode
 arguments [3] in our service manifests (systemd unit files, in
 case of RDO).
 
 The immediate solution to solve the issue would be to use 
 

[openstack-dev] [neutron] [QoS] weekly meeting - update

2015-04-20 Thread Irena Berezovsky
Hi,

This week neutron QoS meeting will take place on Tuesday, April 21 at 14:00
UTC on #openstack-meeting-3.

Next week, the meeting is back to its original slot: Wed at 14:00 UTC on
#openstack-meeting-3.

Please join if you are interested.
__
OpenStack Development Mailing List (not for usage questions)
Unsubscribe: openstack-dev-requ...@lists.openstack.org?subject:unsubscribe
http://lists.openstack.org/cgi-bin/mailman/listinfo/openstack-dev


Re: [openstack-dev] [all][code quality] Voting coverage job (-1 if coverage get worse after patch)

2015-04-20 Thread Sean Dague
On 04/18/2015 09:30 PM, Boris Pavlovic wrote:
 Hi stackers, 
 
 Code coverage is one of the very important metric of overall code
 quality especially in case of Python. It's quite important to ensure
 that code is covered fully with well written unit tests. 
 
 One of the nice thing is coverage job. 
 
 In Rally we are running it against every check which allows us to get
 detailed information about
 coverage before merging patch: 
 http://logs.openstack.org/84/175084/1/check/rally-coverage/c61d5e1/cover/
 
 This helped Rally core team to automate checking that new/changed code
 is covered by unit tests and we raised unit test coverage from ~78% to
 almost 91%. 
 
 But it produces few issues: 
 1) 9k nitpicking - core reviewers have to put -1 if something is not
 covered by unit tests
 2) core team scaling issues - core team members spend a lot of time just
 checking that whole code is covered by unit test and leaving messages
 like this should be covered by unit test 
 3) not friendly community - it's not nice to get on your code -1 from
 somebody that is asking just to write unit tests
 4) coverage regressions - sometimes we accidentally accept patches that
 reduce coverage  
 
 To resolve this issue I improved a bit coverage job in Rally project,
 and now it compares master vs master + patch coverage. If new coverage
 is less than master job is marked as -1. 
 
 Here is the patch for job enhancement: 
 https://review.openstack.org/#/c/174645/
 
 Here is coverage job in action:
 patch https://review.openstack.org/#/c/174677/
 job message
 http://logs.openstack.org/77/174677/4/check/rally-coverage/ba49c90/console.html#_2015-04-17_15_57_17_695

Honestly, I'm suspicious of approaches like this. While 90% coverage is
clearly better than 0% coverage, it's not clear that 91% coverage is
always better than 90% coverage. Especially when you talk about larger
and more complex code bases.

I actually firmly feel that #3 is wrong. I think it's a lot better to
have an early conversation with people about unit tests that need to be
written when they don't submit any. Because I think it's a lot less
friendly to have someone iterate 10 patches to figure out how to pass a
bot's idea of good tests, and then have a reviewer say it's wrong.

Honestly, coverage for projects seems to me to be more of an analog
measure that would be good to graph over time and make sure it's not
regression, but personally I think the brownian motion of individual
patches seems like it's not a great idea to gate on every single patch.
I personally would be -1 for adding this to projects that I have +2 on.

-Sean

-- 
Sean Dague
http://dague.net

__
OpenStack Development Mailing List (not for usage questions)
Unsubscribe: openstack-dev-requ...@lists.openstack.org?subject:unsubscribe
http://lists.openstack.org/cgi-bin/mailman/listinfo/openstack-dev


[openstack-dev] [puppet] Weekly meeting #32

2015-04-20 Thread Emilien Macchi
Hi,

Tomorrow is our weekly meeting.
Please look at the agenda [1].

Feel free to bring new topics and reviews/bugs if needed.
Also, if you had any action, make sure you can give a status during the
meeting or in the etherpad directly.

See you tomorrow,

[1]
https://etherpad.openstack.org/p/puppet-openstack-weekly-meeting-20150421
-- 
Emilien Macchi



signature.asc
Description: OpenPGP digital signature
__
OpenStack Development Mailing List (not for usage questions)
Unsubscribe: openstack-dev-requ...@lists.openstack.org?subject:unsubscribe
http://lists.openstack.org/cgi-bin/mailman/listinfo/openstack-dev


Re: [openstack-dev] [neutron] [docs] Networking Guide Doc Day - April 23rd

2015-04-20 Thread Edgar Magana
I do agree with your suggestion. I will update the wiki and we will be using 
the #openstack-sprint IRC channel

Cheers!

Edgar

From: Anne Gentle 
annegen...@justwriteclick.commailto:annegen...@justwriteclick.com
Reply-To: OpenStack Development Mailing List (not for usage questions) 
openstack-dev@lists.openstack.orgmailto:openstack-dev@lists.openstack.org
Date: Friday, April 17, 2015 at 2:48 PM
To: OpenStack Development Mailing List (not for usage questions) 
openstack-dev@lists.openstack.orgmailto:openstack-dev@lists.openstack.org
Subject: Re: [openstack-dev] [neutron] [docs] Networking Guide Doc Day - April 
23rd



On Fri, Apr 17, 2015 at 3:17 PM, Andreas Jaeger 
a...@suse.commailto:a...@suse.com wrote:
On 04/17/2015 08:25 PM, Edgar Magana wrote:
Hello Folks,

I would like to invite all available contributors to help us to complete
the OpenStack Networking Guide.

We are having a Networking Doc Day on April 23rd in order to review the
current guide and make a big push on its content.
Let's use both the Neutron and Docs IRC channels:
#openstack-neutron
#openstack-doc

I suggest to use the #openstack-sprint channel instead, see 
https://wiki.openstack.org/wiki/VirtualSprints

The infra team had some sprint with a separate channel and having a separate 
place helped to focus.

I like the #openstack-sprint IRC channel idea. It's a nice pairing with doc bug 
day, so please close or triage as many networking bugs as you can with this 
sprint! We'll be doing bug triaging overall in #openstack-doc.

Thanks,
Anne



Andreas
--
 Andreas Jaeger 
aj@{suse.comhttp://suse.com,opensuse.orghttp://opensuse.org} 
Twitter/Identica: jaegerandi
  SUSE LINUX GmbH, Maxfeldstr. 5, 90409 Nürnberg, Germany
   GF: Felix Imendörffer, Jane Smithard, Jennifer Guild, Dilip Upmanyu,
   Graham Norton, HRB 21284 (AG Nürnberg)
GPG fingerprint = 93A3 365E CE47 B889 DF7F  FED1 389A 563C C272 A126


__
OpenStack Development Mailing List (not for usage questions)
Unsubscribe: 
openstack-dev-requ...@lists.openstack.org?subject:unsubscribehttp://openstack-dev-requ...@lists.openstack.org?subject:unsubscribe
http://lists.openstack.org/cgi-bin/mailman/listinfo/openstack-dev



--
Anne Gentle
annegen...@justwriteclick.commailto:annegen...@justwriteclick.com
__
OpenStack Development Mailing List (not for usage questions)
Unsubscribe: openstack-dev-requ...@lists.openstack.org?subject:unsubscribe
http://lists.openstack.org/cgi-bin/mailman/listinfo/openstack-dev


[openstack-dev] [all] Using project-specific channels for official meetings (was: Proposing changes in Rally meetings)

2015-04-20 Thread Jeremy Stanley
CAD85om3RJg4fDHDKPZpmcboF+=aknm9wqo08bas0eov8dey...@mail.gmail.com

On 2015-04-17 16:26:29 +0300 (-0300), Boris Pavlovic wrote:
[...]
 - Move meetings from #openstack-meeting to #openstack-rally chat.
[...]

Please don't. This means anyone who wants to be around in case an
important topic comes up in your meeting has to leave themselves
subscribed to an additional channel, and increases the chances your
meetings will conflict time-wise with others. Using the official
meeting channels increases the ability of the community at large to
be more involved in those discussions.

The new project requirements[1] only say The project has regular
meetings on IRC and those meetings are logged but it seems like an
oversight to me that it doesn't say they should happen in official
meeting channels (at least once the project's application has been
accepted). The structure reform resolution[2] did mention use
#openstack-meeting channels for their team meetings so I think it's
the implied intent there, at least. I've proposed a governance
change[3] in hopes of making this clear for others in the future,
and updated our Meetings wiki article[4] with an additional sentence
in the preamble describing the benefits and linking to related
resources.

[1] http://governance.openstack.org/reference/new-projects-requirements.html
[2] 
http://governance.openstack.org/resolutions/20141202-project-structure-reform-spec.html
[3] https://review.openstack.org/175427
[4] https://wiki.openstack.org/wiki/Meetings
-- 
Jeremy Stanley

__
OpenStack Development Mailing List (not for usage questions)
Unsubscribe: openstack-dev-requ...@lists.openstack.org?subject:unsubscribe
http://lists.openstack.org/cgi-bin/mailman/listinfo/openstack-dev


Re: [openstack-dev] [neutron][stable] Bug 1414218 is not fixed on in neutron stable/juno branch

2015-04-20 Thread Ihar Hrachyshka
-BEGIN PGP SIGNED MESSAGE-
Hash: SHA256

On 04/17/2015 12:56 AM, Carl Baldwin wrote:
 Stephen,
 
 On Thu, Apr 16, 2015 at 4:21 PM, Ma, Stephen B. stephen...@hp.com
 wrote:
 As it stands currently, neutron on the stable/juno branch behaves
 as if https://review.openstack.org/#/c/164329/ was never merged.
 The merge of patch  https://review.openstack.org/#/c/153181 puts
 some LOG.debug statements in the for-loop of the same function.
 The net result is the unintentional revert of patch
 https://review.openstack.org/#/c/164329/.
 
 I wouldn't call this a revert.  Instead, it brought back some
 context that the original patch dealt with but that the cherry pick
 did not. This is a regression but not a revert of the patch.
 
 According to review.openstack.org, the patch 
 https://review.openstack.org/#/c/153181 merged on April 1st at
 1:56 pm. Patch https://review.openstack.org/#/c/164329/ merged on
 the same day at 2:21 pm.   After 153181 merged, the review of
 164329 should have triggered a merge conflict error which would
 have compelled the owner to do a rebase. The merge conflict
 wasn’t reported and the patches merged anyway.  Does this point
 to a problem with the Jenkins CI system?
 
 This was not a problem with the CI system.  The infrastructure
 behaved exactly as it should.
 
 The problem happened when [4] was proposed with a lesser scope
 than [2] and then [3] merged making that extra scope relevant
 again.  I understand why the scope was reduced.  It is often
 necessary to react to changes in context when cherry picking.  That
 is the nature of cherry picking, bringing a patch in to a new
 context and reacting.
 
 It was unfortunate that [3] brought back the relevant context
 which made the broader scope of the change in [2] necessary and
 then they merged together.
 
 After having given it some thought, I have come to the conclusion
 that the only way to catch this would have been to include a proper
 test with [2] and [4] that log debug statements are not executed in
 the loop.  Such a test would have kicked out whichever of [3] and
 [4] happened to merge last from the gate.  It would've been really 
 annoying to fail in the gate but it would have flagged the problem 
 then and there.  Really, the failure was in not requiring the
 tests necessary to prevent regression.  Until we add these tests,
 we will be vulnerable to this regression again.  For example, I
 could merge a new patch to add more logging to this loop today and
 we'd be back to square one.
 
 Carl
 
 [1] https://review.openstack.org/#/c/147455 [2]
 https://review.openstack.org/#/c/149784 [3]
 https://review.openstack.org/#/c/153181 [4]
 https://review.openstack.org/#/c/164329
 

Hi Carl,
thanks for analysis. I've sent a regression unit test for master. Once
it's merged in master, I'll propose for stable till Juno.

[1]: https://review.openstack.org/175445

/Ihar
-BEGIN PGP SIGNATURE-
Version: GnuPG v2

iQEcBAEBCAAGBQJVNReAAAoJEC5aWaUY1u573MgIAK03+RqvujHgtL9SmyjXBDtn
K2awpRWCHM4cmb6Hr6MLVbWNPEC2svjOHWOSRfRZ5vw05xk/ViJ/UM17b7Jz9Drf
cTMVJ6G7lzt+XaCQQeB72NbZSEdEfFAcLLNnb9DzVxRjRcvLcu0dV/tpgJ7YeuMn
vGwAUJkv+5af6iTy0BmDpJZh2hZ9OFXnesLxCcHY4VKcCX7HiXwhSEjhF1pCOdPd
SwRC3MgqL5gcLchoYzcNZ2DtTwK881LixLIh4VhY14VTKzwF1zVJBbar2V5N77RG
9cukeTSsPg+oft/M1JclWUQrQ4G0JWZgE8B5VibpYnF45rYYWDlvAVWwa1pv6uQ=
=KgGO
-END PGP SIGNATURE-

__
OpenStack Development Mailing List (not for usage questions)
Unsubscribe: openstack-dev-requ...@lists.openstack.org?subject:unsubscribe
http://lists.openstack.org/cgi-bin/mailman/listinfo/openstack-dev


Re: [openstack-dev] [all][code quality] Voting coverage job (-1 if coverage get worse after patch)

2015-04-20 Thread Boris Pavlovic
Gordon,

+1. i don't think this would be a good idea as a non-voting job either as
 it can/will lead to lazy reviews.


It is similar to say let's remove unit/functional/pep8/pylint/any other
testing because it will lead to lazy reviews.

Best regards,
Boris Pavlovic





On Mon, Apr 20, 2015 at 5:14 PM, gordon chung g...@live.ca wrote:

 
  Date: Mon, 20 Apr 2015 07:13:31 -0400
  From: s...@dague.net
  To: openstack-dev@lists.openstack.org
  Subject: Re: [openstack-dev] [all][code quality] Voting coverage job (-1
 if coverage get worse after patch)
 
  On 04/18/2015 09:30 PM, Boris Pavlovic wrote:
  Hi stackers,
 
  Code coverage is one of the very important metric of overall code
  quality especially in case of Python. It's quite important to ensure
  that code is covered fully with well written unit tests.
 
  One of the nice thing is coverage job.
 
  In Rally we are running it against every check which allows us to get
  detailed information about
  coverage before merging patch:
 
 http://logs.openstack.org/84/175084/1/check/rally-coverage/c61d5e1/cover/
 
  This helped Rally core team to automate checking that new/changed code
  is covered by unit tests and we raised unit test coverage from ~78% to
  almost 91%.
 
  But it produces few issues:
  1)9k nitpicking - core reviewers have to put -1 if something is not
  covered by unit tests
  2) core team scaling issues - core team members spend a lot of time just
  checking that whole code is covered by unit test and leaving messages
  like this should be covered by unit test
  3) not friendly community - it's not nice to get on your code -1 from
  somebody that is asking just to write unit tests
  4) coverage regressions - sometimes we accidentally accept patches that
  reduce coverage
 
  To resolve this issue I improved a bit coverage job in Rally project,
  and now it compares master vs master + patch coverage. If new coverage
  is less than master job is marked as -1.
 
  Here is the patch for job enhancement:
  https://review.openstack.org/#/c/174645/
 
  Here is coverage job in action:
  patch https://review.openstack.org/#/c/174677/
  job message
 
 http://logs.openstack.org/77/174677/4/check/rally-coverage/ba49c90/console.html#_2015-04-17_15_57_17_695
 
  Honestly, I'm suspicious of approaches like this. While 90% coverage is
  clearly better than 0% coverage, it's not clear that 91% coverage is
  always better than 90% coverage. Especially when you talk about larger
  and more complex code bases.
 
  I actually firmly feel that #3 is wrong. I think it's a lot better to
  have an early conversation with people about unit tests that need to be
  written when they don't submit any. Because I think it's a lot less
  friendly to have someone iterate 10 patches to figure out how to pass a
  bot's idea of good tests, and then have a reviewer say it's wrong.
 
  Honestly, coverage for projects seems to me to be more of an analog
  measure that would be good to graph over time and make sure it's not
  regression, but personally I think the brownian motion of individual
  patches seems like it's not a great idea to gate on every single patch.
  I personally would be -1 for adding this to projects that I have +2 on.
 
  -Sean
 
  --
  Sean Dague
  http://dague.net

 +1. i don't think this would be a good idea as a non-voting job either as
 it can/will lead to lazy reviews.

 cheers,
 gord


 __
 OpenStack Development Mailing List (not for usage questions)
 Unsubscribe: openstack-dev-requ...@lists.openstack.org?subject:unsubscribe
 http://lists.openstack.org/cgi-bin/mailman/listinfo/openstack-dev

__
OpenStack Development Mailing List (not for usage questions)
Unsubscribe: openstack-dev-requ...@lists.openstack.org?subject:unsubscribe
http://lists.openstack.org/cgi-bin/mailman/listinfo/openstack-dev


Re: [openstack-dev] [Zaqar] Call for adoption (or exclusion?)

2015-04-20 Thread Fox, Kevin M
RDO packaging would go a long way for us.

Also what about oslo support? We have a second rabbit for 
sahara/trove/designate for reasons I wont get into here on one cloud that could 
just be made to use Zaqar instead?

I do believe Zaqar is very important. Its been a long bumpy road, but you folks 
are doing a great job. Dont loose heart.

Thanks,
Kevin


From: Flavio Percoco
Sent: Monday, April 20, 2015 5:54:54 AM
To: openstack-dev@lists.openstack.org
Subject: [openstack-dev] [Zaqar] Call for adoption (or exclusion?)

Greetings,

I'd like my first action as Zaqar's PTL to be based on reflections and
transparency with regards to what our past has been, to what our
present is and to what our future could be as a project and community.
Therefore, I'm sending this call for adoption and support before
taking other actions (also mentioned below).

The summit is very close and the Zaqar team is looking forward to it.

The upcoming summit represents an important opportunity for Zaqar to
integrate with other projects. In the previous summits - since
Icehouse's - we've been collecting feedback from the community. We've
worked on addressing the many use-cases, we've worked on addressing
the concerns raised by the community and we've also kept moving
towards reaching the project's goals.

As you all know, the project has gone through many ups and downs.
We've had some failures in the past and we've also had successes, as
a project and as a team. Nevertheless, we've got to the point where it
doesn't make much sense to keep pushing new features to the project
until it gains adoption. Therefore, I'd like to take advantage of the
workshop slots and invite people from other projects to help us/guide
us through a hacking session on their projects so we can help with the
adoption. The current adoption of Zaqar consist in:

- 1 company reachingunning it in production
- 1 planning to do it soon
- RDO support

Unfortunately, the above is certainly not enough for a project to
succeed and it makes the time and effort spent on the project not
worth it. It's been more than 2 years since we kicked the project off
and it's time for it to show some results. The current problem seems
to be that many people want the project but no one wants to be the
first in adopting Zaqar (which kind of invalidates the premises of the
Big tent).

In summary, this is a call for adoption before we call it a nice
adventure and ask for the project to be excluded from the OpenStack
organization based on the lack of adoption and contributions.

If you think it's worth it, speak up. Either way, thanks for the
support and for reading thus far.

On behalf of the Zaqar team,
Flavio

--
@flaper87
Flavio Percoco
__
OpenStack Development Mailing List (not for usage questions)
Unsubscribe: openstack-dev-requ...@lists.openstack.org?subject:unsubscribe
http://lists.openstack.org/cgi-bin/mailman/listinfo/openstack-dev


[openstack-dev] [chef] Status Meeting April 20, 2015

2015-04-20 Thread JJ Asghar
Hey Everyone!

Here’s a link to the hangout: 
https://plus.google.com/hangouts/_/hoaevent/AP36tYenNDpCZC-E2cbqw7050E-AG7RI8SL6bWjGMyuYGKGkCJIcpw?authuser=0hl=en
 
https://plus.google.com/hangouts/_/hoaevent/AP36tYenNDpCZC-E2cbqw7050E-AG7RI8SL6bWjGMyuYGKGkCJIcpw?authuser=0hl=en

And here’s the link to the youtube video: http://youtu.be/x5wOFwpYGqI 
http://youtu.be/x5wOFwpYGqI

-J__
OpenStack Development Mailing List (not for usage questions)
Unsubscribe: openstack-dev-requ...@lists.openstack.org?subject:unsubscribe
http://lists.openstack.org/cgi-bin/mailman/listinfo/openstack-dev


Re: [openstack-dev] [all][code quality] Voting coverage job (-1 if coverage get worse after patch)

2015-04-20 Thread Boris Pavlovic
Dan,

IMHO, most of the test coverage we have for nova's neutronapi is more
 than useless. It's so synthetic that it provides no regression
 protection, and often requires significantly more work than the change
 that is actually being added. It's a huge maintenance burden with very
 little value, IMHO. Good tests for that code would be very valuable of
 course, but what is there now is not.
 I think there are cases where going from 90 to 91% mean adding a ton of
 extra spaghetti just to satisfy a bot, which actually adds nothing but
 bloat to maintain.


Let's not mix the bad unit tests in Nova with the fact that code should be
fully covered by well written unit tests.
This big task can be split into 2 smaller tasks:
1) Bot that will check that we are covering new code by tests and don't
introduce regressions
2) Core and other reviewers ensures that tests are well written.

P.S. Unit tests are the first criteria of code quality: if it is hard to
cover code by unit tests, code is bad written
and should be refactored.

Best regards,
Boris Pavlovic

On Mon, Apr 20, 2015 at 5:26 PM, Dan Smith d...@danplanet.com wrote:

  Well, I think there are very few cases where *less* coverage is better.

 IMHO, most of the test coverage we have for nova's neutronapi is more
 than useless. It's so synthetic that it provides no regression
 protection, and often requires significantly more work than the change
 that is actually being added. It's a huge maintenance burden with very
 little value, IMHO. Good tests for that code would be very valuable of
 course, but what is there now is not.

 I think there are cases where going from 90 to 91% mean adding a ton of
 extra spaghetti just to satisfy a bot, which actually adds nothing but
 bloat to maintain.

  This I completely agree with. Asking for unit tests is a common thing,
  and if done early in the review process, is not a non-friendly thing.
  It's just matter of fact. And if the comment is given with some example
  unit test code -- or a pointer to a unit test that could be used as an
  example -- even better. It grows the submitter.

 +1

  I certainly am not opposed to introducing coverage regression jobs that
  produce a history of coverage. I would not personally support them being
  a blocking/gate job, though.

 As Gordon said elsewhere in this thread, I'm not even sure I want to see
 it reporting as PASS/FAIL. It sounds like this would end up being like
 our pylint job, which was utterly confused by a lot of things and
 started to be something that wasn't even reliable enough to use as an
 advisory test.

 Recording the data for long-term analysis would be excellent though.
 It'd be nice to see that we increased coverage over a cycle.

 --Dan

 __
 OpenStack Development Mailing List (not for usage questions)
 Unsubscribe: openstack-dev-requ...@lists.openstack.org?subject:unsubscribe
 http://lists.openstack.org/cgi-bin/mailman/listinfo/openstack-dev

__
OpenStack Development Mailing List (not for usage questions)
Unsubscribe: openstack-dev-requ...@lists.openstack.org?subject:unsubscribe
http://lists.openstack.org/cgi-bin/mailman/listinfo/openstack-dev


Re: [openstack-dev] [all][code quality] Voting coverage job (-1 if coverage get worse after patch)

2015-04-20 Thread Dan Smith
 Well, I think there are very few cases where *less* coverage is better.

IMHO, most of the test coverage we have for nova's neutronapi is more
than useless. It's so synthetic that it provides no regression
protection, and often requires significantly more work than the change
that is actually being added. It's a huge maintenance burden with very
little value, IMHO. Good tests for that code would be very valuable of
course, but what is there now is not.

I think there are cases where going from 90 to 91% mean adding a ton of
extra spaghetti just to satisfy a bot, which actually adds nothing but
bloat to maintain.

 This I completely agree with. Asking for unit tests is a common thing,
 and if done early in the review process, is not a non-friendly thing.
 It's just matter of fact. And if the comment is given with some example
 unit test code -- or a pointer to a unit test that could be used as an
 example -- even better. It grows the submitter.

+1

 I certainly am not opposed to introducing coverage regression jobs that
 produce a history of coverage. I would not personally support them being
 a blocking/gate job, though.

As Gordon said elsewhere in this thread, I'm not even sure I want to see
it reporting as PASS/FAIL. It sounds like this would end up being like
our pylint job, which was utterly confused by a lot of things and
started to be something that wasn't even reliable enough to use as an
advisory test.

Recording the data for long-term analysis would be excellent though.
It'd be nice to see that we increased coverage over a cycle.

--Dan

__
OpenStack Development Mailing List (not for usage questions)
Unsubscribe: openstack-dev-requ...@lists.openstack.org?subject:unsubscribe
http://lists.openstack.org/cgi-bin/mailman/listinfo/openstack-dev


Re: [openstack-dev] [keystone] Changes to Spec Proposal Freeze and Feature Freeze dates for Keystone in Liberty

2015-04-20 Thread Adam Young

On 04/17/2015 11:31 PM, Morgan Fainberg wrote:

As a quick update, for the Liberty cycle, keystone will be using the first 
milestone as our Spec Proposal Freeze (SPF), with Feature Proposal Freeze (API 
Impacting features must be code complete / ready for review / gating) at the 
second milestone.

This will help to give us more time to ensure features and related issues to 
new features can be fully implemented prior to the RC window(s) and limit the 
rush to land code in the third milestone.

Please feel free to discuss questions / concerns here in this thread, in 
#openstack-keystone on IRC, or during our weekly IRC meeting.

Cheers,
Morgan Fainberg

Sent via mobile
__
OpenStack Development Mailing List (not for usage questions)
Unsubscribe: openstack-dev-requ...@lists.openstack.org?subject:unsubscribe
http://lists.openstack.org/cgi-bin/mailman/listinfo/openstack-dev
If you have a spec to propose, please file it against Backlog until it 
is approved.  Once it is approved, we will move it to the appropriate 
release; Liberty or later as appropriate.


__
OpenStack Development Mailing List (not for usage questions)
Unsubscribe: openstack-dev-requ...@lists.openstack.org?subject:unsubscribe
http://lists.openstack.org/cgi-bin/mailman/listinfo/openstack-dev


Re: [openstack-dev] [chef] A new Core member!

2015-04-20 Thread Edgar Magana
Congratulations!!

The same for you JJ!

Edgar

From: Jay Lau jay.lau@gmail.commailto:jay.lau@gmail.com
Reply-To: OpenStack Development Mailing List (not for usage questions) 
openstack-dev@lists.openstack.orgmailto:openstack-dev@lists.openstack.org
Date: Sunday, April 19, 2015 at 10:52 PM
To: OpenStack Development Mailing List (not for usage questions) 
openstack-dev@lists.openstack.orgmailto:openstack-dev@lists.openstack.org
Subject: Re: [openstack-dev] [chef] A new Core member!

Congrats Zhi Wei! Well deserved!

2015-04-20 11:26 GMT+08:00 Jian Wen 
wenjia...@gmail.commailto:wenjia...@gmail.com:
Congrats

On Sat, Apr 18, 2015 at 5:42 AM, JJ Asghar 
jasg...@chef.iomailto:jasg...@chef.io wrote:
 Hey everyone!

 I'd like to announce that Zhiwei Chen has stepped up as a new Core Member. 
 Please take a moment to congratulate him!

 Thanks Zhiwei!

 JJ Asghar
 __
 OpenStack Development Mailing List (not for usage questions)
 Unsubscribe: 
 openstack-dev-requ...@lists.openstack.org?subject:unsubscribehttp://openstack-dev-requ...@lists.openstack.org?subject:unsubscribe
 http://lists.openstack.org/cgi-bin/mailman/listinfo/openstack-dev



--
Best,

Jian

__
OpenStack Development Mailing List (not for usage questions)
Unsubscribe: 
openstack-dev-requ...@lists.openstack.org?subject:unsubscribehttp://openstack-dev-requ...@lists.openstack.org?subject:unsubscribe
http://lists.openstack.org/cgi-bin/mailman/listinfo/openstack-dev



--
Thanks,

Jay Lau (Guangya Liu)
__
OpenStack Development Mailing List (not for usage questions)
Unsubscribe: openstack-dev-requ...@lists.openstack.org?subject:unsubscribe
http://lists.openstack.org/cgi-bin/mailman/listinfo/openstack-dev


Re: [openstack-dev] [keystone] keystoneclient stable/icehouse broken

2015-04-20 Thread Ihar Hrachyshka
-BEGIN PGP SIGNED MESSAGE-
Hash: SHA256

On 04/20/2015 10:26 AM, Ihar Hrachyshka wrote:
 On 04/20/2015 12:34 AM, Brant Knudson wrote:
 
 
 On Sun, Apr 19, 2015 at 3:07 PM, Brant Knudson b...@acm.org 
 mailto:b...@acm.org wrote:
 
 
 Ever since the stable/icehouse branch was created for 
 python-keystoneclient it's been broken. There are a couple of 
 issues:
 
 1) The gate-python-keystoneclient-python34 job is failing with
 the error ERROR: InterpreterNotFound: python3.4. I don't know
 why it's not available. Maybe python3 needs to be installed on
 the instance or maybe the job should not be run for
 stable/icehouse. No fix has been proposed for this as far as I
 know. I'll need some help from infra to figure it out.
 
 
 For this one, the job was just removed via an infra change, see 
 https://review.openstack.org/#/c/175235/ .
 
 Should we make it global for all clients?

OK, I went forward and sent the patch to disable them all:
https://review.openstack.org/175433
-BEGIN PGP SIGNATURE-
Version: GnuPG v2

iQEcBAEBCAAGBQJVNRHeAAoJEC5aWaUY1u57VwsIAMiicyHXp/vBS4htkzrZgxt6
lrDJ62bSBktxoNS3nz8UHDukTc1u1u9Ehd4qEtnyjLGKB5YBCb07rqecznov/QAD
dv5isXX2eDRkjwKzDHgYo/N+pcR/HhSA99Zgng4qnVuO6UM7WgbXtmjmvVJVr4mq
1Rv57kkOsbIaF8lspV2VnZQlR/zx8I9bEEkLNM63RrlRqYjLkMNTQTGO5QKecD8u
h9I21GD0ZIvhPcBYJwZN5pA99E6RCPL8MWn7aXMl7L2UwNEqOaqxf9VV9SY3O+Uv
Ctf5gkMcyLGV85IT8963grClJ7JRzwJzgSuOMcxCdHXdrOyOtAZT29VaOifXI7c=
=HAwa
-END PGP SIGNATURE-

__
OpenStack Development Mailing List (not for usage questions)
Unsubscribe: openstack-dev-requ...@lists.openstack.org?subject:unsubscribe
http://lists.openstack.org/cgi-bin/mailman/listinfo/openstack-dev


Re: [openstack-dev] [neutron] [QoS] weekly meeting - update

2015-04-20 Thread Kyle Mestery
On Mon, Apr 20, 2015 at 8:44 AM, Ihar Hrachyshka ihrac...@redhat.com
wrote:

 -BEGIN PGP SIGNED MESSAGE-
 Hash: SHA256

 On 04/20/2015 12:20 PM, Miguel Angel Ajo Pelayo wrote:
  Thank you Irena,
 
  I believe this last minute change deserves an explanation, I asked
  Irena to write to the list on my behalf (thank you!).
 
  I got a surgery to one of my kids scheduled on Wednesday (it’s
  something very mild near the ear), also it’s holiday for a few of
  the participants that were intending to join.

 I hope your kid (and you) will be well.

 ++, hope everything turns out ok!


 
  I hope it works for most of you, otherwise we will all be available
  on next Wednesday 29th as planned.

 Note that the proposed time conflicts with general neutron meeting.


This is true, but I think this is a one-time occurance due to some
scheduling concerns.


 /Ihar
 -BEGIN PGP SIGNATURE-
 Version: GnuPG v2

 iQEcBAEBCAAGBQJVNQK/AAoJEC5aWaUY1u578PcIAL7FkO+wSV4AdkcjIrFNbrcX
 aHmbV9pYYkUf3GTrBfqBzJ37XqApSCrFinZPpg7vrDfp1TLxvWXBoh8HhBrJUiv3
 ItqEGpixotKcuT06E0QSm76p6ZkIFffy68Iudj1dX1bLVuDa7VU59jcBxo9H3EMQ
 Ei4Vtvf3M1a8wPZV+FHcySzkjrLNJNlgUCHOy/h5JCWC26nGxKHciFYxXz82HQpQ
 V6o2d+tyLAkJnkIkmbUuRfOLoZaBFwc7ortS1CEt00fMux6EyoNmuhouBZxoUp84
 IKZsSDea8QRciHFot1mUA4cF9Up1vFiNuy9K3FOh8VuNCxzc2Un0sGtjIP6zdb0=
 =Poy8
 -END PGP SIGNATURE-

 __
 OpenStack Development Mailing List (not for usage questions)
 Unsubscribe: openstack-dev-requ...@lists.openstack.org?subject:unsubscribe
 http://lists.openstack.org/cgi-bin/mailman/listinfo/openstack-dev

__
OpenStack Development Mailing List (not for usage questions)
Unsubscribe: openstack-dev-requ...@lists.openstack.org?subject:unsubscribe
http://lists.openstack.org/cgi-bin/mailman/listinfo/openstack-dev


[openstack-dev] [Glance] Open glance-drivers to all glance-cores

2015-04-20 Thread Flavio Percoco

Hello Glance folks, and not Glance folks :D

Here's a thought. I believe, based on the size of our
project/community/reviewers team, we should just give access to all
glance-cores to glance-drivers. Few considerations:

1) Many of our reviewers have been part of Glance even before I became
part of it. It just makes no sense to me that these folks that have
put efforts, time and that have helped making Glance what it is today
don't have a voice on the specs. Commenting seems to not be enough,
apparently.

2) I'd like to encourage a more open communication in our specs review
process and including all our current *code* reviewers seems like a
good step forward towards that. Things that I'd love to thing and to
avoid are:

 - I'd love to avoid all kind of private emails/conversations. Specs
   can either be discussed in the review (which is what it's for),
   team meetings or mailing list.

 - I'd love for specs to get more attention from other folks. In
   other words, I'd like to scale our specs review process. There are
   specs that have sitten there for a bit.

 - Our *code* reviewers know Glance's code, I want them to have a way
   to express a stronger opinion/vote.

3) Although this doesn't seem to work for other projects, I believe
Glance is not such a big community for this to fail. If anything, it
should help us to manage the load a bit better. If there are
core-reviewers that simply don't want to do spec reviews, that's fine.

4) If there are non-core reviewers that want to be part of the
glance-drivers team then we can vote as we do for new cores. I have to
admit that I'm having a hard time to imagine a case like this but...
who knows? right?

5) It used to be like this and many of us just found themselves out of
the glance-drivers team without notice. It's probably an unexpected
side effect of disconnecting LP/gerrit and splitting the teams. Not a
big deal, but...

Thoughts?
Flavio

--
@flaper87
Flavio Percoco


pgpjvArMypqkP.pgp
Description: PGP signature
__
OpenStack Development Mailing List (not for usage questions)
Unsubscribe: openstack-dev-requ...@lists.openstack.org?subject:unsubscribe
http://lists.openstack.org/cgi-bin/mailman/listinfo/openstack-dev


[openstack-dev] [nova] Required data migrations in Kilo, need Turbo Hipster tests updated

2015-04-20 Thread Dan Smith
This proposed patch requiring a data migration in Nova master is making
Turbo Hipster face plant - https://review.openstack.org/#/c/174480/

This is because we will require Kilo deployers to fully migrate their
flavor data from system_metadata to instance_extra before they upgrade
to the next release. They (and turbo hipster) will need to do this first:

https://github.com/openstack/nova/blob/master/nova/cmd/manage.py#L963

I'm not sure how you want to handle this, either by converting your data
sets, or only converting the ones that master runs.

It would be nice to merge this patch as soon as grenade is ready to do
so, as it's blocking all other db migrations in master.

Thanks!

--Dan

__
OpenStack Development Mailing List (not for usage questions)
Unsubscribe: openstack-dev-requ...@lists.openstack.org?subject:unsubscribe
http://lists.openstack.org/cgi-bin/mailman/listinfo/openstack-dev


Re: [openstack-dev] [Zaqar] Call for adoption (or exclusion?)

2015-04-20 Thread Anita Kuno
On 04/20/2015 08:54 AM, Flavio Percoco wrote:
 Greetings,
 
 I'd like my first action as Zaqar's PTL to be based on reflections
 and transparency with regards to what our past has been, to what
 our present is and to what our future could be as a project and
 community. Therefore, I'm sending this call for adoption and
 support before taking other actions (also mentioned below).
 
 The summit is very close and the Zaqar team is looking forward to
 it.
 
 The upcoming summit represents an important opportunity for Zaqar
 to integrate with other projects. In the previous summits - since 
 Icehouse's - we've been collecting feedback from the community.
 We've worked on addressing the many use-cases, we've worked on
 addressing the concerns raised by the community and we've also kept
 moving towards reaching the project's goals.
 
 As you all know, the project has gone through many ups and downs. 
 We've had some failures in the past and we've also had successes,
 as a project and as a team. Nevertheless, we've got to the point
 where it doesn't make much sense to keep pushing new features to
 the project until it gains adoption. Therefore, I'd like to take
 advantage of the workshop slots and invite people from other
 projects to help us/guide us through a hacking session on their
 projects so we can help with the adoption. The current adoption of
 Zaqar consist in:
 
 - 1 company reachingunning it in production - 1 planning to do it
 soon - RDO support
 
 Unfortunately, the above is certainly not enough for a project to 
 succeed and it makes the time and effort spent on the project not 
 worth it. It's been more than 2 years since we kicked the project
 off and it's time for it to show some results. The current problem
 seems to be that many people want the project but no one wants to
 be the first in adopting Zaqar (which kind of invalidates the
 premises of the Big tent).
 
 In summary, this is a call for adoption before we call it a nice 
 adventure and ask for the project to be excluded from the
 OpenStack organization based on the lack of adoption and
 contributions.
 
 If you think it's worth it, speak up. Either way, thanks for the 
 support and for reading thus far.
 
 On behalf of the Zaqar team, Flavio
 
 
 
 __

 
OpenStack Development Mailing List (not for usage questions)
 Unsubscribe:
 openstack-dev-requ...@lists.openstack.org?subject:unsubscribe 
 http://lists.openstack.org/cgi-bin/mailman/listinfo/openstack-dev
 
Thank you for the honesty, here Flavio, I certainly appreciate it.

One of the challenges we all currently face is relevance to our
mission. I think many developers continue to work diligently in that
regard on Zaqar but results need a combination of things, hard work
and dedication are only part of that.

I am heartened by your courage in taking an honest look at the status
of your project and asking for support in understanding its place in
the overall picture. Regardless of the outcome I hope you and your
fellow developers recognize how much that speaks of your character.

I hope you get some honest answers to your question, in turn.

Thanks Flavio,
Anita.

__
OpenStack Development Mailing List (not for usage questions)
Unsubscribe: openstack-dev-requ...@lists.openstack.org?subject:unsubscribe
http://lists.openstack.org/cgi-bin/mailman/listinfo/openstack-dev


Re: [openstack-dev] [all][code quality] Voting coverage job (-1 if coverage get worse after patch)

2015-04-20 Thread gordon chung

 Date: Mon, 20 Apr 2015 07:13:31 -0400
 From: s...@dague.net
 To: openstack-dev@lists.openstack.org
 Subject: Re: [openstack-dev] [all][code quality] Voting coverage job (-1 if 
 coverage get worse after patch)

 On 04/18/2015 09:30 PM, Boris Pavlovic wrote:
 Hi stackers,

 Code coverage is one of the very important metric of overall code
 quality especially in case of Python. It's quite important to ensure
 that code is covered fully with well written unit tests.

 One of the nice thing is coverage job.

 In Rally we are running it against every check which allows us to get
 detailed information about
 coverage before merging patch:
 http://logs.openstack.org/84/175084/1/check/rally-coverage/c61d5e1/cover/

 This helped Rally core team to automate checking that new/changed code
 is covered by unit tests and we raised unit test coverage from ~78% to
 almost 91%.

 But it produces few issues:
 1)9k nitpicking - core reviewers have to put -1 if something is not
 covered by unit tests
 2) core team scaling issues - core team members spend a lot of time just
 checking that whole code is covered by unit test and leaving messages
 like this should be covered by unit test
 3) not friendly community - it's not nice to get on your code -1 from
 somebody that is asking just to write unit tests
 4) coverage regressions - sometimes we accidentally accept patches that
 reduce coverage

 To resolve this issue I improved a bit coverage job in Rally project,
 and now it compares master vs master + patch coverage. If new coverage
 is less than master job is marked as -1.

 Here is the patch for job enhancement:
 https://review.openstack.org/#/c/174645/

 Here is coverage job in action:
 patch https://review.openstack.org/#/c/174677/
 job message
 http://logs.openstack.org/77/174677/4/check/rally-coverage/ba49c90/console.html#_2015-04-17_15_57_17_695

 Honestly, I'm suspicious of approaches like this. While 90% coverage is
 clearly better than 0% coverage, it's not clear that 91% coverage is
 always better than 90% coverage. Especially when you talk about larger
 and more complex code bases.

 I actually firmly feel that #3 is wrong. I think it's a lot better to
 have an early conversation with people about unit tests that need to be
 written when they don't submit any. Because I think it's a lot less
 friendly to have someone iterate 10 patches to figure out how to pass a
 bot's idea of good tests, and then have a reviewer say it's wrong.

 Honestly, coverage for projects seems to me to be more of an analog
 measure that would be good to graph over time and make sure it's not
 regression, but personally I think the brownian motion of individual
 patches seems like it's not a great idea to gate on every single patch.
 I personally would be -1 for adding this to projects that I have +2 on.

 -Sean

 --
 Sean Dague
 http://dague.net

+1. i don't think this would be a good idea as a non-voting job either as it 
can/will lead to lazy reviews.

cheers,
gord

  
__
OpenStack Development Mailing List (not for usage questions)
Unsubscribe: openstack-dev-requ...@lists.openstack.org?subject:unsubscribe
http://lists.openstack.org/cgi-bin/mailman/listinfo/openstack-dev


Re: [openstack-dev] Multi Region Designate

2015-04-20 Thread Anik
 Hi Kiall,
Will appreciate if you can provide your comments on the email below.
Regards, Anik 

 

 From: Anik anik...@yahoo.com
 To: openstack-dev@lists.openstack.org openstack-dev@lists.openstack.org 
 Sent: Saturday, April 11, 2015 5:37 AM
 Subject: Re: [openstack-dev] Multi Region Designate
   
Hi Kiall,
Thanks for getting back. 
Yes, I understand that Designate is providing the API interface to push data 
into a DNS namespace, so not really related to the region concept in the same 
way as nova or most other OpenStack services. 
I think the problem I am highlighting here is that of making updates for zone 
data to an authoritative DNS server from distributed sources. 
Take the example of a company which has deployed their resources across 
multiple OpenStack regions. Now they just want to have a flat DNS namespace 
(say example.com). They will need to enter host - IP mapping data to some 
authoritative back end DNS server for this purpose. The records for this zone 
are being created from multiple regions either through static data entry 
through designate or via notification handlers from OpenStack events like FIP 
creation.
So my question is can we view designate simply as an data entry vehicle with an 
API front end where a single (centralized) backend DNS server can be fed data 
from multiple designate instances ? That way different designate instances in 
different regions can generate their local RRs for a zone (example.com) and 
point to the same backend DNS for populating the zone file. Once data goes into 
the centralized backend DNS, it will be the responsibility of the DNS 
infrastructure to serve the DNS data in a distributed scale out manner globally 
for lookups.
The problem that will still need to be solved is how do you create major DNS 
entries, like creating a new zone, with this approach ? I will try to describe 
a solution for that in a follow up email but wanted to get your opinion first 
on what I am describing here so far. 
Regards, Anik 

--

Message: 1
Date: Tue, 07 Apr 2015 13:00:33 +0100
From: Kiall Mac Innes ki...@macinnes.ie
To: openstack-dev@lists.openstack.org
Subject: Re: [openstack-dev] Multi Region Designate
Message-ID: 5523c6e1.9090...@macinnes.ie
Content-Type: text/plain; charset=windows-1252

Hey Anik,

So, unlike Nova or other services which really are region aware,
Designate, being designed to push data into the global DNS namespace,
doesn't have the same concept of regions.

Typically, you will either have regions which are close enough to run
a Galera/Percona cluster across them without adding too much latency, or
you will run asynchronous replication from one region to another using
an Active/Standby failover for the core DB.

The DNS team @ HP has discussed possible improvements to this many times
over the last year or so, but haven't come up with any great solutions
to providing what amounts to a global service is a per-region way. We're
certainly open to suggestions! :)

Thanks,
Kiall

On 23/03/15 04:41, Anik wrote:
 Hi,
 
 Are there any plans to have multi region DNS service through designate ?
 
 For example If a tenant has projects in multiple regions and wants to
 use a single (flat) external domain name space for floating IPs, what is
 the proposed solution for such a use case using Designate ?
  
 Regards,
 Anik
 
 
 __
 OpenStack Development Mailing List (not for usage questions)
 Unsubscribe: openstack-dev-requ...@lists.openstack.org?subject:unsubscribe
 http://lists.openstack.org/cgi-bin/mailman/listinfo/openstack-dev
 



   

  __
OpenStack Development Mailing List (not for usage questions)
Unsubscribe: openstack-dev-requ...@lists.openstack.org?subject:unsubscribe
http://lists.openstack.org/cgi-bin/mailman/listinfo/openstack-dev


Re: [openstack-dev] [all][code quality] Voting coverage job (-1 if coverage get worse after patch)

2015-04-20 Thread Dan Smith
 Let's not mix the bad unit tests in Nova with the fact that code should
 be fully covered by well written unit tests. 

I'm not using bad tests in nova to justify not having coverage testing.
I'm saying that the argument that more coverage is always better has
some real-life counter examples.

Also, a test that says coverage increased might lead to lazy +2s is
very similar to this code made it into the tree because it had a ton of
(bad) tests that made it look well-tested, which we already know is true :)

 P.S. Unit tests are the first criteria of code quality: if it is hard to
 cover code by unit tests, code is bad written and should be refactored. 

Totally agree. Draw what conclusions you will about my feelings on the
quality of the code that is tested by those tests :)

--Dan

__
OpenStack Development Mailing List (not for usage questions)
Unsubscribe: openstack-dev-requ...@lists.openstack.org?subject:unsubscribe
http://lists.openstack.org/cgi-bin/mailman/listinfo/openstack-dev


Re: [openstack-dev] [all] Using project-specific channels for official meetings (was: Proposing changes in Rally meetings)

2015-04-20 Thread Jay Pipes

+1, Jeremy. Excellent points.

-jay

On 04/20/2015 10:59 AM, Jeremy Stanley wrote:

CAD85om3RJg4fDHDKPZpmcboF+=aknm9wqo08bas0eov8dey...@mail.gmail.com

On 2015-04-17 16:26:29 +0300 (-0300), Boris Pavlovic wrote:
[...]

- Move meetings from #openstack-meeting to #openstack-rally chat.

[...]

Please don't. This means anyone who wants to be around in case an
important topic comes up in your meeting has to leave themselves
subscribed to an additional channel, and increases the chances your
meetings will conflict time-wise with others. Using the official
meeting channels increases the ability of the community at large to
be more involved in those discussions.

The new project requirements[1] only say The project has regular
meetings on IRC and those meetings are logged but it seems like an
oversight to me that it doesn't say they should happen in official
meeting channels (at least once the project's application has been
accepted). The structure reform resolution[2] did mention use
#openstack-meeting channels for their team meetings so I think it's
the implied intent there, at least. I've proposed a governance
change[3] in hopes of making this clear for others in the future,
and updated our Meetings wiki article[4] with an additional sentence
in the preamble describing the benefits and linking to related
resources.

[1] http://governance.openstack.org/reference/new-projects-requirements.html
[2] 
http://governance.openstack.org/resolutions/20141202-project-structure-reform-spec.html
[3] https://review.openstack.org/175427
[4] https://wiki.openstack.org/wiki/Meetings



__
OpenStack Development Mailing List (not for usage questions)
Unsubscribe: openstack-dev-requ...@lists.openstack.org?subject:unsubscribe
http://lists.openstack.org/cgi-bin/mailman/listinfo/openstack-dev


[openstack-dev] [Neutron][Ironic] Setting IPXE tag for dnsmasq

2015-04-20 Thread Sean M. Collins
Hi,

In the following patch, I had a question about setting the IPXE tag by
default.

https://review.openstack.org/#/c/172040/

Basically, I'm unsure if we want to set this tag by default. I freely
admit that I'm not an expert in PXE, but my thinking is that rather than
enabling it by default, we should use the extra_dhcp_opts API extension
to set the IPXE tag.

http://specs.openstack.org/openstack/neutron-specs/specs/api/extra_dhcp_options__extra-dhcp-opt_.html

Thoughts?

-- 
Sean M. Collins

__
OpenStack Development Mailing List (not for usage questions)
Unsubscribe: openstack-dev-requ...@lists.openstack.org?subject:unsubscribe
http://lists.openstack.org/cgi-bin/mailman/listinfo/openstack-dev


Re: [openstack-dev] [all][code quality] Voting coverage job (-1 if coverage get worse after patch)

2015-04-20 Thread Hayes, Graham
On 20/04/15 18:01, Clint Byrum wrote:
 Excerpts from Boris Pavlovic's message of 2015-04-18 18:30:02 -0700:
 Hi stackers,

 Code coverage is one of the very important metric of overall code quality
 especially in case of Python. It's quite important to ensure that code is
 covered fully with well written unit tests.

 One of the nice thing is coverage job.

 In Rally we are running it against every check which allows us to get
 detailed information about
 coverage before merging patch:
 http://logs.openstack.org/84/175084/1/check/rally-coverage/c61d5e1/cover/

 This helped Rally core team to automate checking that new/changed code is
 covered by unit tests and we raised unit test coverage from ~78% to almost
 91%.

 But it produces few issues:
 1) 9k nitpicking - core reviewers have to put -1 if something is not
 covered by unit tests
 2) core team scaling issues - core team members spend a lot of time just
 checking that whole code is covered by unit test and leaving messages like
 this should be covered by unit test
 3) not friendly community - it's not nice to get on your code -1 from
 somebody that is asking just to write unit tests
 4) coverage regressions - sometimes we accidentally accept patches that
 reduce coverage

 To resolve this issue I improved a bit coverage job in Rally project, and
 now it compares master vs master + patch coverage. If new coverage is less
 than master job is marked as -1.

 Here is the patch for job enhancement:
 https://review.openstack.org/#/c/174645/

 Here is coverage job in action:
 patch https://review.openstack.org/#/c/174677/
 job message
 http://logs.openstack.org/77/174677/4/check/rally-coverage/ba49c90/console.html#_2015-04-17_15_57_17_695

 
 The link to the important line was key, because without it, just clicking
 through from the review was incomprehensible to me. Can I suggest some
 whitespace or bordering so we can see where the error is easily?
 
 Anyway, interesting thoughts from everyone. I have to agree with those
 that say this isn't reliable enough to make it vote. Non-voting would be
 interesting though, if it gave a clear score difference, and a diff of
 the two coverage reports. I think this is more useful as an automated
 pointer to how things probably should be, but sometimes it's entirely
 o-k to regress this number a few points.
 
 Also graphing this over time in a post-commit job seems like a no-brainer.


Designate has started doing this - it is still a WIP as we continue
tweaking settings, but we have a dashboard here -

http://sonar.designate-ci.com/

 
 __
 OpenStack Development Mailing List (not for usage questions)
 Unsubscribe: openstack-dev-requ...@lists.openstack.org?subject:unsubscribe
 http://lists.openstack.org/cgi-bin/mailman/listinfo/openstack-dev
 


__
OpenStack Development Mailing List (not for usage questions)
Unsubscribe: openstack-dev-requ...@lists.openstack.org?subject:unsubscribe
http://lists.openstack.org/cgi-bin/mailman/listinfo/openstack-dev


  1   2   >