Re: [openstack-dev] [Neutron][bgpvpn] Service Plugin vs Service driver

2015-08-19 Thread Mathieu Rohon
Hi,

thanks for your reply irena and salvatore.

Currently, we're targeting 4 backends : bagpipe (the ref impelmentations
compatible with other ref implementations of neutron), ODL, contrail and
nuage.
Contrail and bagpipe work with networks attachments to a bgpvpn connection,
while ODL and Nuage work with routers attachments. We even start thinking
about port attachments [1]
Moreover, ODL needs a RD attribute that won't be supported by other
backends.

I think that each backend should be able to manage each kind of attachment
in the future, depending on the will of the backend dev team. But in a
firts step, we have to manage the capacity of each backend.

So, indeed, the managment of attachments to a bgpvpn connection through the
use of extensions will expose backend capacity. And I agree that it's not
the good way, since when moving from one cloud to another, the API will
change depending on the backend.

So I see two ways to solve this issue :
1-In first releases, backends that don't support a feature will through a
'NotImplemented exception when the feature will be called through the
API; We still have an inconsistent API, but hopefully, this gone be
temporary.
2-reducing the scope of the spec [2] and having less compatible backends,
and a smaller community for the bgpvpn project.

[1]https://blueprints.launchpad.net/bgpvpn/+spec/port-association
[2]https://review.openstack.org/#/c/177740/

regards,

Mathieu

On Wed, Aug 19, 2015 at 1:55 PM, Irena Berezovsky irenab@gmail.com
wrote:

 Current VPNaaS Service Plugin inherits from VpnPluginRpcDbMixin, which is
 not required for some vendor solutions, since L3 is implemented without
 leveraging L3 Agents to manage router namespaces (ODL, MidoNet, etc).
 I guess if Mixin usage will be changed to conditional RPC support based on
 drivers requirements, follow what Salvatore suggested makes perfect sense.


 On Wed, Aug 19, 2015 at 11:06 AM, Salvatore Orlando 
 salv.orla...@gmail.com wrote:

 my 0.02€ on the matter inline.

 Regards,
 Salvatore

 On 18 August 2015 at 23:45, Mathieu Rohon mathieu.ro...@gmail.com
 wrote:

 hi brandon,

 thanks for your answer.

 my answers inline,



 On Tue, Aug 18, 2015 at 8:53 PM, Brandon Logan 
 brandon.lo...@rackspace.com wrote:

 ​So let me make sure I understand this. You want to do a separate
 service plugin for what would normally be separate drivers under one
 service plugin.  The reasons for this are:


 1. You dont want users the ability to choose the type, you want it
 always to be the same one

 While in theory it is be possible to have multiple BGPVPN providers in
 the same deployment, there are control and data plane aspects that the
 service type framework at the moment cannot deal with it. Mathieu brought
 some examples in the bug report. The bottom line appears to be that the
 choice of the l3 service plugin (or whatever serves l3 in your deployment)
 also dictates the choiche of the BGPVPN service provider to employ.

 2. Some types do want to be the source of truth of the data stored,
 instead of it being the service plugin database.

 This point has little to do with service types. It's about the fact that
 plugins are not required to implemented the various db mixins in neutron.db
 and therefore not required to use the neutron DB.


 First, let me address the possibility of a solution using one service
 plugin and multiple drivers per type:


 I think that you can overcome #1 in the instantiation of the service
 plugin to check if there are more than 1 provider active, if so you can
 just throw an exception saying you can only have 1.  I'd have to look at it
 more to see if there are any caveats to this, but I think that would work.


 For #2, assuming #1 works, then the drivers that are defined can have
 some boolean that they set that will tell the plugin whether they are the
 source of truth or not, and depending on that you can store the data in the
 service plugin's db or just pass the data along, also pass GET requests to
 the drivers as well.


 I agree that those workarounds will surely works but I wonder what is
 the meaning of a service plugin/type that can only support one service
 provider? can't the service plugin be the service provider directly?


 I believe there is some value, but I am not able to quantify it at the
 moment.
 - A single service plugin also implies (more or less) a common
 user-facing APIs. I really don't want to end up in a conditons where the
 user API looks different (or the workflow is different) according to what's
 backing the neutron BGPVPN implementation
 - A single service plugin provides a commonplace for all the boilerplate
 management logic. This works for most drivers, but not for those who don't
 rely on neutron DB as a data source (unless you manage to build a
 sqlalchemy dialect for things such as opencontrail APIs, but I seriously
 doubt that it would be feasible)
 - Distinct service plugins might lead to different workflows. This is not
 necessarily a 

Re: [openstack-dev] [stable] [infra] How to auto-generate stable release notes

2015-08-19 Thread Kuvaja, Erno
 -Original Message-
 From: Robert Collins [mailto:robe...@robertcollins.net]
 Sent: Wednesday, August 19, 2015 11:38 AM
 To: OpenStack Development Mailing List (not for usage questions)
 Subject: Re: [openstack-dev] [stable] [infra] How to auto-generate stable
 release notes
 
 On 19 August 2015 at 21:19, Thierry Carrez thie...@openstack.org wrote:
  Robert Collins wrote:
  [...]
  Proposed data structure:
  - create a top level directory in each repo called release-notes
  - within that create a subdirectory called changes.
  - within the release-notes dir we place yaml files containing the
  release note inputs.
  - within the 'changes' subdirectory, the name of the yaml file will
  be the gerrit change id in a canonical form.
 E.g. I1234abcd.yaml
 This serves two purposes: it guarantees file name uniqueness (no
  merge conflicts) and lets us
 determine which release to group it in (the most recent one, in
  case of merge+revert+merge patterns).

We try to have python-glanceclient and glance_store including release notes 
upon the release time. We use in tree doc/source/index.rst for ease of access. 
This provides our release notes through: 
docs.openstack.org/developer/python-glanceclient/ and you can easily follow up 
stable branches via git: 
https://github.com/openstack/python-glanceclient/blob/stable/kilo/doc/source/index.rst

I've been trying to push mentality in to our community that last thing before 
release, we merge release notes update and tag that. What comes to stable, I 
think it's worth of adding release notes in the backport workflow.
 
  One small issue I see with using changeid in the filename is that it
  prevents people from easily proposing a backport with a release note
  snippet in them (since they can't predict the changeID). They will
  have to get it generated and then amend their commit.
 
 Backports typically use the original changeID - they will if they use git 
 cherry-
 pick.
 
  I think we need to enforce some more structure. Release notes are
  easier to read if you group them by category. For stable branches you
  should put critical upgrade notes first, then security updates,
  then random release notes. For master branch notes we usually have
  critical upgrade notes, then major features, then known issues,
  then random release notes. So I would encourage a slightly more
  detailed schema with categories to keep consistency and readability.

Strong maybe, pointless in stable if our aim is to have each commit being 
release or if we anyways have one or two changes per topic.

This would make sense on initial release from master excluding libs and clients 
which tends to have less changes per release anyways.
 
 Sure - please fill it in :). I was winging it, since I don't do release 
 notes, I had
 no idea of your needs.
 
  Processing:
  1) determine the revisions we need to generate release notes for. By
  default generate notes for the current minor release. (E.g. if the
  tree version is 1.2.3.dev4 we would generate release notes for 1.2.0,
  1.2.1, 1.2.2, 1.2.3[which dev4 is leading up to]).
 
  How would that work in a post-versioned world ? What would you
  generate if the tree version is 1.2.3.post12 ?
 
 1.2.3 is still the version, not that we can use post versions at all with pbr.
 (Short story - we can't because we used them wrongly and we haven't had
 nearly enough time to flush out remaining instances in the wild).
 
  2) For each version: scan all the commits to determine gerrit change-id's.
   i) read in all those change ids .yaml files and pull out any notes within
 them.
   ii) read in any full version yaml file (and merge in its contained
  notes)
   iii) Construct a markdown document as follows:
a) Sort any preludes (there should be only one at most, but lets
  not error if there are multiple)
b) sort any notes
 
  We would sort them by category.
 
 The requirement for deterministic results means we'd just sort them.
 If they are divided into categories, we'd sort the list of categories (perhaps
 according to some schema) and then within each category sort the notes.
 
c) for each note transform it into a bullet point by prepending its
  first line with '- ' and every subsequent line with '  ' (two spaces
  to form a hanging indent).
d) strip any trailing \n's from everything.
e) join the result - '\n'.join(chain(preludes, notes))
   iv) we output the resulting file to release-notes/$version.md where
  $version is the pbr reported version for the tree (e.g. in the
  example above it would be 1.2.3.dev4, *not* 1.2.3).
 
  So you would have release-notes/1.2.2.yaml and release-notes/1.2.2.md
  in the same directory, with one being a subset of the data present in
  the other ? That feels a bit confusing. I would rather use two
  separate directories (source and output) for that.
 
 If you like, sure. Though the thing I was thinking was that for very old 
 things
 we might generate the md file, delete the yaml, 

[openstack-dev] [requirements] [global-requirements] [mistral] Using pika library

2015-08-19 Thread Nikolay Makhotkin
Hi, folks!

Recently we've had the discussion with oslo.messaging team about
acknowledge feature in RabbitMQ:
http://lists.openstack.org/pipermail/openstack-dev/2015-July/068806.html

After that Mistral team did the research about using *kombu *or *pika*
library for implementation of remote procedure call server. Both kombu and
pika was met our requirements. But we would prefer to use *pika* by next
reasons:

 1. It is less complex than *kombu*;
 2. *kombu* itself is abstraction of messaging (but we don't need that);
 3. We had the discussion with one of RabbitMQ developer which advised us
to use *pika* (comparing to *kombu*)


Is it possible to add *pika *to the global-requirements for our needs?

Thanks.
-- 
Best Regards,
Nikolay
@ Mirantis Inc.
__
OpenStack Development Mailing List (not for usage questions)
Unsubscribe: openstack-dev-requ...@lists.openstack.org?subject:unsubscribe
http://lists.openstack.org/cgi-bin/mailman/listinfo/openstack-dev


[openstack-dev] [tricircle] Cancellation of Weekly Team Meeting 2015.08.19

2015-08-19 Thread Zhipeng Huang
Hi Team,

Due to inability of several team members to attend today's meeting, the
meeting would be canceled and discussion are welcomed on the mailing list :)

-- 
Zhipeng (Howard) Huang

Standard Engineer
IT Standard  Patent/IT Prooduct Line
Huawei Technologies Co,. Ltd
Email: huangzhip...@huawei.com
Office: Huawei Industrial Base, Longgang, Shenzhen

(Previous)
Research Assistant
Mobile Ad-Hoc Network Lab, Calit2
University of California, Irvine
Email: zhipe...@uci.edu
Office: Calit2 Building Room 2402

OpenStack, OPNFV, OpenDaylight, OpenCompute Aficionado
__
OpenStack Development Mailing List (not for usage questions)
Unsubscribe: openstack-dev-requ...@lists.openstack.org?subject:unsubscribe
http://lists.openstack.org/cgi-bin/mailman/listinfo/openstack-dev


Re: [openstack-dev] [openstack-infra][third-paty][CI][nodepool]Using Nodepool for creating slaves.

2015-08-19 Thread Asselin, Ramy
Hi Xies, Abhi,

It works a bit differently.
Nodepool is responsible to launch VMs which it then registers as Jenkins Slaves.
These Jenkins slaves have “labels” which identify certain user-properties such 
as Operating System, image contents, etc.
When CI wants to run a test case it submits the job to Jenkins master to be run 
on any Jenkins slave that matches the desired “label”.
Jenkins will wait until a slave of that ‘label’ is available and assign the job 
once available.

Ramy


From: Xie, Xianshan [mailto:xi...@cn.fujitsu.com]
Sent: Tuesday, August 18, 2015 10:59 PM
To: OpenStack Development Mailing List (not for usage questions)
Subject: Re: [openstack-dev] [openstack-infra][third-paty][CI][nodepool]Using 
Nodepool for creating slaves.

Hi Abhi,
   IIUC, you should create and configure slaves(these slaves can be VMs or real 
physical machine) in Jenkins.
And the nodepool is used to create and pool VMs automatically, and these VMs 
should be run on the slaves.
Then, while CI wants to build and execute a testcase, especially which attempts 
to be run on an isolated host, the nodepool will match a proper VM for this 
testcase.

Hope this might help you.


Xiexs


From: Abhishek Shrivastava [mailto:abhis...@cloudbyte.com]
Sent: Tuesday, August 18, 2015 1:46 PM
To: openstack-in...@lists.openstack.org; OpenStack Development Mailing List 
(not for usage questions)
Subject: Re: [openstack-dev] [openstack-infra][third-paty][CI][nodepool]Using 
Nodepool for creating slaves.

Also adding the following:

  *   
https://github.com/openstack-infra/project-config/tree/master/nodepool/elements
Does this means that we don't have to take care of creating slaves(i.e; 
installing slave using scripts as we have done in master) and it will be done 
automatically, and also we don't have to configure slaves in Jenkins.

A bit confusing for me so if anyone can explain it to me then it will be very 
helpful.

On Tue, Aug 18, 2015 at 11:11 AM, Abhishek Shrivastava 
abhis...@cloudbyte.commailto:abhis...@cloudbyte.com wrote:
Hi Folks,

I was going through Ramy's guide for setting up CI, there I found out the 
following:

  *   
https://github.com/rasselin/os-ext-testing#setting-up-nodepool-jenkins-slaves
But I don't get the fact on how to create the image, also what major settings 
need to be done to make the config perfect for use. Can anyone help me with 
that?

--
[Image removed by sender.]
Thanks  Regards,
Abhishek
Cloudbyte Inc.http://www.cloudbyte.com



--
[Image removed by sender.]
Thanks  Regards,
Abhishek
Cloudbyte Inc.http://www.cloudbyte.com
__
OpenStack Development Mailing List (not for usage questions)
Unsubscribe: openstack-dev-requ...@lists.openstack.org?subject:unsubscribe
http://lists.openstack.org/cgi-bin/mailman/listinfo/openstack-dev


Re: [openstack-dev] [requirements] [global-requirements] [mistral] Using pika library

2015-08-19 Thread Davanum Srinivas
Nikolay,

Do you mean that you will *NOT* use oslo.messaging and use pika directly.
I'd strongly discourage that possibility.

Few members on the oslo.messaging team are looking at pika library already
and are doing a prototype:
https://github.com/dukhlov/oslo.messaging/blob/master/oslo_messaging/_drivers/impl_pika.py

If you are interested in that effort, please let us know.

Thanks,
Dims


On Wed, Aug 19, 2015 at 7:21 AM, Nikolay Makhotkin nmakhot...@mirantis.com
wrote:

 Hi, folks!

 Recently we've had the discussion with oslo.messaging team about
 acknowledge feature in RabbitMQ:
 http://lists.openstack.org/pipermail/openstack-dev/2015-July/068806.html

 After that Mistral team did the research about using *kombu *or *pika*
 library for implementation of remote procedure call server. Both kombu and
 pika was met our requirements. But we would prefer to use *pika* by next
 reasons:

  1. It is less complex than *kombu*;
  2. *kombu* itself is abstraction of messaging (but we don't need that);
  3. We had the discussion with one of RabbitMQ developer which advised us
 to use *pika* (comparing to *kombu*)


 Is it possible to add *pika *to the global-requirements for our needs?

 Thanks.
 --
 Best Regards,
 Nikolay
 @ Mirantis Inc.

 __
 OpenStack Development Mailing List (not for usage questions)
 Unsubscribe: openstack-dev-requ...@lists.openstack.org?subject:unsubscribe
 http://lists.openstack.org/cgi-bin/mailman/listinfo/openstack-dev




-- 
Davanum Srinivas :: https://twitter.com/dims
__
OpenStack Development Mailing List (not for usage questions)
Unsubscribe: openstack-dev-requ...@lists.openstack.org?subject:unsubscribe
http://lists.openstack.org/cgi-bin/mailman/listinfo/openstack-dev


Re: [openstack-dev] [requirements] [global-requirements] [mistral] Using pika library

2015-08-19 Thread Nikolay Makhotkin
Hi, Davanum!

Have you already read the thread [1]? It is about acknowledge feature in
oslo.messaging. Particularly, about the absent of this feature in
oslo.messaging.

The guys from messaging said that it is very problematically to add that
kind of feature to oslo.messaging because it does not fit to
oslo.messaging's approach.

[1] http://lists.openstack.org/pipermail/openstack-dev/2015-July/068806.html

On Wed, Aug 19, 2015 at 2:35 PM, Davanum Srinivas dava...@gmail.com wrote:

 Nikolay,

 Do you mean that you will *NOT* use oslo.messaging and use pika directly.
 I'd strongly discourage that possibility.

 Few members on the oslo.messaging team are looking at pika library already
 and are doing a prototype:

 https://github.com/dukhlov/oslo.messaging/blob/master/oslo_messaging/_drivers/impl_pika.py

 If you are interested in that effort, please let us know.

 Thanks,
 Dims


 On Wed, Aug 19, 2015 at 7:21 AM, Nikolay Makhotkin 
 nmakhot...@mirantis.com wrote:

 Hi, folks!

 Recently we've had the discussion with oslo.messaging team about
 acknowledge feature in RabbitMQ:
 http://lists.openstack.org/pipermail/openstack-dev/2015-July/068806.html

 After that Mistral team did the research about using *kombu *or *pika*
 library for implementation of remote procedure call server. Both kombu and
 pika was met our requirements. But we would prefer to use *pika* by next
 reasons:

  1. It is less complex than *kombu*;
  2. *kombu* itself is abstraction of messaging (but we don't need that);
  3. We had the discussion with one of RabbitMQ developer which advised us
 to use *pika* (comparing to *kombu*)


 Is it possible to add *pika *to the global-requirements for our needs?

 Thanks.
 --
 Best Regards,
 Nikolay
 @ Mirantis Inc.

 __
 OpenStack Development Mailing List (not for usage questions)
 Unsubscribe:
 openstack-dev-requ...@lists.openstack.org?subject:unsubscribe
 http://lists.openstack.org/cgi-bin/mailman/listinfo/openstack-dev




 --
 Davanum Srinivas :: https://twitter.com/dims

 __
 OpenStack Development Mailing List (not for usage questions)
 Unsubscribe: openstack-dev-requ...@lists.openstack.org?subject:unsubscribe
 http://lists.openstack.org/cgi-bin/mailman/listinfo/openstack-dev




-- 
Best Regards,
Nikolay
__
OpenStack Development Mailing List (not for usage questions)
Unsubscribe: openstack-dev-requ...@lists.openstack.org?subject:unsubscribe
http://lists.openstack.org/cgi-bin/mailman/listinfo/openstack-dev


Re: [openstack-dev] [openstack][nova] Streamlining of config options in nova

2015-08-19 Thread Markus Zoeller
Markus Zoeller/Germany/IBM@IBMDE wrote on 08/17/2015 09:37:09 AM:

 From: Markus Zoeller/Germany/IBM@IBMDE
 To: OpenStack Development Mailing List \(not for usage questions\) 
 openstack-dev@lists.openstack.org
 Date: 08/17/2015 09:48 AM
 Subject: Re: [openstack-dev] [openstack][nova] Streamlining of config 
 options in nova
 
 Michael Still mi...@stillhq.com wrote on 08/12/2015 10:08:26 PM:
 
  From: Michael Still mi...@stillhq.com
  To: OpenStack Development Mailing List (not for usage questions) 
  openstack-dev@lists.openstack.org
  Date: 08/12/2015 10:14 PM
  Subject: Re: [openstack-dev] [openstack][nova] Streamlining of config 
  options in nova
  [...]
  
  Do we see https://review.openstack.org/#/c/205154/ as a reasonable 
  example of such centralization? If not, what needs to change there to 
  make it an example of that centralization? I see value in having a 
  worked example people can follow before we attempt a large number of 
  these moves.
  [...]
  Michael
 
 IIUC, this change doesn't yet meet the idea and needs to change by:
 * creating a module nova/conf/default.py and
 * move the imagecache config options to that module
 
 After this change, it wouldn't address the need to lookup which
 services use a specific config option. What about enhancing this to
 something like this:
 [...]

Based on Michael's proposal I did another one which shows what I tried
to describe in the previous mail. 
The example: https://review.openstack.org/#/c/214581/

Regards,
Markus Zoeller (markus_z)


__
OpenStack Development Mailing List (not for usage questions)
Unsubscribe: openstack-dev-requ...@lists.openstack.org?subject:unsubscribe
http://lists.openstack.org/cgi-bin/mailman/listinfo/openstack-dev


Re: [openstack-dev] [devstack] Possible issues cryptography 1.0 and os-client-config 1.6.2

2015-08-19 Thread Sean Dague
On 08/18/2015 09:34 PM, John Griffith wrote:
 
 
 On Tue, Aug 18, 2015 at 7:42 PM, John Griffith john.griffi...@gmail.com
 mailto:john.griffi...@gmail.com wrote:
 
 
 
 On Tue, Aug 18, 2015 at 2:14 PM, Robert Collins
 robe...@robertcollins.net mailto:robe...@robertcollins.net wrote:
 
 On 19 August 2015 at 03:51, Sean Dague s...@dague.net
 mailto:s...@dague.net wrote:
 
  So... I'm at Linux Con this week, meaning that things will be slow. 
 I
  think - https://review.openstack.org/#/c/208582/ (slightly updated 
 this
  morning) will get devstack users working again. And I agree, we 
 really
  need devstack and the gate to be convergent on their solution here, 
 not
  divergent.
 
 So unless something has changed, devstack users are broken only on
 Fedora - and the constraints thing won't protect them at this stage
 because of two things.
 
 Firstly, the bug isn't a cryptography bug - its a setuptools / pip
 thing resulting in the .so pip installs being in the arch
 neutral path
 rather than lib64, and this would work except that devstack also
 installs python-cffi, which then masks the pip updated one. I don't
 know why devstack is installing the binary package :/. This is a
 Fedora platform specific bug - it doesn't show up on Ubuntu - either
 because devstack doesn't install the ubuntu python-cffi package, or
 because pip/setuptools on ubuntu don't have the same disconnect with
 system packages in the same way. I'm not sure which.
 
 Secondly, until we have a gate on openstack/requirements that checks
 devstack-on-fedora, fedora developers will be exposed to this
 sort of
 thing from time to time :/.
 
 -Rob
 
 --
 Robert Collins rbtcoll...@hp.com mailto:rbtcoll...@hp.com
 Distinguished Technologist
 HP Converged Cloud
 
 
 __
 OpenStack Development Mailing List (not for usage questions)
 Unsubscribe:
 openstack-dev-requ...@lists.openstack.org?subject:unsubscribe
 http://openstack-dev-requ...@lists.openstack.org?subject:unsubscribe
 http://lists.openstack.org/cgi-bin/mailman/listinfo/openstack-dev
 
 ​Catching up on this thread, looks like the referenced devstk change
 above (987dc6453e8e3a8a46d748059378564c42bafc5c) merged and broke
 things.  Seems we don't install opt/stack/requirements so stack.sh
 is failing for third party CI's that don't use node-pool (suspect
 they'll fail when they're nodes are rebuilt similar to last weeks
 issue with keystone).
 
 Went ahead and confirmed that a fresh download and stack.sh locally
 fails, going to have a look after dinner but thought maybe somebody
 already knows what's up with this.
 
 Thanks,
 John
 
 ​For those that are interested, Clark pointed me to this patch [1] which
 in fact the addresses the issue I was running in to. 
 
 [1]: https://review.openstack.org/#/c/214409/

Sorry about jumping the gun there. We thought, incorrectly, we had the
right fix. And it's a conference week so access to my local test env
wasn't easy.

I've got a few ideas on how to robustify this whole path to make issues
like this less likely to happen in the future.

My bad.

-Sean

-- 
Sean Dague
http://dague.net



signature.asc
Description: OpenPGP digital signature
__
OpenStack Development Mailing List (not for usage questions)
Unsubscribe: openstack-dev-requ...@lists.openstack.org?subject:unsubscribe
http://lists.openstack.org/cgi-bin/mailman/listinfo/openstack-dev


Re: [openstack-dev] [openstack-deb] Devstack stable/juno fails to install

2015-08-19 Thread Matt Riedemann



On 8/18/2015 5:49 PM, Tony Breeds wrote:

On Tue, Aug 18, 2015 at 10:04:56PM +, Jeremy Stanley wrote:

On 2015-08-18 15:48:08 -0500 (-0500), Matt Riedemann wrote:
[...]

You'd also have to raise the cap on swiftclient in g-r stable/juno
to python-swiftclient=2.2.0,2.4.0.

[...]

Followed by stable point releases of everything with a stable/juno
branch and a {test-,}requirements.txt entry for python-swiftclient.
Oh, and some of those things might _also_ have overly-strict caps in
global-requirements.txt, so iterate until clean.


Oh boy ;P

Yours Tony.



__
OpenStack Development Mailing List (not for usage questions)
Unsubscribe: openstack-dev-requ...@lists.openstack.org?subject:unsubscribe
http://lists.openstack.org/cgi-bin/mailman/listinfo/openstack-dev



Yeah, it sucks.

--

Thanks,

Matt Riedemann


__
OpenStack Development Mailing List (not for usage questions)
Unsubscribe: openstack-dev-requ...@lists.openstack.org?subject:unsubscribe
http://lists.openstack.org/cgi-bin/mailman/listinfo/openstack-dev


Re: [openstack-dev] [nova] API: Question on 'Retry-After': 0 in HTTPForbidden

2015-08-19 Thread Chen CH Ji
ok thanks for confirm, I will file a bug and fix it~,

Best Regards!

Kevin (Chen) Ji 纪 晨

Engineer, zVM Development, CSTL
Notes: Chen CH Ji/China/IBM@IBMCN   Internet: jiche...@cn.ibm.com
Phone: +86-10-82454158
Address: 3/F Ring Building, ZhongGuanCun Software Park, Haidian District,
Beijing 100193, PRC



From:   Alex Xu hejie...@intel.com
To: OpenStack Development Mailing List (not for usage questions)
openstack-dev@lists.openstack.org
Date:   08/19/2015 08:14 AM
Subject:Re: [openstack-dev] [nova] API: Question on 'Retry-After': 0 in
HTTPForbidden



+1 for Retry-After is wrong for quota case

  在 2015年8月19日,下午1:32,GHANSHYAM MANN ghanshyamm...@gmail.com
  写道:

  Retry-After
__
OpenStack Development Mailing List (not for usage questions)
Unsubscribe: openstack-dev-requ...@lists.openstack.org?subject:unsubscribe
http://lists.openstack.org/cgi-bin/mailman/listinfo/openstack-dev
__
OpenStack Development Mailing List (not for usage questions)
Unsubscribe: openstack-dev-requ...@lists.openstack.org?subject:unsubscribe
http://lists.openstack.org/cgi-bin/mailman/listinfo/openstack-dev


Re: [openstack-dev] [Neutron][bgpvpn] Service Plugin vs Service driver

2015-08-19 Thread Irena Berezovsky
Current VPNaaS Service Plugin inherits from VpnPluginRpcDbMixin, which is
not required for some vendor solutions, since L3 is implemented without
leveraging L3 Agents to manage router namespaces (ODL, MidoNet, etc).
I guess if Mixin usage will be changed to conditional RPC support based on
drivers requirements, follow what Salvatore suggested makes perfect sense.

On Wed, Aug 19, 2015 at 11:06 AM, Salvatore Orlando salv.orla...@gmail.com
wrote:

 my 0.02€ on the matter inline.

 Regards,
 Salvatore

 On 18 August 2015 at 23:45, Mathieu Rohon mathieu.ro...@gmail.com wrote:

 hi brandon,

 thanks for your answer.

 my answers inline,



 On Tue, Aug 18, 2015 at 8:53 PM, Brandon Logan 
 brandon.lo...@rackspace.com wrote:

 ​So let me make sure I understand this. You want to do a separate
 service plugin for what would normally be separate drivers under one
 service plugin.  The reasons for this are:


 1. You dont want users the ability to choose the type, you want it
 always to be the same one

 While in theory it is be possible to have multiple BGPVPN providers in
 the same deployment, there are control and data plane aspects that the
 service type framework at the moment cannot deal with it. Mathieu brought
 some examples in the bug report. The bottom line appears to be that the
 choice of the l3 service plugin (or whatever serves l3 in your deployment)
 also dictates the choiche of the BGPVPN service provider to employ.

 2. Some types do want to be the source of truth of the data stored,
 instead of it being the service plugin database.

 This point has little to do with service types. It's about the fact that
 plugins are not required to implemented the various db mixins in neutron.db
 and therefore not required to use the neutron DB.


 First, let me address the possibility of a solution using one service
 plugin and multiple drivers per type:


 I think that you can overcome #1 in the instantiation of the service
 plugin to check if there are more than 1 provider active, if so you can
 just throw an exception saying you can only have 1.  I'd have to look at it
 more to see if there are any caveats to this, but I think that would work.


 For #2, assuming #1 works, then the drivers that are defined can have
 some boolean that they set that will tell the plugin whether they are the
 source of truth or not, and depending on that you can store the data in the
 service plugin's db or just pass the data along, also pass GET requests to
 the drivers as well.


 I agree that those workarounds will surely works but I wonder what is the
 meaning of a service plugin/type that can only support one service
 provider? can't the service plugin be the service provider directly?


 I believe there is some value, but I am not able to quantify it at the
 moment.
 - A single service plugin also implies (more or less) a common user-facing
 APIs. I really don't want to end up in a conditons where the user API looks
 different (or the workflow is different) according to what's backing the
 neutron BGPVPN implementation
 - A single service plugin provides a commonplace for all the boilerplate
 management logic. This works for most drivers, but not for those who don't
 rely on neutron DB as a data source (unless you manage to build a
 sqlalchemy dialect for things such as opencontrail APIs, but I seriously
 doubt that it would be feasible)
 - Distinct service plugins might lead to different workflows. This is not
 necessarily a bad thing, because integration for some backends might need
 it. However this means that during review phase particular attention should
 be paid to ensure the behaviour of each service plugin respects the API
 specification.



 The reasons why I'm considering this change are :

 1. I'm not sure we would have some use cases where we would be able to
 choose one bgpvpn backend independently from the provider of the core
 plugin (or a mech driver in the ML2 case) and/or the router plugin.
 If one use ODL to manage its core resources, he won't be able to use
 nuage or contrail to manage its bgpvpn connection.
 The bgpvpn project is more about having a common API than having the
 capacity to mix backends. At least for the moment.


 I agree with this; but this problem exists regardless of whether you have
 a single service plugin with drivers or multiple service plugins. You are
 unlikely to be able to use the contrail BGPVPN service plugin is core and
 l3 are managed by ODL, I think.



 2. I'm also considering that each plugin, which would be backend
 dependent, could declare what features it supports through the use of
 extensions.


 Unfortunately extensions are the only way to declare supported
 capabilities at the moment. But please - don't end up allowing each service
 plugin exposing a different API.


 Each plugin would be a bgpvpn service type, and would implement the
 bgpvpn extension, but some of them could extend the bgpvpn_connection
 resource with other extensions also hosted in the bgpvpn 

Re: [openstack-dev] [cinder] [third-party] ProphetStor CI account

2015-08-19 Thread Rick Chen
HI Ramy:
Many thanks, I completed to install log-server.

http://download.prophetstor.com/prophetstor_ci/203895/3/check/prophetstor-ds
vm-tempest-cinder-ci/5111/logs/

So, can you help me to re-enable my gerrit account?


-Original Message-
From: Asselin, Ramy [mailto:ramy.asse...@hp.com] 
Sent: Tuesday, August 18, 2015 11:28 PM
To: OpenStack Development Mailing List (not for usage questions)
openstack-dev@lists.openstack.org; 'Mike Perez' thin...@gmail.com
Subject: Re: [openstack-dev] [cinder] [third-party] ProphetStor CI account

Rick,

These files are missing newlines i.e. unreadable for me: [1] [2] [3]

Out of curiosity, any particular reason you don't set up a log server like
OpenStack Infra?
I have a script to do that [4], which uses the upstream common solution [5]

Ramy

[1]
http://download.prophetstor.com/prophetstor_ci/203895/3/check/prophetstor-ds
vm-tempest-cinder-ci/5100/logs/devstacklog.txt.gz
[2]
http://download.prophetstor.com/prophetstor_ci/203895/3/check/prophetstor-ds
vm-tempest-cinder-ci/5100/logs/etc/cinder/cinder.conf.txt.gz
[3]
http://download.prophetstor.com/prophetstor_ci/203895/3/check/prophetstor-ds
vm-tempest-cinder-ci/5100/logs/screen-c-vol.txt.gz
[4]
https://github.com/rasselin/os-ext-testing/blob/master/puppet/install_log_se
rver.sh
]5]
http://git.openstack.org/cgit/openstack-infra/puppet-openstackci/tree/manife
sts/logserver.pp



-Original Message-
From: Rick Chen [mailto:rick.c...@prophetstor.com]
Sent: Monday, August 17, 2015 8:22 AM
To: 'Mike Perez'
Cc: openstack-dev@lists.openstack.org
Subject: Re: [openstack-dev] [cinder] [third-party] ProphetStor CI account

HI Mike:
I completed to refine our CI configuration to follow Ramy's
comments. Does any missed or other attention I need respect?

[1] Add export DEVSTACK_GATE_TEMPEST_REGEX=volume to verify all
cinder volume testing.
[2] Add each service configuration in the log.

http://download.prophetstor.com/prophetstor_ci/203895/3/check/prophetstor-ds
vm-tempest-cinder-ci/5100/logs/etc/
[3] Add email alert when the devstack build failed to instead of you
notify to me.
[4] Integrate VMware snapshot revert feature in the Jenkins master
to clean CI slave machine OS environment that avoid the devstack building
failed due to previous devstack garbage configuration.
[5] Latest CI result for you reference.

http://download.prophetstor.com/prophetstor_ci/203895/3/check/prophetstor-ds
vm-tempest-cinder-ci/5100/logs/
http://download.prophetstor.com/prophetstor_ci/

[6] Logs need to be browsable online.
Add Rewrite module and rule in the apache configuration.

my gerrit account:  prophetstor-ci
   gerrit account email:prophetstor...@prophetstor.com

Many thanks.

-Original Message-
From: Mike Perez [mailto:thin...@gmail.com]
Sent: Friday, August 14, 2015 11:41 PM
To: Rick Chen rick.c...@prophetstor.com
Cc: openstack-dev@lists.openstack.org
Subject: Re: [cinder] [third-party]RE: [OpenStack-Infra] ProphetStor CI
account

On 09:44 Aug 14, Rick Chen wrote:
 HI Mike:
   Sorry again, I already add email alert agent in our CI Jenkins
server 
 to capture each failed build result.
   [1] -
 http://lists.openstack.org/pipermail/third-party-announce/2015-June/00
 0192.h
 tml
   [2] -
 http://lists.openstack.org/pipermail/third-party-announce/2015-June/00
 0193.h
 tml
   Solution 1: Our Jenkins client machine is vmware machine, I already 
 add snapshot revert script in the Jenkins Job script. Each git review job
 trigger the client will revert to  clean environment
 to solve this problem.
   Solution 2: I don't know whiched changed to make keystone unable to

 import pastedeploy. So I try to uninstall python-pastedeploy package 
 in the local to solve some
issue about unable to build devstack issue.
   Sorry again to disturb you.

Rick,

I looked at your CI results directory [1], but it looks like the last time
this ran was on July 28th according to the last modified dates. This should
be actively running even if you account is disabled from leaving comments,
so I can verify from the logs things are running fine again.

In addition, see Ramy's comments with issues with the CI [2].

[1] - http://download.prophetstor.com/prophetstor_ci/?C=M;O=A
[2] -
http://lists.openstack.org/pipermail/openstack-infra/2015-August/003057.html

--
Mike Perez


__
OpenStack Development Mailing List (not for usage questions)
Unsubscribe: openstack-dev-requ...@lists.openstack.org?subject:unsubscribe
http://lists.openstack.org/cgi-bin/mailman/listinfo/openstack-dev

__
OpenStack Development Mailing List (not for usage questions)
Unsubscribe: 

Re: [openstack-dev] [cinder] [third-party] ProphetStor CI account

2015-08-19 Thread Asselin, Ramy
Hi Rick,

Huge improvement. Log server is looking great! Thanks!

Next question is what (cinder) patch set is that job running?
It seems to be cinder master [1]. 
Is that intended? That's fine to validate general functionality, but eventually 
it needs to run the actual cinder patch set under test.

It's helpful to include a link to the patch that invoked the job at the top of 
the console.log file, e.g. [2].

Ramy

[1] 
http://download.prophetstor.com/prophetstor_ci/203895/3/check/prophetstor-dsvm-tempest-cinder-ci/5111/logs/devstack-gate-setup-workspace-new.txt.gz#_2015-08-19_18_27_38_953
[2] 
https://github.com/rasselin/os-ext-testing/blob/master/puppet/modules/os_ext_testing/templates/jenkins_job_builder/config/macros.yaml.erb#L93


-Original Message-
From: Rick Chen [mailto:rick.c...@prophetstor.com] 
Sent: Wednesday, August 19, 2015 5:23 AM
To: 'OpenStack Development Mailing List (not for usage questions)'; 'Mike Perez'
Subject: Re: [openstack-dev] [cinder] [third-party] ProphetStor CI account

HI Ramy:
Many thanks, I completed to install log-server.

http://download.prophetstor.com/prophetstor_ci/203895/3/check/prophetstor-ds
vm-tempest-cinder-ci/5111/logs/

So, can you help me to re-enable my gerrit account?


-Original Message-
From: Asselin, Ramy [mailto:ramy.asse...@hp.com]
Sent: Tuesday, August 18, 2015 11:28 PM
To: OpenStack Development Mailing List (not for usage questions) 
openstack-dev@lists.openstack.org; 'Mike Perez' thin...@gmail.com
Subject: Re: [openstack-dev] [cinder] [third-party] ProphetStor CI account

Rick,

These files are missing newlines i.e. unreadable for me: [1] [2] [3]

Out of curiosity, any particular reason you don't set up a log server like 
OpenStack Infra?
I have a script to do that [4], which uses the upstream common solution [5]

Ramy

[1]
http://download.prophetstor.com/prophetstor_ci/203895/3/check/prophetstor-ds
vm-tempest-cinder-ci/5100/logs/devstacklog.txt.gz
[2]
http://download.prophetstor.com/prophetstor_ci/203895/3/check/prophetstor-ds
vm-tempest-cinder-ci/5100/logs/etc/cinder/cinder.conf.txt.gz
[3]
http://download.prophetstor.com/prophetstor_ci/203895/3/check/prophetstor-ds
vm-tempest-cinder-ci/5100/logs/screen-c-vol.txt.gz
[4]
https://github.com/rasselin/os-ext-testing/blob/master/puppet/install_log_se
rver.sh
]5]
http://git.openstack.org/cgit/openstack-infra/puppet-openstackci/tree/manife
sts/logserver.pp



-Original Message-
From: Rick Chen [mailto:rick.c...@prophetstor.com]
Sent: Monday, August 17, 2015 8:22 AM
To: 'Mike Perez'
Cc: openstack-dev@lists.openstack.org
Subject: Re: [openstack-dev] [cinder] [third-party] ProphetStor CI account

HI Mike:
I completed to refine our CI configuration to follow Ramy's comments. 
Does any missed or other attention I need respect?

[1] Add export DEVSTACK_GATE_TEMPEST_REGEX=volume to verify all 
cinder volume testing.
[2] Add each service configuration in the log.

http://download.prophetstor.com/prophetstor_ci/203895/3/check/prophetstor-ds
vm-tempest-cinder-ci/5100/logs/etc/
[3] Add email alert when the devstack build failed to instead of you 
notify to me.
[4] Integrate VMware snapshot revert feature in the Jenkins master to 
clean CI slave machine OS environment that avoid the devstack building failed 
due to previous devstack garbage configuration.
[5] Latest CI result for you reference.

http://download.prophetstor.com/prophetstor_ci/203895/3/check/prophetstor-ds
vm-tempest-cinder-ci/5100/logs/
http://download.prophetstor.com/prophetstor_ci/

[6] Logs need to be browsable online.
Add Rewrite module and rule in the apache configuration.

my gerrit account:  prophetstor-ci
   gerrit account email:prophetstor...@prophetstor.com

Many thanks.

-Original Message-
From: Mike Perez [mailto:thin...@gmail.com]
Sent: Friday, August 14, 2015 11:41 PM
To: Rick Chen rick.c...@prophetstor.com
Cc: openstack-dev@lists.openstack.org
Subject: Re: [cinder] [third-party]RE: [OpenStack-Infra] ProphetStor CI account

On 09:44 Aug 14, Rick Chen wrote:
 HI Mike:
   Sorry again, I already add email alert agent in our CI Jenkins
server 
 to capture each failed build result.
   [1] -
 http://lists.openstack.org/pipermail/third-party-announce/2015-June/00
 0192.h
 tml
   [2] -
 http://lists.openstack.org/pipermail/third-party-announce/2015-June/00
 0193.h
 tml
   Solution 1: Our Jenkins client machine is vmware machine, I already 
 add snapshot revert script in the Jenkins Job script. Each git review job
 trigger the client will revert to  clean environment
 to solve this problem.
   Solution 2: I don't know whiched changed to make keystone unable to

 import pastedeploy. So I try to uninstall python-pastedeploy package 
 in the local to solve some
issue about unable to 

[openstack-dev] Cross-project meeting times

2015-08-19 Thread Anne Gentle
Hi all,

In last week's TC Highlights blog post [1] I asked if there is interest in
moving the cross-project meeting. Historically it is held after the TC
meeting, but there isn't a requirement for those timings to line up. I've
heard from European and Eastern Standard Time contributors that it's a
tough time to meet half the year. It's also a bit early for APAC, my
apologies for noting this but still proposing to meet earlier.

I'd like to propose a new cross-project meeting time, 1800 Tuesdays. To
that end I've created a review with the proposed time:

https://review.openstack.org/214605

Please take a look, see if you think it could work, and let us know either
on this list or the review itself.

Thanks,

Anne

1.
http://www.openstack.org/blog/2015/08/technical-committee-highlights-august-11-2015/


--
Anne Gentle
Rackspace
Principal Engineer
www.justwriteclick.com
__
OpenStack Development Mailing List (not for usage questions)
Unsubscribe: openstack-dev-requ...@lists.openstack.org?subject:unsubscribe
http://lists.openstack.org/cgi-bin/mailman/listinfo/openstack-dev


Re: [openstack-dev] Cross-project meeting times

2015-08-19 Thread Anne Gentle
On Wed, Aug 19, 2015 at 9:33 AM, Jeremy Stanley fu...@yuggoth.org wrote:

 On 2015-08-19 08:17:06 -0500 (-0500), Anne Gentle wrote:
  In last week's TC Highlights blog post [1] I asked if there is interest
 in
  moving the cross-project meeting. Historically it is held after the TC
  meeting, but there isn't a requirement for those timings to line up. I've
  heard from European and Eastern Standard Time contributors that it's a
  tough time to meet half the year.

 I'm in USA EST/EDT and it's not been particularly inconvenient for
 me, though I don't have children or keep a strict business hours
 schedule so perhaps that's why.

  It's also a bit early for APAC, my apologies for noting this but
  still proposing to meet earlier.

 Yeah, I'm not especially keen on ostracizing APAC for the sake of
 EMEA or the Americas, but I get that there's never a perfect time
 for everyone on the planet.

  I'd like to propose a new cross-project meeting time, 1800
  Tuesdays. To that end I've created a review with the proposed
  time:
 
  https://review.openstack.org/214605
 
  Please take a look, see if you think it could work, and let us
  know either on this list or the review itself.

 It's worth acknowledging that this conflicts with the Keystone
 meeting, and we do normally have decent Keystone representation in
 the current time slot.


Oh, I love that the gate test would have told me that. I intended to be
side-by-side with Murano, so I have revised the proposal accordingly.
Thanks for pointing it out and for the input!
Anne


 --
 Jeremy Stanley

 __
 OpenStack Development Mailing List (not for usage questions)
 Unsubscribe: openstack-dev-requ...@lists.openstack.org?subject:unsubscribe
 http://lists.openstack.org/cgi-bin/mailman/listinfo/openstack-dev




-- 
Anne Gentle
Rackspace
Principal Engineer
www.justwriteclick.com
__
OpenStack Development Mailing List (not for usage questions)
Unsubscribe: openstack-dev-requ...@lists.openstack.org?subject:unsubscribe
http://lists.openstack.org/cgi-bin/mailman/listinfo/openstack-dev


Re: [openstack-dev] Cross-project meeting times

2015-08-19 Thread Sean Dague
+1 for moving it earlier. 

On August 19, 2015 6:17:06 AM PDT, Anne Gentle annegen...@justwriteclick.com 
wrote:
Hi all,

In last week's TC Highlights blog post [1] I asked if there is interest
in
moving the cross-project meeting. Historically it is held after the TC
meeting, but there isn't a requirement for those timings to line up.
I've
heard from European and Eastern Standard Time contributors that it's a
tough time to meet half the year. It's also a bit early for APAC, my
apologies for noting this but still proposing to meet earlier.

I'd like to propose a new cross-project meeting time, 1800 Tuesdays. To
that end I've created a review with the proposed time:

https://review.openstack.org/214605

Please take a look, see if you think it could work, and let us know
either
on this list or the review itself.

Thanks,

Anne

1.
http://www.openstack.org/blog/2015/08/technical-committee-highlights-august-11-2015/


--
Anne Gentle
Rackspace
Principal Engineer
www.justwriteclick.com




__
OpenStack Development Mailing List (not for usage questions)
Unsubscribe:
openstack-dev-requ...@lists.openstack.org?subject:unsubscribe
http://lists.openstack.org/cgi-bin/mailman/listinfo/openstack-dev

-- 
Sean Dague 
http://dague.net __
OpenStack Development Mailing List (not for usage questions)
Unsubscribe: openstack-dev-requ...@lists.openstack.org?subject:unsubscribe
http://lists.openstack.org/cgi-bin/mailman/listinfo/openstack-dev


Re: [openstack-dev] Cross-project meeting times

2015-08-19 Thread Morgan Fainberg
I am ok with this moving as long as it doesn't camp on the Keystone meeting 
time ;). In all seriousness I'm not opposed to moving the meeting if it will 
include more people / make lives better for those who are there. 

Sent via mobile

 On Aug 19, 2015, at 08:20, Sean Dague s...@dague.net wrote:
 
 +1 for moving it earlier.
 
 
 
 On August 19, 2015 6:17:06 AM PDT, Anne Gentle 
 annegen...@justwriteclick.com wrote:
 
 Hi all, 
 
 In last week's TC Highlights blog post [1] I asked if there is interest in 
 moving the cross-project meeting. Historically it is held after the TC 
 meeting, but there isn't a requirement for those timings to line up. I've 
 heard from European and Eastern Standard Time contributors that it's a tough 
 time to meet half the year. It's also a bit early for APAC, my apologies for 
 noting this but still proposing to meet earlier.
 
 I'd like to propose a new cross-project meeting time, 1800 Tuesdays. To that 
 end I've created a review with the proposed time:
 
 https://review.openstack.org/214605 
 
 Please take a look, see if you think it could work, and let us know either 
 on this list or the review itself.
 
 Thanks,
 
 Anne
 
 1. 
 http://www.openstack.org/blog/2015/08/technical-committee-highlights-august-11-2015/
 
 
 --
 Anne Gentle
 Rackspace
 Principal Engineer
 www.justwriteclick.com
 
 OpenStack Development Mailing List (not for usage questions)
 Unsubscribe: openstack-dev-requ...@lists.openstack.org?subject:unsubscribe
 http://lists.openstack.org/cgi-bin/mailman/listinfo/openstack-dev
 
 -- 
 Sean Dague 
 http://dague.net
 __
 OpenStack Development Mailing List (not for usage questions)
 Unsubscribe: openstack-dev-requ...@lists.openstack.org?subject:unsubscribe
 http://lists.openstack.org/cgi-bin/mailman/listinfo/openstack-dev
__
OpenStack Development Mailing List (not for usage questions)
Unsubscribe: openstack-dev-requ...@lists.openstack.org?subject:unsubscribe
http://lists.openstack.org/cgi-bin/mailman/listinfo/openstack-dev


Re: [openstack-dev] [requirements] [global-requirements] [mistral] Using pika library

2015-08-19 Thread Doug Hellmann
Excerpts from Nikolay Makhotkin's message of 2015-08-19 17:16:14 +0300:
 Hi, Davanum!
 
 Have you already read the thread [1]? It is about acknowledge feature in
 oslo.messaging. Particularly, about the absent of this feature in
 oslo.messaging.
 
 The guys from messaging said that it is very problematically to add that
 kind of feature to oslo.messaging because it does not fit to
 oslo.messaging's approach.

The Oslo libraries are meant to evolve as the needs to the applications
evolve. That process works best when it comes about through
collaboration between all of us, and the Oslo team has taken on the
mission of enabling that collaboration. What I'm hearing in this
request is the library our community has written doesn't do something
we want, so rather than work on it with other members of our community
we want to adopt a different library that is missing different
features [2].

As far as I can tell from reading the thread you linked to, you
weren't told no just that it might be harder than just moving the
place we send acknowledgments inside the current driver, and we're
likely to need your help with the implementation.  The thread sort
of died off, so perhaps that wasn't clear.

You have what seems to be a new case -- perhaps its an old case
that was never being handled properly and everyone actually always
wanted this, I don't know. Either way, handling that case will
require a change to the semantics of the library, which means we
need to be careful about how we do it, but it's not impossible or
unwanted.

However we implement it, we need to ensure backwards compatibility
for applications relying on the current behavior. For example,
perhaps the application would pass a flag to the messaging library
to control whether ACKs are sent before or after processing (we
don't want that as a configuration option, because it's the application
developer who needs to handle any differences in behavior, rather
than the deployer). We should start out with the default behavior
set to what we have now, and then we can experiment with changing
it in each application before changing the default in the library.

So, if you're interested in working with us on that, let us know.

Doug

[2] pika does not yet support Python 3, and would require work within
the application to set up configuration options that would then be
different from the options used in other OpenStack applications.

 
 [1] http://lists.openstack.org/pipermail/openstack-dev/2015-July/068806.html
 
 On Wed, Aug 19, 2015 at 2:35 PM, Davanum Srinivas dava...@gmail.com wrote:
 
  Nikolay,
 
  Do you mean that you will *NOT* use oslo.messaging and use pika directly.
  I'd strongly discourage that possibility.
 
  Few members on the oslo.messaging team are looking at pika library already
  and are doing a prototype:
 
  https://github.com/dukhlov/oslo.messaging/blob/master/oslo_messaging/_drivers/impl_pika.py
 
  If you are interested in that effort, please let us know.
 
  Thanks,
  Dims
 
 
  On Wed, Aug 19, 2015 at 7:21 AM, Nikolay Makhotkin 
  nmakhot...@mirantis.com wrote:
 
  Hi, folks!
 
  Recently we've had the discussion with oslo.messaging team about
  acknowledge feature in RabbitMQ:
  http://lists.openstack.org/pipermail/openstack-dev/2015-July/068806.html
 
  After that Mistral team did the research about using *kombu *or *pika*
  library for implementation of remote procedure call server. Both kombu and
  pika was met our requirements. But we would prefer to use *pika* by next
  reasons:
 
   1. It is less complex than *kombu*;
   2. *kombu* itself is abstraction of messaging (but we don't need that);
   3. We had the discussion with one of RabbitMQ developer which advised us
  to use *pika* (comparing to *kombu*)
 
 
  Is it possible to add *pika *to the global-requirements for our needs?
 
  Thanks.
  --
  Best Regards,
  Nikolay
  @ Mirantis Inc.
 
  __
  OpenStack Development Mailing List (not for usage questions)
  Unsubscribe:
  openstack-dev-requ...@lists.openstack.org?subject:unsubscribe
  http://lists.openstack.org/cgi-bin/mailman/listinfo/openstack-dev
 
 
 
 
  --
  Davanum Srinivas :: https://twitter.com/dims
 
  __
  OpenStack Development Mailing List (not for usage questions)
  Unsubscribe: openstack-dev-requ...@lists.openstack.org?subject:unsubscribe
  http://lists.openstack.org/cgi-bin/mailman/listinfo/openstack-dev
 
 
 

__
OpenStack Development Mailing List (not for usage questions)
Unsubscribe: openstack-dev-requ...@lists.openstack.org?subject:unsubscribe
http://lists.openstack.org/cgi-bin/mailman/listinfo/openstack-dev


[openstack-dev] [Fuel] Great updates to tests and CI jobs

2015-08-19 Thread Roman Prykhodchenko
Hi folks!

Today I’m proud to announce that since this moment python-fuelclient has it’s 
own python-jobs in OpenStack CI. Thanks to all of you who helped me making Fuel 
Client compatible with the upstream CI.
Besides sharing great news I think it’s necessary to share changes we had to 
do, in order to accomplish this result.

First of all tests were reorganized: now functional and unit tests have their 
own separate folders inside the fuelclient/tests directory. That allowed us to 
distinguish them from both the CI and a developer’s point of view, so there 
will be no mess we used to have.

The other change we’ve made is deleting run_tests.sh*. It is possible to run 
and manage all the tests via tox which is a de-facto standard in OpenStack 
ecosystem. That also means anyone who is familiar with any of OpenStack 
projects will be able to orchestrate tests without a need to learn anything. 
Tox is preconfigured to run py26, py27, pep8, cover, functional, and cleanup 
environments. py26 and py27 only run unit tests and cover also involves 
calculating coverage. functional fires up Nailgun and launches functional 
tests. cleanup stops Nailgun, deletes its DB and any files left after 
functional tests and what you will definitely like — cleans up all *.pyc files. 
By default tox executes environments in the following order: 
py26-py27-pep8-functional-cleanup.

Minimal tox was updated to 2.1 which guarantees no external environment 
variable is passed to tests.

The jobs on OpenStack CI are set to be non-voting for a few days to give it a 
better try. On the next week we will switch them to voting. At the same time we 
will remove unit tests from FuelCI to not waste extra time.


* Technically it is kept in place to keep compatibility with FuelCI but it only 
invokes tox from inside. It will be removed later, when it’s time to switch off 
unit tests on FuelCI.


- romcheg


signature.asc
Description: Message signed with OpenPGP using GPGMail
__
OpenStack Development Mailing List (not for usage questions)
Unsubscribe: openstack-dev-requ...@lists.openstack.org?subject:unsubscribe
http://lists.openstack.org/cgi-bin/mailman/listinfo/openstack-dev


Re: [openstack-dev] [openstack-infra][third-paty][CI][nodepool]Using Nodepool for creating slaves.

2015-08-19 Thread Abhishek Shrivastava
Hi Ramy,

I got the following you mentioned, so as per my understanding here are the
points:

   - We need to install CI master on a VM (*Using Ubuntu 14.04 in my case*).
   - The Master VM should have properties like 8 GB RAM, 100 GB HD.
   - Nodepool, Jenkins and Zull will be installed in the master VM.
   - We had to create slaves images and configure it to nodepool (*Creating
   Ubuntu 14.04 images*).
   - Nodepool will create it automatically later.

Please guide me if I am wrong at any point. Also, your valuable suggestions
are also welcome.


On Wed, Aug 19, 2015 at 7:24 PM, Asselin, Ramy ramy.asse...@hp.com wrote:

 Hi Xies, Abhi,



 It works a bit differently.

 Nodepool is responsible to launch VMs which it then registers as Jenkins
 Slaves.

 These Jenkins slaves have “labels” which identify certain user-properties
 such as Operating System, image contents, etc.

 When CI wants to run a test case it submits the job to Jenkins master to
 be run on any Jenkins slave that matches the desired “label”.

 Jenkins will wait until a slave of that ‘label’ is available and assign
 the job once available.



 Ramy





 *From:* Xie, Xianshan [mailto:xi...@cn.fujitsu.com]
 *Sent:* Tuesday, August 18, 2015 10:59 PM
 *To:* OpenStack Development Mailing List (not for usage questions)
 *Subject:* Re: [openstack-dev]
 [openstack-infra][third-paty][CI][nodepool]Using Nodepool for creating
 slaves.



 Hi Abhi,

IIUC, you should create and configure slaves(these slaves can be VMs
 or real physical machine) in Jenkins.

 And the nodepool is used to create and pool VMs automatically, and these
 VMs should be run on the slaves.

 Then, while CI wants to build and execute a testcase, especially which
 attempts to be run on an isolated host, the nodepool will match a proper
 VM for this testcase.



 Hope this might help you.





 Xiexs





 *From:* Abhishek Shrivastava [mailto:abhis...@cloudbyte.com]
 *Sent:* Tuesday, August 18, 2015 1:46 PM
 *To:* openstack-in...@lists.openstack.org; OpenStack Development Mailing
 List (not for usage questions)
 *Subject:* Re: [openstack-dev]
 [openstack-infra][third-paty][CI][nodepool]Using Nodepool for creating
 slaves.



 Also adding the following:

-

 https://github.com/openstack-infra/project-config/tree/master/nodepool/elements

 Does this means that we don't have to take care of creating slaves(i.e;
 installing slave using scripts as we have done in master) and it will be
 done automatically, and also we don't have to configure slaves in Jenkins.



 A bit confusing for me so if anyone can explain it to me then it will be
 very helpful.



 On Tue, Aug 18, 2015 at 11:11 AM, Abhishek Shrivastava 
 abhis...@cloudbyte.com wrote:

 Hi Folks,



 I was going through Ramy's guide for setting up CI, there I found out the
 following:

-

 https://github.com/rasselin/os-ext-testing#setting-up-nodepool-jenkins-slaves

 But I don't get the fact on how to create the image, also what major
 settings need to be done to make the config perfect for use. Can anyone
 help me with that?



 --

 *[image: Image removed by sender.]*

 *Thanks  Regards,*

 *Abhishek*

 *Cloudbyte Inc. http://www.cloudbyte.com*





 --

 *[image: Image removed by sender.]*

 *Thanks  Regards,*

 *Abhishek*

 *Cloudbyte Inc. http://www.cloudbyte.com*

 __
 OpenStack Development Mailing List (not for usage questions)
 Unsubscribe: openstack-dev-requ...@lists.openstack.org?subject:unsubscribe
 http://lists.openstack.org/cgi-bin/mailman/listinfo/openstack-dev




-- 


*Thanks  Regards,*
*Abhishek*
*Cloudbyte Inc. http://www.cloudbyte.com*
__
OpenStack Development Mailing List (not for usage questions)
Unsubscribe: openstack-dev-requ...@lists.openstack.org?subject:unsubscribe
http://lists.openstack.org/cgi-bin/mailman/listinfo/openstack-dev


Re: [openstack-dev] Cross-project meeting times

2015-08-19 Thread Jeremy Stanley
On 2015-08-19 08:17:06 -0500 (-0500), Anne Gentle wrote:
 In last week's TC Highlights blog post [1] I asked if there is interest in
 moving the cross-project meeting. Historically it is held after the TC
 meeting, but there isn't a requirement for those timings to line up. I've
 heard from European and Eastern Standard Time contributors that it's a
 tough time to meet half the year.

I'm in USA EST/EDT and it's not been particularly inconvenient for
me, though I don't have children or keep a strict business hours
schedule so perhaps that's why.

 It's also a bit early for APAC, my apologies for noting this but
 still proposing to meet earlier.

Yeah, I'm not especially keen on ostracizing APAC for the sake of
EMEA or the Americas, but I get that there's never a perfect time
for everyone on the planet.

 I'd like to propose a new cross-project meeting time, 1800
 Tuesdays. To that end I've created a review with the proposed
 time:
 
 https://review.openstack.org/214605
 
 Please take a look, see if you think it could work, and let us
 know either on this list or the review itself.

It's worth acknowledging that this conflicts with the Keystone
meeting, and we do normally have decent Keystone representation in
the current time slot.
-- 
Jeremy Stanley

__
OpenStack Development Mailing List (not for usage questions)
Unsubscribe: openstack-dev-requ...@lists.openstack.org?subject:unsubscribe
http://lists.openstack.org/cgi-bin/mailman/listinfo/openstack-dev


Re: [openstack-dev] [cinder] Proposing Gorka Eguileor for core

2015-08-19 Thread Jay S. Bryant

Congratulations!  Welcome Gorka!

Jay

On 08/19/2015 12:01 PM, Mike Perez wrote:

On 12:13 Aug 13, Mike Perez wrote:

It gives me great pleasure to nominate Gorka Eguileor for Cinder core.

Gorka's contributions to Cinder core have been much apprecated:

https://review.openstack.org/#/q/owner:%22Gorka+Eguileor%22+project:openstack/cinder,p,0035b6410002dd11

60/90 day review stats:

http://russellbryant.net/openstack-stats/cinder-reviewers-60.txt
http://russellbryant.net/openstack-stats/cinder-reviewers-90.txt

Cinder core, please reply with a +1 for approval. This will be left
open until August 19th. Assuming there are no objections, this will go
forward after voting is closed.

Gorka has been added to Cinder core. Welcome!




__
OpenStack Development Mailing List (not for usage questions)
Unsubscribe: openstack-dev-requ...@lists.openstack.org?subject:unsubscribe
http://lists.openstack.org/cgi-bin/mailman/listinfo/openstack-dev


Re: [openstack-dev] [fuel][puppet] The state of collaboration: 9 weeks

2015-08-19 Thread Emilien Macchi


On 08/18/2015 03:33 AM, Dmitry Borodaenko wrote:
 Two weeks ago, I flagged the patch sets to commits ratio as the biggest
 problem that Fuel contributors to Puppet OpenStack should address, and
 over the past two weeks the situation has improved dramatically. In
 first and second week of August, 19 of our commits were merged in
 upstream, bringing our patch sets per commit ratio from 19 down to 5.6
 (while average for Puppet OpenStack during that period was 6.5). With
 the share of patch sets pushed by Fuel developers remaining at roughly
 the same level (15.9% vs 17.4%), I think it's safe to call this problem
 solved. Simply awesome!
 
 Comparing last 30 days contribution stats vs same numbers two weeks ago:
 
 Bogdan Dobrelia (#3 reviewer!): 67.2% - 66.3% (disagreements 4.9% - 3.6%)
 Denis Egorenko: 97% - 87.5% (disagreements 12.1% - 13.9%)
 Vasyl Saienko: 100% - 96.4% (disagreements 16.7% - 10.7%)
 Ivan Berezovskiy: 100% - 92.3% (disagreements 0% - 3.8%)
 Sergey Kolekonov: 91.7% - 95.7% (disagreements 8.3% - 13%)
 Max Yatsenko: n/a - 100% (disagreements n/a - 17.4%)
 Alex Schultz: 80% - 80% (disagreements 20% - 26.7%)
 Bartlomiej Piotrowski: n/a - 100% (disagreements n/a - 12.5%)
 Sergii Golovatiuk: 100% - 100% (disagreements 33.3% - 0%)
 
 Bogdan continues to set the example and improve his numbers, which is
 not surprising considering that he's also the top reviewer in
 fuel-library. I think puppet-nova and puppet-neutron teams should
 seriously consider nominating him for core, he already tops reviewers
 lists for these modules.

http://stackalytics.com/?user_id=bogdandometric=marks

2 commits and 16 LOC in our Puppet modules is in my opinion not enough
to promote him core reviewer today.
Though he's making good progress on reviews, we also need to read how he
write code in our am upstremodules, and not in Fuel Library.


 Denis, Vasyl, and Ivan are not there yet, but they all have noticeably
 increased both number and quality of their reviews, keep it up guys!
 
 Numbers for other top reviewers are uneven and small enough for noise to
 overtake meaningful data, all I can recommend here is to watch your
 disagreements and learn from them. A ratio above 10% can mean one of
 three things: 1) you're not doing enough reviews so even a handful of
 disagreements sticks out -- do more reviews and this will improve on its
 own; 2) you're missing problems with the code that other reviewers find
 unacceptable -- try to be more attentive and watch for the things that
 you've been missing; 3) you disagree with majority on how some things
 should be done -- discuss your differences on IRC or ML and figure out a
 consensus.
 
 Moving on to other numbers, weekly IRC meetings participation remains
 good:
 
 Aug-4: 4 of 15 participants, 22 of 162 lines
 Aug-11: 6 of 16 participants, 62 of 192 lines
 
 Unfortunately it's not all roses and unicorns, last week I flagged a
 stuck review that I think has been mishandled by Puppet OpenStack team
 [0][1], and it still remains in the same state.
 
 [0] https://review.openstack.org/198695
 [1]
 http://eavesdrop.openstack.org/meetings/puppet_openstack/2015/puppet_openstack.2015-08-11-15.00.log.html#l-140
 
 
 On July 8, patch set 2 has passed CI. It received 2 +1 votes from other
 Fuel developers on July 10 and 29, but remained ignored by upstream
 reviewers until August 10, more than a month after the current patch set
 was posted. Then, a Swift core reviewer left a -1 disagreeing with the
 intent of the patch, and even though patch author posted a rebuttal a
 day later, the patch remains stuck and untouched for yet another week.
 
 It's a one-off case that does not outweigh the positive trends I've
 outlined above, but even one stuck patch that fixes a critical bug is
 enough to justify a fork.
 
 Speaking of forks, we managed to un-fork 9 upstream modules [2] with
 puppet-librarian-simple before Fuel 7.0 soft code freeze has kicked in.
 
 [2]
 https://github.com/stackforge/fuel-library/blob/master/deployment/Puppetfile
 
 
 That's 9 times more than my conservative estimate of converting at least
 1 module to librarian in 7.0, but these were the easiest and least
 deviated from upstream. We've still got 50 more modules to convert in
 Fuel 8.0, many will require commits to be merged in upstream before they
 can be completely un-forked. Having such commits wait for a month at a
 time only to be summarily rejected puts this effort at risk, lets figure
 out what went wrong this time and come up with a way to prevent this
 from happening again.
 
 Thanks,
 

From a general perspective, it's clear Fuel people is making good
progress to be involved in Puppet OpenStack group, and we can be proud
of our recent discussions that lead us to this state now.

Promoting people to the core team is another story and it will come
naturally like it has been done for other people, I think you need to
continue to show that efforts are consistent and good stuffs will
probably happen.


Re: [openstack-dev] [neutron][fwaas][dvr] FWaaS with DVR

2015-08-19 Thread Sean M. Collins
Great writeup, I think this is an excellent starting place for our
efforts moving forward.

There is also some information on an accepted spec about firewall
insertion[1], search for the phrase Phase 2 where firewalls can be
associated with ports - and also some of my thinking about having FwaaS
consume the networking-sfc project's proposed API, since that could help
describe firewall insertion - although I don't know if we'd expose it to
the user and have them use the SFC API to insert their firewalls, or if
maybe in the FwaaS API we can take a list of ports like described in
[1], and then consume the SFC API in the backend.

At the very least, we're going to have lots to talk about in Tokyo :)


[1]: 
http://specs.openstack.org/openstack/neutron-specs/specs/kilo/fwaas-router-insertion.html

-- 
Sean M. Collins

__
OpenStack Development Mailing List (not for usage questions)
Unsubscribe: openstack-dev-requ...@lists.openstack.org?subject:unsubscribe
http://lists.openstack.org/cgi-bin/mailman/listinfo/openstack-dev


[openstack-dev] [fwaas][dvr] FWaaS with DVR

2015-08-19 Thread Mickey Spiegel
Currently, FWaaS behaves differently with DVR, applying to only north/south traffic, whereas FWaaS on routers in network nodes applies to both north/south and east/west traffic. There is a compatibility issue due to the asymmetric design of L3 forwarding in DVR, which breaks the connection tracking that FWaaS currently relies on.I started an etherpad where I hope the community can discuss the problem, collect multiple possible solutions, and eventually try to reach consensus about how to move forward:https://etherpad.openstack.org/p/FWaaS_with_DVRI listed every possible solution that I can think of as a starting point. I am somewhat new to OpenStack and FWaaS, so please correct anything that I might have misrepresented.Please add more possible solutions and comment on the possible solutions already listed.Mickey


__
OpenStack Development Mailing List (not for usage questions)
Unsubscribe: openstack-dev-requ...@lists.openstack.org?subject:unsubscribe
http://lists.openstack.org/cgi-bin/mailman/listinfo/openstack-dev


[openstack-dev] [Neutron] Kuryr - virtual sprint

2015-08-19 Thread Gal Sagie
Hello everyone,

During our last meeting an idea was brought up that we try to do a virtual
sprint
for Kuryr somewhere in September.

Basically the plan is very similar to the mid cycle sprints or feature
sprints where
we iterate on couple of tasks online and finish gaps we might have in Kuryr.
(I think we are talking about 2-3 days)

The agenda for the sprint is dependent on the amount of work we finish by
then,
but it will probably consist of containerising some of the common plugins
and connecting
things end to end. (for host networking)

I started this email in order to find the best dates for it, so if you plan
on participating
please share your preferred dates (anyone that has a Neutron plugin might
want to offer a containerised version of it with Kuryr to integrate with
Docker and lib network and the sprint
is probably a good place to start doing it)

Thanks
Gal.
__
OpenStack Development Mailing List (not for usage questions)
Unsubscribe: openstack-dev-requ...@lists.openstack.org?subject:unsubscribe
http://lists.openstack.org/cgi-bin/mailman/listinfo/openstack-dev


[openstack-dev] [neutron] RFE for DHCP agent changes for networking-calico

2015-08-19 Thread Neil Jerram
FYI, I've raised the new RFE bug that I suggested below:
https://bugs.launchpad.net/neutron/+bug/1486649

Neil


On 18/08/15 23:22, Neil Jerram wrote:
 Although the DHCP-related patches below are I think very close to mergeable, 
 Brian Haley on IRC queried what, process-wise, motivates merging them now 
 (for Liberty).

 I think he's right that something is missing, so I'd like to discuss filling 
 that hole here. What has happened so far is this:

 - https://review.openstack.org/#/c/198439/ described 'routed networking', 
 which is the ultimate motivation for these patches. 

 - I realised/was told that there should be an RFE bug, per current process, 
 so raised https://bugs.launchpad.net/neutron/+bug/1472704

 - Those contributed to the beginning of discussions about supporting 'routed' 
 or 'L3' networks in Neutron - which are ongoing and will take Mitaka at least 
 to refine. 

 - Nevertheless, the DHCP-related patches are still valuable now (as explained 
 below) and feasible within the Liberty timescale, so I've continued refining 
 those.

 - Discussions, which I believe supported this in principle, took place in 
 neutron-drivers [1][2] and main Neutron [3] IRC meetings.

 [1] 
 http://eavesdrop.openstack.org/meetings/neutron_drivers/2015/neutron_drivers.2015-07-14-15.04.log.html‎

 [2]
 http://eavesdrop.openstack.org/meetings/neutron_drivers/2015/neutron_drivers.2015-07-21-15.00.log.html

 [3] discussion between 14:49:44 and 14:56:49 at 
 http://eavesdrop.openstack.org/meetings/networking/2015/networking.2015-07-28-14.01.log.html

 The specific process issue now is that the patches that (IMO) make sense for 
 Liberty reference a bug (1472704) that has a much wider scope and so is quite 
 correctly not approved for Liberty. 

 So, what to do? My guess is to raise a new RFE bug that just motivates the 
 DHCP agent support that I'd like to achieve - by way of the existing patches 
 - in the Liberty timescale, ask neutron-drivers to approve that, and update 
 the patches to reference that bug instead. 

 Does that sound right?

 Regards, 
   Neil 


 ‎
   Original Message  
 From: Neil Jerram
 Sent: Monday, 17 August 2015 18:47
 To: OpenStack Development Mailing List (not for usage questions)
 Reply To: OpenStack Development Mailing List (not for usage questions)
 Subject: [openstack-dev] [neutron] New networking-calico project

 I'd like to announce networking-calico, a new project within the Neutron
 stadium to provide OpenStack integration pieces for Project Calico
 [1][2]. In a sentence, Calico is a backend that uses routing and
 iptables to provide IP-level connectivity between VMs, instead of - as
 most Neutron backends do - using bridging to provide an effective L2
 broadcast domain. You can read about why that might be interesting at
 [1][2], or in more OpenStack-centric terms at [3].

 Calico's semantics are not fully describable by the current Neutron API,
 and I plan to contribute to API and data model work to address this. 
 Discussion about that has already begun at [3] and in the email thread
 about 'routed, segmented networks' [4], and I hope it will continue
 through the end of this cycle, in Tokyo, and during Mitaka.

 For a practical deployment, though, and with some semantic caveats [5],
 Calico-style connectivity can be used already in an OpenStack cluster - 
 and we have several operator partners interested in and trialling that. 
 My team has been developing and refining this since Icehouse, using
 Calico-specific patches to Nova and Neutron, but we are now within
 touching distance, we think, of working with vanilla OpenStack when
 Liberty is released. We released our v1.0 milestone of the core Calico
 code last week [14], our Nova patches were merged in July, and we have
 the following core Neutron patches currently in review.

 [6] https://review.openstack.org/#/c/205181/
 [7] https://review.openstack.org/#/c/206078/
 [8] https://review.openstack.org/#/c/206077/
 [9] https://review.openstack.org/#/c/206079/

 These patches have been through many cycles of review - thanks in
 particular to Cedric and Oleg - and are now, I believe, fully tested and
 polished. They make small generalizations to the DHCP agent code so
 that a networking-calico-provided interface driver will be able to use
 it, instead of having to provide a parallel DHCP agent implementation. 
 I would particularly appreciate if Neutron core reviewers would consider
 reviewing and approving [6] and [7] now, as they are the changes that
 would be messiest if I had to reimplement them out-of-tree using some
 kind of subclassing approach.

 Then the plan for networking-calico is that it will contain docs, an ML2
 mechanism driver, a DHCP interface driver, and a Devstack plugin for
 Calico. These aren't yet at [10], but I will be getting on with that
 shortly, and you can already see those pieces in other forms (which will
 be retired) at [11], [12] and [13]. Hence, within the next few weeks, I
 hope that 

Re: [openstack-dev] [Fuel] Great updates to tests and CI jobs

2015-08-19 Thread Boris Pavlovic
Roman,

well done! ;)

Best regards,
Boris Pavlovic

On Wed, Aug 19, 2015 at 8:38 AM, Roman Prykhodchenko m...@romcheg.me wrote:

 Hi folks!

 Today I’m proud to announce that since this moment python-fuelclient has
 it’s own python-jobs in OpenStack CI. Thanks to all of you who helped me
 making Fuel Client compatible with the upstream CI.
 Besides sharing great news I think it’s necessary to share changes we had
 to do, in order to accomplish this result.

 First of all tests were reorganized: now functional and unit tests have
 their own separate folders inside the fuelclient/tests directory. That
 allowed us to distinguish them from both the CI and a developer’s point of
 view, so there will be no mess we used to have.

 The other change we’ve made is deleting run_tests.sh*. It is possible to
 run and manage all the tests via tox which is a de-facto standard in
 OpenStack ecosystem. That also means anyone who is familiar with any of
 OpenStack projects will be able to orchestrate tests without a need to
 learn anything. Tox is preconfigured to run py26, py27, pep8, cover,
 functional, and cleanup environments. py26 and py27 only run unit tests and
 cover also involves calculating coverage. functional fires up Nailgun and
 launches functional tests. cleanup stops Nailgun, deletes its DB and any
 files left after functional tests and what you will definitely like —
 cleans up all *.pyc files. By default tox executes environments in the
 following order: py26-py27-pep8-functional-cleanup.

 Minimal tox was updated to 2.1 which guarantees no external environment
 variable is passed to tests.

 The jobs on OpenStack CI are set to be non-voting for a few days to give
 it a better try. On the next week we will switch them to voting. At the
 same time we will remove unit tests from FuelCI to not waste extra time.


 * Technically it is kept in place to keep compatibility with FuelCI but it
 only invokes tox from inside. It will be removed later, when it’s time to
 switch off unit tests on FuelCI.


 - romcheg

 __
 OpenStack Development Mailing List (not for usage questions)
 Unsubscribe: openstack-dev-requ...@lists.openstack.org?subject:unsubscribe
 http://lists.openstack.org/cgi-bin/mailman/listinfo/openstack-dev


__
OpenStack Development Mailing List (not for usage questions)
Unsubscribe: openstack-dev-requ...@lists.openstack.org?subject:unsubscribe
http://lists.openstack.org/cgi-bin/mailman/listinfo/openstack-dev


Re: [openstack-dev] [TripleO] Moving instack upstream

2015-08-19 Thread Dougal Matthews




- Original Message -
 From: Dmitry Tantsur dtant...@redhat.com
 To: openstack-dev@lists.openstack.org
 Sent: Wednesday, 19 August, 2015 5:57:36 PM
 Subject: Re: [openstack-dev] [TripleO] Moving instack upstream
 
 On 08/19/2015 06:42 PM, Derek Higgins wrote:
  On 06/08/15 15:01, Dougal Matthews wrote:
  - Original Message -
  From: Dan Prince dpri...@redhat.com
  To: OpenStack Development Mailing List (not for usage questions)
  openstack-dev@lists.openstack.org
  Sent: Thursday, 6 August, 2015 1:12:42 PM
  Subject: Re: [openstack-dev] [TripleO] Moving instack upstream
 
  snip
 
  I would really like to see us rename python-rdomanager-oscplugin. I
  think any project having the name RDO in it probably doesn't belong
  under TripleO proper. Looking at the project there are some distro
  specific things... but those are fairly encapsulated (or could be made
  so fairly easily).
 
  I agree, it made sense as it was the entrypoint to RDO-Manager. However,
  it could easily be called the python-tripleo-oscplugin or similar. The
  changes would be really trivial, I can only think of one area that
  may be distro specific.
 
  I'm putting the commit together now to pull these repositories into
  upstream tripleo are we happy with the name python-tripleo-oscplugin ?
 
 Do we really need this oscplugin postfix? It may be clear for some of
 us, but I don't that our users know that OSC means OpenStackClient, and
 that oscplugin designates something that adds features to openstack
 command. Can't we just call it python-tripleo? or maybe even just
 tripleo?

+1 to either.

Having oscplugin in the name just revealed an implementation detail, there
may be a point where for some reason everyone moves away from OSC.

 
 
 
 
  __
  OpenStack Development Mailing List (not for usage questions)
  Unsubscribe: openstack-dev-requ...@lists.openstack.org?subject:unsubscribe
  http://lists.openstack.org/cgi-bin/mailman/listinfo/openstack-dev
 
 
 __
 OpenStack Development Mailing List (not for usage questions)
 Unsubscribe: openstack-dev-requ...@lists.openstack.org?subject:unsubscribe
 http://lists.openstack.org/cgi-bin/mailman/listinfo/openstack-dev
 

__
OpenStack Development Mailing List (not for usage questions)
Unsubscribe: openstack-dev-requ...@lists.openstack.org?subject:unsubscribe
http://lists.openstack.org/cgi-bin/mailman/listinfo/openstack-dev


Re: [openstack-dev] [Fuel][MOS][Bootstrap] Please try Ubuntu bootstrap in MOS 7.0

2015-08-19 Thread Mikhail Semenov
As we considered today, Ubuntu bootstrap will not be shipped in MOS 7.0. It
was a hard decision based on the issue with NICs naming [1].
This bug can be fixed only by changing the naming of network interfaces(
http://www.freedesktop.org/wiki/Software/systemd/PredictableNetworkInterfaceNames/)
and it's too late to do it in MOS 7.0 scope.
So, this feature is moved to MOS 8.0.

[1] https://bugs.launchpad.net/mos/+bug/1482049

--
Thanks,
Michael

On Thu, Aug 13, 2015 at 6:30 PM, Mikhail Semenov mseme...@mirantis.com
wrote:

 Hi all,

 We have new feature in the upcoming release MOS 7.0 - Ubuntu-based
 bootstrap in addition to current CentOS-based one. Design spec can be found
 here https://review.openstack.org/#/c/194154/.

 Current 7.0 ISO contains 2 bootstrap images: CentOS-based (default) and
 Ubuntu-based. You can easily switch to Ubuntu-based bootstrap using this
 steps:
 1. Make sure the master node can access Ubuntu (
 http://archive.ubuntu.com/ubuntu) and MOS (
 http://mirror.fuel-infra.org/mos-repos) APT repositories.
 2. Run the following command on the master node:
 *fuel-bootstrap-image-set ubuntu*
 3. Just in a case restart dnsmasq:
 *dockerctl shell cobbler service dnsmasq restart*
 4. Reboot the slave nodes.

 There are only 2 weeks left for testing. On 08/27 we will make a decision
 about using Ubuntu bootstrap by default in MOS 7.0. It depends on the test
 results and statistics(more deployments - more confidence).

 I want to ask everyone to try new Ubuntu bootstrap. Please, deploy it on
 your environments and file bugs in case of failures. It's most important
 for *partners* *and* *plugin developers*. Feel free to contact Alexei
 Sheplyakov(feature lead) and me in case of questions.

 --
 Thanks,
 Michael




-- 
Thanks,
Michael
__
OpenStack Development Mailing List (not for usage questions)
Unsubscribe: openstack-dev-requ...@lists.openstack.org?subject:unsubscribe
http://lists.openstack.org/cgi-bin/mailman/listinfo/openstack-dev


Re: [openstack-dev] [neutron] What does being a neutron-core member mean? [WAS: Re: [neutron] I am pleased to propose two new Neutron API/DB/RPC core reviewers!]

2015-08-19 Thread Ihar Hrachyshka
-BEGIN PGP SIGNED MESSAGE-
Hash: SHA256

On 08/14/2015 05:25 PM, Russell Bryant wrote:
 While this includes me, I'm really not taking this personally.
 I'm thinking about it in the general sense.

Thanks, and sorry for the thread, but I felt that we should clarify
the matter asap if the new world does not completely stick to some
minds in the team, like mine.

 
 On 08/14/2015 11:03 AM, Kyle Mestery wrote:
 I'd argue the system is built on a web of trust. If you trust
 me, and I trust Russell and Brandon, then you should likely
 trust Russell and Brandon as well. This is EXACTLY what the
 Lieutenant system was meant to convey, though I now feel like
 perhaps people missed this key ingredient of the new world we
 find ourselves in.
 
 This is a huge and important point.  The N to N trust model we've
 been operating under doesn't scale.  Neutron is trying to move to a
 different trust model that has proven to scale much further than
 we've been able to do within a single OpenStack project so far.
 

Indeed that's the case, and I believe Kyle's efforts are the main
reason we have a team that is so open to newcomers and different
perspectives. That's why I feel that even if I am not completely
bought in the new world doctrine, I should expect that if Kyle does
something, he makes it for good. That's indeed trust, but based on
past experience, not the potential future.

 If Kyle and others leading a section of Neutron trust me, I'm happy
 to jump in and do more reviews.  If they trust me, I'd hope others
 not as familiar with me or my work can trust by proxy.  The same
 applies to Brandon.  I honestly don't know Brandon very well, but I
 have a high level of trust for Kyle.  Kyle trusts him, so +1 from
 me.
 

I tried to digest it these days, and I still have problems with it.

In my world, trust indeed can be based on proxy referrals, but not
solely. Usually whenever there are nominations sent, I already have a
clue of how candidates contribute to the repo, their goods and bads.
If not, I always have a source of truth to fix the lack of knowledge
(stackalytics, git log, ...) If I have no ways to know, I don't feel
like I'm in the position to +1 a nomination. If the vote is to be
based solely on my trust in Kyle, then I'm better not to vote at all
(that's what I did) and defer to Kyle alone to make a judgement. With
this new world, do we even need to vote?

 Kyle has a tough role here.  It means he gives up some control, but
 it's the way the project will scale.  Kyle doesn't have to develop
 a close trust relationship with everyone merging code into the main
 neutron repo, much less all the other repos.  He can delegate some
 of that.  It only works if everyone buys into this way of
 thinking.
 

Agreed, though there is still should be some kind of relationship
between team members, if not with Kyle.

I think the discussion is not about delegation though; but about
criteria that we apply to core reviewers, both existing and new ones.
Kyle removed several members from the core team before because of
their low review stats (in the past, not in the future), and I believe
it was the right thing to do. But then we should probably apply
similar requirements to new candidates.

Now, I see Kyle's point in trying to push for more proxy trust in
neutron, and I also think that I may miss new developments in project
governance, and indeed adding more cores in the team is a good thing,
especially from those contributors that showed their effectiveness in
other openstack projects (ovn, nova for Russell; lbaas for Brandon).

I only want to make sure that by doing it we don't lower criteria to
core reviewers in terms of number of reviews etc. I see we lag on it.

And also I am concerned that we may suggest to others that non-core
reviews are somehow insignificant and that collecting some review
stats for several months or even weeks is considered a pointless
effort unless it's done with a core hammer.

I value reviews of multiple openstack folks who are not cores in
neutron, f.e. @otherwiseguy and @gsagie for anything ovsdb related; or
@zzzeek for all things sql-ish; or @salv-orlando for all things
API/policy/how the world started to exist; or @jlibosva for anything
python-esoteric; or @moshele for sr-iov... The list follows. I don't
want them to feel their reviews are not that valuable if not +2.

Ihar
-BEGIN PGP SIGNATURE-
Version: GnuPG v2

iQEcBAEBCAAGBQJV1L7sAAoJEC5aWaUY1u57rhYIAOCxX5K8HbHNcUYh33/rvTRc
InqvoKKu5NWFU4s+iUZly1Fu5/3JXzLR5h8/+1b/gWR5EDYJ2Q6FRy5Bmn6Fduuw
cHV6trqGfEmA+NJsvNSNeg1Ux8hQ0hjdcF0mcrMhM0li+DFDMwogHMxPUAzKF4Cm
fcMDr+aZW3zkUDi0Y/iUjxqWwQFOBwPg0gWhKqhasVTqbOfd0W62z4gT9o6ZYkdn
mJr6jU+qc1hV+St03qpgLN9h/S023Ha1PCnMBUfjldbthmVBtJEsgmyfHlqWpWmc
UGSH7vTv6EmSSVcvZmAuCSZQKeG4UaodbApNusELFTA4zSK6GeKgJL9hr9MfkCs=
=ZXGT
-END PGP SIGNATURE-

__
OpenStack Development Mailing List (not for usage questions)
Unsubscribe: 

Re: [openstack-dev] [TripleO] Moving instack upstream

2015-08-19 Thread Derek Higgins

On 06/08/15 15:01, Dougal Matthews wrote:

- Original Message -

From: Dan Prince dpri...@redhat.com
To: OpenStack Development Mailing List (not for usage questions) 
openstack-dev@lists.openstack.org
Sent: Thursday, 6 August, 2015 1:12:42 PM
Subject: Re: [openstack-dev] [TripleO] Moving instack upstream


snip


I would really like to see us rename python-rdomanager-oscplugin. I
think any project having the name RDO in it probably doesn't belong
under TripleO proper. Looking at the project there are some distro
specific things... but those are fairly encapsulated (or could be made
so fairly easily).


I agree, it made sense as it was the entrypoint to RDO-Manager. However,
it could easily be called the python-tripleo-oscplugin or similar. The
changes would be really trivial, I can only think of one area that
may be distro specific.


I'm putting the commit together now to pull these repositories into 
upstream tripleo are we happy with the name python-tripleo-oscplugin ?




__
OpenStack Development Mailing List (not for usage questions)
Unsubscribe: openstack-dev-requ...@lists.openstack.org?subject:unsubscribe
http://lists.openstack.org/cgi-bin/mailman/listinfo/openstack-dev


Re: [openstack-dev] [TripleO] Moving instack upstream

2015-08-19 Thread Dmitry Tantsur

On 08/19/2015 06:42 PM, Derek Higgins wrote:

On 06/08/15 15:01, Dougal Matthews wrote:

- Original Message -

From: Dan Prince dpri...@redhat.com
To: OpenStack Development Mailing List (not for usage questions)
openstack-dev@lists.openstack.org
Sent: Thursday, 6 August, 2015 1:12:42 PM
Subject: Re: [openstack-dev] [TripleO] Moving instack upstream


snip


I would really like to see us rename python-rdomanager-oscplugin. I
think any project having the name RDO in it probably doesn't belong
under TripleO proper. Looking at the project there are some distro
specific things... but those are fairly encapsulated (or could be made
so fairly easily).


I agree, it made sense as it was the entrypoint to RDO-Manager. However,
it could easily be called the python-tripleo-oscplugin or similar. The
changes would be really trivial, I can only think of one area that
may be distro specific.


I'm putting the commit together now to pull these repositories into
upstream tripleo are we happy with the name python-tripleo-oscplugin ?


Do we really need this oscplugin postfix? It may be clear for some of 
us, but I don't that our users know that OSC means OpenStackClient, and 
that oscplugin designates something that adds features to openstack 
command. Can't we just call it python-tripleo? or maybe even just 
tripleo?






__
OpenStack Development Mailing List (not for usage questions)
Unsubscribe: openstack-dev-requ...@lists.openstack.org?subject:unsubscribe
http://lists.openstack.org/cgi-bin/mailman/listinfo/openstack-dev



__
OpenStack Development Mailing List (not for usage questions)
Unsubscribe: openstack-dev-requ...@lists.openstack.org?subject:unsubscribe
http://lists.openstack.org/cgi-bin/mailman/listinfo/openstack-dev


Re: [openstack-dev] [Fuel] Great updates to tests and CI jobs

2015-08-19 Thread Sebastian Kalinowski
Indeed, great news!

I would only suggest to wait a little bit more that a few days with
switching
to the voting mode since it looks like there will be not so many patches
proposed to python-fuelclient as we are heading towards Hard Code Freeze.

I hope that the next step will be to enable Python 3 pipepline for our
client so
we could finally test all the code that uses six library for Python 2  3
compatibility.

Best,
Sebastian

2015-08-19 19:00 GMT+02:00 Boris Pavlovic bpavlo...@mirantis.com:

 Roman,

 well done! ;)

 Best regards,
 Boris Pavlovic

 On Wed, Aug 19, 2015 at 8:38 AM, Roman Prykhodchenko m...@romcheg.me
 wrote:

 Hi folks!

 Today I’m proud to announce that since this moment python-fuelclient has
 it’s own python-jobs in OpenStack CI. Thanks to all of you who helped me
 making Fuel Client compatible with the upstream CI.
 Besides sharing great news I think it’s necessary to share changes we had
 to do, in order to accomplish this result.

 First of all tests were reorganized: now functional and unit tests have
 their own separate folders inside the fuelclient/tests directory. That
 allowed us to distinguish them from both the CI and a developer’s point of
 view, so there will be no mess we used to have.

 The other change we’ve made is deleting run_tests.sh*. It is possible to
 run and manage all the tests via tox which is a de-facto standard in
 OpenStack ecosystem. That also means anyone who is familiar with any of
 OpenStack projects will be able to orchestrate tests without a need to
 learn anything. Tox is preconfigured to run py26, py27, pep8, cover,
 functional, and cleanup environments. py26 and py27 only run unit tests and
 cover also involves calculating coverage. functional fires up Nailgun and
 launches functional tests. cleanup stops Nailgun, deletes its DB and any
 files left after functional tests and what you will definitely like —
 cleans up all *.pyc files. By default tox executes environments in the
 following order: py26-py27-pep8-functional-cleanup.

 Minimal tox was updated to 2.1 which guarantees no external environment
 variable is passed to tests.

 The jobs on OpenStack CI are set to be non-voting for a few days to give
 it a better try. On the next week we will switch them to voting. At the
 same time we will remove unit tests from FuelCI to not waste extra time.


 * Technically it is kept in place to keep compatibility with FuelCI but
 it only invokes tox from inside. It will be removed later, when it’s time
 to switch off unit tests on FuelCI.


 - romcheg

 __
 OpenStack Development Mailing List (not for usage questions)
 Unsubscribe:
 openstack-dev-requ...@lists.openstack.org?subject:unsubscribe
 http://lists.openstack.org/cgi-bin/mailman/listinfo/openstack-dev



 __
 OpenStack Development Mailing List (not for usage questions)
 Unsubscribe: openstack-dev-requ...@lists.openstack.org?subject:unsubscribe
 http://lists.openstack.org/cgi-bin/mailman/listinfo/openstack-dev


__
OpenStack Development Mailing List (not for usage questions)
Unsubscribe: openstack-dev-requ...@lists.openstack.org?subject:unsubscribe
http://lists.openstack.org/cgi-bin/mailman/listinfo/openstack-dev


Re: [openstack-dev] [cinder] Proposing Gorka Eguileor for core

2015-08-19 Thread Mike Perez
On 12:13 Aug 13, Mike Perez wrote:
 It gives me great pleasure to nominate Gorka Eguileor for Cinder core.
 
 Gorka's contributions to Cinder core have been much apprecated:
 
 https://review.openstack.org/#/q/owner:%22Gorka+Eguileor%22+project:openstack/cinder,p,0035b6410002dd11
 
 60/90 day review stats:
 
 http://russellbryant.net/openstack-stats/cinder-reviewers-60.txt
 http://russellbryant.net/openstack-stats/cinder-reviewers-90.txt
 
 Cinder core, please reply with a +1 for approval. This will be left
 open until August 19th. Assuming there are no objections, this will go
 forward after voting is closed.

Gorka has been added to Cinder core. Welcome!

-- 
Mike Perez

__
OpenStack Development Mailing List (not for usage questions)
Unsubscribe: openstack-dev-requ...@lists.openstack.org?subject:unsubscribe
http://lists.openstack.org/cgi-bin/mailman/listinfo/openstack-dev


Re: [openstack-dev] [neutron][fwaas][dvr] FWaaS with DVR

2015-08-19 Thread Mickey Spiegel
Resending, forgot the [neutron] tag-Mickey Spiegel/San Jose/IBM wrote: -To: openstack-dev@lists.openstack.orgFrom: Mickey Spiegel/San Jose/IBMDate: 08/19/2015 09:45AMSubject: [fwaas][dvr] FWaaS with DVRCurrently, FWaaS behaves differently with DVR, applying to only north/south traffic, whereas FWaaS on routers in network nodes applies to both north/south and east/west traffic. There is a compatibility issue due to the asymmetric design of L3 forwarding in DVR, which breaks the connection tracking that FWaaS currently relies on.I started an etherpad where I hope the community can discuss the problem, collect multiple possible solutions, and eventually try to reach consensus about how to move forward:https://etherpad.openstack.org/p/FWaaS_with_DVRI listed every possible solution that I can think of as a starting point. I am somewhat new to OpenStack and FWaaS, so please correct anything that I might have misrepresented.Please add more possible solutions and comment on the possible solutions already listed.Mickey


__
OpenStack Development Mailing List (not for usage questions)
Unsubscribe: openstack-dev-requ...@lists.openstack.org?subject:unsubscribe
http://lists.openstack.org/cgi-bin/mailman/listinfo/openstack-dev


[openstack-dev] [glance] [nova] Image Prefetching – Precaching

2015-08-19 Thread Alberto Geniola
Hi everyone,


This is my first email to the OS developer forum, so forgive me if I
misplaced the subject tags J.


Straight to the point: for a project we’re involved in, we think that a
pre-fetcher mechanism would be great for a variety of use cases. There was
an attempt with this blueprint:


https://blueprints.launchpad.net/nova/+spec/nova-image-cache-management-2


and a more recent one:


https://blueprints.launchpad.net/python-novaclient/+spec/prefetch-image


although both seems to be dead now.

So I really want to get a feedback from the developer’s community whether
(1) such a feature makes sense in general, and (2) it may be worth the
integration of such a component in the OpenStack code. In fact, although we
can solve our problem by developing an in-house component, it would be
better to have it integrated in OpenStack, including Nova and Horizon, so I
need the feedback from the OS Guru guys J.


What do you think?



-- 
Dott. Alberto Geniola

  albertogeni...@gmail.com
  +39-346-6271105
  https://www.linkedin.com/in/albertogeniola

Web: http://www.hw4u.it
__
OpenStack Development Mailing List (not for usage questions)
Unsubscribe: openstack-dev-requ...@lists.openstack.org?subject:unsubscribe
http://lists.openstack.org/cgi-bin/mailman/listinfo/openstack-dev


Re: [openstack-dev] [nova] should we combine a set of minor microversion bump needed fix into one microversoin bump?

2015-08-19 Thread Matt Riedemann



On 8/19/2015 2:16 PM, Matt Riedemann wrote:



On 8/19/2015 1:33 PM, Matt Riedemann wrote:



On 8/19/2015 12:18 PM, Chen CH Ji wrote:

In doing [1] [2], some suggestions raised that those kind of change need
microversion bump which is fine
however, another concern raised on whether we need combine a set of
those kind of changes (which may only change some error code) into one
bump ?

apparently there are pros and cons for doing so, combine makes API
version bump not that frequent for minor changes
but makes it hard to review and backport ... so any suggestions on how
to handle ? Thanks


[1]https://review.openstack.org/#/c/198753/
[2]https://review.openstack.org/#/c/173985/

Best Regards!

Kevin (Chen) Ji 纪 晨

Engineer, zVM Development, CSTL
Notes: Chen CH Ji/China/IBM@IBMCN   Internet: jiche...@cn.ibm.com
Phone: +86-10-82454158
Address: 3/F Ring Building, ZhongGuanCun Software Park, Haidian
District, Beijing 100193, PRC


__


OpenStack Development Mailing List (not for usage questions)
Unsubscribe:
openstack-dev-requ...@lists.openstack.org?subject:unsubscribe
http://lists.openstack.org/cgi-bin/mailman/listinfo/openstack-dev



I don't see why https://review.openstack.org/#/c/198753/ would require a
microversion bump.  We've always allowed handling 500s and turning them
into more appropriate error codes, like a 400 in this case.

As noted:

http://specs.openstack.org/openstack/api-wg/guidelines/evaluating_api_changes.html



Changing an error response code to be more accurate. is generally
acceptable.



https://review.openstack.org/#/c/173985/ doesn't require a version bump
for the same reasons, IMO.  If people are hung up on 400 vs 403 in that
change, just make it a 400, we do it both ways in the compute API.



I guess the problems are in the doc:

http://git.openstack.org/cgit/openstack/nova/tree/doc/source/api_microversion_dev.rst#n63

  - the list of status codes allowed for a particular request

Example: an API previously could return 200, 400, 403, 404 and the
change would make the API now also be allowed to return 409.

  - changing a status code on a particular response

Example: changing the return code of an API from 501 to 400.

So in the one change, just return 400.  In the service_get change where 
you want to return a 400 but it's only returning a 404 today, then I 
guess according to the doc you'd need a microversion bump.  But what do 
we do about fixing that bug in the v2 API?  Do we not fix it?  Do we 
return 404 but v2.1 would return 400 with a microversion bump?  That's 
equally inconsistent and gross IMO.


--

Thanks,

Matt Riedemann


__
OpenStack Development Mailing List (not for usage questions)
Unsubscribe: openstack-dev-requ...@lists.openstack.org?subject:unsubscribe
http://lists.openstack.org/cgi-bin/mailman/listinfo/openstack-dev


Re: [openstack-dev] [nova] should we combine a set of minor microversion bump needed fix into one microversoin bump?

2015-08-19 Thread Matt Riedemann



On 8/19/2015 12:18 PM, Chen CH Ji wrote:

In doing [1] [2], some suggestions raised that those kind of change need
microversion bump which is fine
however, another concern raised on whether we need combine a set of
those kind of changes (which may only change some error code) into one
bump ?

apparently there are pros and cons for doing so, combine makes API
version bump not that frequent for minor changes
but makes it hard to review and backport ... so any suggestions on how
to handle ? Thanks


[1]https://review.openstack.org/#/c/198753/
[2]https://review.openstack.org/#/c/173985/

Best Regards!

Kevin (Chen) Ji 纪 晨

Engineer, zVM Development, CSTL
Notes: Chen CH Ji/China/IBM@IBMCN   Internet: jiche...@cn.ibm.com
Phone: +86-10-82454158
Address: 3/F Ring Building, ZhongGuanCun Software Park, Haidian
District, Beijing 100193, PRC


__
OpenStack Development Mailing List (not for usage questions)
Unsubscribe: openstack-dev-requ...@lists.openstack.org?subject:unsubscribe
http://lists.openstack.org/cgi-bin/mailman/listinfo/openstack-dev



I don't see why https://review.openstack.org/#/c/198753/ would require a 
microversion bump.  We've always allowed handling 500s and turning them 
into more appropriate error codes, like a 400 in this case.


As noted:

http://specs.openstack.org/openstack/api-wg/guidelines/evaluating_api_changes.html

Changing an error response code to be more accurate. is generally 
acceptable.


--

Thanks,

Matt Riedemann


__
OpenStack Development Mailing List (not for usage questions)
Unsubscribe: openstack-dev-requ...@lists.openstack.org?subject:unsubscribe
http://lists.openstack.org/cgi-bin/mailman/listinfo/openstack-dev


[openstack-dev] [Neutron] binding information for networks

2015-08-19 Thread Gal Sagie
Hello all,

Recently i have came across two use cases that having binding
information, or metadata
for networks can be useful. (similar to the port binding profile for that
matter)

For example:

1) In project Kuryr we want to have a binding information which maps the
Neutron network
to docker network (And we might want to do it prior to the docker
network being created,
that is assign a network that is ready to be attached) so this field
also needs to be editable
(just like the port binding profile)

2) For multi site OpenStack (multi cloud) use cases we might want to share
information which
binds logically same network that is created at each OpenStack cloud
site (and hence the ID's
are different).
(Something like this could be useful for project Tricircle for example)

3) Use cases for multi controllers environments? (each controller manage
different networks?)

I believe adding such optional field to the network API is really low risk
due to its being optional
and i believe other use cases can be found to leverage it.

Feel free to share ideas/comments.

If there are no strong objections to it, i will add an RFE/Spec to add this
ability.

Thanks
Gal.
__
OpenStack Development Mailing List (not for usage questions)
Unsubscribe: openstack-dev-requ...@lists.openstack.org?subject:unsubscribe
http://lists.openstack.org/cgi-bin/mailman/listinfo/openstack-dev


Re: [openstack-dev] [Neutron] binding information for networks

2015-08-19 Thread Assaf Muller
On Wed, Aug 19, 2015 at 2:34 PM, Gal Sagie gal.sa...@gmail.com wrote:

 Hello all,

 Recently i have came across two use cases that having binding
 information, or metadata
 for networks can be useful. (similar to the port binding profile for that
 matter)

 For example:

 1) In project Kuryr we want to have a binding information which maps the
 Neutron network
 to docker network (And we might want to do it prior to the docker
 network being created,
 that is assign a network that is ready to be attached) so this field
 also needs to be editable
 (just like the port binding profile)

 2) For multi site OpenStack (multi cloud) use cases we might want to share
 information which
 binds logically same network that is created at each OpenStack cloud
 site (and hence the ID's
 are different).
 (Something like this could be useful for project Tricircle for example)

 3) Use cases for multi controllers environments? (each controller manage
 different networks?)

 I believe adding such optional field to the network API is really low risk
 due to its being optional
 and i believe other use cases can be found to leverage it.


I wonder if we should just add a key/pair tuples tags or metadata
generic field instead. There's
been similar requests floating about that could also use a place to dump
their data in.



 Feel free to share ideas/comments.

 If there are no strong objections to it, i will add an RFE/Spec to add
 this ability.

 Thanks
 Gal.



 __
 OpenStack Development Mailing List (not for usage questions)
 Unsubscribe: openstack-dev-requ...@lists.openstack.org?subject:unsubscribe
 http://lists.openstack.org/cgi-bin/mailman/listinfo/openstack-dev


__
OpenStack Development Mailing List (not for usage questions)
Unsubscribe: openstack-dev-requ...@lists.openstack.org?subject:unsubscribe
http://lists.openstack.org/cgi-bin/mailman/listinfo/openstack-dev


Re: [openstack-dev] [Neutron] Etherpad from the Ops Meetup

2015-08-19 Thread Assaf Muller
On Wed, Aug 19, 2015 at 2:52 PM, Edgar Magana edgar.mag...@workday.com
wrote:

 Folks,

 I just want to share with you the feedback collected today during the
 networking session on Ops Meet-up:
 https://etherpad.openstack.org/p/PAO-ops-network-model

 Special thanks to Ryan and Doug for helping on some questions.


The only action items for Neutron developers that I can spot are:

   1. Linux bridge + DVR / multi host
   2. Prevent data loss when restarting the OVS agent (The patch [1] is
   very close to merge anyway, nothing more to do here)
   3. Work as described by [2] (Big deployers team)

The rest is either polling (Who uses what feature / plugin / etc) or
generic comments with no actionable bugs or RFEs.
Did I miss anything?

[1] https://review.openstack.org/#/c/182920/
[2] https://etherpad.openstack.org/p/Network_Segmentation_Usecases

Cheers,

 Edgar

 __
 OpenStack Development Mailing List (not for usage questions)
 Unsubscribe: openstack-dev-requ...@lists.openstack.org?subject:unsubscribe
 http://lists.openstack.org/cgi-bin/mailman/listinfo/openstack-dev


__
OpenStack Development Mailing List (not for usage questions)
Unsubscribe: openstack-dev-requ...@lists.openstack.org?subject:unsubscribe
http://lists.openstack.org/cgi-bin/mailman/listinfo/openstack-dev


Re: [openstack-dev] [Neutron] Etherpad from the Ops Meetup

2015-08-19 Thread Edgar Magana
Actually, there were very few requirements collected. So, your summary is 
correct.

I feel that this time we did not get a lot of input s we got during the Ops 
meet-up in Philadelphia.

I also recommend to read the burning issues ether pads, there are few 
suggestions on the networking side. Actually, I believe Operators has expressed 
in this session some good feedback that they probaly did not want to repeat 
during the networking section.

https://etherpad.openstack.org/p/PAO-ops-burning-issues

Cheers,

Edgar

From: Assaf Muller
Reply-To: OpenStack Development Mailing List (not for usage questions)
Date: Wednesday, August 19, 2015 at 1:34 PM
To: OpenStack Development Mailing List (not for usage questions)
Subject: Re: [openstack-dev] [Neutron] Etherpad from the Ops Meetup



On Wed, Aug 19, 2015 at 2:52 PM, Edgar Magana 
edgar.mag...@workday.commailto:edgar.mag...@workday.com wrote:
Folks,

I just want to share with you the feedback collected today during the 
networking session on Ops Meet-up:
https://etherpad.openstack.org/p/PAO-ops-network-model

Special thanks to Ryan and Doug for helping on some questions.


The only action items for Neutron developers that I can spot are:

  1.  Linux bridge + DVR / multi host
  2.  Prevent data loss when restarting the OVS agent (The patch [1] is very 
close to merge anyway, nothing more to do here)
  3.  Work as described by [2] (Big deployers team)

The rest is either polling (Who uses what feature / plugin / etc) or generic 
comments with no actionable bugs or RFEs.
Did I miss anything?

[1] https://review.openstack.org/#/c/182920/
[2] https://etherpad.openstack.org/p/Network_Segmentation_Usecases

Cheers,

Edgar

__
OpenStack Development Mailing List (not for usage questions)
Unsubscribe: 
openstack-dev-requ...@lists.openstack.org?subject:unsubscribehttp://openstack-dev-requ...@lists.openstack.org?subject:unsubscribe
http://lists.openstack.org/cgi-bin/mailman/listinfo/openstack-dev


__
OpenStack Development Mailing List (not for usage questions)
Unsubscribe: openstack-dev-requ...@lists.openstack.org?subject:unsubscribe
http://lists.openstack.org/cgi-bin/mailman/listinfo/openstack-dev


Re: [openstack-dev] [fuel][puppet] The state of collaboration: 9 weeks

2015-08-19 Thread Matt Fischer
Dmitry,

I've appreciated the feedback on my patches from your team and the work
they are doing, it's great that everyone is working together better now. I
think getting more puppet core reviewers is certainly on the horizon and
will happen with continued effort, it just takes time and trust. But its
on the radar to use a analogy.

As for your specific issue with the swift patch, I don't know enough about
ring builder to decide whether the author or the swift reviewer is right so
I was hoping he (the swift core) would follow-up to your comment. The
puppet code itself is fine. I've also asked someone on my team who is a
swift expert (but not a puppet core) to take a look and weigh-in. I don't
know what our official policy is, but I would expect your author to reach
out to the person who left the -1 and attempt to resolve it with them
before one of us would essentially override the -1.


On Tue, Aug 18, 2015 at 12:33 AM, Dmitry Borodaenko 
dborodae...@mirantis.com wrote:

 Two weeks ago, I flagged the patch sets to commits ratio as the biggest
 problem that Fuel contributors to Puppet OpenStack should address, and
 over the past two weeks the situation has improved dramatically. In
 first and second week of August, 19 of our commits were merged in
 upstream, bringing our patch sets per commit ratio from 19 down to 5.6
 (while average for Puppet OpenStack during that period was 6.5). With
 the share of patch sets pushed by Fuel developers remaining at roughly
 the same level (15.9% vs 17.4%), I think it's safe to call this problem
 solved. Simply awesome!

 Comparing last 30 days contribution stats vs same numbers two weeks ago:

 Bogdan Dobrelia (#3 reviewer!): 67.2% - 66.3% (disagreements 4.9% - 3.6%)
 Denis Egorenko: 97% - 87.5% (disagreements 12.1% - 13.9%)
 Vasyl Saienko: 100% - 96.4% (disagreements 16.7% - 10.7%)
 Ivan Berezovskiy: 100% - 92.3% (disagreements 0% - 3.8%)
 Sergey Kolekonov: 91.7% - 95.7% (disagreements 8.3% - 13%)
 Max Yatsenko: n/a - 100% (disagreements n/a - 17.4%)
 Alex Schultz: 80% - 80% (disagreements 20% - 26.7%)
 Bartlomiej Piotrowski: n/a - 100% (disagreements n/a - 12.5%)
 Sergii Golovatiuk: 100% - 100% (disagreements 33.3% - 0%)

 Bogdan continues to set the example and improve his numbers, which is
 not surprising considering that he's also the top reviewer in
 fuel-library. I think puppet-nova and puppet-neutron teams should
 seriously consider nominating him for core, he already tops reviewers
 lists for these modules.

 Denis, Vasyl, and Ivan are not there yet, but they all have noticeably
 increased both number and quality of their reviews, keep it up guys!

 Numbers for other top reviewers are uneven and small enough for noise to
 overtake meaningful data, all I can recommend here is to watch your
 disagreements and learn from them. A ratio above 10% can mean one of
 three things: 1) you're not doing enough reviews so even a handful of
 disagreements sticks out -- do more reviews and this will improve on its
 own; 2) you're missing problems with the code that other reviewers find
 unacceptable -- try to be more attentive and watch for the things that
 you've been missing; 3) you disagree with majority on how some things
 should be done -- discuss your differences on IRC or ML and figure out a
 consensus.

 Moving on to other numbers, weekly IRC meetings participation remains
 good:

 Aug-4: 4 of 15 participants, 22 of 162 lines
 Aug-11: 6 of 16 participants, 62 of 192 lines

 Unfortunately it's not all roses and unicorns, last week I flagged a
 stuck review that I think has been mishandled by Puppet OpenStack team
 [0][1], and it still remains in the same state.

 [0] https://review.openstack.org/198695
 [1]
 http://eavesdrop.openstack.org/meetings/puppet_openstack/2015/puppet_openstack.2015-08-11-15.00.log.html#l-140

 On July 8, patch set 2 has passed CI. It received 2 +1 votes from other
 Fuel developers on July 10 and 29, but remained ignored by upstream
 reviewers until August 10, more than a month after the current patch set
 was posted. Then, a Swift core reviewer left a -1 disagreeing with the
 intent of the patch, and even though patch author posted a rebuttal a
 day later, the patch remains stuck and untouched for yet another week.

 It's a one-off case that does not outweigh the positive trends I've
 outlined above, but even one stuck patch that fixes a critical bug is
 enough to justify a fork.

 Speaking of forks, we managed to un-fork 9 upstream modules [2] with
 puppet-librarian-simple before Fuel 7.0 soft code freeze has kicked in.

 [2]
 https://github.com/stackforge/fuel-library/blob/master/deployment/Puppetfile

 That's 9 times more than my conservative estimate of converting at least
 1 module to librarian in 7.0, but these were the easiest and least
 deviated from upstream. We've still got 50 more modules to convert in
 Fuel 8.0, many will require commits to be merged in upstream before they
 can be completely un-forked. Having such commits wait for a 

[openstack-dev] [Neutron] Etherpad from the Ops Meetup

2015-08-19 Thread Edgar Magana
Folks,

I just want to share with you the feedback collected today during the 
networking session on Ops Meet-up:
https://etherpad.openstack.org/p/PAO-ops-network-model

Special thanks to Ryan and Doug for helping on some questions.

Cheers,

Edgar
__
OpenStack Development Mailing List (not for usage questions)
Unsubscribe: openstack-dev-requ...@lists.openstack.org?subject:unsubscribe
http://lists.openstack.org/cgi-bin/mailman/listinfo/openstack-dev


Re: [openstack-dev] [fuel][puppet] The state of collaboration: 9 weeks

2015-08-19 Thread Dmitry Borodaenko
Matt,

I appreciate that it has barely been 2 months since we've started following
the new model of collaboration (see thread subject :), so the intent of
highlighting Bogdan's work was exactly what you said: put it on your radar.

We have discussed the swift ring rebalance patch in the IRC meeting
yesterday:
http://eavesdrop.openstack.org/meetings/puppet_openstack/2015/puppet_openstack.2015-08-18-15.00.log.html#l-108

You've now confirmed what Emilien said in the meeting: core reviewers in
puppet-swift don't know enough about ring rebalance to judge this patch on
their own, and need an expert opinion from Swift team. That's totally fine
in my book and I don't have any issue with that.

I also don't have an issue with the -1 that's still outstanding: it's a
valid concern and it was good to raise it. I think Alex has addressed it in
his rebuttal, and now it needs two more votes to move forward: a comment
from a Puppet expert to confirm or disprove Alex's statement that his code
is idemptotent and will not spuriously trigger rebalance when it's not
needed, and one more from Christian to confirm that the idempotency
assurance is sufficient to address his concern.

My problem was that it took a month and two escalations on weekly IRC
meeting and another one here before this situation was explained. A better
way to handle this would have been to leave a +1 (or even 0) with a comment
along the lines of Puppet code looks good, but we need a Swift expert to
confirm this, Christian please have a look.

In other words, it never hurts to over-communicate :)

Thanks,
-DmitryB

On Wed, Aug 19, 2015 at 11:47 AM Matt Fischer m...@mattfischer.com wrote:

 Dmitry,

 I've appreciated the feedback on my patches from your team and the work
 they are doing, it's great that everyone is working together better now. I
 think getting more puppet core reviewers is certainly on the horizon and
 will happen with continued effort, it just takes time and trust. But its
 on the radar to use a analogy.

 As for your specific issue with the swift patch, I don't know enough about
 ring builder to decide whether the author or the swift reviewer is right so
 I was hoping he (the swift core) would follow-up to your comment. The
 puppet code itself is fine. I've also asked someone on my team who is a
 swift expert (but not a puppet core) to take a look and weigh-in. I don't
 know what our official policy is, but I would expect your author to reach
 out to the person who left the -1 and attempt to resolve it with them
 before one of us would essentially override the -1.


 On Tue, Aug 18, 2015 at 12:33 AM, Dmitry Borodaenko 
 dborodae...@mirantis.com wrote:

 Two weeks ago, I flagged the patch sets to commits ratio as the biggest
 problem that Fuel contributors to Puppet OpenStack should address, and
 over the past two weeks the situation has improved dramatically. In
 first and second week of August, 19 of our commits were merged in
 upstream, bringing our patch sets per commit ratio from 19 down to 5.6
 (while average for Puppet OpenStack during that period was 6.5). With
 the share of patch sets pushed by Fuel developers remaining at roughly
 the same level (15.9% vs 17.4%), I think it's safe to call this problem
 solved. Simply awesome!

 Comparing last 30 days contribution stats vs same numbers two weeks ago:

 Bogdan Dobrelia (#3 reviewer!): 67.2% - 66.3% (disagreements 4.9% -
 3.6%)
 Denis Egorenko: 97% - 87.5% (disagreements 12.1% - 13.9%)
 Vasyl Saienko: 100% - 96.4% (disagreements 16.7% - 10.7%)
 Ivan Berezovskiy: 100% - 92.3% (disagreements 0% - 3.8%)
 Sergey Kolekonov: 91.7% - 95.7% (disagreements 8.3% - 13%)
 Max Yatsenko: n/a - 100% (disagreements n/a - 17.4%)
 Alex Schultz: 80% - 80% (disagreements 20% - 26.7%)
 Bartlomiej Piotrowski: n/a - 100% (disagreements n/a - 12.5%)
 Sergii Golovatiuk: 100% - 100% (disagreements 33.3% - 0%)

 Bogdan continues to set the example and improve his numbers, which is
 not surprising considering that he's also the top reviewer in
 fuel-library. I think puppet-nova and puppet-neutron teams should
 seriously consider nominating him for core, he already tops reviewers
 lists for these modules.

 Denis, Vasyl, and Ivan are not there yet, but they all have noticeably
 increased both number and quality of their reviews, keep it up guys!

 Numbers for other top reviewers are uneven and small enough for noise to
 overtake meaningful data, all I can recommend here is to watch your
 disagreements and learn from them. A ratio above 10% can mean one of
 three things: 1) you're not doing enough reviews so even a handful of
 disagreements sticks out -- do more reviews and this will improve on its
 own; 2) you're missing problems with the code that other reviewers find
 unacceptable -- try to be more attentive and watch for the things that
 you've been missing; 3) you disagree with majority on how some things
 should be done -- discuss your differences on IRC or ML and figure out a
 consensus.

 Moving on to 

Re: [openstack-dev] [Neutron][fwaas] APAC friendly meeting

2015-08-19 Thread Sean M. Collins
OK -  UTC sounds good to me, so if anyone is available we can conduct the 
meeting this week - so in
about 5 hours?

I'll push an update to the ircmeetings repo. I think it'll be a light
agenda from my end due to my last minute decision, but it'll at least give 
everyone
time to say hello and bring up anything they've wanted to discuss.
-- 
Sean M. Collins

__
OpenStack Development Mailing List (not for usage questions)
Unsubscribe: openstack-dev-requ...@lists.openstack.org?subject:unsubscribe
http://lists.openstack.org/cgi-bin/mailman/listinfo/openstack-dev


Re: [openstack-dev] [Horizon] Update on Angular Identity work

2015-08-19 Thread Thai Q Tran
Hi Lin,I agree with you and Eric that we have a lot of HTML fragments. Some of them I think make sense as directives:The table footer is a good example of something we can convert into a directive:https://review.openstack.org/#/c/207631/The table header on the other hand is something more specific to your table:https://github.com/openstack/horizon/blob/master/openstack_dashboard/dashboards/identity/static/dashboard/identity/users/table/table-header.htmlSo there are two approaches we can take here:1. Keep some of the presentation related data in the HTML: mainly things like table headers, column definitions, translated texts, etc... I like this approach a bit more because it allow us to read the HTML and know exactly what we are expecting to see. This table.html is compose of smaller directives like hz-table-footer and regular html tags like th and td etc... I think as we have more of these smaller directives available, we can combine the fragments into one file.2. We could create a more general table directive with a common template. This is more inline with what we have currently for legacy. BUT the presentation logic like translations, definitions would now have to reside in the table controller AND we lose the semantic readability part. Doing it this way could potentially introduce more complexity as it now requires people to learn the table directive, which could be very complex if it does not use smaller directives. Another common problem we encountered with this pattern was a lack of customization. In legacy, it was pretty hard to add an icon into a table cell. If we go down this route, I believe we might start to encounter the same issues.In summary, we are working on addressing the HTML fragments, but I think we as a community should go with option 1 and stay away from option 2.-Lin Hua Cheng os.lch...@gmail.com wrote: -To: "OpenStack Development Mailing List (not for usage questions)" openstack-dev@lists.openstack.orgFrom: Lin Hua Cheng os.lch...@gmail.comDate: 08/18/2015 02:36PMCc: Vince Brunssen/Austin/IBM@IBMUSSubject: Re: [openstack-dev] [Horizon] Update on Angular Identity workI think the table setup pattern have some opportunity for reducing code duplication before it gets re-used by other panels.. We used to just need to write one file to define a table, now we have to write 9 files [1]. Can we have a table directive to reduce the duplicated code before moving forward to other panels?-Lin[1] https://github.com/openstack/horizon/tree/master/openstack_dashboard/dashboards/identity/static/dashboard/identity/users/tableOn Tue, Aug 18, 2015 at 11:49 AM, Thai Q Tran tqt...@us.ibm.com wrote:Hi everyone,Just wanted to keep everyone up to date on the angular panels work. The goal was to set a pattern that others can follow, to that end, there were a few requirements:1. reusable and possibly pluggable2. easy to understand3. reduce code duplicationThese requirements don't always go hand-in-hand, and that is the primary reason why it is taking a bit longer. I believe we are nearing the end of it, here are some items remaining that I believe is crucial to finishing up this work.a. i18n was completed, so we need help moving gettext blobs to HTML templates (example patch:https://review.openstack.org/#/c/210366/ ) volunteers are welcomed! We want others to use the translate directive as the main way to translate text blobs, this was why we went down this road using babel and angular_extractor plugin.b. transfer table supports clone feature ( https://review.openstack.org/#/c/211345/). There were a lot of template duplications, this clone feature reduces the HTML by a considerable amount. Since this is something we use quite often, it made sense to invest time into improving it. We have had complaints that there was too much HTML fragments, this will address a bit of that. One of the challenge was to get it working with existing launch-instance, so I spent about 2 weeks making sure it worked well with the old code while allowing the new clone feature.c. I believe we have a pretty good pattern setup for tables. The final piece of the puzzle was the patterns for various actions. We have wizard (create user), form (edit user), confirmation dialog (delete user), and actions with no modal dialog (enable user). We wanted a general pattern that would address the requirements mentioned above. There were some discussions around extensibility at the midcycle that I think will fit well here as well ( https://blueprints.launchpad.net/horizon/+spec/angular-workflow-plugin ). The actions can follow a similar pattern to workflow. I believe this pattern would address #1 and #3 but making it easy to understand is a bit challenging - I think this is where documentation could help.https://review.openstack.org/#/c/202315/ and a few other patches are going to be ready for review soon (sometime end of this week)!Item #c is the most important piece, it is going to be the general pattern that people will use to build their 

Re: [openstack-dev] [nova] should we combine a set of minor microversion bump needed fix into one microversoin bump?

2015-08-19 Thread Matt Riedemann



On 8/19/2015 1:33 PM, Matt Riedemann wrote:



On 8/19/2015 12:18 PM, Chen CH Ji wrote:

In doing [1] [2], some suggestions raised that those kind of change need
microversion bump which is fine
however, another concern raised on whether we need combine a set of
those kind of changes (which may only change some error code) into one
bump ?

apparently there are pros and cons for doing so, combine makes API
version bump not that frequent for minor changes
but makes it hard to review and backport ... so any suggestions on how
to handle ? Thanks


[1]https://review.openstack.org/#/c/198753/
[2]https://review.openstack.org/#/c/173985/

Best Regards!

Kevin (Chen) Ji 纪 晨

Engineer, zVM Development, CSTL
Notes: Chen CH Ji/China/IBM@IBMCN   Internet: jiche...@cn.ibm.com
Phone: +86-10-82454158
Address: 3/F Ring Building, ZhongGuanCun Software Park, Haidian
District, Beijing 100193, PRC


__

OpenStack Development Mailing List (not for usage questions)
Unsubscribe:
openstack-dev-requ...@lists.openstack.org?subject:unsubscribe
http://lists.openstack.org/cgi-bin/mailman/listinfo/openstack-dev



I don't see why https://review.openstack.org/#/c/198753/ would require a
microversion bump.  We've always allowed handling 500s and turning them
into more appropriate error codes, like a 400 in this case.

As noted:

http://specs.openstack.org/openstack/api-wg/guidelines/evaluating_api_changes.html


Changing an error response code to be more accurate. is generally
acceptable.



https://review.openstack.org/#/c/173985/ doesn't require a version bump 
for the same reasons, IMO.  If people are hung up on 400 vs 403 in that 
change, just make it a 400, we do it both ways in the compute API.


--

Thanks,

Matt Riedemann


__
OpenStack Development Mailing List (not for usage questions)
Unsubscribe: openstack-dev-requ...@lists.openstack.org?subject:unsubscribe
http://lists.openstack.org/cgi-bin/mailman/listinfo/openstack-dev


Re: [openstack-dev] [devstack] Possible issues cryptography 1.0 and os-client-config 1.6.2

2015-08-19 Thread Robert Collins
On 20 August 2015 at 01:42, Sean Dague s...@dague.net wrote:

 Sorry about jumping the gun there. We thought, incorrectly, we had the
 right fix. And it's a conference week so access to my local test env
 wasn't easy.

No worries - these things happen. Having higher fidelity tests would
give some more insulation - perhaps not gating though - e.g. a
non-cached non-voting nodepool job that looks very much like a local
developer experience. And then one of those for Ubuntu and Fedora (and
any other commonly used platforms we wish to support developers
using).

FWIW I think the fix for the specific issue should be to not install
the python-cffi package, but I couldn't trivially figure out what was
triggering the install. Not installing it would make devstack on
Fedora faster (since we're still installing the thing from PyPI as
well..)

-Rob

-- 
Robert Collins rbtcoll...@hp.com
Distinguished Technologist
HP Converged Cloud

__
OpenStack Development Mailing List (not for usage questions)
Unsubscribe: openstack-dev-requ...@lists.openstack.org?subject:unsubscribe
http://lists.openstack.org/cgi-bin/mailman/listinfo/openstack-dev


Re: [openstack-dev] [Neutron] Etherpad from the Ops Meetup

2015-08-19 Thread Ryan Moats
One thing came up during lunch was including unit and functional testing of
dual stack in the check and gate queues - I was regaled over lunch with one
operator's experiences in trying to run Neutron on a dual stack system.

Ryan Moats (regXboi)

Edgar Magana edgar.mag...@workday.com wrote on 08/19/2015 03:43:44 PM:

 From: Edgar Magana edgar.mag...@workday.com
 To: OpenStack Development Mailing List (not for usage questions)
 openstack-dev@lists.openstack.org
 Date: 08/19/2015 03:44 PM
 Subject: Re: [openstack-dev] [Neutron] Etherpad from the Ops Meetup

 Actually, there were very few requirements collected. So, your
 summary is correct.

 I feel that this time we did not get a lot of input s we got during
 the Ops meet-up in Philadelphia.

 I also recommend to read the burning issues ether pads, there are
 few suggestions on the networking side. Actually, I believe
 Operators has expressed in this session some good feedback that they
 probaly did not want to repeat during the networking section.

 https://etherpad.openstack.org/p/PAO-ops-burning-issues

 Cheers,

 Edgar

 From: Assaf Muller
 Reply-To: OpenStack Development Mailing List (not for usage questions)
 Date: Wednesday, August 19, 2015 at 1:34 PM
 To: OpenStack Development Mailing List (not for usage questions)
 Subject: Re: [openstack-dev] [Neutron] Etherpad from the Ops Meetup

 On Wed, Aug 19, 2015 at 2:52 PM, Edgar Magana edgar.mag...@workday.com
  wrote:
 Folks,

 I just want to share with you the feedback collected today during
 the networking session on Ops Meet-up:
 https://etherpad.openstack.org/p/PAO-ops-network-model

 Special thanks to Ryan and Doug for helping on some questions.

 The only action items for Neutron developers that I can spot are:
 1. Linux bridge + DVR / multi host
 2. Prevent data loss when restarting the OVS agent (The patch [1] is
 very close to merge anyway, nothing more to do here)
 3. Work as described by [2] (Big deployers team)
 The rest is either polling (Who uses what feature / plugin / etc) or
 generic comments with no actionable bugs or RFEs.
 Did I miss anything?

 [1] https://review.openstack.org/#/c/182920/
 [2] https://etherpad.openstack.org/p/Network_Segmentation_Usecases

 Cheers,

 Edgar


__
 OpenStack Development Mailing List (not for usage questions)
 Unsubscribe:
openstack-dev-requ...@lists.openstack.org?subject:unsubscribe
 http://lists.openstack.org/cgi-bin/mailman/listinfo/openstack-dev


__
 OpenStack Development Mailing List (not for usage questions)
 Unsubscribe:
openstack-dev-requ...@lists.openstack.org?subject:unsubscribe
 http://lists.openstack.org/cgi-bin/mailman/listinfo/openstack-dev
__
OpenStack Development Mailing List (not for usage questions)
Unsubscribe: openstack-dev-requ...@lists.openstack.org?subject:unsubscribe
http://lists.openstack.org/cgi-bin/mailman/listinfo/openstack-dev


Re: [openstack-dev] [Neutron] Etherpad from the Ops Meetup

2015-08-19 Thread Sean M. Collins
On Wed, Aug 19, 2015 at 05:11:55PM EDT, Ryan Moats wrote:
 One thing came up during lunch was including unit and functional testing of
 dual stack in the check and gate queues - I was regaled over lunch with one
 operator's experiences in trying to run Neutron on a dual stack system.

We are testing dual stack

https://review.openstack.org/#/c/160856/

Have they found gaps in our coverage?

-- 
Sean M. Collins

__
OpenStack Development Mailing List (not for usage questions)
Unsubscribe: openstack-dev-requ...@lists.openstack.org?subject:unsubscribe
http://lists.openstack.org/cgi-bin/mailman/listinfo/openstack-dev


[openstack-dev] [packaging] asks from the ops meetup

2015-08-19 Thread Matthew Thode
I'll start by giving this out, but I'll also summarize the asks we had
from upstream.

https://etherpad.openstack.org/p/PAO-ops-packaging


General services:
  - gate check on example config and doc generation
- was mentioned this has broken in the past and taken a while to fix
  - document dependencies needed for config/doc generation
- (not all of test requirements)
  - generated example configs generated and stored in an automated way
- (in lieu of packagers generating the configs dynamically)
  - A place to look for files that go in /etc
  - Publish pip-freeze at the end
  - Don't strip out files in the repo when publishing to pip
  - Publish an example init-script (systemd)
- I think this might be going away with wsgi

Docs:
  - nginx wsgi examples

-- 
Matthew Thode (prometheanfire)



signature.asc
Description: OpenPGP digital signature
__
OpenStack Development Mailing List (not for usage questions)
Unsubscribe: openstack-dev-requ...@lists.openstack.org?subject:unsubscribe
http://lists.openstack.org/cgi-bin/mailman/listinfo/openstack-dev


[openstack-dev] [app-catalog] IRC Meeting Thursday August 20th at 17:00UTC

2015-08-19 Thread Christopher Aedo
Howdy! Our next OpenStack App Catalog meeting will take place this
Thursday August 20th at 17:00 UTC in #openstack-meeting-3

The agenda can be found here:
https://wiki.openstack.org/wiki/Meetings/app-catalog

Please add agenda items if there's anything specific you would like to
discuss (or of course if the meeting time is not convenient for you
join us on IRC #openstack-app-catalog).

Please join us if you can!

-Christopher

__
OpenStack Development Mailing List (not for usage questions)
Unsubscribe: openstack-dev-requ...@lists.openstack.org?subject:unsubscribe
http://lists.openstack.org/cgi-bin/mailman/listinfo/openstack-dev


[openstack-dev] [nova] contextlib.nested and Python3 failing

2015-08-19 Thread Sylvain Bauza

Hi,

I was writing some tests so I added a contextlib.nested to a checked 
TestCase [1]. Unfortunately, contextlib.nested is no longer available in 
Python3 and there is no clear solution on how to provide a compatible 
import for both python2 and python3:
 - either providing a python3 compatible behaviour by using 
contextlib.ExitStack but that class is not available in Python 2
 - or provide contextlib2 for python2 (and thus adding it to the 
requirements)


That sounds really disruptive and blocking as we are close to the 
FeatureFreeze. Many other users of contextlib.nested are not impacted by 
the job because it excludes all of them but since the test I'm changing 
is part of the existing validated tests, that leaves Jenkins -1'ing my 
change.


Of course, a 3rd solution would consist of excluding my updated test 
from the python3 check but I can hear others yelling at that :-)


Ideas appreciated.

-Sylvain

[1] 
https://review.openstack.org/#/c/199205/18/nova/tests/unit/scheduler/test_rpcapi.py,cm



__
OpenStack Development Mailing List (not for usage questions)
Unsubscribe: openstack-dev-requ...@lists.openstack.org?subject:unsubscribe
http://lists.openstack.org/cgi-bin/mailman/listinfo/openstack-dev


Re: [openstack-dev] [Neutron] Etherpad from the Ops Meetup

2015-08-19 Thread Matthew Thode
On 08/19/2015 05:29 PM, Ryan Moats wrote:
 They didn't mention a release by name, so I think it may be fair that they
 were testing pre-kilo - I'll take the action item to follow up with them...
 
 Ryan
 
 Sean M. Collins s...@coreitpro.com wrote on 08/19/2015 04:25:22 PM:
 
 From: Sean M. Collins s...@coreitpro.com
 To: OpenStack Development Mailing List (not for usage questions)
 openstack-dev@lists.openstack.org
 Date: 08/19/2015 04:26 PM
 Subject: Re: [openstack-dev] [Neutron] Etherpad from the Ops Meetup

 On Wed, Aug 19, 2015 at 05:11:55PM EDT, Ryan Moats wrote:
 One thing came up during lunch was including unit and functional
 testing of
 dual stack in the check and gate queues - I was regaled over lunch with
 one
 operator's experiences in trying to run Neutron on a dual stack system.

 We are testing dual stack

 https://review.openstack.org/#/c/160856/

 Have they found gaps in our coverage?

 --
 Sean M. Collins


 __
 OpenStack Development Mailing List (not for usage questions)
 Unsubscribe:
 openstack-dev-requ...@lists.openstack.org?subject:unsubscribe
 http://lists.openstack.org/cgi-bin/mailman/listinfo/openstack-dev

 
 
 
 __
 OpenStack Development Mailing List (not for usage questions)
 Unsubscribe: openstack-dev-requ...@lists.openstack.org?subject:unsubscribe
 http://lists.openstack.org/cgi-bin/mailman/listinfo/openstack-dev
 
Some of the issue was that DVR wasn't (not sure if it still isn't)
tested in a multi-node setup.

-- 
Matthew Thode (prometheanfire)



signature.asc
Description: OpenPGP digital signature
__
OpenStack Development Mailing List (not for usage questions)
Unsubscribe: openstack-dev-requ...@lists.openstack.org?subject:unsubscribe
http://lists.openstack.org/cgi-bin/mailman/listinfo/openstack-dev


Re: [openstack-dev] [Neutron] Etherpad from the Ops Meetup

2015-08-19 Thread Tom Fifield



On 19/08/15 11:52, Edgar Magana wrote:

Folks,

I just want to share with you the feedback collected today during the
networking session on Ops Meet-up:
https://etherpad.openstack.org/p/PAO-ops-network-model

Special thanks to Ryan and Doug for helping on some questions.


Line 28 on https://etherpad.openstack.org/p/PAO-ops-deployment-tips also 
has some stuff on networking


__
OpenStack Development Mailing List (not for usage questions)
Unsubscribe: openstack-dev-requ...@lists.openstack.org?subject:unsubscribe
http://lists.openstack.org/cgi-bin/mailman/listinfo/openstack-dev


Re: [openstack-dev] [Neutron] Etherpad from the Ops Meetup

2015-08-19 Thread Ryan Moats
They didn't mention a release by name, so I think it may be fair that they
were testing pre-kilo - I'll take the action item to follow up with them...

Ryan

Sean M. Collins s...@coreitpro.com wrote on 08/19/2015 04:25:22 PM:

 From: Sean M. Collins s...@coreitpro.com
 To: OpenStack Development Mailing List (not for usage questions)
 openstack-dev@lists.openstack.org
 Date: 08/19/2015 04:26 PM
 Subject: Re: [openstack-dev] [Neutron] Etherpad from the Ops Meetup

 On Wed, Aug 19, 2015 at 05:11:55PM EDT, Ryan Moats wrote:
  One thing came up during lunch was including unit and functional
testing of
  dual stack in the check and gate queues - I was regaled over lunch with
one
  operator's experiences in trying to run Neutron on a dual stack system.

 We are testing dual stack

 https://review.openstack.org/#/c/160856/

 Have they found gaps in our coverage?

 --
 Sean M. Collins


__
 OpenStack Development Mailing List (not for usage questions)
 Unsubscribe:
openstack-dev-requ...@lists.openstack.org?subject:unsubscribe
 http://lists.openstack.org/cgi-bin/mailman/listinfo/openstack-dev

__
OpenStack Development Mailing List (not for usage questions)
Unsubscribe: openstack-dev-requ...@lists.openstack.org?subject:unsubscribe
http://lists.openstack.org/cgi-bin/mailman/listinfo/openstack-dev


Re: [openstack-dev] [Fuel][MOS][Bootstrap] Please try Ubuntu bootstrap in MOS 7.0

2015-08-19 Thread Vladimir Kuklin
Folks

Why not enable it as an experimental?

On Wed, Aug 19, 2015 at 12:20 PM, Mikhail Semenov mseme...@mirantis.com
wrote:

 As we considered today, Ubuntu bootstrap will not be shipped in MOS 7.0.
 It was a hard decision based on the issue with NICs naming [1].
 This bug can be fixed only by changing the naming of network interfaces(
 http://www.freedesktop.org/wiki/Software/systemd/PredictableNetworkInterfaceNames/)
 and it's too late to do it in MOS 7.0 scope.
 So, this feature is moved to MOS 8.0.

 [1] https://bugs.launchpad.net/mos/+bug/1482049

 --
 Thanks,
 Michael

 On Thu, Aug 13, 2015 at 6:30 PM, Mikhail Semenov mseme...@mirantis.com
 wrote:

 Hi all,

 We have new feature in the upcoming release MOS 7.0 - Ubuntu-based
 bootstrap in addition to current CentOS-based one. Design spec can be found
 here https://review.openstack.org/#/c/194154/.

 Current 7.0 ISO contains 2 bootstrap images: CentOS-based (default) and
 Ubuntu-based. You can easily switch to Ubuntu-based bootstrap using this
 steps:
 1. Make sure the master node can access Ubuntu (
 http://archive.ubuntu.com/ubuntu) and MOS (
 http://mirror.fuel-infra.org/mos-repos) APT repositories.
 2. Run the following command on the master node:
 *fuel-bootstrap-image-set ubuntu*
 3. Just in a case restart dnsmasq:
 *dockerctl shell cobbler service dnsmasq restart*
 4. Reboot the slave nodes.

 There are only 2 weeks left for testing. On 08/27 we will make a decision
 about using Ubuntu bootstrap by default in MOS 7.0. It depends on the test
 results and statistics(more deployments - more confidence).

 I want to ask everyone to try new Ubuntu bootstrap. Please, deploy it on
 your environments and file bugs in case of failures. It's most important
 for *partners* *and* *plugin developers*. Feel free to contact Alexei
 Sheplyakov(feature lead) and me in case of questions.

 --
 Thanks,
 Michael




 --
 Thanks,
 Michael

 __
 OpenStack Development Mailing List (not for usage questions)
 Unsubscribe: openstack-dev-requ...@lists.openstack.org?subject:unsubscribe
 http://lists.openstack.org/cgi-bin/mailman/listinfo/openstack-dev




-- 
Yours Faithfully,
Vladimir Kuklin,
Fuel Library Tech Lead,
Mirantis, Inc.
+7 (495) 640-49-04
+7 (926) 702-39-68
Skype kuklinvv
35bk3, Vorontsovskaya Str.
Moscow, Russia,
www.mirantis.com http://www.mirantis.ru/
www.mirantis.ru
vkuk...@mirantis.com
__
OpenStack Development Mailing List (not for usage questions)
Unsubscribe: openstack-dev-requ...@lists.openstack.org?subject:unsubscribe
http://lists.openstack.org/cgi-bin/mailman/listinfo/openstack-dev


Re: [openstack-dev] [Fuel][MOS][Bootstrap] Please try Ubuntu bootstrap in MOS 7.0

2015-08-19 Thread Mike Scherbakov
As it simply has blocking bugs, and so it can't even be called
experimental, only prototype. I don't vote though for reverting the code. I
just want to ensure that we don't recommend it to anyone except other
developers, who want to try it and may be propose some fixes.

On Wed, Aug 19, 2015 at 3:56 PM Vladimir Kuklin vkuk...@mirantis.com
wrote:

 Folks

 Why not enable it as an experimental?

 On Wed, Aug 19, 2015 at 12:20 PM, Mikhail Semenov mseme...@mirantis.com
 wrote:

 As we considered today, Ubuntu bootstrap will not be shipped in MOS 7.0.
 It was a hard decision based on the issue with NICs naming [1].
 This bug can be fixed only by changing the naming of network interfaces(
 http://www.freedesktop.org/wiki/Software/systemd/PredictableNetworkInterfaceNames/)
 and it's too late to do it in MOS 7.0 scope.
 So, this feature is moved to MOS 8.0.

 [1] https://bugs.launchpad.net/mos/+bug/1482049

 --
 Thanks,
 Michael

 On Thu, Aug 13, 2015 at 6:30 PM, Mikhail Semenov mseme...@mirantis.com
 wrote:

 Hi all,

 We have new feature in the upcoming release MOS 7.0 - Ubuntu-based
 bootstrap in addition to current CentOS-based one. Design spec can be found
 here https://review.openstack.org/#/c/194154/.

 Current 7.0 ISO contains 2 bootstrap images: CentOS-based (default) and
 Ubuntu-based. You can easily switch to Ubuntu-based bootstrap using this
 steps:
 1. Make sure the master node can access Ubuntu (
 http://archive.ubuntu.com/ubuntu) and MOS (
 http://mirror.fuel-infra.org/mos-repos) APT repositories.
 2. Run the following command on the master node:
 *fuel-bootstrap-image-set ubuntu*
 3. Just in a case restart dnsmasq:
 *dockerctl shell cobbler service dnsmasq restart*
 4. Reboot the slave nodes.

 There are only 2 weeks left for testing. On 08/27 we will make a
 decision about using Ubuntu bootstrap by default in MOS 7.0. It depends on
 the test results and statistics(more deployments - more confidence).

 I want to ask everyone to try new Ubuntu bootstrap. Please, deploy it on
 your environments and file bugs in case of failures. It's most important
 for *partners* *and* *plugin developers*. Feel free to contact Alexei
 Sheplyakov(feature lead) and me in case of questions.

 --
 Thanks,
 Michael




 --
 Thanks,
 Michael

 __
 OpenStack Development Mailing List (not for usage questions)
 Unsubscribe:
 openstack-dev-requ...@lists.openstack.org?subject:unsubscribe
 http://lists.openstack.org/cgi-bin/mailman/listinfo/openstack-dev




 --
 Yours Faithfully,
 Vladimir Kuklin,
 Fuel Library Tech Lead,
 Mirantis, Inc.
 +7 (495) 640-49-04
 +7 (926) 702-39-68
 Skype kuklinvv
 35bk3, Vorontsovskaya Str.
 Moscow, Russia,
 www.mirantis.com http://www.mirantis.ru/
 www.mirantis.ru
 vkuk...@mirantis.com
 __
 OpenStack Development Mailing List (not for usage questions)
 Unsubscribe: openstack-dev-requ...@lists.openstack.org?subject:unsubscribe
 http://lists.openstack.org/cgi-bin/mailman/listinfo/openstack-dev

-- 
Mike Scherbakov
#mihgen
__
OpenStack Development Mailing List (not for usage questions)
Unsubscribe: openstack-dev-requ...@lists.openstack.org?subject:unsubscribe
http://lists.openstack.org/cgi-bin/mailman/listinfo/openstack-dev


Re: [openstack-dev] Cross-project meeting times

2015-08-19 Thread Lana Brindley
-BEGIN PGP SIGNED MESSAGE-
Hash: SHA1

That makes it 4am for me, so I'm out :(

L

On 20/08/15 01:39, Morgan Fainberg wrote:
 I am ok with this moving as long as it doesn't camp on the Keystone meeting 
 time ;). In all seriousness I'm not opposed to moving the meeting if it will 
 include more people / make lives better for those who are there. 
 
 Sent via mobile
 
 On Aug 19, 2015, at 08:20, Sean Dague s...@dague.net wrote:

 +1 for moving it earlier.



 On August 19, 2015 6:17:06 AM PDT, Anne Gentle 
 annegen...@justwriteclick.com wrote:

 Hi all, 

 In last week's TC Highlights blog post [1] I asked if there is interest in 
 moving the cross-project meeting. Historically it is held after the TC 
 meeting, but there isn't a requirement for those timings to line up. I've 
 heard from European and Eastern Standard Time contributors that it's a 
 tough time to meet half the year. It's also a bit early for APAC, my 
 apologies for noting this but still proposing to meet earlier.

 I'd like to propose a new cross-project meeting time, 1800 Tuesdays. To 
 that end I've created a review with the proposed time:

 https://review.openstack.org/214605 

 Please take a look, see if you think it could work, and let us know either 
 on this list or the review itself.

 Thanks,

 Anne

 1. 
 http://www.openstack.org/blog/2015/08/technical-committee-highlights-august-11-2015/


 --
 Anne Gentle
 Rackspace
 Principal Engineer
 www.justwriteclick.com

 OpenStack Development Mailing List (not for usage questions)
 Unsubscribe: openstack-dev-requ...@lists.openstack.org?subject:unsubscribe
 http://lists.openstack.org/cgi-bin/mailman/listinfo/openstack-dev

 -- 
 Sean Dague 
 http://dague.net
 __
 OpenStack Development Mailing List (not for usage questions)
 Unsubscribe: openstack-dev-requ...@lists.openstack.org?subject:unsubscribe
 http://lists.openstack.org/cgi-bin/mailman/listinfo/openstack-dev
 
 
 
 __
 OpenStack Development Mailing List (not for usage questions)
 Unsubscribe: openstack-dev-requ...@lists.openstack.org?subject:unsubscribe
 http://lists.openstack.org/cgi-bin/mailman/listinfo/openstack-dev
 


- -- 
Lana Brindley
Technical Writer
Rackspace Cloud Builders Australia
http://lanabrindley.com
-BEGIN PGP SIGNATURE-
Version: GnuPG v1

iQEcBAEBAgAGBQJV1QFZAAoJELppzVb4+KUyAysIAKIbbgv9q2PGOMyHYMM4rzen
U1MNUJsFJ+zeXkLedRQYOTYOGEtevLph/3DuPku4BdoyjvDSRc6O5GsWI371SjSw
+6CLtImy4qKyPbEVt1O6hKArjDQDzjv2y/VJUcumm9/5J/k144QLxYebYwXpMKdw
o0bYL1bjtVAMInTegodywdGA4zIcc5lQ6XDbgJOfhI9rs/D1nol0w9sOe7WS7puK
cGxh3fiH9pJFlXmkEyL3kXqZ6plVgTEHTeoV5/T8IEBH72QpsdwTqn74f0pllW6r
6mwhUK+MeP3Omk8QgNNDOvA9DOCPUZSfgnYFEgAeG4zFCBWn6nH6MYu+ykIBwEg=
=qTHO
-END PGP SIGNATURE-

__
OpenStack Development Mailing List (not for usage questions)
Unsubscribe: openstack-dev-requ...@lists.openstack.org?subject:unsubscribe
http://lists.openstack.org/cgi-bin/mailman/listinfo/openstack-dev


Re: [openstack-dev] [Fuel][MOS][Bootstrap] Please try Ubuntu bootstrap in MOS 7.0

2015-08-19 Thread Mike Scherbakov
Mikhail,
thanks for the update. I'm glad that we have an agreement here, and
collaborative decision have been made not to enable something in 7.0 which
is proven to be not yet production ready, such late in the release cycle.
I'm all for completing this work in 8.0 though.

Can you please:
- provide an answer on UX, question which I asked in separate email in this
same thread
- don't even mention MOS going further (neither in subject nor in email),
as we are discussing and working with Fuel code here

Thank you,

On Wed, Aug 19, 2015 at 10:20 AM Mikhail Semenov mseme...@mirantis.com
wrote:

 As we considered today, Ubuntu bootstrap will not be shipped in MOS 7.0.
 It was a hard decision based on the issue with NICs naming [1].
 This bug can be fixed only by changing the naming of network interfaces(
 http://www.freedesktop.org/wiki/Software/systemd/PredictableNetworkInterfaceNames/)
 and it's too late to do it in MOS 7.0 scope.
 So, this feature is moved to MOS 8.0.

 [1] https://bugs.launchpad.net/mos/+bug/1482049

 --
 Thanks,
 Michael

 On Thu, Aug 13, 2015 at 6:30 PM, Mikhail Semenov mseme...@mirantis.com
 wrote:

 Hi all,

 We have new feature in the upcoming release MOS 7.0 - Ubuntu-based
 bootstrap in addition to current CentOS-based one. Design spec can be found
 here https://review.openstack.org/#/c/194154/.

 Current 7.0 ISO contains 2 bootstrap images: CentOS-based (default) and
 Ubuntu-based. You can easily switch to Ubuntu-based bootstrap using this
 steps:
 1. Make sure the master node can access Ubuntu (
 http://archive.ubuntu.com/ubuntu) and MOS (
 http://mirror.fuel-infra.org/mos-repos) APT repositories.
 2. Run the following command on the master node:
 *fuel-bootstrap-image-set ubuntu*
 3. Just in a case restart dnsmasq:
 *dockerctl shell cobbler service dnsmasq restart*
 4. Reboot the slave nodes.

 There are only 2 weeks left for testing. On 08/27 we will make a decision
 about using Ubuntu bootstrap by default in MOS 7.0. It depends on the test
 results and statistics(more deployments - more confidence).

 I want to ask everyone to try new Ubuntu bootstrap. Please, deploy it on
 your environments and file bugs in case of failures. It's most important
 for *partners* *and* *plugin developers*. Feel free to contact Alexei
 Sheplyakov(feature lead) and me in case of questions.

 --
 Thanks,
 Michael




 --
 Thanks,
 Michael
 __
 OpenStack Development Mailing List (not for usage questions)
 Unsubscribe: openstack-dev-requ...@lists.openstack.org?subject:unsubscribe
 http://lists.openstack.org/cgi-bin/mailman/listinfo/openstack-dev

-- 
Mike Scherbakov
#mihgen
__
OpenStack Development Mailing List (not for usage questions)
Unsubscribe: openstack-dev-requ...@lists.openstack.org?subject:unsubscribe
http://lists.openstack.org/cgi-bin/mailman/listinfo/openstack-dev


Re: [openstack-dev] [Neutron] Etherpad from the Ops Meetup

2015-08-19 Thread Salvatore Orlando
The etherpad contains some complaints around DVR implementation that might
deserve furhter exploration.
However, as pointed out by Jay, the comments made leave very little room
for actionable items.
It would be great if the author(s) could fill in with more details.

Salvatore

On 19 August 2015 at 23:11, Ryan Moats rmo...@us.ibm.com wrote:

 One thing came up during lunch was including unit and functional testing
 of dual stack in the check and gate queues - I was regaled over lunch with
 one operator's experiences in trying to run Neutron on a dual stack system.

 Ryan Moats (regXboi)

 Edgar Magana edgar.mag...@workday.com wrote on 08/19/2015 03:43:44 PM:

  From: Edgar Magana edgar.mag...@workday.com
  To: OpenStack Development Mailing List (not for usage questions)
  openstack-dev@lists.openstack.org
  Date: 08/19/2015 03:44 PM

  Subject: Re: [openstack-dev] [Neutron] Etherpad from the Ops Meetup
 
  Actually, there were very few requirements collected. So, your
  summary is correct.
 
  I feel that this time we did not get a lot of input s we got during
  the Ops meet-up in Philadelphia.
 
  I also recommend to read the burning issues ether pads, there are
  few suggestions on the networking side. Actually, I believe
  Operators has expressed in this session some good feedback that they
  probaly did not want to repeat during the networking section.
 
  https://etherpad.openstack.org/p/PAO-ops-burning-issues
 
  Cheers,
 
  Edgar
 
  From: Assaf Muller
  Reply-To: OpenStack Development Mailing List (not for usage questions)
  Date: Wednesday, August 19, 2015 at 1:34 PM
  To: OpenStack Development Mailing List (not for usage questions)
  Subject: Re: [openstack-dev] [Neutron] Etherpad from the Ops Meetup
 
  On Wed, Aug 19, 2015 at 2:52 PM, Edgar Magana edgar.mag...@workday.com
   wrote:
  Folks,
 
  I just want to share with you the feedback collected today during
  the networking session on Ops Meet-up:
  https://etherpad.openstack.org/p/PAO-ops-network-model
 
  Special thanks to Ryan and Doug for helping on some questions.
 
  The only action items for Neutron developers that I can spot are:
  1. Linux bridge + DVR / multi host
  2. Prevent data loss when restarting the OVS agent (The patch [1] is
  very close to merge anyway, nothing more to do here)
  3. Work as described by [2] (Big deployers team)
  The rest is either polling (Who uses what feature / plugin / etc) or
  generic comments with no actionable bugs or RFEs.
  Did I miss anything?
 
  [1] https://review.openstack.org/#/c/182920/
  [2] https://etherpad.openstack.org/p/Network_Segmentation_Usecases
 
  Cheers,
 
  Edgar
 
 
 __
  OpenStack Development Mailing List (not for usage questions)
  Unsubscribe:
 openstack-dev-requ...@lists.openstack.org?subject:unsubscribe
  http://lists.openstack.org/cgi-bin/mailman/listinfo/openstack-dev

 
 __
  OpenStack Development Mailing List (not for usage questions)
  Unsubscribe:
 openstack-dev-requ...@lists.openstack.org?subject:unsubscribe
  http://lists.openstack.org/cgi-bin/mailman/listinfo/openstack-dev


 __
 OpenStack Development Mailing List (not for usage questions)
 Unsubscribe: openstack-dev-requ...@lists.openstack.org?subject:unsubscribe
 http://lists.openstack.org/cgi-bin/mailman/listinfo/openstack-dev


__
OpenStack Development Mailing List (not for usage questions)
Unsubscribe: openstack-dev-requ...@lists.openstack.org?subject:unsubscribe
http://lists.openstack.org/cgi-bin/mailman/listinfo/openstack-dev


Re: [openstack-dev] [Neutron] Kuryr - virtual sprint

2015-08-19 Thread Salvatore Orlando
Hi Gal,

even if I've been a lurker so far, I'm interested in attending for learning
and contributing to it with my massive bug-injecting skills!

You said virtual sprint and somewhere in september - I think
somewhere refers to dates?
Anyway I am pretty much open to any date from September 7th onwards.

Salvatore


On 19 August 2015 at 19:57, Gal Sagie gal.sa...@gmail.com wrote:

 Hello everyone,

 During our last meeting an idea was brought up that we try to do a virtual
 sprint
 for Kuryr somewhere in September.

 Basically the plan is very similar to the mid cycle sprints or feature
 sprints where
 we iterate on couple of tasks online and finish gaps we might have in
 Kuryr.
 (I think we are talking about 2-3 days)

 The agenda for the sprint is dependent on the amount of work we finish by
 then,
 but it will probably consist of containerising some of the common plugins
 and connecting
 things end to end. (for host networking)

 I started this email in order to find the best dates for it, so if you
 plan on participating
 please share your preferred dates (anyone that has a Neutron plugin might
 want to offer a containerised version of it with Kuryr to integrate with
 Docker and lib network and the sprint
 is probably a good place to start doing it)

 Thanks
 Gal.

 __
 OpenStack Development Mailing List (not for usage questions)
 Unsubscribe: openstack-dev-requ...@lists.openstack.org?subject:unsubscribe
 http://lists.openstack.org/cgi-bin/mailman/listinfo/openstack-dev


__
OpenStack Development Mailing List (not for usage questions)
Unsubscribe: openstack-dev-requ...@lists.openstack.org?subject:unsubscribe
http://lists.openstack.org/cgi-bin/mailman/listinfo/openstack-dev


Re: [openstack-dev] [openstack-ansible][keystone] Federation beyond Shibboleth

2015-08-19 Thread Adam Young

On 08/19/2015 04:23 AM, Jesse Pretorius wrote:


On 12 August 2015 at 18:48, Adam Young ayo...@redhat.com 
mailto:ayo...@redhat.com wrote:



The simplest one is Kerberos + SSSD;

Kerberos provides Authentication.
mod_lookup_identity uses SSSD to get Groups.  It turns LDAP into
another  Federated identity, much simpler than the LDAP code in
Keystone (I am responsible for that mess).

We are working on automating this via Ansible on top of a
RHEL/Centos 7 install to demo in Tokyo.

I am not certain if all the pieces are in place yet for Debian
based install.  Specifically, it needs an updated sssd-dbus package.

We also have mod_mellon and Ipsilon working, as Jamie demo'ed at
Pycon AU.


Sounds great!

Would you be prepared to put together some WIP reviews to add those to 
the Keystone role in openstack-ansible? Even if they're non-working 
sketches that we can work from and iterate on, that'd be great.


Our sample code is here:

https://github.com/jamielennox/rippowam



I wrote up a README for what we are doing:

https://github.com/admiyo/rippowam/blob/master/README.rst


The stuff you care about is here:

Setting up SSSD
https://github.com/jamielennox/rippowam/blob/master/roles/packstack/tasks/infopipe.yml

And 
https://github.com/jamielennox/rippowam/blob/master/roles/packstack/tasks/keystone-sssd.yml





Note that we're looking at implementing some changes to broaden the 
platform support too. We're moving some of the pieces into place for 
the liberty [1] release and I'll be putting my thoughts down on 
multi-platform host enablement [2] soon. Also, considering that it'd 
be easier to comprehend, consume and iterate the ansible roles if they 
were independent consumable units I've also proposed [3][4] to break 
them out into their own repositories. It'd be great if you could 
provide your input.


[1] https://blueprints.launchpad.net/openstack-ansible/+spec/liberty
[2] 
https://blueprints.launchpad.net/openstack-ansible/+spec/multi-platform-host
[3] 
https://blueprints.launchpad.net/openstack-ansible/+spec/independent-role-repositories

[4] https://review.openstack.org/213779



__
OpenStack Development Mailing List (not for usage questions)
Unsubscribe: openstack-dev-requ...@lists.openstack.org?subject:unsubscribe
http://lists.openstack.org/cgi-bin/mailman/listinfo/openstack-dev


__
OpenStack Development Mailing List (not for usage questions)
Unsubscribe: openstack-dev-requ...@lists.openstack.org?subject:unsubscribe
http://lists.openstack.org/cgi-bin/mailman/listinfo/openstack-dev


Re: [openstack-dev] [Neutron] Etherpad from the Ops Meetup

2015-08-19 Thread Doug Wiegley
To expand on that a bit, I think the DVR complaints were vague because of the 
simple fact that the overwhelming majority were or wanted to run linuxbridge, 
not OVS, so DVR was a theoretical thing for them.

doug

 On Aug 19, 2015, at 2:21 PM, Salvatore Orlando salv.orla...@gmail.com wrote:
 
 The etherpad contains some complaints around DVR implementation that might 
 deserve furhter exploration.
 However, as pointed out by Jay, the comments made leave very little room for 
 actionable items.
 It would be great if the author(s) could fill in with more details.
 
 Salvatore
 
 On 19 August 2015 at 23:11, Ryan Moats rmo...@us.ibm.com 
 mailto:rmo...@us.ibm.com wrote:
 One thing came up during lunch was including unit and functional testing of 
 dual stack in the check and gate queues - I was regaled over lunch with one 
 operator's experiences in trying to run Neutron on a dual stack system.
 
 Ryan Moats (regXboi)
 
 Edgar Magana edgar.mag...@workday.com mailto:edgar.mag...@workday.com 
 wrote on 08/19/2015 03:43:44 PM:
 
  From: Edgar Magana edgar.mag...@workday.com 
  mailto:edgar.mag...@workday.com
  To: OpenStack Development Mailing List (not for usage questions) 
  openstack-dev@lists.openstack.org 
  mailto:openstack-dev@lists.openstack.org
  Date: 08/19/2015 03:44 PM
 
 
  Subject: Re: [openstack-dev] [Neutron] Etherpad from the Ops Meetup
  
  Actually, there were very few requirements collected. So, your 
  summary is correct.
  
  I feel that this time we did not get a lot of input s we got during 
  the Ops meet-up in Philadelphia.
  
  I also recommend to read the burning issues ether pads, there are 
  few suggestions on the networking side. Actually, I believe 
  Operators has expressed in this session some good feedback that they
  probaly did not want to repeat during the networking section.
  
  https://etherpad.openstack.org/p/PAO-ops-burning-issues 
  https://etherpad.openstack.org/p/PAO-ops-burning-issues
  
  Cheers,
  
  Edgar
  
  From: Assaf Muller
  Reply-To: OpenStack Development Mailing List (not for usage questions)
  Date: Wednesday, August 19, 2015 at 1:34 PM
  To: OpenStack Development Mailing List (not for usage questions)
  Subject: Re: [openstack-dev] [Neutron] Etherpad from the Ops Meetup
  
  On Wed, Aug 19, 2015 at 2:52 PM, Edgar Magana edgar.mag...@workday.com 
  mailto:edgar.mag...@workday.com
   wrote:
  Folks,
  
  I just want to share with you the feedback collected today during 
  the networking session on Ops Meet-up:
  https://etherpad.openstack.org/p/PAO-ops-network-model 
  https://etherpad.openstack.org/p/PAO-ops-network-model
  
  Special thanks to Ryan and Doug for helping on some questions.
  
  The only action items for Neutron developers that I can spot are:
  1. Linux bridge + DVR / multi host
  2. Prevent data loss when restarting the OVS agent (The patch [1] is
  very close to merge anyway, nothing more to do here)
  3. Work as described by [2] (Big deployers team)
  The rest is either polling (Who uses what feature / plugin / etc) or
  generic comments with no actionable bugs or RFEs.
  Did I miss anything?
  
  [1] https://review.openstack.org/#/c/182920/ 
  https://review.openstack.org/#/c/182920/
  [2] https://etherpad.openstack.org/p/Network_Segmentation_Usecases 
  https://etherpad.openstack.org/p/Network_Segmentation_Usecases
  
  Cheers,
  
  Edgar
  
  __
  OpenStack Development Mailing List (not for usage questions)
  Unsubscribe: openstack-dev-requ...@lists.openstack.org?subject:unsubscribe 
  http://openstack-dev-requ...@lists.openstack.org/?subject:unsubscribe
  http://lists.openstack.org/cgi-bin/mailman/listinfo/openstack-dev 
  http://lists.openstack.org/cgi-bin/mailman/listinfo/openstack-dev
 
  __
  OpenStack Development Mailing List (not for usage questions)
  Unsubscribe: openstack-dev-requ...@lists.openstack.org?subject:unsubscribe 
  http://openstack-dev-requ...@lists.openstack.org/?subject:unsubscribe
  http://lists.openstack.org/cgi-bin/mailman/listinfo/openstack-dev 
  http://lists.openstack.org/cgi-bin/mailman/listinfo/openstack-dev
 
 
 
 __
 OpenStack Development Mailing List (not for usage questions)
 Unsubscribe: openstack-dev-requ...@lists.openstack.org?subject:unsubscribe 
 http://openstack-dev-requ...@lists.openstack.org/?subject:unsubscribe
 http://lists.openstack.org/cgi-bin/mailman/listinfo/openstack-dev 
 http://lists.openstack.org/cgi-bin/mailman/listinfo/openstack-dev
 
 
 __
 OpenStack Development Mailing List (not for usage questions)
 Unsubscribe: openstack-dev-requ...@lists.openstack.org?subject:unsubscribe
 http://lists.openstack.org/cgi-bin/mailman/listinfo/openstack-dev


Re: [openstack-dev] [Horizon] Update on Angular Identity work

2015-08-19 Thread Lin Hua Cheng
Hi Thai,

Thanks for investigating the two options.

Option 2 might be better. Folks have to learn the new pattern of writing
multiple files, so I think the learning curve for a new table directive is
not that much of a difference.

I think option 2 is going to be easier to maintain, since we have a layer
of abstraction. It might even also increase adoptability since it would be
easier to use.  It might be harder to customize, but that would probably
not be done often.  The table directive would be used as is most of the
time.

My thought is design the code to be easy to use for the use case that will
be used most of the time rather than the customization case  which maybe
harder to do. Which leads me to preferring option 2.

Thanks,
Lin

On Wed, Aug 19, 2015 at 12:16 PM, Thai Q Tran tqt...@us.ibm.com wrote:

 Hi Lin,

 I agree with you and Eric that we have a lot of HTML fragments. Some of
 them I think make sense as directives:
 The table footer is a good example of something we can convert into a
 directive: https://review.openstack.org/#/c/207631/
 The table header on the other hand is something more specific to your
 table:
 https://github.com/openstack/horizon/blob/master/openstack_dashboard/dashboards/identity/static/dashboard/identity/users/table/table-header.html

 So there are two approaches we can take here:
 1. Keep some of the presentation related data in the HTML: mainly things
 like table headers, column definitions, translated texts, etc... I like
 this approach a bit more because it allow us to read the HTML and know
 exactly what we are expecting to see. This table.html is compose of smaller
 directives like hz-table-footer and regular html tags like th and td
 etc... I think as we have more of these smaller directives available, we
 can combine the fragments into one file.

 2. We could create a more general table directive with a common template.
 This is more inline with what we have currently for legacy. BUT the
 presentation logic like translations, definitions would now have to reside
 in the table controller AND we lose the semantic readability part. Doing it
 this way could potentially introduce more complexity as it now requires
 people to learn the table directive, which could be very complex if it does
 not use smaller directives. Another common problem we encountered with this
 pattern was a lack of customization. In legacy, it was pretty hard to add
 an icon into a table cell. If we go down this route, I believe we might
 start to encounter the same issues.

 In summary, we are working on addressing the HTML fragments, but I think
 we as a community should go with option 1 and stay away from option 2.

 -Lin Hua Cheng os.lch...@gmail.com wrote: -
 To: OpenStack Development Mailing List (not for usage questions) 
 openstack-dev@lists.openstack.org
 From: Lin Hua Cheng os.lch...@gmail.com
 Date: 08/18/2015 02:36PM
 Cc: Vince Brunssen/Austin/IBM@IBMUS
 Subject: Re: [openstack-dev] [Horizon] Update on Angular Identity work


 I think the table setup pattern have some opportunity for reducing code
 duplication before it gets re-used by other panels..

 We used to just need to write one file to define a table, now we have to
 write 9 files [1].  Can we have a table directive to reduce the duplicated
 code before moving forward to other panels?

 -Lin

 [1]
 https://github.com/openstack/horizon/tree/master/openstack_dashboard/dashboards/identity/static/dashboard/identity/users/table

 On Tue, Aug 18, 2015 at 11:49 AM, Thai Q Tran tqt...@us.ibm.com wrote:

 Hi everyone,

 Just wanted to keep everyone up to date on the angular panels work. The
 goal was to set a pattern that others can follow, to that end, there were a
 few requirements:
 1. reusable and possibly pluggable
 2. easy to understand
 3. reduce code duplication

 These requirements don't always go hand-in-hand, and that is the primary
 reason why it is taking a bit longer. I believe we are nearing the end of
 it, here are some items remaining that I believe is crucial to finishing up
 this work.

 a. i18n was completed, so we need help moving gettext blobs to HTML
 templates (example patch: https://review.openstack.org/#/c/210366/ )
 volunteers are welcomed! We want others to use the translate directive as
 the main way to translate text blobs, this was why we went down this road
 using babel and angular_extractor plugin.

 b. transfer table supports clone feature (
 https://review.openstack.org/#/c/211345/ ). There were a lot of template
 duplications, this clone feature reduces the HTML by a considerable amount.
 Since this is something we use quite often, it made sense to invest time
 into improving it. We have had complaints that there was too much HTML
 fragments, this will address a bit of that. One of the challenge was to get
 it working with existing launch-instance, so I spent about 2 weeks making
 sure it worked well with the old code while allowing the new clone feature.

 c. I believe we have a pretty 

Re: [openstack-dev] [packaging] asks from the ops meetup

2015-08-19 Thread Ian Cordasco
Questions in-line, but I'd appreciate a better summary

On 8/19/15, 17:50, Matthew Thode prometheanf...@gentoo.org wrote:

I'll start by giving this out, but I'll also summarize the asks we had
from upstream.

https://etherpad.openstack.org/p/PAO-ops-packaging


General services:
  - gate check on example config and doc generation
- was mentioned this has broken in the past and taken a while to fix

The etherpad doesn't have much on this topic, could you (or someone else
from the mid-cycle) expound on this?

  - document dependencies needed for config/doc generation
- (not all of test requirements)

So you want a doc-requirements.txt file? That doesn't have other libraries
other than the documentation related ones?

  - generated example configs generated and stored in an automated way
- (in lieu of packagers generating the configs dynamically)

Don't most projects already do this?

  - A place to look for files that go in /etc

Again, don't most projects have an etc/ directory inside of them?

  - Publish pip-freeze at the end

At the end of what?

  - Don't strip out files in the repo when publishing to pip

No services are published to PyPI. What is this about?

  - Publish an example init-script (systemd)

This seems reasonable

- I think this might be going away with wsgi

What?

Docs:
  - nginx wsgi examples

Is nginx even supported in any of the services? If so, are we already
gating on that?

__
OpenStack Development Mailing List (not for usage questions)
Unsubscribe: openstack-dev-requ...@lists.openstack.org?subject:unsubscribe
http://lists.openstack.org/cgi-bin/mailman/listinfo/openstack-dev


Re: [openstack-dev] [nova] contextlib.nested and Python3 failing

2015-08-19 Thread Davanum Srinivas
haha :)

-- dims

On Wed, Aug 19, 2015 at 7:59 PM, Sylvain Bauza sba...@redhat.com wrote:



 Le 19/08/2015 16:51, Sylvain Bauza a écrit :

 Hi,

 I was writing some tests so I added a contextlib.nested to a checked
 TestCase [1]. Unfortunately, contextlib.nested is no longer available in
 Python3 and there is no clear solution on how to provide a compatible
 import for both python2 and python3:
  - either providing a python3 compatible behaviour by using
 contextlib.ExitStack but that class is not available in Python 2
  - or provide contextlib2 for python2 (and thus adding it to the
 requirements)

 That sounds really disruptive and blocking as we are close to the
 FeatureFreeze. Many other users of contextlib.nested are not impacted by
 the job because it excludes all of them but since the test I'm changing is
 part of the existing validated tests, that leaves Jenkins -1'ing my change.

 Of course, a 3rd solution would consist of excluding my updated test from
 the python3 check but I can hear others yelling at that :-)

 Ideas appreciated.


 So, I just saw there is actually already a solution for that here:
 https://github.com/openstack/nova/blob/master/nova/test.py#L72-L78

 beer_count['dims']++

 Thanks,


 -Sylvain

 [1]
 https://review.openstack.org/#/c/199205/18/nova/tests/unit/scheduler/test_rpcapi.py,cm


 __

 OpenStack Development Mailing List (not for usage questions)
 Unsubscribe:
 openstack-dev-requ...@lists.openstack.org?subject:unsubscribe
 http://lists.openstack.org/cgi-bin/mailman/listinfo/openstack-dev



 __
 OpenStack Development Mailing List (not for usage questions)
 Unsubscribe: openstack-dev-requ...@lists.openstack.org?subject:unsubscribe
 http://lists.openstack.org/cgi-bin/mailman/listinfo/openstack-dev




-- 
Davanum Srinivas :: https://twitter.com/dims
__
OpenStack Development Mailing List (not for usage questions)
Unsubscribe: openstack-dev-requ...@lists.openstack.org?subject:unsubscribe
http://lists.openstack.org/cgi-bin/mailman/listinfo/openstack-dev


[openstack-dev] [nova][cinder] Extending attached disks

2015-08-19 Thread Taylor . Bertie
Hi everyone,In my current pre-production deployment we were looking for a method to live extend attached volumes to an instance. This was one of the requirements for deployment. I've worked with libvirt hypervisors before so it didn't take long to find a workable solution. However I'm not sure how transferable this will be across deployment models. Our deployment model is using libvirt for nova and ceph for backend storage. This means obviously libvirt is using rdb to connect to volumes.Currently the method I use is:- Force cinder to run an extend operation.- Tell Libvirt that the attached disk has been extended.It would be worth discussing if this can be ported to upstream such that the API can handle the leg work, rather than this current manual method.Detailed instructions.You will need: volume-id of volume you want to resize, hypervisor_hostname and instance_name from instance volume is attached to.Example: extending volumef9fa66ab-b29a-40f6-b4f4-e9c64a155738 attached to instance-0012 on node-6 to 100GB$ cinder reset-state --state availablef9fa66ab-b29a-40f6-b4f4-e9c64a155738$ cinder extendf9fa66ab-b29a-40f6-b4f4-e9c64a155738 100$ cinder reset-state --state in-usef9fa66ab-b29a-40f6-b4f4-e9c64a155738$ssh node-6node-6$ virsh qemu-monitor-command instance-0012 --hmp "info block" | grep f9fa66ab-b29a-40f6-b4f4-e9c64a155738drive-virtio-disk1: removable=0 io-status=ok file=rbd:volumes-slow/volume-f9fa66ab-b29a-40f6-b4f4-e9c64a155738:id=cinder:key=keyhere==:auth_supported=cephx\\;none:mon_host=10.1.226.64\\:6789\\;10.1.226.65\\:6789\\;10.1.226.66\\:6789 ro=0 drv=raw encrypted=0 bps=0 bps_rd=0 bps_wr=0 iops=0 iops_rd=0 iops_wr=0This will get you the disk-id, which in this case is drive-virtio-disk1.node-6$virsh qemu-monitor-command instance-0012 --hmp "block_resize drive-virtio-disk1 100G"Finally, you need to perform a drive rescan on the actual instance and resize and extend thefile-system. This will be OS specific.I've tested this a few times and it seems very reliable.Taylor BertieEnterprise Support Infrastructure EngineerMobile +64 27 952 3949Phone +64 4 462 5030Email taylor.ber...@solnet.co.nzSolnet Solutions LimitedLevel 12, Solnet House70 The Terrace, Wellington 6011PO Box 397, Wellington 6140www.solnet.co.nzAttention:
This email may contain information intended for the sole use of
the original recipient. Please respect this when sharing or
disclosing this email's contents with any third party. If you
believe you have received this email in error, please delete it
and notify the sender or postmas...@solnetsolutions.co.nz as
soon as possible. The content of this email does not necessarily
reflect the views of Solnet Solutions Ltd.


__
OpenStack Development Mailing List (not for usage questions)
Unsubscribe: openstack-dev-requ...@lists.openstack.org?subject:unsubscribe
http://lists.openstack.org/cgi-bin/mailman/listinfo/openstack-dev


[openstack-dev] [nova][cinder] Extending attached disks

2015-08-19 Thread Taylor . Bertie
Hi everyone,

Apologises for the duplicate send, looks like my mail client doesn't create 
very clean HTML messages. Here is the message in plain-text. I'll make sure to 
send to the list in plain-text from now on.

In my current pre-production deployment we were looking for a method to live 
extend attached volumes to an instance. This was one of the requirements for 
deployment. I've worked with libvirt hypervisors before so it didn't take long 
to find a workable solution. However I'm not sure how transferable this will be 
across deployment models. Our deployment model is using libvirt for nova and 
ceph for backend storage. This means obviously libvirt is using rdb to connect 
to volumes.

Currently the method I use is:

- Force cinder to run an extend operation.
- Tell Libvirt that the attached disk has been extended.

It would be worth discussing if this can be ported to upstream such that the 
API can handle the leg work, rather than this current manual method.

Detailed instructions.
You will need: volume-id of volume you want to resize, hypervisor_hostname and 
instance_name from instance volume is attached to.

Example: extending volume f9fa66ab-b29a-40f6-b4f4-e9c64a155738 attached to 
instance-0012 on node-6 to 100GB

$ cinder reset-state --state available f9fa66ab-b29a-40f6-b4f4-e9c64a155738
$ cinder extend f9fa66ab-b29a-40f6-b4f4-e9c64a155738 100
$ cinder reset-state --state in-use f9fa66ab-b29a-40f6-b4f4-e9c64a155738

$ssh node-6
node-6$ virsh qemu-monitor-command instance-0012 --hmp info block | grep 
f9fa66ab-b29a-40f6-b4f4-e9c64a155738
drive-virtio-disk1: removable=0 io-status=ok 
file=rbd:volumes-slow/volume-f9fa66ab-b29a-40f6-b4f4-e9c64a155738:id=cinder:key=keyhere==:auth_supported=cephx\\;none:mon_host=10.1.226.64\\:6789\\;10.1.226.65\\:6789\\;10.1.226.66\\:6789
 ro=0 drv=raw encrypted=0 bps=0 bps_rd=0 bps_wr=0 iops=0 iops_rd=0 iops_wr=0

This will get you the disk-id, which in this case is drive-virtio-disk1.

node-6$ virsh qemu-monitor-command instance-0012 --hmp block_resize 
drive-virtio-disk1 100G

Finally, you need to perform a drive rescan on the actual instance and resize 
and extend the file-system. This will be OS specific.

I've tested this a few times and it seems very reliable.

Taylor Bertie
Enterprise Support Infrastructure Engineer

Mobile +64 27 952 3949
Phone +64 4 462 5030
Email taylor.ber...@solnet.co.nz

Solnet Solutions Limited
Level 12, Solnet House
70 The Terrace, Wellington 6011
PO Box 397, Wellington 6140

www.solnet.co.nz 

Attention:
This email may contain information intended for the sole use of
the original recipient. Please respect this when sharing or
disclosing this email's contents with any third party. If you
believe you have received this email in error, please delete it
and notify the sender or postmas...@solnetsolutions.co.nz as
soon as possible. The content of this email does not necessarily
reflect the views of Solnet Solutions Ltd.


__
OpenStack Development Mailing List (not for usage questions)
Unsubscribe: openstack-dev-requ...@lists.openstack.org?subject:unsubscribe
http://lists.openstack.org/cgi-bin/mailman/listinfo/openstack-dev


Re: [openstack-dev] [Fuel] Great updates to tests and CI jobs

2015-08-19 Thread Mike Scherbakov
Sounds great. Thank you Roman!
I've heard complains about tests not passing for [1]. Now it's passed, so I
hope that issues are resolved.

[1] https://review.openstack.org/#/c/212906/

On Wed, Aug 19, 2015 at 10:51 AM Sebastian Kalinowski 
skalinow...@mirantis.com wrote:

 Indeed, great news!

 I would only suggest to wait a little bit more that a few days with
 switching
 to the voting mode since it looks like there will be not so many patches
 proposed to python-fuelclient as we are heading towards Hard Code Freeze.

 I hope that the next step will be to enable Python 3 pipepline for our
 client so
 we could finally test all the code that uses six library for Python 2 
 3 compatibility.

 Best,
 Sebastian

 2015-08-19 19:00 GMT+02:00 Boris Pavlovic bpavlo...@mirantis.com:

 Roman,

 well done! ;)

 Best regards,
 Boris Pavlovic

 On Wed, Aug 19, 2015 at 8:38 AM, Roman Prykhodchenko m...@romcheg.me
 wrote:

 Hi folks!

 Today I’m proud to announce that since this moment python-fuelclient has
 it’s own python-jobs in OpenStack CI. Thanks to all of you who helped me
 making Fuel Client compatible with the upstream CI.
 Besides sharing great news I think it’s necessary to share changes we
 had to do, in order to accomplish this result.

 First of all tests were reorganized: now functional and unit tests have
 their own separate folders inside the fuelclient/tests directory. That
 allowed us to distinguish them from both the CI and a developer’s point of
 view, so there will be no mess we used to have.

 The other change we’ve made is deleting run_tests.sh*. It is possible to
 run and manage all the tests via tox which is a de-facto standard in
 OpenStack ecosystem. That also means anyone who is familiar with any of
 OpenStack projects will be able to orchestrate tests without a need to
 learn anything. Tox is preconfigured to run py26, py27, pep8, cover,
 functional, and cleanup environments. py26 and py27 only run unit tests and
 cover also involves calculating coverage. functional fires up Nailgun and
 launches functional tests. cleanup stops Nailgun, deletes its DB and any
 files left after functional tests and what you will definitely like —
 cleans up all *.pyc files. By default tox executes environments in the
 following order: py26-py27-pep8-functional-cleanup.

 Minimal tox was updated to 2.1 which guarantees no external environment
 variable is passed to tests.

 The jobs on OpenStack CI are set to be non-voting for a few days to give
 it a better try. On the next week we will switch them to voting. At the
 same time we will remove unit tests from FuelCI to not waste extra time.


 * Technically it is kept in place to keep compatibility with FuelCI but
 it only invokes tox from inside. It will be removed later, when it’s time
 to switch off unit tests on FuelCI.


 - romcheg


 __
 OpenStack Development Mailing List (not for usage questions)
 Unsubscribe:
 openstack-dev-requ...@lists.openstack.org?subject:unsubscribe
 http://lists.openstack.org/cgi-bin/mailman/listinfo/openstack-dev



 __
 OpenStack Development Mailing List (not for usage questions)
 Unsubscribe:
 openstack-dev-requ...@lists.openstack.org?subject:unsubscribe
 http://lists.openstack.org/cgi-bin/mailman/listinfo/openstack-dev


 __
 OpenStack Development Mailing List (not for usage questions)
 Unsubscribe: openstack-dev-requ...@lists.openstack.org?subject:unsubscribe
 http://lists.openstack.org/cgi-bin/mailman/listinfo/openstack-dev

-- 
Mike Scherbakov
#mihgen
__
OpenStack Development Mailing List (not for usage questions)
Unsubscribe: openstack-dev-requ...@lists.openstack.org?subject:unsubscribe
http://lists.openstack.org/cgi-bin/mailman/listinfo/openstack-dev


Re: [openstack-dev] [fuel] Gerrit dashboard update: ready for core reviewers, disagreements

2015-08-19 Thread Mike Scherbakov
Thank you Dmitry,
everyone can now open review inbox following [1]. Full link was also
updated by Dmitry on main Fuel wiki page.

[1] http://bit.ly/1LjYO4t

On Wed, Aug 12, 2015 at 8:53 PM Cameron Seader cameron.sea...@suse.com
wrote:

 test

 On 08/12/2015 07:16 PM, Dmitry Borodaenko wrote:
  Fuelers,
 
  I've proposed an update for the Fuel gerrit dashboard:
  https://review.openstack.org/212231
 
  New Ready for Core Reviewers section encourages peer review by
  non-cores and allows cores to focus on reviews that already have +1
  from other reviews and from CI.
 
  New Disagreements section highlights reviews that have both positive
  and negative code review votes. This worked out pretty well for Puppet
  OpenStack, lets try to use it in Fuel, too.
 
  The remaining sections are rearranged to exclude commits that match
  the two new sections.
 
  --
  Dmitry Borodaenko
 
 
 
 __
  OpenStack Development Mailing List (not for usage questions)
  Unsubscribe:
 openstack-dev-requ...@lists.openstack.org?subject:unsubscribe
  http://lists.openstack.org/cgi-bin/mailman/listinfo/openstack-dev

 --
 Cameron Seader
 Systems Engineer
 SUSE
 c...@suse.com
 (w)208-572-0095
 (M)208-420-2167

 Register for SUSECon 2015
 www.susecon.com


 __
 OpenStack Development Mailing List (not for usage questions)
 Unsubscribe: openstack-dev-requ...@lists.openstack.org?subject:unsubscribe
 http://lists.openstack.org/cgi-bin/mailman/listinfo/openstack-dev

-- 
Mike Scherbakov
#mihgen
__
OpenStack Development Mailing List (not for usage questions)
Unsubscribe: openstack-dev-requ...@lists.openstack.org?subject:unsubscribe
http://lists.openstack.org/cgi-bin/mailman/listinfo/openstack-dev


Re: [openstack-dev] [packaging] asks from the ops meetup

2015-08-19 Thread Matthew Thode
On 08/19/2015 07:22 PM, Ian Cordasco wrote:
 Questions in-line, but I'd appreciate a better summary
 
 On 8/19/15, 17:50, Matthew Thode prometheanf...@gentoo.org wrote:
 
 I'll start by giving this out, but I'll also summarize the asks we had
from upstream.

 https://etherpad.openstack.org/p/PAO-ops-packaging


 General services:
  - gate check on example config and doc generation
- was mentioned this has broken in the past and taken a while to fix
 
 The etherpad doesn't have much on this topic, could you (or someone else
 from the mid-cycle) expound on this?

Not sure, wasn't the one that brought it up, but a specific check on
config/doc generation did seem like a good idea.

 
  - document dependencies needed for config/doc generation
- (not all of test requirements)
 
 So you want a doc-requirements.txt file? That doesn't have other libraries
 other than the documentation related ones?
 

Yes, though I think this may cover example config generation as well.

  - generated example configs generated and stored in an automated way
- (in lieu of packagers generating the configs dynamically)
 
 Don't most projects already do this?

iirc neutron at least does not

 
  - A place to look for files that go in /etc
 
 Again, don't most projects have an etc/ directory inside of them?

yes, though files have been removed in favor of dynamic generation.  The
more specific ask was for this to be auto generated and updated, which
we don't see as being done (could be wrong)

 
  - Publish pip-freeze at the end
 
 At the end of what?

of a test/gerrit run

 
  - Don't strip out files in the repo when publishing to pip
 
 No services are published to PyPI. What is this about?

Think this is more the bash autocomplete stuff

 
  - Publish an example init-script (systemd)
 
 This seems reasonable
 
- I think this might be going away with wsgi
 
 What?

the init scripts may be going away because of wsgi, it's be in apache or
nginx or whatever

 
 Docs:
  - nginx wsgi examples
 
 Is nginx even supported in any of the services? If so, are we already
 gating on that?
 
The docs give example configs for apache mod_wsgi, this was an ask for
similiar with nginx.

-- 
-- Matthew Thode (prometheanfire)



signature.asc
Description: OpenPGP digital signature
__
OpenStack Development Mailing List (not for usage questions)
Unsubscribe: openstack-dev-requ...@lists.openstack.org?subject:unsubscribe
http://lists.openstack.org/cgi-bin/mailman/listinfo/openstack-dev


Re: [openstack-dev] [nova] contextlib.nested and Python3 failing

2015-08-19 Thread melanie witt
On Aug 19, 2015, at 16:51, Sylvain Bauza sba...@redhat.com wrote:

 Ideas appreciated.

Instead of using the nested context managers, a way I like is to decorate a 
nested function in the test and call it, for example:


def test_thing(self):

@mock.patch(...)
@mock.patch(...)
@mock.patch(...)
def do_test(..., ..., ...):
...

do_test()



-melanie (irc: melwitt)







signature.asc
Description: Message signed with OpenPGP using GPGMail
__
OpenStack Development Mailing List (not for usage questions)
Unsubscribe: openstack-dev-requ...@lists.openstack.org?subject:unsubscribe
http://lists.openstack.org/cgi-bin/mailman/listinfo/openstack-dev


Re: [openstack-dev] [nova][cinder] Extending attached disks

2015-08-19 Thread John Griffith
On Wed, Aug 19, 2015 at 7:48 PM, taylor.ber...@solnet.co.nz wrote:

 Hi everyone,

 Apologises for the duplicate send, looks like my mail client doesn't
 create very clean HTML messages. Here is the message in plain-text. I'll
 make sure to send to the list in plain-text from now on.

 In my current pre-production deployment we were looking for a method to
 live extend attached volumes to an instance. This was one of the
 requirements for deployment. I've worked with libvirt hypervisors before so
 it didn't take long to find a workable solution. However I'm not sure how
 transferable this will be across deployment models. Our deployment model is
 using libvirt for nova and ceph for backend storage. This means obviously
 libvirt is using rdb to connect to volumes.

 Currently the method I use is:

 - Force cinder to run an extend operation.
 - Tell Libvirt that the attached disk has been extended.

 It would be worth discussing if this can be ported to upstream such that
 the API can handle the leg work, rather than this current manual method.

 Detailed instructions.
 You will need: volume-id of volume you want to resize, hypervisor_hostname
 and instance_name from instance volume is attached to.

 Example: extending volume f9fa66ab-b29a-40f6-b4f4-e9c64a155738 attached to
 instance-0012 on node-6 to 100GB

 $ cinder reset-state --state available f9fa66ab-b29a-40f6-b4f4-e9c64a155738
 $ cinder extend f9fa66ab-b29a-40f6-b4f4-e9c64a155738 100
 $ cinder reset-state --state in-use f9fa66ab-b29a-40f6-b4f4-e9c64a155738

 $ssh node-6
 node-6$ virsh qemu-monitor-command instance-0012 --hmp info block |
 grep f9fa66ab-b29a-40f6-b4f4-e9c64a155738
 drive-virtio-disk1: removable=0 io-status=ok
 file=rbd:volumes-slow/volume-f9fa66ab-b29a-40f6-b4f4-e9c64a155738:id=cinder:key=keyhere==:auth_supported=cephx\\;none:mon_host=10.1.226.64\\:6789\\;10.1.226.65\\:6789\\;10.1.226.66\\:6789
 ro=0 drv=raw encrypted=0 bps=0 bps_rd=0 bps_wr=0 iops=0 iops_rd=0 iops_wr=0

 This will get you the disk-id, which in this case is drive-virtio-disk1.

 node-6$ virsh qemu-monitor-command instance-0012 --hmp block_resize
 drive-virtio-disk1 100G

 Finally, you need to perform a drive rescan on the actual instance and
 resize and extend the file-system. This will be OS specific.

 I've tested this a few times and it seems very reliable.

 Taylor Bertie
 Enterprise Support Infrastructure Engineer

 Mobile +64 27 952 3949
 Phone +64 4 462 5030
 Email taylor.ber...@solnet.co.nz

 Solnet Solutions Limited
 Level 12, Solnet House
 70 The Terrace, Wellington 6011
 PO Box 397, Wellington 6140

 www.solnet.co.nz

 Attention:
 This email may contain information intended for the sole use of
 the original recipient. Please respect this when sharing or
 disclosing this email's contents with any third party. If you
 believe you have received this email in error, please delete it
 and notify the sender or postmas...@solnetsolutions.co.nz as
 soon as possible. The content of this email does not necessarily
 reflect the views of Solnet Solutions Ltd.


 __
 OpenStack Development Mailing List (not for usage questions)
 Unsubscribe: openstack-dev-requ...@lists.openstack.org?subject:unsubscribe
 http://lists.openstack.org/cgi-bin/mailman/listinfo/openstack-dev


​Hey Taylor,

This is something that has come up a number of times but I personally
didn't have a good solution for it on the iSCSI side.  I'm not sure if your
method would work with iSCSI attached devices because typically you need to
detach/reattach for size changes to take effect, in other words I'm
uncertain if libvirt would be able to see the changes.  That being said I
also didn't know about this option in libvirt so it may work out.

I'll let the Nova folks reply regarding interest from their side in the M
release, but I know from the Cinder side and the Trove side this would in
fact be a desireable feature.

Appreciate the detailed write up, and again WELCOME!!

Thanks,
John​
__
OpenStack Development Mailing List (not for usage questions)
Unsubscribe: openstack-dev-requ...@lists.openstack.org?subject:unsubscribe
http://lists.openstack.org/cgi-bin/mailman/listinfo/openstack-dev


[openstack-dev] What's Up, Doc? 21 August 2015 (Early edition)

2015-08-19 Thread Lana Brindley
-BEGIN PGP SIGNED MESSAGE-
Hash: SHA1

Hi everyone,

First of all, apologies for missing last week's newsletter: I got so
caught up in the documentation swarm happening here in Brisbane that it
totally slipped my mind! To make up for it, have this week's newsletter
a day early :) In swarm news, the two days ran extremely smoothly, much
to the credit of Suyog, Brian, and Alex who did the heavy lifting of
preparation and organisation. While we focused largely on copy editing,
we also had a lot of great discussion about the overall architecture of
the book, and now have a draft plan ready for Mitaka, which Darren is
driving with the Ops/Arch Guide speciality team.

While last week was all about the docs swarm, this week has been doing
the final cleanup on our newly converted RST books. The Security Guide
is now up, and the Cloud Admin and HA Guides aren't far behind. We're
also about to start testing the Install Guide, now that its conversion
is complete. Well done to all the people who have helped out on these
efforts, great job!

== Progress towards Liberty ==

55 days to go!

* RST conversion:
** Install Guide: Conversion is done, testing to begin soon.
** Cloud Admin Guide: is complete! The new version will be available on
docs.openstack.org very soon.
** HA Guide: is also done, and will available on the site soon.
** Security Guide: is complete, and live:
http://docs.openstack.org/security-guide/

* User Guides information architecture overhaul
** Some user analysis has begun, with a new blueprint to land soon.

* Greater focus on helping out devs with docs in their repo
** Work has picked up on the Ironic docs again.

* Improve how we communicate with and support our corporate contributors
** If you currently work on documentation for a company that would like
to improve their upstream commits for documentation, please contact me!

* Improve communication with Docs Liaisons
** I'm very pleased to see liaisons getting more involved in our bugs
and reviews. Keep up the good work!

* Clearing out old bugs
** Sadly, no action on the spotlight bugs again this week. I'll keep the
current three bugs for this week, to give everyone a little more time.

== RST Migration ==

That's it! We're done!

Do you have ideas for which book should be next? Have a think on it, and
we'll discuss this at Summit.

== Training Guides ==

I'm happy to announce that the Training Labs are now in their own repo,
and are considered a documentation speciality team. Well done to Pranav,
Matjaz, Sayali, and Roger for driving this effort.

== Countdown to Summit ==

With the Liberty release less than two months away, that means it's
nearly Summit time again: https://www.openstack.org/summit/tokyo-2015/

Here's a few things you might want to be thinking about:
* Do you need a visa to visit Japan? If so, you need to be organising
this NOW: https://www.openstack.org/summit/tokyo-2015/tokyo-and-travel/#visa
* Do you have an ATC pass? If you haven't received your pass yet, and
you're an ATC, please contact me so I can chase this up for you.
Remember to use your ATC discount code before 31 August to make sure you
get the full price discounted.

== Doc team meeting ==

The APAC meeting was held this week. Read the minutes here:
https://wiki.openstack.org/wiki/Documentation/MeetingLogs#2015-08-19

The next meetings are:
US: Wednesday 26 August, 14:00:00 UTC
APAC: Wednesday 2 September, 00:30:00 UTC

Please go ahead and add any agenda items to the meeting page here:
https://wiki.openstack.org/wiki/Meetings/DocTeamMeeting#Agenda_for_next_meeting

== Spotlight bugs for this week ==

Let's give these three a little more love:

https://bugs.launchpad.net/openstack-manuals/+bug/1257018 VPNaaS isn't
documented in cloud admin

https://bugs.launchpad.net/openstack-manuals/+bug/1257656 VMware: add
support for VM diagnostics

https://bugs.launchpad.net/openstack-manuals/+bug/1261969 Document nova
server package

- --

Remember, if you have content you would like to add to this newsletter,
or you would like to be added to the distribution list, please email me
directly at openst...@lanabrindley.com, or visit:
https://wiki.openstack.org/w/index.php?title=Documentation/WhatsUpDoc

Keep on doc'ing!

Lana


- -- 
Lana Brindley
Technical Writer
Rackspace Cloud Builders Australia
http://lanabrindley.com
-BEGIN PGP SIGNATURE-
Version: GnuPG v1

iQEcBAEBAgAGBQJV1TwWAAoJELppzVb4+KUylDUIALVRDpsMU+xM+7x8AsJKfnwv
BRmGvUQWrrneBdx99b4Dyq/qianUPxz0hHjdchdeA37JfQYGiKoaVWVR1QAj5aPs
WSg5/KRKI8cjHdfGDo7o0NhFIl2d9cyLj55xXap89QWSZvGoRSn8pXIibRoGd+1t
Pp4RpxqftB8BYTlDkrdePYDIb0X+um3CJ2a/0DwuKUUVfn5zWxt9pOBYrYuqyFbK
fUmI0LzRtopT+hmk02eHaefFzq+nQg5RO64osxd3JG/Zibgb8nIqw6eTjMBLvLs8
aPiNQ5ZSi5dwwRfy3pX8XpM4bl9iXOjhEAxtBT+6Zen4MvaTLehXbnoQ+ooETcQ=
=ul61
-END PGP SIGNATURE-

__
OpenStack Development Mailing List (not for usage questions)
Unsubscribe: 

[openstack-dev] [nova][qa] libvirt + LXC CI - where's the beef?

2015-08-19 Thread Matt Riedemann
After spending a few hours on 
https://bugs.launchpad.net/nova/+bug/1370590 I'm annoyed by the fact we 
don't yet have a CI system for testing libvirt + LXC.


At the Juno midcycle in Portland I thought I remember some guy(s) from 
Rackspace talking about getting a CI job running, whatever happened with 
that?


It seems like we should be able to get this going using community infra, 
right?  Just need some warm bodies to get the parts together and figure 
out which Tempest tests can't be run with that setup - but we have the 
hypervisor support matrix to help us out as a starter.


It also seems unfair to require third party CI for libvirt + parallels 
(virtuozzo) but we don't have the same requirement for LXC.


What gives?!

--

Thanks,

Matt Riedemann


__
OpenStack Development Mailing List (not for usage questions)
Unsubscribe: openstack-dev-requ...@lists.openstack.org?subject:unsubscribe
http://lists.openstack.org/cgi-bin/mailman/listinfo/openstack-dev


Re: [openstack-dev] [neutron] extension implemented by multiple plugins

2015-08-19 Thread Ihar Hrachyshka
-BEGIN PGP SIGNED MESSAGE-
Hash: SHA256

On 08/19/2015 10:54 AM, Bence Romsics wrote:
 Hi,
 
 I'm not sure I need it. :-)
 
 My first idea was, that if two plugins implement an extension
 together (neither the new first class resource, nor the new port
 attributes is a usable feature in themselves in my case), then it
 would be nice to express this.
 
 However thinking a bit more, I believe the only practical
 difference between your solution in the qos patches and my first
 idea is that we could catch some bad neutron configurations (ie.
 loading only one of the two plugins). Which is probably really
 rare, so it does not seem to justify the extra complexity. So I
 will just go with your stuff. Thanks.
 

Well, if we can move into dreams area, we may think of a way to
express such inter-dependency, f.e. by introducing hidden
sub-extensions; and meta-extensions that are satisfied only if all
sub-extension pieces are present.

But we like simple solutions, so we just hacked around the limitation.
Our fault. :)

Ihar
-BEGIN PGP SIGNATURE-
Version: GnuPG v2

iQEcBAEBCAAGBQJV1FfcAAoJEC5aWaUY1u57QrAH/A7qwU0EI9GE7yLI3pKckxnQ
7WJrjeLkewJkAH4LgPPkrD37ENgvKihF7MeEONzLaGll3OPp0xqTMGelLf+xPQ83
Cp2FNvG32kBi9EI/ge/VNxKBqpP+b6GcVP+UiH87dL4o35GHdbdC8uopKXjjDEKL
uP2yVvJNz2IsojPUgbNw7GlWsP43EL93Piig6T7aRpApafSair3unc0/FbiYZlD/
WGepc+vwni+NC+Hk8PAb2jKCWA7xNvmZzpFKrTvY7Z75t0AK39a6SdCPbUvjwU/9
XL+gcPOggLq9LElZjdnyEW+EmVO0euAbl3YYLbyPdJWxM4d3sk+KGQCBhfwgsOs=
=B0T+
-END PGP SIGNATURE-

__
OpenStack Development Mailing List (not for usage questions)
Unsubscribe: openstack-dev-requ...@lists.openstack.org?subject:unsubscribe
http://lists.openstack.org/cgi-bin/mailman/listinfo/openstack-dev


Re: [openstack-dev] [stable] [infra] How to auto-generate stable release notes

2015-08-19 Thread Robert Collins
On 19 August 2015 at 21:19, Thierry Carrez thie...@openstack.org wrote:
 Robert Collins wrote:
 [...]
 Proposed data structure:
 - create a top level directory in each repo called release-notes
 - within that create a subdirectory called changes.
 - within the release-notes dir we place yaml files containing the
 release note inputs.
 - within the 'changes' subdirectory, the name of the yaml file will be
 the gerrit change id in a canonical form.
E.g. I1234abcd.yaml
This serves two purposes: it guarantees file name uniqueness (no
 merge conflicts) and lets us
determine which release to group it in (the most recent one, in
 case of merge+revert+merge patterns).

 One small issue I see with using changeid in the filename is that it
 prevents people from easily proposing a backport with a release note
 snippet in them (since they can't predict the changeID). They will have
 to get it generated and then amend their commit.

Backports typically use the original changeID - they will if they use
git cherry-pick.

 I think we need to enforce some more structure. Release notes are easier
 to read if you group them by category. For stable branches you should
 put critical upgrade notes first, then security updates, then random
 release notes. For master branch notes we usually have critical upgrade
 notes, then major features, then known issues, then random release
 notes. So I would encourage a slightly more detailed schema with
 categories to keep consistency and readability.

Sure - please fill it in :). I was winging it, since I don't do
release notes, I had no idea of your needs.

 Processing:
 1) determine the revisions we need to generate release notes for. By
 default generate notes for the current minor release. (E.g. if the
 tree version is 1.2.3.dev4 we would generate release notes for 1.2.0,
 1.2.1, 1.2.2, 1.2.3[which dev4 is leading up to]).

 How would that work in a post-versioned world ? What would you generate
 if the tree version is 1.2.3.post12 ?

1.2.3 is still the version, not that we can use post versions at all
with pbr. (Short story - we can't because we used them wrongly and we
haven't had nearly enough time to flush out remaining instances in the
wild).

 2) For each version: scan all the commits to determine gerrit change-id's.
  i) read in all those change ids .yaml files and pull out any notes within 
 them.
  ii) read in any full version yaml file (and merge in its contained notes)
  iii) Construct a markdown document as follows:
   a) Sort any preludes (there should be only one at most, but lets not
 error if there are multiple)
   b) sort any notes

 We would sort them by category.

The requirement for deterministic results means we'd just sort them.
If they are divided into categories, we'd sort the list of categories
(perhaps according to some schema) and then within each category sort
the notes.

   c) for each note transform it into a bullet point by prepending its
 first line with '- ' and every subsequent line with '  ' (two spaces
 to form a hanging indent).
   d) strip any trailing \n's from everything.
   e) join the result - '\n'.join(chain(preludes, notes))
  iv) we output the resulting file to release-notes/$version.md where
 $version is the pbr reported version for the tree (e.g. in the example
 above it would be 1.2.3.dev4, *not* 1.2.3).

 So you would have release-notes/1.2.2.yaml and release-notes/1.2.2.md in
 the same directory, with one being a subset of the data present in the
 other ? That feels a bit confusing. I would rather use two separate
 directories (source and output) for that.

If you like, sure. Though the thing I was thinking was that for very
old things we might generate the md file, delete the yaml, and commit
to the tree.

 3) possibly symlink the highest output version to ./RELEASENOTES.md or
 something, so other tooling can look for a constant value.

 +1

 If we want to put release notes in sdists, we can have pbr do this,
 otherwise it could just be built entirely separately.

 I think we need to put release notes in sdists, so that people consuming
 stable branches from a random commit can still get work-in-progress
 releasenotes for the upcoming version.

Those two things are disconnected. Consuming a random commit doesn't
imply sdist - nor does it preclude it.

We don't *currently* generate release notes in sdists. Whats the
driver for adding it? [perhaps as a use case so we can flush out
hidden assumptions we have]

 I recommend we start with it entirely separate: part of the
 release-management tooling.

 That could work, for example, for the liberty release. I think for
 stable branches we'll need releasenotes published in the sdists, for the
 above-mentioned reason.

I don't understand the reason well enough to follow it.

-Rob


-- 
Robert Collins rbtcoll...@hp.com
Distinguished Technologist
HP Converged Cloud

__
OpenStack Development Mailing List (not 

Re: [openstack-dev] Fw: [heat-translator] Nominating new core reviewers

2015-08-19 Thread Idan Moyal
+1



 Hello,

 I am glad to nominate Vahid Hashemian [1] and Srinivas Tadepalli [2] for
 the Heat-Translator core reviewers team.

 Both of them have been providing significant contribution, development and
 review, since the beginning of this year and knows code base well.

 Existing cores, please reply this email by end of this week with your vote
 +1/-1 for their addition to the team.

 Review stats:
 *http://stackalytics.com/report/contribution/heat-translator/90*
 http://stackalytics.com/report/contribution/heat-translator/90

 [1]
 *https://review.openstack.org/#/q/reviewer:%22Vahid+Hashemian+%253Cvahidhashemian%2540us.ibm.com%253E%22,n,z*
 https://review.openstack.org/#/q/reviewer:%22Vahid+Hashemian+%253Cvahidhashemian%2540us.ibm.com%253E%22,n,z

 [2]
 *https://review.openstack.org/#/q/reviewer:%22srinivas_tadepalli+%253Csrinivas.tadepalli%2540tcs.com%253E%22,n,z*
 https://review.openstack.org/#/q/reviewer:%22srinivas_tadepalli+%253Csrinivas.tadepalli%2540tcs.com%253E%22,n,z

 Regards,
 Sahdev Zala
 PTL, Heat-Translator



__
OpenStack Development Mailing List (not for usage questions)
Unsubscribe: openstack-dev-requ...@lists.openstack.org?subject:unsubscribe
http://lists.openstack.org/cgi-bin/mailman/listinfo/openstack-dev


[openstack-dev] [Ironic] Vendor tools related to Ironic

2015-08-19 Thread Ramakrishnan G
Hi All,

This is an informational mail for both vendor tool developers and Ironic
community.

For vendor tool developers - We decided the last week's Ironic meeting [1]
that vendors who want to share tools/scripts related to Ironic, can do so
in their own preferred way (personal github repositories or
stackforge/openstack github repositories ((provided it gets accepted))).
Such vendor tools can be listed in Ironic wiki[3].  These vendor tools will
not be reviewed/maintained by the Ironic community.

For Ironic community - After having taken the action item for wikifying
them, I have just written down wiki pages ([2] and [3]), and linked them to
the main page of our wiki[4].  This just captures what we discussed in the
meeting, plus a bit of additions from my side.  Please feel free to discuss
and edit them as required.

[1]
http://eavesdrop.openstack.org/meetings/ironic/2015/ironic.2015-08-17-17.00.log.txt
[2] https://wiki.openstack.org/wiki/Ironic/ThirdPartyVendorToolsDeveloperDoc
[3] https://wiki.openstack.org/wiki/Ironic/ThirdPartyVendorToolsList
[4] https://wiki.openstack.org/wiki/Ironic

Thanks.

Regards,
Ramesh
__
OpenStack Development Mailing List (not for usage questions)
Unsubscribe: openstack-dev-requ...@lists.openstack.org?subject:unsubscribe
http://lists.openstack.org/cgi-bin/mailman/listinfo/openstack-dev


Re: [openstack-dev] [ironic] Re: New API for node create, specifying initial provision state

2015-08-19 Thread Ramakrishnan G
My opinion:

- If a new API is desirable by operators who would like to skip a few steps
in Ironic before making it active, then we should do it.   I mean we should
allow them to skip the enroll state and manageable state, thereby giving
them an opportunity to land the node in manageable or available state
by default.

- Default state (by default) should be enroll as that's where the state
of a node in Ironic begins. May be optionally it can be tweaked in
ironic.conf.

- I don't like the idea to land a node directly in active state.  The main
reason being it differs from driver to driver, what it takes to bring a
node to active and what is required for a take over for the active node.
For example, while deploying a partition image (by pxe or virtual media
drivers), the uuid of the root partition should be available in the
driver_internal_info for take_over to happen.  So, it would mean that even
for existing drivers, we would need to at least provide a mechanism for
writing driver_internal_info from the API which is not desirable.  It is
very much a valid use case to do import.  From first thought, I think we
should have a new API endpoint to request such an import and a new method
in DeployInterface (not an abstract method) for importing bare metals from
another system.  The API should allow parameters to be passed from the
driver to do the import, optionally requesting to reboot the bare metal
after it is imported (to make sure that Ironic can properly manage the node
again).  The new method in DeployInterface should do what it takes to
import the bare metal given the parameters.  But, that might be a different
story :).

Regards,
Ramesh

On Wed, Aug 19, 2015 at 5:35 AM, Ruby Loo rlooya...@gmail.com wrote:




 On 17 August 2015 at 20:20, Robert Collins robe...@robertcollins.net
 wrote:

 On 11 August 2015 at 06:13, Ruby Loo rlooya...@gmail.com wrote:
  Hi, sorry for the delay. I vote no. I understand the rationale of
 trying to
  do things so that we don't break our users but that's what the
 versioning is
  meant for and more importantly -- I think adding the ENROLL state is
 fairly
  important wrt the lifecycle of a node. I don't particularly want to
 hide
  that and/or let folks opt out of it in the long term.
 
  From a reviewer point-of-view, my concern is me trying to remember
 all the
  possible permutations/states etc that are possible to make sure that
 new
  code doesn't break existing behavior. I haven't thought out whether
 adding
  this new API would make that worse or not, but then, I don't really
 want to
  have to think about it. So KISS as much as we can! :)

 I'm a little surprised by this, to be honest.

 Here's why: allowing the initial state to be chosen from
 ENROLL/AVAILABLE from the latest version of the API is precisely as
 complex as allowing two versions of the API {old, new} where old
 creates nodes in  AVAILABLE and new creates nodes in ENROLL. The only
 difference I can see is that eventually someday if {old} stops being
 supported, then and only then we can go through the code and clean
 things up.

 It seems to me that the costs to us of supporting graceful transitions
 for users here are:

 1) A new version NEWVER of the API that supports node state being one
 of {not supplied, AVAILABLE, ENROLL}, on creation, defaulting to
 AVAILABLE when not supplied.
 2) Supporting the initial state of AVAILABLE indefinitely rather than
 just until we *delete* version 1.10.
 3) CD deployments that had rolled forward to 1.11 will need to add the
 state parameter to their scripts to move forward to NEWVER.
 4) Don't default the client to the veresions between 1.10 and NEWVER
 versions at any point.

 That seems like a very small price to pay on our side, and the
 benefits for users are that they can opt into the new functionality
 when they are ready.

 -Rob


 After thinking about this some more, I'm not actually going to address
 Rob's points above. What I want to do is go back and discuss... what do
 people think about having an API that allows the initial provision state to
 be specified, for a node that is created in Ironic. I'm assuming that
 enroll state exists :)

 Earlier today on IRC, Devananda mentioned that there's a very strong case
 for allowing a node to be created in any of the stable states (enroll,
 manageable, available, active). Maybe he'll elaborate later on this. I
 know that there's a use case where there is a desire to import nodes (with
 instances on them) from another system into ironic, and have them be active
 right away. (They don't want the nodes to go from
 enroll-verifying-manageable-cleaning!!!-available!!!-active).

 1. What would the default provision state be, if it wasn't specified?
 A. 'available' to be backwards compatible with pre-v1.11
 or
 B. 'enroll' to be consistent with v1.11+
 or
 ?


 2. What would it mean to set the initial provision state to something
 other than 'enroll'?

 manageable
 
 In our state machinery[0], a node 

Re: [openstack-dev] [neutron] New networking-calico project

2015-08-19 Thread Andreas Jaeger

On 2015-08-18 20:30, Sean M. Collins wrote:

Are your ACLs set up properly?

https://review.openstack.org/#/admin/projects/openstack/networking-calico,access

I don't see your group - or any actual group that has rights assigned to
the repo - it's empty.

compare that to:

https://review.openstack.org/#/admin/projects/openstack/neutron,access


Something is indeed broken. Please discuss with the infra team on 
#openstack-infra IRC channel and let's figure out what's the problem.

I did a quick review and it looks fine in project-config.

It might be that something went wrong with initial project creation.

Andreas
--
 Andreas Jaeger aj@{suse.com,opensuse.org} Twitter/Identica: jaegerandi
  SUSE LINUX GmbH, Maxfeldstr. 5, 90409 Nürnberg, Germany
   GF: Felix Imendörffer, Jane Smithard, Graham Norton,
   HRB 21284 (AG Nürnberg)
GPG fingerprint = 93A3 365E CE47 B889 DF7F  FED1 389A 563C C272 A126


__
OpenStack Development Mailing List (not for usage questions)
Unsubscribe: openstack-dev-requ...@lists.openstack.org?subject:unsubscribe
http://lists.openstack.org/cgi-bin/mailman/listinfo/openstack-dev


Re: [openstack-dev] [nova] API: Question on 'Retry-After': 0 in HTTPForbidden

2015-08-19 Thread Alex Xu
+1 for Retry-After is wrong for quota case

 在 2015年8月19日,下午1:32,GHANSHYAM MANN ghanshyamm...@gmail.com 写道:
 
 Retry-After

__
OpenStack Development Mailing List (not for usage questions)
Unsubscribe: openstack-dev-requ...@lists.openstack.org?subject:unsubscribe
http://lists.openstack.org/cgi-bin/mailman/listinfo/openstack-dev


Re: [openstack-dev] [openstack-infra][third-paty][CI][nodepool]Using Nodepool for creating slaves.

2015-08-19 Thread Xie, Xianshan
Hi Abhi,
   IIUC, you should create and configure slaves(these slaves can be VMs or real 
physical machine) in Jenkins.
And the nodepool is used to create and pool VMs automatically, and these VMs 
should be run on the slaves.
Then, while CI wants to build and execute a testcase, especially which attempts 
to be run on an isolated host, the nodepool will match a proper VM for this 
testcase.

Hope this might help you.


Xiexs


From: Abhishek Shrivastava [mailto:abhis...@cloudbyte.com]
Sent: Tuesday, August 18, 2015 1:46 PM
To: openstack-in...@lists.openstack.org; OpenStack Development Mailing List 
(not for usage questions)
Subject: Re: [openstack-dev] [openstack-infra][third-paty][CI][nodepool]Using 
Nodepool for creating slaves.

Also adding the following:

  *   
https://github.com/openstack-infra/project-config/tree/master/nodepool/elements
Does this means that we don't have to take care of creating slaves(i.e; 
installing slave using scripts as we have done in master) and it will be done 
automatically, and also we don't have to configure slaves in Jenkins.

A bit confusing for me so if anyone can explain it to me then it will be very 
helpful.

On Tue, Aug 18, 2015 at 11:11 AM, Abhishek Shrivastava 
abhis...@cloudbyte.commailto:abhis...@cloudbyte.com wrote:
Hi Folks,

I was going through Ramy's guide for setting up CI, there I found out the 
following:

  *   
https://github.com/rasselin/os-ext-testing#setting-up-nodepool-jenkins-slaves
But I don't get the fact on how to create the image, also what major settings 
need to be done to make the config perfect for use. Can anyone help me with 
that?

--
[https://docs.google.com/uc?export=downloadid=0Byq0j7ZjFlFKV3ZCWnlMRXBCcU0revid=0Byq0j7ZjFlFKa2V5VjdBSjIwUGx6bUROS2IrenNwc0kzd2IwPQ]
Thanks  Regards,
Abhishek
Cloudbyte Inc.http://www.cloudbyte.com



--
[https://docs.google.com/uc?export=downloadid=0Byq0j7ZjFlFKV3ZCWnlMRXBCcU0revid=0Byq0j7ZjFlFKa2V5VjdBSjIwUGx6bUROS2IrenNwc0kzd2IwPQ]
Thanks  Regards,
Abhishek
Cloudbyte Inc.http://www.cloudbyte.com
__
OpenStack Development Mailing List (not for usage questions)
Unsubscribe: openstack-dev-requ...@lists.openstack.org?subject:unsubscribe
http://lists.openstack.org/cgi-bin/mailman/listinfo/openstack-dev


Re: [openstack-dev] [Neutron] neutron-lbaas code structure problem

2015-08-19 Thread Gareth
Thanks Brandon, got it.

It is easy to understand :)

On Sat, Aug 15, 2015 at 2:07 AM, Brandon Logan brandon.lo...@rackspace.com
wrote:

 ​Hi Gareth,

 The reason for this is because lbaas v1 is in the
 services/loadbalancer/drivers path.  This path was maintained from when
 neutron-lbaas was just another directory in the neutron repo.  Once we
 moved to neutron-lbaas as its own repo and going forward with lbaas v2, the
 decision was made to not maintain that same path for v2.  There's no reason
 to keep that path for v2 as v1 will be deprecated and eventually removed
 and we did not want to be stuck with that path.  Eventually the plugin.py
 module will have to be moved to the root directory as well from
 services/loadbalancer but thats a minor change.


 Thanks,

 Brandon
 --
 *From:* Gareth academicgar...@gmail.com
 *Sent:* Thursday, August 13, 2015 9:38 PM
 *To:* OpenStack Development Mailing List
 *Subject:* [openstack-dev] [Neutron] neutron-lbaas code structure problem

 Dear neutron guys.

 [0]
 https://github.com/openstack/neutron-lbaas/tree/master/neutron_lbaas/drivers
 [1]
 https://github.com/openstack/neutron-lbaas/tree/master/neutron_lbaas/services/loadbalancer/drivers

 the codes under these two paths are 'same' (implement same things with v1
 and v2), but why use two different code paths here?

 --
 Gareth

 *Cloud Computing, OpenStack, Distributed Storage, Fitness, Basketball*
 *OpenStack contributor, kun_huang@freenode*
 *My promise: if you find any spelling or grammar mistakes in my email from
 Mar 1 2013, notify me *
 *and I'll donate $1 or ¥1 to an open organization you specify.*

 __
 OpenStack Development Mailing List (not for usage questions)
 Unsubscribe: openstack-dev-requ...@lists.openstack.org?subject:unsubscribe
 http://lists.openstack.org/cgi-bin/mailman/listinfo/openstack-dev




-- 
Gareth

*Cloud Computing, OpenStack, Distributed Storage, Fitness, Basketball*
*OpenStack contributor, kun_huang@freenode*
*My promise: if you find any spelling or grammar mistakes in my email from
Mar 1 2013, notify me *
*and I'll donate $1 or ¥1 to an open organization you specify.*
__
OpenStack Development Mailing List (not for usage questions)
Unsubscribe: openstack-dev-requ...@lists.openstack.org?subject:unsubscribe
http://lists.openstack.org/cgi-bin/mailman/listinfo/openstack-dev


Re: [openstack-dev] [TripleO][Tuskar] Steps to follow to provide MidoNet as Neutron backend in TripleO's overcloud

2015-08-19 Thread Jaume Devesa
Thanks Steven.

I've registered the blueprint:

https://blueprints.launchpad.net/tripleo/+spec/midonet-deployment-support

We'll start preparing the pseudo-thirdparty job, develop the feature and
bother you guys in the IRC
channel as soon as you approve the blueprint.

Can we discuss it next Thursday on the IRC meeting?

On 18 August 2015 at 18:14, Steven Hardy sha...@redhat.com wrote:

 On Tue, Aug 18, 2015 at 05:59:44PM +0200, Jaume Devesa wrote:
  Hi Steven/Emilien,
 
  Thanks for the quick responses.
 
  On Tue, 18 Aug 2015 16:10, Steven Hardy wrote:
   On Tue, Aug 18, 2015 at 04:19:08PM +0200, Jaume Devesa wrote:
  
   I think the pattern for the templates will be similar to the Cisco ML2
   plugins which are currently being integrated:
  
   https://review.openstack.org/#/c/198754/
  
   The plug-points for third-party configuration is still undergoing some
   refinement, but the basic steps are:
  
   1. Ensure you have support in the upstream puppet modules (as
 mentioned by
   Emilien), and figure out the hieradata required to drive puppet as
   required.
 
  Yes, we would like to be fully upstream on this.  MidoNet plugin support
 for
  Puppet Neutron is already done since Kilo (and backported to Juno). We
 do have
  in mind Emilien's request. So I think that won't be a problem.
 
   2. Create a heat template which creates the hieradata, and defines
   parameters for all configurable values, e.g like:
  
  
 https://review.openstack.org/#/c/198754/10/puppet/extraconfig/pre_deploy/controller/network-cisco.yaml
  
   3. Define a heat environment file, which wires in the template from
 (2) via
   the OS::TripleO::ControllerExtraConfigPre interface:
  
  
 https://review.openstack.org/#/c/198754/10/environments/cisco-nexus-ucsm-plugin.yaml
  
   4. Add the hieradata file deployed via (2) to the controller hierarchy:
  
  
 https://review.openstack.org/#/c/198754/10/puppet/controller-puppet.yaml
  
   5. Add conditional logic to the manifiests so the appropriate modules
 from
   (1) are included when your backend is enabled:
  
  
 https://review.openstack.org/#/c/198754/10/puppet/manifests/overcloud_controller.pp
  
 https://review.openstack.org/#/c/198754/10/puppet/manifests/overcloud_controller_pacemaker.pp
  
   Basically the way this works is the hieradata is deployed via (2)
 before
   puppet runs, and the manifiest changes in (5) consumes that data when
 we
   apply it during deployment.
 
  The links and the steps to follow are so helpful! Thanks again. Couple of
  questions here:
 
  * There is no need of `tripleo-puppet-elements`?

 It depends, if your additions require additional packages to be installed,
 then you may need to either add them to an existing element, or create a
 new element which may be specified by those building images with
 diskimage-builder, e.g so their images contain what you require.


 https://github.com/openstack/tripleo-puppet-elements/blob/master/elements/overcloud-controller/install.d/package-installs-overcloud-controller

 If your integration purely requires configuration changes (and the puppet
 module already exists in the image), you may not need to do anything.

  * Since the integration seems feasible, does it make sense to start
 opening a
blueprint and start working on it?

 Absolutely, a blueprint is probably a good idea (although tbh these haven't
 been strictly required lately..) summarising the required changes, then you
 can use the examples I linked to work on the template changes.

   No, we're moving away from tuskar and it's not required for third-party
   integration such as described above (it's also not covered in CI).
  
   Speaking of CI, it'd be good to discuss how you plan to ensure your
 stuff
   stays working, as clearly we don't have the resources in upstream CI to
   test it, having third-party CI jobs vote on TripleO changes would be
 one
   way to solve this, but AFAIK we don't yet have a process in place to
 enable
   this.
 
  Even if there is not an official Third Party methodology, it wouldn't be
 so hard
  to add a Jenkins job on our infrastructure to listen upstream gerrit
 events and
  make comments instead of voting, right? (maybe I am speaking so quickly,
 I can
  not image right now how a TripleO Jenkins job look like...)

 Yes, this was exactly what I had in mind - it'd be great if we could get
 some sort of non-voting comments from those contributing third-party
 additions - I know this pattern works well for other projects, so I guess
 the same approach for TripleO may be reasonable as well.

 Steve

 __
 OpenStack Development Mailing List (not for usage questions)
 Unsubscribe: openstack-dev-requ...@lists.openstack.org?subject:unsubscribe
 http://lists.openstack.org/cgi-bin/mailman/listinfo/openstack-dev




-- 
Jaume Devesa
Software Engineer at Midokura
__
OpenStack 

Re: [openstack-dev] [TripleO][Tuskar] Steps to follow to provide MidoNet as Neutron backend in TripleO's overcloud

2015-08-19 Thread Jaume Devesa
Sorry, I meant Tuesday.


On 19 August 2015 at 10:51, Jaume Devesa devv...@gmail.com wrote:

 Thanks Steven.

 I've registered the blueprint:

 https://blueprints.launchpad.net/tripleo/+spec/midonet-deployment-support

 We'll start preparing the pseudo-thirdparty job, develop the feature and
 bother you guys in the IRC
 channel as soon as you approve the blueprint.

 Can we discuss it next Thursday on the IRC meeting?

 On 18 August 2015 at 18:14, Steven Hardy sha...@redhat.com wrote:

 On Tue, Aug 18, 2015 at 05:59:44PM +0200, Jaume Devesa wrote:
  Hi Steven/Emilien,
 
  Thanks for the quick responses.
 
  On Tue, 18 Aug 2015 16:10, Steven Hardy wrote:
   On Tue, Aug 18, 2015 at 04:19:08PM +0200, Jaume Devesa wrote:
  
   I think the pattern for the templates will be similar to the Cisco ML2
   plugins which are currently being integrated:
  
   https://review.openstack.org/#/c/198754/
  
   The plug-points for third-party configuration is still undergoing some
   refinement, but the basic steps are:
  
   1. Ensure you have support in the upstream puppet modules (as
 mentioned by
   Emilien), and figure out the hieradata required to drive puppet as
   required.
 
  Yes, we would like to be fully upstream on this.  MidoNet plugin
 support for
  Puppet Neutron is already done since Kilo (and backported to Juno). We
 do have
  in mind Emilien's request. So I think that won't be a problem.
 
   2. Create a heat template which creates the hieradata, and defines
   parameters for all configurable values, e.g like:
  
  
 https://review.openstack.org/#/c/198754/10/puppet/extraconfig/pre_deploy/controller/network-cisco.yaml
  
   3. Define a heat environment file, which wires in the template from
 (2) via
   the OS::TripleO::ControllerExtraConfigPre interface:
  
  
 https://review.openstack.org/#/c/198754/10/environments/cisco-nexus-ucsm-plugin.yaml
  
   4. Add the hieradata file deployed via (2) to the controller
 hierarchy:
  
  
 https://review.openstack.org/#/c/198754/10/puppet/controller-puppet.yaml
  
   5. Add conditional logic to the manifiests so the appropriate modules
 from
   (1) are included when your backend is enabled:
  
  
 https://review.openstack.org/#/c/198754/10/puppet/manifests/overcloud_controller.pp
  
 https://review.openstack.org/#/c/198754/10/puppet/manifests/overcloud_controller_pacemaker.pp
  
   Basically the way this works is the hieradata is deployed via (2)
 before
   puppet runs, and the manifiest changes in (5) consumes that data when
 we
   apply it during deployment.
 
  The links and the steps to follow are so helpful! Thanks again. Couple
 of
  questions here:
 
  * There is no need of `tripleo-puppet-elements`?

 It depends, if your additions require additional packages to be installed,
 then you may need to either add them to an existing element, or create a
 new element which may be specified by those building images with
 diskimage-builder, e.g so their images contain what you require.


 https://github.com/openstack/tripleo-puppet-elements/blob/master/elements/overcloud-controller/install.d/package-installs-overcloud-controller

 If your integration purely requires configuration changes (and the puppet
 module already exists in the image), you may not need to do anything.

  * Since the integration seems feasible, does it make sense to start
 opening a
blueprint and start working on it?

 Absolutely, a blueprint is probably a good idea (although tbh these
 haven't
 been strictly required lately..) summarising the required changes, then
 you
 can use the examples I linked to work on the template changes.

   No, we're moving away from tuskar and it's not required for
 third-party
   integration such as described above (it's also not covered in CI).
  
   Speaking of CI, it'd be good to discuss how you plan to ensure your
 stuff
   stays working, as clearly we don't have the resources in upstream CI
 to
   test it, having third-party CI jobs vote on TripleO changes would be
 one
   way to solve this, but AFAIK we don't yet have a process in place to
 enable
   this.
 
  Even if there is not an official Third Party methodology, it wouldn't
 be so hard
  to add a Jenkins job on our infrastructure to listen upstream gerrit
 events and
  make comments instead of voting, right? (maybe I am speaking so
 quickly, I can
  not image right now how a TripleO Jenkins job look like...)

 Yes, this was exactly what I had in mind - it'd be great if we could get
 some sort of non-voting comments from those contributing third-party
 additions - I know this pattern works well for other projects, so I guess
 the same approach for TripleO may be reasonable as well.

 Steve

 __
 OpenStack Development Mailing List (not for usage questions)
 Unsubscribe:
 openstack-dev-requ...@lists.openstack.org?subject:unsubscribe
 http://lists.openstack.org/cgi-bin/mailman/listinfo/openstack-dev




 --
 Jaume Devesa
 Software 

Re: [openstack-dev] [Congress] [Murano] multiple numbers of arguments for table

2015-08-19 Thread Filip Blaha

Hi Tim

We use fixed count of columns. So I believe there should not be any bad 
impact of this change.


Regards
Filip

On 08/18/2015 11:22 PM, Tim Hinrichs wrote:

Hi all,

We're contemplating a small syntax change in the Congress policy 
language and wanted to see if it would cause anyone problems.


Currently you can write rules that give a single table differing 
numbers of columns.  In the following example, the 'error' table has 
both 1 column and 2 columns.


error(vm) :- blah blah
error(vm, net) :- blah blah

We're contemplating removing this flexibility and making every table 
have a fixed number of columns.  (We only support differing numbers of 
columns in very special cases anyway.)


Would this cause any problems?  Murano team?

Thanks,
Tim



__
OpenStack Development Mailing List (not for usage questions)
Unsubscribe: openstack-dev-requ...@lists.openstack.org?subject:unsubscribe
http://lists.openstack.org/cgi-bin/mailman/listinfo/openstack-dev


__
OpenStack Development Mailing List (not for usage questions)
Unsubscribe: openstack-dev-requ...@lists.openstack.org?subject:unsubscribe
http://lists.openstack.org/cgi-bin/mailman/listinfo/openstack-dev


Re: [openstack-dev] [neutron] extension implemented by multiple plugins

2015-08-19 Thread Bence Romsics
Hi,

I'm not sure I need it. :-)

My first idea was, that if two plugins implement an extension together
(neither the new first class resource, nor the new port attributes is
a usable feature in themselves in my case), then it would be nice to
express this.

However thinking a bit more, I believe the only practical difference
between your solution in the qos patches and my first idea is that we
could catch some bad neutron configurations (ie. loading only one of
the two plugins). Which is probably really rare, so it does not seem
to justify the extra complexity. So I will just go with your stuff.
Thanks.

Cheers,
Bence

On Tue, Aug 18, 2015 at 4:02 PM, Ihar Hrachyshka ihrac...@redhat.com wrote:
 -BEGIN PGP SIGNED MESSAGE-
 Hash: SHA256

 On 08/18/2015 03:11 PM, Bence Romsics wrote:
 Hi Ihar,

 Thank you. Just rebased my patch and following the example of the
 qos feature now I can start neutron-server with both the service
 plugin and the ml2 extension driver loaded. However I have noticed
 that I can no longer mark the extension driver as implementing the
 extension alias (the 'extension_alias' property seems to be better
 not used, or I still have the same error). Is that intentional?


 I think the assumption is that only one plugin is capable of
 implementing an extension. We only allowed to implement no extensions
 at all. If you think we should allow multiple plugins to claim support
 for the same extension, then it's an additional use case on top of
 what we needed in qos. Why do you need it?

 BTW feature/qos was merged in master yesterday, so it's now available
 for all patches.

 Ihar
 -BEGIN PGP SIGNATURE-
 Version: GnuPG v2

 iQEcBAEBCAAGBQJV0zrZAAoJEC5aWaUY1u57DIAIAJG+U3sVI/ejvEmETEtbINH+
 mm8IFhpwoSzMNcRKfrlobgmu4R/+saGfQsUaQHjh4ko7PVq2eDH9sMPlHjVZXUGi
 x5Rt7gKuFCXsPLyXybjAaaWQjI/hO65/V7D1xwQceRl9FL6kSjgxoasu5ufGUR4j
 ZMmp0f9nN8v7VVHynhLq0FEYMqMs0fylO2hnyJKyJUk26Xd1GZqv/58jAl6RaB3Z
 LzE6Qd6yO0R4ekEhL4DhBbf3+J59ljDhgCbCvScKiL83IZb0FT4vcYMvuHIKezHt
 c23ImDJjz9ZCCld0ah39/jEcqOWj8IM41L/1Qjwdk/Fn/s1CUtFY1vJ28z8IOgg=
 =rMZ7
 -END PGP SIGNATURE-

 __
 OpenStack Development Mailing List (not for usage questions)
 Unsubscribe: openstack-dev-requ...@lists.openstack.org?subject:unsubscribe
 http://lists.openstack.org/cgi-bin/mailman/listinfo/openstack-dev

__
OpenStack Development Mailing List (not for usage questions)
Unsubscribe: openstack-dev-requ...@lists.openstack.org?subject:unsubscribe
http://lists.openstack.org/cgi-bin/mailman/listinfo/openstack-dev


Re: [openstack-dev] [stable] [infra] How to auto-generate stable release notes

2015-08-19 Thread Thierry Carrez
Robert Collins wrote:
 [...]
 Proposed data structure:
 - create a top level directory in each repo called release-notes
 - within that create a subdirectory called changes.
 - within the release-notes dir we place yaml files containing the
 release note inputs.
 - within the 'changes' subdirectory, the name of the yaml file will be
 the gerrit change id in a canonical form.
E.g. I1234abcd.yaml
This serves two purposes: it guarantees file name uniqueness (no
 merge conflicts) and lets us
determine which release to group it in (the most recent one, in
 case of merge+revert+merge patterns).

One small issue I see with using changeid in the filename is that it
prevents people from easily proposing a backport with a release note
snippet in them (since they can't predict the changeID). They will have
to get it generated and then amend their commit.

I don't really have a better suggestion though, so I guess we could do
some git-review magic to simplify that (fix the filename at ChangeID
generation time and/or have a --releasenote option that autocreates a file).

 - we also create files that roll up all the notes within history
 versions - named by the version. e.g. release-notes/1.2.3.yaml.
 
 Yaml schema:
 prelude: prelude prose
 notes:
  - note1
  - note2
  - note3

I think we need to enforce some more structure. Release notes are easier
to read if you group them by category. For stable branches you should
put critical upgrade notes first, then security updates, then random
release notes. For master branch notes we usually have critical upgrade
notes, then major features, then known issues, then random release
notes. So I would encourage a slightly more detailed schema with
categories to keep consistency and readability.

 Processing:
 1) determine the revisions we need to generate release notes for. By
 default generate notes for the current minor release. (E.g. if the
 tree version is 1.2.3.dev4 we would generate release notes for 1.2.0,
 1.2.1, 1.2.2, 1.2.3[which dev4 is leading up to]).

How would that work in a post-versioned world ? What would you generate
if the tree version is 1.2.3.post12 ?

 2) For each version: scan all the commits to determine gerrit change-id's.
  i) read in all those change ids .yaml files and pull out any notes within 
 them.
  ii) read in any full version yaml file (and merge in its contained notes)
  iii) Construct a markdown document as follows:
   a) Sort any preludes (there should be only one at most, but lets not
 error if there are multiple)
   b) sort any notes

We would sort them by category.

   c) for each note transform it into a bullet point by prepending its
 first line with '- ' and every subsequent line with '  ' (two spaces
 to form a hanging indent).
   d) strip any trailing \n's from everything.
   e) join the result - '\n'.join(chain(preludes, notes))
  iv) we output the resulting file to release-notes/$version.md where
 $version is the pbr reported version for the tree (e.g. in the example
 above it would be 1.2.3.dev4, *not* 1.2.3).

So you would have release-notes/1.2.2.yaml and release-notes/1.2.2.md in
the same directory, with one being a subset of the data present in the
other ? That feels a bit confusing. I would rather use two separate
directories (source and output) for that.

 3) possibly symlink the highest output version to ./RELEASENOTES.md or
 something, so other tooling can look for a constant value.

+1

 If we want to put release notes in sdists, we can have pbr do this,
 otherwise it could just be built entirely separately.

I think we need to put release notes in sdists, so that people consuming
stable branches from a random commit can still get work-in-progress
releasenotes for the upcoming version.

 I recommend we start with it entirely separate: part of the
 release-management tooling.

That could work, for example, for the liberty release. I think for
stable branches we'll need releasenotes published in the sdists, for the
above-mentioned reason.

Thanks,

-- 
Thierry Carrez (ttx)

__
OpenStack Development Mailing List (not for usage questions)
Unsubscribe: openstack-dev-requ...@lists.openstack.org?subject:unsubscribe
http://lists.openstack.org/cgi-bin/mailman/listinfo/openstack-dev


[openstack-dev] [Heat] Bugs for Rackspace resources that use scheduler tasks

2015-08-19 Thread Pavlo Shchelokovskyy
Hi Randall, Jason

this is re bug https://bugs.launchpad.net/heat/+bug/1393268

As most of in-tree resources are now fixed in this regard, Steve Baker
asked me to create separate bugs for Rackspace resources from Heat's
contrib that need fixing. As I am not comfortable with messing around in
those resources (and I remember I've talked with Randall about this last
summit), I have assigned those bugs to Randall first so you can spread them
between your heat team.

Not sure when/if you guys will switch to convergence, so I've made those
bugs about using scheduler.TaskRunner objects as Medium (those are must for
convergence phase 2), and those where only rich objects are passed around
as Low.

Bugs in question are:
- Rackspace Cloud Network https://bugs.launchpad.net/heat/+bug/1486464
  (this one is easy, it almost does the right thing already), priority Low
- Rackspace Cloud LoadBalancer https://bugs.launchpad.net/heat/+bug/1486463
  (this one is bad, especially the update logic), priority Medium

Best regards,
-- 
Dr. Pavlo Shchelokovskyy
Senior Software Engineer
Mirantis Inc
www.mirantis.com
__
OpenStack Development Mailing List (not for usage questions)
Unsubscribe: openstack-dev-requ...@lists.openstack.org?subject:unsubscribe
http://lists.openstack.org/cgi-bin/mailman/listinfo/openstack-dev


Re: [openstack-dev] [ironic] Re: New API for node create, specifying initial provision state

2015-08-19 Thread Dmitry Tantsur
To be honest, I'm tired of repeating the same arguments again and 
again... I personally would like to get something cool done, rather than 
discussing how to work around our new state machine again and again.


Now to some trolling: please include a way to users to opt-out from 
NOSTATE - AVAILABLE renaming.


On 08/18/2015 09:11 PM, Ruby Loo wrote:

Apologies, forgot to add [ironic] to the subject.

On 18 August 2015 at 13:27, Ruby Loo rlooya...@gmail.com
mailto:rlooya...@gmail.com wrote:

Hi,

I want to start a different thread on this topic because I don't
think this is about whether/how to do API microversions. Rather,
given that we are going to support microversioning, how to deal with
the non-backward compatible change in 1.11 with the ENROLL state
(instead of AVAILABLE) being the provision state that a node is in,
after being created/registered in ironic.

(This was from 'Let's talk about API versions,
http://lists.openstack.org/pipermail/openstack-dev/2015-August/072287.html.)

I want to think about this before replying but others are more than
welcome to reply first so that I may not feel the need to reply :-)

--ruby
maybe chop off this and above when replying :-)

On 17 August 2015 at 20:20, Robert Collins
robe...@robertcollins.net mailto:robe...@robertcollins.net wrote:

On 11 August 2015 at 06:13, Ruby Loo rlooya...@gmail.com
mailto:rlooya...@gmail.com wrote:
 Hi, sorry for the delay. I vote no. I understand the rationale of 
trying to
 do things so that we don't break our users but that's what the 
versioning is
 meant for and more importantly -- I think adding the ENROLL state is 
fairly
 important wrt the lifecycle of a node. I don't particularly want to 
hide
 that and/or let folks opt out of it in the long term.

 From a reviewer point-of-view, my concern is me trying to remember 
all the
 possible permutations/states etc that are possible to make sure that 
new
 code doesn't break existing behavior. I haven't thought out whether 
adding
 this new API would make that worse or not, but then, I don't really 
want to
 have to think about it. So KISS as much as we can! :)

I'm a little surprised by this, to be honest.

Here's why: allowing the initial state to be chosen from
ENROLL/AVAILABLE from the latest version of the API is precisely as
complex as allowing two versions of the API {old, new} where old
creates nodes in  AVAILABLE and new creates nodes in ENROLL. The
only
difference I can see is that eventually someday if {old} stops being
supported, then and only then we can go through the code and clean
things up.

It seems to me that the costs to us of supporting graceful
transitions
for users here are:

1) A new version NEWVER of the API that supports node state
being one
of {not supplied, AVAILABLE, ENROLL}, on creation, defaulting to
AVAILABLE when not supplied.


-1, it's a breaking change again. And it does not make any sense to me.


2) Supporting the initial state of AVAILABLE indefinitely rather
than
just until we *delete* version 1.10.


We don't delete any versions. This would be a terrible (backward 
incompatible) change, breaking the whole idea of versioning.



3) CD deployments that had rolled forward to 1.11 will need to
add the
state parameter to their scripts to move forward to NEWVER.
4) Don't default the client to the veresions between 1.10 and NEWVER
versions at any point.

That seems like a very small price to pay on our side, and the
benefits for users are that they can opt into the new functionality
when they are ready.


That's what versioning is for, so we're fine, nothing needs to be done.



-Rob

--
Robert Collins rbtcoll...@hp.com mailto:rbtcoll...@hp.com
Distinguished Technologist
HP Converged Cloud


__
OpenStack Development Mailing List (not for usage questions)
Unsubscribe:
openstack-dev-requ...@lists.openstack.org?subject:unsubscribe
http://openstack-dev-requ...@lists.openstack.org?subject:unsubscribe
http://lists.openstack.org/cgi-bin/mailman/listinfo/openstack-dev





__
OpenStack Development Mailing List (not for usage questions)
Unsubscribe: openstack-dev-requ...@lists.openstack.org?subject:unsubscribe
http://lists.openstack.org/cgi-bin/mailman/listinfo/openstack-dev




__
OpenStack Development Mailing List (not for usage questions)
Unsubscribe: 

Re: [openstack-dev] [ironic] Re: New API for node create, specifying initial provision state

2015-08-19 Thread Dmitry Tantsur

On 08/19/2015 02:05 AM, Ruby Loo wrote:




On 17 August 2015 at 20:20, Robert Collins
robe...@robertcollins.net mailto:robe...@robertcollins.net
wrote:

On 11 August 2015 at 06:13, Ruby Loo rlooya...@gmail.com
mailto:rlooya...@gmail.com wrote:
 Hi, sorry for the delay. I vote no. I understand the rationale of 
trying to
 do things so that we don't break our users but that's what the 
versioning is
 meant for and more importantly -- I think adding the ENROLL state 
is fairly
 important wrt the lifecycle of a node. I don't particularly want 
to hide
 that and/or let folks opt out of it in the long term.

 From a reviewer point-of-view, my concern is me trying to 
remember all the
 possible permutations/states etc that are possible to make sure 
that new
 code doesn't break existing behavior. I haven't thought out 
whether adding
 this new API would make that worse or not, but then, I don't 
really want to
 have to think about it. So KISS as much as we can! :)

I'm a little surprised by this, to be honest.

Here's why: allowing the initial state to be chosen from
ENROLL/AVAILABLE from the latest version of the API is
precisely as
complex as allowing two versions of the API {old, new} where old
creates nodes in  AVAILABLE and new creates nodes in ENROLL.
The only
difference I can see is that eventually someday if {old}
stops being
supported, then and only then we can go through the code and
clean
things up.

It seems to me that the costs to us of supporting graceful
transitions
for users here are:

1) A new version NEWVER of the API that supports node state
being one
of {not supplied, AVAILABLE, ENROLL}, on creation, defaulting to
AVAILABLE when not supplied.
2) Supporting the initial state of AVAILABLE indefinitely
rather than
just until we *delete* version 1.10.
3) CD deployments that had rolled forward to 1.11 will need
to add the
state parameter to their scripts to move forward to NEWVER.
4) Don't default the client to the veresions between 1.10
and NEWVER
versions at any point.

That seems like a very small price to pay on our side, and the
benefits for users are that they can opt into the new
functionality
when they are ready.

-Rob


After thinking about this some more, I'm not actually going to address
Rob's points above. What I want to do is go back and discuss... what do
people think about having an API that allows the initial provision state
to be specified, for a node that is created in Ironic. I'm assuming that
enroll state exists :)


Again...



Earlier today on IRC, Devananda mentioned that there's a very strong
case for allowing a node to be created in any of the stable states
(enroll, manageable, available, active). Maybe he'll elaborate later on
this. I know that there's a use case where there is a desire to import
nodes (with instances on them) from another system into ironic, and have
them be active right away. (They don't want the nodes to go from
enroll-verifying-manageable-cleaning!!!-available!!!-active).


And I want node to be created in INSPECTING state directly. I don't care 
it's a transient state, I just want it :) Oh, and can I please skip 
MANAGEABLE? I need the following flow INSPECTING-AVAILABLE.


Now seriously: to what degree are we going to allow people to break our 
state machine? Or alternatively, are we going to allow steps to happen 
automatically? I'm in favor of this idea actually, maybe someone feels 
like writing a spec?




1. What would the default provision state be, if it wasn't specified?
A. 'available' to be backwards compatible with pre-v1.11
or
B. 'enroll' to be consistent with v1.11+
or
?


B. No more breaking changes please.




2. What would it mean to set the initial provision state to something
other than 'enroll'?

manageable

In our state machinery[0], a node goes from enroll - verifying -
manageable. For manageble to be initial state, does it mean that
A. whatever is needed for enroll and verifying is done and succeeds
(under the hood)
or
B. whatever is needed for enroll is done and succeeds (but no verifying)
or
C. no enroll or verifying is done, it goes straight to manageble


A sounds nice, but that's now how our state machine currently works. 
Being able to skip states is really an interesting feature, but it 
requires somewhat broader discussion. And then yes, you should allow me 
to just straight into INSPECTING in this case :)


If it's not implied, then my 

Re: [openstack-dev] [ironic] Re: New API for node create, specifying initial provision state

2015-08-19 Thread Lucas Alvares Gomes
Hi,

 After thinking about this some more, I'm not actually going to address Rob's
 points above. What I want to do is go back and discuss... what do people
 think about having an API that allows the initial provision state to be
 specified, for a node that is created in Ironic. I'm assuming that enroll
 state exists :)

 Earlier today on IRC, Devananda mentioned that there's a very strong case
 for allowing a node to be created in any of the stable states (enroll,
 manageable, available, active). Maybe he'll elaborate later on this. I know
 that there's a use case where there is a desire to import nodes (with
 instances on them) from another system into ironic, and have them be active
 right away. (They don't want the nodes to go from
 enroll-verifying-manageable-cleaning!!!-available!!!-active).


I would like to hear the more elaborated proposal before we start
digging much into this problem.

 1. What would the default provision state be, if it wasn't specified?
 A. 'available' to be backwards compatible with pre-v1.11
 or
 B. 'enroll' to be consistent with v1.11+
 or
 ?


 2. What would it mean to set the initial provision state to something other
 than 'enroll'?

 manageable
 
 In our state machinery[0], a node goes from enroll - verifying -
 manageable. For manageble to be initial state, does it mean that
 A. whatever is needed for enroll and verifying is done and succeeds (under
 the hood)
 or
 B. whatever is needed for enroll is done and succeeds (but no verifying)
 or
 C. no enroll or verifying is done, it goes straight to manageble

 I'm fine with A.I'm not sure that B makes sense and I definitely don't think
 C makes sense. To date, verifying means checking that the conductor can get
 the power state on the node, to verify the supplied power credentials. I
 don't think it is a big deal if we skip this step; it just means that the
 next time some action is taken on the node, it might fail.

 available
 
 In our state machinery, a node goes from enroll - verifying - manageable
 - cleaning - available. For available to be initial state, does it mean
 that
 A. whatever is needed for enroll, verifying, cleaning is done and succeeds
 (under the hood)
 or
 B. whatever is needed for enroll is done and succeeds (but no verifying or
 cleaning)
 or
 ??

 active
 
 In our state machinery, a node goes from enroll - verifying - manageable
 - cleaning - available-deploying-active. For active to be initial state,
 does it mean that
 A. whatever is needed for enroll, verifying, cleaning, deploying is done and
 succeeds (under the hood)
 or
 B. whatever is needed for enroll is done and succeeds (but no verifying or
 cleaning)
 or
 C. whatever is needed for enroll and I dunno, any 'takeover' stuff by
 conductor or whatever node states need to be updated to be in active?


What I'm more concerned about allowing the enroll a node in any stable
state is that it's going to be a big change in our API. We have PATCH
as a mechanism of updating a resource partially because we have
read-only attributes (driver_internal_info, *_updated_at, etc...) in
the API that are internal and should not be updated by the user. Some
states might depend on them i.e a node in ACTIVE state might have
indicators in the driver_internal_info field.

Another thing it's really cross resource, a node in ACTIVE state will
depend on a certain port which it was used to be deployed (and other
things about registering that port in Neutron with the right DHCP
information, so if one is PXE booting after ACTIVE the node won't get
stuck with a boot error. (Also we need to create the right TFTP (or
TFTP + HTTP for iPXE) environment for that node.

Anyway, I don't want to get much deeper, I think we should all be open
to hear what will be proposed with a fresh mind.

Cheers,
Lucas

__
OpenStack Development Mailing List (not for usage questions)
Unsubscribe: openstack-dev-requ...@lists.openstack.org?subject:unsubscribe
http://lists.openstack.org/cgi-bin/mailman/listinfo/openstack-dev


Re: [openstack-dev] [Neutron][bgpvpn] Service Plugin vs Service driver

2015-08-19 Thread Salvatore Orlando
my 0.02€ on the matter inline.

Regards,
Salvatore

On 18 August 2015 at 23:45, Mathieu Rohon mathieu.ro...@gmail.com wrote:

 hi brandon,

 thanks for your answer.

 my answers inline,



 On Tue, Aug 18, 2015 at 8:53 PM, Brandon Logan 
 brandon.lo...@rackspace.com wrote:

 ​So let me make sure I understand this. You want to do a separate service
 plugin for what would normally be separate drivers under one service
 plugin.  The reasons for this are:


 1. You dont want users the ability to choose the type, you want it always
 to be the same one

 While in theory it is be possible to have multiple BGPVPN providers in the
same deployment, there are control and data plane aspects that the service
type framework at the moment cannot deal with it. Mathieu brought some
examples in the bug report. The bottom line appears to be that the choice
of the l3 service plugin (or whatever serves l3 in your deployment) also
dictates the choiche of the BGPVPN service provider to employ.

 2. Some types do want to be the source of truth of the data stored,
 instead of it being the service plugin database.

 This point has little to do with service types. It's about the fact that
plugins are not required to implemented the various db mixins in neutron.db
and therefore not required to use the neutron DB.


 First, let me address the possibility of a solution using one service
 plugin and multiple drivers per type:


 I think that you can overcome #1 in the instantiation of the service
 plugin to check if there are more than 1 provider active, if so you can
 just throw an exception saying you can only have 1.  I'd have to look at it
 more to see if there are any caveats to this, but I think that would work.


 For #2, assuming #1 works, then the drivers that are defined can have
 some boolean that they set that will tell the plugin whether they are the
 source of truth or not, and depending on that you can store the data in the
 service plugin's db or just pass the data along, also pass GET requests to
 the drivers as well.


 I agree that those workarounds will surely works but I wonder what is the
 meaning of a service plugin/type that can only support one service
 provider? can't the service plugin be the service provider directly?


I believe there is some value, but I am not able to quantify it at the
moment.
- A single service plugin also implies (more or less) a common user-facing
APIs. I really don't want to end up in a conditons where the user API looks
different (or the workflow is different) according to what's backing the
neutron BGPVPN implementation
- A single service plugin provides a commonplace for all the boilerplate
management logic. This works for most drivers, but not for those who don't
rely on neutron DB as a data source (unless you manage to build a
sqlalchemy dialect for things such as opencontrail APIs, but I seriously
doubt that it would be feasible)
- Distinct service plugins might lead to different workflows. This is not
necessarily a bad thing, because integration for some backends might need
it. However this means that during review phase particular attention should
be paid to ensure the behaviour of each service plugin respects the API
specification.



 The reasons why I'm considering this change are :

 1. I'm not sure we would have some use cases where we would be able to
 choose one bgpvpn backend independently from the provider of the core
 plugin (or a mech driver in the ML2 case) and/or the router plugin.
 If one use ODL to manage its core resources, he won't be able to use nuage
 or contrail to manage its bgpvpn connection.
 The bgpvpn project is more about having a common API than having the
 capacity to mix backends. At least for the moment.


I agree with this; but this problem exists regardless of whether you have a
single service plugin with drivers or multiple service plugins. You are
unlikely to be able to use the contrail BGPVPN service plugin is core and
l3 are managed by ODL, I think.



 2. I'm also considering that each plugin, which would be backend
 dependent, could declare what features it supports through the use of
 extensions.


Unfortunately extensions are the only way to declare supported capabilities
at the moment. But please - don't end up allowing each service plugin
exposing a different API.


 Each plugin would be a bgpvpn service type, and would implement the
 bgpvpn extension, but some of them could extend the bgpvpn_connection
 resource with other extensions also hosted in the bgpvpn project. Since
 some backends only support attachment of networks to a bgpvpn_connection,
 others support attachment of routers, and others both attachments, I'm
 considering having an extension for each type of attachment. Then the
 bgpvpn plugin declares what extensions it supports and the end user can act
 accordingly depending on the scan of neutron extensions.


This is not good. It appears that you are forced to leak backend details to
API consumers. Is it possible for you 

[openstack-dev] [Fuel] Code review process in Fuel and related issues

2015-08-19 Thread Mike Scherbakov
 Hi all,
let's discuss code review process in Fuel and what we can improve. For
those who want to just have a quick context of this email, please check out
presentation slides [5].

** Issues **
Depending on a Fuel subproject, I'm aware of two buckets of issues with
code review in Fuel:
a) It is hard to get code reviewed and merged
b) Quality of code review itself could be better

First bucket:
1) It is hard to find subject matter experts who can help and core
reviewers for the area of code, especially if you are new to the project
2) Contributor sometimes receives contradicting opinions from other
reviewers, including cores
3) Assigned / responsible core reviewer is needed for a feature in order to
help in architectural negotiations, guiding through, landing the code into
master
4) Long wait time for getting code reviewed

Quality-related items:
5) Not thorough enough, full review in one shot. For example, reviewer can
put -1 due to missed comma, but do not notice major gap in the code. It
leads to many patch sets, and demotivation of contributors
6) Some of the core reviewers decreased their involvement, and so number of
reviews has dropped dramatically. However, they still occasionally merge
code. I propose to remove these cores, and get them back if their
involvement is increased back again (I very rarely merge code, but I'm one
of those to be removed from cores). This is standard practice in OpenStack
community as well, see Neutron as example [4, line 270].
7) As a legacy of the past, we still have old core reviewers being able to
merge code in all Fuel repos. All new cores have core rights only for
single repo, which is their primary area of expertise. For example, core
team size for fuel-library is adidenko + whole fuel-core group [7]. In
fact, there are just 4 trusted or real core reviewers in fuel-library,
not the whole fuel-core group.

These problems are not new to OpenStack and open source in general. You can
find discussions about same and similar issues in [1], [2], [3].


** Analysis of data **
In order to understand what can be improved, I mined the data at first.
Main source of information was stackalytics.com. Please take a look at few
graphs on slides 4-7 [5], built based on data from stackalytics. Major
conclusions from these graphs:
1) Rather small number of core reviewers (in comparison with overall number
of contributors) reviewing 40-60% of patch sets, depending on repo (40%
fuel-library, 60% fuel-web). See slide #4.
2) Load on core reviewers in Fuel team is higher in average, if you compare
it with some other OpenStack projects. Average load on core reviewer across
Nova, Keystone, Neutron and Cinder is 2.5 reviews a day. In Fuel though it
is 3.6 for fuel-web and 4.6 for fuel-library. See slide #6.
3) Statistics on how fast feedback on code proposed is provided:
- fuel-library: 2095 total reviews in 30 days [13], 80 open reviews,
average wait time for reviewer - 1d 1h [12]
- fuel-web: 1789 total reviews in 30 days [14], 52 open reviews, average
wait time for reviewer - 1d 17h [15]

There is no need to have deep analysis on whether we have well defined
areas of ownership in Fuel components or not: we don’t have it formally
defined, and it’s not documented anywhere. So, finding a right core
reviewer can be challenging task for a new contributor to Fuel, and this
issue has to be addressed.


** Proposed solution **
According to stackalytics, for the whole fuel-group we had 262 reviewers
with 24 core reviewers for the past 180 days [19]. I think that these
numbers can be considered as high enough in order to think about structure
in which code review process would be transparent, understandable and
scalable.

Let’s first agree on the terminology which I’d like to use. It can take
pages of precise definitions, however in this email thread I’d like to
focus on code review process more, and hopefully high level description of
roles would be enough for now.
- Contributor: new contributor, who doesn’t work on Fuel regularly and
doesn’t know team structure (or full time Fuel developer, who just started
his work on Fuel)
- SME: subject matter expert of certain Fuel area of code, which he / she
regularly contributes to and reviews code of other contributors into this
area. Example: network checker or Nailgun agent.
- Core Reviewer: expert in one or few parts of Fuel, who was promoted to
Core Reviewers team thanks to the contribution, high rate of quality
reviews.
- Component Lead: The one who defines architecture of a particular module
or component in Fuel, does majority of merges there, resolves conflicts
between SMEs and / or contributors in the area of responsibility, if
conflicts can’t be resolved by other means. Component Lead has to review
all design specs in its parts where his/her component is under change.
- Fuel PTL: Project Team Lead in its OpenStack standard definition [8],
delegates most of the work to component leads, but helps in cases when
resolution of conflicts between 

Re: [openstack-dev] [congress] [murano] Congress jenkins job is failing

2015-08-19 Thread Filip Blaha

Hi Tim

I will try it once  it merges. Thanks

Filio

On 08/18/2015 05:46 PM, Tim Hinrichs wrote:

Hi Filip,

I just submitted a revert of the problematic change.  Once it merges, 
all should be well again.  Sorry for the trouble.


Tim

On Tue, Aug 18, 2015 at 7:57 AM Tim Hinrichs t...@styra.com 
mailto:t...@styra.com wrote:


Looks like we merged a database schema change without the
migration script.  I'm on it.  (We'll get our tempest tests
running in gate again ASAP.)

Tim

On Tue, Aug 18, 2015 at 7:36 AM Filip Blaha filip.bl...@hp.com
mailto:filip.bl...@hp.com wrote:

Hi Congress team.

Our jenkins job testing integration congress and murano is
failing.
Congress fails to start on some DB error [1] . Does anyone
know what
could be the problem?

[1]

http://logs.openstack.org/08/211608/3/check/gate-murano-congress-devstack-dsvm/db1b682/logs/screen-congress.txt.gz#_2015-08-18_10_17_05_033

Thanks
Filip


__
OpenStack Development Mailing List (not for usage questions)
Unsubscribe:
openstack-dev-requ...@lists.openstack.org?subject:unsubscribe
http://openstack-dev-requ...@lists.openstack.org?subject:unsubscribe
http://lists.openstack.org/cgi-bin/mailman/listinfo/openstack-dev



__
OpenStack Development Mailing List (not for usage questions)
Unsubscribe: openstack-dev-requ...@lists.openstack.org?subject:unsubscribe
http://lists.openstack.org/cgi-bin/mailman/listinfo/openstack-dev


__
OpenStack Development Mailing List (not for usage questions)
Unsubscribe: openstack-dev-requ...@lists.openstack.org?subject:unsubscribe
http://lists.openstack.org/cgi-bin/mailman/listinfo/openstack-dev


  1   2   >