[openstack-dev] [Nova] Requirements.txt and optional requirements
Hello! Do dependencies required only in some contexts belong into requirements.txt? Yesterday we had a short discussion on #openstack-nova regarding how to handle optional requirements. This was triggered by our quobyte nova driver (https://review.openstack.org/#/c/110722/18), who requires xattr, which we therefore added to requirements.txt (as it is provided by the requirements project). Points from the discussion: - If we add this we will be adding every requirement for every component --- this becomes to big. - Remove this requirement, no optional entries in requirements.txt, a 'deployer' has to know what dependencies the components he wants to use have --- Usually he does not know and installation becomes more issue prone - Other (in between) ideas??? Please note that this has some urgency, the change set referenced above has been in review for months and i'm trying to react asap on comments but the deadline is approaching (next week) and if i have to do bigger changes I'd like to know as fast as possible... Best regards SIlvan Kaiser -- -- *Quobyte* GmbH Boyenstr. 41 - 10115 Berlin-Mitte - Germany +49-30-814 591 800 - www.quobyte.com Amtsgericht Berlin-Charlottenburg, HRB 149012B management board: Dr. Felix Hupfeld, Dr. Björn Kolbeck, Dr. Jan Stender __ OpenStack Development Mailing List (not for usage questions) Unsubscribe: openstack-dev-requ...@lists.openstack.org?subject:unsubscribe http://lists.openstack.org/cgi-bin/mailman/listinfo/openstack-dev
Re: [openstack-dev] [all] need help with my first commit: The branch 'master' does not exist on the given remote 'gerrit'
Hello. I think there might be something wrong with git-review in your env. You might want try in another env, preferably linux if its handy. I noticed your origin is from github? you should clone from here instead: http://git.openstack.org/cgit/stackforge/congress Here's what you should get when you run the commands to setup the remotes: ~/temp/congress$ git review -s Creating a git remote called gerrit that maps to: ssh://zaro0...@review.openstack.org:29418/stackforge/congress.git ~/temp/congress$ git remote -v gerrit ssh://zaro0...@review.openstack.org:29418/stackforge/congress.git (fetch) gerrit ssh://zaro0...@review.openstack.org:29418/stackforge/congress.git (push) origin https://git.openstack.org/stackforge/congress (fetch) origin https://git.openstack.org/stackforge/congress (push) On Mon, Jan 26, 2015 at 9:09 PM, Tran, Steven steven.tr...@hp.com wrote: Hi, Can someone point out what I miss that results in the following warning? $ git review The branch 'master' does not exist on the given remote 'gerrit'. If these changes are intended to start a new branch, re-run with the '-R' option enabled. I believe I shouldn’t do “git review -R” because it prompts me to submit multiple commits. I can do “git review -s” without any errors. I follow the steps at http://docs.openstack.org/infra/manual/developers.html#starting-a-change I’m using Cygwin. $ git status On branch bp/murano-driver nothing to commit, working directory clean $ git branch * bp/murano-driver master $ git config --list core.repositoryformatversion=0 core.filemode=true core.bare=false core.logallrefupdates=true core.ignorecase=true remote.origin.url=https://github.com/stackforge/congress.git remote.origin.fetch=+refs/heads/*:refs/remotes/origin/* branch.master.remote=origin branch.master.merge=refs/heads/master remote.gerrit.url=ssh:// steven...@review.openstack.org:29418/stackforge/congress.git user.name=Steven Tran user.email=steven.tr...@hp.com gitreview.username=stevenldt $ git log commit 5567b6e4622246ad86cdb9d6c0643427573e8d13 Author: Steven Tran steven.tr...@hp.com Date: Mon Jan 26 17:19:38 2015 -0800 Change-Id: Idc4abf32a7aa25231a7a6df511df998a0a3a50ad Implements: blueprint murano-driver Thanks, -Steven __ OpenStack Development Mailing List (not for usage questions) Unsubscribe: openstack-dev-requ...@lists.openstack.org?subject:unsubscribe http://lists.openstack.org/cgi-bin/mailman/listinfo/openstack-dev __ OpenStack Development Mailing List (not for usage questions) Unsubscribe: openstack-dev-requ...@lists.openstack.org?subject:unsubscribe http://lists.openstack.org/cgi-bin/mailman/listinfo/openstack-dev
[openstack-dev] oslo.i18n 1.3.1 released
The Oslo team is pleased to announce the release of: oslo.i18n 1.3.1: oslo.i18n library The primary reason for this release is a packaging issue reported and fixed by Dan Smith. For more details, please see the git log history below and: http://launchpad.net/oslo.i18n/+milestone/1.3.1 Please report issues through launchpad: http://bugs.launchpad.net/oslo.i18n Changes in /home/dhellmann/repos/openstack/oslo.i18n 1.3.0..1.3.1 - d9b3ca6 Clear global cache in test_get_available_languages e934009 Make setup.cfg packages include oslo.i18n Diffstat (except docs and test files) - setup.cfg| 1 + 2 files changed, 4 insertions(+) __ OpenStack Development Mailing List (not for usage questions) Unsubscribe: openstack-dev-requ...@lists.openstack.org?subject:unsubscribe http://lists.openstack.org/cgi-bin/mailman/listinfo/openstack-dev
Re: [openstack-dev] [Fuel] removing single mode
+1 On Tue, Jan 27, 2015 at 4:05 PM, Aleksandr Didenko adide...@mirantis.com wrote: Hi, After starting implementing granular deployment we've faced a bunch of issues that would make further development of this feature much more complicated if we have to support both Simple and HA deployment modes. For example: simple mode does not require cluster (corosync, pacemaker, vips, etc), so we had to skip this task for Simple mode somehow - we can use conditional tasks, or conditional manifests in our tasks, or create separate task graphs for different deployment modes, etc - either way it's pretty much doubling the amount of work for some parts of Fuel and our development cycle. At the moment, CI blocks us from further development of fuel-library modularization BP [2] because we still use Simple mode in CI. So in order to proceed with this BP we have two options: 1) remove Simple mode from CI/QA and thus drop it completely from Fuel 2) double our efforts to support both Simple and HA modes in granular deployment We have a BP about single-controller HA [1]. HA with single controller works just fine at the moment. So if you want to test Fuel on a minimum set of nodes, you can do this on 3 nodes (Fuel master, controller, compute), just like with Simple mode before. I suppose, it's time to finally drop support for Simple mode in Fuel :) [1] https://blueprints.launchpad.net/fuel/+spec/single-controller-ha [2] https://blueprints.launchpad.net/fuel/+spec/fuel-library-modularization -- Regards, Aleksandr Didenko On Tue, Aug 26, 2014 at 9:25 AM, Mike Scherbakov mscherba...@mirantis.com wrote: Definitely fuel spec is needed :) On Mon, Aug 25, 2014 at 8:45 PM, Evgeniy L e...@mirantis.com wrote: Hi Andrew, I have some comments regarding to you action items 2) Removing simple mode from the ui and tests 3) Removing simple mode support from nailgun (maybe we leave it) and cli We shouldn't do it, because nailgun should handle both versions of cluster. What we have to do here is to use openstack.yaml to keep all possible modes. For new release there will be only ha, to manage previous releases we have to create data migrations in nailgun to create the filed with modes i.e. multinode and ha. Also fixes for ui are required too, I think it mostly related to wizard, 'mode' tab where use can chose ha or non ha cluster in case of new release there should be only ha, and in case of old releases there should be ha and multinode. Thanks, On Mon, Aug 25, 2014 at 8:19 PM, Andrew Woodward xar...@gmail.com wrote: Started a new thread so that we don't hijack the older thread. as Andrew, will you work on it in 6.0? What are remaining items there? Also, it might affect our tests - simple mode runs faster so we use it for smoke ISO test. Anastasia, please confirm that we can switch smoke to one-ha-controller model, or even drop smoke at all and use BVT only (running CentOS 3 HA controllers and same with Ubuntu). The primary reason that we haven't disabled single yet is was due to [0] where we where having problems adding additional controllers. With the changes to galera and rabbit clustering it appears that we ended up fixing it already. The remaining issues are: 1) Ensuring we have good test coverage for the cases we expect to support [1] 2) Removing simple mode from the ui and tests 3) Removing simple mode support from nailgun (maybe we leave it) and cli 4) Updating documentation [0] https://bugs.launchpad.net/fuel/+bug/1350266 [1] https://bugs.launchpad.net/fuel/+bug/1350266/comments/7 -- Andrew Mirantis Ceph community ___ OpenStack-dev mailing list OpenStack-dev@lists.openstack.org http://lists.openstack.org/cgi-bin/mailman/listinfo/openstack-dev ___ OpenStack-dev mailing list OpenStack-dev@lists.openstack.org http://lists.openstack.org/cgi-bin/mailman/listinfo/openstack-dev -- Mike Scherbakov #mihgen ___ OpenStack-dev mailing list OpenStack-dev@lists.openstack.org http://lists.openstack.org/cgi-bin/mailman/listinfo/openstack-dev __ OpenStack Development Mailing List (not for usage questions) Unsubscribe: openstack-dev-requ...@lists.openstack.org?subject:unsubscribe http://lists.openstack.org/cgi-bin/mailman/listinfo/openstack-dev __ OpenStack Development Mailing List (not for usage questions) Unsubscribe: openstack-dev-requ...@lists.openstack.org?subject:unsubscribe http://lists.openstack.org/cgi-bin/mailman/listinfo/openstack-dev
Re: [openstack-dev] [heat][hot]
Thank you very much On Tue, Jan 27, 2015 at 1:06 PM, Angus Salkeld asalk...@mirantis.com wrote: On Tue, Jan 27, 2015 at 7:00 PM, Dmitry mey...@gmail.com wrote: I have another question, is it possible to get the stack name in the hot script? E.g. params: $stack_name: {get_global_variable: $stack.name} See: http://docs.openstack.org/developer/heat/template_guide/hot_spec.html#pseudo-parameters Regards Angus On Tue, Jan 27, 2015 at 3:53 AM, Qiming Teng teng...@linux.vnet.ibm.com wrote: On Mon, Jan 26, 2015 at 07:44:25PM +0200, Dmitry wrote: thanks, exactly what I was looking for: curl http://169.254.169.254/1.0/meta-data/instance-id or, /var/lib/cloud/data/instance-id, if cloud-init is there. Regards, Qiming On Mon, Jan 26, 2015 at 7:31 PM, Zane Bitter zbit...@redhat.com wrote: On 25/01/15 10:41, Dmitry wrote: Hello, I need to receive instance id as part of the instance installation script. Something like: params: $current_id: {get_param: $this.id http://this.id} I have no idea what this is supposed to mean, sorry. Is it possible? The get_resource function will return the server UUID for a server resource, but you can't use it from within that resource itself (it would be a circular reference). The UUID of a server is provided to the server through the Nova metadata; you should retrieve it from there in your user_data script. cheers, Zane. __ OpenStack Development Mailing List (not for usage questions) Unsubscribe: openstack-dev-requ...@lists.openstack.org?subject:unsubscribe http://lists.openstack.org/cgi-bin/mailman/listinfo/openstack-dev __ OpenStack Development Mailing List (not for usage questions) Unsubscribe: openstack-dev-requ...@lists.openstack.org?subject:unsubscribe http://lists.openstack.org/cgi-bin/mailman/listinfo/openstack-dev __ OpenStack Development Mailing List (not for usage questions) Unsubscribe: openstack-dev-requ...@lists.openstack.org?subject:unsubscribe http://lists.openstack.org/cgi-bin/mailman/listinfo/openstack-dev __ OpenStack Development Mailing List (not for usage questions) Unsubscribe: openstack-dev-requ...@lists.openstack.org?subject:unsubscribe http://lists.openstack.org/cgi-bin/mailman/listinfo/openstack-dev __ OpenStack Development Mailing List (not for usage questions) Unsubscribe: openstack-dev-requ...@lists.openstack.org?subject:unsubscribe http://lists.openstack.org/cgi-bin/mailman/listinfo/openstack-dev __ OpenStack Development Mailing List (not for usage questions) Unsubscribe: openstack-dev-requ...@lists.openstack.org?subject:unsubscribe http://lists.openstack.org/cgi-bin/mailman/listinfo/openstack-dev
[openstack-dev] Hyper-V meeting
Hi All, Due to weather conditions and others traveling we will need to postpone the Hyper-V meeting until next week. For issues or questions please email directly or contact one of us on the IRC channel. We will resume next week at the usual time. p Peter J. Pouliot CISSP Microsoft Cloud+Enterprise Solutions C:\OpenStack New England Research Development Center 1 Memorial Drive Cambridge, MA 02142 P: 1.(857).4536436 E: ppoul...@microsoft.commailto:ppoul...@microsoft.com __ OpenStack Development Mailing List (not for usage questions) Unsubscribe: openstack-dev-requ...@lists.openstack.org?subject:unsubscribe http://lists.openstack.org/cgi-bin/mailman/listinfo/openstack-dev
Re: [openstack-dev] [Policy][Group-based-policy] Policy violations investigation
Hi Ariel, This is indeed one of the use cases that is very relevant to, and can be supported, with the GBP model. The GBP policy actions provide a way to “redirect” to a service-instance/chain on matching a traffic classifier. If you are able to represent the “honeypot” functionality as a Neutron advanced service, or wrap it in an implemented service, then you can integrate it with today’s implementation. The GBP team will be happy to provide you with more information on how you can propose and implement any changes that you may need to make for this integration. Also, feel free to catch us in #openstack-gbp and/or during the GBP weekly IRC meeting [1]. Thanks, ~Sumit. [1] https://wiki.openstack.org/wiki/Meetings/Neutron_Group_Policy On Tue, Jan 27, 2015 at 8:19 AM, Ariel Zeitlin ariel.zeit...@gmail.com wrote: Hi, I want to propose an idea of investigation of policy violations (for white-list policies defined by GBP) by, for instance, redirecting the violating sessions to a HoneyPot. Meaning, that if the only communication between Group A and Group B is by port 80 (as described in the GPB) then an access to port 22 from Group A to Group B will be redirected to and answered by a HoneyPot that will investigate the real reason for policy violation, or simply log and drop the violating connection attempt. In tightly defined policies world as achieved through GBP an attacker trying to propagate inside the network is more likely to hit a wall and then actually create a golden lead for his detection. Do you think this concept can/should to be part of GBP and what would be the best way to promote it (sorry, I am pretty new to OpenStack and GBP specifically). Thanks, Ariel __ OpenStack Development Mailing List (not for usage questions) Unsubscribe: openstack-dev-requ...@lists.openstack.org?subject:unsubscribe http://lists.openstack.org/cgi-bin/mailman/listinfo/openstack-dev __ OpenStack Development Mailing List (not for usage questions) Unsubscribe: openstack-dev-requ...@lists.openstack.org?subject:unsubscribe http://lists.openstack.org/cgi-bin/mailman/listinfo/openstack-dev
Re: [openstack-dev] [tc] do we really need project tags in the governance repository?
Excerpts from Thierry Carrez's message of 2015-01-27 02:46:03 -0800: Doug Hellmann wrote: On Mon, Jan 26, 2015, at 12:02 PM, Thierry Carrez wrote: [...] I'm open to alternative suggestions on where the list of tags, their definition and the list projects they apply to should live. If you don't like that being in the governance repository, what would have your preference ? From the very beginning I have taken the position that tags are by themselves not sufficiently useful for evaluating projects. If someone wants to choose between Ceilometer, Monasca, or StackTach, we're unlikely to come up with tags that will let them do that. They need in-depth discussions of deployment options, performance characteristics, and feature trade-offs. They are still useful to give people a chance to discover that those 3 are competing in the same space, and potentially get an idea of which one (if any) is deployed on more than one public cloud, better documented, or security-supported. I agree with you that an (opinionated) article comparing those 3 solutions would be a nice thing to have, but I'm just saying that basic, clearly-defined reference project metadata still has a lot of value, especially as we grow the number of projects. I agree with your statement that summary reference metadata is useful. I agree with Doug that it is inappropriate for the TC to assign it. That said, I object to only saying this is all information that can be found elsewhere or should live elsewhere, because that is just keeping the current situation -- where that information exists somewhere but can't be efficiently found by our downstream consumers. We need a taxonomy and clear definitions for tags, so that our users can easily find, understand and navigate such project metadata. As someone new to the project, I would not think to look in the governance documents for state information about a project. I would search for things like install guide openstack or component list openstack and expect to find them in the documentation. So I think putting the information in those (or similar) places will actually make it easier to find for someone that hasn't been involved in the discussion of tags and the governance repository. The idea here is to have the reference information in some Gerrit-controlled repository (currently openstack/governance, but I'm open to moving this elsewhere), and have that reference information consumed by the openstack.org website when you navigate to the Software section, to present a browseable/searchable list of projects with project metadata. I don't expect anyone to read the YAML file from the governance repository. On the other hand, the software section of the openstack.org website is by far the most visited page of all our web properties, so I expect most people to see that. Just like we gather docs and specs into single websites, we could also gather project metadata. Let the projects set their tags. One thing that might make sense for the TC to do is to elevate certain tags to a more important status that they _will_ provide guidance on when to use. However, the actual project to tag mapping would work quite well as a single file in whatever repository the project team thinks would be the best starting point for a new user. __ OpenStack Development Mailing List (not for usage questions) Unsubscribe: openstack-dev-requ...@lists.openstack.org?subject:unsubscribe http://lists.openstack.org/cgi-bin/mailman/listinfo/openstack-dev
Re: [openstack-dev] [Fuel] removing single mode
not to prolong single mode, I'd like to see it die. However we will need to be able to add, change, remove, or noop portions of the tasks graph in the future. Many of the plugins that cant currently be built would rely on being able to sub out parts of the graph. How is that going to factor into granular deployments? On Tue, Jan 27, 2015 at 5:05 AM, Aleksandr Didenko adide...@mirantis.com wrote: Hi, After starting implementing granular deployment we've faced a bunch of issues that would make further development of this feature much more complicated if we have to support both Simple and HA deployment modes. For example: simple mode does not require cluster (corosync, pacemaker, vips, etc), so we had to skip this task for Simple mode somehow - we can use conditional tasks, or conditional manifests in our tasks, or create separate task graphs for different deployment modes, etc - either way it's pretty much doubling the amount of work for some parts of Fuel and our development cycle. At the moment, CI blocks us from further development of fuel-library modularization BP [2] because we still use Simple mode in CI. So in order to proceed with this BP we have two options: 1) remove Simple mode from CI/QA and thus drop it completely from Fuel 2) double our efforts to support both Simple and HA modes in granular deployment We have a BP about single-controller HA [1]. HA with single controller works just fine at the moment. So if you want to test Fuel on a minimum set of nodes, you can do this on 3 nodes (Fuel master, controller, compute), just like with Simple mode before. I suppose, it's time to finally drop support for Simple mode in Fuel :) [1] https://blueprints.launchpad.net/fuel/+spec/single-controller-ha [2] https://blueprints.launchpad.net/fuel/+spec/fuel-library-modularization -- Regards, Aleksandr Didenko On Tue, Aug 26, 2014 at 9:25 AM, Mike Scherbakov mscherba...@mirantis.com wrote: Definitely fuel spec is needed :) On Mon, Aug 25, 2014 at 8:45 PM, Evgeniy L e...@mirantis.com wrote: Hi Andrew, I have some comments regarding to you action items 2) Removing simple mode from the ui and tests 3) Removing simple mode support from nailgun (maybe we leave it) and cli We shouldn't do it, because nailgun should handle both versions of cluster. What we have to do here is to use openstack.yaml to keep all possible modes. For new release there will be only ha, to manage previous releases we have to create data migrations in nailgun to create the filed with modes i.e. multinode and ha. Also fixes for ui are required too, I think it mostly related to wizard, 'mode' tab where use can chose ha or non ha cluster in case of new release there should be only ha, and in case of old releases there should be ha and multinode. Thanks, On Mon, Aug 25, 2014 at 8:19 PM, Andrew Woodward xar...@gmail.com wrote: Started a new thread so that we don't hijack the older thread. as Andrew, will you work on it in 6.0? What are remaining items there? Also, it might affect our tests - simple mode runs faster so we use it for smoke ISO test. Anastasia, please confirm that we can switch smoke to one-ha-controller model, or even drop smoke at all and use BVT only (running CentOS 3 HA controllers and same with Ubuntu). The primary reason that we haven't disabled single yet is was due to [0] where we where having problems adding additional controllers. With the changes to galera and rabbit clustering it appears that we ended up fixing it already. The remaining issues are: 1) Ensuring we have good test coverage for the cases we expect to support [1] 2) Removing simple mode from the ui and tests 3) Removing simple mode support from nailgun (maybe we leave it) and cli 4) Updating documentation [0] https://bugs.launchpad.net/fuel/+bug/1350266 [1] https://bugs.launchpad.net/fuel/+bug/1350266/comments/7 -- Andrew Mirantis Ceph community ___ OpenStack-dev mailing list OpenStack-dev@lists.openstack.org http://lists.openstack.org/cgi-bin/mailman/listinfo/openstack-dev ___ OpenStack-dev mailing list OpenStack-dev@lists.openstack.org http://lists.openstack.org/cgi-bin/mailman/listinfo/openstack-dev -- Mike Scherbakov #mihgen ___ OpenStack-dev mailing list OpenStack-dev@lists.openstack.org http://lists.openstack.org/cgi-bin/mailman/listinfo/openstack-dev __ OpenStack Development Mailing List (not for usage questions) Unsubscribe: openstack-dev-requ...@lists.openstack.org?subject:unsubscribe http://lists.openstack.org/cgi-bin/mailman/listinfo/openstack-dev -- Andrew Mirantis Fuel community ambassador Ceph community __ OpenStack Development
Re: [openstack-dev] [Fuel] Getting rid of kickstart/preseed for all NEW releases
I don't see this as crazy, it's not a feature of the cloud, its a mechanism to get us there. It's not even something that most of the time anyone sees. Continuing to waste time supporting something we are ready to replace, and have been testing for a release already is crazy. It adds to the technical debt around provisioning that is broken a chlot of the time. We spend around 11% of all commits of fuel-library to cobbler, templates, pmanager etc It's also not removing it, it will continue to be present to support prior releases, so it's even still available if we cant make IBP work the way we need to. On Tue, Jan 27, 2015 at 2:23 AM, Vladimir Kozhukalov vkozhuka...@mirantis.com wrote: Guys, First, we are not talking about deliberate disabling preseed based approach just because we so crazy. The question is What is the best way to achieve our 6.1 goals? We definitely need to be able to install two versions of Ubuntu 12.04 and 14.04. Those versions have different sets of packages (for example ntp related ones) and we install some of those packages during provisioning (we point out which packages we need with their versions). To make this working with preseed based approach we need either to insert some IF release==6.1 conditional lines into preseed (not very beautiful, isn't it?) or to create different Distros and Profiles for different releases. Second is not a problem for Cobbler but it is for nailgun/astute because we do not deal with that stuff and it looks that we cannot implement this easily. IMO, the only options we have are to insert IFs into preseed (I would say it is not more reliable than IBP) or to refuse preseed approach for ONLY NEW UPCOMING releases. You can call crazy but for me having a set IFs together with pmanager.py which are absolutely difficult to maintain is crazy. Vladimir Kozhukalov On Tue, Jan 27, 2015 at 3:03 AM, Andrew Woodward xar...@gmail.com wrote: On Mon, Jan 26, 2015 at 10:47 AM, Sergii Golovatiuk sgolovat...@mirantis.com wrote: Until we are sure IBP solves operation phase where we need to deliver updated packages so client will be able to provision new machines with these fixed packages, I would leave backward compatibility with normal provision. ... Just in case. doesn't running 'apt-get upgrade' or 'yum update' after laying out the FS image resolve the gap until we can rebuild the images on the fly? -- Best regards, Sergii Golovatiuk, Skype #golserge IRC #holser On Mon, Jan 26, 2015 at 4:56 PM, Vladimir Kozhukalov vkozhuka...@mirantis.com wrote: My suggestion is to make IBP the only option available for all upcoming OpenStack releases which are defined in openstack.yaml. It is to be possible to install OS using kickstart for all currently available OpenStack releases. Vladimir Kozhukalov On Mon, Jan 26, 2015 at 6:22 PM, Igor Kalnitsky ikalnit...@mirantis.com wrote: Just want to be sure I understand you correctly: do you propose to FORBID kickstart/preseed installation way in upcoming release at all? On Mon, Jan 26, 2015 at 3:59 PM, Vladimir Kozhukalov vkozhuka...@mirantis.com wrote: Subject is changed. Vladimir Kozhukalov On Mon, Jan 26, 2015 at 4:55 PM, Vladimir Kozhukalov vkozhuka...@mirantis.com wrote: Dear Fuelers, As you might know we need it to be possible to install several versions of a particular OS (Ubuntu and Centos) by 6.1 As far as having different OS versions also means having different sets of packages and some of the packages are installed and configured during provisioning stage, we need to have a kind of kickstart/preseed version mechanism. Cobbler is exactly such a mechanism. It allows us to have several Distros (installer images) and profiles (kickstart/preseed files). But unfortunately, for some reasons we have not been using those Cobbler's capabilities since the beginning of Fuel and it doesn't seem to be easily introduced into Nailgun to deal with the whole Cobbler life cycle. Anyway, we are moving towards IBP (image based provisioning) and we already have different images connected to different OpenStack releases (openstack.yaml) and everything else which is necessary for initial node configuration is serialized inside provision data (including profile name like 'ubuntu_1204' or 'ubuntu_1404') and we are able to choose cloud-init template by this profile name. And taking into account what it is written above, the suggestion is to completely avoid using kickstart/preseed based way of OS provisioning by 6.1 for all new releases allowing ONLY old ones to use this way. Any opinions about that stuff are welcome. Vladimir Kozhukalov __ OpenStack Development Mailing List (not for usage questions)
Re: [openstack-dev] [cinder] [nova] [scheduler] Nova node name passed to Cinder
On Jan 26, 2015, at 10:16 PM, Philipp Marek philipp.ma...@linbit.com wrote: Hello Vish, Nova passes ip, iqn, and hostname into initialize_connection. That should give you the info you need. thank you, but that is on the _Nova_ side. I need to know that on the Cinder node already: For that the cinder volume driver needs to know at ... time which Nova host will be used to access the data. but it's not passed in there: The arguments passed to this functions already include an attached_host value, sadly it's currently given as None... Therefore my question where/when that value is calculated… Initialize connection passes that data to cinder in the call. The connector dictionary in the call should contain the info from nova: https://github.com/openstack/cinder/blob/master/cinder/volume/driver.py#L1051 Regards, Phil -- : Ing. Philipp Marek : LINBIT | Your Way to High Availability : DRBD/HA support and consulting http://www.linbit.com : DRBD® and LINBIT® are registered trademarks of LINBIT, Austria. __ OpenStack Development Mailing List (not for usage questions) Unsubscribe: openstack-dev-requ...@lists.openstack.org?subject:unsubscribe http://lists.openstack.org/cgi-bin/mailman/listinfo/openstack-dev __ OpenStack Development Mailing List (not for usage questions) Unsubscribe: openstack-dev-requ...@lists.openstack.org?subject:unsubscribe http://lists.openstack.org/cgi-bin/mailman/listinfo/openstack-dev
Re: [openstack-dev] [Telco][NFV] Meeting facilitator for January 28th
- Original Message - From: Marc Koderer m...@koderer.com To: OpenStack Development Mailing List (not for usage questions) openstack-dev@lists.openstack.org Hi Steve, I can host it. Regards Marc Thanks Marc! __ OpenStack Development Mailing List (not for usage questions) Unsubscribe: openstack-dev-requ...@lists.openstack.org?subject:unsubscribe http://lists.openstack.org/cgi-bin/mailman/listinfo/openstack-dev
Re: [openstack-dev] [keystone] Flush expired tokens automatically ?
Thanks Adam, Thierry! Dani On Tue, Jan 27, 2015 at 1:43 PM, Adam Young ayo...@redhat.com wrote: Short term answers: The amount of infrastructure we would have to build to replicate CRON is not worth it. Figuring out a CRON strategy for nontrivial deployment is part of a larger data management scheme. Long term answers: Tokens should not be persisted. We have been working toward ephemeral tokens for a long time, but the vision of how to get there is not uniformly shared among the team. We spent a lot of time arguing about AE tokens, which looked promising, but do not support federation. Where we are headed is a split of the data in the token into an ephemeral portion and a persisted portion. The persisted portion would be reused, and would represent the delegation of authority. The epehmeral portion will represent the time aspects of the token: when issued, when expired, etc. The ephemeral portion would refer to the persisted portion. The revocation events code is necessary for PKI tokens, and might be required depending on how we do the ephemeral/persisted split. With AE tokens it would have been necessary, but with a unified delegation mechanism, it would be less so. If anyone feels the need for ephemeral tokens strongly enough to contribute, please let me know. We've put a lot of design into where we are today, and I would encourage you to learn the issues before jumping in to the solutions. I'm more than willing to guide any new development along these lines. __ OpenStack Development Mailing List (not for usage questions) Unsubscribe: openstack-dev-requ...@lists.openstack.org?subject:unsubscribe http://lists.openstack.org/cgi-bin/mailman/listinfo/openstack-dev __ OpenStack Development Mailing List (not for usage questions) Unsubscribe: openstack-dev-requ...@lists.openstack.org?subject:unsubscribe http://lists.openstack.org/cgi-bin/mailman/listinfo/openstack-dev
Re: [openstack-dev] [Openstack-operators] [openstack-operators] [Keystone] flush expired tokens and moves deleted instance
Excerpts from Tim Bell's message of 2015-01-25 22:10:10 -0800: This is often mentioned as one of those items which catches every OpenStack cloud operator at some time. It's not clear to me that there could not be a scheduled job built into the system with a default frequency (configurable, ideally). If we are all configuring this as a cron job, is there a reason that it could not be built into the code ? It has come up before. The main reason not to build it into the code as it's even better to just _never store tokens_: https://blueprints.launchpad.net/keystone/+spec/non-persistent-tokens http://git.openstack.org/cgit/openstack/keystone-specs/plain/specs/juno/non-persistent-tokens.rst or just use certs: https://blueprints.launchpad.net/keystone/+spec/keystone-tokenless-authz-with-x509-ssl-client-cert The general thought is that putting lots of things in the database that don't need to be stored anywhere is a bad idea. The need for the cron job is just a symptom of that bug. __ OpenStack Development Mailing List (not for usage questions) Unsubscribe: openstack-dev-requ...@lists.openstack.org?subject:unsubscribe http://lists.openstack.org/cgi-bin/mailman/listinfo/openstack-dev
Re: [openstack-dev] [Openstack-operators] [openstack-operators] [Keystone] flush expired tokens and moves deleted instance
This is one reason to use the memcached backend. Why replicate these tokens in the first place. On Tuesday, January 27, 2015 at 10:21 AM, Clint Byrum wrote: Excerpts from Tim Bell's message of 2015-01-25 22:10:10 -0800: This is often mentioned as one of those items which catches every OpenStack cloud operator at some time. It's not clear to me that there could not be a scheduled job built into the system with a default frequency (configurable, ideally). If we are all configuring this as a cron job, is there a reason that it could not be built into the code ? It has come up before. The main reason not to build it into the code as it's even better to just _never store tokens_: https://blueprints.launchpad.net/keystone/+spec/non-persistent-tokens http://git.openstack.org/cgit/openstack/keystone-specs/plain/specs/juno/non-persistent-tokens.rst or just use certs: https://blueprints.launchpad.net/keystone/+spec/keystone-tokenless-authz-with-x509-ssl-client-cert The general thought is that putting lots of things in the database that don't need to be stored anywhere is a bad idea. The need for the cron job is just a symptom of that bug. __ OpenStack Development Mailing List (not for usage questions) Unsubscribe: openstack-dev-requ...@lists.openstack.org?subject:unsubscribe (mailto:openstack-dev-requ...@lists.openstack.org?subject:unsubscribe) http://lists.openstack.org/cgi-bin/mailman/listinfo/openstack-dev __ OpenStack Development Mailing List (not for usage questions) Unsubscribe: openstack-dev-requ...@lists.openstack.org?subject:unsubscribe http://lists.openstack.org/cgi-bin/mailman/listinfo/openstack-dev
Re: [openstack-dev] [oslo] temporarily disabling python 3.x testing for oslo.messaging and oslo.rootwrap
On Tue, Jan 27, 2015, at 12:44 PM, Julien Danjou wrote: On Tue, Jan 27 2015, Clark Boylan wrote: So the issue is that the garbage collector segfaults on null objects in the to be garbage collected list. Which means that by the time garbage collection breaks you don't have the info you need to know what references lead to the segfault. I spent a bit of time in gdb debugging this and narrowed it down enough to realize what the bug was and find it was fixed in later python releases but didn't have the time to sort out how to figure out specifically which references in oslo.messaging caused the garbage collector to fall over. ╯‵Д′)╯彡┻━┻ Ok, then let's disable it I guess. If there's a chance to keep something has even a non-voting job, that'd be cool, but I'm not even sure that's an option if it just doesn't work and we can't keep py33. I did think about a non-voting job, but there's not much point. We expect it to fail with the segfault, so we would just be wasting resources. :-/ -- Julien Danjou ;; Free Software hacker ;; http://julien.danjou.info __ OpenStack Development Mailing List (not for usage questions) Unsubscribe: openstack-dev-requ...@lists.openstack.org?subject:unsubscribe http://lists.openstack.org/cgi-bin/mailman/listinfo/openstack-dev Email had 1 attachment: + signature.asc 1k (application/pgp-signature) __ OpenStack Development Mailing List (not for usage questions) Unsubscribe: openstack-dev-requ...@lists.openstack.org?subject:unsubscribe http://lists.openstack.org/cgi-bin/mailman/listinfo/openstack-dev
Re: [openstack-dev] [oslo.messaging] Performance testing. Initial steps.
On Tue, Jan 27, 2015, at 12:28 PM, Denis Makogon wrote: On Tue, Jan 27, 2015 at 7:15 PM, Doug Hellmann d...@doughellmann.com wrote: On Tue, Jan 27, 2015, at 10:56 AM, Denis Makogon wrote: On Thu, Jan 15, 2015 at 8:56 PM, Doug Hellmann d...@doughellmann.com wrote: On Jan 15, 2015, at 1:30 PM, Denis Makogon dmako...@mirantis.com wrote: Good day to All, The question that i’d like to raise here is not simple one, so i’d like to involve as much readers as i can. I’d like to speak about oslo.messaging performance testing. As community we’ve put lots of efforts in making oslo.messaging widely used drivers stable as much as possible. Stability is a good thing, but is it enough for saying “works well”? I’d say that it’s not. Since oslo.messaging uses driver-based messaging workflow, it makes sense to dig into each driver and collect all required/possible performance metrics. First of all, it does make sense to figure out how to perform performance testing, first that came into my mind is to simulate high load on one of corresponding drivers. Here comes the question of how it can be accomplished withing available oslo.messaging tools - high load on any driver can perform an application that: • can populate multiple emitters(rpc clients) and consumers (rpc servers). • can force clients to send messages of pre-defined number of messages of any length. That makes sense. Another thing is why do we need such thing. Profiling, performance testing can improve the way in which our drivers were implemented. It can show us actual “bottlenecks” in messaging process, in general. In some cases it does make sense to figure out where problem takes its place - whether AMQP causes messaging problems or certain driver that speaks to AMQP fails. Next thing that i want to discuss the architecture of profiling/performance testing. As i can see it seemed to be a “good” way to add profiling code to each driver. If there’s any objection or better solution, please bring them to the light. What sort of extra profiling code do you anticipate needing? As i can foresee (taking into account [1]) couple decorators, possibly one that handles metering process. The biggest part of code will take highload tool that'll be a part of messaging. But another question adding certain dependecies to the project. Once we’d have final design for profiling we would need to figure out tools for profiling. After searching over the web, i found pretty interesting topic related to python profiling [1]. After certain investigations it does makes sense discuss next profiling options(apply one or both): • Line-by-line timing and execution frequency with a profiler (there are possible Pros and Cons, but i would say the per-line statistics is more than appreciable at initial performance testing steps) • Memory/CPU consumption Metrics. The most useful metric for us is time, any time-based metric, since it is very useful to know at which step or/and by whom delay/timeout caused, for example, so as it said, we would be able to figure out whether AMQP or driver fails to do what it was designed for. Before proposing spec i’d like to figure out any other requirements, use cases and restrictions for messaging performance testing. Also, if there any stories of success in boosting python performance - feel free to share it. The metrics to measure depend on the goal. Do we think the messaging code is using too much memory? Is it too slow? Or is there something else causing concern? It does make sense to have profiling for cases when trying to upscale cluster and it'll be a good thing to have an ability to figure out if scaled AMQP service has it's best configuration (i guess here would come the question about doing performance testing using well-known tools), and the most interesting question is about how messaging driver decreases (or leaves untouched) throughput between RPC client and server. This metering results can be compared to those tools that were designed for performance testing. And that's why it'll be good step forward having profiling/performance testing using high load technic. That makes it sound like you want to build performance testing tools for the infrastructure oslo.messaging is using, and not for oslo.messaging itself. Is that right? I'd like to build tool that would be able to profile messaging over various deployments. This tool would give me an ability to compare results of performance testing produced by native tools and oslo.messaging-based tool, eventually it would lead us into digging into code and trying to figure out where bad things are
Re: [openstack-dev] [keystone] Flush expired tokens automatically ?
Short term answers: The amount of infrastructure we would have to build to replicate CRON is not worth it. Figuring out a CRON strategy for nontrivial deployment is part of a larger data management scheme. Long term answers: Tokens should not be persisted. We have been working toward ephemeral tokens for a long time, but the vision of how to get there is not uniformly shared among the team. We spent a lot of time arguing about AE tokens, which looked promising, but do not support federation. Where we are headed is a split of the data in the token into an ephemeral portion and a persisted portion. The persisted portion would be reused, and would represent the delegation of authority. The epehmeral portion will represent the time aspects of the token: when issued, when expired, etc. The ephemeral portion would refer to the persisted portion. The revocation events code is necessary for PKI tokens, and might be required depending on how we do the ephemeral/persisted split. With AE tokens it would have been necessary, but with a unified delegation mechanism, it would be less so. If anyone feels the need for ephemeral tokens strongly enough to contribute, please let me know. We've put a lot of design into where we are today, and I would encourage you to learn the issues before jumping in to the solutions. I'm more than willing to guide any new development along these lines. __ OpenStack Development Mailing List (not for usage questions) Unsubscribe: openstack-dev-requ...@lists.openstack.org?subject:unsubscribe http://lists.openstack.org/cgi-bin/mailman/listinfo/openstack-dev
[openstack-dev] oslo.messaging 1.6.0 released
The Oslo team is pleased to announce the release of: oslo.messaging 1.6.0: Oslo Messaging API The primary reason for this release is to move the code out of the oslo namespace package as part of https://blueprints.launchpad.net/oslo-incubator/+spec/drop-namespace-packages This release also includes requirements updates, and several months worth of bug fixes. For more details, please see the git log history below and: http://launchpad.net/oslo.messaging/+milestone/1.6.0 Please report issues through launchpad: http://bugs.launchpad.net/oslo.messaging Changes in /home/dhellmann/repos/openstack/oslo.messaging 1.5.1..1.6.0 -- bfb8c97 Updated from global requirements eb92511 Expose _impl_test for designate ee31a84 Update Oslo imports to remove namespace package 563376c Speedup the rabbit tests f286ef1 Fix functionnal tests db7371c Fixed docstring for Notifier 386f5da zmq: Refactor test case shared code 7680897 Add more private symbols to the old namespace package 2832051 Updated from global requirements b888ee3 Fixes test_two_pools_three_listener 0c49f0d Add TimerTestCase missing tests case be9fca7 fix qpid test issue with eventlet monkey patching 0ca1b1e Make setup.cfg packages include oslo.messaging 408d0da Upgrade to hacking 0.10 a6d068a Add oslo.messaging._drivers.common for heat tests 1fa0e6a Port zmq driver to Python 3 bc8675a fix qpid test issue with eventlet monkey patching e55a83e Move files out of the namespace package 31a149a Add a info log when a reconnection occurs 44132d4 rabbit: fix timeout timer when duration is None c18f9f7 Don't log each received messages 3e2d142 Fix some comments in a backporting review session c40ba04 Enable IPv6-support in libzmq by default 372bc49 Add a thread + futures executor based executor 56a9c55 safe_log Sanitize Passwords in List of Dicts 709c401 Updated from global requirements 98bfdd1 rabbit: add some tests when rpc_backend is set d3e6ea1 Warns user if thread monkeypatch is not done cd71c47 Add functional and unit 0mq driver tests 15aa5cb The executor doesn't need to set the timeout 43a9dc1 qpid: honor iterconsume timeout 023b7f4 rabbit: more precise iterconsume timeout 737afde Workflow documentation is now in infra-manual 66db2b3 Touch up grammar in warning messages 4e6dabb Make the RPCVersionCapError message clearer 254405d Doc: 'wait' releases driver connection, not 'stop' 09cd9c0 Don't allow call with fanout target 0844037 Add an optional executor callback to dispatcher eb21f6b Warn user if needed when the process is forked 7ad0d7e Fix reconnect race condition with RabbitMQ cluster 1624793 Add more TLS protocols to rabbit impl 6987b8a Fix incorrect attribute name in matchmaker_redis Diffstat (except docs and test files) - CONTRIBUTING.rst | 7 +- oslo/messaging/__init__.py | 15 + oslo/messaging/_cmd/__init__.py| 1 - oslo/messaging/_cmd/zmq_receiver.py| 39 - oslo/messaging/_drivers/__init__.py| 1 - oslo/messaging/_drivers/amqp.py| 222 - oslo/messaging/_drivers/amqpdriver.py | 472 -- oslo/messaging/_drivers/base.py| 108 --- oslo/messaging/_drivers/common.py | 343 +--- oslo/messaging/_drivers/impl_fake.py | 233 - oslo/messaging/_drivers/impl_qpid.py | 731 oslo/messaging/_drivers/impl_rabbit.py | 783 - oslo/messaging/_drivers/impl_zmq.py| 941 oslo/messaging/_drivers/matchmaker.py | 321 --- oslo/messaging/_drivers/matchmaker_redis.py| 139 --- oslo/messaging/_drivers/matchmaker_ring.py | 104 --- oslo/messaging/_drivers/pool.py| 88 -- oslo/messaging/_drivers/protocols/__init__.py | 0 oslo/messaging/_drivers/protocols/amqp/__init__.py | 0 .../_drivers/protocols/amqp/controller.py | 589 - oslo/messaging/_drivers/protocols/amqp/driver.py | 295 --- .../messaging/_drivers/protocols/amqp/eventloop.py | 339 --- oslo/messaging/_drivers/protocols/amqp/opts.py | 73 -- oslo/messaging/_executors/base.py | 33 +- oslo/messaging/_executors/impl_blocking.py | 56 -- oslo/messaging/_executors/impl_eventlet.py | 112 --- oslo/messaging/_i18n.py| 35 - oslo/messaging/_utils.py | 41 - oslo/messaging/conffixture.py | 67 +- oslo/messaging/exceptions.py | 29 +- oslo/messaging/localcontext.py | 44 +- oslo/messaging/notify/__init__.py | 1 + oslo/messaging/notify/_impl_log.py | 35 - oslo/messaging/notify/_impl_messaging.py | 60 -- oslo/messaging/notify/_impl_noop.py
[openstack-dev] [Telco][NFV] Meeting reminder - Wednesday 28th @ 1400 UTC in #openstack-meeting-alt
Hi all, Just a friendly reminder that this week's OpenStack Telco Working Group meeting is tomorrow, Wednesday the 28th, at 1400 UTC in #openstack-meeting-alt. Please add any items you wish to discuss to the agenda at: https://etherpad.openstack.org/p/nfv-meeting-agenda Marc Koderer has kindly stepped up to run the meeting in my absence. Thanks, Steve __ OpenStack Development Mailing List (not for usage questions) Unsubscribe: openstack-dev-requ...@lists.openstack.org?subject:unsubscribe http://lists.openstack.org/cgi-bin/mailman/listinfo/openstack-dev
Re: [openstack-dev] [Fuel] Cluster replaced deployment of provisioning information
Dmitry This is an interesting topic. As per our discussions earlier, I suggest that in the future we move to different serializers for each granule of our deployment, so that we do not need to drag a lot of senseless data into particular task being executed. Say, we have a fencing task, which has a serializer module written in python. This module is imported by Nailgun and what it actually does, it executes specific Nailgun core methods that access database or other sources of information and retrieve data in the way this task wants it instead of adjusting the task to the only 'astute.yaml'. On Thu, Jan 22, 2015 at 8:59 PM, Evgeniy L e...@mirantis.com wrote: Hi Dmitry, The problem with merging is usually it's not clear how system performs merging. For example you have the next hash {'list': [{'k': 1}, {'k': 2}, {'k': 3}]}, and I want {'list': [{'k': 4}]} to be merged, what system should do? Replace the list or add {'k': 4}? Both cases should be covered. Most of the users don't remember all of the keys, usually user gets the defaults, and changes some values in place, in this case we should ask user to remove the rest of the fields. The only solution which I see is to separate the data from the graph, not to send this information to user. Thanks, On Thu, Jan 22, 2015 at 5:18 PM, Dmitriy Shulyak dshul...@mirantis.com wrote: Hi guys, I want to discuss the way we are working with deployment configuration that were redefined for cluster. In case it was redefined by API - we are using that information instead of generated. With one exception, we will generate new repo sources and path to manifest if we are using update (patching feature in 6.0). Starting from 6.1 this configuration will be populated by tasks, which is a part of granular deployment workflow and replacement of configuration will lead to inability to use partial graph execution API. Ofcourse it is possible to hack around and make it work, but imo we need generic solution. Next problem - if user will upload replaced information, changes on cluster attributes, or networks, wont be reflected in deployment anymore and it constantly leads to problems for deployment engineers that are using fuel. What if user want to add data, and use generated of networks, attributes, etc? - it may be required as a part of manual plugin installation (ha_fencing requires a lot of configuration to be added into astute.yaml), - or you need to substitute networking data, e.g add specific parameters for linux bridges So given all this, i think that we should not substitute all information, but only part that is present in redefined info, and if there is additional parameters they will be simply merged into generated info __ OpenStack Development Mailing List (not for usage questions) Unsubscribe: openstack-dev-requ...@lists.openstack.org?subject:unsubscribe http://lists.openstack.org/cgi-bin/mailman/listinfo/openstack-dev __ OpenStack Development Mailing List (not for usage questions) Unsubscribe: openstack-dev-requ...@lists.openstack.org?subject:unsubscribe http://lists.openstack.org/cgi-bin/mailman/listinfo/openstack-dev -- Yours Faithfully, Vladimir Kuklin, Fuel Library Tech Lead, Mirantis, Inc. +7 (495) 640-49-04 +7 (926) 702-39-68 Skype kuklinvv 45bk3, Vorontsovskaya Str. Moscow, Russia, www.mirantis.com http://www.mirantis.ru/ www.mirantis.ru vkuk...@mirantis.com __ OpenStack Development Mailing List (not for usage questions) Unsubscribe: openstack-dev-requ...@lists.openstack.org?subject:unsubscribe http://lists.openstack.org/cgi-bin/mailman/listinfo/openstack-dev
Re: [openstack-dev] [Fuel][Agent] Moving Fuel Agent to a separate repo
Mike, You are absolutely right about our current priorities for 6.1 and this thread is not about immediate action. But just to be fair, moving Fuel Client to a separate repo was a priori much more complicated procedure because it is tested together with nailgun. For Fuel Agent we just need to create a separate repo (30 minutes) and make changes for fuel-main (30 minutes). There is nothing to worry about because it is completely independent. And taking into account our recent activities about integrating it with Ironic I would say there is no reason to postpone this until 7.0 Alexander, As for fuel_agent_ci, it is not used currently on the regular basis, so I think we need it to be moved to the same separate repo and then one day in the future maybe we will use it for functional testing. Vladimir Kozhukalov On Tue, Jan 27, 2015 at 1:39 AM, Roman Prykhodchenko m...@romcheg.me wrote: I think the idea is not to work on it right at this moment but to accept the general idea of fuel-agent being moved somewhere it can be alone. I’m not sure there is one single approach for separating a component from the common repository because each of them has their own use-cases and requirements so for every single one of them there is a need to do the same job as we’ve done for Fuel Client. Thar said I’d like to note that only by having a clear specification of how work- data- and test-flaws have to be changed after the component is put to its own repository it will be possible to judge on the time frame and the number of resources required to accomplish this task. - romcheg 26 січ. 2015 о 20:39 Mike Scherbakov mscherba...@mirantis.com написав(ла): -1 to make changes now +1 to Alexandra Let's finish fuel-client first. Also, it is about prioritization. We have many things to be resolved in 6.1 (e.g. package the rest of the stuff which not yet packaged into RPM/DEB; split repos openstack/fuel/linux, etc.), and fuel agent in particular has pretty low priority to me in 6.1. In examples I have provided, which are essential for 6.1, we are experiencing lack of hands. Let's see if we can focus our work on those items and many other essential things, and come to this question later. On Mon, Jan 26, 2015 at 10:29 PM, Aleksandra Fedorova afedor...@mirantis.com wrote: It seems that we have general agreement about the idea, but to make it happen we need much more detailed proposal. Even with python-fuelclient it is not quite clear right now, which version of nailgun should be used to test it, and the opposite: which version of fuelclient we have to use in iso builds. We also don't handle it in the build system very well right now, as we use git hashes, and not fixed versions, or packages. Maybe we should complete the python-fuelclient transformation first and see how it is going to work for us? On Jan 26, 2015 8:59 PM, Roman Prykhodchenko m...@romcheg.me wrote: Vladimir, As a fuel-separatist I give this initiative a big +1 because of the following advantages I can see: - Git is designed for keeping smaller single-compoent repos, keeping everything to one repo is a discouraged pattern - Having a separate -core group that will only contain active core reviewers for fuel-agent project so getting core-reviews will be easier. - It makes possible to re-use some of the existing jobs in OpenStack CI - Making independent releases becomes possible AFAIK fuel-agent is positioned as an independent provisioning tool which will not be exclusively used by Fuel. There is a work in progress to integrate it with Ironic. Integrating it to any other provisioning system should also be possible then. From that perspective putting it into its own repo also brings the following advantages: - Connecting 3rd party CI will be possible - Getting involved for the new folks will be much easier - romcheg 26 січ. 2015 о 17:42 Vladimir Kozhukalov vkozhuka...@mirantis.com написав(ла): Fuelers, As most of you might know we have a bunch of projects inside fuel-web repo which are not directly related to Fuel Web application. Some of them are tested together and it seemed we could end up with a set of incompatibility issues if we separated them and stopped tracking their versions on the git level (instead of release level). Recent activities about separating Fuel Client from Nailgun (api) make me think we are mature enough to move all other not related project out of fuel-web repo and bring them together not earlier than on the stage of system/functional testing. Next step would be moving out Fuel Agent project. The reason is that it is independent and potentially could be used even out of Fuel because its data parsing mechanism is implemented so as to be agnostic to the data format. Some people could be potentially interested in using it independently with their own data format. It is tested together with other
Re: [openstack-dev] [Fuel] [UI] Deploy Changes dialog redesign
Guys, I'm now here and I don't agree that we need to remove changes attribute. On the opposite, I think this is the only attribute which should be looked at on UI and backend, and all these pending_addition and pending_someotherstuff are obsolete and needless. Just assume, that we'll soon have some plugin or just some tech which allows us to modify some settings on UI after environment was deployed and somehow apply it onto nodes (like, for example, we're planning such thing for VMWare). In this case there is no any pending_addition or some other stuff, these are just changes to apply on a node somehow, maybe just execute some script on them. And the same goes to a lot of cases with plugins, which do some services on target nodes configurable. Pending_addition flag, on the other hand, is useless, because all changes we should apply on node are already listed in changes attribute. We can even probably add provisioning and deployment into these pending changes do avoid logic duplication. But still, as for me, this is the only working mechanism we should consider and which will really help us to cver complex cases in the future. On Tue, Jan 27, 2015 at 10:52 AM, Mike Scherbakov mscherba...@mirantis.com wrote: +1, I do not think it's usable as how it is now. Let's think though if we can come up with better idea how to show what has been changed (or even otherwise, what was not touched - and so might bring a surprise later). We might want to think about it after wizard-like UI is implemented. On Mon, Jan 26, 2015 at 8:26 PM, Igor Kalnitsky ikalnit...@mirantis.com wrote: +1 for removing attribute. @Evgeniy, I'm not sure that this attribute really shows all changes that's going to be done. On Mon, Jan 26, 2015 at 7:11 PM, Evgeniy L e...@mirantis.com wrote: To be more specific, +1 for removing this information from UI, not from backend. On Mon, Jan 26, 2015 at 7:46 PM, Evgeniy L e...@mirantis.com wrote: Hi, I agree that this information is useless, but it's not really clear what you are going to show instead, will you completely remove the information about nodes for deployment? I think the list of nodes for deployment (without detailed list of changes) can be useful for the user. Thanks, On Mon, Jan 26, 2015 at 7:23 PM, Vitaly Kramskikh vkramsk...@mirantis.com wrote: +1 for removing changes attribute. It's useless now. If there are no plans to add something else there, let's remove it. 2015-01-26 11:39 GMT+03:00 Julia Aranovich jkirnos...@mirantis.com: Hi All, Since we changed Deploy Changes pop-up and added processing of role limits and restrictions I would like to raise a question of it's subsequent refactoring. In particular, I mean 'changes' attribute of cluster model. It's displayed in Deploy Changes dialog in the following format: Changed disks configuration on the following nodes: node_name_list Changed interfaces configuration on the following nodes: node_name_list Changed network settings Changed OpenStack settings This list looks absolutely useless. It doesn't make any sense to display lists of new, not deployed nodes with changed disks/interfaces. It's obvious I think that new nodes attributes await deployment. At the same time user isn't able to change disks/interfaces on deployed nodes (at least in UI). So, such node name lists are definitely redundant. Networks and settings are also locked after deployment finished. I tend to get rid of cluster model 'changes' attribute at all. It is important for me to know your opinion, to make a final decision. Please feel free and share your ideas and concerns if any. Regards, Julia -- Kind Regards, Julia Aranovich, Software Engineer, Mirantis, Inc +7 (905) 388-82-61 (cell) Skype: juliakirnosova www.mirantis.ru jaranov...@mirantis.com __ OpenStack Development Mailing List (not for usage questions) Unsubscribe: openstack-dev-requ...@lists.openstack.org?subject:unsubscribe http://lists.openstack.org/cgi-bin/mailman/listinfo/openstack-dev -- Vitaly Kramskikh, Fuel UI Tech Lead, Mirantis, Inc. __ OpenStack Development Mailing List (not for usage questions) Unsubscribe: openstack-dev-requ...@lists.openstack.org?subject:unsubscribe http://lists.openstack.org/cgi-bin/mailman/listinfo/openstack-dev __ OpenStack Development Mailing List (not for usage questions) Unsubscribe: openstack-dev-requ...@lists.openstack.org?subject:unsubscribe http://lists.openstack.org/cgi-bin/mailman/listinfo/openstack-dev __ OpenStack Development Mailing List (not
Re: [openstack-dev] [keystone] Flush expired tokens automatically ?
Updating subject line to attract keystone devs Daniel Comnea wrote: +100 Dani On Mon, Jan 26, 2015 at 1:10 AM, Tim Bell tim.b...@cern.ch mailto:tim.b...@cern.ch wrote: This is often mentioned as one of those items which catches every OpenStack cloud operator at some time. It’s not clear to me that there could not be a scheduled job built into the system with a default frequency (configurable, ideally). __ __ If we are all configuring this as a cron job, is there a reason that it could not be built into the code ? __ __ Tim __ __ *From:*Mike Smith [mailto:mism...@overstock.com mailto:mism...@overstock.com] *Sent:* 24 January 2015 18:08 *To:* Daniel Comnea *Cc:* OpenStack Development Mailing List (not for usage questions); openstack-operat...@lists.openstack.org mailto:openstack-operat...@lists.openstack.org *Subject:* Re: [Openstack-operators] [openstack-dev][openstack-operators]flush expired tokens and moves deleted instance __ __ It is still mentioned in the Juno installation docs: __ __ By default, the Identity service stores expired tokens in the database indefinitely. The accumulation of expired tokens considerably increases the database size and might degrade service performance, particularly in environments with limited resources. We recommend that you use cron to configure a periodic task that purges expired tokens hourly: # (crontab -l -u keystone 21 | grep -q token_flush) || \ echo '@hourly /usr/bin/keystone-manage token_flush /var/log/keystone/ keystone-tokenflush.log 21' \ /var/spool/cron/keystone __ __ __ __ Mike Smith Principal Engineer, Website Systems Overstock.com http://Overstock.com __ __ On Jan 24, 2015, at 10:03 AM, Daniel Comnea comnea.d...@gmail.com mailto:comnea.d...@gmail.com wrote: __ __ Hi all, I just bumped into Sebastien's blog where he suggested a cron job should run in production to tidy up expired tokens - see blog[1] Could you please remind me if this is still required in IceHouse/ Juno? (i kind of remember i've seen some work being done in this direction but i can't find the emails) Thanks, Dani [1] http://www.sebastien-han.fr/blog/2014/08/18/a-must-have-cron-job-on-your-openstack-cloud/ ___ OpenStack-operators mailing list openstack-operat...@lists.openstack.org mailto:openstack-operat...@lists.openstack.org http://lists.openstack.org/cgi-bin/mailman/listinfo/openstack-operators __ __ __ __ CONFIDENTIALITY NOTICE: This message is intended only for the use and review of the individual or entity to which it is addressed and may contain information that is privileged and confidential. If the reader of this message is not the intended recipient, or the employee or agent responsible for delivering the message solely to the intended recipient, you are hereby notified that any dissemination, distribution or copying of this communication is strictly prohibited. If you have received this communication in error, please notify sender immediately by telephone or return email. Thank you. __ OpenStack Development Mailing List (not for usage questions) Unsubscribe: openstack-dev-requ...@lists.openstack.org?subject:unsubscribe http://lists.openstack.org/cgi-bin/mailman/listinfo/openstack-dev -- Thierry Carrez (ttx) __ OpenStack Development Mailing List (not for usage questions) Unsubscribe: openstack-dev-requ...@lists.openstack.org?subject:unsubscribe http://lists.openstack.org/cgi-bin/mailman/listinfo/openstack-dev
[openstack-dev] Cross-Project meeting, Tue January 27th, 21:00 UTC
Dear PTLs, cross-project liaisons and anyone else interested, We'll have a cross-project meeting today at 21:00 UTC, with the following agenda: * Cross-project DevRef akin to Nova's ([1]) [2] (@sigmavirus24) * Avoiding private symbols in Oslo libraries [3] (dhellmann) * Discuss the importance of getting cross-project reviews of guidelines (e.g. [4]) and how to best go about getting those reviews for the API working group [5] (etoews) * Progress (or lack thereof) on providing default config files * openstack-specs discussion * CLI Sorting Argument Guidelines [6] -- ready to move to TC final approval ? * Add TRACE definition to log guidelines [7] * Open discussion announcements [1] http://docs.openstack.org/developer/nova/devref/development.environment.html [2] http://lists.openstack.org/pipermail/openstack-dev/2015-January/054837.html [3] http://lists.openstack.org/pipermail/openstack-dev/2015-January/054810.html [4] https://review.openstack.org/#/c/145579/ [5] https://wiki.openstack.org/wiki/API_Working_Group [6] https://review.openstack.org/#/c/145544/ [7] https://review.openstack.org/#/c/145245/ See you there ! For more details on this meeting, please see: https://wiki.openstack.org/wiki/Meetings/CrossProjectMeeting -- Thierry Carrez (ttx) __ OpenStack Development Mailing List (not for usage questions) Unsubscribe: openstack-dev-requ...@lists.openstack.org?subject:unsubscribe http://lists.openstack.org/cgi-bin/mailman/listinfo/openstack-dev
Re: [openstack-dev] [Murano] SQLite support - drop or not?
On 26.01.2015 18:34, Ruslan Kamaldinov wrote: On Mon, Jan 26, 2015 at 6:12 PM, Andrew Pashkin apash...@mirantis.com wrote: On 26.01.2015 18:05, Ruslan Kamaldinov wrote: I think it's still important to perform migration specific checks. We want to make sure that DB is in expected state after each specific migration. Why? 1. It's not just the schema we care about. It's the effect of particular DB migration script on data stored in DB. We need to make sure that data is not corrupted or lost in any way 2. Some migrations add or remove indexes and constraints, we might want to test that Ok, I got it =) -- With kind regards, Andrew Pashkin. cell phone - +7 (985) 898 57 59 Skype - waves_in_fluids e-mail - apash...@mirantis.com __ OpenStack Development Mailing List (not for usage questions) Unsubscribe: openstack-dev-requ...@lists.openstack.org?subject:unsubscribe http://lists.openstack.org/cgi-bin/mailman/listinfo/openstack-dev
Re: [openstack-dev] [heat][hot]
I have another question, is it possible to get the stack name in the hot script? E.g. params: $stack_name: {get_global_variable: $stack.name} On Tue, Jan 27, 2015 at 3:53 AM, Qiming Teng teng...@linux.vnet.ibm.com wrote: On Mon, Jan 26, 2015 at 07:44:25PM +0200, Dmitry wrote: thanks, exactly what I was looking for: curl http://169.254.169.254/1.0/meta-data/instance-id or, /var/lib/cloud/data/instance-id, if cloud-init is there. Regards, Qiming On Mon, Jan 26, 2015 at 7:31 PM, Zane Bitter zbit...@redhat.com wrote: On 25/01/15 10:41, Dmitry wrote: Hello, I need to receive instance id as part of the instance installation script. Something like: params: $current_id: {get_param: $this.id http://this.id} I have no idea what this is supposed to mean, sorry. Is it possible? The get_resource function will return the server UUID for a server resource, but you can't use it from within that resource itself (it would be a circular reference). The UUID of a server is provided to the server through the Nova metadata; you should retrieve it from there in your user_data script. cheers, Zane. __ OpenStack Development Mailing List (not for usage questions) Unsubscribe: openstack-dev-requ...@lists.openstack.org?subject:unsubscribe http://lists.openstack.org/cgi-bin/mailman/listinfo/openstack-dev __ OpenStack Development Mailing List (not for usage questions) Unsubscribe: openstack-dev-requ...@lists.openstack.org?subject:unsubscribe http://lists.openstack.org/cgi-bin/mailman/listinfo/openstack-dev __ OpenStack Development Mailing List (not for usage questions) Unsubscribe: openstack-dev-requ...@lists.openstack.org?subject:unsubscribe http://lists.openstack.org/cgi-bin/mailman/listinfo/openstack-dev __ OpenStack Development Mailing List (not for usage questions) Unsubscribe: openstack-dev-requ...@lists.openstack.org?subject:unsubscribe http://lists.openstack.org/cgi-bin/mailman/listinfo/openstack-dev
[openstack-dev] [tc] Take back the naming process
I do not like how we are selecting names for our releases right now. The current process is autocratic and opaque and not fun - which is the exact opposite of what a community selected name should be. I propose: * As soon as development starts on release X, we open the voting for the name of release X+1 (we're working on Kilo now, we should have known the name of L at the K summit) * Anyone can nominate a name - although we do suggest that something at least related to the location of the associated summit would be nice * We condorcet vote on the entire list of nominated names * After we have the winning list, the foundation trademark checks the name * If there is a trademark issue (and only a trademark issue - not a marketing doesn't like the name issue) we'll move down to the next name on the list If we cannot have this process be completely open and democratic, then what the heck is the point of having our massive meritocracy in the first place? There's a lot of overhead we deal with by being a leaderless collective you know - we should occasionally get to have fun with it. Monty __ OpenStack Development Mailing List (not for usage questions) Unsubscribe: openstack-dev-requ...@lists.openstack.org?subject:unsubscribe http://lists.openstack.org/cgi-bin/mailman/listinfo/openstack-dev
Re: [openstack-dev] [oslo.messaging] Performance testing. Initial steps.
On 01/27/2015 06:31 PM, Doug Hellmann wrote: On Tue, Jan 27, 2015, at 12:28 PM, Denis Makogon wrote: I'd like to build tool that would be able to profile messaging over various deployments. This tool would give me an ability to compare results of performance testing produced by native tools and oslo.messaging-based tool, eventually it would lead us into digging into code and trying to figure out where bad things are happening (that's the actual place where we would need to profile messaging code). Correct me if i'm wrong. It would be interesting to have recommendations for deployment of rabbit or qpid based on performance testing with oslo.messaging. It would also be interesting to have recommendations for changes to the implementation of oslo.messaging based on performance testing. I'm not sure you want to do full-stack testing for the latter, though. Either way, I think you would be able to start the testing without any changes in oslo.messaging. I agree. I think the first step is to define what to measure and then construct an application using olso.messaging that allows the data of interest to be captured using different drivers and indeed different configurations of a given driver. I wrote a very simple test application to test one aspect that I felt was important, namely the scalability of the RPC mechanism as you increase the number of clients and servers involved. The code I used is https://github.com/grs/ombt, its probably stale at the moment, I only link to it as an example of approach. Using that test code I was then able to compare performance in this one aspect across drivers (the 'rabbit', 'qpid' and new amqp 1.0 based drivers _ I wanted to try zmq, but couldn't figure out how to get it working at the time), and for different deployment options using a given driver (amqp 1.0 using qpidd or qpid dispatch router in either standalone or with multiple connected routers). There are of course several other aspects that I think would be important to explore: notifications, more specific variations in the RPC 'topology' i.e. number of clients on given server number of servers in single group etc, and a better tool (or set of tools) would allow all of these to be explored. From my experimentation, I believe the biggest differences in scalability are going to come not from optimising the code in oslo.messaging so much as choosing different patterns for communication. Those choices may be constrained by other aspects as well of course, notably approach to reliability. __ OpenStack Development Mailing List (not for usage questions) Unsubscribe: openstack-dev-requ...@lists.openstack.org?subject:unsubscribe http://lists.openstack.org/cgi-bin/mailman/listinfo/openstack-dev
[openstack-dev] [nova] [api] Get servers with limit and IP address filter
Hello, When applying an IP address filter to a paginated servers query (eg, supplying servers/detail?ip=192.168limit=100), the IP address filtering is only being applied against the non-filtered page of servers that were retrieved from the DB; see [1]. I believe that the IP address filtering should be done before the limit is applied, returning up to limit servers that match the IP address filter. Currently, if the servers in the page of data returned from the DB do not happen to match the IP address filter (applied in the compute API), then no servers will be returned by the REST API (even if there are servers that match the IP address filter). This seems like a bug to me, shouldn't all filtering be done at the DB layer? [1]: https://github.com/openstack/nova/blob/master/nova/compute/api.py#L2037-L2042 Thanks, Steven Kaufer__ OpenStack Development Mailing List (not for usage questions) Unsubscribe: openstack-dev-requ...@lists.openstack.org?subject:unsubscribe http://lists.openstack.org/cgi-bin/mailman/listinfo/openstack-dev
Re: [openstack-dev] [Openstack-operators] [openstack-operators] [Keystone] flush expired tokens and moves deleted instance
The problem with running in memcached is now you have to keep _EVERY_ token in RAM. This is not any cheaper than cleaning out a giant on-disk table. Also worth noting is that memcached can produce frustrating results unless you run it with -M. That is because without -M, your tokens may be removed well before their expiration and well before memcached fills up if the slabs that are allocated in the early days of running are filled up. Also single users that have many tokens will overrun the per-item limit in memcached with the size of the token ID list. There's no magic bullet.. just trade-offs that may or may not work well for your site. Excerpts from John Dewey's message of 2015-01-27 10:41:33 -0800: This is one reason to use the memcached backend. Why replicate these tokens in the first place. On Tuesday, January 27, 2015 at 10:21 AM, Clint Byrum wrote: Excerpts from Tim Bell's message of 2015-01-25 22:10:10 -0800: This is often mentioned as one of those items which catches every OpenStack cloud operator at some time. It's not clear to me that there could not be a scheduled job built into the system with a default frequency (configurable, ideally). If we are all configuring this as a cron job, is there a reason that it could not be built into the code ? It has come up before. The main reason not to build it into the code as it's even better to just _never store tokens_: https://blueprints.launchpad.net/keystone/+spec/non-persistent-tokens http://git.openstack.org/cgit/openstack/keystone-specs/plain/specs/juno/non-persistent-tokens.rst or just use certs: https://blueprints.launchpad.net/keystone/+spec/keystone-tokenless-authz-with-x509-ssl-client-cert The general thought is that putting lots of things in the database that don't need to be stored anywhere is a bad idea. The need for the cron job is just a symptom of that bug. __ OpenStack Development Mailing List (not for usage questions) Unsubscribe: openstack-dev-requ...@lists.openstack.org?subject:unsubscribe (mailto:openstack-dev-requ...@lists.openstack.org?subject:unsubscribe) http://lists.openstack.org/cgi-bin/mailman/listinfo/openstack-dev __ OpenStack Development Mailing List (not for usage questions) Unsubscribe: openstack-dev-requ...@lists.openstack.org?subject:unsubscribe http://lists.openstack.org/cgi-bin/mailman/listinfo/openstack-dev
Re: [openstack-dev] [Swift] Swift GUI (free or open source)?
https://github.com/cschwede/django-swiftbrowser is done by a swift core dev You should browse: http://docs.openstack.org/developer/swift/associated_projects.html#associated-projects On Mon, Jan 26, 2015 at 11:50 AM, Adam Lawson alaw...@aqorn.com wrote: I'm researching for a web-based visualization that simply displays OpenStack Swift and/or node status, cluster health etc in some manner. being able to run a command would be cool but a little more than I need. Does such a thing currently exist? I know about SwiftStack but I'm wondering if there are other efforts that have produced a way to visualize Swift telemetry. Has anyone run across such a thing? *Adam Lawson* AQORN, Inc. 427 North Tatnall Street Ste. 58461 Wilmington, Delaware 19801-2230 Toll-free: (844) 4-AQORN-NOW ext. 101 International: +1 302-387-4660 Direct: +1 916-246-2072 __ OpenStack Development Mailing List (not for usage questions) Unsubscribe: openstack-dev-requ...@lists.openstack.org?subject:unsubscribe http://lists.openstack.org/cgi-bin/mailman/listinfo/openstack-dev __ OpenStack Development Mailing List (not for usage questions) Unsubscribe: openstack-dev-requ...@lists.openstack.org?subject:unsubscribe http://lists.openstack.org/cgi-bin/mailman/listinfo/openstack-dev
Re: [openstack-dev] [tc] Take back the naming process
On Tue, Jan 27, 2015 at 1:50 PM, Monty Taylor mord...@inaugust.com wrote: I do not like how we are selecting names for our releases right now. The current process is autocratic and opaque and not fun - which is the exact opposite of what a community selected name should be. ++ I propose: * As soon as development starts on release X, we open the voting for the name of release X+1 (we're working on Kilo now, we should have known the name of L at the K summit) * Anyone can nominate a name - although we do suggest that something at least related to the location of the associated summit would be nice * We condorcet vote on the entire list of nominated names * After we have the winning list, the foundation trademark checks the name * If there is a trademark issue (and only a trademark issue - not a marketing doesn't like the name issue) we'll move down to the next name on the list Huge +1 here. If we cannot have this process be completely open and democratic, then what the heck is the point of having our massive meritocracy in the first place? There's a lot of overhead we deal with by being a leaderless collective you know - we should occasionally get to have fun with it. Agree with all your points Monty. This puts naming into the hands of the individual foundation members. Seems like it should be there. Monty __ OpenStack Development Mailing List (not for usage questions) Unsubscribe: openstack-dev-requ...@lists.openstack.org?subject:unsubscribe http://lists.openstack.org/cgi-bin/mailman/listinfo/openstack-dev __ OpenStack Development Mailing List (not for usage questions) Unsubscribe: openstack-dev-requ...@lists.openstack.org?subject:unsubscribe http://lists.openstack.org/cgi-bin/mailman/listinfo/openstack-dev
Re: [openstack-dev] required libvirtd/qemu versions for numa support?
On 01/26/2015 05:37 PM, Jay Pipes wrote: On 01/26/2015 07:33 AM, Chris Friesen wrote: Hi, I'm interested in the recent work around NUMA support for guest instances (https://blueprints.launchpad.net/nova/+spec/virt-driver-numa-placement), but I'm having some difficulty figuring out what versions of libvirt and qemu are required. From the research that I've done it seems like qemu 2.1 might be required, but I've been unable to find a specific version listed in the nova requirements or in the openstack global requirements. Is it there and I just can't find it? If it's not specified, and yet openstack relies on it, perhaps it should be added. (Or at least documented somewhere.) Hi Chris, The constants starting here: http://git.openstack.org/cgit/openstack/nova/tree/nova/virt/libvirt/driver.py#n340 should answer your questions. Thanks, that's useful. Looking at the history of that file, I see git commit d927635 adding in support for NUMA memory allocation policy using the libvirt numatune option, but it doesn't modify the libvirt or qemu version requirements. When I asked on the libvirt list they said that qemu 2.1 was needed to support pinning memory on host NUMA nodes. Do we get around that somehow? Also, the _get_host_numa_topology() code uses pages.size and pages.total which would seem to depend on hugepages support in libvirt, but that was only added in 1.2.6. I don't see any hugepage-related versions listed here for libvirt. (I actually ran into a problem here before upgrading libvirt, it threw an exception in _get_host_numa_topology(). If I recall it was because cell.mempages was empty since libvirt was too old.) Chris __ OpenStack Development Mailing List (not for usage questions) Unsubscribe: openstack-dev-requ...@lists.openstack.org?subject:unsubscribe http://lists.openstack.org/cgi-bin/mailman/listinfo/openstack-dev
Re: [openstack-dev] [Fuel] removing single mode
not to prolong single mode, I'd like to see it die. However we will need to be able to add, change, remove, or noop portions of the tasks graph in the future. Many of the plugins that cant currently be built would rely on being able to sub out parts of the graph. How is that going to factor into granular deployments? There is several ways to achieve noop task: 1. By condition on task itself (same expression parser that is used for UI validation). Right now we are able to add condtion like, cluster:mode != multinode, but the problem is additional complexity to support different chains of tasks, and additional refactoring in library. 2. Skip particular task in deployment API call As for plugins and add/stubout/change - all of this is possible, there is no plugins API for that stuff, and we will need to think what exactly we want to expose, but from granular deployment perspective it is just a matter of changing data for particular task in graph __ OpenStack Development Mailing List (not for usage questions) Unsubscribe: openstack-dev-requ...@lists.openstack.org?subject:unsubscribe http://lists.openstack.org/cgi-bin/mailman/listinfo/openstack-dev
Re: [openstack-dev] oslo.messaging 1.6.0 released
There were some issues with the build job, so this release has just gone live. I apologize for the delay. Doug On Tue, Jan 27, 2015, at 02:05 PM, Doug Hellmann wrote: The Oslo team is pleased to announce the release of: oslo.messaging 1.6.0: Oslo Messaging API The primary reason for this release is to move the code out of the oslo namespace package as part of https://blueprints.launchpad.net/oslo-incubator/+spec/drop-namespace-packages This release also includes requirements updates, and several months worth of bug fixes. For more details, please see the git log history below and: http://launchpad.net/oslo.messaging/+milestone/1.6.0 Please report issues through launchpad: http://bugs.launchpad.net/oslo.messaging Changes in /home/dhellmann/repos/openstack/oslo.messaging 1.5.1..1.6.0 -- bfb8c97 Updated from global requirements eb92511 Expose _impl_test for designate ee31a84 Update Oslo imports to remove namespace package 563376c Speedup the rabbit tests f286ef1 Fix functionnal tests db7371c Fixed docstring for Notifier 386f5da zmq: Refactor test case shared code 7680897 Add more private symbols to the old namespace package 2832051 Updated from global requirements b888ee3 Fixes test_two_pools_three_listener 0c49f0d Add TimerTestCase missing tests case be9fca7 fix qpid test issue with eventlet monkey patching 0ca1b1e Make setup.cfg packages include oslo.messaging 408d0da Upgrade to hacking 0.10 a6d068a Add oslo.messaging._drivers.common for heat tests 1fa0e6a Port zmq driver to Python 3 bc8675a fix qpid test issue with eventlet monkey patching e55a83e Move files out of the namespace package 31a149a Add a info log when a reconnection occurs 44132d4 rabbit: fix timeout timer when duration is None c18f9f7 Don't log each received messages 3e2d142 Fix some comments in a backporting review session c40ba04 Enable IPv6-support in libzmq by default 372bc49 Add a thread + futures executor based executor 56a9c55 safe_log Sanitize Passwords in List of Dicts 709c401 Updated from global requirements 98bfdd1 rabbit: add some tests when rpc_backend is set d3e6ea1 Warns user if thread monkeypatch is not done cd71c47 Add functional and unit 0mq driver tests 15aa5cb The executor doesn't need to set the timeout 43a9dc1 qpid: honor iterconsume timeout 023b7f4 rabbit: more precise iterconsume timeout 737afde Workflow documentation is now in infra-manual 66db2b3 Touch up grammar in warning messages 4e6dabb Make the RPCVersionCapError message clearer 254405d Doc: 'wait' releases driver connection, not 'stop' 09cd9c0 Don't allow call with fanout target 0844037 Add an optional executor callback to dispatcher eb21f6b Warn user if needed when the process is forked 7ad0d7e Fix reconnect race condition with RabbitMQ cluster 1624793 Add more TLS protocols to rabbit impl 6987b8a Fix incorrect attribute name in matchmaker_redis Diffstat (except docs and test files) - CONTRIBUTING.rst | 7 +- oslo/messaging/__init__.py | 15 + oslo/messaging/_cmd/__init__.py| 1 - oslo/messaging/_cmd/zmq_receiver.py| 39 - oslo/messaging/_drivers/__init__.py| 1 - oslo/messaging/_drivers/amqp.py| 222 - oslo/messaging/_drivers/amqpdriver.py | 472 -- oslo/messaging/_drivers/base.py| 108 --- oslo/messaging/_drivers/common.py | 343 +--- oslo/messaging/_drivers/impl_fake.py | 233 - oslo/messaging/_drivers/impl_qpid.py | 731 oslo/messaging/_drivers/impl_rabbit.py | 783 - oslo/messaging/_drivers/impl_zmq.py| 941 oslo/messaging/_drivers/matchmaker.py | 321 --- oslo/messaging/_drivers/matchmaker_redis.py| 139 --- oslo/messaging/_drivers/matchmaker_ring.py | 104 --- oslo/messaging/_drivers/pool.py| 88 -- oslo/messaging/_drivers/protocols/__init__.py | 0 oslo/messaging/_drivers/protocols/amqp/__init__.py | 0 .../_drivers/protocols/amqp/controller.py | 589 - oslo/messaging/_drivers/protocols/amqp/driver.py | 295 --- .../messaging/_drivers/protocols/amqp/eventloop.py | 339 --- oslo/messaging/_drivers/protocols/amqp/opts.py | 73 -- oslo/messaging/_executors/base.py | 33 +- oslo/messaging/_executors/impl_blocking.py | 56 -- oslo/messaging/_executors/impl_eventlet.py | 112 --- oslo/messaging/_i18n.py| 35 - oslo/messaging/_utils.py | 41 - oslo/messaging/conffixture.py | 67 +- oslo/messaging/exceptions.py | 29 +-
Re: [openstack-dev] [tc] Take back the naming process
++ absolutely! Sent via mobile On Jan 27, 2015, at 14:19, Jim Meyer j...@geekdaily.org wrote: +1 all the way down. More fun double-plus-good. —j On Jan 27, 2015, at 1:50 PM, Monty Taylor mord...@inaugust.com wrote: I do not like how we are selecting names for our releases right now. The current process is autocratic and opaque and not fun - which is the exact opposite of what a community selected name should be. I propose: * As soon as development starts on release X, we open the voting for the name of release X+1 (we're working on Kilo now, we should have known the name of L at the K summit) * Anyone can nominate a name - although we do suggest that something at least related to the location of the associated summit would be nice * We condorcet vote on the entire list of nominated names * After we have the winning list, the foundation trademark checks the name * If there is a trademark issue (and only a trademark issue - not a marketing doesn't like the name issue) we'll move down to the next name on the list If we cannot have this process be completely open and democratic, then what the heck is the point of having our massive meritocracy in the first place? There's a lot of overhead we deal with by being a leaderless collective you know - we should occasionally get to have fun with it. Monty __ OpenStack Development Mailing List (not for usage questions) Unsubscribe: openstack-dev-requ...@lists.openstack.org?subject:unsubscribe http://lists.openstack.org/cgi-bin/mailman/listinfo/openstack-dev __ OpenStack Development Mailing List (not for usage questions) Unsubscribe: openstack-dev-requ...@lists.openstack.org?subject:unsubscribe http://lists.openstack.org/cgi-bin/mailman/listinfo/openstack-dev __ OpenStack Development Mailing List (not for usage questions) Unsubscribe: openstack-dev-requ...@lists.openstack.org?subject:unsubscribe http://lists.openstack.org/cgi-bin/mailman/listinfo/openstack-dev
Re: [openstack-dev] [Fuel] Cluster replaced deployment of provisioning information
On Thu, Jan 22, 2015 at 7:59 PM, Evgeniy L e...@mirantis.com wrote: The problem with merging is usually it's not clear how system performs merging. For example you have the next hash {'list': [{'k': 1}, {'k': 2}, {'k': 3}]}, and I want {'list': [{'k': 4}]} to be merged, what system should do? Replace the list or add {'k': 4}? Both cases should be covered. What if we will replace based on root level? It feels enough for me. Most of the users don't remember all of the keys, usually user gets the defaults, and changes some values in place, in this case we should ask user to remove the rest of the fields. And we are not going to force them delete something - if all information is present than it is what user actually wants. The only solution which I see is to separate the data from the graph, not to send this information to user. Probably, i will follow same approach that is used for repo generation, mainly because it is quite usefull for debuging - to see how tasks are generated, but it doesnt solves two additional points: 1. There is constantly some data in nailgun becomes invalid just because we are asking user to overwrite everything (most common case is allocated ip addresses) 2. What if you only need to add some data, like in fencing plugin? It will mean that such cluster is not going to be supportable, what if we will want to upgrade that cluster and new serializer should be used? i think there is even warning on UI. __ OpenStack Development Mailing List (not for usage questions) Unsubscribe: openstack-dev-requ...@lists.openstack.org?subject:unsubscribe http://lists.openstack.org/cgi-bin/mailman/listinfo/openstack-dev
Re: [openstack-dev] [Fuel] Cluster replaced deployment of provisioning information
On Tue, Jan 27, 2015 at 10:47 AM, Vladimir Kuklin vkuk...@mirantis.com wrote: This is an interesting topic. As per our discussions earlier, I suggest that in the future we move to different serializers for each granule of our deployment, so that we do not need to drag a lot of senseless data into particular task being executed. Say, we have a fencing task, which has a serializer module written in python. This module is imported by Nailgun and what it actually does, it executes specific Nailgun core methods that access database or other sources of information and retrieve data in the way this task wants it instead of adjusting the task to the only 'astute.yaml'. I like this idea, and to make things easier we may provide read only access for plugins, but i am not sure that everyone will agree to expose database to distributed task serializers. It may be quite fragile and we wont be able to change anything internally, consider refactoring of volumes or networks. On the other hand if we will be able to make single public interface for inventory (this is how i am calling part of nailgun that is reponsible for cluster information storage) and use that interface (through REST Api ??) in component that will be responsible for deployment serialization and execution. Basically, what i am saying is that we need to split nailgun to microservices, and then reuse that api in plugins or in config generators right in library. __ OpenStack Development Mailing List (not for usage questions) Unsubscribe: openstack-dev-requ...@lists.openstack.org?subject:unsubscribe http://lists.openstack.org/cgi-bin/mailman/listinfo/openstack-dev
Re: [openstack-dev] [tc] Take back the naming process
On Jan 27, 2015, at 3:50 PM, Monty Taylor mord...@inaugust.com wrote: I do not like how we are selecting names for our releases right now. The current process is autocratic and opaque and not fun - which is the exact opposite of what a community selected name should be. Autocratic? Could you elaborate? I propose: * As soon as development starts on release X, we open the voting for the name of release X+1 (we're working on Kilo now, we should have known the name of L at the K summit) * Anyone can nominate a name - although we do suggest that something at least related to the location of the associated summit would be nice * We condorcet vote on the entire list of nominated names * After we have the winning list, the foundation trademark checks the name * If there is a trademark issue (and only a trademark issue - not a marketing doesn't like the name issue) we'll move down to the next name on the list If we cannot have this process be completely open and democratic, then what the heck is the point of having our massive meritocracy in the first place? There's a lot of overhead we deal with by being a leaderless collective you know - we should occasionally get to have fun with it. If your goal is to actually involve our massive meritocracy, I’d suggest expanding this thread to include at least the community marketing mailing list rather than just the -dev mailing list (possibly also the Foundation mailing list?). The release names are some of our most prominent brands, meaning choosing them is by definition a marketing activity. Not including the part of our meritocracy with experience in branding and marketing feels counterintuitive to me (again if the goal is actually to be meritocratic). Jonathan __ OpenStack Development Mailing List (not for usage questions) Unsubscribe: openstack-dev-requ...@lists.openstack.org?subject:unsubscribe http://lists.openstack.org/cgi-bin/mailman/listinfo/openstack-dev
Re: [openstack-dev] [barbican] python-barbicanclient 3.0.2 released
On 01/27/2015 03:55 PM, Douglas Mendizabal wrote: Hi openstack-dev, The barbican team would like to announce the release of python-barbicanclient 3.0.2. This is a minor release that fixes a bug in the pbr versioning that was preventing the client from working correctly. The release is available on PyPI https://pypi.python.org/pypi/python-barbicanclient/3.0.2 Which just broke everything, because it creates incompatible requirements in stable/juno with cinder. :( -Sean -- Sean Dague http://dague.net signature.asc Description: OpenPGP digital signature __ OpenStack Development Mailing List (not for usage questions) Unsubscribe: openstack-dev-requ...@lists.openstack.org?subject:unsubscribe http://lists.openstack.org/cgi-bin/mailman/listinfo/openstack-dev
Re: [openstack-dev] [nova] Nominating Melanie Witt for python-novaclient-core
-Original Message- From: Michael Still [mailto:mi...@stillhq.com] Sent: Wednesday, January 28, 2015 7:41 AM To: OpenStack Development Mailing List Subject: [openstack-dev] [nova] Nominating Melanie Witt for python-novaclient-core Greetings, I would like to nominate Melanie Witt for the python-novaclient-core team. (What is python-novaclient-core? Its a new group which will contain all of nova-core as well as anyone else we think should have core reviewer powers on just the python-novaclient code). Melanie has been involved with nova for a long time now. She does solid reviews in python-novaclient, and at least two current nova-cores have suggested her as ready for core review powers on that repository. Please respond with +1s or any concerns. +1 Thanks Ken'ichi Ohmichi __ OpenStack Development Mailing List (not for usage questions) Unsubscribe: openstack-dev-requ...@lists.openstack.org?subject:unsubscribe http://lists.openstack.org/cgi-bin/mailman/listinfo/openstack-dev
[openstack-dev] [Heat] core team changes
Hi all After having a look at the stats: http://stackalytics.com/report/contribution/heat-group/90 http://stackalytics.com/?module=heat-groupmetric=person-day I'd like to propose the following changes to the Heat core team: Add: Qiming Teng Huang Tianhua Remove: Bartosz Górski (Bartosz has indicated that he is happy to be removed and doesn't have the time to work on heat ATM). Core team please respond with +/- 1. Thanks Angus __ OpenStack Development Mailing List (not for usage questions) Unsubscribe: openstack-dev-requ...@lists.openstack.org?subject:unsubscribe http://lists.openstack.org/cgi-bin/mailman/listinfo/openstack-dev
[openstack-dev] [Manila]Questions about using not handle share-servers drivers with Flat network
Hi list, I have some questions. Hope can get help from you guys. Manila has two driver modes. For handle share server drivers, the share-network is easy to understand. For not handle share-servers drivers, manila request admin to do everything before manila-share service start, and when the service is running, it only serves requests do not contain share-network. I kept confusing about which/why users would create shares without share-network. Although when working with this kind of driver, the manila-share service can only support one specific network restricted by the backend. But users do not know backends, they should always want to create shares with share-network, because users always want to connect shares to their instances that lives in the cloud with share-network. Then I have been told that these shares created without share-network are assumed to be used on a public network. The public network do make a clear explanation about why share-network not matter anymore. But, when I build my cloud with Manila, what I want to do is let backends to serve my Flat network. I want to have 2 backends in Manila, both of them are not handle share-servers drivers. I set 192.168.6.253 for backend1 and create a Flat network in neutron with subnet 192.168.6.0/24 with IP range from 192.168.6.1-192.168.6.252. I set 192.168.7.253 for backend2 and create a Flat network in neutron with subnet 192.168.7.0/24 with IP range from 192.168.7.1-192.168.7.252. The reason I build my cloud like this is because I want to do some performance tests on both backends, to compare the two backends. I think it should not hard to do it, but manila do not support that currently. So, is this the behavior should work ? Or anything else I missed ? Thanks. -chen __ OpenStack Development Mailing List (not for usage questions) Unsubscribe: openstack-dev-requ...@lists.openstack.org?subject:unsubscribe http://lists.openstack.org/cgi-bin/mailman/listinfo/openstack-dev
Re: [openstack-dev] [tc] Take back the naming process
On 01/27/2015 06:05 PM, Jonathan Bryce wrote: On Jan 27, 2015, at 3:50 PM, Monty Taylor mord...@inaugust.com wrote: I do not like how we are selecting names for our releases right now. The current process is autocratic and opaque and not fun - which is the exact opposite of what a community selected name should be. Autocratic? Could you elaborate? Right now we're starting from a set list of pre-approved names that there was absolutely no participation in the selection of and about which discussion is summarily shut down. I know it's with the best of intentions, but it's not ok. I propose: * As soon as development starts on release X, we open the voting for the name of release X+1 (we're working on Kilo now, we should have known the name of L at the K summit) * Anyone can nominate a name - although we do suggest that something at least related to the location of the associated summit would be nice * We condorcet vote on the entire list of nominated names * After we have the winning list, the foundation trademark checks the name * If there is a trademark issue (and only a trademark issue - not a marketing doesn't like the name issue) we'll move down to the next name on the list If we cannot have this process be completely open and democratic, then what the heck is the point of having our massive meritocracy in the first place? There's a lot of overhead we deal with by being a leaderless collective you know - we should occasionally get to have fun with it. If your goal is to actually involve our massive meritocracy, I’d suggest expanding this thread to include at least the community marketing mailing list rather than just the -dev mailing list (possibly also the Foundation mailing list?). The release names are some of our most prominent brands, meaning choosing them is by definition a marketing activity. Not including the part of our meritocracy with experience in branding and marketing feels counterintuitive to me (again if the goal is actually to be meritocratic). I was under the impression that the human names were development codenames and also this was a topic of discussion at the TC meeting today, which is why I popped it to the dev list - no slight or exclusion was intended! I have cross-posted this reply to foundat...@lists.openstack.org and market...@lists.openstack.org. You'll notice that I did say in my suggestion that ANYONE should be able to propose a name - I believe that would include non-dev people. Since the people in question are marketing people, I would imagine that if any of them feel strongly about a name, that it should be trivial for them to make their case in a persuasive way. I'm not willing to cede that choosing the name is by definition a marketing activity - and in fact the sense that such a position was developing is precisely why I think it's time to get this sorted. I think the dev community feels quite a bit of ownership on this topic and I would like to keep it that way. Thanks! Monty __ OpenStack Development Mailing List (not for usage questions) Unsubscribe: openstack-dev-requ...@lists.openstack.org?subject:unsubscribe http://lists.openstack.org/cgi-bin/mailman/listinfo/openstack-dev
Re: [openstack-dev] [nova] Requesting FFE for opencontrail-nova-vif-driver-plugin
Hi John Thank you so much. My apologies for bp isn't lined for review, I have used wrong git format. It's fixed now. Best Nachi 2015-01-28 2:39 GMT+09:00 John Garbutt j...@johngarbutt.com: Hi, Apologies, we can re-approve that because your code was up before the deadline. I was unable to do that yesterday as the code was not linked in the blueprint whiteboard at that time, so it looked like there was no code up for review. Apologies, its a gap in the tooling. Please try to make sure the code is linked on the blueprint, and its marked as NeedsCodeReview when all your code is up for review. Hopefully that should help get your code reviewed quicker. Thanks, John On 27 January 2015 at 00:58, Nati Ueno nati.u...@gmail.com wrote: Hi nova folks May I request FFE for vif driver for contrail? Spec was already approved, and 1st code review pushed Jan21, and it's just 95 lines code. BP https://blueprints.launchpad.net/nova/+spec/opencontrail-nova-vif-driver-plugin Code https://review.openstack.org/#/c/148805/1 Best Nachi -- Nachi Ueno email:nati.u...@gmail.com twitter:http://twitter.com/nati -- Nachi Ueno email:nati.u...@gmail.com twitter:http://twitter.com/nati __ OpenStack Development Mailing List (not for usage questions) Unsubscribe: openstack-dev-requ...@lists.openstack.org?subject:unsubscribe http://lists.openstack.org/cgi-bin/mailman/listinfo/openstack-dev
Re: [openstack-dev] [OpenStack Foundation] [tc] Take back the naming process
Hey Monty, I’d like to weigh in here, because I think there have been some misunderstandings around Lemming-gate. I’m glad you raised your concerns; it’s a good test of release naming for us all to discuss and learn from. To provide a little context for those new to the discussion, historically, when it’s time to name the development cycle, open suggestions are taken on a wiki page (https://wiki.openstack.org/wiki/Release_Naming) after which the Technical Committee works to create a short list that are then voted on by the entire community. Typically, Foundation staff play a role in this process to work with our trademark counsel to vet the release names. We register them to ensure our rights, and they become significant brands for the OpenStack community, as well as all of the companies who are building and marketing their products on OpenStack. One of the names that was proposed for the L development cycle was Lemming. So little-known fact, I’m actually a huge fan of rodents (I’ve had several pet rats), but I’m afraid the name Lemming conjures up more than a small mammal. The dictionary.com definition is a member of any large group following an unthinking course towards mass destruction, or if you prefer Urban Dictionary, “a member of a crowd with no originality or voice of his own. One who speaks or repeats only what he has been told. A tool. A cretin.” When I heard that Lemming was a consideration, I was a bit concerned. Most of all, I care about and am protective of this community, and I think that would paint us with a pretty big / easy target. Regardless, I did the due diligence with our trademark counsel, and they provided the following feedback: “The proposed trademark LEMMING cleared our preliminary search for the usual goods/services, subject to the usual limitations. The majority of applications/registrations that others have filed for the term are dead (no pun intended). I take this to mean the brand generally has problems in the marketplace due to negative connotation.” So, I reached out to Thierry and a few of the TC members to share my perspective and concern from a marketing standpoint. I have a lot of respect for you and this community, and I would hate to jeopardize the perception of your work. I am very sensitive to the fact that I do not have a magical marketing veto; I was simply providing feedback and trying to bring another perspective to the conversation. My sense from talking to them was that Lemming was kind of a joke and not a serious option. I also read the notes of the following TC meeting, and it didn’t seem like there was much of an issue...so I stopped worrying about it. (TC meeting notes for reference, you can search Lemming in this discussion: http://eavesdrop.openstack.org/meetings/tc/2015/tc.2015-01-13-20.01.log.txt) Anyhow, it seems like it’s boiled into a larger issue, and I’m more than happy to have the discussion and get more input. I stand by my advice and hope our community leaders will make a reasonable decision. I certainly don’t want to take the fun out of release naming, but at the end of the day we are all pretty fortunate and have quite a bit of fun as part of this community. I was just trying to protect it. Best, Lauren On Jan 27, 2015, at 6:59 PM, Monty Taylor mord...@inaugust.com wrote: On 01/27/2015 06:05 PM, Jonathan Bryce wrote: On Jan 27, 2015, at 3:50 PM, Monty Taylor mord...@inaugust.com wrote: I do not like how we are selecting names for our releases right now. The current process is autocratic and opaque and not fun - which is the exact opposite of what a community selected name should be. Autocratic? Could you elaborate? Right now we're starting from a set list of pre-approved names that there was absolutely no participation in the selection of and about which discussion is summarily shut down. I know it's with the best of intentions, but it's not ok. I propose: * As soon as development starts on release X, we open the voting for the name of release X+1 (we're working on Kilo now, we should have known the name of L at the K summit) * Anyone can nominate a name - although we do suggest that something at least related to the location of the associated summit would be nice * We condorcet vote on the entire list of nominated names * After we have the winning list, the foundation trademark checks the name * If there is a trademark issue (and only a trademark issue - not a marketing doesn't like the name issue) we'll move down to the next name on the list If we cannot have this process be completely open and democratic, then what the heck is the point of having our massive meritocracy in the first place? There's a lot of overhead we deal with by being a leaderless collective you know - we should occasionally get to have fun with it. If your goal is to actually involve our massive meritocracy, I’d suggest expanding this thread to include at
Re: [openstack-dev] [nova][gate][stable] How eventlet 0.16.1 broke the gate
Here is one that is more complete: https://gist.github.com/harlowja/e22e8c0771b336ca392f Using a really simple requirement set that will not work: $ cat test.txt taskflow networkx1.5 Running the above gist on that (and waiting for a while; since it does do a lot of backtracking and trying of different versions) the program will eventually break with something like the following: http://paste.ubuntu.com/9907530/ The above can likely be optimized more (to avoid diving into requirements that have already failed being selected) but it does seem to work as a satisfiability solver that will recursively check requirements deeply and try as many solutions as possible (with backtracking when a requirement is selected that doesn't work). -Josh Joshua Harlow wrote: Seems like a simple fix? https://github.com/pypa/pip/blob/1.5.6/pip/req.py#L1536 Make a new session somewhere in that gist/code and profit? Kevin L. Mitchell wrote: On Wed, 2015-01-21 at 18:48 -0800, Joshua Harlow wrote: Another thing that I just started whipping together: https://gist.github.com/harlowja/5e39ec5ca9e3f0d9a21f One problem, though, is that parse_requirements() now requires the session keyword argument. In version 6.0.6, parse_requirements() begins with: def parse_requirements(filename, finder=None, comes_from=None, options=None, session=None): if session is None: raise TypeError( parse_requirements() missing 1 required keyword argument: 'session' ) __ OpenStack Development Mailing List (not for usage questions) Unsubscribe: openstack-dev-requ...@lists.openstack.org?subject:unsubscribe http://lists.openstack.org/cgi-bin/mailman/listinfo/openstack-dev
Re: [openstack-dev] [barbican] python-barbicanclient 3.0.2 released
On 01/27/2015 05:21 PM, Sean Dague wrote: On 01/27/2015 03:55 PM, Douglas Mendizabal wrote: Hi openstack-dev, The barbican team would like to announce the release of python-barbicanclient 3.0.2. This is a minor release that fixes a bug in the pbr versioning that was preventing the client from working correctly. The release is available on PyPI https://pypi.python.org/pypi/python-barbicanclient/3.0.2 Which just broke everything, because it creates incompatible requirements in stable/juno with cinder. :( Here is the footnote - http://logs.openstack.org/18/150618/1/check/check-grenade-dsvm/c727602/logs/grenade.sh.txt.gz#_2015-01-28_00_04_54_429 -Sean -- Sean Dague http://dague.net signature.asc Description: OpenPGP digital signature __ OpenStack Development Mailing List (not for usage questions) Unsubscribe: openstack-dev-requ...@lists.openstack.org?subject:unsubscribe http://lists.openstack.org/cgi-bin/mailman/listinfo/openstack-dev
Re: [openstack-dev] [nova][gate][stable] How eventlet 0.16.1 broke the gate
Btw try this on 'pip6' (for those that want to); Pip 6+ moved some of the code around that this uses; for feel to update it though and adjust it to find where the new stuff is :-P Joshua Harlow wrote: Here is one that is more complete: https://gist.github.com/harlowja/e22e8c0771b336ca392f Using a really simple requirement set that will not work: $ cat test.txt taskflow networkx1.5 Running the above gist on that (and waiting for a while; since it does do a lot of backtracking and trying of different versions) the program will eventually break with something like the following: http://paste.ubuntu.com/9907530/ The above can likely be optimized more (to avoid diving into requirements that have already failed being selected) but it does seem to work as a satisfiability solver that will recursively check requirements deeply and try as many solutions as possible (with backtracking when a requirement is selected that doesn't work). -Josh Joshua Harlow wrote: Seems like a simple fix? https://github.com/pypa/pip/blob/1.5.6/pip/req.py#L1536 Make a new session somewhere in that gist/code and profit? Kevin L. Mitchell wrote: On Wed, 2015-01-21 at 18:48 -0800, Joshua Harlow wrote: Another thing that I just started whipping together: https://gist.github.com/harlowja/5e39ec5ca9e3f0d9a21f One problem, though, is that parse_requirements() now requires the session keyword argument. In version 6.0.6, parse_requirements() begins with: def parse_requirements(filename, finder=None, comes_from=None, options=None, session=None): if session is None: raise TypeError( parse_requirements() missing 1 required keyword argument: 'session' ) __ OpenStack Development Mailing List (not for usage questions) Unsubscribe: openstack-dev-requ...@lists.openstack.org?subject:unsubscribe http://lists.openstack.org/cgi-bin/mailman/listinfo/openstack-dev
[openstack-dev] How to pass through devstack config
Hi, I have seen Sean Dague's patch [1], if I understood correctly, by this patch we can reduce the number of DEVSTACK_GATE variables that we need. Trying to follow this patch to configure my gate job DEVSTACK_GATE_GLUSTERFS [2]. I am not able to figure out the way to use this patch [1]. Please suggest me how to use the patch [1] to configure my gate job [2]. [1] https://review.openstack.org/#/c/145321/ [2] https://review.openstack.org/#/c/143308/7/devstack-vm-gate.sh -- Warm Regards, Bharat Kumar Kobagana Software Engineer OpenStack Storage – RedHat India __ OpenStack Development Mailing List (not for usage questions) Unsubscribe: openstack-dev-requ...@lists.openstack.org?subject:unsubscribe http://lists.openstack.org/cgi-bin/mailman/listinfo/openstack-dev
Re: [openstack-dev] [Fuel] removing single mode
+1 -- Best regards, Sergii Golovatiuk, Skype #golserge IRC #holser On Tue, Jan 27, 2015 at 2:44 PM, Stanislaw Bogatkin sbogat...@mirantis.com wrote: +1 On Tue, Jan 27, 2015 at 4:05 PM, Aleksandr Didenko adide...@mirantis.com wrote: Hi, After starting implementing granular deployment we've faced a bunch of issues that would make further development of this feature much more complicated if we have to support both Simple and HA deployment modes. For example: simple mode does not require cluster (corosync, pacemaker, vips, etc), so we had to skip this task for Simple mode somehow - we can use conditional tasks, or conditional manifests in our tasks, or create separate task graphs for different deployment modes, etc - either way it's pretty much doubling the amount of work for some parts of Fuel and our development cycle. At the moment, CI blocks us from further development of fuel-library modularization BP [2] because we still use Simple mode in CI. So in order to proceed with this BP we have two options: 1) remove Simple mode from CI/QA and thus drop it completely from Fuel 2) double our efforts to support both Simple and HA modes in granular deployment We have a BP about single-controller HA [1]. HA with single controller works just fine at the moment. So if you want to test Fuel on a minimum set of nodes, you can do this on 3 nodes (Fuel master, controller, compute), just like with Simple mode before. I suppose, it's time to finally drop support for Simple mode in Fuel :) [1] https://blueprints.launchpad.net/fuel/+spec/single-controller-ha [2] https://blueprints.launchpad.net/fuel/+spec/fuel-library-modularization -- Regards, Aleksandr Didenko On Tue, Aug 26, 2014 at 9:25 AM, Mike Scherbakov mscherba...@mirantis.com wrote: Definitely fuel spec is needed :) On Mon, Aug 25, 2014 at 8:45 PM, Evgeniy L e...@mirantis.com wrote: Hi Andrew, I have some comments regarding to you action items 2) Removing simple mode from the ui and tests 3) Removing simple mode support from nailgun (maybe we leave it) and cli We shouldn't do it, because nailgun should handle both versions of cluster. What we have to do here is to use openstack.yaml to keep all possible modes. For new release there will be only ha, to manage previous releases we have to create data migrations in nailgun to create the filed with modes i.e. multinode and ha. Also fixes for ui are required too, I think it mostly related to wizard, 'mode' tab where use can chose ha or non ha cluster in case of new release there should be only ha, and in case of old releases there should be ha and multinode. Thanks, On Mon, Aug 25, 2014 at 8:19 PM, Andrew Woodward xar...@gmail.com wrote: Started a new thread so that we don't hijack the older thread. as Andrew, will you work on it in 6.0? What are remaining items there? Also, it might affect our tests - simple mode runs faster so we use it for smoke ISO test. Anastasia, please confirm that we can switch smoke to one-ha-controller model, or even drop smoke at all and use BVT only (running CentOS 3 HA controllers and same with Ubuntu). The primary reason that we haven't disabled single yet is was due to [0] where we where having problems adding additional controllers. With the changes to galera and rabbit clustering it appears that we ended up fixing it already. The remaining issues are: 1) Ensuring we have good test coverage for the cases we expect to support [1] 2) Removing simple mode from the ui and tests 3) Removing simple mode support from nailgun (maybe we leave it) and cli 4) Updating documentation [0] https://bugs.launchpad.net/fuel/+bug/1350266 [1] https://bugs.launchpad.net/fuel/+bug/1350266/comments/7 -- Andrew Mirantis Ceph community ___ OpenStack-dev mailing list OpenStack-dev@lists.openstack.org http://lists.openstack.org/cgi-bin/mailman/listinfo/openstack-dev ___ OpenStack-dev mailing list OpenStack-dev@lists.openstack.org http://lists.openstack.org/cgi-bin/mailman/listinfo/openstack-dev -- Mike Scherbakov #mihgen ___ OpenStack-dev mailing list OpenStack-dev@lists.openstack.org http://lists.openstack.org/cgi-bin/mailman/listinfo/openstack-dev __ OpenStack Development Mailing List (not for usage questions) Unsubscribe: openstack-dev-requ...@lists.openstack.org?subject:unsubscribe http://lists.openstack.org/cgi-bin/mailman/listinfo/openstack-dev __ OpenStack Development Mailing List (not for usage questions) Unsubscribe: openstack-dev-requ...@lists.openstack.org?subject:unsubscribe http://lists.openstack.org/cgi-bin/mailman/listinfo/openstack-dev
Re: [openstack-dev] [Fuel] removing single mode
+1 to simple mode removal On Tue, Jan 27, 2015 at 4:44 PM, Stanislaw Bogatkin sbogat...@mirantis.com wrote: +1 On Tue, Jan 27, 2015 at 4:05 PM, Aleksandr Didenko adide...@mirantis.com wrote: Hi, After starting implementing granular deployment we've faced a bunch of issues that would make further development of this feature much more complicated if we have to support both Simple and HA deployment modes. For example: simple mode does not require cluster (corosync, pacemaker, vips, etc), so we had to skip this task for Simple mode somehow - we can use conditional tasks, or conditional manifests in our tasks, or create separate task graphs for different deployment modes, etc - either way it's pretty much doubling the amount of work for some parts of Fuel and our development cycle. At the moment, CI blocks us from further development of fuel-library modularization BP [2] because we still use Simple mode in CI. So in order to proceed with this BP we have two options: 1) remove Simple mode from CI/QA and thus drop it completely from Fuel 2) double our efforts to support both Simple and HA modes in granular deployment We have a BP about single-controller HA [1]. HA with single controller works just fine at the moment. So if you want to test Fuel on a minimum set of nodes, you can do this on 3 nodes (Fuel master, controller, compute), just like with Simple mode before. I suppose, it's time to finally drop support for Simple mode in Fuel :) [1] https://blueprints.launchpad.net/fuel/+spec/single-controller-ha [2] https://blueprints.launchpad.net/fuel/+spec/fuel-library-modularization -- Regards, Aleksandr Didenko On Tue, Aug 26, 2014 at 9:25 AM, Mike Scherbakov mscherba...@mirantis.com wrote: Definitely fuel spec is needed :) On Mon, Aug 25, 2014 at 8:45 PM, Evgeniy L e...@mirantis.com wrote: Hi Andrew, I have some comments regarding to you action items 2) Removing simple mode from the ui and tests 3) Removing simple mode support from nailgun (maybe we leave it) and cli We shouldn't do it, because nailgun should handle both versions of cluster. What we have to do here is to use openstack.yaml to keep all possible modes. For new release there will be only ha, to manage previous releases we have to create data migrations in nailgun to create the filed with modes i.e. multinode and ha. Also fixes for ui are required too, I think it mostly related to wizard, 'mode' tab where use can chose ha or non ha cluster in case of new release there should be only ha, and in case of old releases there should be ha and multinode. Thanks, On Mon, Aug 25, 2014 at 8:19 PM, Andrew Woodward xar...@gmail.com wrote: Started a new thread so that we don't hijack the older thread. as Andrew, will you work on it in 6.0? What are remaining items there? Also, it might affect our tests - simple mode runs faster so we use it for smoke ISO test. Anastasia, please confirm that we can switch smoke to one-ha-controller model, or even drop smoke at all and use BVT only (running CentOS 3 HA controllers and same with Ubuntu). The primary reason that we haven't disabled single yet is was due to [0] where we where having problems adding additional controllers. With the changes to galera and rabbit clustering it appears that we ended up fixing it already. The remaining issues are: 1) Ensuring we have good test coverage for the cases we expect to support [1] 2) Removing simple mode from the ui and tests 3) Removing simple mode support from nailgun (maybe we leave it) and cli 4) Updating documentation [0] https://bugs.launchpad.net/fuel/+bug/1350266 [1] https://bugs.launchpad.net/fuel/+bug/1350266/comments/7 -- Andrew Mirantis Ceph community ___ OpenStack-dev mailing list OpenStack-dev@lists.openstack.org http://lists.openstack.org/cgi-bin/mailman/listinfo/openstack-dev ___ OpenStack-dev mailing list OpenStack-dev@lists.openstack.org http://lists.openstack.org/cgi-bin/mailman/listinfo/openstack-dev -- Mike Scherbakov #mihgen ___ OpenStack-dev mailing list OpenStack-dev@lists.openstack.org http://lists.openstack.org/cgi-bin/mailman/listinfo/openstack-dev __ OpenStack Development Mailing List (not for usage questions) Unsubscribe: openstack-dev-requ...@lists.openstack.org?subject:unsubscribe http://lists.openstack.org/cgi-bin/mailman/listinfo/openstack-dev __ OpenStack Development Mailing List (not for usage questions) Unsubscribe: openstack-dev-requ...@lists.openstack.org?subject:unsubscribe http://lists.openstack.org/cgi-bin/mailman/listinfo/openstack-dev -- Yours Faithfully, Vladimir Kuklin, Fuel Library Tech Lead, Mirantis,
Re: [openstack-dev] [nova][NFV][qa] Testing NUMA, CPU pinning and large pages
- Original Message - From: Vladik Romanovsky vladik.romanov...@enovance.com To: openstack-dev@lists.openstack.org Hi everyone, Following Steve Gordon's email [1], regarding CI for NUMA, SR-IOV, and other features, I'd like to start a discussion about the NUMA testing in particular. Recently we have started a work to test some of these features. The current plan is to use the functional tests, in the Nova tree, to exercise the code paths for NFV use cases. In general, these will contain tests to cover various scenarios regarding NUMA, CPU pinning, large pages and validate a correct placement/scheduling. Hi Vladik, There was some discussion of the above at the Nova mid-cycle yesterday, are you able to give a quick update on any progress with regards to creation of the above functional tests? In addition to the functional tests in Nova, we have also proposed two basic scenarios in Tempest [2][3]. One to make sure that an instance can boot with a minimal NUMA configuration (a topology that every host should have) and one that would request an impossible topology and fail with an expected exception. We also discussed the above tempest changes and they will likely receive some more review cycles as a result of this discussion but it looks like there is already some feedback from Nikola that needs to be addressed. More broadly for the list it looks like we need to determine whether adding a negative test in this case is a valid/desireable use of Tempest. Thanks, Steve __ OpenStack Development Mailing List (not for usage questions) Unsubscribe: openstack-dev-requ...@lists.openstack.org?subject:unsubscribe http://lists.openstack.org/cgi-bin/mailman/listinfo/openstack-dev
Re: [openstack-dev] [Nova] Requirements.txt and optional requirements
On 01/27/2015 12:18 AM, Silvan Kaiser wrote: Hello! Do dependencies required only in some contexts belong into requirements.txt? Yesterday we had a short discussion on #openstack-nova regarding how to handle optional requirements. This was triggered by our quobyte nova driver (https://review.openstack.org/#/c/110722/18), who requires xattr, which we therefore added to requirements.txt (as it is provided by the requirements project). Points from the discussion: - If we add this we will be adding every requirement for every component --- this becomes to big. - Remove this requirement, no optional entries in requirements.txt, a 'deployer' has to know what dependencies the components he wants to use have --- Usually he does not know and installation becomes more issue prone - Other (in between) ideas??? Please note that this has some urgency, the change set referenced above has been in review for months and i'm trying to react asap on comments but the deadline is approaching (next week) and if i have to do bigger changes I'd like to know as fast as possible... Typically the answer is no. The libvirt volume driver architecture is kind of weird in the fact that it doesn't actually split it's drivers out into separate files, so there can be a file level boundry (including loading) for these things. That being said, in general, optional things are not in requirements.txt. You will notice libvirt isn't even in requirements.txt, because it's not a nova requirement. Optional things should be handled in documentation at this point, and the code should be structured to not fail when that's not installed if it's not needed. But, also, in staring at the code, I'm confused that xattr is used in only 1 place, which is a fall back failure path. Seems like the code could easily be redone to not need it, and get info from mount instead, no? -Sean -- Sean Dague http://dague.net signature.asc Description: OpenPGP digital signature __ OpenStack Development Mailing List (not for usage questions) Unsubscribe: openstack-dev-requ...@lists.openstack.org?subject:unsubscribe http://lists.openstack.org/cgi-bin/mailman/listinfo/openstack-dev
Re: [openstack-dev] [Nova] Requirements.txt and optional requirements
On 1/27/2015 2:18 AM, Silvan Kaiser wrote: Hello! Do dependencies required only in some contexts belong into requirements.txt? Yesterday we had a short discussion on #openstack-nova regarding how to handle optional requirements. This was triggered by our quobyte nova driver (https://review.openstack.org/#/c/110722/18), who requires xattr, which we therefore added to requirements.txt (as it is provided by the requirements project). Points from the discussion: - If we add this we will be adding every requirement for every component --- this becomes to big. - Remove this requirement, no optional entries in requirements.txt, a 'deployer' has to know what dependencies the components he wants to use have --- Usually he does not know and installation becomes more issue prone - Other (in between) ideas??? Please note that this has some urgency, the change set referenced above has been in review for months and i'm trying to react asap on comments but the deadline is approaching (next week) and if i have to do bigger changes I'd like to know as fast as possible... Best regards SIlvan Kaiser -- *Quobyte* GmbH Boyenstr. 41 - 10115 Berlin-Mitte - Germany +49-30-814 591 800 - www.quobyte.com http://www.quobyte.com/ Amtsgericht Berlin-Charlottenburg, HRB 149012B management board: Dr. Felix Hupfeld, Dr. Björn Kolbeck, Dr. Jan Stender __ OpenStack Development Mailing List (not for usage questions) Unsubscribe: openstack-dev-requ...@lists.openstack.org?subject:unsubscribe http://lists.openstack.org/cgi-bin/mailman/listinfo/openstack-dev In my opinion the volume driver is optional and therefore the dependency is optional, it's all based on what the configuration is, the same as which DB or RPC backend you use, which is why those dependencies are in test-requirements.txt. While it's more obvious to a deployer that if you're going to configure Nova to use MySQL you need some MySQL packages to make it work, any deployer that's adding support for this volume driver should also probably be testing their deployment scripts, e.g. chef cookbooks/recipes, and if they haven't written their script correctly they'll find out that it blows up with an ImportError because of a missing xattr. Otherwise, [1]. [1] http://troll.me/images/the-most-interesting-man-in-the-world/i-dont-always-test-my-code-but-when-i-do-i-do-it-in-production.jpg -- Thanks, Matt Riedemann __ OpenStack Development Mailing List (not for usage questions) Unsubscribe: openstack-dev-requ...@lists.openstack.org?subject:unsubscribe http://lists.openstack.org/cgi-bin/mailman/listinfo/openstack-dev
Re: [openstack-dev] [tc] Take back the naming process
On 01/27/2015 05:19 PM, Jim Meyer wrote: +1 all the way down. More fun double-plus-good. —j On Jan 27, 2015, at 1:50 PM, Monty Taylor mord...@inaugust.com wrote: I do not like how we are selecting names for our releases right now. The current process is autocratic and opaque and not fun - which is the exact opposite of what a community selected name should be. I propose: * As soon as development starts on release X, we open the voting for the name of release X+1 (we're working on Kilo now, we should have known the name of L at the K summit) * Anyone can nominate a name - although we do suggest that something at least related to the location of the associated summit would be nice * We condorcet vote on the entire list of nominated names * After we have the winning list, the foundation trademark checks the name * If there is a trademark issue (and only a trademark issue - not a marketing doesn't like the name issue) we'll move down to the next name on the list If we cannot have this process be completely open and democratic, then what the heck is the point of having our massive meritocracy in the first place? There's a lot of overhead we deal with by being a leaderless collective you know - we should occasionally get to have fun with it. Monty __ OpenStack Development Mailing List (not for usage questions) Unsubscribe: openstack-dev-requ...@lists.openstack.org?subject:unsubscribe http://lists.openstack.org/cgi-bin/mailman/listinfo/openstack-dev __ OpenStack Development Mailing List (not for usage questions) Unsubscribe: openstack-dev-requ...@lists.openstack.org?subject:unsubscribe http://lists.openstack.org/cgi-bin/mailman/listinfo/openstack-dev I nominate Ladysmith and Langley as the two obvious l named locations closest to Vancouver. Oh, and I think Monty is spot on __ OpenStack Development Mailing List (not for usage questions) Unsubscribe: openstack-dev-requ...@lists.openstack.org?subject:unsubscribe http://lists.openstack.org/cgi-bin/mailman/listinfo/openstack-dev
Re: [openstack-dev] [tc] Take back the naming process
Monty Taylor mord...@inaugust.com writes: I do not like how we are selecting names for our releases right now. The current process is autocratic and opaque and not fun - which is the exact opposite of what a community selected name should be. I propose: * As soon as development starts on release X, we open the voting for the name of release X+1 (we're working on Kilo now, we should have known the name of L at the K summit) * Anyone can nominate a name - although we do suggest that something at least related to the location of the associated summit would be nice * We condorcet vote on the entire list of nominated names * After we have the winning list, the foundation trademark checks the name * If there is a trademark issue (and only a trademark issue - not a marketing doesn't like the name issue) we'll move down to the next name on the list Thank you, I agree! I have proposed a change[1] to the governance repo that I believe implements the suggested process. Note that I kept the existing rules about the locality of the name, since I think that's a good part of the fun (anyone can come up with a cool L word, but finding one near the summit is a challenge). Of course it is easy to modify the naming rules without changing the process if we desire, and I made explicit the process for overriding the rules for names that sound really cool. Note that if this is approved, I would expect it to be used for the Miyazaki release, but not before. [1] https://review.openstack.org/150604 -Jim __ OpenStack Development Mailing List (not for usage questions) Unsubscribe: openstack-dev-requ...@lists.openstack.org?subject:unsubscribe http://lists.openstack.org/cgi-bin/mailman/listinfo/openstack-dev
Re: [openstack-dev] [nova] Nominating Melanie Witt for python-novaclient-core
On Wed, Jan 28, 2015 at 9:11 AM, Michael Still mi...@stillhq.com wrote: Greetings, I would like to nominate Melanie Witt for the python-novaclient-core team. (What is python-novaclient-core? Its a new group which will contain all of nova-core as well as anyone else we think should have core reviewer powers on just the python-novaclient code). Melanie has been involved with nova for a long time now. She does solid reviews in python-novaclient, and at least two current nova-cores have suggested her as ready for core review powers on that repository. Please respond with +1s or any concerns. +1 __ OpenStack Development Mailing List (not for usage questions) Unsubscribe: openstack-dev-requ...@lists.openstack.org?subject:unsubscribe http://lists.openstack.org/cgi-bin/mailman/listinfo/openstack-dev
[openstack-dev] [nova] Nominating Melanie Witt for python-novaclient-core
Greetings, I would like to nominate Melanie Witt for the python-novaclient-core team. (What is python-novaclient-core? Its a new group which will contain all of nova-core as well as anyone else we think should have core reviewer powers on just the python-novaclient code). Melanie has been involved with nova for a long time now. She does solid reviews in python-novaclient, and at least two current nova-cores have suggested her as ready for core review powers on that repository. Please respond with +1s or any concerns. References: https://review.openstack.org/#/q/project:openstack/python-novaclient+reviewer:%22melanie+witt+%253Cmelwitt%2540yahoo-inc.com%253E%22,n,z As a reminder, we use the voting process outlined at https://wiki.openstack.org/wiki/Nova/CoreTeam to add members to our core team. Thanks, Michael -- Rackspace Australia __ OpenStack Development Mailing List (not for usage questions) Unsubscribe: openstack-dev-requ...@lists.openstack.org?subject:unsubscribe http://lists.openstack.org/cgi-bin/mailman/listinfo/openstack-dev
Re: [openstack-dev] [nova] Nominating Melanie Witt for python-novaclient-core
On 01/27/2015 02:41 PM, Michael Still wrote: Greetings, I would like to nominate Melanie Witt for the python-novaclient-core team. (What is python-novaclient-core? Its a new group which will contain all of nova-core as well as anyone else we think should have core reviewer powers on just the python-novaclient code). Melanie has been involved with nova for a long time now. She does solid reviews in python-novaclient, and at least two current nova-cores have suggested her as ready for core review powers on that repository. Please respond with +1s or any concerns. References: https://review.openstack.org/#/q/project:openstack/python-novaclient+reviewer:%22melanie+witt+%253Cmelwitt%2540yahoo-inc.com%253E%22,n,z As a reminder, we use the voting process outlined at https://wiki.openstack.org/wiki/Nova/CoreTeam to add members to our core team. Thanks, Michael +1 -- Sean Dague http://dague.net signature.asc Description: OpenPGP digital signature __ OpenStack Development Mailing List (not for usage questions) Unsubscribe: openstack-dev-requ...@lists.openstack.org?subject:unsubscribe http://lists.openstack.org/cgi-bin/mailman/listinfo/openstack-dev
Re: [openstack-dev] [oslo] temporarily disabling python 3.x testing for oslo.messaging and oslo.rootwrap
On Tue, Jan 27, 2015, at 12:06 PM, victor stinner wrote: Hi, What is the Python bug? Do you have a reference to the bug report and the patch? http://bugs.python.org/issue21435 Python 3.4.3 release schedule: 3.4.3rc1 will be tagged Saturday February 7 and released Sunday February 8. 3.4.3 final will follow two weeks later, tagged Saturday February 21 and released Sunday February 22. https://mail.python.org/pipermail/python-dev/2015-January/137773.html Victor __ OpenStack Development Mailing List (not for usage questions) Unsubscribe: openstack-dev-requ...@lists.openstack.org?subject:unsubscribe http://lists.openstack.org/cgi-bin/mailman/listinfo/openstack-dev __ OpenStack Development Mailing List (not for usage questions) Unsubscribe: openstack-dev-requ...@lists.openstack.org?subject:unsubscribe http://lists.openstack.org/cgi-bin/mailman/listinfo/openstack-dev
Re: [openstack-dev] [nova] Nominating Melanie Witt for python-novaclient-core
Please respond with +1s or any concerns. +1 --Dan signature.asc Description: OpenPGP digital signature __ OpenStack Development Mailing List (not for usage questions) Unsubscribe: openstack-dev-requ...@lists.openstack.org?subject:unsubscribe http://lists.openstack.org/cgi-bin/mailman/listinfo/openstack-dev
Re: [openstack-dev] [nova] Nominating Melanie Witt for python-novaclient-core
+1 -Original Message- From: Dan Smith [mailto:d...@danplanet.com] Sent: Tuesday, January 27, 2015 3:31 PM To: OpenStack Development Mailing List (not for usage questions) Subject: Re: [openstack-dev] [nova] Nominating Melanie Witt for python-novaclient-core Please respond with +1s or any concerns. +1 --Dan __ OpenStack Development Mailing List (not for usage questions) Unsubscribe: openstack-dev-requ...@lists.openstack.org?subject:unsubscribe http://lists.openstack.org/cgi-bin/mailman/listinfo/openstack-dev
Re: [openstack-dev] [nova] novaclient support for V2.1 micro versions
As I understand it, novaclient would by default not pass the microversion HTTP header (X-OpenStack-Compute-API-Version) so it would get the server's MIN_VERSION, ie 2.1 for the foreseeable future. It would be straightforward to add something like a --api-version=xx command line argument, or it might be useful to read a value from a local config file. I don't think either of those has been done yet, though. gilliard On Fri, Jan 23, 2015 at 1:05 PM, Chen CH Ji jiche...@cn.ibm.com wrote: No, AFAICT it's not supported because the v2.1 microversion and related bp are still under implementation ,there is no change on novaclient now ... Best Regards! Kevin (Chen) Ji 纪 晨 Engineer, zVM Development, CSTL Notes: Chen CH Ji/China/IBM@IBMCN Internet: jiche...@cn.ibm.com Phone: +86-10-82454158 Address: 3/F Ring Building, ZhongGuanCun Software Park, Haidian District, Beijing 100193, PRC [image: Inactive hide details for Day, Phil ---01/23/2015 05:56:47 PM---Hi Folks, Is there any support yet in novaclient for requesti]Day, Phil ---01/23/2015 05:56:47 PM---Hi Folks, Is there any support yet in novaclient for requesting a specific microversion ? (looking From: Day, Phil philip@hp.com To: OpenStack Development Mailing List (openstack-dev@lists.openstack.org) openstack-dev@lists.openstack.org Date: 01/23/2015 05:56 PM Subject: [openstack-dev] [nova] novaclient support for V2.1 micro versions -- Hi Folks, Is there any support yet in novaclient for requesting a specific microversion ? (looking at the final leg of extending clean-shutdown to the API, and wondering how to test this in devstack via the novaclient) Phil __ OpenStack Development Mailing List (not for usage questions) Unsubscribe: openstack-dev-requ...@lists.openstack.org?subject:unsubscribe http://lists.openstack.org/cgi-bin/mailman/listinfo/openstack-dev __ OpenStack Development Mailing List (not for usage questions) Unsubscribe: openstack-dev-requ...@lists.openstack.org?subject:unsubscribe http://lists.openstack.org/cgi-bin/mailman/listinfo/openstack-dev __ OpenStack Development Mailing List (not for usage questions) Unsubscribe: openstack-dev-requ...@lists.openstack.org?subject:unsubscribe http://lists.openstack.org/cgi-bin/mailman/listinfo/openstack-dev
Re: [openstack-dev] [nova] Nominating Melanie Witt for python-novaclient-core
On Tue, Jan 27, 2015 at 3:52 PM, Sean Dague s...@dague.net wrote: On 01/27/2015 02:41 PM, Michael Still wrote: Greetings, I would like to nominate Melanie Witt for the python-novaclient-core team. (What is python-novaclient-core? Its a new group which will contain all of nova-core as well as anyone else we think should have core reviewer powers on just the python-novaclient code). Melanie has been involved with nova for a long time now. She does solid reviews in python-novaclient, and at least two current nova-cores have suggested her as ready for core review powers on that repository. Please respond with +1s or any concerns. References: https://review.openstack.org/#/q/project:openstack/python-novaclient+reviewer:%22melanie+witt+%253Cmelwitt%2540yahoo-inc.com%253E%22,n,z As a reminder, we use the voting process outlined at https://wiki.openstack.org/wiki/Nova/CoreTeam to add members to our core team. Thanks, Michael +1 +1 -- Sean Dague http://dague.net __ OpenStack Development Mailing List (not for usage questions) Unsubscribe: openstack-dev-requ...@lists.openstack.org?subject:unsubscribe http://lists.openstack.org/cgi-bin/mailman/listinfo/openstack-dev __ OpenStack Development Mailing List (not for usage questions) Unsubscribe: openstack-dev-requ...@lists.openstack.org?subject:unsubscribe http://lists.openstack.org/cgi-bin/mailman/listinfo/openstack-dev
Re: [openstack-dev] [tc] Take back the naming process
+1 all the way down. More fun double-plus-good. —j On Jan 27, 2015, at 1:50 PM, Monty Taylor mord...@inaugust.com wrote: I do not like how we are selecting names for our releases right now. The current process is autocratic and opaque and not fun - which is the exact opposite of what a community selected name should be. I propose: * As soon as development starts on release X, we open the voting for the name of release X+1 (we're working on Kilo now, we should have known the name of L at the K summit) * Anyone can nominate a name - although we do suggest that something at least related to the location of the associated summit would be nice * We condorcet vote on the entire list of nominated names * After we have the winning list, the foundation trademark checks the name * If there is a trademark issue (and only a trademark issue - not a marketing doesn't like the name issue) we'll move down to the next name on the list If we cannot have this process be completely open and democratic, then what the heck is the point of having our massive meritocracy in the first place? There's a lot of overhead we deal with by being a leaderless collective you know - we should occasionally get to have fun with it. Monty __ OpenStack Development Mailing List (not for usage questions) Unsubscribe: openstack-dev-requ...@lists.openstack.org?subject:unsubscribe http://lists.openstack.org/cgi-bin/mailman/listinfo/openstack-dev __ OpenStack Development Mailing List (not for usage questions) Unsubscribe: openstack-dev-requ...@lists.openstack.org?subject:unsubscribe http://lists.openstack.org/cgi-bin/mailman/listinfo/openstack-dev
Re: [openstack-dev] [nova] [api] Get servers with limit and IP address filter
The network info for an instance is cached as a blob of data (neutron has the canonical version in most installs), so it isn’t particularly easy to do at the database layer. You would likely need a pretty complex stored procedure to do it accurately. Vish On Jan 27, 2015, at 2:00 PM, Steven Kaufer kau...@us.ibm.com wrote: Hello, When applying an IP address filter to a paginated servers query (eg, supplying servers/detail?ip=192.168limit=100), the IP address filtering is only being applied against the non-filtered page of servers that were retrieved from the DB; see [1]. I believe that the IP address filtering should be done before the limit is applied, returning up to limit servers that match the IP address filter. Currently, if the servers in the page of data returned from the DB do not happen to match the IP address filter (applied in the compute API), then no servers will be returned by the REST API (even if there are servers that match the IP address filter). This seems like a bug to me, shouldn't all filtering be done at the DB layer? [1]: https://github.com/openstack/nova/blob/master/nova/compute/api.py#L2037-L2042 Thanks, Steven Kaufer __ OpenStack Development Mailing List (not for usage questions) Unsubscribe: openstack-dev-requ...@lists.openstack.org?subject:unsubscribe http://lists.openstack.org/cgi-bin/mailman/listinfo/openstack-dev __ OpenStack Development Mailing List (not for usage questions) Unsubscribe: openstack-dev-requ...@lists.openstack.org?subject:unsubscribe http://lists.openstack.org/cgi-bin/mailman/listinfo/openstack-dev
[openstack-dev] [Fuel][Plugins][Orchestration] Unclear handling of primary-controler and controller roles
Hello all, You may know that for deployment configuration we are serializing additional prefix for controller role (primary), with the goal of deployment order control (primary-controller always should be deployed before secondaries) and some condiions in fuel-library code. However, we cannot guarantee that primary controller will be always the same node, because it is not business of nailgun to control elections of primary. Essentially user should not rely on nailgun information to find primary, but we need to persist node elected as primary in first deployment to resolve orchestration issues (when new node added to cluster we should not mark it as primary). So we called primary-controller - internal role, which means that it is not exposed to users (or external developers). But with introduction of plugins and granular deployment, in my opinion, we need to be able to specify that task should run specifically on primary, or on secondaries. Alternative to this approach would be - always run task on all controllers, and let task itself to verify that it is executed on primary or not. Is it possible to have significantly different sets of tasks for controller and primary-controller? And same goes for mongo, and i think we had primary for swift also. __ OpenStack Development Mailing List (not for usage questions) Unsubscribe: openstack-dev-requ...@lists.openstack.org?subject:unsubscribe http://lists.openstack.org/cgi-bin/mailman/listinfo/openstack-dev
[openstack-dev] [barbican] python-barbicanclient 3.0.2 released
Hi openstack-dev, The barbican team would like to announce the release of python-barbicanclient 3.0.2. This is a minor release that fixes a bug in the pbr versioning that was preventing the client from working correctly. The release is available on PyPI https://pypi.python.org/pypi/python-barbicanclient/3.0.2 https://pypi.python.org/pypi/python-barbicanclient/3.0.2 Thanks, - Doug Mendizábal Douglas Mendizábal IRC: redrobot PGP Key: 245C 7B6F 70E9 D8F3 F5D5 0CC9 AD14 1F30 2D58 923C signature.asc Description: Message signed with OpenPGP using GPGMail __ OpenStack Development Mailing List (not for usage questions) Unsubscribe: openstack-dev-requ...@lists.openstack.org?subject:unsubscribe http://lists.openstack.org/cgi-bin/mailman/listinfo/openstack-dev
Re: [openstack-dev] [Fuel] Getting rid of kickstart/preseed for all NEW releases
Andrew is right about our ability to upgrade packages on a system using yum update or apt-get upgrade because IBP installs standalone OS (unlike cloud case). Even more, we'll build Ubuntu images on a master node by 6.1 and of course we'll be able to use actual repo for that. Vladimir Kozhukalov On Tue, Jan 27, 2015 at 1:23 PM, Vladimir Kozhukalov vkozhuka...@mirantis.com wrote: Guys, First, we are not talking about deliberate disabling preseed based approach just because we so crazy. The question is What is the best way to achieve our 6.1 goals? We definitely need to be able to install two versions of Ubuntu 12.04 and 14.04. Those versions have different sets of packages (for example ntp related ones) and we install some of those packages during provisioning (we point out which packages we need with their versions). To make this working with preseed based approach we need either to insert some IF release==6.1 conditional lines into preseed (not very beautiful, isn't it?) or to create different Distros and Profiles for different releases. Second is not a problem for Cobbler but it is for nailgun/astute because we do not deal with that stuff and it looks that we cannot implement this easily. IMO, the only options we have are to insert IFs into preseed (I would say it is not more reliable than IBP) or to refuse preseed approach for ONLY NEW UPCOMING releases. You can call crazy but for me having a set IFs together with pmanager.py which are absolutely difficult to maintain is crazy. Vladimir Kozhukalov On Tue, Jan 27, 2015 at 3:03 AM, Andrew Woodward xar...@gmail.com wrote: On Mon, Jan 26, 2015 at 10:47 AM, Sergii Golovatiuk sgolovat...@mirantis.com wrote: Until we are sure IBP solves operation phase where we need to deliver updated packages so client will be able to provision new machines with these fixed packages, I would leave backward compatibility with normal provision. ... Just in case. doesn't running 'apt-get upgrade' or 'yum update' after laying out the FS image resolve the gap until we can rebuild the images on the fly? -- Best regards, Sergii Golovatiuk, Skype #golserge IRC #holser On Mon, Jan 26, 2015 at 4:56 PM, Vladimir Kozhukalov vkozhuka...@mirantis.com wrote: My suggestion is to make IBP the only option available for all upcoming OpenStack releases which are defined in openstack.yaml. It is to be possible to install OS using kickstart for all currently available OpenStack releases. Vladimir Kozhukalov On Mon, Jan 26, 2015 at 6:22 PM, Igor Kalnitsky ikalnit...@mirantis.com wrote: Just want to be sure I understand you correctly: do you propose to FORBID kickstart/preseed installation way in upcoming release at all? On Mon, Jan 26, 2015 at 3:59 PM, Vladimir Kozhukalov vkozhuka...@mirantis.com wrote: Subject is changed. Vladimir Kozhukalov On Mon, Jan 26, 2015 at 4:55 PM, Vladimir Kozhukalov vkozhuka...@mirantis.com wrote: Dear Fuelers, As you might know we need it to be possible to install several versions of a particular OS (Ubuntu and Centos) by 6.1 As far as having different OS versions also means having different sets of packages and some of the packages are installed and configured during provisioning stage, we need to have a kind of kickstart/preseed version mechanism. Cobbler is exactly such a mechanism. It allows us to have several Distros (installer images) and profiles (kickstart/preseed files). But unfortunately, for some reasons we have not been using those Cobbler's capabilities since the beginning of Fuel and it doesn't seem to be easily introduced into Nailgun to deal with the whole Cobbler life cycle. Anyway, we are moving towards IBP (image based provisioning) and we already have different images connected to different OpenStack releases (openstack.yaml) and everything else which is necessary for initial node configuration is serialized inside provision data (including profile name like 'ubuntu_1204' or 'ubuntu_1404') and we are able to choose cloud-init template by this profile name. And taking into account what it is written above, the suggestion is to completely avoid using kickstart/preseed based way of OS provisioning by 6.1 for all new releases allowing ONLY old ones to use this way. Any opinions about that stuff are welcome. Vladimir Kozhukalov __ OpenStack Development Mailing List (not for usage questions) Unsubscribe: openstack-dev-requ...@lists.openstack.org?subject:unsubscribe http://lists.openstack.org/cgi-bin/mailman/listinfo/openstack-dev __ OpenStack Development Mailing List (not for usage questions) Unsubscribe:
Re: [openstack-dev] [tc] do we really need project tags in the governance repository?
Doug Hellmann wrote: On Mon, Jan 26, 2015, at 12:02 PM, Thierry Carrez wrote: [...] I'm open to alternative suggestions on where the list of tags, their definition and the list projects they apply to should live. If you don't like that being in the governance repository, what would have your preference ? From the very beginning I have taken the position that tags are by themselves not sufficiently useful for evaluating projects. If someone wants to choose between Ceilometer, Monasca, or StackTach, we're unlikely to come up with tags that will let them do that. They need in-depth discussions of deployment options, performance characteristics, and feature trade-offs. They are still useful to give people a chance to discover that those 3 are competing in the same space, and potentially get an idea of which one (if any) is deployed on more than one public cloud, better documented, or security-supported. I agree with you that an (opinionated) article comparing those 3 solutions would be a nice thing to have, but I'm just saying that basic, clearly-defined reference project metadata still has a lot of value, especially as we grow the number of projects. That said, I object to only saying this is all information that can be found elsewhere or should live elsewhere, because that is just keeping the current situation -- where that information exists somewhere but can't be efficiently found by our downstream consumers. We need a taxonomy and clear definitions for tags, so that our users can easily find, understand and navigate such project metadata. As someone new to the project, I would not think to look in the governance documents for state information about a project. I would search for things like install guide openstack or component list openstack and expect to find them in the documentation. So I think putting the information in those (or similar) places will actually make it easier to find for someone that hasn't been involved in the discussion of tags and the governance repository. The idea here is to have the reference information in some Gerrit-controlled repository (currently openstack/governance, but I'm open to moving this elsewhere), and have that reference information consumed by the openstack.org website when you navigate to the Software section, to present a browseable/searchable list of projects with project metadata. I don't expect anyone to read the YAML file from the governance repository. On the other hand, the software section of the openstack.org website is by far the most visited page of all our web properties, so I expect most people to see that. If we need a component list with descriptions, let's build that. It can be managed by a team of interested parties -- perhaps some of the operators or deployers, for example. I don't know if we have an existing place where it would make sense to put it, or if we need a new repository. We've been applying DRY to the existing projects/programs list and saying that because we already have a list in the governance repository we shouldn't repeat that information elsewhere, but we're also starting to go to a lot of lengths to define a format to hold information (tags, with metadata, a taxonomy, etc.) that isn't needed for project governance. That makes me think we're trying to force-fit this idea into a single list. If I understand you correctly, you'd like to have the project teams list (previously known as programs) in the governance repository, together with the list of their associated code repositories. Then you would have a duplicate list of code repositories, with their associated tag metadata, in some other repository. I understand the limits of DRY, but that duplication still sounds like a maintenance nightmare (especially given how often the repository list is updated)... How do you make sure that repositories in A are in B ? Some check test at the gate ? Alternatively we could have the project teams / code repositories association live in the other repository and just duplicate the project teams list, which arguably should be smaller. That means we would also delegate the repository scope sanity-check to the other repository maintainers, but I'm fine with that. We could have one file per project team and a check test that validates the project team exists in the governance repository. The only (small) issue with that option is that code repositories translate into ATCs, which translate into TC voters, so this is arguably a governance thing. The tagging proposal (only one-month old) has so far received a pretty good reception from operators and other downstream users, who see it as a way to explain and contribute what type of information matters to them. The Technical Committee members are not the only people who can propose tags. I agree that a product matrix with some basic information will be useful for deployers and operators to find project details, which can then go into more
Re: [openstack-dev] [Telco][NFV] Meeting facilitator for January 28th
Hi Steve, I can host it. Regards Marc Am 27.01.2015 um 08:40 schrieb Steve Gordon sgor...@redhat.com: Hi all, As mentioned in the notes from last week's meeting I am going to be in transit during our 1400 UTC meeting this Wednesday (28th) [1]. Is anyone else willing and able to facilitate in my absence? Thanks, Steve [1] https://wiki.openstack.org/wiki/TelcoWorkingGroup#Technical_Team_Meetings __ OpenStack Development Mailing List (not for usage questions) Unsubscribe: openstack-dev-requ...@lists.openstack.org?subject:unsubscribe http://lists.openstack.org/cgi-bin/mailman/listinfo/openstack-dev __ OpenStack Development Mailing List (not for usage questions) Unsubscribe: openstack-dev-requ...@lists.openstack.org?subject:unsubscribe http://lists.openstack.org/cgi-bin/mailman/listinfo/openstack-dev
Re: [openstack-dev] [Fuel] Proposal for nominating people to python-fuelclient-core
I think the consensus was found and the resolution is positive. 26 січ. 2015 о 14:37 Tomasz Napierala tnapier...@mirantis.com написав(ла): +1 On 26 Jan 2015, at 11:33, Roman Prykhodchenko m...@romcheg.me wrote: Hi Guys, According to our previous thread [1] and the decision made there I’d like to initiate separation of the original fuel-core group. At the first step propose the following python guys from the original fuel-core group to be nominated to python-fuelclient-core group. Aleksey Kasatkin — akasatkin Dmitry Pyzhov — dpyzhov Evgeniy L — evgeniyl___ Igor Kalnitsky — ikalnitsky The decision will be made basing on lazy consensus. Since I was in python-fuelclient-core group only for technical reasons, I will remove myself from there as soon as it’s populated. All following nominations and de-nominations will be done according to the approved core-dev process [2]. References: 1. http://lists.openstack.org/pipermail/openstack-dev/2015-January/055038.html 2. https://wiki.openstack.org/wiki/Governance/Approved/CoreDevProcess - romcheg __ OpenStack Development Mailing List (not for usage questions) Unsubscribe: openstack-dev-requ...@lists.openstack.org?subject:unsubscribe http://lists.openstack.org/cgi-bin/mailman/listinfo/openstack-dev -- Tomasz 'Zen' Napierala Sr. OpenStack Engineer tnapier...@mirantis.com __ OpenStack Development Mailing List (not for usage questions) Unsubscribe: openstack-dev-requ...@lists.openstack.org?subject:unsubscribe http://lists.openstack.org/cgi-bin/mailman/listinfo/openstack-dev signature.asc Description: Message signed with OpenPGP using GPGMail __ OpenStack Development Mailing List (not for usage questions) Unsubscribe: openstack-dev-requ...@lists.openstack.org?subject:unsubscribe http://lists.openstack.org/cgi-bin/mailman/listinfo/openstack-dev
Re: [openstack-dev] [Fuel] fuel master monitoring
The proposed monitoring options make sense, since the Fuel master has nothing yet, but I would like to ressurect this thread to see if we can discuss some strategies in order to avoid the /var/log fillup with consequent docker containers corruption. Now, a customer facing this corruption can recover the master, as described in our documentation [1]. Of course, if we could avoid the problem at all, it would be even better. So, do we have a strategy in progress on this? As a first attempt, I filed a blueprint, proposing to separate /var/log [2]. Thanks, Fabrizio. [1] http://docs.mirantis.com/openstack/fuel/fuel-5.1/operations.html#fuel-master-and-docker-disk-space-troubleshooting http://docs.mirantis.com/openstack/fuel/fuel-5.1/operations.html#fuel-master-and-docker-disk-space-troubleshooting [2] https://blueprints.launchpad.net/fuel/+spec/isolate-var-log-on-master https://blueprints.launchpad.net/fuel/+spec/isolate-var-log-on-master On 21 Nov 2014, at 12:01, Matthew Mosesohn mmoses...@mirantis.com wrote: I'm okay with Sensu or Monit, just as long as the results of monitoring can be represented in a web UI and has a configurable option for email alerting. Tight integration with Fuel Web is a nice-to-have (via AMQP perhaps), but anything that can solve our out-of-disk scenario is ideal. I did my best to tune our logging and logs rotation, but monitoring is the most sensible approach. -Matthew On Fri, Nov 21, 2014 at 12:21 PM, Przemyslaw Kaminski pkamin...@mirantis.com wrote: BTW, there's also Monit http://mmonit.com/monit/ (though it's in C) that looks quite nice. Some config examples: http://omgitsmgp.com/2013/09/07/a-monit-primer/ P. On 11/20/2014 09:13 PM, Dmitriy Shulyak wrote: Guys, maybe we can use existing software, for example Sensu [1]? Maybe i am wrong, but i dont like the idea to start writing our small monitoring applications.. Also something well designed and extendable can be reused for statistic collector 1. https://github.com/sensu On Wed, Nov 12, 2014 at 12:47 PM, Tomasz Napierala tnapier...@mirantis.com wrote: On 06 Nov 2014, at 12:20, Przemyslaw Kaminski pkamin...@mirantis.com wrote: I didn't mean a robust monitoring system, just something simpler. Notifications is a good idea for FuelWeb. I’m all for that, but if we add it, we need to document ways to clean up space. We could also add some kind of simple job to remove rotated logs, obsolete spanshots, etc., but this is out of scope for 6.0 I guess. Regards, -- Tomasz 'Zen' Napierala Sr. OpenStack Engineer tnapier...@mirantis.com ___ OpenStack-dev mailing list OpenStack-dev@lists.openstack.org http://lists.openstack.org/cgi-bin/mailman/listinfo/openstack-dev ___ OpenStack-dev mailing list OpenStack-dev@lists.openstack.org http://lists.openstack.org/cgi-bin/mailman/listinfo/openstack-dev ___ OpenStack-dev mailing list OpenStack-dev@lists.openstack.org http://lists.openstack.org/cgi-bin/mailman/listinfo/openstack-dev ___ OpenStack-dev mailing list OpenStack-dev@lists.openstack.org http://lists.openstack.org/cgi-bin/mailman/listinfo/openstack-dev __ OpenStack Development Mailing List (not for usage questions) Unsubscribe: openstack-dev-requ...@lists.openstack.org?subject:unsubscribe http://lists.openstack.org/cgi-bin/mailman/listinfo/openstack-dev
Re: [openstack-dev] [Fuel] Getting rid of kickstart/preseed for all NEW releases
Guys, First, we are not talking about deliberate disabling preseed based approach just because we so crazy. The question is What is the best way to achieve our 6.1 goals? We definitely need to be able to install two versions of Ubuntu 12.04 and 14.04. Those versions have different sets of packages (for example ntp related ones) and we install some of those packages during provisioning (we point out which packages we need with their versions). To make this working with preseed based approach we need either to insert some IF release==6.1 conditional lines into preseed (not very beautiful, isn't it?) or to create different Distros and Profiles for different releases. Second is not a problem for Cobbler but it is for nailgun/astute because we do not deal with that stuff and it looks that we cannot implement this easily. IMO, the only options we have are to insert IFs into preseed (I would say it is not more reliable than IBP) or to refuse preseed approach for ONLY NEW UPCOMING releases. You can call crazy but for me having a set IFs together with pmanager.py which are absolutely difficult to maintain is crazy. Vladimir Kozhukalov On Tue, Jan 27, 2015 at 3:03 AM, Andrew Woodward xar...@gmail.com wrote: On Mon, Jan 26, 2015 at 10:47 AM, Sergii Golovatiuk sgolovat...@mirantis.com wrote: Until we are sure IBP solves operation phase where we need to deliver updated packages so client will be able to provision new machines with these fixed packages, I would leave backward compatibility with normal provision. ... Just in case. doesn't running 'apt-get upgrade' or 'yum update' after laying out the FS image resolve the gap until we can rebuild the images on the fly? -- Best regards, Sergii Golovatiuk, Skype #golserge IRC #holser On Mon, Jan 26, 2015 at 4:56 PM, Vladimir Kozhukalov vkozhuka...@mirantis.com wrote: My suggestion is to make IBP the only option available for all upcoming OpenStack releases which are defined in openstack.yaml. It is to be possible to install OS using kickstart for all currently available OpenStack releases. Vladimir Kozhukalov On Mon, Jan 26, 2015 at 6:22 PM, Igor Kalnitsky ikalnit...@mirantis.com wrote: Just want to be sure I understand you correctly: do you propose to FORBID kickstart/preseed installation way in upcoming release at all? On Mon, Jan 26, 2015 at 3:59 PM, Vladimir Kozhukalov vkozhuka...@mirantis.com wrote: Subject is changed. Vladimir Kozhukalov On Mon, Jan 26, 2015 at 4:55 PM, Vladimir Kozhukalov vkozhuka...@mirantis.com wrote: Dear Fuelers, As you might know we need it to be possible to install several versions of a particular OS (Ubuntu and Centos) by 6.1 As far as having different OS versions also means having different sets of packages and some of the packages are installed and configured during provisioning stage, we need to have a kind of kickstart/preseed version mechanism. Cobbler is exactly such a mechanism. It allows us to have several Distros (installer images) and profiles (kickstart/preseed files). But unfortunately, for some reasons we have not been using those Cobbler's capabilities since the beginning of Fuel and it doesn't seem to be easily introduced into Nailgun to deal with the whole Cobbler life cycle. Anyway, we are moving towards IBP (image based provisioning) and we already have different images connected to different OpenStack releases (openstack.yaml) and everything else which is necessary for initial node configuration is serialized inside provision data (including profile name like 'ubuntu_1204' or 'ubuntu_1404') and we are able to choose cloud-init template by this profile name. And taking into account what it is written above, the suggestion is to completely avoid using kickstart/preseed based way of OS provisioning by 6.1 for all new releases allowing ONLY old ones to use this way. Any opinions about that stuff are welcome. Vladimir Kozhukalov __ OpenStack Development Mailing List (not for usage questions) Unsubscribe: openstack-dev-requ...@lists.openstack.org?subject:unsubscribe http://lists.openstack.org/cgi-bin/mailman/listinfo/openstack-dev __ OpenStack Development Mailing List (not for usage questions) Unsubscribe: openstack-dev-requ...@lists.openstack.org?subject:unsubscribe http://lists.openstack.org/cgi-bin/mailman/listinfo/openstack-dev __ OpenStack Development Mailing List (not for usage questions) Unsubscribe: openstack-dev-requ...@lists.openstack.org?subject:unsubscribe http://lists.openstack.org/cgi-bin/mailman/listinfo/openstack-dev
Re: [openstack-dev] [heat][hot]
On Tue, Jan 27, 2015 at 7:00 PM, Dmitry mey...@gmail.com wrote: I have another question, is it possible to get the stack name in the hot script? E.g. params: $stack_name: {get_global_variable: $stack.name} See: http://docs.openstack.org/developer/heat/template_guide/hot_spec.html#pseudo-parameters Regards Angus On Tue, Jan 27, 2015 at 3:53 AM, Qiming Teng teng...@linux.vnet.ibm.com wrote: On Mon, Jan 26, 2015 at 07:44:25PM +0200, Dmitry wrote: thanks, exactly what I was looking for: curl http://169.254.169.254/1.0/meta-data/instance-id or, /var/lib/cloud/data/instance-id, if cloud-init is there. Regards, Qiming On Mon, Jan 26, 2015 at 7:31 PM, Zane Bitter zbit...@redhat.com wrote: On 25/01/15 10:41, Dmitry wrote: Hello, I need to receive instance id as part of the instance installation script. Something like: params: $current_id: {get_param: $this.id http://this.id} I have no idea what this is supposed to mean, sorry. Is it possible? The get_resource function will return the server UUID for a server resource, but you can't use it from within that resource itself (it would be a circular reference). The UUID of a server is provided to the server through the Nova metadata; you should retrieve it from there in your user_data script. cheers, Zane. __ OpenStack Development Mailing List (not for usage questions) Unsubscribe: openstack-dev-requ...@lists.openstack.org?subject:unsubscribe http://lists.openstack.org/cgi-bin/mailman/listinfo/openstack-dev __ OpenStack Development Mailing List (not for usage questions) Unsubscribe: openstack-dev-requ...@lists.openstack.org?subject:unsubscribe http://lists.openstack.org/cgi-bin/mailman/listinfo/openstack-dev __ OpenStack Development Mailing List (not for usage questions) Unsubscribe: openstack-dev-requ...@lists.openstack.org?subject:unsubscribe http://lists.openstack.org/cgi-bin/mailman/listinfo/openstack-dev __ OpenStack Development Mailing List (not for usage questions) Unsubscribe: openstack-dev-requ...@lists.openstack.org?subject:unsubscribe http://lists.openstack.org/cgi-bin/mailman/listinfo/openstack-dev __ OpenStack Development Mailing List (not for usage questions) Unsubscribe: openstack-dev-requ...@lists.openstack.org?subject:unsubscribe http://lists.openstack.org/cgi-bin/mailman/listinfo/openstack-dev
Re: [openstack-dev] [barbican] python-barbicanclient 3.0.2 released
Hi Sean, Thanks for the heads up, and for adding the stable-compat-jobs to the client. [1] This is an interesting problem, since the proposal bot keeps the python-barbicanclient requirements in sync with global-requirements. I’m not sure what the correct fix for this is? - Doug [1] https://review.openstack.org/#/c/150645/ Douglas Mendizábal IRC: redrobot PGP Key: 245C 7B6F 70E9 D8F3 F5D5 0CC9 AD14 1F30 2D58 923C On Jan 27, 2015, at 7:22 PM, Sean Dague s...@dague.net wrote: On 01/27/2015 05:21 PM, Sean Dague wrote: On 01/27/2015 03:55 PM, Douglas Mendizabal wrote: Hi openstack-dev, The barbican team would like to announce the release of python-barbicanclient 3.0.2. This is a minor release that fixes a bug in the pbr versioning that was preventing the client from working correctly. The release is available on PyPI https://pypi.python.org/pypi/python-barbicanclient/3.0.2 Which just broke everything, because it creates incompatible requirements in stable/juno with cinder. :( Here is the footnote - http://logs.openstack.org/18/150618/1/check/check-grenade-dsvm/c727602/logs/grenade.sh.txt.gz#_2015-01-28_00_04_54_429 -Sean -- Sean Dague http://dague.net __ OpenStack Development Mailing List (not for usage questions) Unsubscribe: openstack-dev-requ...@lists.openstack.org?subject:unsubscribe http://lists.openstack.org/cgi-bin/mailman/listinfo/openstack-dev signature.asc Description: Message signed with OpenPGP using GPGMail __ OpenStack Development Mailing List (not for usage questions) Unsubscribe: openstack-dev-requ...@lists.openstack.org?subject:unsubscribe http://lists.openstack.org/cgi-bin/mailman/listinfo/openstack-dev
Re: [openstack-dev] [Manila]Questions about using not handle share-servers drivers with Flat network
On 01/27/2015 06:39 PM, Li, Chen wrote: Hi list, I have some questions. Hope can get help from you guys. Manila has two driver modes. For handle share server drivers, the share-network is easy to understand. For not handle share-servers drivers, manila request admin to do everything before manila-share service start, and when the service is running, it only serves requests do not contain share-network. I kept confusing about which/why users would create shares without share-network. Although when working with this kind of driver, the manila-share service can only support one specific network restricted by the backend. But “users” do not know backends, they should always want to create shares with share-network, because users always want to connect shares to their instances that lives in the cloud with “share-network”. Then I have been told that these shares created without share-network are assumed to be used on a public network. The public network do make a clear explanation about why share-network not matter anymore. But, when I build my cloud with Manila, what I want to do is let backends to serve my “Flat network”. I want to have 2 backends in Manila, both of them are “*/not/* handle share-servers drivers”. I set 192.168.6.253 for backend1 and create a “Flat network” in neutron with subnet 192.168.6.0/24 with IP range from 192.168.6.1-192.168.6.252. I set 192.168.7.253 for backend2 and create a “Flat network” in neutron with subnet 192.168.7.0/24 with IP range from 192.168.7.1-192.168.7.252. The reason I build my cloud like this is because I want to do some performance tests on both backends, to compare the two backends. I think it should not hard to do it, but manila do not support that currently. So, is this the behavior should work ? Or anything else I missed ? Manila needs to support backends that can create share servers and backends that can't create share servers. We do this because of the reality that different storage systems have different capabilities and designs, and we don't want to block anything that can reasonably described as a shared filesystem from working with Manila. For the purposes of Manila, a share server is a logically isolated instance of a file share server, with its own IP address, routing tables, security domain, and name services. Manila only tracks the existence of share servers that were created as the result of a share-create operation. Share servers created by manila have IP addresses assigned by Manila, and can be expected to be deleted by Manila sometime after the last share on that share server is deleted. Backends that simply create shares on a preexsting storage systems are not referred to as share servers and networking concerns for those systems are out of scope for Manila. The reason we distinguish between so-called flat and segmented networks is to accommodate the reality that in the real world, storage systems often exist inside labs and datacenters where the network is not under the control of the storage admin. This was a key point we identified during Juno and one of the major reasons for the network rearchitecture during Kilo. If a storage controller is connected into a flat subnet it may be able to create share servers on that subnet, but nothing more fancy. To participate in multiple subnets some form of network virtualization or segmentation is required and oftentimes that's not possible either due to lack of support on the storage controller, lack of support in the network due to physical or administrative limitations, or even lack of sophistication on the part of the deployer (don't discount this last one -- the difficulty of getting the network right is a major blocker for admins who want to try out Manila). What flat network means from Manila's perspective is that share servers may be created but only on a network predefined by the administrator, and not on any tenant-defined network. Connectivity between the tenant network and the share server network is considered out of scope for Manila. Segmented network means that Manila presumes complete control of the network through some powerful plugin such as Neutron such that Manila can connect share servers to any network specified by the tenant, and Manila assumes responsibility for establishing any needed routes. In your case if you have a driver that doesn't handle share servers, then the network is complete out of scope for Manila. Drivers that don't manage share servers have neither flat not segment networking in Manila, they have NO networking. I'll do a followup mail on the UI changes that are coming around share networks and the mess that they have become. For now, you just have to know that share networks should not be used with drivers that don't manage share servers, and they should be used with drivers that do manage share servers. -Ben Swartzlander
Re: [openstack-dev] [nova] Nominating Melanie Witt for python-novaclient-core
On 1/27/2015 4:41 PM, Michael Still wrote: Greetings, I would like to nominate Melanie Witt for the python-novaclient-core team. (What is python-novaclient-core? Its a new group which will contain all of nova-core as well as anyone else we think should have core reviewer powers on just the python-novaclient code). Melanie has been involved with nova for a long time now. She does solid reviews in python-novaclient, and at least two current nova-cores have suggested her as ready for core review powers on that repository. Please respond with +1s or any concerns. References: https://review.openstack.org/#/q/project:openstack/python-novaclient+reviewer:%22melanie+witt+%253Cmelwitt%2540yahoo-inc.com%253E%22,n,z As a reminder, we use the voting process outlined at https://wiki.openstack.org/wiki/Nova/CoreTeam to add members to our core team. Thanks, Michael +1 -- Thanks, Matt Riedemann __ OpenStack Development Mailing List (not for usage questions) Unsubscribe: openstack-dev-requ...@lists.openstack.org?subject:unsubscribe http://lists.openstack.org/cgi-bin/mailman/listinfo/openstack-dev
Re: [openstack-dev] [nova][gate][stable] How eventlet 0.16.1 broke the gate
On 1/15/2015 5:41 PM, Sean Dague wrote: On 01/15/2015 06:25 PM, Joe Gordon wrote: We can side step the dependency graphing and ordering issue by looking at the list of curently installed packages via pip freeze and not installing dependencies (pip install --no-deps) After looking into this further here are the known issues: * Partial capping won't work [0], so we need to pin all dependencies, we can generate this list per file via pip install -r and pip freeze, but this doesn't address the issue of apt-get vs pip install. For example in the stable gate we use suds 0.4.1 but only suds 0.4.0 is available via pip. * Not all packages are installed in are standard dsvm-tempest env, so using pip-freeze from that isn't enough * We need to run this per requirements file and move to using pip install --no-deps everywhere. As the global-requirements sync wouldn't work the first time since files don't list all transient dependencies yet. So that's basically writing our own dependency system entirely, and skipping pip's (vs. fudging around pip's issues). I expect that's going to go poorly in the OpenStack ecosystem realm because a lot of very repetitive manual analysis will need to be done on each project. And if we want to bump a cap, regenerating all the graphs becomes another manual process. * We can still break if a package version is removed from pypi * in pip-freeze we sometimes install versions lower then our minimum version (python-libvirt!) That's because python-libvirt is not in any requirements.txt file, so we're taking the system version. It's in test-requirements.txt, but not for long. [1] -Sean [1] https://review.openstack.org/#/c/150148/ -- Thanks, Matt Riedemann __ OpenStack Development Mailing List (not for usage questions) Unsubscribe: openstack-dev-requ...@lists.openstack.org?subject:unsubscribe http://lists.openstack.org/cgi-bin/mailman/listinfo/openstack-dev
Re: [openstack-dev] [Heat] core team changes
Hi all After having a look at the stats: http://stackalytics.com/report/contribution/heat-group/90 http://stackalytics.com/?module=heat-groupmetric=person-day I'd like to propose the following changes to the Heat core team: Add: Qiming Teng Huang Tianhua Remove: Bartosz Górski (Bartosz has indicated that he is happy to be removed and doesn't have the time to work on heat ATM). Core team please respond with +/- 1. Thanks Angus +1! -- Thomas __ OpenStack Development Mailing List (not for usage questions) Unsubscribe: openstack-dev-requ...@lists.openstack.org?subject:unsubscribe http://lists.openstack.org/cgi-bin/mailman/listinfo/openstack-dev
Re: [openstack-dev] [Heat] core team changes
+1 Pavlo Shchelokovskyy Software Engineer Mirantis Inc www.mirantis.com On Wed, Jan 28, 2015 at 8:26 AM, Thomas Herve thomas.he...@enovance.com wrote: Hi all After having a look at the stats: http://stackalytics.com/report/contribution/heat-group/90 http://stackalytics.com/?module=heat-groupmetric=person-day I'd like to propose the following changes to the Heat core team: Add: Qiming Teng Huang Tianhua Remove: Bartosz Górski (Bartosz has indicated that he is happy to be removed and doesn't have the time to work on heat ATM). Core team please respond with +/- 1. Thanks Angus +1! -- Thomas __ OpenStack Development Mailing List (not for usage questions) Unsubscribe: openstack-dev-requ...@lists.openstack.org?subject:unsubscribe http://lists.openstack.org/cgi-bin/mailman/listinfo/openstack-dev __ OpenStack Development Mailing List (not for usage questions) Unsubscribe: openstack-dev-requ...@lists.openstack.org?subject:unsubscribe http://lists.openstack.org/cgi-bin/mailman/listinfo/openstack-dev
Re: [openstack-dev] [nova] The constraints from flavor and image metadata
Hi, Travis Thanks for your reply. I think I'm more talking about the resource constraints instead of behavior constraints. My example like serial_port_count, memory_pagesize, hw_numa_nodes etc are all requires resources. Sorry for the confusion. If image property requires resource that's not specified in flavor, what should be the result. I'm not sure if there are blanket rule, but maybe there are some generic consideration factor? Thanks --jyh -Original Message- From: Tripp, Travis S [mailto:travis.tr...@hp.com] Sent: Wednesday, January 21, 2015 6:00 PM To: OpenStack Development Mailing List (not for usage questions) Subject: Re: [openstack-dev] The constraints from flavor and image metadata JYH, Are you asking for this to be a blanket rule? It seems to me that this could be a case by case basis, but I question making it a blanket rule. For example, the os_shutdown_timeout property [1] seems very workload specific. In your proposal, this would mean that the operator would have to add that property with a max value to every single flavor in order for it to be taken advantage of, right? Is that really the desired behavior? Or what about the watchdog behavior (hw_watchdog_action)? It supports an enum of possibilities: disabled,reset,poweroff, pause,none² If the flavor provides a default value what would it even mean for an image to specify something different? [1](https://review.openstack.org/#/c/89650/12) George, Regarding constraints, you should take a look at this: http://docs.openstack.org/developer/glance/metadefs-concepts.html Almost all of the available nova properties with constraint enforcement can be viewed by getting a current devstack, going into horizon, and launching the Update Metadata action on flavors / Host Aggregates, or Images. -Travis On 1/17/15, 7:41 AM, George Shuklin george.shuk...@gmail.com wrote: When I played with metadata, I had have constant feeling it had mess together few things: 1. H/W requirements for images. 2. Accounting requirements (good CPU for good price, HDD for cheap) 3. Licensing restrictions (run this one only on the hosts with licenses) 4. Administrative management (like 'flavors of tenant X should be run only on hosts Y') 5. OS information (like inherited metadata on images) All that together is called 'metadata'. Some metadata have special meaning in one context (like 'availability_zone' for hosts, or CPU limitation), some is used by administrator in other context. All together it looks like pre-datastructure code (if someone remembers that). No data types, no type restrictions, you can assign letter to instruction address and pointer to string to float. Same with current metadata in nova/glance. Raw namespace of key-value items without any meaningful restriction and specific expression. It gives flexibility, but cause a huge strain on operators. I think it needs more expressive representation. On 01/13/2015 11:39 PM, Jiang, Yunhong wrote: Hi, There are some discussion and disagreement on the requirement from flavor and image metadata at nova spec https://review.openstack.org/#/c/138937/ and I want to get more input from the community. When launch a VM, some requirements may come from image metadata and flavor. There are a lot of such cases like serial_port_count, memory_pagesize, hw_numa_nodes, hw:cpu_max_sockets etc. Most of them are done in nova/virt/hardware.py. Both the nova-spec and the current implementation seems agree that if flavor has the requirement, the image's metadata should not require more than the flavor requirement. However, the disagreement comes when no requirement from flavor, i.e. only image has the resource requirement. For example, for serial_port_count, If flavor extra specs is not set, then any image meta value is permitted. For hw_mem_page_size, it's forbidden if only image request and no flavor request (https://github.com/openstack/nova/blob/master/nova/virt/hardware.p y#L873 ), and hw_numa_nodes will fail if both flavor and image metadata are specified (https://github.com/openstack/nova/blob/master/nova/virt/hardware.p y#L852 ). As to this nova spec at https://review.openstack.org/#/c/138937/ , someone (Don, Malini) think if image requires some feature/resource that is not specified in flavor, it should be ok, while I think it should be forbidden. I discussed with Jay Pipe on IRC before and he thought if flavor has no requirement, image requirement should be failed, and I created a bug at https://bugs.launchpad.net/nova/+bug/1403276 at that time. But according to the discussion on this BP, seems this is not always accepted by others. I hope to get feedback from the mailing list on the relationship of requirement from image/flavor. Possibly we should take different
Re: [openstack-dev] [nova] The constraints from flavor and image metadata
Sorry for slow response, this mail is lost in the mail flood. For the pre-datastructure code, I think there have been some discussion on it, like https://wiki.openstack.org/wiki/VirtDriverImageProperties or https://bugs.launchpad.net/nova/+bug/1275875 . But I do agree that we should enhance it to be more formal, if we do treat it as something like API. Thanks --jyh -Original Message- From: George Shuklin [mailto:george.shuk...@gmail.com] Sent: Saturday, January 17, 2015 6:41 AM To: openstack-dev@lists.openstack.org Subject: Re: [openstack-dev] The constraints from flavor and image metadata When I played with metadata, I had have constant feeling it had mess together few things: 1. H/W requirements for images. 2. Accounting requirements (good CPU for good price, HDD for cheap) 3. Licensing restrictions (run this one only on the hosts with licenses) 4. Administrative management (like 'flavors of tenant X should be run only on hosts Y') 5. OS information (like inherited metadata on images) All that together is called 'metadata'. Some metadata have special meaning in one context (like 'availability_zone' for hosts, or CPU limitation), some is used by administrator in other context. All together it looks like pre-datastructure code (if someone remembers that). No data types, no type restrictions, you can assign letter to instruction address and pointer to string to float. Same with current metadata in nova/glance. Raw namespace of key-value items without any meaningful restriction and specific expression. It gives flexibility, but cause a huge strain on operators. I think it needs more expressive representation. On 01/13/2015 11:39 PM, Jiang, Yunhong wrote: Hi, There are some discussion and disagreement on the requirement from flavor and image metadata at nova spec https://review.openstack.org/#/c/138937/ and I want to get more input from the community. When launch a VM, some requirements may come from image metadata and flavor. There are a lot of such cases like serial_port_count, memory_pagesize, hw_numa_nodes, hw:cpu_max_sockets etc. Most of them are done in nova/virt/hardware.py. Both the nova-spec and the current implementation seems agree that if flavor has the requirement, the image's metadata should not require more than the flavor requirement. However, the disagreement comes when no requirement from flavor, i.e. only image has the resource requirement. For example, for serial_port_count, If flavor extra specs is not set, then any image meta value is permitted. For hw_mem_page_size, it's forbidden if only image request and no flavor request (https://github.com/openstack/nova/blob/master/nova/virt/hardware.py#L 873 ), and hw_numa_nodes will fail if both flavor and image metadata are specified (https://github.com/openstack/nova/blob/master/nova/virt/hardware.py#L 852 ). As to this nova spec at https://review.openstack.org/#/c/138937/ , someone (Don, Malini) think if image requires some feature/resource that is not specified in flavor, it should be ok, while I think it should be forbidden. I discussed with Jay Pipe on IRC before and he thought if flavor has no requirement, image requirement should be failed, and I created a bug at https://bugs.launchpad.net/nova/+bug/1403276 at that time. But according to the discussion on this BP, seems this is not always accepted by others. I hope to get feedback from the mailing list on the relationship of requirement from image/flavor. Possibly we should take different policy for different resource requirement, but some general rule and the reason for those rules will be helpful. BTW, This topic was sent to the operator ML yesterday by Malini at This http://lists.openstack.org/pipermail/openstack-operators/2015- January/005882.html and I raise it here to cover both lists. Thanks --jyh __ OpenStack Development Mailing List (not for usage questions) Unsubscribe: OpenStack-dev- requ...@lists.openstack.org?subject:unsubscribe http://lists.openstack.org/cgi-bin/mailman/listinfo/openstack-dev __ OpenStack Development Mailing List (not for usage questions) Unsubscribe: OpenStack-dev- requ...@lists.openstack.org?subject:unsubscribe http://lists.openstack.org/cgi-bin/mailman/listinfo/openstack-dev __ OpenStack Development Mailing List (not for usage questions) Unsubscribe: openstack-dev-requ...@lists.openstack.org?subject:unsubscribe http://lists.openstack.org/cgi-bin/mailman/listinfo/openstack-dev
Re: [openstack-dev] [Fuel] Getting rid of kickstart/preseed for all NEW releases
Gentlemen, I have one small question about IBP, and I'm not sure if this is the right place to ask, but still: how do you plan to build the images for the image-based provisioning? Will you leverage diskimage-builder https://github.com/openstack/diskimage-builder or some other tool? Thanks, -- Best regards, Oleg Gelbukh Mirantis Labs On Tue, Jan 27, 2015 at 10:55 PM, Andrew Woodward xar...@gmail.com wrote: I don't see this as crazy, it's not a feature of the cloud, its a mechanism to get us there. It's not even something that most of the time anyone sees. Continuing to waste time supporting something we are ready to replace, and have been testing for a release already is crazy. It adds to the technical debt around provisioning that is broken a chlot of the time. We spend around 11% of all commits of fuel-library to cobbler, templates, pmanager etc It's also not removing it, it will continue to be present to support prior releases, so it's even still available if we cant make IBP work the way we need to. On Tue, Jan 27, 2015 at 2:23 AM, Vladimir Kozhukalov vkozhuka...@mirantis.com wrote: Guys, First, we are not talking about deliberate disabling preseed based approach just because we so crazy. The question is What is the best way to achieve our 6.1 goals? We definitely need to be able to install two versions of Ubuntu 12.04 and 14.04. Those versions have different sets of packages (for example ntp related ones) and we install some of those packages during provisioning (we point out which packages we need with their versions). To make this working with preseed based approach we need either to insert some IF release==6.1 conditional lines into preseed (not very beautiful, isn't it?) or to create different Distros and Profiles for different releases. Second is not a problem for Cobbler but it is for nailgun/astute because we do not deal with that stuff and it looks that we cannot implement this easily. IMO, the only options we have are to insert IFs into preseed (I would say it is not more reliable than IBP) or to refuse preseed approach for ONLY NEW UPCOMING releases. You can call crazy but for me having a set IFs together with pmanager.py which are absolutely difficult to maintain is crazy. Vladimir Kozhukalov On Tue, Jan 27, 2015 at 3:03 AM, Andrew Woodward xar...@gmail.com wrote: On Mon, Jan 26, 2015 at 10:47 AM, Sergii Golovatiuk sgolovat...@mirantis.com wrote: Until we are sure IBP solves operation phase where we need to deliver updated packages so client will be able to provision new machines with these fixed packages, I would leave backward compatibility with normal provision. ... Just in case. doesn't running 'apt-get upgrade' or 'yum update' after laying out the FS image resolve the gap until we can rebuild the images on the fly? -- Best regards, Sergii Golovatiuk, Skype #golserge IRC #holser On Mon, Jan 26, 2015 at 4:56 PM, Vladimir Kozhukalov vkozhuka...@mirantis.com wrote: My suggestion is to make IBP the only option available for all upcoming OpenStack releases which are defined in openstack.yaml. It is to be possible to install OS using kickstart for all currently available OpenStack releases. Vladimir Kozhukalov On Mon, Jan 26, 2015 at 6:22 PM, Igor Kalnitsky ikalnit...@mirantis.com wrote: Just want to be sure I understand you correctly: do you propose to FORBID kickstart/preseed installation way in upcoming release at all? On Mon, Jan 26, 2015 at 3:59 PM, Vladimir Kozhukalov vkozhuka...@mirantis.com wrote: Subject is changed. Vladimir Kozhukalov On Mon, Jan 26, 2015 at 4:55 PM, Vladimir Kozhukalov vkozhuka...@mirantis.com wrote: Dear Fuelers, As you might know we need it to be possible to install several versions of a particular OS (Ubuntu and Centos) by 6.1 As far as having different OS versions also means having different sets of packages and some of the packages are installed and configured during provisioning stage, we need to have a kind of kickstart/preseed version mechanism. Cobbler is exactly such a mechanism. It allows us to have several Distros (installer images) and profiles (kickstart/preseed files). But unfortunately, for some reasons we have not been using those Cobbler's capabilities since the beginning of Fuel and it doesn't seem to be easily introduced into Nailgun to deal with the whole Cobbler life cycle. Anyway, we are moving towards IBP (image based provisioning) and we already have different images connected to different OpenStack releases (openstack.yaml) and everything else which is necessary for initial node configuration is serialized inside provision data (including profile name like 'ubuntu_1204' or
Re: [openstack-dev] [devstack] Installation problem
Hi Rajdeep, This may be because of some configuration mismatch. I had same ImportError while uploading my Cinder Driver during devstack installation, so to deal with that I have rechecked my logs again and found that the mistake was in my cinder.conf file, so I think that might be the same case with you. Hope this might help. On Mon, Jan 26, 2015 at 7:52 PM, Rajdeep Dua rajdeep@gmail.com wrote: Tried updating an existing installation.. Did a clean.sh and tried again with stack.sh Now getting the following error.. ImportError: Could not import settings 'openstack_dashboard.settings' (Is it on sys.path? Is there an import error in the settings file?): cannot import name types On Mon, Jan 26, 2015 at 7:33 PM, Abhishek Shrivastava abhis...@cloudbyte.com wrote: Hi Rajdeep, Can you please send the details of how are you trying to install the latest devstack and complete log so that it will be easy to now where are you failing. On Mon, Jan 26, 2015 at 4:56 PM, Rajdeep Dua rajdeep@gmail.com wrote: Getting following exception on latest devstack installation. Please let me know how to resolve this. Thanks Rajdeep + /usr/local/bin/glance-manage db_sync Traceback (most recent call last): File /usr/local/bin/glance-manage, line 9, in module load_entry_point('glance==2015.1.dev24', 'console_scripts', 'glance-manage')() File /usr/local/lib/python2.7/dist-packages/pkg_resources/__init__.py, line 519, in load_entry_point return get_distribution(dist).load_entry_point(group, name) File /usr/local/lib/python2.7/dist-packages/pkg_resources/__init__.py, line 2630, in load_entry_point return ep.load() File /usr/local/lib/python2.7/dist-packages/pkg_resources/__init__.py, line 2310, in load return self.resolve() File /usr/local/lib/python2.7/dist-packages/pkg_resources/__init__.py, line 2316, in resolve module = __import__(self.module_name, fromlist=['__name__'], level=0) File /opt/stack/glance/glance/cmd/manage.py, line 45, in module from glance.common import config File /opt/stack/glance/glance/common/config.py, line 29, in module from oslo_concurrency import lockutils File /usr/local/lib/python2.7/dist-packages/oslo_concurrency/lockutils.py, line 30, in module from oslo.config import cfgfilter ImportError: cannot import name cfgfilter __ OpenStack Development Mailing List (not for usage questions) Unsubscribe: openstack-dev-requ...@lists.openstack.org?subject:unsubscribe http://lists.openstack.org/cgi-bin/mailman/listinfo/openstack-dev -- *Thanks Regards,* *Abhishek* *Cloudbyte Inc. http://www.cloudbyte.com* __ OpenStack Development Mailing List (not for usage questions) Unsubscribe: openstack-dev-requ...@lists.openstack.org?subject:unsubscribe http://lists.openstack.org/cgi-bin/mailman/listinfo/openstack-dev __ OpenStack Development Mailing List (not for usage questions) Unsubscribe: openstack-dev-requ...@lists.openstack.org?subject:unsubscribe http://lists.openstack.org/cgi-bin/mailman/listinfo/openstack-dev -- *Thanks Regards,* *Abhishek* *Cloudbyte Inc. http://www.cloudbyte.com* __ OpenStack Development Mailing List (not for usage questions) Unsubscribe: openstack-dev-requ...@lists.openstack.org?subject:unsubscribe http://lists.openstack.org/cgi-bin/mailman/listinfo/openstack-dev
Re: [openstack-dev] [nova] Nominating Melanie Witt for python-novaclient-core
+1 From: Michael Still [mi...@stillhq.com] Sent: Tuesday, January 27, 2015 5:41 PM To: OpenStack Development Mailing List Subject: [openstack-dev] [nova] Nominating Melanie Witt for python-novaclient-core Greetings, I would like to nominate Melanie Witt for the python-novaclient-core team. (What is python-novaclient-core? Its a new group which will contain all of nova-core as well as anyone else we think should have core reviewer powers on just the python-novaclient code). Melanie has been involved with nova for a long time now. She does solid reviews in python-novaclient, and at least two current nova-cores have suggested her as ready for core review powers on that repository. Please respond with +1s or any concerns. References: https://review.openstack.org/#/q/project:openstack/python-novaclient+reviewer:%22melanie+witt+%253Cmelwitt%2540yahoo-inc.com%253E%22,n,z As a reminder, we use the voting process outlined at https://wiki.openstack.org/wiki/Nova/CoreTeam to add members to our core team. Thanks, Michael -- Rackspace Australia __ OpenStack Development Mailing List (not for usage questions) Unsubscribe: openstack-dev-requ...@lists.openstack.org?subject:unsubscribe http://lists.openstack.org/cgi-bin/mailman/listinfo/openstack-dev __ OpenStack Development Mailing List (not for usage questions) Unsubscribe: openstack-dev-requ...@lists.openstack.org?subject:unsubscribe http://lists.openstack.org/cgi-bin/mailman/listinfo/openstack-dev
[openstack-dev] [oslo] temporarily disabling python 3.x testing for oslo.messaging and oslo.rootwrap
The infra team has been working hard to update our Python 3 testing for all projects to run on 3.4 instead of 3.3. Two of the last projects to be able to shift are oslo.messaging and oslo.rootwrap. The test suites for both projects trigger a segfault bug in the 3.4 interpreter as it is shipped on Ubuntu Trusty. The fix for the segfault is already available upstream, and the team at Canonical is working on packaging a new release, but our schedules are out of sync. Maintaining a separate image and pool of testing nodes for 3.3 testing of just these two projects is going to be a bit of a burden, and so the infra team has asked if we’re willing to turn off the 3.3 jobs for the two projects, leaving us without 3.x testing in the gate until the 3.4 interpreter on Trusty is updated. The latest word from Canonical is that they plan to package Python 3.4.3, due to be released in about a month. It will take some additional time to put it through their release process, and so there’s some uncertainty about how long we would be without 3.x gate jobs, but it doesn’t look like it will be indefinitely. To mitigate that risk, fungi has suggested starting to work on Debian Jessie worker images, which would include a version of Python 3.4 that doesn’t have the segfault issue. His goal is to have something working by around the end of March. That gives Canonical up to a month to release the 3.4.3 package before we would definitely move those tests to Debian. Whether we move any of the other projects, or would move anyway if fungi gets Debian working more quickly than he expects, would remain to be seen. Although we do have some risk of introducing Python 3 regressions into the two libraries, I am inclined to go along with the infra team’s request and disable the tests for a short period of time. The rootwrap library doesn’t see a lot of changes, and we can rely on the messaging lib devs to run tests locally for a little while. Before I give the go-ahead, I want to hear concerns from the rest of the team. Let’s try to have an answer by the 29th (Thursday). Doug __ OpenStack Development Mailing List (not for usage questions) Unsubscribe: openstack-dev-requ...@lists.openstack.org?subject:unsubscribe http://lists.openstack.org/cgi-bin/mailman/listinfo/openstack-dev
Re: [openstack-dev] [oslo][heat] potentially breaking release of oslo.messaging Tuesday 27th
On Mon, Jan 26, 2015, at 06:57 PM, Angus Salkeld wrote: On Tue, Jan 27, 2015 at 8:05 AM, Doug Hellmann d...@doughellmann.com wrote: We’ve held up the oslo.messaging release with the namespace package work for a while now while we work with the nova, designate, and heat teams to fix things up so their tests won’t break. We think the one remaining issue is in heat, where some tests are mocking private parts of oslo.messaging. There’s a bug filed at https://bugs.launchpad.net/heat/+bug/1412836 I think asalkeld fixed similar tests in https://review.openstack.org/#/c/145094/1/heat/tests/test_stack_lock.py but missed these at the time. I would propose a fix, but I really don’t understand the test suite or what’s going on there. If someone else does propose a fix, please ping me in #openstack-oslo on IRC and I’ll test the pre-release against it to see if the issue is resolved. This should sort it out: https://review.openstack.org/150185 -Angus Thanks! Doug I plan to release the new version of oslo.messaging around 15:00 UTC on 27 Jan, but I will wait if there’s a fix in heat’s merge queue. Doug __ OpenStack Development Mailing List (not for usage questions) Unsubscribe: openstack-dev-requ...@lists.openstack.org?subject:unsubscribe http://lists.openstack.org/cgi-bin/mailman/listinfo/openstack-dev __ OpenStack Development Mailing List (not for usage questions) Unsubscribe: openstack-dev-requ...@lists.openstack.org?subject:unsubscribe http://lists.openstack.org/cgi-bin/mailman/listinfo/openstack-dev __ OpenStack Development Mailing List (not for usage questions) Unsubscribe: openstack-dev-requ...@lists.openstack.org?subject:unsubscribe http://lists.openstack.org/cgi-bin/mailman/listinfo/openstack-dev
Re: [openstack-dev] [oslo.messaging] Performance testing. Initial steps.
On Thu, Jan 15, 2015 at 8:56 PM, Doug Hellmann d...@doughellmann.com wrote: On Jan 15, 2015, at 1:30 PM, Denis Makogon dmako...@mirantis.com wrote: Good day to All, The question that i’d like to raise here is not simple one, so i’d like to involve as much readers as i can. I’d like to speak about oslo.messaging performance testing. As community we’ve put lots of efforts in making oslo.messaging widely used drivers stable as much as possible. Stability is a good thing, but is it enough for saying “works well”? I’d say that it’s not. Since oslo.messaging uses driver-based messaging workflow, it makes sense to dig into each driver and collect all required/possible performance metrics. First of all, it does make sense to figure out how to perform performance testing, first that came into my mind is to simulate high load on one of corresponding drivers. Here comes the question of how it can be accomplished withing available oslo.messaging tools - high load on any driver can perform an application that: • can populate multiple emitters(rpc clients) and consumers (rpc servers). • can force clients to send messages of pre-defined number of messages of any length. That makes sense. Another thing is why do we need such thing. Profiling, performance testing can improve the way in which our drivers were implemented. It can show us actual “bottlenecks” in messaging process, in general. In some cases it does make sense to figure out where problem takes its place - whether AMQP causes messaging problems or certain driver that speaks to AMQP fails. Next thing that i want to discuss the architecture of profiling/performance testing. As i can see it seemed to be a “good” way to add profiling code to each driver. If there’s any objection or better solution, please bring them to the light. What sort of extra profiling code do you anticipate needing? As i can foresee (taking into account [1]) couple decorators, possibly one that handles metering process. The biggest part of code will take highload tool that'll be a part of messaging. But another question adding certain dependecies to the project. Once we’d have final design for profiling we would need to figure out tools for profiling. After searching over the web, i found pretty interesting topic related to python profiling [1]. After certain investigations it does makes sense discuss next profiling options(apply one or both): • Line-by-line timing and execution frequency with a profiler (there are possible Pros and Cons, but i would say the per-line statistics is more than appreciable at initial performance testing steps) • Memory/CPU consumption Metrics. The most useful metric for us is time, any time-based metric, since it is very useful to know at which step or/and by whom delay/timeout caused, for example, so as it said, we would be able to figure out whether AMQP or driver fails to do what it was designed for. Before proposing spec i’d like to figure out any other requirements, use cases and restrictions for messaging performance testing. Also, if there any stories of success in boosting python performance - feel free to share it. The metrics to measure depend on the goal. Do we think the messaging code is using too much memory? Is it too slow? Or is there something else causing concern? It does make sense to have profiling for cases when trying to upscale cluster and it'll be a good thing to have an ability to figure out if scaled AMQP service has it's best configuration (i guess here would come the question about doing performance testing using well-known tools), and the most interesting question is about how messaging driver decreases (or leaves untouched) throughput between RPC client and server. This metering results can be compared to those tools that were designed for performance testing. And that's why it'll be good step forward having profiling/performance testing using high load technic. [1] http://www.huyng.com/posts/python-performance-analysis/ Kind regards, Denis Makogon IRC: denis_makogon dmako...@mirantis.com __ OpenStack Development Mailing List (not for usage questions) Unsubscribe: openstack-dev-requ...@lists.openstack.org?subject:unsubscribe http://lists.openstack.org/cgi-bin/mailman/listinfo/openstack-dev __ OpenStack Development Mailing List (not for usage questions) Unsubscribe: openstack-dev-requ...@lists.openstack.org?subject:unsubscribe http://lists.openstack.org/cgi-bin/mailman/listinfo/openstack-dev Kind regards, Denis M. __ OpenStack Development Mailing List (not for usage questions) Unsubscribe: openstack-dev-requ...@lists.openstack.org?subject:unsubscribe
Re: [openstack-dev] [Fuel][Neutron ML2][VMWare]NetworkNotFoundForBridge: Network could not be found for bridge br-int
Hi Xarses, Actually it is multi-hypervisor environment. The error in the nova.log is: NetworkNotFoundForBridge: Network could not be found for bridge br-int the above error disappears changing the mech driver order in /etc/neutron/plugins/ml2/ml2_conf.ini file from mechanism_drivers = openvswitch,dvs to mechanism_drivers =dvs, openvswitch On Mon, Jan 19, 2015 at 12:31 PM, Foss Geek thefossg...@gmail.com wrote: Hi Xarses, Thanks for your time! I was not able to check my mail yesterday. Sorry for the delay. One of my colleague fixed this issue yesterday. I will understand the issue and update this thread. -- Thanks Regards E-Mail: thefossg...@gmail.com IRC: neophy Blog : http://lmohanphy.livejournal.com/ On Sat, Jan 17, 2015 at 1:17 AM, Andrew Woodward xar...@gmail.com wrote: neophy, It seems like there are left overs that fuel was using in the config that would not be present when you installed neutron fresh. I'd compare the config files and start backing out bits you dont need. I'd start with the lines refrencing br-int, you dont need them on nodes that aren't using the ovs agent. Poke me on IRC if you need more help Xarses (GMT-8) On Fri, Jan 9, 2015 at 1:08 PM, Foss Geek thefossg...@gmail.com wrote: Dear All, I am trying to integrate Openstack + vCenter + Neutron + VMware dvSwitch ML2 Mechanism driver. I deployed a two node openstack environment (controller + compute with KVM) with Neutron VLAN + KVM using fuel 5.1. Again I installed nova-compute using yum in controller node and configured nova-compute in controller to point vCenter. I am also using Neutron VLAN with VMware dvSwitch ML2 Mechanism driver. My vCenter is properly configured as suggested by the doc: https://www.mirantis.com/blog/managing-vmware-vcenter-resources-mirantis-openstack-5-0-part-1-create-vsphere-cluster/ I am able to create network from Horizon and I can see the same network created in vCenter. When I try to create a VM I am getting the below error in Horizon. Error: Failed to launch instance test-01: Please try again later [Error: No valid host was found. ]. Here is the error message from Instance Overview tab: Instance Overview Info Name test-01 ID 309a1f47-83b6-4ab4-9d71-642a2000c8a1 Status Error Availability Zone nova Created Jan. 9, 2015, 8:16 p.m. Uptime 0 minutes Fault Message No valid host was found. Code 500 Details File /usr/lib/python2.6/site-packages/nova/scheduler/filter_scheduler.py, line 108, in schedule_run_instance raise exception.NoValidHost(reason=) Created Jan. 9, 2015, 8:16 p.m Getting the below error in nova-all.log: 183Jan 9 20:16:23 node-18 nova-api 2015-01-09 20:16:23.135 31870 DEBUG keystoneclient.middleware.auth_token [req-c9ec0973-ff63-4ac3-a0f7-1d2d7b7aa470 ] Authenticating user token __call__ /usr/lib/python2.6/site-packages/keystoneclient/middleware/auth_token.py:676 183Jan 9 20:16:23 node-18 nova-api 2015-01-09 20:16:23.136 31870 DEBUG keystoneclient.middleware.auth_token [req-c9ec0973-ff63-4ac3-a0f7-1d2d7b7aa470 ] Removing headers from request environment: X-Identity-Status,X-Domain-Id,X-Domain-Name,X-Project-Id,X-Project-Name,X-Project-Domain-Id,X-Project-Domain-Name,X-User-Id,X-User-Name,X-User-Domain-Id,X-User-Domain-Name,X-Roles,X-Service-Catalog,X-User,X-Tenant-Id,X-Tenant-Name,X-Tenant,X-Role _remove_auth_headers /usr/lib/python2.6/site-packages/keystoneclient/middleware/auth_token.py:733 183Jan 9 20:16:23 node-18 nova-api 2015-01-09 20:16:23.137 31870 DEBUG keystoneclient.middleware.auth_token [req-c9ec0973-ff63-4ac3-a0f7-1d2d7b7aa470 ] Returning cached token _cache_get /usr/lib/python2.6/site-packages/keystoneclient/middleware/auth_token.py:1545 183Jan 9 20:16:23 node-18 nova-api 2015-01-09 20:16:23.138 31870 DEBUG keystoneclient.middleware.auth_token [req-c9ec0973-ff63-4ac3-a0f7-1d2d7b7aa470 ] Storing token in cache store /usr/lib/python2.6/site-packages/keystoneclient/middleware/auth_token.py:1460 183Jan 9 20:16:23 node-18 nova-api 2015-01-09 20:16:23.139 31870 DEBUG keystoneclient.middleware.auth_token [req-c9ec0973-ff63-4ac3-a0f7-1d2d7b7aa470 ] Received request from user: 4564fea80fa14e1daed160afa074d389 with project_id : dd32714d9009495bb51276e284380d6a and roles: admin,_member_ _build_user_headers /usr/lib/python2.6/site-packages/keystoneclient/middleware/auth_token.py:996 183Jan 9 20:16:23 node-18 nova-api 2015-01-09 20:16:23.141 31870 DEBUG routes.middleware [req-05089e83-e4c1-4d90-b7c5-065226e55d91 ] Matched GET /dd32714d9009495bb51276e284380d6a/servers/309a1f47-83b6-4ab4-9d71-642a2000c8a1 __call__ /usr/lib/python2.6/site-packages/routes/middleware.py:100 183Jan 9 20:16:23 node-18 nova-api 2015-01-09 20:16:23.142 31870 DEBUG routes.middleware [req-05089e83-e4c1-4d90-b7c5-065226e55d91 ] Route path: '/{project_id}/servers/:(id)', defaults:
Re: [openstack-dev] [Openstack][dev][Zuul] Merge Failed Error in CI - GitPython Error
Hi the merge fail error that we reported in ubuntu 12.04 has been solved in the new ubuntu 14.04 CI master setup. many thanks to ramy on the update of the repo :) https://github.com/rasselin/os-ext-testing cheers! On Fri, Jan 16, 2015 at 4:58 PM, Punith S punit...@cloudbyte.com wrote: Hi stackers, i'm running CI for openstack cinder patches, when zuul reads a new patch from gerrit, it tries to merge the patch to it's own cinder repo @/var/lib/zuul/git/openstack/cinder and returns the comment to gerrit saying hence it is failing to issue the tempest-job in jenkins via gearman !!! on checking the trace the error seems to come from GitPython 0.3.2.1 the zuul/merger-debug log snapshot ref - http://paste.openstack.org/show/158218/ *raise ValueError(Failed to parse line: %r % line) * *ValueError: Failed to parse line: 'Total 9 (delta 7), reused 9 (delta 7)'* ' is this a problem of python git ? i'm using ubuntu 12.04 and git 1.7 thanks regards, punith s cloudbyte.com -- regards, punith s cloudbyte.com -- regards, punith s cloudbyte.com __ OpenStack Development Mailing List (not for usage questions) Unsubscribe: openstack-dev-requ...@lists.openstack.org?subject:unsubscribe http://lists.openstack.org/cgi-bin/mailman/listinfo/openstack-dev
Re: [openstack-dev] [Openstack][infra] Zuul-Merger Error in CI
Hi the merge fail error that we reported in ubuntu 12.04 has been solved in the new ubuntu 14.04 CI master setup. many thanks to ramy on the update of the repo :) https://github.com/rasselin/os-ext-testing cheers! On Thu, Jan 8, 2015 at 7:16 PM, Punith S punit...@cloudbyte.com wrote: hi, i'm running CI for openstack cinder patches, when zuul reads a new patch from gerrit, it tries to merge the patch to it's own cinder repo @/var/lib/zuul/git/openstack/cinder and returns the comment to gerrit saying hence it is failing to issue the dsvm-tempest-job in jenkins via gearman !!! the zuul/merger-debug log sanpshot 2015-01-08 19:03:43,320 DEBUG zuul.MergeServer: Got merge job. 2015-01-08 19:03:43,321 DEBUG zuul.Merger: Merging for change 145778,1. 2015-01-08 19:03:43,321 DEBUG zuul.Merger: Processing refspec refs/changes/78/145778/1 for project openstack/cinder / master ref Zbd4a4ad6ff3741c68ce382afa6d8df84 2015-01-08 19:03:43,383 DEBUG zuul.Merger: Unable to find commit for ref master/Zbd4a4ad6ff3741c68ce382afa6d8df84 2015-01-08 19:03:43,384 DEBUG zuul.Merger: No base commit found for (u'openstack/cinder', u'master') 2015-01-08 19:03:43,384 DEBUG zuul.Repo: Resetting repository /var/lib/zuul/git/openstack/cinder 2015-01-08 19:03:43,385 DEBUG zuul.Repo: Updating repository /var/lib/zuul/git/openstack/cinder 2015-01-08 19:03:54,507 DEBUG zuul.Repo: Checking out 5993660498f44e96b0f35ccc0f4d4a4c7b430363 2015-01-08 19:04:02,685 ERROR zuul.Merger: Exception while merging a change: Traceback (most recent call last): File /usr/local/lib/python2.7/dist-packages/zuul/merger/merger.py, line 234, in _mergeChange commit = repo.merge(item['refspec'], 'resolve') File /usr/local/lib/python2.7/dist-packages/zuul/merger/merger.py, line 132, in merge self.fetch(ref) File /usr/local/lib/python2.7/dist-packages/zuul/merger/merger.py, line 145, in fetch origin.fetch(ref) File /usr/local/lib/python2.7/dist-packages/git/remote.py, line 598, in fetch return self._get_fetch_info_from_stderr(proc, progress or RemoteProgress()) File /usr/local/lib/python2.7/dist-packages/git/remote.py, line 540, in _get_fetch_info_from_stderr for err_line, fetch_line in zip(fetch_info_lines, fetch_head_info)) File /usr/local/lib/python2.7/dist-packages/git/remote.py, line 540, in genexpr for err_line, fetch_line in zip(fetch_info_lines, fetch_head_info)) File /usr/local/lib/python2.7/dist-packages/git/remote.py, line 252, in _from_line raise ValueError(Failed to parse line: %r % line) ValueError: Failed to parse line: 'Total 7 (delta 5), reused 7 (delta 5)' is this a problem of python git ? i'm using ubuntu 12.04 and git 1.7 thanks in advance -- regards, punith s cloudbyte.com -- regards, punith s cloudbyte.com __ OpenStack Development Mailing List (not for usage questions) Unsubscribe: openstack-dev-requ...@lists.openstack.org?subject:unsubscribe http://lists.openstack.org/cgi-bin/mailman/listinfo/openstack-dev
Re: [openstack-dev] [Fuel] removing single mode
Hi, After starting implementing granular deployment we've faced a bunch of issues that would make further development of this feature much more complicated if we have to support both Simple and HA deployment modes. For example: simple mode does not require cluster (corosync, pacemaker, vips, etc), so we had to skip this task for Simple mode somehow - we can use conditional tasks, or conditional manifests in our tasks, or create separate task graphs for different deployment modes, etc - either way it's pretty much doubling the amount of work for some parts of Fuel and our development cycle. At the moment, CI blocks us from further development of fuel-library modularization BP [2] because we still use Simple mode in CI. So in order to proceed with this BP we have two options: 1) remove Simple mode from CI/QA and thus drop it completely from Fuel 2) double our efforts to support both Simple and HA modes in granular deployment We have a BP about single-controller HA [1]. HA with single controller works just fine at the moment. So if you want to test Fuel on a minimum set of nodes, you can do this on 3 nodes (Fuel master, controller, compute), just like with Simple mode before. I suppose, it's time to finally drop support for Simple mode in Fuel :) [1] https://blueprints.launchpad.net/fuel/+spec/single-controller-ha [2] https://blueprints.launchpad.net/fuel/+spec/fuel-library-modularization -- Regards, Aleksandr Didenko On Tue, Aug 26, 2014 at 9:25 AM, Mike Scherbakov mscherba...@mirantis.com wrote: Definitely fuel spec is needed :) On Mon, Aug 25, 2014 at 8:45 PM, Evgeniy L e...@mirantis.com wrote: Hi Andrew, I have some comments regarding to you action items 2) Removing simple mode from the ui and tests 3) Removing simple mode support from nailgun (maybe we leave it) and cli We shouldn't do it, because nailgun should handle both versions of cluster. What we have to do here is to use openstack.yaml to keep all possible modes. For new release there will be only ha, to manage previous releases we have to create data migrations in nailgun to create the filed with modes i.e. multinode and ha. Also fixes for ui are required too, I think it mostly related to wizard, 'mode' tab where use can chose ha or non ha cluster in case of new release there should be only ha, and in case of old releases there should be ha and multinode. Thanks, On Mon, Aug 25, 2014 at 8:19 PM, Andrew Woodward xar...@gmail.com wrote: Started a new thread so that we don't hijack the older thread. as Andrew, will you work on it in 6.0? What are remaining items there? Also, it might affect our tests - simple mode runs faster so we use it for smoke ISO test. Anastasia, please confirm that we can switch smoke to one-ha-controller model, or even drop smoke at all and use BVT only (running CentOS 3 HA controllers and same with Ubuntu). The primary reason that we haven't disabled single yet is was due to [0] where we where having problems adding additional controllers. With the changes to galera and rabbit clustering it appears that we ended up fixing it already. The remaining issues are: 1) Ensuring we have good test coverage for the cases we expect to support [1] 2) Removing simple mode from the ui and tests 3) Removing simple mode support from nailgun (maybe we leave it) and cli 4) Updating documentation [0] https://bugs.launchpad.net/fuel/+bug/1350266 [1] https://bugs.launchpad.net/fuel/+bug/1350266/comments/7 -- Andrew Mirantis Ceph community ___ OpenStack-dev mailing list OpenStack-dev@lists.openstack.org http://lists.openstack.org/cgi-bin/mailman/listinfo/openstack-dev ___ OpenStack-dev mailing list OpenStack-dev@lists.openstack.org http://lists.openstack.org/cgi-bin/mailman/listinfo/openstack-dev -- Mike Scherbakov #mihgen ___ OpenStack-dev mailing list OpenStack-dev@lists.openstack.org http://lists.openstack.org/cgi-bin/mailman/listinfo/openstack-dev __ OpenStack Development Mailing List (not for usage questions) Unsubscribe: openstack-dev-requ...@lists.openstack.org?subject:unsubscribe http://lists.openstack.org/cgi-bin/mailman/listinfo/openstack-dev
Re: [openstack-dev] [Openstack][dev][Zuul] Merge Failed Error in CI - GitPython Error
Punith, I think it’s because when you installed fresh again on 14.04, the zuul GitPython dependency was updated to the latest. I proposed this zuul patch to fix it: https://review.openstack.org/#/c/149336/ Ramy From: Punith S [mailto:punit...@cloudbyte.com] Sent: Tuesday, January 27, 2015 4:33 AM To: OpenStack Development Mailing List (not for usage questions) Cc: Openstack Team Subject: Re: [openstack-dev] [Openstack][dev][Zuul] Merge Failed Error in CI - GitPython Error Hi the merge fail error that we reported in ubuntu 12.04 has been solved in the new ubuntu 14.04 CI master setup. many thanks to ramy on the update of the repo :) https://github.com/rasselin/os-ext-testing cheers! On Fri, Jan 16, 2015 at 4:58 PM, Punith S punit...@cloudbyte.commailto:punit...@cloudbyte.com wrote: Hi stackers, i'm running CI for openstack cinder patches, when zuul reads a new patch from gerrit, it tries to merge the patch to it's own cinder repo @/var/lib/zuul/git/openstack/cinder and returns the comment to gerrit saying [cid:image001.jpg@01D03A03.67046AC0] hence it is failing to issue the tempest-job in jenkins via gearman !!! on checking the trace the error seems to come from GitPython 0.3.2.1 the zuul/merger-debug log snapshot ref - http://paste.openstack.org/show/158218/ raise ValueError(Failed to parse line: %r % line) ValueError: Failed to parse line: 'Total 9 (delta 7), reused 9 (delta 7)'' is this a problem of python git ? i'm using ubuntu 12.04 and git 1.7 thanks regards, punith s cloudbyte.comhttp://cloudbyte.com -- regards, punith s cloudbyte.comhttp://cloudbyte.com -- regards, punith s cloudbyte.comhttp://cloudbyte.com __ OpenStack Development Mailing List (not for usage questions) Unsubscribe: openstack-dev-requ...@lists.openstack.org?subject:unsubscribe http://lists.openstack.org/cgi-bin/mailman/listinfo/openstack-dev
Re: [openstack-dev] [Nova] Requirements.txt and optional requirements
On 01/27/2015 07:14 AM, Matt Riedemann wrote: On 1/27/2015 2:18 AM, Silvan Kaiser wrote: Hello! Do dependencies required only in some contexts belong into requirements.txt? Yesterday we had a short discussion on #openstack-nova regarding how to handle optional requirements. This was triggered by our quobyte nova driver (https://review.openstack.org/#/c/110722/18), who requires xattr, which we therefore added to requirements.txt (as it is provided by the requirements project). Points from the discussion: - If we add this we will be adding every requirement for every component --- this becomes to big. - Remove this requirement, no optional entries in requirements.txt, a 'deployer' has to know what dependencies the components he wants to use have --- Usually he does not know and installation becomes more issue prone - Other (in between) ideas??? Please note that this has some urgency, the change set referenced above has been in review for months and i'm trying to react asap on comments but the deadline is approaching (next week) and if i have to do bigger changes I'd like to know as fast as possible... Best regards SIlvan Kaiser -- *Quobyte* GmbH Boyenstr. 41 - 10115 Berlin-Mitte - Germany +49-30-814 591 800 - www.quobyte.com http://www.quobyte.com/ Amtsgericht Berlin-Charlottenburg, HRB 149012B management board: Dr. Felix Hupfeld, Dr. Björn Kolbeck, Dr. Jan Stender __ OpenStack Development Mailing List (not for usage questions) Unsubscribe: openstack-dev-requ...@lists.openstack.org?subject:unsubscribe http://lists.openstack.org/cgi-bin/mailman/listinfo/openstack-dev In my opinion the volume driver is optional and therefore the dependency is optional, it's all based on what the configuration is, the same as which DB or RPC backend you use, which is why those dependencies are in test-requirements.txt. While it's more obvious to a deployer that if you're going to configure Nova to use MySQL you need some MySQL packages to make it work, any deployer that's adding support for this volume driver should also probably be testing their deployment scripts, e.g. chef cookbooks/recipes, and if they haven't written their script correctly they'll find out that it blows up with an ImportError because of a missing xattr. Otherwise, [1]. Couple things... a) I agree with Sean and Matt here that this is an optional dependency and belongs in the deployment documentation and configuration management manifests. b) The Glance API image cache can use xattr if SQLite is not desired [1], and Glance does *not* list xattr as a dependency in requirements.txt. Swift also has a dependency on python-xattr [2]. So, this particular Python library is not an unknown by any means. c) Remember that even if you install python-xattr, that still doesn't mean it will automatically work. You still need to enable a filesystem that supports atime (i.e. noatime must not be set in fstab for the filesystem) [3]. Just an FYI. Best, -jay [1] https://github.com/openstack/glance/blob/master/glance/image_cache/drivers/xattr.py [2] https://github.com/openstack/swift/blob/master/requirements.txt#L11 [3] https://github.com/openstack/glance/blob/master/glance/image_cache/drivers/xattr.py#L23-L24 __ OpenStack Development Mailing List (not for usage questions) Unsubscribe: openstack-dev-requ...@lists.openstack.org?subject:unsubscribe http://lists.openstack.org/cgi-bin/mailman/listinfo/openstack-dev
Re: [openstack-dev] [Nova] Requirements.txt and optional requirements
On 01/27/2015 02:18 AM, Silvan Kaiser wrote: Hello! Do dependencies required only in some contexts belong into requirements.txt? Yesterday we had a short discussion on #openstack-nova regarding how to handle optional requirements. This was triggered by our quobyte nova driver (https://review.openstack.org/#/c/110722/18), who requires xattr, which we therefore added to requirements.txt (as it is provided by the requirements project). Points from the discussion: - If we add this we will be adding every requirement for every component --- this becomes to big. - Remove this requirement, no optional entries in requirements.txt, a 'deployer' has to know what dependencies the components he wants to use have --- Usually he does not know and installation becomes more issue prone - Other (in between) ideas??? Please note that this has some urgency, the change set referenced above has been in review for months and i'm trying to react asap on comments but the deadline is approaching (next week) and if i have to do bigger changes I'd like to know as fast as possible... Best regards SIlvan Kaiser I will just put in another plug for some work I had started around this (and never finished :-( ). https://review.openstack.org/#/c/83150/ (despite the Jenkins results, I'm pretty sure that was working locally for me) Also the discussion at http://lists.openstack.org/pipermail/openstack-dev/2014-February/026976.html There was general consensus on the approach and support has been in pbr for a long time now, but I've never had time to figure out what would be needed to make it play nicely with global requirements. I _think_ that's the only major blocker preventing this from being useful, so if someone wanted to pick it up and run with it that would be awesome. -Ben __ OpenStack Development Mailing List (not for usage questions) Unsubscribe: openstack-dev-requ...@lists.openstack.org?subject:unsubscribe http://lists.openstack.org/cgi-bin/mailman/listinfo/openstack-dev
Re: [openstack-dev] [Openstack][infra] Zuul-Merger Error in CI
FYI, it wasn’t a change to my repo, but to openstack upstream that solved the 12.04 -- 14.04 issue: https://review.openstack.org/#/c/141518/ So this will help anyone using the Openstack-Infra zuul puppet modules! Ramy From: Punith S [mailto:punit...@cloudbyte.com] Sent: Tuesday, January 27, 2015 4:32 AM To: openstack-in...@lists.openstack.org; OpenStack Development Mailing List (not for usage questions) Cc: Asselin, Ramy Subject: Re: [Openstack][infra] Zuul-Merger Error in CI Hi the merge fail error that we reported in ubuntu 12.04 has been solved in the new ubuntu 14.04 CI master setup. many thanks to ramy on the update of the repo :) https://github.com/rasselin/os-ext-testing cheers! On Thu, Jan 8, 2015 at 7:16 PM, Punith S punit...@cloudbyte.commailto:punit...@cloudbyte.com wrote: hi, i'm running CI for openstack cinder patches, when zuul reads a new patch from gerrit, it tries to merge the patch to it's own cinder repo @/var/lib/zuul/git/openstack/cinder and returns the comment to gerrit saying [cid:image001.jpg@01D03A03.B7884B60] hence it is failing to issue the dsvm-tempest-job in jenkins via gearman !!! the zuul/merger-debug log sanpshot 2015-01-08 19:03:43,320 DEBUG zuul.MergeServer: Got merge job. 2015-01-08 19:03:43,321 DEBUG zuul.Merger: Merging for change 145778,1. 2015-01-08 19:03:43,321 DEBUG zuul.Merger: Processing refspec refs/changes/78/145778/1 for project openstack/cinder / master ref Zbd4a4ad6ff3741c68ce382afa6d8df84 2015-01-08 19:03:43,383 DEBUG zuul.Merger: Unable to find commit for ref master/Zbd4a4ad6ff3741c68ce382afa6d8df84 2015-01-08 19:03:43,384 DEBUG zuul.Merger: No base commit found for (u'openstack/cinder', u'master') 2015-01-08 19:03:43,384 DEBUG zuul.Repo: Resetting repository /var/lib/zuul/git/openstack/cinder 2015-01-08 19:03:43,385 DEBUG zuul.Repo: Updating repository /var/lib/zuul/git/openstack/cinder 2015-01-08 19:03:54,507 DEBUG zuul.Repo: Checking out 5993660498f44e96b0f35ccc0f4d4a4c7b430363 2015-01-08 19:04:02,685 ERROR zuul.Merger: Exception while merging a change: Traceback (most recent call last): File /usr/local/lib/python2.7/dist-packages/zuul/merger/merger.py, line 234, in _mergeChange commit = repo.merge(item['refspec'], 'resolve') File /usr/local/lib/python2.7/dist-packages/zuul/merger/merger.py, line 132, in merge self.fetch(ref) File /usr/local/lib/python2.7/dist-packages/zuul/merger/merger.py, line 145, in fetch origin.fetch(ref) File /usr/local/lib/python2.7/dist-packages/git/remote.py, line 598, in fetch return self._get_fetch_info_from_stderr(proc, progress or RemoteProgress()) File /usr/local/lib/python2.7/dist-packages/git/remote.py, line 540, in _get_fetch_info_from_stderr for err_line, fetch_line in zip(fetch_info_lines, fetch_head_info)) File /usr/local/lib/python2.7/dist-packages/git/remote.py, line 540, in genexpr for err_line, fetch_line in zip(fetch_info_lines, fetch_head_info)) File /usr/local/lib/python2.7/dist-packages/git/remote.py, line 252, in _from_line raise ValueError(Failed to parse line: %r % line) ValueError: Failed to parse line: 'Total 7 (delta 5), reused 7 (delta 5)' is this a problem of python git ? i'm using ubuntu 12.04 and git 1.7 thanks in advance -- regards, punith s cloudbyte.comhttp://cloudbyte.com -- regards, punith s cloudbyte.comhttp://cloudbyte.com __ OpenStack Development Mailing List (not for usage questions) Unsubscribe: openstack-dev-requ...@lists.openstack.org?subject:unsubscribe http://lists.openstack.org/cgi-bin/mailman/listinfo/openstack-dev
Re: [openstack-dev] [Nova] Requirements.txt and optional requirements
On Tue, Jan 27, 2015 at 07:12:29AM -0800, Sean Dague wrote: On 01/27/2015 12:18 AM, Silvan Kaiser wrote: Hello! Do dependencies required only in some contexts belong into requirements.txt? Yesterday we had a short discussion on #openstack-nova regarding how to handle optional requirements. This was triggered by our quobyte nova driver (https://review.openstack.org/#/c/110722/18), who requires xattr, which we therefore added to requirements.txt (as it is provided by the requirements project). Points from the discussion: - If we add this we will be adding every requirement for every component --- this becomes to big. - Remove this requirement, no optional entries in requirements.txt, a 'deployer' has to know what dependencies the components he wants to use have --- Usually he does not know and installation becomes more issue prone - Other (in between) ideas??? Please note that this has some urgency, the change set referenced above has been in review for months and i'm trying to react asap on comments but the deadline is approaching (next week) and if i have to do bigger changes I'd like to know as fast as possible... Typically the answer is no. The libvirt volume driver architecture is kind of weird in the fact that it doesn't actually split it's drivers out into separate files, so there can be a file level boundry (including loading) for these things. Not immediately relevant, but in the L cycle, I'm hoping to finally split the volume.py up into a subdirectory of files. The nova.conf 'volume_drivers' config will be removed by thenm, avoiding the back compat class naming problem we'd have if we split it in Kilo Regards, Daniel -- |: http://berrange.com -o-http://www.flickr.com/photos/dberrange/ :| |: http://libvirt.org -o- http://virt-manager.org :| |: http://autobuild.org -o- http://search.cpan.org/~danberr/ :| |: http://entangle-photo.org -o- http://live.gnome.org/gtk-vnc :| __ OpenStack Development Mailing List (not for usage questions) Unsubscribe: openstack-dev-requ...@lists.openstack.org?subject:unsubscribe http://lists.openstack.org/cgi-bin/mailman/listinfo/openstack-dev