[openstack-dev] [nova] FFE Request: Pass image meta to hard reboot for generating xml

2013-09-09 Thread Wangpan
Hi,

I have a patch need to be reviewed, which fix the bug 
https://bugs.launchpad.net/nova/+bug/1206809
and this is the commit: https://review.openstack.org/#/c/39668/
I think this is a serious bug because we may lose some features supporting 
which enabled by the image properity after hard reboot.
The description of this bug is below:
Currently the libvirt xml of instance will be generated every time
during hard reboot by get_guest_config and to_xml method in libvirt
driver, but the image_meta is not passed into the get_guest_config
method like spawn(), so some configs related to the image_meta will
be lost(compared with the spawn process), we need to get the
image metadata and passes it to the to_xml method during hard reboot.

2013-09-09



Wangpan___
OpenStack-dev mailing list
OpenStack-dev@lists.openstack.org
http://lists.openstack.org/cgi-bin/mailman/listinfo/openstack-dev


Re: [openstack-dev] [Nova] FFE Request: Encrypt Cinder volumes

2013-09-09 Thread Thierry Carrez
Russell Bryant wrote:
 I would be good with the exception for this, assuming that:
 
 1) Those from nova-core that have reviewed the code are still happy with
 it and would do a final review to get it merged.
 
 2) There is general consensus that the simple config based key manager
 (single key) does provide some amount of useful security.  I believe it
 does, just want to make sure we're in agreement on it.  Obviously we
 want to improve this in the future.

+1

I think this is sufficiently self-contained that the regression risk is
extremely limited. It's also nice to have a significant hardening
improvement in the Havana featurelist. I would just prefer if it landed
ASAP since I would like as much usage around it as we can get, to make
sure the previous audits didn't miss an obvious bug/security hole in it.

-- 
Thierry Carrez (ttx)

___
OpenStack-dev mailing list
OpenStack-dev@lists.openstack.org
http://lists.openstack.org/cgi-bin/mailman/listinfo/openstack-dev


Re: [openstack-dev] [Nova] FFE exception for https://review.openstack.org/#/c/45126/

2013-09-09 Thread Thierry Carrez
Robert Collins wrote:
 This small patch is needed for the pxe orchestration integration that
 will (finally!) permit using Neutron DHCP rather than a manual dnsmasq
 for Nova baremetal (and Ironic).
 
 We only found out that this was buggy when integration testing, and
 this patch came in right at the end of the H3 mass of patches :(.
 
 Without it, the DHCP integration is unusual. We could perhaps hardcode
 the value in H, but that would make it spuriously different to what
 would be in I.
 
 So, I'd like a FFE for this patch, if we can.

That looks arguably like a bugfix to me. +1

-- 
Thierry Carrez (ttx)

___
OpenStack-dev mailing list
OpenStack-dev@lists.openstack.org
http://lists.openstack.org/cgi-bin/mailman/listinfo/openstack-dev


[openstack-dev] [Neutron]All unittest passed but Jenkins failed

2013-09-09 Thread ZhiQiang Fan
currently, i don't know if it is coverage problem or something else.

the direct cause is:

sudo /usr/local/jenkins/slave_scripts/jenkins-sudo-grep.sh post

Sep  9 06:57:23 precise1 sudo:  jenkins : 3 incorrect password
attempts ; TTY=unknown ;
PWD=/home/jenkins/workspace/gate-neutron-python27 ; USER=root ;
COMMAND=ovs-vsctl --timeout=2 -- --columns=external_ids,name,ofport
find Interface external_ids:iface-id=71d9fa4c-f074-46bd-96af-8c592d37c160


meanwhile, i found that:

2013-09-09 06:42:25.922 | + git fetch
http://zuul.openstack.org/p/openstack/neutron
refs/zuul/master/Z62b50e610b554304bde4aa2a9ea80193
2013-09-09 06:42:26.747 | From http://zuul.openstack.org/p/openstack/neutron
2013-09-09 06:42:26.747 |  * branch
refs/zuul/master/Z62b50e610b554304bde4aa2a9ea80193 - FETCH_HEAD
2013-09-09 06:42:26.751 | + git checkout FETCH_HEAD
2013-09-09 06:42:26.954 | Warning: you are leaving 17 commits behind,
not connected to
2013-09-09 06:42:26.954 | any of your branches:
2013-09-09 06:42:26.954 |
2013-09-09 06:42:26.954 |   62d0927 Avoid shadowing NeutronException
'message' attribute
2013-09-09 06:42:26.954 |   e26639b Merge Replace assertEquals with
assertEqual
2013-09-09 06:42:26.954 |   5bae582 Load ML2 mech drivers as listed in
ml2_conf.ini
2013-09-09 06:42:26.955 |   902dc88 Replace assertEquals with assertEqual
2013-09-09 06:42:26.955 |  ... and 13 more.
2013-09-09 06:42:26.955 |
2013-09-09 06:42:26.955 | If you want to keep them by creating a new
branch, this may be a good time
2013-09-09 06:42:26.956 | to do so with:
2013-09-09 06:42:26.956 |
2013-09-09 06:42:26.956 |  git branch new_branch_name
62d09275d899237dc34cf50c81e99d50489212ff
2013-09-09 06:42:26.956 |
2013-09-09 06:42:26.962 | HEAD is now at 7cbd0f5... Improve dhcp_agent_scheduler


but in my local env:

$ git log --pretty=format:%h %s

7cbd0f5 Improve dhcp_agent_scheduler
57ce39f Merge Enclose command args in with_venv.sh
9707c73 Merge Imported Translations from Transifex
45beae8 Merge Fix IF checks on spawned green thread instance
f7c55db Imported Translations from Transifex
0f81818 Merge Mock midonetclient in test_midonet_lib
fc0e7cd Fix IF checks on spawned green thread instance
e82f0eb Prevents 400 NVP errors caused by a None display_name
e26639b Merge Replace assertEquals with assertEqual
5bae582 Load ML2 mech drivers as listed in ml2_conf.ini
fe92e1e Mock midonetclient in test_midonet_lib
902dc88 Replace assertEquals with assertEqual


it seems they are not matched? 62d0927 Avoid shadowing
NeutronException 'message' attribute is not in my branch, but i
already rebase the latest master branch.


can anyone help me?


review: https://review.openstack.org/#/c/42457/7
log:
http://logs.openstack.org/57/42457/7/check/gate-neutron-python27/453c38fhttp://logs.openstack.org/57/42457/7/check/gate-neutron-python27/453c38f/console.html
console:
http://logs.openstack.org/57/42457/7/check/gate-neutron-python27/453c38f/console.html
 :


-- 
blog: zqfan.github.com
git: github.com/zqfan
___
OpenStack-dev mailing list
OpenStack-dev@lists.openstack.org
http://lists.openstack.org/cgi-bin/mailman/listinfo/openstack-dev


Re: [openstack-dev] [nova] FFE Request: Pass image meta to hard reboot for generating xml

2013-09-09 Thread Thierry Carrez
Wangpan wrote:
 I have a patch need to be reviewed, which fix the bug
 https://bugs.launchpad.net/nova/+bug/1206809
 and this is the commit: https://review.openstack.org/#/c/39668/
 I think this is a serious bug because we may lose some features
 [...]

This looks like a bugfix. There is no need for an exception for bug
fixes (actually the feature freeze is in place so that we can
concentrate on exercising features and fix bugs, until we produce a
first release candidate).

Regards,

-- 
Thierry Carrez (ttx)

___
OpenStack-dev mailing list
OpenStack-dev@lists.openstack.org
http://lists.openstack.org/cgi-bin/mailman/listinfo/openstack-dev


[openstack-dev] [Nova][Baremetal][DB] Core review request: bugfix for 1221620

2013-09-09 Thread Roman Podolyaka
Hi,

There is a patch on review (https://review.openstack.org/#/c/45422/) fixing
https://bugs.launchpad.net/tripleo/+bug/1221620 which has importance
'Critical' in Nova and TripleO (long story short: currently Nova Baremetal
deployments with more than one baremetal node won't work).

It would be really nice to have this patch reviewed by core developers, so
we can fix the bug ASAP.

Thanks,
Roman
___
OpenStack-dev mailing list
OpenStack-dev@lists.openstack.org
http://lists.openstack.org/cgi-bin/mailman/listinfo/openstack-dev


Re: [openstack-dev] [Nova][Baremetal][DB] Core review request: bugfix for 1221620

2013-09-09 Thread Nikola Đipanov
On 09/09/13 11:25, Roman Podolyaka wrote:
 Hi,
 
 There is a patch on review (https://review.openstack.org/#/c/45422/)
 fixing https://bugs.launchpad.net/tripleo/+bug/1221620 which has
 importance 'Critical' in Nova and TripleO (long story short: currently
 Nova Baremetal deployments with more than one baremetal node won't work).
 
 It would be really nice to have this patch reviewed by core developers,
 so we can fix the bug ASAP.
 

Hey - thanks for responding quickly - I commented on the patch and tbh I
am starting to be -1 on this due to issues mentioned on the review.

I will accept that my take on this is too conservative :) and remove a
-1 if needed to get this in, but at this point, I have some doubts
weather this is the right approach.

Cheers,

N.


 Thanks,
 Roman
 
 
 ___
 OpenStack-dev mailing list
 OpenStack-dev@lists.openstack.org
 http://lists.openstack.org/cgi-bin/mailman/listinfo/openstack-dev
 


___
OpenStack-dev mailing list
OpenStack-dev@lists.openstack.org
http://lists.openstack.org/cgi-bin/mailman/listinfo/openstack-dev


Re: [openstack-dev] [Nova][Baremetal][DB] Core review request: bugfix for 1221620

2013-09-09 Thread Roman Podolyaka
Hi,

I'm ok with both accepting this patch and reverting the commit, which
introduced the regression, but it would be really nice to have these DB
optimizations in Nova.

As for your concern of accepting such optimizations. I don't think, it's a
problem of such patches themselves, but rather with the lack of
comprehensive tests of complex OpenStack installations in our CI (at the
same time I personally believe our CI is the best thing ever happened to
OpenStack :), CI team you really rock!).

Anyway, TripleO-CI found this regression. Maybe we should consider adding
its job to Nova check/gate pipelines?

Thanks,
Roman


On Mon, Sep 9, 2013 at 1:59 PM, Nikola Đipanov ndipa...@redhat.com wrote:

 On 09/09/13 11:25, Roman Podolyaka wrote:
  Hi,
 
  There is a patch on review (https://review.openstack.org/#/c/45422/)
  fixing https://bugs.launchpad.net/tripleo/+bug/1221620 which has
  importance 'Critical' in Nova and TripleO (long story short: currently
  Nova Baremetal deployments with more than one baremetal node won't work).
 
  It would be really nice to have this patch reviewed by core developers,
  so we can fix the bug ASAP.
 

 Hey - thanks for responding quickly - I commented on the patch and tbh I
 am starting to be -1 on this due to issues mentioned on the review.

 I will accept that my take on this is too conservative :) and remove a
 -1 if needed to get this in, but at this point, I have some doubts
 weather this is the right approach.

 Cheers,

 N.


  Thanks,
  Roman
 
 
  ___
  OpenStack-dev mailing list
  OpenStack-dev@lists.openstack.org
  http://lists.openstack.org/cgi-bin/mailman/listinfo/openstack-dev
 


 ___
 OpenStack-dev mailing list
 OpenStack-dev@lists.openstack.org
 http://lists.openstack.org/cgi-bin/mailman/listinfo/openstack-dev

___
OpenStack-dev mailing list
OpenStack-dev@lists.openstack.org
http://lists.openstack.org/cgi-bin/mailman/listinfo/openstack-dev


[openstack-dev] run_tests in debug mode fails

2013-09-09 Thread Rosa, Andrea (HP Cloud Services)
Hi all

I need to debug a specific test but when I try to run it in debug mode using 
the run_tests -d (I need to attach pdb) that command fails but if I run the 
script without the -d option that works.
I created a brand-new env so I don't think it's related to my local env.
Anyone is experiencing the same issue?
Should I file a nova bug for that?

Error details:
./run_tests.sh -d 
nova.tests.integrated.test_servers.ServersTestV3.test_create_and_rebuild_server
Traceback (most recent call last):
  File nova/tests/integrated/test_servers.py, line 43, in setUp
super(ServersTest, self).setUp()
  File nova/tests/integrated/integrated_helpers.py, line 87, in setUp
self.consoleauth = self.start_service('consoleauth')
  File nova/test.py, line 279, in start_service
svc = self.useFixture(ServiceFixture(name, host, **kwargs))
  File 
/home/ubuntu/nova/.venv/local/lib/python2.7/site-packages/testtools/testcase.py,
 line 591, in useFixture
fixture.setUp()
  File nova/test.py, line 174, in setUp
self.service = service.Service.create(**self.kwargs)
  File nova/service.py, line 245, in create
manager = CONF.get(manager_cls, None)
  File /home/ubuntu/nova/.venv/lib/python2.7/_abcoll.py, line 342, in get
return self[key]
  File 
/home/ubuntu/nova/.venv/local/lib/python2.7/site-packages/oslo/config/cfg.py, 
line 1610, in __getitem__
return self.__getattr__(key)
  File 
/home/ubuntu/nova/.venv/local/lib/python2.7/site-packages/oslo/config/cfg.py, 
line 1606, in __getattr__
return self._get(name)
  File 
/home/ubuntu/nova/.venv/local/lib/python2.7/site-packages/oslo/config/cfg.py, 
line 1930, in _get
value = self._substitute(self._do_get(name, group, namespace))
  File 
/home/ubuntu/nova/.venv/local/lib/python2.7/site-packages/oslo/config/cfg.py, 
line 1948, in _do_get
info = self._get_opt_info(name, group)
  File 
/home/ubuntu/nova/.venv/local/lib/python2.7/site-packages/oslo/config/cfg.py, 
line 2029, in _get_opt_info
raise NoSuchOptError(opt_name, group)
NoSuchOptError: no such option: consoleauth_manager

Ran 1 test in 11.296s
FAILED (failures=1)

Thanks 
--
Andrea 

___
OpenStack-dev mailing list
OpenStack-dev@lists.openstack.org
http://lists.openstack.org/cgi-bin/mailman/listinfo/openstack-dev


Re: [openstack-dev] [Nova][Baremetal][DB] Core review request: bugfix for 1221620

2013-09-09 Thread Robert Collins
We deseperately want TripleO in the gate and are working towards it.
However, doing that acceptably fast makes it non-trivial [nested VM's
are kindof slow...]. If there was BYOI in RackSpace and in HP's
non-Beta regions, and custom networking in both clouds, then we could
avoid a layer of nesting and test the different TripleO layers
independently (and concurrently) but sadly thats not the case yet, so
we're having to work on tuning and the occasional hack.

We hope to have at least functional tests for nova-bm in soon, with
TripleO as a whole following on subsequently to that.

-Rob

On 9 September 2013 23:12, Roman Podolyaka rpodoly...@mirantis.com wrote:
 Hi,

 I'm ok with both accepting this patch and reverting the commit, which
 introduced the regression, but it would be really nice to have these DB
 optimizations in Nova.

 As for your concern of accepting such optimizations. I don't think, it's a
 problem of such patches themselves, but rather with the lack of
 comprehensive tests of complex OpenStack installations in our CI (at the
 same time I personally believe our CI is the best thing ever happened to
 OpenStack :), CI team you really rock!).

 Anyway, TripleO-CI found this regression. Maybe we should consider adding
 its job to Nova check/gate pipelines?

 Thanks,
 Roman


 On Mon, Sep 9, 2013 at 1:59 PM, Nikola Đipanov ndipa...@redhat.com wrote:

 On 09/09/13 11:25, Roman Podolyaka wrote:
  Hi,
 
  There is a patch on review (https://review.openstack.org/#/c/45422/)
  fixing https://bugs.launchpad.net/tripleo/+bug/1221620 which has
  importance 'Critical' in Nova and TripleO (long story short: currently
  Nova Baremetal deployments with more than one baremetal node won't
  work).
 
  It would be really nice to have this patch reviewed by core developers,
  so we can fix the bug ASAP.
 

 Hey - thanks for responding quickly - I commented on the patch and tbh I
 am starting to be -1 on this due to issues mentioned on the review.

 I will accept that my take on this is too conservative :) and remove a
 -1 if needed to get this in, but at this point, I have some doubts
 weather this is the right approach.

 Cheers,

 N.


  Thanks,
  Roman
 
 
  ___
  OpenStack-dev mailing list
  OpenStack-dev@lists.openstack.org
  http://lists.openstack.org/cgi-bin/mailman/listinfo/openstack-dev
 


 ___
 OpenStack-dev mailing list
 OpenStack-dev@lists.openstack.org
 http://lists.openstack.org/cgi-bin/mailman/listinfo/openstack-dev



 ___
 OpenStack-dev mailing list
 OpenStack-dev@lists.openstack.org
 http://lists.openstack.org/cgi-bin/mailman/listinfo/openstack-dev




-- 
Robert Collins rbtcoll...@hp.com
Distinguished Technologist
HP Converged Cloud

___
OpenStack-dev mailing list
OpenStack-dev@lists.openstack.org
http://lists.openstack.org/cgi-bin/mailman/listinfo/openstack-dev


Re: [openstack-dev] [nova] FFE Request: v3 setting v3 API core

2013-09-09 Thread Thierry Carrez
Christopher Yeoh wrote:
 The following 3 changesets in the queue:
 
 https://review.openstack.org/#/c/43274/
 https://review.openstack.org/#/c/43278/
 https://review.openstack.org/#/c/43280/
 
 make keypairs, scheduler hints and console output part of the V3 core
 api. This essentially changes just two things:
 
 - the v3 API server will refuse to startup if they are not loaded (this
   is the definition of a feature being part of core given that all of
   the API is an 'extension' now.
 - the resource is accessed slightly differently - /v3/keypairs rather
   than /v3/os-keypairs as an example
 
 In terms of risk the change is limited to the V3 API only. And although
 the V3 API will be experimental in Havana anyway and subject to some
 change I would like to include this because of the resource name
 changes and minimise any hassle for people who do start using the V3 API
 in Havana and then want to use it for Icehouse. It has similar
 downstream effects on documentation.

Agreed, that sounds like a useful pre-release cleanup.
No objection from me, especially if this is ready to land.

-- 
Thierry Carrez (ttx)

___
OpenStack-dev mailing list
OpenStack-dev@lists.openstack.org
http://lists.openstack.org/cgi-bin/mailman/listinfo/openstack-dev


Re: [openstack-dev] [Nova][Baremetal][DB] Core review request: bugfix for 1221620

2013-09-09 Thread Roman Podolyaka
Robert,

Cool! That would be really nice! nova-bm functional tests are the bare
minimum we need.

Thanks,
Roman


On Mon, Sep 9, 2013 at 2:27 PM, Robert Collins robe...@robertcollins.netwrote:

 We deseperately want TripleO in the gate and are working towards it.
 However, doing that acceptably fast makes it non-trivial [nested VM's
 are kindof slow...]. If there was BYOI in RackSpace and in HP's
 non-Beta regions, and custom networking in both clouds, then we could
 avoid a layer of nesting and test the different TripleO layers
 independently (and concurrently) but sadly thats not the case yet, so
 we're having to work on tuning and the occasional hack.

 We hope to have at least functional tests for nova-bm in soon, with
 TripleO as a whole following on subsequently to that.

 -Rob

 On 9 September 2013 23:12, Roman Podolyaka rpodoly...@mirantis.com
 wrote:
  Hi,
 
  I'm ok with both accepting this patch and reverting the commit, which
  introduced the regression, but it would be really nice to have these DB
  optimizations in Nova.
 
  As for your concern of accepting such optimizations. I don't think, it's
 a
  problem of such patches themselves, but rather with the lack of
  comprehensive tests of complex OpenStack installations in our CI (at the
  same time I personally believe our CI is the best thing ever happened to
  OpenStack :), CI team you really rock!).
 
  Anyway, TripleO-CI found this regression. Maybe we should consider adding
  its job to Nova check/gate pipelines?
 
  Thanks,
  Roman
 
 
  On Mon, Sep 9, 2013 at 1:59 PM, Nikola Đipanov ndipa...@redhat.com
 wrote:
 
  On 09/09/13 11:25, Roman Podolyaka wrote:
   Hi,
  
   There is a patch on review (https://review.openstack.org/#/c/45422/)
   fixing https://bugs.launchpad.net/tripleo/+bug/1221620 which has
   importance 'Critical' in Nova and TripleO (long story short: currently
   Nova Baremetal deployments with more than one baremetal node won't
   work).
  
   It would be really nice to have this patch reviewed by core
 developers,
   so we can fix the bug ASAP.
  
 
  Hey - thanks for responding quickly - I commented on the patch and tbh I
  am starting to be -1 on this due to issues mentioned on the review.
 
  I will accept that my take on this is too conservative :) and remove a
  -1 if needed to get this in, but at this point, I have some doubts
  weather this is the right approach.
 
  Cheers,
 
  N.
 
 
   Thanks,
   Roman
  
  
   ___
   OpenStack-dev mailing list
   OpenStack-dev@lists.openstack.org
   http://lists.openstack.org/cgi-bin/mailman/listinfo/openstack-dev
  
 
 
  ___
  OpenStack-dev mailing list
  OpenStack-dev@lists.openstack.org
  http://lists.openstack.org/cgi-bin/mailman/listinfo/openstack-dev
 
 
 
  ___
  OpenStack-dev mailing list
  OpenStack-dev@lists.openstack.org
  http://lists.openstack.org/cgi-bin/mailman/listinfo/openstack-dev
 



 --
 Robert Collins rbtcoll...@hp.com
 Distinguished Technologist
 HP Converged Cloud

 ___
 OpenStack-dev mailing list
 OpenStack-dev@lists.openstack.org
 http://lists.openstack.org/cgi-bin/mailman/listinfo/openstack-dev

___
OpenStack-dev mailing list
OpenStack-dev@lists.openstack.org
http://lists.openstack.org/cgi-bin/mailman/listinfo/openstack-dev


Re: [openstack-dev] [Nova][Baremetal][DB] Core review request: bugfix for 1221620

2013-09-09 Thread Nikola Đipanov
On 09/09/13 13:12, Roman Podolyaka wrote:
 Hi,
 
 I'm ok with both accepting this patch and reverting the commit, which
 introduced the regression, but it would be really nice to have these DB
 optimizations in Nova.
 
 As for your concern of accepting such optimizations. I don't think, it's
 a problem of such patches themselves, but rather with the lack of
 comprehensive tests of complex OpenStack installations in our CI (at the
 same time I personally believe our CI is the best thing ever happened to
 OpenStack :), CI team you really rock!).
 

More CI is always good - and OpenStack CI is amazing without a doubt.
However - I think this is not something that ties in very much with
these kind of optimisations.

The problem with (most) optimisations is that they optimise for a use
case. No matter how at scale you tested this - it is still one data
point - and this patch does not come for free (regression risk,
technical debt to name only a few). You can mitigate some of the issues
with CI - but you can't say for sure that this is not in fact slower for
people with different deployments/usage patterns.

Now this patch may very well be a net win - but I personally have no way
of knowing that - and to me - this is the problem with this whole
approach - I see the downsides, but don't see the conclusive evidence of
the pros of it (we tried it on a really big (tm) cluster - it must be
better is not real data IMHO).

I realize that we as a project are approaching the point where
performance is a thing we need to care about - but then we need to own
it as a project (maybe have a sub-team that works on this exclusively).
One shot DB query optimisations in Python code seem like a horrible
anti-pattern TBH.

I may propose a session on this for the summit.

Cheers,

N.

 Anyway, TripleO-CI found this regression. Maybe we should consider
 adding its job to Nova check/gate pipelines?
 
 Thanks,
 Roman
 
 
 On Mon, Sep 9, 2013 at 1:59 PM, Nikola Đipanov ndipa...@redhat.com
 mailto:ndipa...@redhat.com wrote:
 
 On 09/09/13 11:25, Roman Podolyaka wrote:
  Hi,
 
  There is a patch on review (https://review.openstack.org/#/c/45422/)
  fixing https://bugs.launchpad.net/tripleo/+bug/1221620 which has
  importance 'Critical' in Nova and TripleO (long story short: currently
  Nova Baremetal deployments with more than one baremetal node won't
 work).
 
  It would be really nice to have this patch reviewed by core
 developers,
  so we can fix the bug ASAP.
 
 
 Hey - thanks for responding quickly - I commented on the patch and tbh I
 am starting to be -1 on this due to issues mentioned on the review.
 
 I will accept that my take on this is too conservative :) and remove a
 -1 if needed to get this in, but at this point, I have some doubts
 weather this is the right approach.
 
 Cheers,
 
 N.
 
 
  Thanks,
  Roman
 
 
  ___
  OpenStack-dev mailing list
  OpenStack-dev@lists.openstack.org
 mailto:OpenStack-dev@lists.openstack.org
  http://lists.openstack.org/cgi-bin/mailman/listinfo/openstack-dev
 
 
 
 ___
 OpenStack-dev mailing list
 OpenStack-dev@lists.openstack.org
 mailto:OpenStack-dev@lists.openstack.org
 http://lists.openstack.org/cgi-bin/mailman/listinfo/openstack-dev
 
 
 
 
 ___
 OpenStack-dev mailing list
 OpenStack-dev@lists.openstack.org
 http://lists.openstack.org/cgi-bin/mailman/listinfo/openstack-dev
 


___
OpenStack-dev mailing list
OpenStack-dev@lists.openstack.org
http://lists.openstack.org/cgi-bin/mailman/listinfo/openstack-dev


Re: [openstack-dev] [Nova][Baremetal][DB] Core review request: bugfix for 1221620

2013-09-09 Thread Boris Pavlovic
Nikola,

The main problem in this case that we use DB in wrong way.
If you  need in online request to return 100k rows then you are doing
something wrong IMHO. And this fix is better then nothing (and it is the
best thing that we could do).


Best regards,
Boris Pavlovic



On Mon, Sep 9, 2013 at 4:10 PM, Nikola Đipanov ndipa...@redhat.com wrote:

 On 09/09/13 13:12, Roman Podolyaka wrote:
  Hi,
 
  I'm ok with both accepting this patch and reverting the commit, which
  introduced the regression, but it would be really nice to have these DB
  optimizations in Nova.
 
  As for your concern of accepting such optimizations. I don't think, it's
  a problem of such patches themselves, but rather with the lack of
  comprehensive tests of complex OpenStack installations in our CI (at the
  same time I personally believe our CI is the best thing ever happened to
  OpenStack :), CI team you really rock!).
 

 More CI is always good - and OpenStack CI is amazing without a doubt.
 However - I think this is not something that ties in very much with
 these kind of optimisations.

 The problem with (most) optimisations is that they optimise for a use
 case. No matter how at scale you tested this - it is still one data
 point - and this patch does not come for free (regression risk,
 technical debt to name only a few). You can mitigate some of the issues
 with CI - but you can't say for sure that this is not in fact slower for
 people with different deployments/usage patterns.

 Now this patch may very well be a net win - but I personally have no way
 of knowing that - and to me - this is the problem with this whole
 approach - I see the downsides, but don't see the conclusive evidence of
 the pros of it (we tried it on a really big (tm) cluster - it must be
 better is not real data IMHO).

 I realize that we as a project are approaching the point where
 performance is a thing we need to care about - but then we need to own
 it as a project (maybe have a sub-team that works on this exclusively).
 One shot DB query optimisations in Python code seem like a horrible
 anti-pattern TBH.

 I may propose a session on this for the summit.

 Cheers,

 N.

  Anyway, TripleO-CI found this regression. Maybe we should consider
  adding its job to Nova check/gate pipelines?
 
  Thanks,
  Roman
 
 
  On Mon, Sep 9, 2013 at 1:59 PM, Nikola Đipanov ndipa...@redhat.com
  mailto:ndipa...@redhat.com wrote:
 
  On 09/09/13 11:25, Roman Podolyaka wrote:
   Hi,
  
   There is a patch on review (
 https://review.openstack.org/#/c/45422/)
   fixing https://bugs.launchpad.net/tripleo/+bug/1221620 which has
   importance 'Critical' in Nova and TripleO (long story short:
 currently
   Nova Baremetal deployments with more than one baremetal node won't
  work).
  
   It would be really nice to have this patch reviewed by core
  developers,
   so we can fix the bug ASAP.
  
 
  Hey - thanks for responding quickly - I commented on the patch and
 tbh I
  am starting to be -1 on this due to issues mentioned on the review.
 
  I will accept that my take on this is too conservative :) and remove
 a
  -1 if needed to get this in, but at this point, I have some doubts
  weather this is the right approach.
 
  Cheers,
 
  N.
 
 
   Thanks,
   Roman
  
  
   ___
   OpenStack-dev mailing list
   OpenStack-dev@lists.openstack.org
  mailto:OpenStack-dev@lists.openstack.org
   http://lists.openstack.org/cgi-bin/mailman/listinfo/openstack-dev
  
 
 
  ___
  OpenStack-dev mailing list
  OpenStack-dev@lists.openstack.org
  mailto:OpenStack-dev@lists.openstack.org
  http://lists.openstack.org/cgi-bin/mailman/listinfo/openstack-dev
 
 
 
 
  ___
  OpenStack-dev mailing list
  OpenStack-dev@lists.openstack.org
  http://lists.openstack.org/cgi-bin/mailman/listinfo/openstack-dev
 


 ___
 OpenStack-dev mailing list
 OpenStack-dev@lists.openstack.org
 http://lists.openstack.org/cgi-bin/mailman/listinfo/openstack-dev

___
OpenStack-dev mailing list
OpenStack-dev@lists.openstack.org
http://lists.openstack.org/cgi-bin/mailman/listinfo/openstack-dev


Re: [openstack-dev] [Nova][Baremetal][DB] Core review request: bugfix for 1221620

2013-09-09 Thread Nikola Đipanov
On 09/09/13 14:17, Boris Pavlovic wrote:
 Nikola, 
 
 The main problem in this case that we use DB in wrong way.
 If you  need in online request to return 100k rows then you are doing
 something wrong IMHO. 

Agreed!

 And this fix is better then nothing (and it is the
 best thing that we could do).
 

I am sensitive to that - this is tricky timing for such an issue, and as
I stated on the review - will remove the -1 if there are more people who
come up and say they want to keep it.

I am just speaking up against this way of introducing optimisations
which I think is wrong and should happen only in special cases like this
(maybe, let's see :)), and not be something we do as a rule.

If we want to be serious about performance - we can't keep on doing this
- IMHO.

N.

 
 Best regards,
 Boris Pavlovic
 
 
 
 On Mon, Sep 9, 2013 at 4:10 PM, Nikola Đipanov ndipa...@redhat.com
 mailto:ndipa...@redhat.com wrote:
 
 On 09/09/13 13:12, Roman Podolyaka wrote:
  Hi,
 
  I'm ok with both accepting this patch and reverting the commit, which
  introduced the regression, but it would be really nice to have
 these DB
  optimizations in Nova.
 
  As for your concern of accepting such optimizations. I don't
 think, it's
  a problem of such patches themselves, but rather with the lack of
  comprehensive tests of complex OpenStack installations in our CI
 (at the
  same time I personally believe our CI is the best thing ever
 happened to
  OpenStack :), CI team you really rock!).
 
 
 More CI is always good - and OpenStack CI is amazing without a doubt.
 However - I think this is not something that ties in very much with
 these kind of optimisations.
 
 The problem with (most) optimisations is that they optimise for a use
 case. No matter how at scale you tested this - it is still one data
 point - and this patch does not come for free (regression risk,
 technical debt to name only a few). You can mitigate some of the issues
 with CI - but you can't say for sure that this is not in fact slower for
 people with different deployments/usage patterns.
 
 Now this patch may very well be a net win - but I personally have no way
 of knowing that - and to me - this is the problem with this whole
 approach - I see the downsides, but don't see the conclusive evidence of
 the pros of it (we tried it on a really big (tm) cluster - it must be
 better is not real data IMHO).
 
 I realize that we as a project are approaching the point where
 performance is a thing we need to care about - but then we need to own
 it as a project (maybe have a sub-team that works on this exclusively).
 One shot DB query optimisations in Python code seem like a horrible
 anti-pattern TBH.
 
 I may propose a session on this for the summit.
 
 Cheers,
 
 N.
 
  Anyway, TripleO-CI found this regression. Maybe we should consider
  adding its job to Nova check/gate pipelines?
 
  Thanks,
  Roman
 
 
  On Mon, Sep 9, 2013 at 1:59 PM, Nikola Đipanov
 ndipa...@redhat.com mailto:ndipa...@redhat.com
  mailto:ndipa...@redhat.com mailto:ndipa...@redhat.com wrote:
 
  On 09/09/13 11:25, Roman Podolyaka wrote:
   Hi,
  
   There is a patch on review
 (https://review.openstack.org/#/c/45422/)
   fixing https://bugs.launchpad.net/tripleo/+bug/1221620 which has
   importance 'Critical' in Nova and TripleO (long story short:
 currently
   Nova Baremetal deployments with more than one baremetal node
 won't
  work).
  
   It would be really nice to have this patch reviewed by core
  developers,
   so we can fix the bug ASAP.
  
 
  Hey - thanks for responding quickly - I commented on the patch
 and tbh I
  am starting to be -1 on this due to issues mentioned on the
 review.
 
  I will accept that my take on this is too conservative :) and
 remove a
  -1 if needed to get this in, but at this point, I have some doubts
  weather this is the right approach.
 
  Cheers,
 
  N.
 
 
   Thanks,
   Roman
  
  
   ___
   OpenStack-dev mailing list
   OpenStack-dev@lists.openstack.org
 mailto:OpenStack-dev@lists.openstack.org
  mailto:OpenStack-dev@lists.openstack.org
 mailto:OpenStack-dev@lists.openstack.org
  
 http://lists.openstack.org/cgi-bin/mailman/listinfo/openstack-dev
  
 
 
  ___
  OpenStack-dev mailing list
  OpenStack-dev@lists.openstack.org
 mailto:OpenStack-dev@lists.openstack.org
  mailto:OpenStack-dev@lists.openstack.org
 

[openstack-dev] [glance] FFE Request: Add swift_store_ssl_compression param

2013-09-09 Thread stuart . mclaren

This change:

https://review.openstack.org/#/c/32919/

is the final piece of a puzzle that allows a (potentially significant)
performance improvement for image uploads (snapshots)/downloads when
using ssl.

Its the last change required for the following paths:

(nova/cinder) - (glance client) - (glance) - (swift client) - (swift)

Without this patch swift will be a bottleneck running at ~17 MB/s while
the other parts can potentially reach ~100 MB/s.

Risk: Currently the patch sets compression to be disabled by default
(giving better performance), but the old behaviour can be reverted
by setting the relevant config parameter. (We could even potentially
consider defaulting to the old behaviour.)

The patch was originally uploaded on Jun 13.

-Stuart

___
OpenStack-dev mailing list
OpenStack-dev@lists.openstack.org
http://lists.openstack.org/cgi-bin/mailman/listinfo/openstack-dev


Re: [openstack-dev] [Nova] FFE exception for https://review.openstack.org/#/c/45126/

2013-09-09 Thread Russell Bryant
On 09/09/2013 05:01 AM, Thierry Carrez wrote:
 Robert Collins wrote:
 This small patch is needed for the pxe orchestration integration that
 will (finally!) permit using Neutron DHCP rather than a manual dnsmasq
 for Nova baremetal (and Ironic).

 We only found out that this was buggy when integration testing, and
 this patch came in right at the end of the H3 mass of patches :(.

 Without it, the DHCP integration is unusual. We could perhaps hardcode
 the value in H, but that would make it spuriously different to what
 would be in I.

 So, I'd like a FFE for this patch, if we can.
 
 That looks arguably like a bugfix to me. +1
 

ACK on the FFE.

-- 
Russell Bryant

___
OpenStack-dev mailing list
OpenStack-dev@lists.openstack.org
http://lists.openstack.org/cgi-bin/mailman/listinfo/openstack-dev


Re: [openstack-dev] [Openstack] [TROVE] database instance creation

2013-09-09 Thread Daniel Salinas
Trove allows you to deploy a single vm with 1 server instance of whichever
service supported.  So for example, if you were to deploy a mysql instance,
you would have 1 vm with 1 mysql instance running on it.  You can put as
many databases on that one server instance as you would like with as many
database users as you would like.


On Mon, Sep 9, 2013 at 9:21 AM, Giuseppe Galeota
giuseppegale...@gmail.comwrote:

 Dear all,
 reading the TROVE's 
 Dochttp://docs.openstack.org/developer/trove/dev/design.htmlI see that 
 Trove is designed to support a single-tenant database within a
 Nova instance.

 What does means this?

 Does it mean that Trove creates a single VM instance in which a single
 database instance is created?

 Does it mean that Trove creates a single VM instance in which a more
 database instances of a single tenant are created ?

 Thank you,
 Giuseppe

 ___
 Mailing list:
 http://lists.openstack.org/cgi-bin/mailman/listinfo/openstack
 Post to : openst...@lists.openstack.org
 Unsubscribe :
 http://lists.openstack.org/cgi-bin/mailman/listinfo/openstack


___
OpenStack-dev mailing list
OpenStack-dev@lists.openstack.org
http://lists.openstack.org/cgi-bin/mailman/listinfo/openstack-dev


Re: [openstack-dev] [nova] FFE Request: v3 setting v3 API core

2013-09-09 Thread Russell Bryant
On 09/09/2013 07:38 AM, Thierry Carrez wrote:
 Christopher Yeoh wrote:
 The following 3 changesets in the queue:

 https://review.openstack.org/#/c/43274/
 https://review.openstack.org/#/c/43278/
 https://review.openstack.org/#/c/43280/

 make keypairs, scheduler hints and console output part of the V3 core
 api. This essentially changes just two things:

 - the v3 API server will refuse to startup if they are not loaded (this
   is the definition of a feature being part of core given that all of
   the API is an 'extension' now.
 - the resource is accessed slightly differently - /v3/keypairs rather
   than /v3/os-keypairs as an example

 In terms of risk the change is limited to the V3 API only. And although
 the V3 API will be experimental in Havana anyway and subject to some
 change I would like to include this because of the resource name
 changes and minimise any hassle for people who do start using the V3 API
 in Havana and then want to use it for Icehouse. It has similar
 downstream effects on documentation.
 
 Agreed, that sounds like a useful pre-release cleanup.
 No objection from me, especially if this is ready to land.
 

Ok, it's fine with me too, but hopefully it's the last set of v3 API
cleanups for havana.

We're going to have to get more strict on these sorts of things, soon.
We really need to shift focus to bug fixes.  Even things like this that
are ready come at a cost since it requires reviewer bandwidth.

-- 
Russell Bryant

___
OpenStack-dev mailing list
OpenStack-dev@lists.openstack.org
http://lists.openstack.org/cgi-bin/mailman/listinfo/openstack-dev


Re: [openstack-dev] [nova] Needs approval again after rebase

2013-09-09 Thread Russell Bryant
On 09/06/2013 07:04 PM, Yingjun Li wrote:
 Hi, The patch https://review.openstack.org/43583 was approved but failed
 to get merged. Could any core reviewer take a look at this after rebase ?

Got it.

Thanks,

-- 
Russell Bryant

___
OpenStack-dev mailing list
OpenStack-dev@lists.openstack.org
http://lists.openstack.org/cgi-bin/mailman/listinfo/openstack-dev


Re: [openstack-dev] [Openstack] [TROVE] database instance creation

2013-09-09 Thread Giuseppe Galeota
Dear all,
reading the TROVE's
Dochttp://docs.openstack.org/developer/trove/dev/design.html
 I see that The trove-taskmanager service does the heavy lifting as far as
provisioning instances, managing the lifecycle of instances, and performing
operations on the *Database instance*.

So, once an instance was created, how does an application deployed in the
cloud platform (IaaS or PaaS level) perform CRUD operation on that database
instance? Maybe, does the trove-taskmanager release an endpoint on which
create a DBMS connection?

Giuseppe


2013/9/9 Daniel Salinas imsplit...@gmail.com

 Trove allows you to deploy a single vm with 1 server instance of whichever
 service supported.  So for example, if you were to deploy a mysql instance,
 you would have 1 vm with 1 mysql instance running on it.  You can put as
 many databases on that one server instance as you would like with as many
 database users as you would like.


 On Mon, Sep 9, 2013 at 9:21 AM, Giuseppe Galeota 
 giuseppegale...@gmail.com wrote:

 Dear all,
 reading the TROVE's 
 Dochttp://docs.openstack.org/developer/trove/dev/design.htmlI see that 
 Trove is designed to support a single-tenant database within a
 Nova instance.

 What does means this?

 Does it mean that Trove creates a single VM instance in which a single
 database instance is created?

 Does it mean that Trove creates a single VM instance in which a more
 database instances of a single tenant are created ?

 Thank you,
 Giuseppe

 ___
 Mailing list:
 http://lists.openstack.org/cgi-bin/mailman/listinfo/openstack
 Post to : openst...@lists.openstack.org
 Unsubscribe :
 http://lists.openstack.org/cgi-bin/mailman/listinfo/openstack



___
OpenStack-dev mailing list
OpenStack-dev@lists.openstack.org
http://lists.openstack.org/cgi-bin/mailman/listinfo/openstack-dev


Re: [openstack-dev] [Openstack] [TROVE] database instance creation

2013-09-09 Thread Giuseppe Galeota
So, I think that Trove is designed to support a *single-tenant *database
within a Nova instance is a misleading definition. What do you think?

Giuseppe


2013/9/9 Daniel Salinas imsplit...@gmail.com

 Trove allows you to deploy a single vm with 1 server instance of whichever
 service supported.  So for example, if you were to deploy a mysql instance,
 you would have 1 vm with 1 mysql instance running on it.  You can put as
 many databases on that one server instance as you would like with as many
 database users as you would like.


 On Mon, Sep 9, 2013 at 9:21 AM, Giuseppe Galeota 
 giuseppegale...@gmail.com wrote:

 Dear all,
 reading the TROVE's 
 Dochttp://docs.openstack.org/developer/trove/dev/design.htmlI see that 
 Trove is designed to support a single-tenant database within a
 Nova instance.

 What does means this?

 Does it mean that Trove creates a single VM instance in which a single
 database instance is created?

 Does it mean that Trove creates a single VM instance in which a more
 database instances of a single tenant are created ?

 Thank you,
 Giuseppe

 ___
 Mailing list:
 http://lists.openstack.org/cgi-bin/mailman/listinfo/openstack
 Post to : openst...@lists.openstack.org
 Unsubscribe :
 http://lists.openstack.org/cgi-bin/mailman/listinfo/openstack



___
OpenStack-dev mailing list
OpenStack-dev@lists.openstack.org
http://lists.openstack.org/cgi-bin/mailman/listinfo/openstack-dev


[openstack-dev] [marconi] Agenda for Today's Meeting @ 1600 UTC

2013-09-09 Thread Kurt Griffiths
The Marconi project team holds a weekly meeting in #openstack-meeting-alt
on Mondays, 1600 UTC.

The next meeting is today, September 9th.

Everyone is welcome. However, please take a minute to review the wiki
before attending for the first time:

http://wiki.openstack.org/marconi

## Agenda (60 mins): ##

* Review actions from last time
* SQL Backend
* Commit tsung configs in Marconi's tree
(https://github.com/rackerlabs/csi-marconi)
* Bugs
* Performance
* Scaling
* Triage blueprints (H3)
* Open discussion (time permitting)

## Coming soon... ##

* Audit and freeze HTTP v1 API


See also:

http://wiki.openstack.org/Meetings/Marconi

Cheers,

Kurt (kgriffs)








___
OpenStack-dev mailing list
OpenStack-dev@lists.openstack.org
http://lists.openstack.org/cgi-bin/mailman/listinfo/openstack-dev


[openstack-dev] [Tuskar] Meeting agenda for Tue 10th September at 19:00 UTC

2013-09-09 Thread Tomas Sedovic

The Tuskar team holds a meeting in #openstack-meeting-alt, see

https://wiki.openstack.org/wiki/Meetings/Tuskar

The next meeting is on Tuesday 10th September at 19:00 UTC.

Current topics for discussion:

* Documentation
* Simplify development setup
* Tests
* Releases  Milestones
* Open discussion

If you have any other topics to discuss, please add them to the wiki.

Thanks,
shadower

___
OpenStack-dev mailing list
OpenStack-dev@lists.openstack.org
http://lists.openstack.org/cgi-bin/mailman/listinfo/openstack-dev


[openstack-dev] Code review (Jenkins-job-builder / sbt-plugin)

2013-09-09 Thread Peter Liljenberg
Hi,

Could someone review/approve this (Added SBT builder
supporthttps://review.openstack.org/#/c/44685/),
thanks!

https://review.openstack.org/#/c/44685/

/Peter
___
OpenStack-dev mailing list
OpenStack-dev@lists.openstack.org
http://lists.openstack.org/cgi-bin/mailman/listinfo/openstack-dev


Re: [openstack-dev] [glance] FFE Request: Add swift_store_ssl_compression param

2013-09-09 Thread Thierry Carrez
stuart.mcla...@hp.com wrote:
 This change:
 
 https://review.openstack.org/#/c/32919/
 
 is the final piece of a puzzle that allows a (potentially significant)
 performance improvement for image uploads (snapshots)/downloads when
 using ssl.

I guess that's why I like puzzles being targeted to the second milestone
in the cycle... deferring those is painful.

 Without this patch swift will be a bottleneck running at ~17 MB/s while
 the other parts can potentially reach ~100 MB/s.
 
 Risk: Currently the patch sets compression to be disabled by default
 (giving better performance), but the old behaviour can be reverted
 by setting the relevant config parameter. (We could even potentially
 consider defaulting to the old behaviour.)

At this stage of the cycle, I would definitely consider defaulting to
the old behavior for Havana, and then this exception would be a
no-brainer. With the proposed default, I have to ask how much mileage
the SSL without compression swift mode has seen, and the risk is
substantially higher.

 The patch was originally uploaded on Jun 13.

Yes, but it was WIP-ed for two months waiting for the necessary support
to land in Swift...

-- 
Thierry Carrez (ttx)

___
OpenStack-dev mailing list
OpenStack-dev@lists.openstack.org
http://lists.openstack.org/cgi-bin/mailman/listinfo/openstack-dev


[openstack-dev] [QA]Tempest CLI Compute-Manage

2013-09-09 Thread Martinez, Castulo


Best Regards / Saludos!

Castulo J. Martinez
ISTQB Test Manager
QA Engineer | Q1st team @GDC
Intel | Security Engineering and Cloud Integration (SECI)
Office: +52.33.2282.4083 | iNet: 8286-4083
 Before printing consider your Environmental Responsibility!


-Original Message-
From: Sean Dague [mailto:sda...@gmail.com] On Behalf Of Sean Dague
Sent: Monday, September 09, 2013 10:43 AM
To: Martinez, Castulo
Subject: Re: Tempest CLI Compute-Manage

Please post to the openstack-dev list with the [QA] tag

On 09/09/2013 11:23 AM, Martinez, Castulo wrote:
 Hi Sean,

 I was looking at the Tempest tests and I have a doubt regarding the 
 CLI compute-manage tests. I saw you are one of the main contributors 
 of these, I hope you are the right person to ask you this, if not, I’d 
 appreciate if you could point me to the right direction.

 When I run the test_compute_manage.py module most of the tests are 
 failing in my environment, however doing some googling I ran into this 
 page from the openStak wiki: 
 https://wiki.openstack.org/wiki/NovaManage

 In one section of that page I found this comment: The nova-manage 
 isn't properly documented, but it's going away in Folsom, so using 
 this wiki page for quick docs on it. , and since Folsom was released 
 in 2012, I guess the tests failing in Tempest would be a result of 
 that nova-manage component not being in the openStack anymore, at 
 least not functional anyway. But if this is the case, why are these tests 
 still in Tempest?

 Thanks in advance for your help J

 Best Regards / Saludos!

 **

 *Castulo J. Martinez*

 *ISTQB Test Manager*

 QA Engineer | Q1st team @GDC

 Intel*|* Security Engineering and Cloud Integration (SECI)

 *Office:*+52.33.2282.4083 *| iNet:* 8286-4083

 PBefore printing consider your *Environmental Responsibility!*



--
Sean Dague
http://dague.net
___
OpenStack-dev mailing list
OpenStack-dev@lists.openstack.org
http://lists.openstack.org/cgi-bin/mailman/listinfo/openstack-dev


[openstack-dev] [Infra] Meeting Tuesday September 10th at 19:00 UTC

2013-09-09 Thread Elizabeth Krumbach Joseph
The OpenStack Infrastructure (Infra) team is hosting our weekly
meeting tomorrow, Tuesday September 10th, at 19:00 UTC in
#openstack-meeting

Meeting agenda available here:
https://wiki.openstack.org/wiki/Meetings/InfraTeamMeeting (anyone is
welcome to to add agenda items)

Everyone interested in infrastructure and process surrounding
automated testing and deployment is encouraged to attend.

We're also having our Bug Day tomorrow, starting at 17:00 UTC, notes
will be coming together here:
https://etherpad.openstack.org/cibugreview-september2013

-- 
Elizabeth Krumbach Joseph || Lyz || pleia2
http://www.princessleia.com

___
OpenStack-dev mailing list
OpenStack-dev@lists.openstack.org
http://lists.openstack.org/cgi-bin/mailman/listinfo/openstack-dev


Re: [openstack-dev] [glance] FFE Request: Add swift_store_ssl_compression param

2013-09-09 Thread Mark Washenberger
I buy an exception here if the configuration defaults to off (no change).

Thanks!


On Mon, Sep 9, 2013 at 8:29 AM, Thierry Carrez thie...@openstack.orgwrote:

 stuart.mcla...@hp.com wrote:
  This change:
 
  https://review.openstack.org/#/c/32919/
 
  is the final piece of a puzzle that allows a (potentially significant)
  performance improvement for image uploads (snapshots)/downloads when
  using ssl.

 I guess that's why I like puzzles being targeted to the second milestone
 in the cycle... deferring those is painful.

  Without this patch swift will be a bottleneck running at ~17 MB/s while
  the other parts can potentially reach ~100 MB/s.
 
  Risk: Currently the patch sets compression to be disabled by default
  (giving better performance), but the old behaviour can be reverted
  by setting the relevant config parameter. (We could even potentially
  consider defaulting to the old behaviour.)

 At this stage of the cycle, I would definitely consider defaulting to
 the old behavior for Havana, and then this exception would be a
 no-brainer. With the proposed default, I have to ask how much mileage
 the SSL without compression swift mode has seen, and the risk is
 substantially higher.

  The patch was originally uploaded on Jun 13.

 Yes, but it was WIP-ed for two months waiting for the necessary support
 to land in Swift...

 --
 Thierry Carrez (ttx)

 ___
 OpenStack-dev mailing list
 OpenStack-dev@lists.openstack.org
 http://lists.openstack.org/cgi-bin/mailman/listinfo/openstack-dev

___
OpenStack-dev mailing list
OpenStack-dev@lists.openstack.org
http://lists.openstack.org/cgi-bin/mailman/listinfo/openstack-dev


[openstack-dev] [marconi] Summary from today's meeting

2013-09-09 Thread Kurt Griffiths
Hi Folks,

Today we discussed the SQL driver, performance patches, and a few other
interesting tidbits.

Summary: http://goo.gl/RbeSUa
Log: http://goo.gl/UqNSPj

Note also that we now have eavesdrop working for #openstack-marconi so you
can find our day-to-day chats archived in the usual place:

http://eavesdrop.openstack.org/irclogs/

  
Cheers,

Kurt (kgriffs)


___
OpenStack-dev mailing list
OpenStack-dev@lists.openstack.org
http://lists.openstack.org/cgi-bin/mailman/listinfo/openstack-dev


Re: [openstack-dev] Code review (Jenkins-job-builder / sbt-plugin)

2013-09-09 Thread Zaro
I believe we are waiting for Mathieu Gagné re-review before approving.
___
OpenStack-dev mailing list
OpenStack-dev@lists.openstack.org
http://lists.openstack.org/cgi-bin/mailman/listinfo/openstack-dev


[openstack-dev] [savanna-dashboard] version 0.3 - updated UI mockups for EDP workflow

2013-09-09 Thread Chad Roberts
Updated UI mockups for savanna dashboard EDP.
https://wiki.openstack.org/wiki/Savanna/UIMockups/JobCreation

Regards,
Chad

___
OpenStack-dev mailing list
OpenStack-dev@lists.openstack.org
http://lists.openstack.org/cgi-bin/mailman/listinfo/openstack-dev


Re: [openstack-dev] [QA]Tempest CLI Compute-Manage

2013-09-09 Thread Joe Gordon
On Mon, Sep 9, 2013 at 10:48 AM, Martinez, Castulo 
castulo.marti...@intel.com wrote:



 Best Regards / Saludos!

 Castulo J. Martinez
 ISTQB Test Manager
 QA Engineer | Q1st team @GDC
 Intel | Security Engineering and Cloud Integration (SECI)
 Office: +52.33.2282.4083 | iNet: 8286-4083
  Before printing consider your Environmental Responsibility!


 -Original Message-
 From: Sean Dague [mailto:sda...@gmail.com] On Behalf Of Sean Dague
 Sent: Monday, September 09, 2013 10:43 AM
 To: Martinez, Castulo
 Subject: Re: Tempest CLI Compute-Manage

 Please post to the openstack-dev list with the [QA] tag

 On 09/09/2013 11:23 AM, Martinez, Castulo wrote:
  Hi Sean,
 
  I was looking at the Tempest tests and I have a doubt regarding the
  CLI compute-manage tests. I saw you are one of the main contributors
  of these, I hope you are the right person to ask you this, if not, I’d
  appreciate if you could point me to the right direction.
 
  When I run the test_compute_manage.py module most of the tests are
  failing in my environment, however doing some googling I ran into this
  page from the openStak wiki:
  https://wiki.openstack.org/wiki/NovaManage
 
  In one section of that page I found this comment: The nova-manage
  isn't properly documented, but it's going away in Folsom, so using
  this wiki page for quick docs on it. , and since Folsom was released
  in 2012, I guess the tests failing in Tempest would be a result of
  that nova-manage component not being in the openStack anymore, at
  least not functional anyway. But if this is the case, why are these
 tests still in Tempest?


Sadly that wiki page is incorrect, nova-manage is still around.

nova-manage doesn't use the REST APIs and must be run locally on a machine
with a valid nova.conf file.


 
  Thanks in advance for your help J
 
  Best Regards / Saludos!
 
  **
 
  *Castulo J. Martinez*
 
  *ISTQB Test Manager*
 
  QA Engineer | Q1st team @GDC
 
  Intel*|* Security Engineering and Cloud Integration (SECI)
 
  *Office:*+52.33.2282.4083 *| iNet:* 8286-4083
 
  PBefore printing consider your *Environmental Responsibility!*
 


 --
 Sean Dague
 http://dague.net
 ___
 OpenStack-dev mailing list
 OpenStack-dev@lists.openstack.org
 http://lists.openstack.org/cgi-bin/mailman/listinfo/openstack-dev

___
OpenStack-dev mailing list
OpenStack-dev@lists.openstack.org
http://lists.openstack.org/cgi-bin/mailman/listinfo/openstack-dev


Re: [openstack-dev] [Nova] FFE Request: Encrypt Cinder volumes

2013-09-09 Thread Jarret Raim


On 9/9/13 9:25 AM, Russell Bryant rbry...@redhat.com wrote:

On 09/09/2013 04:57 AM, Thierry Carrez wrote:
 Russell Bryant wrote:
 I would be good with the exception for this, assuming that:

 1) Those from nova-core that have reviewed the code are still happy
with
 it and would do a final review to get it merged.

 2) There is general consensus that the simple config based key manager
 (single key) does provide some amount of useful security.  I believe it
 does, just want to make sure we're in agreement on it.  Obviously we
 want to improve this in the future.
 
 +1
 
 I think this is sufficiently self-contained that the regression risk is
 extremely limited. It's also nice to have a significant hardening
 improvement in the Havana featurelist. I would just prefer if it landed
 ASAP since I would like as much usage around it as we can get, to make
 sure the previous audits didn't miss an obvious bug/security hole in it.
 

The response seems positive from everyone so far.  I think we should
approve this and try to get it merged ASAP (absolutely this week, and
hopefully in the first half of the week).

ACK on the FFE from me.


Me as well for what it's worth. While I understand the concerns around key
management, Barbican will have our 1.0 release for Havana and it should be
relatively easy to integrate the proposed patches with Barbican at that
time. Even so, the current version does offer some security and gives us
the ability to have the code tested before we introduce another moving
part.


Thanks,
Jarret Raim


___
OpenStack-dev mailing list
OpenStack-dev@lists.openstack.org
http://lists.openstack.org/cgi-bin/mailman/listinfo/openstack-dev


[openstack-dev] [TripleO] summit.openstack.org track label for TripleO - Deployment

2013-09-09 Thread Robert Collins
Thierry, is it possible to change this to 'Deployment' rather than
TripleO in the summit tool? I think it would avoid folk interested in
Tuskar failing to find a place to submit their proposals, and as a
program we are multi-project - Tomas and I have just discussed this in
the tripleo meeting slot and think it would be a good idea.

-Rob

-- 
Robert Collins rbtcoll...@hp.com
Distinguished Technologist
HP Converged Cloud

___
OpenStack-dev mailing list
OpenStack-dev@lists.openstack.org
http://lists.openstack.org/cgi-bin/mailman/listinfo/openstack-dev


Re: [openstack-dev] [tripleo] Scaling of TripleO

2013-09-09 Thread Robert Collins
On 10 September 2013 08:04, Mike Spreitzer mspre...@us.ibm.com wrote:


 My vision for TripleO/undercloud and scale in the long term is:
 - A fully redundant self-healing undercloud
   - (implies self hosting)
 ...

 Robert, what do you mean by self hosting?  If a cloud can self-host, why
 do we need two clouds (under and over)?

Running the baremetal scheduler and a regular scheduler is still not
pretty; the baremetal scheduler exact-matches on memory etc, vs a
subdividing scheduler which looks for 'fits in'. You can work around
this by running cells.

However, there is a very nice separation of concerns in having your
production cloud and your deployment cloud completely disconnected.
For instance, a configuration error is much less able to permit a
tenant of your production cloud deploying onto baremetal when they
shouldn't. Relatedly, being able to spin up multiple overclouds gives
you a great dev/CI story: test your overcloud by having a parallel
test overcloud sitting on the same undercloud substrate.

That said, I think it's feasible to support a single cloud for folk
that want it - and initially when we started this I wanted it, I just
no longer think that it's actually the ideal configuration :).

-Rob

-- 
Robert Collins rbtcoll...@hp.com
Distinguished Technologist
HP Converged Cloud

___
OpenStack-dev mailing list
OpenStack-dev@lists.openstack.org
http://lists.openstack.org/cgi-bin/mailman/listinfo/openstack-dev


Re: [openstack-dev] [tripleo] Scaling of TripleO

2013-09-09 Thread Mike Spreitzer
Robert Collins robe...@robertcollins.net wrote on 09/06/2013 05:31:14 
PM:

 From: Robert Collins robe...@robertcollins.net
 To: OpenStack Development Mailing List 
openstack-dev@lists.openstack.org, 
 Date: 09/06/2013 05:36 PM
 Subject: Re: [openstack-dev] [tripleo] Scaling of TripleO
 
 ...
 My vision for TripleO/undercloud and scale in the long term is:
 - A fully redundant self-healing undercloud
   - (implies self hosting)
...

Robert, what do you mean by self hosting?  If a cloud can self-host, why 
do we need two clouds (under and over)?

Thanks,
Mike___
OpenStack-dev mailing list
OpenStack-dev@lists.openstack.org
http://lists.openstack.org/cgi-bin/mailman/listinfo/openstack-dev


Re: [openstack-dev] [Nova] FFE Request: Encrypt Cinder volumes

2013-09-09 Thread John Griffith
On Mon, Sep 9, 2013 at 1:20 PM, Jarret Raim jarret.r...@rackspace.comwrote:



 On 9/9/13 9:25 AM, Russell Bryant rbry...@redhat.com wrote:

 On 09/09/2013 04:57 AM, Thierry Carrez wrote:
  Russell Bryant wrote:
  I would be good with the exception for this, assuming that:
 
  1) Those from nova-core that have reviewed the code are still happy
 with
  it and would do a final review to get it merged.
 
  2) There is general consensus that the simple config based key manager
  (single key) does provide some amount of useful security.  I believe it
  does, just want to make sure we're in agreement on it.  Obviously we
  want to improve this in the future.
 
  +1
 
  I think this is sufficiently self-contained that the regression risk is
  extremely limited. It's also nice to have a significant hardening
  improvement in the Havana featurelist. I would just prefer if it landed
  ASAP since I would like as much usage around it as we can get, to make
  sure the previous audits didn't miss an obvious bug/security hole in it.
 
 
 The response seems positive from everyone so far.  I think we should
 approve this and try to get it merged ASAP (absolutely this week, and
 hopefully in the first half of the week).
 
 ACK on the FFE from me.


 Me as well for what it's worth. While I understand the concerns around key
 management, Barbican will have our 1.0 release for Havana and it should be
 relatively easy to integrate the proposed patches with Barbican at that
 time. Even so, the current version does offer some security and gives us
 the ability to have the code tested before we introduce another moving
 part.


 Thanks,
 Jarret Raim


 ___
 OpenStack-dev mailing list
 OpenStack-dev@lists.openstack.org
 http://lists.openstack.org/cgi-bin/mailman/listinfo/openstack-dev


Fine on the Cinder side for the related components there.
___
OpenStack-dev mailing list
OpenStack-dev@lists.openstack.org
http://lists.openstack.org/cgi-bin/mailman/listinfo/openstack-dev


Re: [openstack-dev] [Neutron] Bug #1209011

2013-09-09 Thread Mark McClain
Carl-

Thanks for pointing this out.  I've fixed the bug status.

mark

On Sep 9, 2013, at 6:33 PM, Baldwin, Carl (HPCS Neutron) 
carl.bald...@hp.com wrote:

 Hi all,
 
 This bug was marked as fix released for H-3.  However, the fix that was
 merged was reverted due to gate breakage.  The patch was resubmitted as
 https://review.openstack.org/#/c/42412/ and fixes the gate breakage but
 this new patch has not been merged.  So, the bug state of Yix released
 is not accurate.
 
 This bug needs one of the following two actions:
 
 1) The new patch accepted and bug state changed to Fix Committed.
 1) Bug state reverted to In Progress.
 
 Thanks,
 Carl
 
 
 ___
 OpenStack-dev mailing list
 OpenStack-dev@lists.openstack.org
 http://lists.openstack.org/cgi-bin/mailman/listinfo/openstack-dev


___
OpenStack-dev mailing list
OpenStack-dev@lists.openstack.org
http://lists.openstack.org/cgi-bin/mailman/listinfo/openstack-dev


Re: [openstack-dev] [Trove] Modify source code for Postgres engine

2013-09-09 Thread Michael Basnight

On Sep 6, 2013, at 8:19 AM, Giuseppe Galeota wrote:

 Dear all,
 this is a technical question. I would try to modify the source code of Trove 
 in order to create databases instances using Postgres engine. I think that it 
 is necessary to modify the create method in the InstanceController class. 
 Is it right? What other things should I modify?

Hi Giuseppe,

When I proposed trove to be a openstack incubated project, i created a postgres 
work in progress. [1] It may help answer some of your questions. Many things 
have changed since then ( i think its been 3+ mo now), but it will show you 
where to start.

[1] https://review.openstack.org/#/c/28328/


signature.asc
Description: Message signed with OpenPGP using GPGMail
___
OpenStack-dev mailing list
OpenStack-dev@lists.openstack.org
http://lists.openstack.org/cgi-bin/mailman/listinfo/openstack-dev


[openstack-dev] [Neutron] Gate breakage for multi-process API patch.

2013-09-09 Thread Baldwin, Carl (HPCS Neutron)
Hi all,

https://review.openstack.org/#/c/37131/

This review has been consistently marked as fail for the last three patch
sets.  I'm scratching my head over how the failure is related to the
patch.  Can anyone lend some insight?  Is this a known failure that is not
caused by my patch or is this failure actually due to my patch?

The test breaking is test_008_check_public_network_connectivity.  I have
run the patch with the new api_workers config option set to 0, 1, 2, and 5
and I've been able to create instances that have full network connectivity
to my public network in each case.

Thanks,
Carl


___
OpenStack-dev mailing list
OpenStack-dev@lists.openstack.org
http://lists.openstack.org/cgi-bin/mailman/listinfo/openstack-dev


[openstack-dev] [Neutron] Bug #1209011

2013-09-09 Thread Baldwin, Carl (HPCS Neutron)
Hi all,

This bug was marked as fix released for H-3.  However, the fix that was
merged was reverted due to gate breakage.  The patch was resubmitted as
https://review.openstack.org/#/c/42412/ and fixes the gate breakage but
this new patch has not been merged.  So, the bug state of Yix released
is not accurate.

This bug needs one of the following two actions:

1) The new patch accepted and bug state changed to Fix Committed.
1) Bug state reverted to In Progress.

Thanks,
Carl


___
OpenStack-dev mailing list
OpenStack-dev@lists.openstack.org
http://lists.openstack.org/cgi-bin/mailman/listinfo/openstack-dev


Re: [openstack-dev] [Neutron] Gate breakage for multi-process API patch.

2013-09-09 Thread Davanum Srinivas
Carl,

if you check the rechecks page -
http://status.openstack.org/rechecks/you will see 18 other reviews
hitting the same bug reported at
https://bugs.launchpad.net/tempest/+bug/1197476.

So, in your review for https://review.openstack.org/#/c/37131/, add a
comment recheck bug 1197476 which will basically re-run the jenkins tests
and update the rechecks page with your review number.

See here for more info -
https://wiki.openstack.org/wiki/GerritJenkinsGit#Test_Failures

-- dims


On Mon, Sep 9, 2013 at 6:40 PM, Baldwin, Carl (HPCS Neutron) 
carl.bald...@hp.com wrote:

 Hi all,

 https://review.openstack.org/#/c/37131/

 This review has been consistently marked as fail for the last three patch
 sets.  I'm scratching my head over how the failure is related to the
 patch.  Can anyone lend some insight?  Is this a known failure that is not
 caused by my patch or is this failure actually due to my patch?

 The test breaking is test_008_check_public_network_connectivity.  I have
 run the patch with the new api_workers config option set to 0, 1, 2, and 5
 and I've been able to create instances that have full network connectivity
 to my public network in each case.

 Thanks,
 Carl


 ___
 OpenStack-dev mailing list
 OpenStack-dev@lists.openstack.org
 http://lists.openstack.org/cgi-bin/mailman/listinfo/openstack-dev




-- 
Davanum Srinivas :: http://davanum.wordpress.com
___
OpenStack-dev mailing list
OpenStack-dev@lists.openstack.org
http://lists.openstack.org/cgi-bin/mailman/listinfo/openstack-dev


Re: [openstack-dev] [Neutron] Gate breakage for multi-process API patch.

2013-09-09 Thread Baldwin, Carl (HPCS Neutron)
Thank you for that information.  I see that rechecks page referenced from the 
wiki now that you have mentioned it.  I have learned something.

Carl

Sent from my HTC

- Reply message -
From: Davanum Srinivas dava...@gmail.com
To: OpenStack Development Mailing List openstack-dev@lists.openstack.org
Subject: [openstack-dev] [Neutron] Gate breakage for multi-process API patch.
Date: Mon, Sep 9, 2013 5:49 PM

Carl,

if you check the rechecks page - http://status.openstack.org/rechecks/ you 
will see 18 other reviews hitting the same bug reported at 
https://bugs.launchpad.net/tempest/+bug/1197476.

So, in your review for https://review.openstack.org/#/c/37131/, add a comment 
recheck bug 1197476 which will basically re-run the jenkins tests and update 
the rechecks page with your review number.

See here for more info - 
https://wiki.openstack.org/wiki/GerritJenkinsGit#Test_Failures

-- dims


On Mon, Sep 9, 2013 at 6:40 PM, Baldwin, Carl (HPCS Neutron) 
carl.bald...@hp.commailto:carl.bald...@hp.com wrote:
Hi all,

https://review.openstack.org/#/c/37131/

This review has been consistently marked as fail for the last three patch
sets.  I'm scratching my head over how the failure is related to the
patch.  Can anyone lend some insight?  Is this a known failure that is not
caused by my patch or is this failure actually due to my patch?

The test breaking is test_008_check_public_network_connectivity.  I have
run the patch with the new api_workers config option set to 0, 1, 2, and 5
and I've been able to create instances that have full network connectivity
to my public network in each case.

Thanks,
Carl


___
OpenStack-dev mailing list
OpenStack-dev@lists.openstack.orgmailto:OpenStack-dev@lists.openstack.org
http://lists.openstack.org/cgi-bin/mailman/listinfo/openstack-dev



--
Davanum Srinivas :: http://davanum.wordpress.com

___
OpenStack-dev mailing list
OpenStack-dev@lists.openstack.org
http://lists.openstack.org/cgi-bin/mailman/listinfo/openstack-dev


Re: [openstack-dev] [nova] FFE Request: v3 setting v3 API core

2013-09-09 Thread Christopher Yeoh
On Tue, Sep 10, 2013 at 12:01 AM, Russell Bryant rbry...@redhat.com wrote:

 On 09/09/2013 07:38 AM, Thierry Carrez wrote:
  Christopher Yeoh wrote:
  The following 3 changesets in the queue:
  Agreed, that sounds like a useful pre-release cleanup.
  No objection from me, especially if this is ready to land.
 

 Ok, it's fine with me too, but hopefully it's the last set of v3 API
 cleanups for havana.


Thanks Russell. Everything else v3 api related (except for bug fixes/tests)
we'll defer
to Icehouse.

Regards,

Chris
___
OpenStack-dev mailing list
OpenStack-dev@lists.openstack.org
http://lists.openstack.org/cgi-bin/mailman/listinfo/openstack-dev


Re: [openstack-dev] OpenStack + PyPy: Status and goals

2013-09-09 Thread Roman Podolyaka
Hi Alex,

That's really cool! I believe, performance is not the only benefit we can
get from running OpenStack projects on PyPy. We  can also improve the
overall correctness of our code (as PyPy behaves differently with
non-closed files, etc), just like compiling of your C/C++ app using
different compilers can show hidden errors.

And what about eventlet? Does it work well on PyPy? (as it is used in Nova,
Neutron, etc)

Thanks,
Roman


On Tue, Sep 10, 2013 at 12:28 AM, Alex Gaynor alex.gay...@gmail.com wrote:

 Hi all,

 Many of you have probably seen me send review requests in the last few
 weeks
 about adding PyPy support to various OpenStack projects. A few people were
 confused by these, so I wanted to fill everyone in on what I'm up to :)

 First, for those who aren't familiar with what PyPy is: PyPy is an
 implementation of the Python language which includes a high performance
 tracing
 just-in-time compiler and which is faster than CPython (the reference, and
 most
 widely deployed, implementation) on almost all workloads.

 The current status is:

 Two major projects work, both Marconi and Swift, Marconi is gating against
 PyPy
 already, Swift isn't yet since I needed to fix a few small PyPy bugs and
 those
 aren't in a release yet, expect it soon :)

 In terms of results, I've observed 30% performance improvements on GET
 workloads for Swift under PyPy vs. CPython (other workloads haven't been
 benchmarked tet). I believe the Marconi folks have also observed some
 performance wins, but I'll let them speak to that, I don't have the full
 details.

 Many python-clients projects are also working out of the box and gating:
 including novaclient, swiftclient, marconiclient, ceilometerclient,
 heatclient,
 and ironicclient!

 There's a few outstanding reviews to add PyPy gating for cinderclient,
 troveclient, and glanceclient.

 In terms of future direction:

 I'm going to continue to work on getting more projects running and gating
 against PyPy.

 Right now I'm focusing a lot of my attention on improving Swift
 performance,
 particularly under PyPy, but also under CPython.

 I'm hoping some day PyPy will be the default way to deploy OpenStack!


 If you're interested in getting your project running on PyPy, or looking at
 performance under it, please let me know, I'm always interested in helping!

 Thanks,
 Alex

 --
 I disapprove of what you say, but I will defend to the death your right
 to say it. -- Evelyn Beatrice Hall (summarizing Voltaire)
 The people's good is the highest law. -- Cicero
 GPG Key fingerprint: 125F 5C67 DFE9 4084

 ___
 OpenStack-dev mailing list
 OpenStack-dev@lists.openstack.org
 http://lists.openstack.org/cgi-bin/mailman/listinfo/openstack-dev


___
OpenStack-dev mailing list
OpenStack-dev@lists.openstack.org
http://lists.openstack.org/cgi-bin/mailman/listinfo/openstack-dev