Re: [openstack-dev] [savanna] How to handle diverging EDP job configuration settings

2014-01-29 Thread Jon Maron
I imagine ‘neutron’ would follow suit as well.. On Jan 29, 2014, at 9:23 AM, Trevor McKay wrote: > So, assuming we go forward with this, the followup question is whether > or not to move "main_class" and "java_opts" for Java actions into > "edp.java.main_class" and "edp.java.java_opts" configs.

[openstack-dev] [savanna] neutron floating IP assignment unexpected

2013-12-03 Thread Jon Maron
Hi, I have the following configuration in savanna.conf: # If set to True, Savanna will use floating IPs to communicate # with instances. To make sure that all instances have # floating IPs assigned in Nova Network set # "auto_assign_floating_ip=True" in nova.conf.If Neutron is # used for networ

Re: [openstack-dev] [Savanna] Definition of template

2013-11-18 Thread Jon Maron
I'd like to suggest that we take a step back and identify the actual requirement(s) we're trying address, independent of the actual implementation (current or otherwise). Once that requirement is clearly stated, we can think of viable approaches and then, lastly, how the current architecture ca

Re: [openstack-dev] [savanna] Loading of savanna.conf properties

2013-11-10 Thread Jon Maron
t: >> SWIFT_CONFIG = swift_helper.get_swift_configs() >> The oslo.config is not initialized at module load time (that is true for >> any module), so that is why you see the defaults instead of the supplied >> values. >> >> Still, if you share the code, so

Re: [openstack-dev] [savanna] Loading of savanna.conf properties

2013-11-10 Thread Jon Maron
- Jon On Nov 10, 2013, at 3:53 AM, Dmitry Mescheryakov wrote: > Hey Jon, > > Can you post your code as a work in progress review? Maybe we can perceive > from the code what is wrong. > > Thanks, > > Dmitry > > > 2013/11/10 Jon Maron > Hi, >

[openstack-dev] [savanna] Loading of savanna.conf properties

2013-11-09 Thread Jon Maron
Hi, I am debugging an issue with the swift integration - I see os_auth_url with a value of 127.0.0.1, indicating that at the time the swift helper is invoked the default value for auth host is being leveraged rather than the value in the savanna.conf file. Any ideas how that may happen? Mor

Re: [openstack-dev] [savanna] using keystone client

2013-10-08 Thread Jon Maron
On Oct 7, 2013, at 10:02 PM, Dolph Mathews wrote: > > On Mon, Oct 7, 2013 at 5:57 PM, Jon Maron wrote: > Hi, > > I'm trying to use the keystone client code in savanna/utils/openstack but > my attempt to sue it yield: > > 'Api v2.0 endpoint not found

[openstack-dev] [savanna] using keystone client

2013-10-07 Thread Jon Maron
Hi, I'm trying to use the keystone client code in savanna/utils/openstack but my attempt to sue it yield: 'Api v2.0 endpoint not found in service identity' An code sample: from savanna.utils.openstack import keystone . . . service_id = next((service.id for service in

Re: [openstack-dev] [savanna] neutron and private networks

2013-10-03 Thread Jon Maron
On Oct 3, 2013, at 11:42 AM, Matthew Farrellee wrote: > On 10/03/2013 11:21 AM, Jon Maron wrote: >> Hi, >> >> I'd like to raise an issue in the hopes of opening some discussion on >> the IRC chat later today: >> >> We see a critical requirement to

[openstack-dev] [savanna] neutron and private networks

2013-10-03 Thread Jon Maron
Hi, I'd like to raise an issue in the hopes of opening some discussion on the IRC chat later today: We see a critical requirement to support the creation of a savanna cluster with neutron networking while leveraging a private network (i.e. without the assignment of public IPs) - at least

[openstack-dev] [savanna] multi-tenant support

2013-10-02 Thread Jon Maron
Hi, A couple of questions related to multi-tenancy: 1) Does savanna currently support multiple concurrent cluster creation requests from multiple users/tenants? 2) What is the significance of the admin credentials in savanna.conf? Is there support for multiple tenants via the savanna

[openstack-dev] [savanna] unit test failures/errors

2013-09-25 Thread Jon Maron
Hi, I can't seem to get a clean run from the py27 unit tests. On the surface it doesn't seem that my current commit has anything to do with the code paths tested. I've tried rebuilding my virtual env as well as rebasing but the issue hasn't been resolved. I've also clones the repository in

[openstack-dev] [savanna] swift integration - optional?

2013-09-11 Thread Jon Maron
Hi, I noticed that the swift integration is optionally enabled via a configuration property? Is there a reason for not making it available as a base, feature of the cluster (i.e. simply allowing access to swift should it be required)? What would be a scenario in which it would be beneficial

Re: [openstack-dev] [savanna] Program name and Mission statement

2013-09-11 Thread Jon Maron
On Sep 10, 2013, at 9:42 PM, Mike Spreitzer wrote: > Jon Maron wrote on 09/10/2013 08:50:23 PM: > > > From: Jon Maron > > To: OpenStack Development Mailing List , > > Cc: OpenStack Development Mailing List > > Date: 09/10/2013 08:55 PM > > Subject: R

Re: [openstack-dev] [savanna] Program name and Mission statement

2013-09-10 Thread Jon Maron
Openstack Big Data Platform On Sep 10, 2013, at 8:39 PM, David Scott wrote: > I vote for 'Open Stack Data' > > > On Tue, Sep 10, 2013 at 5:30 PM, Zhongyue Luo wrote: >> Why not "OpenStack MapReduce"? I think that pretty much says it all? >> >> >> On Wed, Sep 11, 2013 at 3:54 AM, Glen Campb

Re: [openstack-dev] [savanna] cluster scaling on the 0.2 branch

2013-09-03 Thread Jon Maron
, 2013, at 3:47 PM, Jon Maron wrote: > I've done some additional debugging/testing, and the issue is definitely in > the savanna provisioning code. > > I have verified that the correct inputs are provided to the validate_scaling > method invocation, and that those references re

Re: [openstack-dev] [savanna] cluster scaling on the 0.2 branch

2013-08-30 Thread Jon Maron
=u'9935bf76-d08b-4cdd-ad20-bbcb2ea5666f', > instance_id=u'67092d96-9808-4830-be4a-9f7f54e04b58', > instance_name=u'np-oozie-old-0.2-worker-datanode-002', > internal_ip=u'10.155.0.110', management_ip=u'172.18.79.254', volumes=[]}>] > &g

Re: [openstack-dev] [savanna] cluster scaling on the 0.2 branch

2013-08-29 Thread Jon Maron
9, 25, 751723), > updated=datetime.datetime(2013, 8, 29, 12, 11, 45, 614467), extra=None, > node_group_id=u'9935bf76-d08b-4cdd-ad20-bbcb2ea5666f', > instance_id=u'67092d96-9808-4830-be4a-9f7f54e04b58', > instance_name=u'np-oozie-old-0.2-worker-datanode-002', >

[openstack-dev] [savanna] cluster scaling on the 0.2 branch

2013-08-28 Thread Jon Maron
Hi, I am trying to back port the HDP scaling implementation to the 0.2 branch and have run into a number of differences. At this point I am trying to figure out whether what I am observing is intended or symptoms of a bug. For a case in which I am adding one instance to an existing node gr