Re: [openstack-dev] [savanna] How to handle diverging EDP job configuration settings

2014-01-29 Thread Alexander Ignatov
Thank you for bringing this up, Trevor. EDP gets more diverse and it's time to change its model. I totally agree with your proposal, but one minor comment. Instead of savanna. prefix in job_configs wouldn't it be better to make it as edp.? I think savanna. is too more wide word for this. And one

Re: [openstack-dev] [savanna] How to handle diverging EDP job configuration settings

2014-01-29 Thread Trevor McKay
On Wed, 2014-01-29 at 14:35 +0400, Alexander Ignatov wrote: Thank you for bringing this up, Trevor. EDP gets more diverse and it's time to change its model. I totally agree with your proposal, but one minor comment. Instead of savanna. prefix in job_configs wouldn't it be better to make it

Re: [openstack-dev] [savanna] How to handle diverging EDP job configuration settings

2014-01-29 Thread Trevor McKay
So, assuming we go forward with this, the followup question is whether or not to move main_class and java_opts for Java actions into edp.java.main_class and edp.java.java_opts configs. I think yes. Best, Trevor On Wed, 2014-01-29 at 09:15 -0500, Trevor McKay wrote: On Wed, 2014-01-29 at 14:35

Re: [openstack-dev] [savanna] How to handle diverging EDP job configuration settings

2014-01-29 Thread Jon Maron
I imagine ‘neutron’ would follow suit as well.. On Jan 29, 2014, at 9:23 AM, Trevor McKay tmc...@redhat.com wrote: So, assuming we go forward with this, the followup question is whether or not to move main_class and java_opts for Java actions into edp.java.main_class and edp.java.java_opts

Re: [openstack-dev] [savanna] How to handle diverging EDP job configuration settings

2014-01-29 Thread Sergey Lukjanov
Trevor, it sounds reasonable to move main_class and java_opts to edp.java. Jon, does you mean neutron-related info for namespaces support? If yes than neutron isn't the user-side config. Thanks. On Wed, Jan 29, 2014 at 6:37 PM, Jon Maron jma...@hortonworks.com wrote: I imagine 'neutron'

Re: [openstack-dev] [savanna] How to handle diverging EDP job configuration settings

2014-01-29 Thread Andrew Lazarev
I like idea of edp. prefix. Andrew. On Wed, Jan 29, 2014 at 6:23 AM, Trevor McKay tmc...@redhat.com wrote: So, assuming we go forward with this, the followup question is whether or not to move main_class and java_opts for Java actions into edp.java.main_class and edp.java.java_opts configs.

[openstack-dev] [savanna] How to handle diverging EDP job configuration settings

2014-01-28 Thread Trevor McKay
Hello all, In our first pass at EDP, the model for job settings was very consistent across all of our job types. The execution-time settings fit into this (superset) structure: job_configs = {'configs': {}, # config settings for oozie and hadoop 'params': {}, # substitution