Re: Application configuration page is outdated?

2014-11-18 Thread Sumit Mohanty 
Is it possible for you to share the application package? I can browse
through it to see what needs to change.

On Tue, Nov 18, 2014 at 1:48 PM, hsy...@gmail.com hsy...@gmail.com wrote:

 Hi guys,

 I just switch from 40 to 60 and I found the application configuration
 doesn't work any more.

 http://slider.incubator.apache.org/docs/slider_specs/application_instance_configuration.html

 For example :

 {
   schema : http://example.org/specification/v2.0.0;,
   metadata : {
   },
   global : {
   config_types: core-site,hdfs-site,hbase-site,

   java_home: /usr/jdk64/jdk1.7.0_45,
   package_list: files/hbase-0.96.1-hadoop2-bin.tar,
   create.default.zookeeper.node: true

   site.global.app_user: yarn,
   site.global.app_log_dir: ${AGENT_LOG_ROOT}/app/log,
   site.global.app_pid_dir: ${AGENT_WORK_ROOT}/app/run,
   site.global.security_enabled: false,

   site.hbase-site.hbase.hstore.flush.retries.number: 120,
   site.hbase-site.hbase.client.keyvalue.maxsize: 10485760,
   site.hbase-site.hbase.hstore.compactionThreshold: 3,
   site.hbase-site.hbase.rootdir: ${NN_URI}/apps/hbase/data,
   site.hbase-site.hbase.tmp.dir: ${AGENT_WORK_ROOT}/work/app/tmp,
   site.hbase-site.hbase.master.info.port:
 ${HBASE_MASTER.ALLOCATED_PORT},
   site.hbase-site.hbase.regionserver.port: 0,
   site.hbase-site.zookeeper.znode.parent: ${DEF_ZK_PATH},

   site.core-site.fs.defaultFS: ${NN_URI},
   site.hdfs-site.dfs.namenode.https-address: ${NN_HOST}:50470,
   site.hdfs-site.dfs.namenode.http-address: ${NN_HOST}:50070
   }
 }


 I can't get config_types in agent python script anymore. Only global
 properties are set and caught



 Thanks!


-- 
CONFIDENTIALITY NOTICE
NOTICE: This message is intended for the use of the individual or entity to 
which it is addressed and may contain information that is confidential, 
privileged and exempt from disclosure under applicable law. If the reader 
of this message is not the intended recipient, you are hereby notified that 
any printing, copying, dissemination, distribution, disclosure or 
forwarding of this communication is strictly prohibited. If you have 
received this communication in error, please contact the sender immediately 
and delete it from your system. Thank You.

Re: Application configuration page is outdated?

2014-11-18 Thread Sumit Mohanty 
Sharing the metainfo.xml, appConfig.json, and resources.json should be
enough.

-Sumit

On Tue, Nov 18, 2014 at 2:00 PM, Sumit Mohanty smoha...@hortonworks.com
wrote:

 Is it possible for you to share the application package? I can browse
 through it to see what needs to change.

 On Tue, Nov 18, 2014 at 1:48 PM, hsy...@gmail.com hsy...@gmail.com
 wrote:

 Hi guys,

 I just switch from 40 to 60 and I found the application configuration
 doesn't work any more.

 http://slider.incubator.apache.org/docs/slider_specs/application_instance_configuration.html

 For example :

 {
   schema : http://example.org/specification/v2.0.0;,
   metadata : {
   },
   global : {
   config_types: core-site,hdfs-site,hbase-site,

   java_home: /usr/jdk64/jdk1.7.0_45,
   package_list: files/hbase-0.96.1-hadoop2-bin.tar,
   create.default.zookeeper.node: true

   site.global.app_user: yarn,
   site.global.app_log_dir: ${AGENT_LOG_ROOT}/app/log,
   site.global.app_pid_dir: ${AGENT_WORK_ROOT}/app/run,
   site.global.security_enabled: false,

   site.hbase-site.hbase.hstore.flush.retries.number: 120,
   site.hbase-site.hbase.client.keyvalue.maxsize: 10485760,
   site.hbase-site.hbase.hstore.compactionThreshold: 3,
   site.hbase-site.hbase.rootdir: ${NN_URI}/apps/hbase/data,
   site.hbase-site.hbase.tmp.dir: ${AGENT_WORK_ROOT}/work/app/tmp,
   site.hbase-site.hbase.master.info.port:
 ${HBASE_MASTER.ALLOCATED_PORT},
   site.hbase-site.hbase.regionserver.port: 0,
   site.hbase-site.zookeeper.znode.parent: ${DEF_ZK_PATH},

   site.core-site.fs.defaultFS: ${NN_URI},
   site.hdfs-site.dfs.namenode.https-address: ${NN_HOST}:50470,
   site.hdfs-site.dfs.namenode.http-address: ${NN_HOST}:50070
   }
 }


 I can't get config_types in agent python script anymore. Only global
 properties are set and caught



 Thanks!




-- 
CONFIDENTIALITY NOTICE
NOTICE: This message is intended for the use of the individual or entity to 
which it is addressed and may contain information that is confidential, 
privileged and exempt from disclosure under applicable law. If the reader 
of this message is not the intended recipient, you are hereby notified that 
any printing, copying, dissemination, distribution, disclosure or 
forwarding of this communication is strictly prohibited. If you have 
received this communication in error, please contact the sender immediately 
and delete it from your system. Thank You.

Re: Application configuration page is outdated?

2014-11-18 Thread hsy...@gmail.com 
I just figure out:

config_types is changed to system_configs

Or you can have configFile in metainfo.xml and create configuration
folder with xml or env configuration files in it


On Tue, Nov 18, 2014 at 2:04 PM, Sumit Mohanty smoha...@hortonworks.com
wrote:

 Sharing the metainfo.xml, appConfig.json, and resources.json should be
 enough.

 -Sumit

 On Tue, Nov 18, 2014 at 2:00 PM, Sumit Mohanty smoha...@hortonworks.com
 wrote:

  Is it possible for you to share the application package? I can browse
  through it to see what needs to change.
 
  On Tue, Nov 18, 2014 at 1:48 PM, hsy...@gmail.com hsy...@gmail.com
  wrote:
 
  Hi guys,
 
  I just switch from 40 to 60 and I found the application configuration
  doesn't work any more.
 
 
 http://slider.incubator.apache.org/docs/slider_specs/application_instance_configuration.html
 
  For example :
 
  {
schema : http://example.org/specification/v2.0.0;,
metadata : {
},
global : {
config_types: core-site,hdfs-site,hbase-site,
 
java_home: /usr/jdk64/jdk1.7.0_45,
package_list: files/hbase-0.96.1-hadoop2-bin.tar,
create.default.zookeeper.node: true
 
site.global.app_user: yarn,
site.global.app_log_dir: ${AGENT_LOG_ROOT}/app/log,
site.global.app_pid_dir: ${AGENT_WORK_ROOT}/app/run,
site.global.security_enabled: false,
 
site.hbase-site.hbase.hstore.flush.retries.number: 120,
site.hbase-site.hbase.client.keyvalue.maxsize: 10485760,
site.hbase-site.hbase.hstore.compactionThreshold: 3,
site.hbase-site.hbase.rootdir: ${NN_URI}/apps/hbase/data,
site.hbase-site.hbase.tmp.dir:
 ${AGENT_WORK_ROOT}/work/app/tmp,
site.hbase-site.hbase.master.info.port:
  ${HBASE_MASTER.ALLOCATED_PORT},
site.hbase-site.hbase.regionserver.port: 0,
site.hbase-site.zookeeper.znode.parent: ${DEF_ZK_PATH},
 
site.core-site.fs.defaultFS: ${NN_URI},
site.hdfs-site.dfs.namenode.https-address: ${NN_HOST}:50470,
site.hdfs-site.dfs.namenode.http-address: ${NN_HOST}:50070
}
  }
 
 
  I can't get config_types in agent python script anymore. Only global
  properties are set and caught
 
 
 
  Thanks!
 
 
 

 --
 CONFIDENTIALITY NOTICE
 NOTICE: This message is intended for the use of the individual or entity to
 which it is addressed and may contain information that is confidential,
 privileged and exempt from disclosure under applicable law. If the reader
 of this message is not the intended recipient, you are hereby notified that
 any printing, copying, dissemination, distribution, disclosure or
 forwarding of this communication is strictly prohibited. If you have
 received this communication in error, please contact the sender immediately
 and delete it from your system. Thank You.

Re: Application configuration page is outdated?

2014-11-18 Thread Gour Saha 
Given you moved to 0.60 it would be a good idea to start with the default
file in this branch - ./app-packages/hbase/appConfig-default.json

The site documentation is getting updated as we speak.

-Gour

On Tue, Nov 18, 2014 at 2:14 PM, hsy...@gmail.com hsy...@gmail.com wrote:

 I just figure out:

 config_types is changed to system_configs

 Or you can have configFile in metainfo.xml and create configuration
 folder with xml or env configuration files in it


 On Tue, Nov 18, 2014 at 2:04 PM, Sumit Mohanty smoha...@hortonworks.com
 wrote:

  Sharing the metainfo.xml, appConfig.json, and resources.json should be
  enough.
 
  -Sumit
 
  On Tue, Nov 18, 2014 at 2:00 PM, Sumit Mohanty smoha...@hortonworks.com
 
  wrote:
 
   Is it possible for you to share the application package? I can browse
   through it to see what needs to change.
  
   On Tue, Nov 18, 2014 at 1:48 PM, hsy...@gmail.com hsy...@gmail.com
   wrote:
  
   Hi guys,
  
   I just switch from 40 to 60 and I found the application configuration
   doesn't work any more.
  
  
 
 http://slider.incubator.apache.org/docs/slider_specs/application_instance_configuration.html
  
   For example :
  
   {
 schema : http://example.org/specification/v2.0.0;,
 metadata : {
 },
 global : {
 config_types: core-site,hdfs-site,hbase-site,
  
 java_home: /usr/jdk64/jdk1.7.0_45,
 package_list: files/hbase-0.96.1-hadoop2-bin.tar,
 create.default.zookeeper.node: true
  
 site.global.app_user: yarn,
 site.global.app_log_dir: ${AGENT_LOG_ROOT}/app/log,
 site.global.app_pid_dir: ${AGENT_WORK_ROOT}/app/run,
 site.global.security_enabled: false,
  
 site.hbase-site.hbase.hstore.flush.retries.number: 120,
 site.hbase-site.hbase.client.keyvalue.maxsize: 10485760,
 site.hbase-site.hbase.hstore.compactionThreshold: 3,
 site.hbase-site.hbase.rootdir: ${NN_URI}/apps/hbase/data,
 site.hbase-site.hbase.tmp.dir:
  ${AGENT_WORK_ROOT}/work/app/tmp,
 site.hbase-site.hbase.master.info.port:
   ${HBASE_MASTER.ALLOCATED_PORT},
 site.hbase-site.hbase.regionserver.port: 0,
 site.hbase-site.zookeeper.znode.parent: ${DEF_ZK_PATH},
  
 site.core-site.fs.defaultFS: ${NN_URI},
 site.hdfs-site.dfs.namenode.https-address: ${NN_HOST}:50470,
 site.hdfs-site.dfs.namenode.http-address: ${NN_HOST}:50070
 }
   }
  
  
   I can't get config_types in agent python script anymore. Only global
   properties are set and caught
  
  
  
   Thanks!
  
  
  
 
  --
  CONFIDENTIALITY NOTICE
  NOTICE: This message is intended for the use of the individual or entity
 to
  which it is addressed and may contain information that is confidential,
  privileged and exempt from disclosure under applicable law. If the reader
  of this message is not the intended recipient, you are hereby notified
 that
  any printing, copying, dissemination, distribution, disclosure or
  forwarding of this communication is strictly prohibited. If you have
  received this communication in error, please contact the sender
 immediately
  and delete it from your system. Thank You.
 


-- 
CONFIDENTIALITY NOTICE
NOTICE: This message is intended for the use of the individual or entity to 
which it is addressed and may contain information that is confidential, 
privileged and exempt from disclosure under applicable law. If the reader 
of this message is not the intended recipient, you are hereby notified that 
any printing, copying, dissemination, distribution, disclosure or 
forwarding of this communication is strictly prohibited. If you have 
received this communication in error, please contact the sender immediately 
and delete it from your system. Thank You.