-----------------------------------------------------------
This is an automatically generated e-mail. To reply, visit:
https://reviews.apache.org/r/46493/
-----------------------------------------------------------

Review request for Ambari and Vitalyi Brodetskyi.


Bugs: AMBARI-16014
    https://issues.apache.org/jira/browse/AMBARI-16014


Repository: ambari


Description
-------

is_linux_container_executor = (yarn_nodemanager_container_executor_class == 
'org.apache.hadoop.yarn.server.nodemanager.LinuxContainerExecutor')
      File 
"/usr/lib/python2.6/site-packages/resource_management/libraries/script/config_dictionary.py",
 line 73, in __getattr__
        raise Fail("Configuration parameter '" + self.name + "' was not found 
in configurations dictionary!")
    Fail: Configuration parameter 'yarn-site' was not found in configurations 
dictionary!
    INFO 2016-04-21 12:14:21,327 PythonReflectiveExecutor.py:65 - Reflective 
command failed with exception:
    Traceback (most recent call last):
      File 
"/usr/lib/python2.6/site-packages/ambari_agent/PythonReflectiveExecutor.py", 
line 57, in run_file
        imp.load_source('__main__', script)
      File 
"/var/lib/ambari-agent/cache/common-services/YARN/2.1.0.2.0/package/scripts/application_timeline_server.py",
 line 149, in <module>
        ApplicationTimelineServer().execute()
      File 
"/usr/lib/python2.6/site-packages/resource_management/libraries/script/script.py",
 line 251, in execute
        self.save_component_version_to_structured_out()
      File 
"/usr/lib/python2.6/site-packages/resource_management/libraries/script/script.py",
 line 166, in save_component_version_to_structured_out
        component_name = self.get_component_name()
      File 
"/usr/lib/python2.6/site-packages/resource_management/libraries/script/script.py",
 line 152, in get_component_name
        stack_to_component = self.get_stack_to_component()
      File 
"/var/lib/ambari-agent/cache/common-services/YARN/2.1.0.2.0/package/scripts/application_timeline_server.py",
 line 67, in get_stack_to_component
        import params
      File 
"/var/lib/ambari-agent/cache/common-services/YARN/2.1.0.2.0/package/scripts/params.py",
 line 28, in <module>
        from params_linux import *
      File 
"/var/lib/ambari-agent/cache/common-services/YARN/2.1.0.2.0/package/scripts/params_linux.py",
 line 144, in <module>
        is_linux_container_executor = 
(yarn_nodemanager_container_executor_class == 
'org.apache.hadoop.yarn.server.nodemanager.LinuxContainerExecutor')
      File 
"/usr/lib/python2.6/site-packages/resource_management/libraries/script/config_dictionary.py",
 line 73, in __getattr__
        raise Fail("Configuration parameter '" + self.name + "' was not found 
in configurations dictionary!")
    Fail: Configuration parameter 'yarn-site' was not found in configurations 
dictionary!
    INFO 2016-04-21 12:14:21,390 PythonReflectiveExecutor.py:65 - Reflective 
command failed with exception:
    Traceback (most recent call last):
      File 
"/usr/lib/python2.6/site-packages/ambari_agent/PythonReflectiveExecutor.py", 
line 57, in run_file
        imp.load_source('__main__', script)
      File 
"/var/lib/ambari-agent/cache/common-services/YARN/2.1.0.2.0/package/scripts/resourcemanager.py",
 line 280, in <module>
        Resourcemanager().execute()
      File 
"/usr/lib/python2.6/site-packages/resource_management/libraries/script/script.py",
 line 251, in execute
        self.save_component_version_to_structured_out()
      File 
"/usr/lib/python2.6/site-packages/resource_management/libraries/script/script.py",
 line 166, in save_component_version_to_structured_out
        component_name = self.get_component_name()
      File 
"/usr/lib/python2.6/site-packages/resource_management/libraries/script/script.py",
 line 152, in get_component_name
        stack_to_component = self.get_stack_to_component()
      File 
"/var/lib/ambari-agent/cache/common-services/YARN/2.1.0.2.0/package/scripts/resourcemanager.py",
 line 102, in get_stack_to_component
        import params
      File 
"/var/lib/ambari-agent/cache/common-services/YARN/2.1.0.2.0/package/scripts/params.py",
 line 28, in <module>
        from params_linux import *
      File 
"/var/lib/ambari-agent/cache/common-services/YARN/2.1.0.2.0/package/scripts/params_linux.py",
 line 144, in <module>
        is_linux_container_executor = 
(yarn_nodemanager_container_executor_class == 
'org.apache.hadoop.yarn.server.nodemanager.LinuxContainerExecutor')
      File 
"/usr/lib/python2.6/site-packages/resource_management/libraries/script/config_dictionary.py",
 line 73, in __getattr__
        raise Fail("Configuration parameter '" + self.name + "' was not found 
in configurations dictionary!")
    Fail: Configuration parameter 'yarn-site' was not found in configurations 
dictionary!
    INFO 2016-04-21 12:14:21,429 PythonReflectiveExecutor.py:65 - Reflective 
command failed with exception:
    Traceback (most recent call last):
      File 
"/usr/lib/python2.6/site-packages/ambari_agent/PythonReflectiveExecutor.py", 
line 57, in run_file
        imp.load_source('__main__', script)
      File 
"/var/lib/ambari-agent/cache/common-services/ZOOKEEPER/3.4.5.2.0/package/scripts/zookeeper_server.py",
 line 182, in <module>
        ZookeeperServer().execute()
      File 
"/usr/lib/python2.6/site-packages/resource_management/libraries/script/script.py",
 line 251, in execute
        self.save_component_version_to_structured_out()
      File 
"/usr/lib/python2.6/site-packages/resource_management/libraries/script/script.py",
 line 166, in save_component_version_to_structured_out
        component_name = self.get_component_name()
      File 
"/usr/lib/python2.6/site-packages/resource_management/libraries/script/script.py",
 line 152, in get_component_name
        stack_to_component = self.get_stack_to_component()
      File 
"/var/lib/ambari-agent/cache/common-services/ZOOKEEPER/3.4.5.2.0/package/scripts/zookeeper_server.py",
 line 68, in get_stack_to_component
        import params
      File 
"/var/lib/ambari-agent/cache/common-services/ZOOKEEPER/3.4.5.2.0/package/scripts/params.py",
 line 26, in <module>
        from params_linux import *
    ...
    Traceback (most recent call last):
      File 
"/usr/lib/python2.6/site-packages/ambari_agent/PythonReflectiveExecutor.py", 
line 57, in run_file
        imp.load_source('__main__', script)
      File 
"/var/lib/ambari-agent/cache/common-services/HIVE/0.12.0.2.0/package/scripts/mysql_server.py",
 line 64, in <module>
        MysqlServer().execute()
      File 
"/usr/lib/python2.6/site-packages/resource_management/libraries/script/script.py",
 line 248, in execute
        method(env)
      File 
"/var/lib/ambari-agent/cache/common-services/HIVE/0.12.0.2.0/package/scripts/mysql_server.py",
 line 60, in status
        mysql_service(daemon_name=status_params.daemon_name, action='status')
      File 
"/var/lib/ambari-agent/cache/common-services/HIVE/0.12.0.2.0/package/scripts/mysql_service.py",
 line 29, in mysql_service
        Execute(status_cmd)
      File "/usr/lib/python2.6/site-packages/resource_management/core/base.py", 
line 155, in __init__
        self.env.run()
      File 
"/usr/lib/python2.6/site-packages/resource_management/core/environment.py", 
line 160, in run
        self.run_action(resource, action)
      File 
"/usr/lib/python2.6/site-packages/resource_management/core/environment.py", 
line 124, in run_action
        provider_action()
      File 
"/usr/lib/python2.6/site-packages/resource_management/core/providers/system.py",
 line 273, in action_run
        tries=self.resource.tries, try_sleep=self.resource.try_sleep)
      File 
"/usr/lib/python2.6/site-packages/resource_management/core/shell.py", line 70, 
in inner
        result = function(command, **kwargs)
      File 
"/usr/lib/python2.6/site-packages/resource_management/core/shell.py", line 92, 
in checked_call
        tries=tries, try_sleep=try_sleep)
      File 
"/usr/lib/python2.6/site-packages/resource_management/core/shell.py", line 140, 
in _call_wrapper
        result = _call(command, **kwargs_copy)
      File 
"/usr/lib/python2.6/site-packages/resource_management/core/shell.py", line 293, 
in _call
        raise Fail(err_msg)
    Fail: Execution of 'pgrep -l '^mysqld$'' returned 1.
    

This caused by importing params.py from status commands, and by unhandled
exception during for mysql status commands.


Diffs
-----

  
ambari-server/src/main/resources/common-services/ACCUMULO/1.6.1.2.2.0/package/scripts/accumulo_client.py
 ebfacf2 
  
ambari-server/src/main/resources/common-services/ACCUMULO/1.6.1.2.2.0/package/scripts/accumulo_script.py
 1004d23 
  
ambari-server/src/main/resources/common-services/ACCUMULO/1.6.1.2.2.0/package/scripts/params.py
 03debcc 
  
ambari-server/src/main/resources/common-services/ACCUMULO/1.6.1.2.2.0/package/scripts/status_params.py
 0b2ca6f 
  
ambari-server/src/main/resources/common-services/ATLAS/0.1.0.2.3/package/scripts/atlas_client.py
 14a12d3 
  
ambari-server/src/main/resources/common-services/ATLAS/0.1.0.2.3/package/scripts/metadata_server.py
 8103ec7 
  
ambari-server/src/main/resources/common-services/ATLAS/0.1.0.2.3/package/scripts/params.py
 24f9519 
  
ambari-server/src/main/resources/common-services/ATLAS/0.1.0.2.3/package/scripts/status_params.py
 b6b027e 
  
ambari-server/src/main/resources/common-services/FALCON/0.5.0.2.1/package/scripts/falcon_client.py
 75b5de4 
  
ambari-server/src/main/resources/common-services/FALCON/0.5.0.2.1/package/scripts/falcon_server.py
 86bf3b6 
  
ambari-server/src/main/resources/common-services/FALCON/0.5.0.2.1/package/scripts/params_linux.py
 77e18ff 
  
ambari-server/src/main/resources/common-services/FALCON/0.5.0.2.1/package/scripts/status_params.py
 33f1c7e 
  
ambari-server/src/main/resources/common-services/FLUME/1.4.0.2.0/package/scripts/flume_handler.py
 1bd99da 
  
ambari-server/src/main/resources/common-services/HBASE/0.96.0.2.0/package/scripts/hbase_client.py
 b72e648 
  
ambari-server/src/main/resources/common-services/HBASE/0.96.0.2.0/package/scripts/hbase_master.py
 5833773 
  
ambari-server/src/main/resources/common-services/HBASE/0.96.0.2.0/package/scripts/hbase_regionserver.py
 37dd0a1 
  
ambari-server/src/main/resources/common-services/HBASE/0.96.0.2.0/package/scripts/params_linux.py
 621feb6 
  
ambari-server/src/main/resources/common-services/HBASE/0.96.0.2.0/package/scripts/phoenix_queryserver.py
 7d639ec 
  
ambari-server/src/main/resources/common-services/HBASE/0.96.0.2.0/package/scripts/status_params.py
 8b60292 
  
ambari-server/src/main/resources/common-services/HDFS/2.1.0.2.0/package/scripts/datanode.py
 ffaf4ea 
  
ambari-server/src/main/resources/common-services/HDFS/2.1.0.2.0/package/scripts/hdfs_client.py
 9f62d29 
  
ambari-server/src/main/resources/common-services/HDFS/2.1.0.2.0/package/scripts/journalnode.py
 ac73eaf 
  
ambari-server/src/main/resources/common-services/HDFS/2.1.0.2.0/package/scripts/namenode.py
 c8acae3 
  
ambari-server/src/main/resources/common-services/HDFS/2.1.0.2.0/package/scripts/nfsgateway.py
 ca2e3ef 
  
ambari-server/src/main/resources/common-services/HDFS/2.1.0.2.0/package/scripts/params_linux.py
 ce31108 
  
ambari-server/src/main/resources/common-services/HDFS/2.1.0.2.0/package/scripts/snamenode.py
 4a6f144 
  
ambari-server/src/main/resources/common-services/HDFS/2.1.0.2.0/package/scripts/status_params.py
 cdb683b 
  
ambari-server/src/main/resources/common-services/HIVE/0.12.0.2.0/package/scripts/hcat_client.py
 6c41fc2 
  
ambari-server/src/main/resources/common-services/HIVE/0.12.0.2.0/package/scripts/hive_client.py
 6af0cd3 
  
ambari-server/src/main/resources/common-services/HIVE/0.12.0.2.0/package/scripts/hive_metastore.py
 319653e 
  
ambari-server/src/main/resources/common-services/HIVE/0.12.0.2.0/package/scripts/hive_server.py
 9ba8619 
  
ambari-server/src/main/resources/common-services/HIVE/0.12.0.2.0/package/scripts/hive_server_interactive.py
 8af82f0 
  
ambari-server/src/main/resources/common-services/HIVE/0.12.0.2.0/package/scripts/mysql_service.py
 c48c1ef 
  
ambari-server/src/main/resources/common-services/HIVE/0.12.0.2.0/package/scripts/params_linux.py
 122756a 
  
ambari-server/src/main/resources/common-services/HIVE/0.12.0.2.0/package/scripts/status_params.py
 75507a3 
  
ambari-server/src/main/resources/common-services/HIVE/0.12.0.2.0/package/scripts/webhcat_server.py
 482f0be 
  
ambari-server/src/main/resources/common-services/KAFKA/0.8.1.2.2/package/scripts/kafka_broker.py
 41074db 
  
ambari-server/src/main/resources/common-services/KNOX/0.5.0.2.2/package/scripts/knox_gateway.py
 aa5ce1f 
  
ambari-server/src/main/resources/common-services/KNOX/0.5.0.2.2/package/scripts/params_linux.py
 95ab801 
  
ambari-server/src/main/resources/common-services/KNOX/0.5.0.2.2/package/scripts/status_params.py
 b4e8831 
  
ambari-server/src/main/resources/common-services/MAHOUT/1.0.0.2.3/package/scripts/mahout_client.py
 d39b66a 
  
ambari-server/src/main/resources/common-services/OOZIE/4.0.0.2.0/package/scripts/oozie_client.py
 dc08f0b 
  
ambari-server/src/main/resources/common-services/OOZIE/4.0.0.2.0/package/scripts/oozie_server.py
 c7107c9 
  
ambari-server/src/main/resources/common-services/OOZIE/4.0.0.2.0/package/scripts/params_linux.py
 77dbc81 
  
ambari-server/src/main/resources/common-services/OOZIE/4.0.0.2.0/package/scripts/status_params.py
 5790c54 
  
ambari-server/src/main/resources/common-services/PIG/0.12.0.2.0/package/scripts/pig_client.py
 81db437 
  
ambari-server/src/main/resources/common-services/RANGER/0.4.0/package/scripts/params.py
 0a05173 
  
ambari-server/src/main/resources/common-services/RANGER/0.4.0/package/scripts/ranger_admin.py
 8e41c2c 
  
ambari-server/src/main/resources/common-services/RANGER/0.4.0/package/scripts/ranger_tagsync.py
 79316f9 
  
ambari-server/src/main/resources/common-services/RANGER/0.4.0/package/scripts/ranger_usersync.py
 675e798 
  
ambari-server/src/main/resources/common-services/RANGER/0.4.0/package/scripts/status_params.py
 251ca63 
  
ambari-server/src/main/resources/common-services/RANGER_KMS/0.5.0.2.3/package/scripts/kms_server.py
 d8822c1 
  
ambari-server/src/main/resources/common-services/SLIDER/0.60.0.2.2/package/scripts/slider_client.py
 af08a51 
  
ambari-server/src/main/resources/common-services/SPARK/1.2.0.2.2/package/scripts/job_history_server.py
 1041a75 
  
ambari-server/src/main/resources/common-services/SPARK/1.2.0.2.2/package/scripts/params.py
 a64f36f 
  
ambari-server/src/main/resources/common-services/SPARK/1.2.0.2.2/package/scripts/spark_client.py
 e2ec952 
  
ambari-server/src/main/resources/common-services/SPARK/1.2.0.2.2/package/scripts/spark_thrift_server.py
 3c32236 
  
ambari-server/src/main/resources/common-services/SPARK/1.2.0.2.2/package/scripts/status_params.py
 19c9a0e 
  
ambari-server/src/main/resources/common-services/SQOOP/1.4.4.2.0/package/scripts/service_check.py
 f4f0302 
  
ambari-server/src/main/resources/common-services/STORM/0.9.1.2.1/package/scripts/drpc_server.py
 1f88898 
  
ambari-server/src/main/resources/common-services/STORM/0.9.1.2.1/package/scripts/nimbus.py
 b700349 
  
ambari-server/src/main/resources/common-services/STORM/0.9.1.2.1/package/scripts/nimbus_prod.py
 1956120 
  
ambari-server/src/main/resources/common-services/STORM/0.9.1.2.1/package/scripts/params_linux.py
 0752b30 
  
ambari-server/src/main/resources/common-services/STORM/0.9.1.2.1/package/scripts/rest_api.py
 e080794 
  
ambari-server/src/main/resources/common-services/STORM/0.9.1.2.1/package/scripts/status_params.py
 34a1b42 
  
ambari-server/src/main/resources/common-services/STORM/0.9.1.2.1/package/scripts/supervisor.py
 bd9aade 
  
ambari-server/src/main/resources/common-services/STORM/0.9.1.2.1/package/scripts/supervisor_prod.py
 aa79ee3 
  
ambari-server/src/main/resources/common-services/STORM/0.9.1.2.1/package/scripts/ui_server.py
 c7a62d9 
  
ambari-server/src/main/resources/common-services/TEZ/0.4.0.2.1/package/scripts/tez_client.py
 ca13c6e 
  
ambari-server/src/main/resources/common-services/YARN/2.1.0.2.0/package/scripts/application_timeline_server.py
 fdb5be5 
  
ambari-server/src/main/resources/common-services/YARN/2.1.0.2.0/package/scripts/historyserver.py
 e9ee529 
  
ambari-server/src/main/resources/common-services/YARN/2.1.0.2.0/package/scripts/mapreduce2_client.py
 16f43dc 
  
ambari-server/src/main/resources/common-services/YARN/2.1.0.2.0/package/scripts/nodemanager.py
 dd6b130 
  
ambari-server/src/main/resources/common-services/YARN/2.1.0.2.0/package/scripts/params_linux.py
 6f0b620 
  
ambari-server/src/main/resources/common-services/YARN/2.1.0.2.0/package/scripts/resourcemanager.py
 141b11a 
  
ambari-server/src/main/resources/common-services/YARN/2.1.0.2.0/package/scripts/status_params.py
 e17a945 
  
ambari-server/src/main/resources/common-services/YARN/2.1.0.2.0/package/scripts/yarn_client.py
 1fdd9d6 
  
ambari-server/src/main/resources/common-services/ZOOKEEPER/3.4.5.2.0/package/scripts/params_linux.py
 711a24f 
  
ambari-server/src/main/resources/common-services/ZOOKEEPER/3.4.5.2.0/package/scripts/status_params.py
 569385d 
  
ambari-server/src/main/resources/common-services/ZOOKEEPER/3.4.5.2.0/package/scripts/zookeeper_client.py
 3043c45 
  
ambari-server/src/main/resources/common-services/ZOOKEEPER/3.4.5.2.0/package/scripts/zookeeper_server.py
 fee0e83 
  ambari-server/src/test/python/stacks/2.2/configs/ranger-usersync-upgrade.json 
8e886ce 

Diff: https://reviews.apache.org/r/46493/diff/


Testing
-------

mvn clean test


Thanks,

Andrew Onischuk

Reply via email to