-----------------------------------------------------------
This is an automatically generated e-mail. To reply, visit:
https://reviews.apache.org/r/30733/
-----------------------------------------------------------

(Updated Feb. 9, 2015, 1:32 p.m.)


Review request for Ambari, Jaimin Jetly and Yusaku Sako.


Changes
-------

Added AMBARI-9494-Support-Spark-installation-via-Ambari-ga.2.patch which 
handles all fixes ( except the named imports )


Bugs: AMBARI-9494
    https://issues.apache.org/jira/browse/AMBARI-9494


Repository: ambari


Description
-------

Add support for management for Spark using Ambari.
Support for following components are to be addressed :
1] Spark Client
2] Spark Job History Server


Diffs (updated)
-----

  ambari-server/src/main/resources/common-services/SPARK/1.2.0.2.2/alerts.json 
PRE-CREATION 
  
ambari-server/src/main/resources/common-services/SPARK/1.2.0.2.2/configuration/spark-defaults.xml
 PRE-CREATION 
  
ambari-server/src/main/resources/common-services/SPARK/1.2.0.2.2/configuration/spark-env.xml
 PRE-CREATION 
  
ambari-server/src/main/resources/common-services/SPARK/1.2.0.2.2/configuration/spark-log4j-properties.xml
 PRE-CREATION 
  
ambari-server/src/main/resources/common-services/SPARK/1.2.0.2.2/configuration/spark-metrics-properties.xml
 PRE-CREATION 
  ambari-server/src/main/resources/common-services/SPARK/1.2.0.2.2/metainfo.xml 
PRE-CREATION 
  
ambari-server/src/main/resources/common-services/SPARK/1.2.0.2.2/package/scripts/job_history_server.py
 PRE-CREATION 
  
ambari-server/src/main/resources/common-services/SPARK/1.2.0.2.2/package/scripts/params.py
 PRE-CREATION 
  
ambari-server/src/main/resources/common-services/SPARK/1.2.0.2.2/package/scripts/service_check.py
 PRE-CREATION 
  
ambari-server/src/main/resources/common-services/SPARK/1.2.0.2.2/package/scripts/setup_spark.py
 PRE-CREATION 
  
ambari-server/src/main/resources/common-services/SPARK/1.2.0.2.2/package/scripts/spark_client.py
 PRE-CREATION 
  
ambari-server/src/main/resources/common-services/SPARK/1.2.0.2.2/package/scripts/status_params.py
 PRE-CREATION 
  ambari-server/src/main/resources/stacks/HDP/2.2/services/SPARK/metainfo.xml 
PRE-CREATION 

Diff: https://reviews.apache.org/r/30733/diff/


Testing
-------

Did the following testing:

1] Tested on RHEL6 single node cluster 
2] Tested on RHEL6 multi-node cluster with Job history server on one node and 
spark client on other nodes
3] Submitted a job using $PARK_HOME/bin/spark-submit and was able to see the 
job on Spark History Server

Please note the TODO in params.py, hostLevelParams/stack_version is returning 
2.2.0.0, even if the HDP version is 2.2.1.0-xxxx


Thanks,

Gautam Borad

Reply via email to