-----------------------------------------------------------
This is an automatically generated e-mail. To reply, visit:
https://reviews.apache.org/r/30733/
-----------------------------------------------------------
(Updated Feb. 9, 2015, 1:32 p.m.)
Review request for Ambari, Jaimin Jetly and Yusaku Sako.
Changes
-------
Added AMBARI-9494-Support-Spark-installation-via-Ambari-ga.2.patch which
handles all fixes ( except the named imports )
Bugs: AMBARI-9494
https://issues.apache.org/jira/browse/AMBARI-9494
Repository: ambari
Description
-------
Add support for management for Spark using Ambari.
Support for following components are to be addressed :
1] Spark Client
2] Spark Job History Server
Diffs (updated)
-----
ambari-server/src/main/resources/common-services/SPARK/1.2.0.2.2/alerts.json
PRE-CREATION
ambari-server/src/main/resources/common-services/SPARK/1.2.0.2.2/configuration/spark-defaults.xml
PRE-CREATION
ambari-server/src/main/resources/common-services/SPARK/1.2.0.2.2/configuration/spark-env.xml
PRE-CREATION
ambari-server/src/main/resources/common-services/SPARK/1.2.0.2.2/configuration/spark-log4j-properties.xml
PRE-CREATION
ambari-server/src/main/resources/common-services/SPARK/1.2.0.2.2/configuration/spark-metrics-properties.xml
PRE-CREATION
ambari-server/src/main/resources/common-services/SPARK/1.2.0.2.2/metainfo.xml
PRE-CREATION
ambari-server/src/main/resources/common-services/SPARK/1.2.0.2.2/package/scripts/job_history_server.py
PRE-CREATION
ambari-server/src/main/resources/common-services/SPARK/1.2.0.2.2/package/scripts/params.py
PRE-CREATION
ambari-server/src/main/resources/common-services/SPARK/1.2.0.2.2/package/scripts/service_check.py
PRE-CREATION
ambari-server/src/main/resources/common-services/SPARK/1.2.0.2.2/package/scripts/setup_spark.py
PRE-CREATION
ambari-server/src/main/resources/common-services/SPARK/1.2.0.2.2/package/scripts/spark_client.py
PRE-CREATION
ambari-server/src/main/resources/common-services/SPARK/1.2.0.2.2/package/scripts/status_params.py
PRE-CREATION
ambari-server/src/main/resources/stacks/HDP/2.2/services/SPARK/metainfo.xml
PRE-CREATION
Diff: https://reviews.apache.org/r/30733/diff/
Testing
-------
Did the following testing:
1] Tested on RHEL6 single node cluster
2] Tested on RHEL6 multi-node cluster with Job history server on one node and
spark client on other nodes
3] Submitted a job using $PARK_HOME/bin/spark-submit and was able to see the
job on Spark History Server
Please note the TODO in params.py, hostLevelParams/stack_version is returning
2.2.0.0, even if the HDP version is 2.2.1.0-xxxx
Thanks,
Gautam Borad