-----------------------------------------------------------
This is an automatically generated e-mail. To reply, visit:
https://reviews.apache.org/r/31020/
-----------------------------------------------------------
Review request for Ambari, Alejandro Fernandez, Srimanth Gunturi, and Yusaku
Sako.
Bugs: AMBARI-9572
https://issues.apache.org/jira/browse/AMBARI-9572
Repository: ambari
Description
-------
Add the following enhancements to Spark component :
1] Fix service check ( currently it fails on a node where history server is not
running )
2] Add dependency of HDFS/YARN client on Spark Client / Spark Job History Server
3] Check against hdp_stack_version of 2.2.0.0, since Ambari doesnt support
reporting minor verions currently.
4] Add a new file javaopts which till take user input and if user does not
provide -Dhdp version, silently append it.
5] Add dependency in role_command_order.json to run service check only when job
history server is started
Diffs
-----
ambari-server/src/main/resources/common-services/SPARK/1.2.0.2.2/configuration/spark-javaopts-properties.xml
PRE-CREATION
ambari-server/src/main/resources/common-services/SPARK/1.2.0.2.2/metainfo.xml
68833e0
ambari-server/src/main/resources/common-services/SPARK/1.2.0.2.2/package/scripts/job_history_server.py
06389c7
ambari-server/src/main/resources/common-services/SPARK/1.2.0.2.2/package/scripts/params.py
8189039
ambari-server/src/main/resources/common-services/SPARK/1.2.0.2.2/package/scripts/service_check.py
8215c2b
ambari-server/src/main/resources/common-services/SPARK/1.2.0.2.2/package/scripts/setup_spark.py
128f031
ambari-server/src/main/resources/common-services/SPARK/1.2.0.2.2/package/scripts/spark_client.py
2391286
ambari-server/src/main/resources/stacks/HDP/2.2/role_command_order.json
79eaf78
Diff: https://reviews.apache.org/r/31020/diff/
Testing
-------
Tested on RHEL6 3 node cluster.
Submitted a job using spark-submit and checked the Job History Server for that
job.
Thanks,
Gautam Borad