-----------------------------------------------------------
This is an automatically generated e-mail. To reply, visit:
https://reviews.apache.org/r/31020/
-----------------------------------------------------------

Review request for Ambari, Alejandro Fernandez, Srimanth Gunturi, and Yusaku 
Sako.


Bugs: AMBARI-9572
    https://issues.apache.org/jira/browse/AMBARI-9572


Repository: ambari


Description
-------

Add the following enhancements to Spark component :
1] Fix service check ( currently it fails on a node where history server is not 
running )
2] Add dependency of HDFS/YARN client on Spark Client / Spark Job History Server
3] Check against hdp_stack_version of 2.2.0.0, since Ambari doesnt support 
reporting minor verions currently.
4] Add a new file javaopts which till take user input and if user does not 
provide -Dhdp version, silently append it.
5] Add dependency in role_command_order.json to run service check only when job 
history server is started


Diffs
-----

  
ambari-server/src/main/resources/common-services/SPARK/1.2.0.2.2/configuration/spark-javaopts-properties.xml
 PRE-CREATION 
  ambari-server/src/main/resources/common-services/SPARK/1.2.0.2.2/metainfo.xml 
68833e0 
  
ambari-server/src/main/resources/common-services/SPARK/1.2.0.2.2/package/scripts/job_history_server.py
 06389c7 
  
ambari-server/src/main/resources/common-services/SPARK/1.2.0.2.2/package/scripts/params.py
 8189039 
  
ambari-server/src/main/resources/common-services/SPARK/1.2.0.2.2/package/scripts/service_check.py
 8215c2b 
  
ambari-server/src/main/resources/common-services/SPARK/1.2.0.2.2/package/scripts/setup_spark.py
 128f031 
  
ambari-server/src/main/resources/common-services/SPARK/1.2.0.2.2/package/scripts/spark_client.py
 2391286 
  ambari-server/src/main/resources/stacks/HDP/2.2/role_command_order.json 
79eaf78 

Diff: https://reviews.apache.org/r/31020/diff/


Testing
-------

Tested on RHEL6 3 node cluster.
Submitted a job using spark-submit and checked the Job History Server for that 
job.


Thanks,

Gautam Borad

Reply via email to