> On Feb. 6, 2015, 6:36 p.m., Alejandro Fernandez wrote: > > ambari-server/src/main/resources/common-services/SPARK/1.2.0.2.2/configuration/spark-defaults.xml, > > line 69 > > <https://reviews.apache.org/r/30733/diff/1/?file=852169#file852169line69> > > > > May as well remove this property.
Will fix. > On Feb. 6, 2015, 6:36 p.m., Alejandro Fernandez wrote: > > ambari-server/src/main/resources/common-services/SPARK/1.2.0.2.2/package/scripts/job_history_server.py, > > line 32 > > <https://reviews.apache.org/r/30733/diff/1/?file=852174#file852174line32> > > > > From RU perspective, this looks good. We will need hdp-select to > > support the "spark" component. hdp-select supports 'spark-client' and 'spark-historyserver' currently. > On Feb. 6, 2015, 6:36 p.m., Alejandro Fernandez wrote: > > ambari-server/src/main/resources/common-services/SPARK/1.2.0.2.2/package/scripts/job_history_server.py, > > line 63 > > <https://reviews.apache.org/r/30733/diff/1/?file=852174#file852174line63> > > > > Remove all of the unnecessary "pass" calls Will fix. - Gautam ----------------------------------------------------------- This is an automatically generated e-mail. To reply, visit: https://reviews.apache.org/r/30733/#review71464 ----------------------------------------------------------- On Feb. 9, 2015, 1:32 p.m., Gautam Borad wrote: > > ----------------------------------------------------------- > This is an automatically generated e-mail. To reply, visit: > https://reviews.apache.org/r/30733/ > ----------------------------------------------------------- > > (Updated Feb. 9, 2015, 1:32 p.m.) > > > Review request for Ambari, Jaimin Jetly and Yusaku Sako. > > > Bugs: AMBARI-9494 > https://issues.apache.org/jira/browse/AMBARI-9494 > > > Repository: ambari > > > Description > ------- > > Add support for management for Spark using Ambari. > Support for following components are to be addressed : > 1] Spark Client > 2] Spark Job History Server > > > Diffs > ----- > > > ambari-server/src/main/resources/common-services/SPARK/1.2.0.2.2/alerts.json > PRE-CREATION > > ambari-server/src/main/resources/common-services/SPARK/1.2.0.2.2/configuration/spark-defaults.xml > PRE-CREATION > > ambari-server/src/main/resources/common-services/SPARK/1.2.0.2.2/configuration/spark-env.xml > PRE-CREATION > > ambari-server/src/main/resources/common-services/SPARK/1.2.0.2.2/configuration/spark-log4j-properties.xml > PRE-CREATION > > ambari-server/src/main/resources/common-services/SPARK/1.2.0.2.2/configuration/spark-metrics-properties.xml > PRE-CREATION > > ambari-server/src/main/resources/common-services/SPARK/1.2.0.2.2/metainfo.xml > PRE-CREATION > > ambari-server/src/main/resources/common-services/SPARK/1.2.0.2.2/package/scripts/job_history_server.py > PRE-CREATION > > ambari-server/src/main/resources/common-services/SPARK/1.2.0.2.2/package/scripts/params.py > PRE-CREATION > > ambari-server/src/main/resources/common-services/SPARK/1.2.0.2.2/package/scripts/service_check.py > PRE-CREATION > > ambari-server/src/main/resources/common-services/SPARK/1.2.0.2.2/package/scripts/setup_spark.py > PRE-CREATION > > ambari-server/src/main/resources/common-services/SPARK/1.2.0.2.2/package/scripts/spark_client.py > PRE-CREATION > > ambari-server/src/main/resources/common-services/SPARK/1.2.0.2.2/package/scripts/status_params.py > PRE-CREATION > ambari-server/src/main/resources/stacks/HDP/2.2/services/SPARK/metainfo.xml > PRE-CREATION > > Diff: https://reviews.apache.org/r/30733/diff/ > > > Testing > ------- > > Did the following testing: > > 1] Tested on RHEL6 single node cluster > 2] Tested on RHEL6 multi-node cluster with Job history server on one node and > spark client on other nodes > 3] Submitted a job using $PARK_HOME/bin/spark-submit and was able to see the > job on Spark History Server > > Please note the TODO in params.py, hostLevelParams/stack_version is returning > 2.2.0.0, even if the HDP version is 2.2.1.0-xxxx > > > Thanks, > > Gautam Borad > >
