----------------------------------------------------------- This is an automatically generated e-mail. To reply, visit: https://reviews.apache.org/r/58911/#review173652 -----------------------------------------------------------
Ship it! Ship It! - Sid Wagle On May 2, 2017, 2:28 a.m., Alejandro Fernandez wrote: > > ----------------------------------------------------------- > This is an automatically generated e-mail. To reply, visit: > https://reviews.apache.org/r/58911/ > ----------------------------------------------------------- > > (Updated May 2, 2017, 2:28 a.m.) > > > Review request for Ambari, Sumit Mohanty, Swapan Shridhar, Sid Wagle, and > Vitalyi Brodetskyi. > > > Bugs: AMBARI-20910 > https://issues.apache.org/jira/browse/AMBARI-20910 > > > Repository: ambari > > > Description > ------- > > STR: > * Install Ambari 3.0 (last build was 650) > * Install HDP 3.0 (last build is 197) with ZK, HDFS, YARN. Note: will fail on > RM and Service Checks. > * Because Hive is not yet compiling, temporarily comment out Hive as a > required service for Spark, and HIVE_METASTORE as a required co-hosted > component. > /var/lib/ambari-server/resources/common-services/SPARK/2.2.0/metainfo.xml > * Restart Ambari Server > * Attempt to add Spark as a service. > > Error: > ``` > Caught an exception while executing custom service command: <type > 'exceptions.KeyError'>: 'service_package_folder'; 'service_package_folder' > ``` > > This is coming from CustomServiceOrchestrator.py > ``` > except Exception, e: # We do not want to let agent fail completely > exc_type, exc_obj, exc_tb = sys.exc_info() > message = "Caught an exception while executing "\ > "custom service command: {0}: {1}; {2}".format(exc_type, exc_obj, > str(e)) > logger.exception(message) > ``` > > Looks like Spark 2.2.0 doesn't have the package/scripts directory. > > > Diffs > ----- > > > ambari-server/src/main/resources/common-services/SPARK/2.2.0/package/scripts/job_history_server.py > PRE-CREATION > > ambari-server/src/main/resources/common-services/SPARK/2.2.0/package/scripts/livy_server.py > PRE-CREATION > > ambari-server/src/main/resources/common-services/SPARK/2.2.0/package/scripts/livy_service.py > PRE-CREATION > > ambari-server/src/main/resources/common-services/SPARK/2.2.0/package/scripts/params.py > PRE-CREATION > > ambari-server/src/main/resources/common-services/SPARK/2.2.0/package/scripts/service_check.py > PRE-CREATION > > ambari-server/src/main/resources/common-services/SPARK/2.2.0/package/scripts/setup_livy.py > PRE-CREATION > > ambari-server/src/main/resources/common-services/SPARK/2.2.0/package/scripts/setup_spark.py > PRE-CREATION > > ambari-server/src/main/resources/common-services/SPARK/2.2.0/package/scripts/spark_client.py > PRE-CREATION > > ambari-server/src/main/resources/common-services/SPARK/2.2.0/package/scripts/spark_service.py > PRE-CREATION > > ambari-server/src/main/resources/common-services/SPARK/2.2.0/package/scripts/spark_thrift_server.py > PRE-CREATION > > ambari-server/src/main/resources/common-services/SPARK/2.2.0/package/scripts/status_params.py > PRE-CREATION > > ambari-server/src/main/resources/common-services/SPARK/2.2.0/scripts/job_history_server.py > 3937c88 > > ambari-server/src/main/resources/common-services/SPARK/2.2.0/scripts/livy_server.py > 269c97d > > ambari-server/src/main/resources/common-services/SPARK/2.2.0/scripts/livy_service.py > 45201db > > ambari-server/src/main/resources/common-services/SPARK/2.2.0/scripts/params.py > e60cab5 > > ambari-server/src/main/resources/common-services/SPARK/2.2.0/scripts/service_check.py > 518c624 > > ambari-server/src/main/resources/common-services/SPARK/2.2.0/scripts/setup_livy.py > adaca87 > > ambari-server/src/main/resources/common-services/SPARK/2.2.0/scripts/setup_spark.py > 9329ce0 > > ambari-server/src/main/resources/common-services/SPARK/2.2.0/scripts/spark_client.py > 3acde4e > > ambari-server/src/main/resources/common-services/SPARK/2.2.0/scripts/spark_service.py > 536d798 > > ambari-server/src/main/resources/common-services/SPARK/2.2.0/scripts/spark_thrift_server.py > 8953b35 > > ambari-server/src/main/resources/common-services/SPARK/2.2.0/scripts/status_params.py > 07dcc47 > > > Diff: https://reviews.apache.org/r/58911/diff/1/ > > > Testing > ------- > > mvn clean test. Verified on a live cluster. > > > Thanks, > > Alejandro Fernandez > >
