-----------------------------------------------------------
This is an automatically generated e-mail. To reply, visit:
https://reviews.apache.org/r/58911/
-----------------------------------------------------------
Review request for Ambari, Sumit Mohanty, Swapan Shridhar, Sid Wagle, and
Vitalyi Brodetskyi.
Bugs: AMBARI-20910
https://issues.apache.org/jira/browse/AMBARI-20910
Repository: ambari
Description
-------
STR:
* Install Ambari 3.0 (last build was 650)
* Install HDP 3.0 (last build is 197) with ZK, HDFS, YARN. Note: will fail on
RM and Service Checks.
* Because Hive is not yet compiling, temporarily comment out Hive as a required
service for Spark, and HIVE_METASTORE as a required co-hosted component.
/var/lib/ambari-server/resources/common-services/SPARK/2.2.0/metainfo.xml
* Restart Ambari Server
* Attempt to add Spark as a service.
Error:
```
Caught an exception while executing custom service command: <type
'exceptions.KeyError'>: 'service_package_folder'; 'service_package_folder'
```
This is coming from CustomServiceOrchestrator.py
```
except Exception, e: # We do not want to let agent fail completely
exc_type, exc_obj, exc_tb = sys.exc_info()
message = "Caught an exception while executing "\
"custom service command: {0}: {1}; {2}".format(exc_type, exc_obj,
str(e))
logger.exception(message)
```
Looks like Spark 2.2.0 doesn't have the package/scripts directory.
Diffs
-----
ambari-server/src/main/resources/common-services/SPARK/2.2.0/package/scripts/job_history_server.py
PRE-CREATION
ambari-server/src/main/resources/common-services/SPARK/2.2.0/package/scripts/livy_server.py
PRE-CREATION
ambari-server/src/main/resources/common-services/SPARK/2.2.0/package/scripts/livy_service.py
PRE-CREATION
ambari-server/src/main/resources/common-services/SPARK/2.2.0/package/scripts/params.py
PRE-CREATION
ambari-server/src/main/resources/common-services/SPARK/2.2.0/package/scripts/service_check.py
PRE-CREATION
ambari-server/src/main/resources/common-services/SPARK/2.2.0/package/scripts/setup_livy.py
PRE-CREATION
ambari-server/src/main/resources/common-services/SPARK/2.2.0/package/scripts/setup_spark.py
PRE-CREATION
ambari-server/src/main/resources/common-services/SPARK/2.2.0/package/scripts/spark_client.py
PRE-CREATION
ambari-server/src/main/resources/common-services/SPARK/2.2.0/package/scripts/spark_service.py
PRE-CREATION
ambari-server/src/main/resources/common-services/SPARK/2.2.0/package/scripts/spark_thrift_server.py
PRE-CREATION
ambari-server/src/main/resources/common-services/SPARK/2.2.0/package/scripts/status_params.py
PRE-CREATION
ambari-server/src/main/resources/common-services/SPARK/2.2.0/scripts/job_history_server.py
3937c88
ambari-server/src/main/resources/common-services/SPARK/2.2.0/scripts/livy_server.py
269c97d
ambari-server/src/main/resources/common-services/SPARK/2.2.0/scripts/livy_service.py
45201db
ambari-server/src/main/resources/common-services/SPARK/2.2.0/scripts/params.py
e60cab5
ambari-server/src/main/resources/common-services/SPARK/2.2.0/scripts/service_check.py
518c624
ambari-server/src/main/resources/common-services/SPARK/2.2.0/scripts/setup_livy.py
adaca87
ambari-server/src/main/resources/common-services/SPARK/2.2.0/scripts/setup_spark.py
9329ce0
ambari-server/src/main/resources/common-services/SPARK/2.2.0/scripts/spark_client.py
3acde4e
ambari-server/src/main/resources/common-services/SPARK/2.2.0/scripts/spark_service.py
536d798
ambari-server/src/main/resources/common-services/SPARK/2.2.0/scripts/spark_thrift_server.py
8953b35
ambari-server/src/main/resources/common-services/SPARK/2.2.0/scripts/status_params.py
07dcc47
Diff: https://reviews.apache.org/r/58911/diff/1/
Testing
-------
mvn clean test. Verified on a live cluster.
Thanks,
Alejandro Fernandez
