[
https://issues.apache.org/jira/browse/AMBARI-19834?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=15936692#comment-15936692
]
Hudson commented on AMBARI-19834:
---------------------------------
FAILURE: Integrated in Jenkins build Ambari-trunk-Commit #7105 (See
[https://builds.apache.org/job/Ambari-trunk-Commit/7105/])
AMBARI-19834 HDP 3.0 support for Spark with configs, kerberos, widgets, (dsen:
[http://git-wip-us.apache.org/repos/asf?p=ambari.git&a=commit&h=1aba730c672ca6728e676ca259ca6ddfb1ac5ae3])
* (add)
ambari-server/src/main/resources/common-services/SPARK/2.2.0/configuration/spark-metrics-properties.xml
* (add) ambari-server/src/main/resources/common-services/SPARK/2.2.0/alerts.json
* (add)
ambari-server/src/main/resources/common-services/SPARK/2.2.0/scripts/service_check.py
* (add)
ambari-server/src/main/resources/common-services/SPARK/2.2.0/scripts/job_history_server.py
* (add)
ambari-server/src/main/resources/common-services/SPARK/2.2.0/configuration/livy-env.xml
* (add)
ambari-server/src/main/resources/common-services/SPARK/2.2.0/configuration/spark-logsearch-conf.xml
* (add)
ambari-server/src/main/resources/common-services/SPARK/2.2.0/scripts/spark_service.py
* (add)
ambari-server/src/main/resources/common-services/SPARK/2.2.0/scripts/livy_service.py
* (add)
ambari-server/src/main/resources/common-services/SPARK/2.2.0/kerberos.json
* (add)
ambari-server/src/main/resources/common-services/SPARK/2.2.0/metainfo.xml
* (add)
ambari-server/src/main/resources/common-services/SPARK/2.2.0/configuration/spark-env.xml
* (add)
ambari-server/src/main/resources/common-services/SPARK/2.2.0/quicklinks/quicklinks.json
* (add)
ambari-server/src/main/resources/common-services/SPARK/2.2.0/scripts/setup_livy.py
* (add)
ambari-server/src/main/resources/common-services/SPARK/2.2.0/configuration/spark-defaults.xml
* (add)
ambari-server/src/main/resources/common-services/SPARK/2.2.0/scripts/livy_server.py
* (add)
ambari-server/src/main/resources/common-services/SPARK/2.2.0/configuration/spark-thrift-sparkconf.xml
* (add)
ambari-server/src/main/resources/common-services/SPARK/2.2.0/scripts/params.py
* (add)
ambari-server/src/main/resources/common-services/SPARK/2.2.0/configuration/livy-log4j-properties.xml
* (add)
ambari-server/src/main/resources/common-services/SPARK/2.2.0/configuration/livy-conf.xml
* (add)
ambari-server/src/main/resources/common-services/SPARK/2.2.0/configuration/livy-spark-blacklist.xml
* (add)
ambari-server/src/main/resources/common-services/SPARK/2.2.0/scripts/spark_client.py
* (add)
ambari-server/src/main/resources/common-services/SPARK/2.2.0/scripts/setup_spark.py
* (add)
ambari-server/src/main/resources/common-services/SPARK/2.2.0/configuration/spark-thrift-fairscheduler.xml
* (add)
ambari-server/src/main/resources/common-services/SPARK/2.2.0/scripts/spark_thrift_server.py
* (add)
ambari-server/src/main/resources/common-services/SPARK/2.2.0/configuration/spark-log4j-properties.xml
* (add)
ambari-server/src/main/resources/common-services/SPARK/2.2.0/configuration/spark-hive-site-override.xml
* (add)
ambari-server/src/main/resources/stacks/HDP/3.0/services/SPARK/metainfo.xml
* (add)
ambari-server/src/main/resources/common-services/SPARK/2.2.0/scripts/status_params.py
> HDP 3.0 support for Spark with configs, kerberos, widgets, metrics,
> quicklinks, and themes
> ------------------------------------------------------------------------------------------
>
> Key: AMBARI-19834
> URL: https://issues.apache.org/jira/browse/AMBARI-19834
> Project: Ambari
> Issue Type: Story
> Components: stacks
> Affects Versions: 3.0.0
> Reporter: Alejandro Fernandez
> Assignee: Dmytro Sen
> Fix For: 3.0.0
>
> Attachments: AMBARI-19834_2.patch
>
>
> HDP 3.0 support for Spark with configs, kerberos, widgets, metrics,
> quicklinks, and themes
> Flatten from HDP 2.0.6 - 2.6 into common-services, and reference in HDP 3.0
> IMPORTANT: In HDP 3.0, Spark1 is being removed, and Spark2 is being rebranded
> as "Spark"
> In HDP 3.0, we have created a new stack definition that does not inherit from
> other stacks, in order to reduce the complexity of having to analyze older
> stacks.
> This means that we need to create a service definition (metainfo.xml,
> configs, kerberos, widgets, metrics, quicklinks, and themes) that is
> equivalent to what is inherit and deleted from all of the previous stacks.
> A merge needs to account for additions, overrides, and deletions.
> metainfo.xml and configs perform a merge of older versions
> kerberos.json always seems to override the previous file
> Because the bits for this service may not yet be available in the HDP 3.0
> repo,
> the task is to ensure that /api/v1/stacks/HDP/versions/2.6/services/SPARK2
> (which uses inheritance) is equivalent to the flattening of
> /api/v1/stacks/HDP/versions/3.0/services/SPARK .
> Please take a look at how this was done for ZK, HDFS, and YARN/MR.
> This means that you will not be able to actually install the service for now,
> but can still perform validation during the Install Wizard that the correct
> components and configs show up.
--
This message was sent by Atlassian JIRA
(v6.3.15#6346)