[
https://issues.apache.org/jira/browse/AMBARI-17573?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=15365170#comment-15365170
]
Hudson commented on AMBARI-17573:
---------------------------------
SUCCESS: Integrated in Ambari-trunk-Commit #5240 (See
[https://builds.apache.org/job/Ambari-trunk-Commit/5240/])
AMBARI-17573. Add atlas-application config sections to all services that
(afernandez:
[http://git-wip-us.apache.org/repos/asf?p=ambari.git&a=commit&h=eb05baed568bab4b0cf5f1b5e0bac0fff251a622])
*
ambari-server/src/main/resources/common-services/STORM/0.9.1/package/scripts/setup_atlas_storm.py
*
ambari-server/src/main/resources/common-services/SQOOP/1.4.4.2.0/package/scripts/sqoop.py
*
ambari-server/src/main/resources/common-services/HIVE/0.12.0.2.0/package/scripts/params_linux.py
*
ambari-server/src/main/resources/common-services/ATLAS/0.1.0.2.3/configuration/application-properties.xml
*
ambari-server/src/main/resources/stacks/HDP/2.5/services/ATLAS/configuration/application-properties.xml
* ambari-server/src/main/resources/common-services/HIVE/0.12.0.2.0/metainfo.xml
*
ambari-server/src/main/resources/common-services/HIVE/0.12.0.2.0/package/scripts/hcat.py
*
ambari-server/src/main/resources/common-services/STORM/0.9.1/package/scripts/params_linux.py
*
ambari-server/src/main/resources/common-services/SQOOP/1.4.4.2.0/package/scripts/params_linux.py
*
ambari-server/src/main/resources/common-services/HIVE/0.12.0.2.0/configuration/hive-atlas-application.properties.xml
* ambari-server/src/main/resources/common-services/STORM/1.0.1/metainfo.xml
*
ambari-common/src/main/python/resource_management/libraries/functions/setup_atlas_hook.py
* ambari-server/src/main/resources/common-services/SQOOP/1.4.4.2.0/metainfo.xml
*
ambari-server/src/main/resources/common-services/HIVE/0.12.0.2.0/package/scripts/webhcat.py
*
ambari-server/src/main/resources/common-services/HIVE/0.12.0.2.0/package/scripts/setup_atlas_hive.py
*
ambari-server/src/main/resources/common-services/STORM/0.9.1/package/scripts/storm.py
*
ambari-server/src/main/resources/common-services/FALCON/0.5.0.2.1/package/scripts/setup_atlas_falcon.py
*
ambari-server/src/main/resources/common-services/STORM/1.0.1/configuration/storm-atlas-application.properties.xml
*
ambari-server/src/main/resources/common-services/FALCON/0.5.0.2.1/package/scripts/params_linux.py
*
ambari-server/src/main/resources/common-services/SQOOP/1.4.4.2.0/package/scripts/setup_atlas_sqoop.py
*
ambari-server/src/main/resources/common-services/HIVE/0.12.0.2.0/package/scripts/hive.py
*
ambari-server/src/main/resources/common-services/FALCON/0.5.0.2.1/configuration/falcon-atlas-application.properties.xml
*
ambari-server/src/main/resources/common-services/FALCON/0.5.0.2.1/package/scripts/falcon.py
* ambari-server/src/main/resources/common-services/FALCON/0.5.0.2.1/metainfo.xml
> Add atlas-application config sections to all services that run Atlas hook,
> e.g., Hive, Falcon, Storm, Sqoop
> -----------------------------------------------------------------------------------------------------------
>
> Key: AMBARI-17573
> URL: https://issues.apache.org/jira/browse/AMBARI-17573
> Project: Ambari
> Issue Type: Story
> Components: stacks
> Affects Versions: 2.4.0
> Reporter: Alejandro Fernandez
> Assignee: Alejandro Fernandez
> Fix For: 2.4.0
>
> Attachments: AMBARI-17573.branch-2.4.additional.patch,
> AMBARI-17573.branch-2.4.patch, AMBARI-17573.trunk.additional.patch,
> AMBARI-17573.trunk.patch
>
>
> Currently, Atlas hooks that run in Hive, Falconm Storm, Sqoop processes
> reference atlas-application.properties file from Atlas server config location
> - /etc/atlas/conf/atlas-application.properties.
> Not all properties in /etc/atlas/conf/atlas-application.properties are
> required in hooks and some of these properties are sensitive enough not to
> expose them to hooks/clients.
> To address this concern:
> 1. atlas-application.properties should be added as a config section in each
> of the host component's that run Atlas hook - Hive, Storm, Falcon, Sqoop
> 2. These new config sections will only include properties that are required
> to the respective hooks
> 3. During initial deployment, Ambari will initialize these properties with
> values in Atlas server configuration.
> For each one of those services, create a config type called
> ${service}-atlas-application.properties that will be saved to
> /etc/${service}/conf/application.properties
> These are the default values,
> *Falcon*
> atlas.hook.falcon.synchronous=false
> atlas.hook.falcon.numRetries=3
> atlas.hook.falcon.minThreads=5
> atlas.hook.falcon.maxThreads=5
> atlas.hook.falcon.keepAliveTime=10
> atlas.hook.falcon.queueSize
> *Storm*
> atlas.hook.storm.numRetries=3
> *Hive*
> atlas.hook.hive.synchronous=false
> atlas.hook.hive.numRetries=3
> atlas.hook.hive.minThreads=5
> atlas.hook.hive.maxThreads=5
> atlas.hook.hive.keepAliveTime=10
> atlas.hook.hive.queueSize=10000
> *Common for all hooks*
> atlas.kafka.zookeeper.connect=
> atlas.kafka.bootstrap.servers=
> atlas.kafka.zookeeper.session.timeout.ms=400
> atlas.kafka.zookeeper.connection.timeout.ms=200
> atlas.kafka.zookeeper.sync.time.ms=20
> atlas.kafka.hook.group.id=atlas
> atlas.notification.create.topics=true
> atlas.notification.replicas=1
> atlas.notification.topics=ATLAS_HOOK,ATLAS_ENTITIES
> atlas.notification.kafka.service.principal=kafka/[email protected]
> atlas.notification.kafka.keytab.location=/etc/security/keytabs/kafka.service.keytab
> atlas.jaas.KafkaClient.loginModuleName =
> com.sun.security.auth.module.Krb5LoginModule
> atlas.jaas.KafkaClient.loginModuleControlFlag = required
> atlas.jaas.KafkaClient.option.useKeyTab = true
> atlas.jaas.KafkaClient.option.storeKey = true
> atlas.jaas.KafkaClient.option.serviceName = kafka
> atlas.jaas.KafkaClient.option.keyTab =
> /etc/security/keytabs/atlas.service.keytab
> atlas.jaas.KafkaClient.option.principal = atlas/[email protected]
> atlas.cluster.name=
--
This message was sent by Atlassian JIRA
(v6.3.4#6332)
