[
https://issues.apache.org/jira/browse/ATLAS-536?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
]
Shwetha G S updated ATLAS-536:
------------------------------
Summary: Falcon hook loads incorrect configuration when -Datlas.conf is not
given when falcon server startup (was: Falcon hook loads incorrect
configuration when -Datlas.conf is not given when falcon server startup. this
needs to be documented.)
> Falcon hook loads incorrect configuration when -Datlas.conf is not given when
> falcon server startup
> ---------------------------------------------------------------------------------------------------
>
> Key: ATLAS-536
> URL: https://issues.apache.org/jira/browse/ATLAS-536
> Project: Atlas
> Issue Type: Bug
> Affects Versions: trunk
> Reporter: Ayub Khan
> Assignee: Ayub Khan
> Priority: Critical
> Labels: patch
> Fix For: trunk
>
> Attachments: ATLAS-536-v4.patch,
> Adding_atlas_conf_path_to_falcon_server_opts-2.patch,
> Adding_atlas_conf_path_to_falcon_server_opts-3.patch,
> Adding_atlas_conf_path_to_falcon_server_opts-4.patch,
> Adding_atlas_conf_path_to_falcon_server_opts.patch
>
>
> Problem:
> Falcon server startup expects "-Datlas.conf=<path to atlas conf dir>" to read
> the atlas configuration file(application.properties), if this is not
> provided, then falcon hook tries to read the default values from the
> atlas-typesystem jar file.
> *Basically falcon hook depends on "atlas.rest.address" config option present
> in application.properties to post the entity create/update to atlas. But in
> the above the scenario, when "atlas.conf" option is not provided at falcon
> server startup, this will read the atlas.rest.address as localhost which is
> incorrect and all the subsequent falcon hook updates will fail.*
> This also needs to be documented.
> Falcon applicaiton log showing the conf file is read from jar file which has
> default values
> {noformat}
> 2016-02-25 08:29:13,131 INFO - [main:] ~ Initiated backend operations thread
> pool of size 2 (Backend:148)
> 2016-02-25 08:29:13,510 INFO - [main:] ~ Indexes already exist for graph
> (MetadataMappingService:143)
> 2016-02-25 08:29:13,510 INFO - [main:] ~ Initialized graph db:
> titangraph[berkeleyje:/grid/0/hadoop/falcon/data/lineage/graphdb]
> (MetadataMappingService:88)
> 2016-02-25 08:29:13,511 INFO - [main:] ~ Init vertex property keys: [name,
> type, version, timestamp] (MetadataMappingService:91)
> 2016-02-25 08:29:13,511 INFO - [main:] ~ Init edge property keys: [name]
> (MetadataMappingService:94)
> 2016-02-25 08:29:13,515 INFO - [main:] ~ Service initialized:
> org.apache.falcon.metadata.MetadataMappingService (ServiceInitializer:52)
> 2016-02-25 08:29:13,517 INFO - [main:] ~ Initializing service:
> org.apache.falcon.atlas.service.AtlasService (ServiceInitializer:45)
> 2016-02-25 08:29:13,522 INFO - [main:] ~ Loading application.properties from
> jar:file:/grid/0/hdp/2.3.99.0-196/falcon/webapp/falcon/WEB-INF/lib/atlas-typesystem-0.6.0.2.3.99.0-196.jar!/application.properties
> (ApplicationProperties:62)
> 2016-02-25 08:29:13,539 INFO - [main:] ~ Loading client.properties from
> file:/grid/0/hdp/2.3.99.0-196/falcon/webapp/falcon/WEB-INF/classes/client.properties
> (ApplicationProperties:62)
> 2016-02-25 08:29:13,914 INFO - [main:] ~ Real User: falcon (auth:SIMPLE), is
> from ticket cache? false (SecureClientUtils:90)
> 2016-02-25 08:29:13,915 INFO - [main:] ~ doAsUser: falcon
> (SecureClientUtils:93)
> 2016-02-25 08:29:14,780 INFO - [main:] ~ Created Atlas Hook for Falcon
> (FalconHook:144)
> 2016-02-25 08:29:14,780 INFO - [main:] ~ Service initialized:
> org.apache.falcon.atlas.service.AtlasService (ServiceInitializer:52)
> 2016-02-25 08:29:14,782 INFO - [main:] ~ FalconAuditFilter initialization
> started (FalconAuditFilter:49)
> 2016-02-25 08:29:14,785 INFO - [main:] ~ FalconAuthenticationFilter
> initialization started (FalconAuthenticationFilter:83)
> 2016-02-25 08:29:14,802 INFO - [main:] ~ Falcon is running with
> authorization enabled (FalconAuthorizationFilter:62)
> {noformat}
> Falcon application log showing conf file read from /etc/atlas/conf when
> -Datlas.conf is provided
> {noformat}
> 2016-02-25 11:36:52,605 INFO - [main:] ~ Initiated backend operations thread
> pool of size 2 (Backend:148)
> 2016-02-25 11:36:53,119 INFO - [main:] ~ Indexes already exist for graph
> (MetadataMappingService:143)
> 2016-02-25 11:36:53,120 INFO - [main:] ~ Initialized graph db:
> titangraph[berkeleyje:/grid/0/hadoop/falcon/data/lineage/graphdb]
> (MetadataMappingService:88)
> 2016-02-25 11:36:53,122 INFO - [main:] ~ Init vertex property keys: [name,
> type, version, timestamp] (MetadataMappingService:91)
> 2016-02-25 11:36:53,123 INFO - [main:] ~ Init edge property keys: [name]
> (MetadataMappingService:94)
> 2016-02-25 11:36:53,128 INFO - [main:] ~ Service initialized:
> org.apache.falcon.metadata.MetadataMappingService (ServiceInitializer:52)
> 2016-02-25 11:36:53,130 INFO - [main:] ~ Initializing service:
> org.apache.falcon.atlas.service.AtlasService (ServiceInitializer:45)
> 2016-02-25 11:36:53,135 INFO - [main:] ~ Loading application.properties from
> file:/etc/atlas/conf/application.properties (ApplicationProperties:62)
> 2016-02-25 11:36:53,163 INFO - [main:] ~ Loading client.properties from
> file:/etc/atlas/conf/client.properties (ApplicationProperties:62)
> 2016-02-25 11:36:53,396 INFO - [main:] ~ Real User: falcon (auth:SIMPLE), is
> from ticket cache? false (SecureClientUtils:90)
> 2016-02-25 11:36:53,396 INFO - [main:] ~ doAsUser: falcon
> (SecureClientUtils:93)
> 2016-02-25 11:36:54,178 INFO - [main:] ~ Created Atlas Hook for Falcon
> (FalconHook:144)
> 2016-02-25 11:36:54,178 INFO - [main:] ~ Service initialized:
> org.apache.falcon.atlas.service.AtlasService (ServiceInitializer:52)
> 2016-02-25 11:36:54,180 INFO - [main:] ~ FalconAuditFilter initialization
> started (FalconAuditFilter:49)
> 2016-02-25 11:36:54,184 INFO - [main:] ~ FalconAuthenticationFilter
> initialization started (FalconAuthenticationFilter:83)
> 2016-02-25 11:36:54,214 INFO - [main:] ~ Falcon is running with
> authorization enabled (FalconAuthorizationFilter:62)
> 2016-02-25 11:36:55,389 INFO - [main:] ~ Started
> SocketConnector@0.0.0.0:15000 (log:67)
> {noformat}
--
This message was sent by Atlassian JIRA
(v6.3.4#6332)
