[ https://issues.apache.org/jira/browse/ATLAS-1045?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=15601086#comment-15601086 ]
Qiang Zhang commented on ATLAS-1045: ------------------------------------ Hi Ayub Khan, as you error describe :Unable to fetch table sample_view_1 i have test it in lastest code in https://github.com/apache/incubator-atlas and find it test well or can you tell me more about you test enviorment such as have you install Solr or Elasticsearch correctly , what you hive table stoted file directory and besure you have install Hive metastore and thrift have configure well. > HiveHook fails to post metadata for "Create view" with "Relative path in > absolute URI: NULL::character%20varying" exception > --------------------------------------------------------------------------------------------------------------------------- > > Key: ATLAS-1045 > URL: https://issues.apache.org/jira/browse/ATLAS-1045 > Project: Atlas > Issue Type: Bug > Affects Versions: trunk, 0.7-incubating > Reporter: Ayub Khan > Assignee: Qiang Zhang > Priority: Critical > > *Impact: No metadata for "create view" on atlas.* > Steps to repro: > {noformat} > * create table sample (abc String); > * create view sample_view_1 (url COMMENT 'URL of Referring page') AS SELECT > * from sample; > {noformat} > Hiveserver2.log snapshot > {noformat} > 2016-07-23 17:28:24,371 INFO [HiveServer2-Background-Pool: Thread-9870]: > hooks.ATSHook (ATSHook.java:<init>(90)) - Created ATS Hook > 2016-07-23 17:28:24,371 INFO [HiveServer2-Background-Pool: Thread-9870]: > log.PerfLogger (PerfLogger.java:PerfLogBegin(148)) - <PERFLOG > method=PostHook.org.apache.hadoop.hive.ql.hooks.ATSHook > from=org.apache.hadoop.hive.ql.Driver> > 2016-07-23 17:28:24,371 INFO [HiveServer2-Background-Pool: Thread-9870]: > log.PerfLogger (PerfLogger.java:PerfLogEnd(176)) - </PERFLOG > method=PostHook.org.apache.hadoop.hive.ql.hooks.ATSHook start=1469294904371 > end=1469294904371 duration=0 from=org.apache.hadoop.hive.ql.Driver> > 2016-07-23 17:28:24,372 INFO [HiveServer2-Background-Pool: Thread-9870]: > log.PerfLogger (PerfLogger.java:PerfLogBegin(148)) - <PERFLOG > method=PostHook.org.apache.atlas.hive.hook.HiveHook > from=org.apache.hadoop.hive.ql.Driver> > 2016-07-23 17:28:24,372 INFO [HiveServer2-Background-Pool: Thread-9870]: > log.PerfLogger (PerfLogger.java:PerfLogEnd(176)) - </PERFLOG > method=PostHook.org.apache.atlas.hive.hook.HiveHook start=1469294904372 > end=1469294904372 duration=0 from=org.apache.hadoop.hive.ql.Driver> > 2016-07-23 17:28:24,372 INFO [HiveServer2-Background-Pool: Thread-9870]: > ql.Driver (Driver.java:execute(1635)) - Resetting the caller context to > HIVE_SSN_ID:8cc6511f-5454-431b-aa2f-d7a1c11159a7 > 2016-07-23 17:28:24,373 INFO [HiveServer2-Background-Pool: Thread-9870]: > log.PerfLogger (PerfLogger.java:PerfLogEnd(176)) - </PERFLOG > method=Driver.execute start=1469294904326 end=1469294904373 duration=47 > from=org.apache.hadoop.hive.ql.Driver> > 2016-07-23 17:28:24,373 INFO [HiveServer2-Background-Pool: Thread-9870]: > ql.Driver (SessionState.java:printInfo(939)) - OK > 2016-07-23 17:28:24,373 INFO [HiveServer2-Background-Pool: Thread-9870]: > log.PerfLogger (PerfLogger.java:PerfLogBegin(148)) - <PERFLOG > method=releaseLocks from=org.apache.hadoop.hive.ql.Driver> > 2016-07-23 17:28:24,373 INFO [HiveServer2-Background-Pool: Thread-9870]: > log.PerfLogger (PerfLogger.java:PerfLogEnd(176)) - </PERFLOG > method=releaseLocks start=1469294904373 end=1469294904373 duration=0 > from=org.apache.hadoop.hive.ql.Driver> > 2016-07-23 17:28:24,373 INFO [HiveServer2-Background-Pool: Thread-9870]: > log.PerfLogger (PerfLogger.java:PerfLogEnd(176)) - </PERFLOG > method=Driver.run start=1469294904233 end=1469294904373 duration=140 > from=org.apache.hadoop.hive.ql.Driver> > 2016-07-23 17:28:24,373 INFO [Atlas Logger 1]: hook.HiveHook > (HiveHook.java:fireAndForget(202)) - Entered Atlas hook for hook type > POST_EXEC_HOOK operation CREATEVIEW > 2016-07-23 17:28:24,374 INFO [Atlas Logger 1]: metastore.HiveMetaStore > (HiveMetaStore.java:logInfo(822)) - 6: get_database: default > 2016-07-23 17:28:24,374 INFO [Atlas Logger 1]: HiveMetaStore.audit > (HiveMetaStore.java:logAuditEvent(391)) - > ugi=hive/nat-s11-4-kuls-atlas-1.openstacklo...@hwqe.hortonworks.com > ip=unknown-ip-addr cmd=get_database: default > 2016-07-23 17:28:24,380 INFO [Atlas Logger 1]: metastore.HiveMetaStore > (HiveMetaStore.java:logInfo(822)) - 6: get_database: default > 2016-07-23 17:28:24,380 INFO [Atlas Logger 1]: HiveMetaStore.audit > (HiveMetaStore.java:logAuditEvent(391)) - > ugi=hive/nat-s11-4-kuls-atlas-1.openstacklo...@hwqe.hortonworks.com > ip=unknown-ip-addr cmd=get_database: default > 2016-07-23 17:28:24,385 INFO [Atlas Logger 1]: bridge.HiveMetaStoreBridge > (HiveMetaStoreBridge.java:createOrUpdateDBInstance(161)) - Importing objects > from databaseName : default > 2016-07-23 17:28:24,385 INFO [Atlas Logger 1]: metastore.HiveMetaStore > (HiveMetaStore.java:logInfo(822)) - 6: get_table : db=default tbl=sample > 2016-07-23 17:28:24,385 INFO [Atlas Logger 1]: HiveMetaStore.audit > (HiveMetaStore.java:logAuditEvent(391)) - > ugi=hive/nat-s11-4-kuls-atlas-1.openstacklo...@hwqe.hortonworks.com > ip=unknown-ip-addr cmd=get_table : db=default tbl=sample > 2016-07-23 17:28:24,387 INFO [HiveServer2-HttpHandler-Pool: Thread-62]: > session.HiveSessionImpl (HiveSessionImpl.java:acquireAfterOpLock(332)) - We > are setting the hadoop caller context to 8cc6511f-5454-431b-aa2f-d7a1c11159a7 > for thread HiveServer2-HttpHandler-Pool: Thread-62 > 2016-07-23 17:28:24,387 INFO [HiveServer2-HttpHandler-Pool: Thread-62]: > session.HiveSessionImpl (HiveSessionImpl.java:releaseBeforeOpLock(356)) - We > are resetting the hadoop caller context for thread > HiveServer2-HttpHandler-Pool: Thread-62 > 2016-07-23 17:28:24,392 INFO [HiveServer2-HttpHandler-Pool: Thread-62]: > session.HiveSessionImpl (HiveSessionImpl.java:acquireAfterOpLock(332)) - We > are setting the hadoop caller context to 8cc6511f-5454-431b-aa2f-d7a1c11159a7 > for thread HiveServer2-HttpHandler-Pool: Thread-62 > 2016-07-23 17:28:24,392 INFO [HiveServer2-HttpHandler-Pool: Thread-62]: > session.HiveSessionImpl (HiveSessionImpl.java:releaseBeforeOpLock(356)) - We > are resetting the hadoop caller context for thread > HiveServer2-HttpHandler-Pool: Thread-62 > 2016-07-23 17:28:24,396 INFO [HiveServer2-HttpHandler-Pool: Thread-62]: > session.HiveSessionImpl (HiveSessionImpl.java:acquireAfterOpLock(332)) - We > are setting the hadoop caller context to 8cc6511f-5454-431b-aa2f-d7a1c11159a7 > for thread HiveServer2-HttpHandler-Pool: Thread-62 > 2016-07-23 17:28:24,416 INFO [HiveServer2-HttpHandler-Pool: Thread-62]: > log.PerfLogger (PerfLogger.java:PerfLogBegin(148)) - <PERFLOG > method=releaseLocks from=org.apache.hadoop.hive.ql.Driver> > 2016-07-23 17:28:24,416 INFO [HiveServer2-HttpHandler-Pool: Thread-62]: > log.PerfLogger (PerfLogger.java:PerfLogEnd(176)) - </PERFLOG > method=releaseLocks start=1469294904416 end=1469294904416 duration=0 > from=org.apache.hadoop.hive.ql.Driver> > 2016-07-23 17:28:24,416 INFO [HiveServer2-HttpHandler-Pool: Thread-62]: > session.HiveSessionImpl (HiveSessionImpl.java:releaseBeforeOpLock(356)) - We > are resetting the hadoop caller context for thread > HiveServer2-HttpHandler-Pool: Thread-62 > 2016-07-23 17:28:24,424 INFO [Atlas Logger 1]: bridge.HiveMetaStoreBridge > (HiveMetaStoreBridge.java:createOrUpdateTableInstance(411)) - Importing > objects from default.sample > 2016-07-23 17:28:24,424 INFO [Atlas Logger 1]: metastore.HiveMetaStore > (HiveMetaStore.java:logInfo(822)) - 6: get_database: default > 2016-07-23 17:28:24,424 INFO [Atlas Logger 1]: HiveMetaStore.audit > (HiveMetaStore.java:logAuditEvent(391)) - > ugi=hive/nat-s11-4-kuls-atlas-1.openstacklo...@hwqe.hortonworks.com > ip=unknown-ip-addr cmd=get_database: default > 2016-07-23 17:28:24,439 INFO [Atlas Logger 1]: metastore.HiveMetaStore > (HiveMetaStore.java:logInfo(822)) - 6: get_database: default > 2016-07-23 17:28:24,440 INFO [Atlas Logger 1]: HiveMetaStore.audit > (HiveMetaStore.java:logAuditEvent(391)) - > ugi=hive/nat-s11-4-kuls-atlas-1.openstacklo...@hwqe.hortonworks.com > ip=unknown-ip-addr cmd=get_database: default > 2016-07-23 17:28:24,445 INFO [Atlas Logger 1]: bridge.HiveMetaStoreBridge > (HiveMetaStoreBridge.java:createOrUpdateDBInstance(161)) - Importing objects > from databaseName : default > 2016-07-23 17:28:24,446 INFO [Atlas Logger 1]: metastore.HiveMetaStore > (HiveMetaStore.java:logInfo(822)) - 6: get_table : db=default > tbl=sample_view_1 > 2016-07-23 17:28:24,446 INFO [Atlas Logger 1]: HiveMetaStore.audit > (HiveMetaStore.java:logAuditEvent(391)) - > ugi=hive/nat-s11-4-kuls-atlas-1.openstacklo...@hwqe.hortonworks.com > ip=unknown-ip-addr cmd=get_table : db=default tbl=sample_view_1 > 2016-07-23 17:28:24,463 ERROR [Atlas Logger 1]: metastore.RetryingHMSHandler > (RetryingHMSHandler.java:invokeInternal(195)) - > java.lang.IllegalArgumentException: java.net.URISyntaxException: Relative > path in absolute URI: NULL::character%20varying > at org.apache.hadoop.fs.Path.initialize(Path.java:205) > at org.apache.hadoop.fs.Path.<init>(Path.java:171) > at org.apache.hadoop.hive.ql.metadata.Table.getPath(Table.java:242) > at > org.apache.hadoop.hive.ql.metadata.Table.getDataLocation(Table.java:251) > at > org.apache.hadoop.hive.ql..authorization.StorageBasedAuthorizationProvider.authorize(StorageBasedAuthorizationProvider.java:178) > at > org.apache.hadoop.hive.ql..authorization.AuthorizationPreEventListener.authorizeReadTable(AuthorizationPreEventListener.java:188) > at > org.apache.hadoop.hive.ql..authorization.AuthorizationPreEventListener.onEvent(AuthorizationPreEventListener.java:149) > at > org.apache.hadoop.hive.metastore.HiveMetaStore$HMSHandler.firePreEvent(HiveMetaStore.java:2113) > at > org.apache.hadoop.hive.metastore.HiveMetaStore$HMSHandler.get_table(HiveMetaStore.java:1877) > at sun.reflect.GeneratedMethodAccessor66.invoke(Unknown Source) > at > sun.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorImpl.java:43) > at java.lang.reflect.Method.invoke(Method.java:498) > at > org.apache.hadoop.hive.metastore.RetryingHMSHandler.invokeInternal(RetryingHMSHandler.java:139) > at > org.apache.hadoop.hive.metastore.RetryingHMSHandler.invoke(RetryingHMSHandler.java:97) > at com.sun.proxy.$Proxy13.get_table(Unknown Source) > at > org.apache.hadoop.hive.metastore.HiveMetaStoreClient.getTable(HiveMetaStoreClient.java:1234) > at > org.apache.hadoop.hive.ql.metadata.SessionHiveMetaStoreClient.getTable(SessionHiveMetaStoreClient.java:131) > at sun.reflect.GeneratedMethodAccessor67.invoke(Unknown Source) > at > sun.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorImpl.java:43) > at java.lang.reflect.Method.invoke(Method.java:498) > at > org.apache.hadoop.hive.metastore.RetryingMetaStoreClient.invoke(RetryingMetaStoreClient.java:159) > at com.sun.proxy.$Proxy14.getTable(Unknown Source) > at org.apache.hadoop.hive.ql.metadata.Hive.getTable(Hive.java:1157) > at org.apache.hadoop.hive.ql.metadata.Hive.getTable(Hive.java:1131) > at > org.apache.atlas.hive.hook.HiveHook.createOrUpdateEntities(HiveHook.java:513) > at > org.apache.atlas.hive.hook.HiveHook.createOrUpdateEntities(HiveHook.java:535) > at > org.apache.atlas.hive.hook.HiveHook.processHiveEntity(HiveHook.java:623) > at > org.apache.atlas.hive.hook.HiveHook.registerProcess(HiveHook.java:603) > at org.apache.atlas.hive.hook.HiveHook.fireAndForget(HiveHook.java:227) > at org.apache.atlas.hive.hook.HiveHook.access$200(HiveHook.java:82) > at org.apache.atlas.hive.hook.HiveHook$2.run(HiveHook.java:186) > at > java.util.concurrent.Executors$RunnableAdapter.call(Executors.java:511) > at java.util.concurrent.FutureTask.run(FutureTask.java:266) > at > java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1142) > at > java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:617) > at java.lang.Thread.run(Thread.java:745) > Caused by: java.net.URISyntaxException: Relative path in absolute URI: > NULL::character%20varying > at java.net.URI.checkPath(URI.java:1823) > at java.net.URI.<init>(URI.java:745) > at org.apache.hadoop.fs.Path.initialize(Path.java:202) > ... 35 more > 2016-07-23 17:28:24,464 ERROR [Atlas Logger 1]: hook.HiveHook > (HiveHook.java:run(188)) - Atlas hook failed due to error > org.apache.hadoop.hive.ql.metadata.HiveException: Unable to fetch table > sample_view_1. java.net.URISyntaxException: Relative path in absolute URI: > NULL::character%20varying > at org.apache.hadoop.hive.ql.metadata.Hive.getTable(Hive.java:1165) > at org.apache.hadoop.hive.ql.metadata.Hive.getTable(Hive.java:1131) > at > org.apache.atlas.hive.hook.HiveHook.createOrUpdateEntities(HiveHook.java:513) > at > org.apache.atlas.hive.hook.HiveHook.createOrUpdateEntities(HiveHook.java:535) > at > org.apache.atlas.hive.hook.HiveHook.processHiveEntity(HiveHook.java:623) > at > org.apache.atlas.hive.hook.HiveHook.registerProcess(HiveHook.java:603) > at org.apache.atlas.hive.hook.HiveHook.fireAndForget(HiveHook.java:227) > at org.apache.atlas.hive.hook.HiveHook.access$200(HiveHook.java:82) > at org.apache.atlas.hive.hook.HiveHook$2.run(HiveHook.java:186) > at > java.util.concurrent.Executors$RunnableAdapter.call(Executors.java:511) > at java.util.concurrent.FutureTask.run(FutureTask.java:266) > at > java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1142) > at > java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:617) > at java.lang.Thread.run(Thread.java:745) > Caused by: java.lang.IllegalArgumentException: java.net.URISyntaxException: > Relative path in absolute URI: NULL::character%20varying > at org.apache.hadoop.fs.Path.initialize(Path.java:205) > at org.apache.hadoop.fs.Path.<init>(Path.java:171) > at org.apache.hadoop.hive.ql.metadata.Table.getPath(Table.java:242) > at > org.apache.hadoop.hive.ql.metadata.Table.getDataLocation(Table.java:251) > at > org.apache.hadoop.hive.ql..authorization.StorageBasedAuthorizationProvider.authorize(StorageBasedAuthorizationProvider.java:178) > at > org.apache.hadoop.hive.ql..authorization.AuthorizationPreEventListener.authorizeReadTable(AuthorizationPreEventListener.java:188) > at > org.apache.hadoop.hive.ql..authorization.AuthorizationPreEventListener.onEvent(AuthorizationPreEventListener.java:149) > at > org.apache.hadoop.hive.metastore.HiveMetaStore$HMSHandler.firePreEvent(HiveMetaStore.java:2113) > at > org.apache.hadoop.hive.metastore.HiveMetaStore$HMSHandler.get_table(HiveMetaStore.java:1877) > at sun.reflect.GeneratedMethodAccessor66.invoke(Unknown Source) > at > sun.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorImpl.java:43) > at java.lang.reflect.Method.invoke(Method.java:498) > at > org.apache.hadoop.hive.metastore.RetryingHMSHandler.invokeInternal(RetryingHMSHandler.java:139) > at > org.apache.hadoop.hive.metastore.RetryingHMSHandler.invoke(RetryingHMSHandler.java:97) > at com.sun.proxy.$Proxy13.get_table(Unknown Source) > at > org.apache.hadoop.hive.metastore.HiveMetaStoreClient.getTable(HiveMetaStoreClient.java:1234) > at > org.apache.hadoop.hive.ql.metadata.SessionHiveMetaStoreClient.getTable(SessionHiveMetaStoreClient.java:131) > at sun.reflect.GeneratedMethodAccessor67.invoke(Unknown Source) > at > sun.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorImpl.java:43) > at java.lang.reflect.Method.invoke(Method.java:498) > at > org.apache.hadoop.hive.metastore.RetryingMetaStoreClient.invoke(RetryingMetaStoreClient.java:159) > at com.sun.proxy.$Proxy14.getTable(Unknown Source) > at org.apache.hadoop.hive.ql.metadata.Hive.getTable(Hive.java:1157) > ... 13 more > Caused by: java.net.URISyntaxException: Relative path in absolute URI: > NULL::character%20varying > at java.net.URI.checkPath(URI.java:1823) > at java.net.URI.<init>(URI.java:745) > at org.apache.hadoop.fs.Path.initialize(Path.java:202) > ... 35 more > {noformat} -- This message was sent by Atlassian JIRA (v6.3.4#6332)