Ayub Khan created ATLAS-1045:
--------------------------------
Summary: HiveHook fails to post metadata for "Create view" with
"Relative path in absolute URI: NULL::character%20varying" exception
Key: ATLAS-1045
URL: https://issues.apache.org/jira/browse/ATLAS-1045
Project: Atlas
Issue Type: Bug
Affects Versions: trunk, 0.7-incubating
Reporter: Ayub Khan
Priority: Critical
*Impact: No metadata for "create view" on atlas.*
Steps to repro:
{noformat}
* create table sample (abc String);
* create view sample_view_1 (url COMMENT 'URL of Referring page') AS SELECT *
from sample;
{noformat}
Hiveserver2.log snapshot
{noformat}
2016-07-23 17:28:24,371 INFO [HiveServer2-Background-Pool: Thread-9870]:
hooks.ATSHook (ATSHook.java:<init>(90)) - Created ATS Hook
2016-07-23 17:28:24,371 INFO [HiveServer2-Background-Pool: Thread-9870]:
log.PerfLogger (PerfLogger.java:PerfLogBegin(148)) - <PERFLOG
method=PostHook.org.apache.hadoop.hive.ql.hooks.ATSHook
from=org.apache.hadoop.hive.ql.Driver>
2016-07-23 17:28:24,371 INFO [HiveServer2-Background-Pool: Thread-9870]:
log.PerfLogger (PerfLogger.java:PerfLogEnd(176)) - </PERFLOG
method=PostHook.org.apache.hadoop.hive.ql.hooks.ATSHook start=1469294904371
end=1469294904371 duration=0 from=org.apache.hadoop.hive.ql.Driver>
2016-07-23 17:28:24,372 INFO [HiveServer2-Background-Pool: Thread-9870]:
log.PerfLogger (PerfLogger.java:PerfLogBegin(148)) - <PERFLOG
method=PostHook.org.apache.atlas.hive.hook.HiveHook
from=org.apache.hadoop.hive.ql.Driver>
2016-07-23 17:28:24,372 INFO [HiveServer2-Background-Pool: Thread-9870]:
log.PerfLogger (PerfLogger.java:PerfLogEnd(176)) - </PERFLOG
method=PostHook.org.apache.atlas.hive.hook.HiveHook start=1469294904372
end=1469294904372 duration=0 from=org.apache.hadoop.hive.ql.Driver>
2016-07-23 17:28:24,372 INFO [HiveServer2-Background-Pool: Thread-9870]:
ql.Driver (Driver.java:execute(1635)) - Resetting the caller context to
HIVE_SSN_ID:8cc6511f-5454-431b-aa2f-d7a1c11159a7
2016-07-23 17:28:24,373 INFO [HiveServer2-Background-Pool: Thread-9870]:
log.PerfLogger (PerfLogger.java:PerfLogEnd(176)) - </PERFLOG
method=Driver.execute start=1469294904326 end=1469294904373 duration=47
from=org.apache.hadoop.hive.ql.Driver>
2016-07-23 17:28:24,373 INFO [HiveServer2-Background-Pool: Thread-9870]:
ql.Driver (SessionState.java:printInfo(939)) - OK
2016-07-23 17:28:24,373 INFO [HiveServer2-Background-Pool: Thread-9870]:
log.PerfLogger (PerfLogger.java:PerfLogBegin(148)) - <PERFLOG
method=releaseLocks from=org.apache.hadoop.hive.ql.Driver>
2016-07-23 17:28:24,373 INFO [HiveServer2-Background-Pool: Thread-9870]:
log.PerfLogger (PerfLogger.java:PerfLogEnd(176)) - </PERFLOG
method=releaseLocks start=1469294904373 end=1469294904373 duration=0
from=org.apache.hadoop.hive.ql.Driver>
2016-07-23 17:28:24,373 INFO [HiveServer2-Background-Pool: Thread-9870]:
log.PerfLogger (PerfLogger.java:PerfLogEnd(176)) - </PERFLOG method=Driver.run
start=1469294904233 end=1469294904373 duration=140
from=org.apache.hadoop.hive.ql.Driver>
2016-07-23 17:28:24,373 INFO [Atlas Logger 1]: hook.HiveHook
(HiveHook.java:fireAndForget(202)) - Entered Atlas hook for hook type
POST_EXEC_HOOK operation CREATEVIEW
2016-07-23 17:28:24,374 INFO [Atlas Logger 1]: metastore.HiveMetaStore
(HiveMetaStore.java:logInfo(822)) - 6: get_database: default
2016-07-23 17:28:24,374 INFO [Atlas Logger 1]: HiveMetaStore.audit
(HiveMetaStore.java:logAuditEvent(391)) -
ugi=hive/[email protected]
ip=unknown-ip-addr cmd=get_database: default
2016-07-23 17:28:24,380 INFO [Atlas Logger 1]: metastore.HiveMetaStore
(HiveMetaStore.java:logInfo(822)) - 6: get_database: default
2016-07-23 17:28:24,380 INFO [Atlas Logger 1]: HiveMetaStore.audit
(HiveMetaStore.java:logAuditEvent(391)) -
ugi=hive/[email protected]
ip=unknown-ip-addr cmd=get_database: default
2016-07-23 17:28:24,385 INFO [Atlas Logger 1]: bridge.HiveMetaStoreBridge
(HiveMetaStoreBridge.java:createOrUpdateDBInstance(161)) - Importing objects
from databaseName : default
2016-07-23 17:28:24,385 INFO [Atlas Logger 1]: metastore.HiveMetaStore
(HiveMetaStore.java:logInfo(822)) - 6: get_table : db=default tbl=sample
2016-07-23 17:28:24,385 INFO [Atlas Logger 1]: HiveMetaStore.audit
(HiveMetaStore.java:logAuditEvent(391)) -
ugi=hive/[email protected]
ip=unknown-ip-addr cmd=get_table : db=default tbl=sample
2016-07-23 17:28:24,387 INFO [HiveServer2-HttpHandler-Pool: Thread-62]:
session.HiveSessionImpl (HiveSessionImpl.java:acquireAfterOpLock(332)) - We are
setting the hadoop caller context to 8cc6511f-5454-431b-aa2f-d7a1c11159a7 for
thread HiveServer2-HttpHandler-Pool: Thread-62
2016-07-23 17:28:24,387 INFO [HiveServer2-HttpHandler-Pool: Thread-62]:
session.HiveSessionImpl (HiveSessionImpl.java:releaseBeforeOpLock(356)) - We
are resetting the hadoop caller context for thread
HiveServer2-HttpHandler-Pool: Thread-62
2016-07-23 17:28:24,392 INFO [HiveServer2-HttpHandler-Pool: Thread-62]:
session.HiveSessionImpl (HiveSessionImpl.java:acquireAfterOpLock(332)) - We are
setting the hadoop caller context to 8cc6511f-5454-431b-aa2f-d7a1c11159a7 for
thread HiveServer2-HttpHandler-Pool: Thread-62
2016-07-23 17:28:24,392 INFO [HiveServer2-HttpHandler-Pool: Thread-62]:
session.HiveSessionImpl (HiveSessionImpl.java:releaseBeforeOpLock(356)) - We
are resetting the hadoop caller context for thread
HiveServer2-HttpHandler-Pool: Thread-62
2016-07-23 17:28:24,396 INFO [HiveServer2-HttpHandler-Pool: Thread-62]:
session.HiveSessionImpl (HiveSessionImpl.java:acquireAfterOpLock(332)) - We are
setting the hadoop caller context to 8cc6511f-5454-431b-aa2f-d7a1c11159a7 for
thread HiveServer2-HttpHandler-Pool: Thread-62
2016-07-23 17:28:24,416 INFO [HiveServer2-HttpHandler-Pool: Thread-62]:
log.PerfLogger (PerfLogger.java:PerfLogBegin(148)) - <PERFLOG
method=releaseLocks from=org.apache.hadoop.hive.ql.Driver>
2016-07-23 17:28:24,416 INFO [HiveServer2-HttpHandler-Pool: Thread-62]:
log.PerfLogger (PerfLogger.java:PerfLogEnd(176)) - </PERFLOG
method=releaseLocks start=1469294904416 end=1469294904416 duration=0
from=org.apache.hadoop.hive.ql.Driver>
2016-07-23 17:28:24,416 INFO [HiveServer2-HttpHandler-Pool: Thread-62]:
session.HiveSessionImpl (HiveSessionImpl.java:releaseBeforeOpLock(356)) - We
are resetting the hadoop caller context for thread
HiveServer2-HttpHandler-Pool: Thread-62
2016-07-23 17:28:24,424 INFO [Atlas Logger 1]: bridge.HiveMetaStoreBridge
(HiveMetaStoreBridge.java:createOrUpdateTableInstance(411)) - Importing objects
from default.sample
2016-07-23 17:28:24,424 INFO [Atlas Logger 1]: metastore.HiveMetaStore
(HiveMetaStore.java:logInfo(822)) - 6: get_database: default
2016-07-23 17:28:24,424 INFO [Atlas Logger 1]: HiveMetaStore.audit
(HiveMetaStore.java:logAuditEvent(391)) -
ugi=hive/[email protected]
ip=unknown-ip-addr cmd=get_database: default
2016-07-23 17:28:24,439 INFO [Atlas Logger 1]: metastore.HiveMetaStore
(HiveMetaStore.java:logInfo(822)) - 6: get_database: default
2016-07-23 17:28:24,440 INFO [Atlas Logger 1]: HiveMetaStore.audit
(HiveMetaStore.java:logAuditEvent(391)) -
ugi=hive/[email protected]
ip=unknown-ip-addr cmd=get_database: default
2016-07-23 17:28:24,445 INFO [Atlas Logger 1]: bridge.HiveMetaStoreBridge
(HiveMetaStoreBridge.java:createOrUpdateDBInstance(161)) - Importing objects
from databaseName : default
2016-07-23 17:28:24,446 INFO [Atlas Logger 1]: metastore.HiveMetaStore
(HiveMetaStore.java:logInfo(822)) - 6: get_table : db=default tbl=sample_view_1
2016-07-23 17:28:24,446 INFO [Atlas Logger 1]: HiveMetaStore.audit
(HiveMetaStore.java:logAuditEvent(391)) -
ugi=hive/[email protected]
ip=unknown-ip-addr cmd=get_table : db=default tbl=sample_view_1
2016-07-23 17:28:24,463 ERROR [Atlas Logger 1]: metastore.RetryingHMSHandler
(RetryingHMSHandler.java:invokeInternal(195)) -
java.lang.IllegalArgumentException: java.net.URISyntaxException: Relative path
in absolute URI: NULL::character%20varying
at org.apache.hadoop.fs.Path.initialize(Path.java:205)
at org.apache.hadoop.fs.Path.<init>(Path.java:171)
at org.apache.hadoop.hive.ql.metadata.Table.getPath(Table.java:242)
at
org.apache.hadoop.hive.ql.metadata.Table.getDataLocation(Table.java:251)
at
org.apache.hadoop.hive.ql..authorization.StorageBasedAuthorizationProvider.authorize(StorageBasedAuthorizationProvider.java:178)
at
org.apache.hadoop.hive.ql..authorization.AuthorizationPreEventListener.authorizeReadTable(AuthorizationPreEventListener.java:188)
at
org.apache.hadoop.hive.ql..authorization.AuthorizationPreEventListener.onEvent(AuthorizationPreEventListener.java:149)
at
org.apache.hadoop.hive.metastore.HiveMetaStore$HMSHandler.firePreEvent(HiveMetaStore.java:2113)
at
org.apache.hadoop.hive.metastore.HiveMetaStore$HMSHandler.get_table(HiveMetaStore.java:1877)
at sun.reflect.GeneratedMethodAccessor66.invoke(Unknown Source)
at
sun.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorImpl.java:43)
at java.lang.reflect.Method.invoke(Method.java:498)
at
org.apache.hadoop.hive.metastore.RetryingHMSHandler.invokeInternal(RetryingHMSHandler.java:139)
at
org.apache.hadoop.hive.metastore.RetryingHMSHandler.invoke(RetryingHMSHandler.java:97)
at com.sun.proxy.$Proxy13.get_table(Unknown Source)
at
org.apache.hadoop.hive.metastore.HiveMetaStoreClient.getTable(HiveMetaStoreClient.java:1234)
at
org.apache.hadoop.hive.ql.metadata.SessionHiveMetaStoreClient.getTable(SessionHiveMetaStoreClient.java:131)
at sun.reflect.GeneratedMethodAccessor67.invoke(Unknown Source)
at
sun.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorImpl.java:43)
at java.lang.reflect.Method.invoke(Method.java:498)
at
org.apache.hadoop.hive.metastore.RetryingMetaStoreClient.invoke(RetryingMetaStoreClient.java:159)
at com.sun.proxy.$Proxy14.getTable(Unknown Source)
at org.apache.hadoop.hive.ql.metadata.Hive.getTable(Hive.java:1157)
at org.apache.hadoop.hive.ql.metadata.Hive.getTable(Hive.java:1131)
at
org.apache.atlas.hive.hook.HiveHook.createOrUpdateEntities(HiveHook.java:513)
at
org.apache.atlas.hive.hook.HiveHook.createOrUpdateEntities(HiveHook.java:535)
at
org.apache.atlas.hive.hook.HiveHook.processHiveEntity(HiveHook.java:623)
at
org.apache.atlas.hive.hook.HiveHook.registerProcess(HiveHook.java:603)
at org.apache.atlas.hive.hook.HiveHook.fireAndForget(HiveHook.java:227)
at org.apache.atlas.hive.hook.HiveHook.access$200(HiveHook.java:82)
at org.apache.atlas.hive.hook.HiveHook$2.run(HiveHook.java:186)
at
java.util.concurrent.Executors$RunnableAdapter.call(Executors.java:511)
at java.util.concurrent.FutureTask.run(FutureTask.java:266)
at
java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1142)
at
java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:617)
at java.lang.Thread.run(Thread.java:745)
Caused by: java.net.URISyntaxException: Relative path in absolute URI:
NULL::character%20varying
at java.net.URI.checkPath(URI.java:1823)
at java.net.URI.<init>(URI.java:745)
at org.apache.hadoop.fs.Path.initialize(Path.java:202)
... 35 more
2016-07-23 17:28:24,464 ERROR [Atlas Logger 1]: hook.HiveHook
(HiveHook.java:run(188)) - Atlas hook failed due to error
org.apache.hadoop.hive.ql.metadata.HiveException: Unable to fetch table
sample_view_1. java.net.URISyntaxException: Relative path in absolute URI:
NULL::character%20varying
at org.apache.hadoop.hive.ql.metadata.Hive.getTable(Hive.java:1165)
at org.apache.hadoop.hive.ql.metadata.Hive.getTable(Hive.java:1131)
at
org.apache.atlas.hive.hook.HiveHook.createOrUpdateEntities(HiveHook.java:513)
at
org.apache.atlas.hive.hook.HiveHook.createOrUpdateEntities(HiveHook.java:535)
at
org.apache.atlas.hive.hook.HiveHook.processHiveEntity(HiveHook.java:623)
at
org.apache.atlas.hive.hook.HiveHook.registerProcess(HiveHook.java:603)
at org.apache.atlas.hive.hook.HiveHook.fireAndForget(HiveHook.java:227)
at org.apache.atlas.hive.hook.HiveHook.access$200(HiveHook.java:82)
at org.apache.atlas.hive.hook.HiveHook$2.run(HiveHook.java:186)
at
java.util.concurrent.Executors$RunnableAdapter.call(Executors.java:511)
at java.util.concurrent.FutureTask.run(FutureTask.java:266)
at
java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1142)
at
java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:617)
at java.lang.Thread.run(Thread.java:745)
Caused by: java.lang.IllegalArgumentException: java.net.URISyntaxException:
Relative path in absolute URI: NULL::character%20varying
at org.apache.hadoop.fs.Path.initialize(Path.java:205)
at org.apache.hadoop.fs.Path.<init>(Path.java:171)
at org.apache.hadoop.hive.ql.metadata.Table.getPath(Table.java:242)
at
org.apache.hadoop.hive.ql.metadata.Table.getDataLocation(Table.java:251)
at
org.apache.hadoop.hive.ql..authorization.StorageBasedAuthorizationProvider.authorize(StorageBasedAuthorizationProvider.java:178)
at
org.apache.hadoop.hive.ql..authorization.AuthorizationPreEventListener.authorizeReadTable(AuthorizationPreEventListener.java:188)
at
org.apache.hadoop.hive.ql..authorization.AuthorizationPreEventListener.onEvent(AuthorizationPreEventListener.java:149)
at
org.apache.hadoop.hive.metastore.HiveMetaStore$HMSHandler.firePreEvent(HiveMetaStore.java:2113)
at
org.apache.hadoop.hive.metastore.HiveMetaStore$HMSHandler.get_table(HiveMetaStore.java:1877)
at sun.reflect.GeneratedMethodAccessor66.invoke(Unknown Source)
at
sun.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorImpl.java:43)
at java.lang.reflect.Method.invoke(Method.java:498)
at
org.apache.hadoop.hive.metastore.RetryingHMSHandler.invokeInternal(RetryingHMSHandler.java:139)
at
org.apache.hadoop.hive.metastore.RetryingHMSHandler.invoke(RetryingHMSHandler.java:97)
at com.sun.proxy.$Proxy13.get_table(Unknown Source)
at
org.apache.hadoop.hive.metastore.HiveMetaStoreClient.getTable(HiveMetaStoreClient.java:1234)
at
org.apache.hadoop.hive.ql.metadata.SessionHiveMetaStoreClient.getTable(SessionHiveMetaStoreClient.java:131)
at sun.reflect.GeneratedMethodAccessor67.invoke(Unknown Source)
at
sun.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorImpl.java:43)
at java.lang.reflect.Method.invoke(Method.java:498)
at
org.apache.hadoop.hive.metastore.RetryingMetaStoreClient.invoke(RetryingMetaStoreClient.java:159)
at com.sun.proxy.$Proxy14.getTable(Unknown Source)
at org.apache.hadoop.hive.ql.metadata.Hive.getTable(Hive.java:1157)
... 13 more
Caused by: java.net.URISyntaxException: Relative path in absolute URI:
NULL::character%20varying
at java.net.URI.checkPath(URI.java:1823)
at java.net.URI.<init>(URI.java:745)
at org.apache.hadoop.fs.Path.initialize(Path.java:202)
... 35 more
{noformat}
--
This message was sent by Atlassian JIRA
(v6.3.4#6332)
