[
https://issues.apache.org/jira/browse/ATLAS-4470?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
]
Radhika Kundam updated ATLAS-4470:
----------------------------------
Description:
tIn few scenarios of creation Hive_process entity is failed with below error
and this is expected because startTime is mandatory attribute for hive_process
entity. This issue is mainly because Hive is not sending startTime in few
scenarios and since this issue is inconsistent and not sure of the pattern when
Hive is sending empty startTime.
While processing Hive context Atlas initially assign currentTimeStamp to
startTime and then further it proceeds to get startTime from Hive Context and
if that value is empty the mentioned issue is occurring. So to avoid that we
can have extra check at Atlas to consider StartTime from Hive Context only if
it's not empty.
2021-10-13 14:40:00,503 ERROR - [NotificationHookConsumer thread-0:] ~ graph
rollback due to exception AtlasBaseException:Invalid instance creation/updation
parameters passed : hive_process.startTime: mandatory attribute value missing
in type hive_process (GraphTransactionInterceptor:169)2021-10-13 14:40:00,504
WARN - [NotificationHookConsumer thread-0:] ~ Error handling message
(NotificationHookConsumer:752)org.apache.atlas.exception.AtlasBaseException:
Invalid instance creation/updation parameters passed : hive_process.startTime:
mandatory attribute value missing in type hive_process at
org.apache.atlas.repository.store.graph.v2.AtlasEntityGraphDiscoveryV2.validateAndNormalize(AtlasEntityGraphDiscoveryV2.java:97)
at
org.apache.atlas.repository.store.graph.v2.AtlasEntityStoreV2.preCreateOrUpdate(AtlasEntityStoreV2.java:899)
at
org.apache.atlas.repository.store.graph.v2.AtlasEntityStoreV2.createOrUpdate(AtlasEntityStoreV2.java:744)
at
org.apache.atlas.repository.store.graph.v2.AtlasEntityStoreV2.createOrUpdate(AtlasEntityStoreV2.java:275)
at
org.apache.atlas.repository.store.graph.v2.AtlasEntityStoreV2$$FastClassBySpringCGLIB$$6861dca9.invoke(<generated>)
at
org.springframework.cglib.proxy.MethodProxy.invoke(MethodProxy.java:204)
at
org.springframework.aop.framework.CglibAopProxy$CglibMethodInvocation.invokeJoinpoint(CglibAopProxy.java:736)
at
org.springframework.aop.framework.ReflectiveMethodInvocation.proceed(ReflectiveMethodInvocation.java:157)
at
org.apache.atlas.GraphTransactionInterceptor.invoke(GraphTransactionInterceptor.java:82)
at
org.springframework.aop.framework.ReflectiveMethodInvocation.proceed(ReflectiveMethodInvocation.java:179)
at
org.springframework.aop.framework.CglibAopProxy$DynamicAdvisedInterceptor.intercept(CglibAopProxy.java:671)
at
org.apache.atlas.repository.store.graph.v2.AtlasEntityStoreV2$$EnhancerBySpringCGLIB$$ff9731b1.createOrUpdate(<generated>)
at
org.apache.atlas.notification.NotificationHookConsumer$HookConsumer.createOrUpdate(NotificationHookConsumer.java:822)
at
org.apache.atlas.notification.NotificationHookConsumer$HookConsumer.handleMessage(NotificationHookConsumer.java:671)
at
org.apache.atlas.notification.NotificationHookConsumer$HookConsumer.doWork(NotificationHookConsumer.java:524)
at kafka.utils.ShutdownableThread.run(ShutdownableThread.scala:82)
at
was:
In few scenarios of creation Hive_process entity is failed with below error and
this is expected because startTime is mandatory attribute for hive_process
entity. This issue is mainly because Hive is not sending startTime in few
scenarios and since this issue is inconsistent and not sure of the pattern when
Hive is sending empty startTime.
While processing Hive context Atlas initially assign currentTimeStamp to
startTime and then further it proceeds to get startTime from Hive Context and
if that value is empty the mentioned issue is occurring. So to avoid that we
can have extra check to consider StartTime from Hive Context only if it's not
empty.
2021-10-13 14:40:00,503 ERROR - [NotificationHookConsumer thread-0:] ~ graph
rollback due to exception AtlasBaseException:Invalid instance creation/updation
parameters passed : hive_process.startTime: mandatory attribute value missing
in type hive_process (GraphTransactionInterceptor:169)2021-10-13 14:40:00,504
WARN - [NotificationHookConsumer thread-0:] ~ Error handling message
(NotificationHookConsumer:752)org.apache.atlas.exception.AtlasBaseException:
Invalid instance creation/updation parameters passed : hive_process.startTime:
mandatory attribute value missing in type hive_process at
org.apache.atlas.repository.store.graph.v2.AtlasEntityGraphDiscoveryV2.validateAndNormalize(AtlasEntityGraphDiscoveryV2.java:97)
at
org.apache.atlas.repository.store.graph.v2.AtlasEntityStoreV2.preCreateOrUpdate(AtlasEntityStoreV2.java:899)
at
org.apache.atlas.repository.store.graph.v2.AtlasEntityStoreV2.createOrUpdate(AtlasEntityStoreV2.java:744)
at
org.apache.atlas.repository.store.graph.v2.AtlasEntityStoreV2.createOrUpdate(AtlasEntityStoreV2.java:275)
at
org.apache.atlas.repository.store.graph.v2.AtlasEntityStoreV2$$FastClassBySpringCGLIB$$6861dca9.invoke(<generated>)
at
org.springframework.cglib.proxy.MethodProxy.invoke(MethodProxy.java:204)
at
org.springframework.aop.framework.CglibAopProxy$CglibMethodInvocation.invokeJoinpoint(CglibAopProxy.java:736)
at
org.springframework.aop.framework.ReflectiveMethodInvocation.proceed(ReflectiveMethodInvocation.java:157)
at
org.apache.atlas.GraphTransactionInterceptor.invoke(GraphTransactionInterceptor.java:82)
at
org.springframework.aop.framework.ReflectiveMethodInvocation.proceed(ReflectiveMethodInvocation.java:179)
at
org.springframework.aop.framework.CglibAopProxy$DynamicAdvisedInterceptor.intercept(CglibAopProxy.java:671)
at
org.apache.atlas.repository.store.graph.v2.AtlasEntityStoreV2$$EnhancerBySpringCGLIB$$ff9731b1.createOrUpdate(<generated>)
at
org.apache.atlas.notification.NotificationHookConsumer$HookConsumer.createOrUpdate(NotificationHookConsumer.java:822)
at
org.apache.atlas.notification.NotificationHookConsumer$HookConsumer.handleMessage(NotificationHookConsumer.java:671)
at
org.apache.atlas.notification.NotificationHookConsumer$HookConsumer.doWork(NotificationHookConsumer.java:524)
at kafka.utils.ShutdownableThread.run(ShutdownableThread.scala:82)
at
> Creating Hive_Process entity is getting failed due to null startTime
> --------------------------------------------------------------------
>
> Key: ATLAS-4470
> URL: https://issues.apache.org/jira/browse/ATLAS-4470
> Project: Atlas
> Issue Type: Bug
> Components: atlas-core
> Reporter: Radhika Kundam
> Assignee: Radhika Kundam
> Priority: Major
>
> tIn few scenarios of creation Hive_process entity is failed with below error
> and this is expected because startTime is mandatory attribute for
> hive_process entity. This issue is mainly because Hive is not sending
> startTime in few scenarios and since this issue is inconsistent and not sure
> of the pattern when Hive is sending empty startTime.
> While processing Hive context Atlas initially assign currentTimeStamp to
> startTime and then further it proceeds to get startTime from Hive Context and
> if that value is empty the mentioned issue is occurring. So to avoid that we
> can have extra check at Atlas to consider StartTime from Hive Context only if
> it's not empty.
> 2021-10-13 14:40:00,503 ERROR - [NotificationHookConsumer thread-0:] ~ graph
> rollback due to exception AtlasBaseException:Invalid instance
> creation/updation parameters passed : hive_process.startTime: mandatory
> attribute value missing in type hive_process
> (GraphTransactionInterceptor:169)2021-10-13 14:40:00,504 WARN -
> [NotificationHookConsumer thread-0:] ~ Error handling message
> (NotificationHookConsumer:752)org.apache.atlas.exception.AtlasBaseException:
> Invalid instance creation/updation parameters passed :
> hive_process.startTime: mandatory attribute value missing in type
> hive_process at
> org.apache.atlas.repository.store.graph.v2.AtlasEntityGraphDiscoveryV2.validateAndNormalize(AtlasEntityGraphDiscoveryV2.java:97)
> at
> org.apache.atlas.repository.store.graph.v2.AtlasEntityStoreV2.preCreateOrUpdate(AtlasEntityStoreV2.java:899)
> at
> org.apache.atlas.repository.store.graph.v2.AtlasEntityStoreV2.createOrUpdate(AtlasEntityStoreV2.java:744)
> at
> org.apache.atlas.repository.store.graph.v2.AtlasEntityStoreV2.createOrUpdate(AtlasEntityStoreV2.java:275)
> at
> org.apache.atlas.repository.store.graph.v2.AtlasEntityStoreV2$$FastClassBySpringCGLIB$$6861dca9.invoke(<generated>)
> at
> org.springframework.cglib.proxy.MethodProxy.invoke(MethodProxy.java:204)
> at
> org.springframework.aop.framework.CglibAopProxy$CglibMethodInvocation.invokeJoinpoint(CglibAopProxy.java:736)
> at
> org.springframework.aop.framework.ReflectiveMethodInvocation.proceed(ReflectiveMethodInvocation.java:157)
> at
> org.apache.atlas.GraphTransactionInterceptor.invoke(GraphTransactionInterceptor.java:82)
> at
> org.springframework.aop.framework.ReflectiveMethodInvocation.proceed(ReflectiveMethodInvocation.java:179)
> at
> org.springframework.aop.framework.CglibAopProxy$DynamicAdvisedInterceptor.intercept(CglibAopProxy.java:671)
> at
> org.apache.atlas.repository.store.graph.v2.AtlasEntityStoreV2$$EnhancerBySpringCGLIB$$ff9731b1.createOrUpdate(<generated>)
> at
> org.apache.atlas.notification.NotificationHookConsumer$HookConsumer.createOrUpdate(NotificationHookConsumer.java:822)
> at
> org.apache.atlas.notification.NotificationHookConsumer$HookConsumer.handleMessage(NotificationHookConsumer.java:671)
> at
> org.apache.atlas.notification.NotificationHookConsumer$HookConsumer.doWork(NotificationHookConsumer.java:524)
> at kafka.utils.ShutdownableThread.run(ShutdownableThread.scala:82)
> at
--
This message was sent by Atlassian Jira
(v8.3.4#803005)
