Radhika Kundam created ATLAS-4470:
-------------------------------------
Summary: Creating Hive_Process entity is getting failed due to
empty/null startTime
Key: ATLAS-4470
URL: https://issues.apache.org/jira/browse/ATLAS-4470
Project: Atlas
Issue Type: Bug
Reporter: Radhika Kundam
Assignee: Radhika Kundam
In few scenarios of creation Hive_process entity is failed with below error and
this is expected because startTime is mandatory attribute for hive_process
entity. This issue is mainly because Hive is not sending startTime in few
scenarios and since this issue is inconsistent and not sure of the pattern when
Hive is sending empty startTime.
While processing Hive context Atlas initially assign currentTimeStamp to
startTime and then further it proceeds to get startTime from Hive Context and
if that value is empty the mentioned issue is occurring. So to avoid that we
can have extra check to consider StartTime from Hive Context only if it's not
empty.
2021-10-13 14:40:00,503 ERROR - [NotificationHookConsumer thread-0:] ~ graph
rollback due to exception AtlasBaseException:Invalid instance creation/updation
parameters passed : hive_process.startTime: mandatory attribute value missing
in type hive_process (GraphTransactionInterceptor:169)2021-10-13 14:40:00,504
WARN - [NotificationHookConsumer thread-0:] ~ Error handling message
(NotificationHookConsumer:752)org.apache.atlas.exception.AtlasBaseException:
Invalid instance creation/updation parameters passed : hive_process.startTime:
mandatory attribute value missing in type hive_process at
org.apache.atlas.repository.store.graph.v2.AtlasEntityGraphDiscoveryV2.validateAndNormalize(AtlasEntityGraphDiscoveryV2.java:97)
at
org.apache.atlas.repository.store.graph.v2.AtlasEntityStoreV2.preCreateOrUpdate(AtlasEntityStoreV2.java:899)
at
org.apache.atlas.repository.store.graph.v2.AtlasEntityStoreV2.createOrUpdate(AtlasEntityStoreV2.java:744)
at
org.apache.atlas.repository.store.graph.v2.AtlasEntityStoreV2.createOrUpdate(AtlasEntityStoreV2.java:275)
at
org.apache.atlas.repository.store.graph.v2.AtlasEntityStoreV2$$FastClassBySpringCGLIB$$6861dca9.invoke(<generated>)
at
org.springframework.cglib.proxy.MethodProxy.invoke(MethodProxy.java:204)
at
org.springframework.aop.framework.CglibAopProxy$CglibMethodInvocation.invokeJoinpoint(CglibAopProxy.java:736)
at
org.springframework.aop.framework.ReflectiveMethodInvocation.proceed(ReflectiveMethodInvocation.java:157)
at
org.apache.atlas.GraphTransactionInterceptor.invoke(GraphTransactionInterceptor.java:82)
at
org.springframework.aop.framework.ReflectiveMethodInvocation.proceed(ReflectiveMethodInvocation.java:179)
at
org.springframework.aop.framework.CglibAopProxy$DynamicAdvisedInterceptor.intercept(CglibAopProxy.java:671)
at
org.apache.atlas.repository.store.graph.v2.AtlasEntityStoreV2$$EnhancerBySpringCGLIB$$ff9731b1.createOrUpdate(<generated>)
at
org.apache.atlas.notification.NotificationHookConsumer$HookConsumer.createOrUpdate(NotificationHookConsumer.java:822)
at
org.apache.atlas.notification.NotificationHookConsumer$HookConsumer.handleMessage(NotificationHookConsumer.java:671)
at
org.apache.atlas.notification.NotificationHookConsumer$HookConsumer.doWork(NotificationHookConsumer.java:524)
at kafka.utils.ShutdownableThread.run(ShutdownableThread.scala:82)
at
--
This message was sent by Atlassian Jira
(v8.3.4#803005)
