Vineet,
It is not clear what might cause this error. To investigate this issue further, can you send the SQL statements that lead to this error? Thanks, Madhan From: Vineet Mishra <clearmido...@gmail.com> Reply-To: "user@atlas.apache.org" <user@atlas.apache.org> Date: Wednesday, August 9, 2017 at 3:45 AM To: "user@atlas.apache.org" <user@atlas.apache.org> Subject: Re: Atlas not working for complex hive query on single node Hi Guys, Any update on this? Caused by: com.sleepycat.je.LockTimeoutException: (JE 5.0.73) Lock expired. Locker 768997492 3544_NotificationHookConsumer thread-0_Txn: waited for lock on database=edgestore LockAddr:1860143233 LSN=0x0/0xc8613 type=WRITE grant=WAIT_PROMOTION timeoutMillis=500 startTime=1502275039421 endTime=1502275039921 Owners: [<LockInfo locker="768997492 3544_NotificationHookConsumer thread-0_Txn" type="READ"/>, <LockInfo locker="1176127601 3312_pool-1-thread-7_Txn" type="READ"/>] Waiters: [] Transaction 768997492 3544_NotificationHookConsumer thread-0_Txn owns LockAddr:1860143233 <LockInfo locker="768997492 3544_NotificationHookConsumer thread-0_Txn" type="READ"/> Transaction 768997492 3544_NotificationHookConsumer thread-0_Txn waits for LockAddr:1860143233 at com.sleepycat.je.txn.LockManager.newLockTimeoutException(LockManager.java:664) at com.sleepycat.je.txn.LockManager.makeTimeoutMsgInternal(LockManager.java:623) at com.sleepycat.je.txn.SyncedLockManager.makeTimeoutMsg(SyncedLockManager.java:97) I am not able to generate lineage due to this issue. Thanks! On Fri, Aug 4, 2017 at 5:05 PM, Vineet Mishra <clearmido...@gmail.com> wrote: Hi Team, I am using Atlas 0.8 release branch with hive 2.1 which works fine with hive import and with simple CTAS on hive but as when I give CTAS with some joins, its start failing to create lineage(the metadata still is captured by atlas) Also when I am running the same stuff with hive 1.1.0 it doesn't even get the metadata in the latter case, looks like there some persistence issue as what logs depicts. Has any one been through this situation? Atlas log with hive 2.1 ------------------------------- 2017-08-03 05:31:24,011 ERROR - [NotificationHookConsumer thread-0:] ~ Could not commit transaction [71] due to storage exception in commit (StandardTitanGraph:673) com.thinkaurelius.titan.core.TitanException: Could not execute operation due to backend exception at com.thinkaurelius.titan.diskstorage.util.BackendOperation.execute(BackendOperation.java:44) at com.thinkaurelius.titan.diskstorage.keycolumnvalue.cache.CacheTransaction.persist(CacheTransaction.java:86) at com.thinkaurelius.titan.diskstorage.keycolumnvalue.cache.CacheTransaction.flushInternal(CacheTransaction.java:140) . . . . Caused by: com.thinkaurelius.titan.diskstorage.PermanentBackendException: Permanent failure in storage backend at com.thinkaurelius.titan.diskstorage.berkeleyje.BerkeleyJEKeyValueStore.insert(BerkeleyJEKeyValueStore.java:206) . . . . Caused by: com.sleepycat.je.LockTimeoutException: (JE 5.0.73) Lock expired. Locker 2046519996 19950_NotificationHookConsumer thread-0_Txn: waited for lock on database=edgestore LockAddr:2100569783 LSN=0x0/0xeb475 type=WRITE grant=WAIT_PROMOTION timeoutMillis=500 startTime=1501738283510 endTime=1501738284010 Owners: [<LockInfo locker="1619574649 19922_pool-1-thread-4_Txn" type="READ"/>, <LockInfo locker="846918696 19916_pool-1-thread-7_Txn" type="READ"/>, <LockInfo locker="2046519996 19950_NotificationHookConsumer thread-0_Txn" type="READ"/>] Waiters: [] Transaction 2046519996 19950_NotificationHookConsumer thread-0_Txn owns LockAddr:2100569783 <LockInfo locker="2046519996 19950_NotificationHookConsumer thread-0_Txn" type="READ"/> Transaction 2046519996 19950_NotificationHookConsumer thread-0_Txn waits for LockAddr:2100569783 Atlas log With hive 1.1 ------------------------------ 2017-08-04 11:19:15,533 ERROR - [Thread-10:] ~ Evicted [2@7f00010114224-or1010051029126-corp-adobe-com1] from cache but waiting too long for transactions to close. Stale transaction alert on: [standardtitantx[null]] (ManagementLogger$SendAckOnTxClose:189) 2017-08-04 11:19:15,537 ERROR - [Thread-11:] ~ Evicted [3@7f00010114224-or1010051029126-corp-adobe-com1] from cache but waiting too long for transactions to close. Stale transaction alert on: [standardtitantx[null]] (ManagementLogger$SendAckOnTxClose:189) Any help would be highly appreciated. Thanks!