It was a simple CTAS Query, create table final_table as select a.* from table_a a inner join table_b b on a.id=b.id
Where table_a and table_b just had a few records. On Mon, Aug 14, 2017 at 6:01 AM, Madhan Neethiraj <mad...@apache.org> wrote: > Vineet, > > > > It is not clear what might cause this error. To investigate this issue > further, can you send the SQL statements that lead to this error? > > > > Thanks, > > Madhan > > > > > > > > > > *From: *Vineet Mishra <clearmido...@gmail.com> > *Reply-To: *"user@atlas.apache.org" <user@atlas.apache.org> > *Date: *Wednesday, August 9, 2017 at 3:45 AM > *To: *"user@atlas.apache.org" <user@atlas.apache.org> > *Subject: *Re: Atlas not working for complex hive query on single node > > > > Hi Guys, > > > > Any update on this? > > > > Caused by: com.sleepycat.je.LockTimeoutException: (JE 5.0.73) Lock > expired. Locker 768997492 3544_NotificationHookConsumer thread-0_Txn: > waited for lock on database=edgestore LockAddr:1860143233 LSN=0x0/0xc8613 > type=WRITE grant=WAIT_PROMOTION timeoutMillis=500 startTime=1502275039421 > endTime=1502275039921 > > Owners: [<LockInfo locker="768997492 3544_NotificationHookConsumer > thread-0_Txn" type="READ"/>, <LockInfo locker="1176127601 > 3312_pool-1-thread-7_Txn" type="READ"/>] > > Waiters: [] > > Transaction 768997492 3544_NotificationHookConsumer thread-0_Txn owns > LockAddr:1860143233 <LockInfo locker="768997492 > 3544_NotificationHookConsumer thread-0_Txn" type="READ"/> > > Transaction 768997492 3544_NotificationHookConsumer thread-0_Txn waits for > LockAddr:1860143233 > > > > at com.sleepycat.je.txn.LockManager.newLockTimeoutException( > LockManager.java:664) > > at com.sleepycat.je.txn.LockManager.makeTimeoutMsgInternal( > LockManager.java:623) > > at com.sleepycat.je.txn.SyncedLockManager.makeTimeoutMsg( > SyncedLockManager.java:97) > > > > I am not able to generate lineage due to this issue. > > > > Thanks! > > > > On Fri, Aug 4, 2017 at 5:05 PM, Vineet Mishra <clearmido...@gmail.com> > wrote: > > Hi Team, > > > > I am using Atlas 0.8 release branch with hive 2.1 which works fine with > hive import and with simple CTAS on hive but as when I give CTAS with some > joins, its start failing to create lineage(the metadata still is captured > by atlas) > > > > Also when I am running the same stuff with hive 1.1.0 it doesn't even get > the metadata in the latter case, looks like there some persistence issue as > what logs depicts. Has any one been through this situation? > > > > Atlas log with hive 2.1 > > ------------------------------- > > 2017-08-03 05:31:24,011 ERROR - [NotificationHookConsumer thread-0:] ~ > Could not commit transaction [71] due to storage exception in commit > (StandardTitanGraph:673) > > com.thinkaurelius.titan.core.TitanException: Could not execute operation > due to backend exception > > at com.thinkaurelius.titan.diskstorage.util. > BackendOperation.execute(BackendOperation.java:44) > > at com.thinkaurelius.titan.diskstorage.keycolumnvalue. > cache.CacheTransaction.persist(CacheTransaction.java:86) > > at com.thinkaurelius.titan.diskstorage.keycolumnvalue. > cache.CacheTransaction.flushInternal(CacheTransaction.java:140) > > . > > . > > . > > . > > Caused by: com.thinkaurelius.titan.diskstorage.PermanentBackendException: > Permanent failure in storage backend > > at com.thinkaurelius.titan.diskstorage.berkeleyje. > BerkeleyJEKeyValueStore.insert(BerkeleyJEKeyValueStore.java:206) > > . > > . > > . > > . > > Caused by: com.sleepycat.je.LockTimeoutException: (JE 5.0.73) Lock > expired. Locker 2046519996 19950_NotificationHookConsumer thread-0_Txn: > waited for lock on database=edgestore LockAddr:2100569783 LSN=0x0/0xeb475 > type=WRITE grant=WAIT_PROMOTION timeoutMillis=500 startTime=1501738283510 > endTime=1501738284010 > > Owners: [<LockInfo locker="1619574649 19922_pool-1-thread-4_Txn" > type="READ"/>, <LockInfo locker="846918696 19916_pool-1-thread-7_Txn" > type="READ"/>, <LockInfo locker="2046519996 19950_NotificationHookConsumer > thread-0_Txn" type="READ"/>] > > Waiters: [] > > Transaction 2046519996 19950_NotificationHookConsumer thread-0_Txn owns > LockAddr:2100569783 <LockInfo locker="2046519996 > 19950_NotificationHookConsumer thread-0_Txn" type="READ"/> > > Transaction 2046519996 19950_NotificationHookConsumer thread-0_Txn waits > for LockAddr:2100569783 > > > > > > Atlas log With hive 1.1 > > ------------------------------ > > 2017-08-04 11:19:15,533 ERROR - [Thread-10:] ~ Evicted [2@7f00010114224- > or1010051029126-corp-adobe-com1] from cache but waiting too long for > transactions to close. Stale transaction alert on: [standardtitantx[null]] > (ManagementLogger$SendAckOnTxClose:189) > > 2017-08-04 11:19:15,537 ERROR - [Thread-11:] ~ Evicted [3@7f00010114224- > or1010051029126-corp-adobe-com1] from cache but waiting too long for > transactions to close. Stale transaction alert on: [standardtitantx[null]] > (ManagementLogger$SendAckOnTxClose:189) > > > > > > Any help would be highly appreciated. > > > > Thanks! > > >