Hi Daniel, It looks like your update is happening on thread-8. Do you know what is happening on thread-6? That appears to still be holding a read lock.... Strange that it hasn't released. Was thread-6 the thread used by the CRUD operations? If so I would have expected it to have committed (or rolled back if necessary), in which case the lock should have been released.
Best regards, Graham Graham Wallis IBM Analytics Emerging Technology Center Internet: [email protected] IBM Laboratories, Hursley Park, Hursley, Hampshire SO21 2JN Tel: +44-1962-815356 Tie: 7-245356 From: Daniel Lee <[email protected]> To: [email protected] Date: 03/10/2017 23:12 Subject: import-hive.sh error when running against berkeleydb + elasticsearch I've installed and configured a single node instance of atlas. It ran the quickstart.sh set up and I can see all the meta data. I can also do basic CRUD operations through the API. When I try to import a single table hive example using the import-hive.sh script, I run into an error on the Berkeley DB storage backend. I'm going to reset to the installation branch and try the local hbase+solr installation to get around this roadblock. Later I'll try and do a more in depth investigation into causes. Apologies for the crappy formatting. Daniel Lee 2017-10-03 14:40:53,229 ERROR - [pool-1-thread-8 - f6cec1a7-1f19-4aea-811b-b02b646f5bc0:] ~ Unable to update entity by GUID 71460f15-4c8b-4f8d-9377-e40ed4d810f1 {"jsonClass":"org.apache.atlas.typesystem.json.InstanceSerialization$_Reference","id":{"jsonClass":"org.apache.atlas.typesystem.json.InstanceSerialization$_Id","id":"71460f15-4c8b-4f8d-9377-e40ed4d810f1","version":0,"typeName":"hive_db","state":"ACTIVE"},"typeName":"hive_db","values":{"name":"default","location":"hdfs://localhost:9000/user/hive/warehouse","description":"Default Hive database","ownerType":2,"qualifiedName":"default@primary","owner":"public","clusterName":"primary","parameters":{}},"traitNames":[],"traits":{},"systemAttributes":{"createdBy":"admin","modifiedBy":"admin","createdTime":"2017-10-03T21:26:44.312Z","modifiedTime":"2017-10-03T21:26:44.312Z"}} (EntityResource:509) com.thinkaurelius.titan.core.TitanException: Could not commit transaction due to exception during persistence at com.thinkaurelius.titan.graphdb.transaction.StandardTitanTx.commit(StandardTitanTx.java:1348) .... Caused by: com.thinkaurelius.titan.core.TitanException: Could not execute operation due to backend exception at com.thinkaurelius.titan.diskstorage.util.BackendOperation.execute(BackendOperation.java:44) at com.thinkaurelius.titan.diskstorage.keycolumnvalue.cache.CacheTransaction.persist(CacheTransaction.java:86) at com.thinkaurelius.titan.diskstorage.keycolumnvalue.cache.CacheTransaction.flushInternal(CacheTransaction.java:140) .... Caused by: com.thinkaurelius.titan.diskstorage.PermanentBackendException: Permanent failure in storage backend at com.thinkaurelius.titan.diskstorage.berkeleyje.BerkeleyJEKeyValueStore.insert(BerkeleyJEKeyValueStore.java:206) at com.thinkaurelius.titan.diskstorage.berkeleyje.BerkeleyJEKeyValueStore.insert(BerkeleyJEKeyValueStore.java:183) at com.thinkaurelius.titan.diskstorage.berkeleyje.BerkeleyJEStoreManager.mutateMany(BerkeleyJEStoreManager.java:193) at com.thinkaurelius.titan.diskstorage.keycolumnvalue.keyvalue.OrderedKeyValueStoreManagerAdapter.mutateMany(OrderedKeyValueStoreManagerAdapter.java:100) .... Caused by: com.sleepycat.je.LockTimeoutException: (JE 5.0.73) Lock expired. Locker 1070091868 32844_pool-1-thread-8 - f6cec1a7-1f19-4aea-811b-b02b646f5bc0_Txn: waited for lock on database=edgestore LockAddr:1375011805 LSN=0x0/0xe6ff0 type=WRITE grant=WAIT_PROMOTION timeoutMillis=500 startTime=1507066852720 endTime=1507066853224 Owners: [<LockInfo locker="1070091868 32844_pool-1-thread-8 - f6cec1a7-1f19-4aea-811b-b02b646f5bc0_Txn" type="READ"/>, <LockInfo locker="1701677508 32843_pool-1-thread-6_Txn" type="READ"/>] Waiters: [] Transaction 1070091868 32844_pool-1-thread-8 - f6cec1a7-1f19-4aea-811b-b02b646f5bc0_Txn owns LockAddr:1375011805 <LockInfo locker="1070091868 32844_pool-1-thread-8 - f6cec1a7-1f19-4aea-811b-b02b646f5bc0_Txn" type="READ"/> Transaction 1070091868 32844_pool-1-thread-8 - f6cec1a7-1f19-4aea-811b-b02b646f5bc0_Txn waits for LockAddr:1375011805 at com.sleepycat.je.txn.LockManager.newLockTimeoutException(LockManager.java:664) at com.sleepycat.je.txn.LockManager.makeTimeoutMsgInternal(LockManager.java:623) at com.sleepycat.je.txn.SyncedLockManager.makeTimeoutMsg(SyncedLockManager.java:97) at com.sleepycat.je.txn.LockManager.lockInternal(LockManager.java:390) at com.sleepycat.je.txn.LockManager.lock(LockManager.java:276) at com.sleepycat.je.txn.Txn.lockInternal(Txn.java:498) at com.sleepycat.je.txn.Locker.lock(Locker.java:443) at com.sleepycat.je.dbi.CursorImpl.lockLN(CursorImpl.java:2621) at com.sleepycat.je.dbi.CursorImpl.getSlotReuseInfo(CursorImpl.java:1091) at com.sleepycat.je.dbi.CursorImpl.putInternal(CursorImpl.java:880) at com.sleepycat.je.dbi.CursorImpl.put(CursorImpl.java:811) at com.sleepycat.je.Cursor.putAllowPhantoms(Cursor.java:2243) at com.sleepycat.je.Cursor.putNoNotify(Cursor.java:2200) at com.sleepycat.je.Cursor.putNotify(Cursor.java:2117) at com.sleepycat.je.Cursor.putNoDups(Cursor.java:2052) at com.sleepycat.je.Cursor.putInternal(Cursor.java:2020) at com.sleepycat.je.Database.putInternal(Database.java:1302) at com.sleepycat.je.Database.put(Database.java:1172) at com.thinkaurelius.titan.diskstorage.berkeleyje.BerkeleyJEKeyValueStore.insert(BerkeleyJEKeyValueStore.java:194) ... 105 more Unless stated otherwise above: IBM United Kingdom Limited - Registered in England and Wales with number 741598. Registered office: PO Box 41, North Harbour, Portsmouth, Hampshire PO6 3AU
