rdsr opened a new issue #366: Concurrent appends to the same table using HiveCatalog lead to deadlock URL: https://github.com/apache/incubator-iceberg/issues/366 I've noticed that, appending files the the same table from multiple threads takes a very large amount of time. The problem is more evident if the number of threads are more. From the logs it seems there's deadlock in the Metastore. Below is the log I'm pasting from the test case. > [main] INFO org.apache.iceberg.BaseMetastoreTableOperations - Refreshing table metadata from new version: file:/var/folders/dg/xnsw71ls347dkft4qr284zr4000bt7/T/hive3179686150067127808/hivedb.db/tbl/metadata/00000-5001916d-81a9-408c-ad9e-9cdec89090e1.metadata.json > [main] INFO org.apache.iceberg.BaseMetastoreTableOperations - Refreshing table metadata from new version: file:/var/folders/dg/xnsw71ls347dkft4qr284zr4000bt7/T/hive3179686150067127808/hivedb.db/tbl/metadata/00000-5001916d-81a9-408c-ad9e-9cdec89090e1.metadata.json > Starting append 0 > Starting append 1 > Starting append 2 > Starting append 3 > Starting append 4 > Starting append 5 > Starting append 6 > Starting append 7 > Starting append 8 > Starting append 9 > 2019-08-08 11:08:59,302 WARN [pool-3-thread-2] txn.TxnHandler (TxnHandler.java:checkRetryable(982)) - Deadlock detected in checkLock(CheckLockRequest(lockid:7) ). Will wait 200ms try again up to 10 times. > 2019-08-08 11:09:19,518 WARN [pool-3-thread-3] txn.TxnHandler (TxnHandler.java:checkRetryable(982)) - Deadlock detected in checkLock(CheckLockRequest(lockid:6) ). Will wait 200ms try again up to 10 times. > 2019-08-08 11:09:39,743 WARN [pool-3-thread-3] txn.TxnHandler (TxnHandler.java:checkRetryable(982)) - Deadlock detected in checkLock(CheckLockRequest(lockid:6) ). Will wait 400ms try again up to 9 times. > [pool-6-thread-7] INFO org.apache.iceberg.SnapshotProducer - Committed snapshot 3707713582032677660 (MergeAppend) The testcase is published here: https://github.com/apache/incubator-iceberg/compare/master...rdsr:hivecatalog_deadlock?expand=1 Most likely not a bug in Iceberg, but creating ticket for tracking purposes
---------------------------------------------------------------- This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use the URL above to go to the specific comment. For queries about this service, please contact Infrastructure at: [email protected] With regards, Apache Git Services --------------------------------------------------------------------- To unsubscribe, e-mail: [email protected] For additional commands, e-mail: [email protected]
