parisni commented on issue #3731:
URL: https://github.com/apache/hudi/issues/3731#issuecomment-992283484
with the 0.10.0, things looks better: I only get one kind of concurrency
error.
When running 4 concurrent writers into their own partition, I consistently
get
the bellow error for 2 of them. I
from my config, I am expecting the lock to be able to wait a long time before
failing. Here the whole process is running for 25 seconds :
```python
"hoodie.write.lock.wait_time_ms": "120000",
"hoodie.write.lock.wait_time_ms_between_retry": "2000",
"hoodie.write.lock.num_retries": "100",
```
> org.apache.hudi.exception.HoodieLockException: Unable to acquire lock,
lock object LockResponse(lockid:27, state:WAITING)
> at
org.apache.hudi.client.transaction.lock.LockManager.lock(LockManager.java:82)
> at
org.apache.hudi.client.transaction.TransactionManager.beginTransaction(TransactionManager.java:64)
> at
org.apache.hudi.client.AbstractHoodieWriteClient.commitStats(AbstractHoodieWriteClient.java:192)
> at
org.apache.hudi.client.SparkRDDWriteClient.commit(SparkRDDWriteClient.java:124)
> at
org.apache.hudi.HoodieSparkSqlWriter$.commitAndPerformPostOperations(HoodieSparkSqlWriter.scala:633)
> at
org.apache.hudi.HoodieSparkSqlWriter$.write(HoodieSparkSqlWriter.scala:284)
> at org.apache.hudi.DefaultSource.createRelation(DefaultSource.scala:164)
--
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.
To unsubscribe, e-mail: [email protected]
For queries about this service, please contact Infrastructure at:
[email protected]
