gtwuser commented on issue #6463:
URL: https://github.com/apache/hudi/issues/6463#issuecomment-1237680757

   > 
   
   @nsivabalan  sorry for this delay in response, actually sorry i m not sure 
what is meant by multi-writers, but we `removed` concurrent writes to table, 
which was done using `ThreadPoolExecutor` concept in python 
https://docs.python.org/3/library/concurrent.futures.html. And yes that was 
without any lock configuration. 
   
   I was checking there are two suggested ways to achieve this via zookeeper or 
via Hive metastore. 
   Will be really kind of you to explain though, if you can explain if we dont 
have zookeeper available before hand, as we are working in AWS Glue 
environment, what can we do to achiev lock, OR can you share one example of 
achieving this via Hive ? 
   
   Also since i deleted all the records and recreated it sequentially i have 
lost the .hoodie contents. I will try to simulate the same issue again post the 
content asap. 


-- 
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.

To unsubscribe, e-mail: [email protected]

For queries about this service, please contact Infrastructure at:
[email protected]

Reply via email to