nsivabalan commented on issue #5796: URL: https://github.com/apache/hudi/issues/5796#issuecomment-1152916139
As you could see, the root exception ``` 22/06/08 14:51:51 ERROR Worker: abfss://<xxxx>/.hoodie/hoodie.properties': Input/output error: Parallel access to the create path detected. Failing request to honor single writer semantics org.apache.hadoop.fs.PathIOException: abfss:///.hoodie/hoodie.properties': Input/output error: Parallel access to the create path detected. Failing request to honor single writer semantics at shaded.databricks.azurebfs.org.apache.hadoop.fs.azurebfs.AzureBlobFileSystem.checkException(AzureBlobFileSystem.java:1359) at shaded.databricks.azurebfs.org.apache.hadoop.fs.azurebfs.AzureBlobFileSystem.create(AzureBlobFileSystem.java:294) ``` is thrown from AzureBlobFileSytem. Can you explore to see how we can enable multi-writers in AzureBlobFileSystem. If not, two diff processes/writers should be able to write concurrently to same file right? I mean, only one will win in the end, but concurrent writing should be feasible right? or is it that no two writers are allowed to write using AzureBlobFileSystem (I meant, to same file)? I haven't used AzureBlobFileSytem. so would help if you can clarify. -- This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use the URL above to go to the specific comment. To unsubscribe, e-mail: [email protected] For queries about this service, please contact Infrastructure at: [email protected]
