PatrickRen opened a new pull request, #6290: URL: https://github.com/apache/paimon/pull/6290
<!-- Please specify the module before the PR name: [core] ... or [flink] ... --> ### Purpose <!-- Linking this pull request to the issue --> Linked issue: close #6284 <!-- What is the purpose of the change --> This pull request updates the Azure Blob Storage integration and improves object store detection in the codebase. The most important changes are grouped below: **Dependency updates:** * Upgraded the Hadoop shaded filesystem dependency from version 3.3.4 to 3.4.2 in `paimon-filesystems/pom.xml`, which adds supports for Azure Workload Identity authentication in Hadoop's Azure Filesystem. **Azure Blob Storage integration:** * Removed the `requiredOptions` method from the `AzureLoader` class. The original implementation checks if account name and key are set, but this will block usages of other auth mechanisms such as OAuth. **Object store detection improvements:** * Updated the logic in `FlinkFileIO` to recognize the `abfs` scheme as an object store, ensuring proper handling of Azure Blob Storage. ### Tests Unfortunately this pull request doesn't contain any test coverage, as it requires Azure resources for testing, and Azure simulator [Azurite](https://github.com/Azure/Azurite) doesn't support ABFS. However I tested it with my own Azure account with OAuth authentication. ### API and Format No. ### Documentation No. -- This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use the URL above to go to the specific comment. To unsubscribe, e-mail: [email protected] For queries about this service, please contact Infrastructure at: [email protected]
