bryanck opened a new pull request, #8303: URL: https://github.com/apache/iceberg/pull/8303
This PR adds a FileIO implementation for Azure Data Lake Storage Gen2. The URI format was kept consistent with Hadoop's Azure URI format to make any transition easier. Range reads were also implemented. The new FileIO was added as a delegate type in ResolvingFileIO. To keep the PR somewhat straightforward, authorization was limited to using the default Azure credential chain. Also prefix and bulk operation mixin interfaces were not yet implemented. These will be addressed in a follow-up PR. Also added was an Azure bundle project for building a jar with the necessary Azure dependencies when running with Spark or Flink. This is similar to the bundles for AWS and GCP. Also, the project was added as a dependency to the Spark and Flink runtimes, similar to AWS and GCP. -- This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use the URL above to go to the specific comment. To unsubscribe, e-mail: [email protected] For queries about this service, please contact Infrastructure at: [email protected] --------------------------------------------------------------------- To unsubscribe, e-mail: [email protected] For additional commands, e-mail: [email protected]
