andrei-ionescu commented on issue #3283: URL: https://github.com/apache/arrow-rs/issues/3283#issuecomment-1341557528
@tustvold: HDFS with ADLS Gen2 API is different than HDFS + Azure Blob. Here is list files from ADLS Gen2 with HDFS: https://learn.microsoft.com/en-us/azure/storage/blobs/data-lake-storage-use-hdfs-data-lake-storage#get-a-list-of-files-or-directories. I'm not interested in additional functionalities that ADLS Gen2 offers. What I want is to be able to use the `object_store` to access data from ADLS Gen2 with Arrow DataFusion. I know that DataFusion uses Object Store to read from S3 and Azure Blob store but my data is in ADLS Gen2. I'm currently able to use `abfss://my_file_system@az_account_name.dfs.core.windows.net/my/path/id1/id2/` paths with Apache Spark to read and write, but I wold like to have the same functionality in DataFusion. -- This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use the URL above to go to the specific comment. To unsubscribe, e-mail: [email protected] For queries about this service, please contact Infrastructure at: [email protected]
