andrei-ionescu commented on issue #3283: URL: https://github.com/apache/arrow-rs/issues/3283#issuecomment-1341384884
@roeap I tried using the code in Delta Lake for accessing Azure Data Lake (the one that you have given above). It all ends up trying to access data in ADLS Gen2 with the wrong domain — `https://{}.blob.core.windows.net` — and wrong API. For ADLS the domain should be `dfs.core.windows.net`. In the current implementation, an ADLS Gen2 URL: ``` abfss://my_file_system@az_account_name.dfs.core.windows.net/my/path/id1/id2/ ``` Is transformed into: ``` https://az_account_name.blob.core.windows.net/my_file_system/my/path/id1/id2/ ``` Which I don't think is correct for the ADLS Gen2 case. It should be: ``` https://az_account_name.dfs.core.windoww.net/my_file_system?directory=my/path/id1/id2/&resource=filesystem ``` as defined here: https://learn.microsoft.com/en-us/rest/api/storageservices/datalakestoragegen2/path/list @tustvold I also tried listing the files with the method you provided. The same result. I goes to the wrong domain. -- This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use the URL above to go to the specific comment. To unsubscribe, e-mail: [email protected] For queries about this service, please contact Infrastructure at: [email protected]
