Nicholas Pezolano created ARROW-2013:
----------------------------------------
Summary: [Python] Add AzureDataLakeFilesystem to be used with
ParquetDataset and reader/writer functions
Key: ARROW-2013
URL: https://issues.apache.org/jira/browse/ARROW-2013
Project: Apache Arrow
Issue Type: New Feature
Reporter: Nicholas Pezolano
Similar to https://issues.apache.org/jira/browse/ARROW-1213, it would be great
to add AzureDLFileSystem as a supported filesystem in ParquetDataset.
Example:
{code:java}
from azure.datalake.store import AzureDLFileSystem
fs = AzureDLFileSystem(token=token, store_name=store_name)
dataset = pq.ParquetDataset(file_list, filesystem=fs){code}
Throws:
{code:java}
IOError: Unrecognized filesystem: <class
'azure.datalake.store.core.AzureDLFileSystem'>{code}
Azures github:
https://github.com/Azure/azure-data-lake-store-python
--
This message was sent by Atlassian JIRA
(v7.6.3#76005)
