[ https://issues.apache.org/jira/browse/ARROW-1555?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=16172076#comment-16172076 ]
Florian Jetter commented on ARROW-1555: --------------------------------------- [~wesmckinn] Yes, it seems like some abstract methods of the FileSystem class (exists, open, etc.) were not implemented in the wrapper. I'll take care of it > PyArrow write_to_dataset on s3 > ------------------------------ > > Key: ARROW-1555 > URL: https://issues.apache.org/jira/browse/ARROW-1555 > Project: Apache Arrow > Issue Type: Bug > Affects Versions: 0.7.0 > Reporter: Young-Jun Ko > Priority: Trivial > Fix For: 0.8.0 > > > When writing a arrow table to s3, I get an NotImplemented Exception. > The root cause is in _ensure_filesystem and can be reproduced as follows: > import pyarrow > import pyarrow.parquet as pqa > import s3fs > s3 = s3fs.S3FileSystem() > pqa._ensure_filesystem(s3).exists("anything") > It appears that the S3FSWrapper that is instantiated in _ensure_filesystem > does not expose the exist method of s3. -- This message was sent by Atlassian JIRA (v6.4.14#64029)