[
https://issues.apache.org/jira/browse/ARROW-1213?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=16085777#comment-16085777
]
Yacko commented on ARROW-1213:
------------------------------
Thank you for the quick reply. I do have time, but honestly not quite sure if
my technical acumen is enough to solve these issues. within a reasonable
time-frame.
Going forward I will report features or issues instead of using the SO post. I
was only aware that there was some gap between s3 & pyarrow, but didn't quite
stumble open the open issues
[ARROW-1119|https://issues.apache.org/jira/browse/ARROW-1119] &
[ARROW-453|https://issues.apache.org/jira/browse/ARROW-453] that you have
mentioned.
Not quite sure if the existing open issues includes the s3fs implementation
option currently.
> can we add support for pyarrow to read from s3 based on partitions
> ------------------------------------------------------------------
>
> Key: ARROW-1213
> URL: https://issues.apache.org/jira/browse/ARROW-1213
> Project: Apache Arrow
> Issue Type: Improvement
> Reporter: Yacko
> Priority: Minor
>
> Pyarrow dataset function can't read from s3 using s3fs as the filesystem. Is
> there a way we can add the support for read from s3 based on partitioned
> files ?
> I am trying to address the problem mentioned in the stackoverflow link :
> https://stackoverflow.com/questions/45082832/how-to-read-partitioned-parquet-files-from-s3-using-pyarrow-in-python
--
This message was sent by Atlassian JIRA
(v6.4.14#64029)
