[ 
https://issues.apache.org/jira/browse/ARROW-1231?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=17422892#comment-17422892
 ] 

Antoine Pitrou commented on ARROW-1231:
---------------------------------------

{quote}I would prefer to use googleapis/storage-testbench.
{quote}

No objection from me :-)

{quote}I think there is more than one convention. The most common thing is to 
pretend that prefixes are directories, separated by /. {quote}

This is what we do in our S3 filesystem implementation (and is a common 
convention there too), so we should probably do the same here.

I'll add that handling directories is pretty much mandatory for Arrow, 
otherwise the dataset layer won't be able to read/write partitioned datasets.



> [C++] Add filesystem / IO implementation for Google Cloud Storage
> -----------------------------------------------------------------
>
>                 Key: ARROW-1231
>                 URL: https://issues.apache.org/jira/browse/ARROW-1231
>             Project: Apache Arrow
>          Issue Type: New Feature
>          Components: C++
>            Reporter: Wes McKinney
>            Assignee: Carlos O'Ryan
>            Priority: Major
>              Labels: filesystem
>
> See example jumping off point
> https://github.com/tensorflow/tensorflow/tree/master/tensorflow/core/platform/cloud



--
This message was sent by Atlassian Jira
(v8.3.4#803005)

Reply via email to