[
https://issues.apache.org/jira/browse/ARROW-1231?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=17423170#comment-17423170
]
Sergey Serebryakov commented on ARROW-1231:
-------------------------------------------
Hi [~coryan], I have been working on the native GCS implementation as well as
of a few months ago. To my understanding, my previous employer is successfully
using that implementation internally (probably with a few extra fixes), but it
is far from being thoroughly tested. It is based on Arrow 3.0.0 and has only
the "read" part of the API implemented (so no uploads or deletes). I've used
fake-gcs-server for the testing and relied on libgoogle_cloud_storage being
pre-installed in the system. The implementation also includes the flags like
{{-DARROW_GCS=ON}} which I added by full-text search for "S3" 😅
Please see if you find it useful:
[https://github.com/megaserg/arrow/tree/megaserg/add-gcs]
Happy to help with anything!
> [C++] Add filesystem / IO implementation for Google Cloud Storage
> -----------------------------------------------------------------
>
> Key: ARROW-1231
> URL: https://issues.apache.org/jira/browse/ARROW-1231
> Project: Apache Arrow
> Issue Type: New Feature
> Components: C++
> Reporter: Wes McKinney
> Assignee: Carlos O'Ryan
> Priority: Major
> Labels: filesystem
>
> See example jumping off point
> https://github.com/tensorflow/tensorflow/tree/master/tensorflow/core/platform/cloud
--
This message was sent by Atlassian Jira
(v8.3.4#803005)
