[
https://issues.apache.org/jira/browse/ARROW-4463?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=16759574#comment-16759574
]
Wes McKinney commented on ARROW-4463:
-------------------------------------
See http://wesmckinney.com/blog/feather-arrow-future/
I'm waiting for the R community to sort out the packaging issues so that users
can install an Arrow-based Feather package instead of the current small
prototype that we built in 2016. Once that is possible, then we can look at
replacing the internal detail of Feather files with the Arrow IPC binary
protocol.
Please note that Feather files should not be used for long term data storage.
So once a transition to "Feather v2" happens (i.e. the "feather" name will live
on but be based on the standard IPC protocol) then what you can do is:
* Read Feather file with pyarrow X.Y.Z
* Write data to Arrow IPC file
* Read IPC file, write Feather v2 format (if that's what you want)
I do not think it is a great use of time for Rust or any other language to
support Feather until after first supporting the IPC protocol. The latter is
more general than the former
If you have any uncertainty or questions about Feather please don't hesitate to
ask
> [Rust] Support read:write of Feather files
> ------------------------------------------
>
> Key: ARROW-4463
> URL: https://issues.apache.org/jira/browse/ARROW-4463
> Project: Apache Arrow
> Issue Type: New Feature
> Components: Rust
> Affects Versions: 0.12.0
> Reporter: Neville Dipale
> Assignee: Neville Dipale
> Priority: Major
> Labels: pull-request-available
> Time Spent: 20m
> Remaining Estimate: 0h
>
> As an Arrow developer/user, I'd like to be able to read and write Feather
> files.
> The current I/O story in Rust isn't great, we don't yet fully support reading
> and writing between Parquet, we can only read CSV but not yet writing. This
> is an inconvenience (at least for me).
> I propose supporting the Feather format in Rust, initially with the following
> limitations:
> * No date/time support until ARROW-4386 (and potentially more work) lands
> * Reading categorical data (from other languages) but not writing them
> * Reading and writing from and to single record batches. We don't yet
> support slicing of arrays ARROW-3954
> If the above are accept(ed|able), we can enhance the Feather support as the
> dependencies on the above limitations are lifted.
> We can also refactor the Feather code as we work on more IPC in Rust.
--
This message was sent by Atlassian JIRA
(v7.6.3#76005)
