[
https://issues.apache.org/jira/browse/ARROW-4463?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=16759531#comment-16759531
]
Neville Dipale commented on ARROW-4463:
---------------------------------------
Thanks Andy, i nearly missed your reply.
It's a bit confusing because when I looked at wesm/feather, the position seems
to be that once R bindings for Arrow are created, Feather-based IPC will live
in Arrow, and perhaps be improved or superseded by Arrow File format. At the
same time, from looking at pyarrow, it doesn't seem like Arrow File is used,
because 'Tables' are saved as parquet files.
I need(ed) a way to read my existing Feather files, and be able to write
whatever changes I make, back. I think there's still quite a bit outstanding re
Arrow + Parquet before one could use them together in Rust. So I was stuck and
decided to go down the Feather route in the interim.
I'm also interested in Arrow IPC, and will contribute to making it happen once
we've added some currently blocking functionality. If Feather in Rust doesn't
make sense, I can keep the code out of tree, and continue using it for my needs.
> [Rust] Support read:write of Feather files
> ------------------------------------------
>
> Key: ARROW-4463
> URL: https://issues.apache.org/jira/browse/ARROW-4463
> Project: Apache Arrow
> Issue Type: New Feature
> Components: Rust
> Affects Versions: 0.12.0
> Reporter: Neville Dipale
> Assignee: Neville Dipale
> Priority: Major
> Labels: pull-request-available
> Time Spent: 20m
> Remaining Estimate: 0h
>
> As an Arrow developer/user, I'd like to be able to read and write Feather
> files.
> The current I/O story in Rust isn't great, we don't yet fully support reading
> and writing between Parquet, we can only read CSV but not yet writing. This
> is an inconvenience (at least for me).
> I propose supporting the Feather format in Rust, initially with the following
> limitations:
> * No date/time support until ARROW-4386 (and potentially more work) lands
> * Reading categorical data (from other languages) but not writing them
> * Reading and writing from and to single record batches. We don't yet
> support slicing of arrays ARROW-3954
> If the above are accept(ed|able), we can enhance the Feather support as the
> dependencies on the above limitations are lifted.
> We can also refactor the Feather code as we work on more IPC in Rust.
--
This message was sent by Atlassian JIRA
(v7.6.3#76005)
