[
https://issues.apache.org/jira/browse/ARROW-3726?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=16691880#comment-16691880
]
nevi_me commented on ARROW-3726:
--------------------------------
Thanks [~andygrove], does the reader support inferring data schema? I got
schema inference working through sampling a csv and using the regex crate to
match fields by some hierarchy.
It worked relatively well on primitive types, but I struggled with timestamps
because I was trying to read from csv to parquet. For timestamps we could allow
the user to specify the format (yyyy-mm-dd-... etc), or default to an ISO
format. What do you think?
> [Rust] CSV Reader & Writer
> --------------------------
>
> Key: ARROW-3726
> URL: https://issues.apache.org/jira/browse/ARROW-3726
> Project: Apache Arrow
> Issue Type: New Feature
> Components: Rust
> Reporter: nevi_me
> Assignee: Andy Grove
> Priority: Major
> Labels: pull-request-available
> Time Spent: 10m
> Remaining Estimate: 0h
>
> As an Arrow Rust user, I would like to be able to read and write CSV files,
> so that I can quickly ingest data into an Arrow format for futher use, and
> save outputs in CSV.
> As there aren't yet many options for working with tabular/df structures in
> Rust (other than Andy's DataFusion), I'm struggling to motivate for this
> feature. However, I think building a csv parser into Rust would reduce effort
> for future libs (incl DataFusion).
--
This message was sent by Atlassian JIRA
(v7.6.3#76005)
