[ 
https://issues.apache.org/jira/browse/ARROW-12306?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=17318190#comment-17318190
 ] 

Andrew Lamb commented on ARROW-12306:
-------------------------------------

[~heymind] I think having the CsvExec be able to read from stdin (aka anything 
that impl `Read`) is a good idea


Perhaps you an extend CsvFile 
https://github.com/apache/arrow/blob/master/rust/datafusion/src/datasource/csv.rs#L50
 so that it can take either a `Path` or something that implements `Read` and 
then pass that information down to the `CsvExec`

> [Rust] Read CSV format text from stdin or memory
> ------------------------------------------------
>
>                 Key: ARROW-12306
>                 URL: https://issues.apache.org/jira/browse/ARROW-12306
>             Project: Apache Arrow
>          Issue Type: Wish
>          Components: Rust - DataFusion
>            Reporter: Siwei
>            Priority: Minor
>
> Hello,
> I'm building a command line tool that can run SQL queries on text files (csv, 
> json-line ..) . But the `CsvExec` in datafusion can only read csv text from 
> files currently. I have checked its inner implantation the csv reader in 
> arrow, anything impl `Read` could be a valid input.
>  
> Should this feature ( read csv from stdin) come with datafusion ? Or I just 
> make it into my own crate.



--
This message was sent by Atlassian Jira
(v8.3.4#803005)

Reply via email to