[ 
https://issues.apache.org/jira/browse/ARROW-6004?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=16890923#comment-16890923
 ] 

Antoine Pitrou commented on ARROW-6004:
---------------------------------------

> Correct behavior should be to fill those empty lines with missing data for 
> all columns.

Uh, why would it? I know CSV is not an extremely well-specified format, but 
that sounds to me a bit far-fetched. It's also a bit problematic: how do you 
deal with empty lines at the beginning of a file? You don't know the number of 
columns yet.

[~wesmckinn]

> [C++] CSV reader ignore_empty_lines option doesn't handle empty lines
> ---------------------------------------------------------------------
>
>                 Key: ARROW-6004
>                 URL: https://issues.apache.org/jira/browse/ARROW-6004
>             Project: Apache Arrow
>          Issue Type: Bug
>          Components: C++
>            Reporter: Neal Richardson
>            Priority: Minor
>              Labels: csv
>
> Followup to https://issues.apache.org/jira/browse/ARROW-5747. If 
> {{ignore_empty_lines}} is false and there are empty lines, it fails to parse 
> (again, with {{Invalid: Empty CSV file}}).
> Correct behavior should be to fill those empty lines with missing data for 
> all columns.



--
This message was sent by Atlassian JIRA
(v7.6.14#76016)

Reply via email to