Nate Clark created ARROW-13441:
----------------------------------
Summary: [CSV] Streaming reader conversion should skip empty blocks
Key: ARROW-13441
URL: https://issues.apache.org/jira/browse/ARROW-13441
Project: Apache Arrow
Issue Type: Bug
Components: C++
Affects Versions: 5.0.0
Reporter: Nate Clark
Assignee: Nate Clark
The csv streaming reader hardens the schema after the first block is processed.
However if the first block does not have any rows then the schema will be
hardened with all columns as NAType. This is made worse with the
skip_rows_after_names options which will create empty batches until the
specified number of rows are skipped.
--
This message was sent by Atlassian Jira
(v8.3.4#803005)