Nate Clark created ARROW-13441:
----------------------------------

             Summary: [CSV] Streaming reader conversion should skip empty blocks
                 Key: ARROW-13441
                 URL: https://issues.apache.org/jira/browse/ARROW-13441
             Project: Apache Arrow
          Issue Type: Bug
          Components: C++
    Affects Versions: 5.0.0
            Reporter: Nate Clark
            Assignee: Nate Clark


The csv streaming reader hardens the schema after the first block is processed. 
However if the first block does not have any rows then the schema will be 
hardened with all columns as NAType. This is made worse with the 
skip_rows_after_names options which will create empty batches until the 
specified number of rows are skipped.



--
This message was sent by Atlassian Jira
(v8.3.4#803005)

Reply via email to