Joris Van den Bossche created ARROW-10432:
---------------------------------------------

             Summary: [C++] CSV reader: support for multi-character / 
whitespace delimiter?
                 Key: ARROW-10432
                 URL: https://issues.apache.org/jira/browse/ARROW-10432
             Project: Apache Arrow
          Issue Type: Improvement
          Components: C++
            Reporter: Joris Van den Bossche


I don't know how useful general "multi-character" delimiter support is, but one 
specific type of it that seems useful is "whitespace delimited", meaning any 
whitespace (possibly multiple / different whitespace characters). 

In pandas you can achieve this either by passing {{delimiter="\s+"}} or 
specifying {{delim_whitespace=True}} (and both are equivalent, pandas special 
cases {{delimiter="\s+"}} as any other multi-character delimiter is interpreted 
as an actual regex and triggers the slower python engine intead of using the 
default c engine)

cc [~apitrou] [~npr]



--
This message was sent by Atlassian Jira
(v8.3.4#803005)

Reply via email to