Justin Uang created SPARK-25493:
-----------------------------------
Summary: CRLF Line Separators don't work in multiline CSVs
Key: SPARK-25493
URL: https://issues.apache.org/jira/browse/SPARK-25493
Project: Spark
Issue Type: Bug
Components: SQL
Affects Versions: 2.3.1
Reporter: Justin Uang
CSVs with windows style crlf (carriage return line feed) don't work in
multiline mode. They work fine in single line mode because the line separation
is done by Hadoop, which can handle all the different types of line separators.
In multiline mode, the Univocity parser is used to also handle splitting of
records.
--
This message was sent by Atlassian JIRA
(v7.6.3#76005)
---------------------------------------------------------------------
To unsubscribe, e-mail: [email protected]
For additional commands, e-mail: [email protected]
