nicolas paris created SPARK-28779:
-------------------------------------

             Summary: CSV writer doesn't handle older Mac line endings
                 Key: SPARK-28779
                 URL: https://issues.apache.org/jira/browse/SPARK-28779
             Project: Spark
          Issue Type: Bug
          Components: Spark Core
    Affects Versions: 2.4.0, 2.3.0
            Reporter: nicolas paris


The spark csv writer does not consider "\r"  as a newline in string type 
columns. As a result, the resulting csv are not quoted, and they get corrupted.

All \n, \r\n and \r should be considered as newline to allow robust csv 
serialization.



--
This message was sent by Atlassian Jira
(v8.3.2#803003)

---------------------------------------------------------------------
To unsubscribe, e-mail: issues-unsubscr...@spark.apache.org
For additional commands, e-mail: issues-h...@spark.apache.org

Reply via email to