Tomasz Bartczak created SPARK-29437:

             Summary: CSV Writer should escape 'escapechar' when it exists in 
the data
                 Key: SPARK-29437
             Project: Spark
          Issue Type: Bug
          Components: Input/Output
    Affects Versions: 2.4.3
            Reporter: Tomasz Bartczak

When the data contains escape character (default '\') it should either be 
escaped or quoted.

Steps to reproduce: 


The effect can be either bad data read or sometimes even unable to properly 
read the csv, e.g. when escape character is the last character in the column - 
it break the column reading for that row and effectively break e.g. type 
inference for a dataframe

This message was sent by Atlassian Jira

To unsubscribe, e-mail:
For additional commands, e-mail:

Reply via email to