Github user jurriaan commented on the pull request:
https://github.com/apache/spark/pull/13267#issuecomment-221387961
@rxin Good question, I'm not sure what's the best approach here. It looks
like setting the flag to true by default could be a good choice.
The comment at
[https://github.com/uniVocity/univocity-parsers/blob/f3eb2af26374940e60d91d1703bde54619f50c51/src/main/java/com/univocity/parsers/csv/CsvWriterSettings.java#L231-L247](src/main/java/com/univocity/parsers/csv/CsvWriterSettings.java)
mentions the default behaviour (quoteEscapingEnabled set to false) is not
valid CSV according to RFC 4180.
To quote RFC 4180:
> If fields are not enclosed with double quotes, then double quotes may not
appear inside the fields.
I'm not sure why they chose to turn it off by default. Maybe performance
reasons?
---
If your project is set up for it, you can reply to this email and have your
reply appear on GitHub as well. If your project does not have this feature
enabled and wishes so, or if the feature is enabled but not working, please
contact infrastructure at [email protected] or file a JIRA ticket
with INFRA.
---
---------------------------------------------------------------------
To unsubscribe, e-mail: [email protected]
For additional commands, e-mail: [email protected]
