Mario Molina created SPARK-25241:
------------------------------------
Summary: Configurable empty values when reading/writing CSV files
Key: SPARK-25241
URL: https://issues.apache.org/jira/browse/SPARK-25241
Project: Spark
Issue Type: Improvement
Components: Input/Output
Affects Versions: 2.3.1, 2.4.0
Reporter: Mario Molina
There is an option in the CSV parser to set values when we have empty values in
the CSV files or in our dataframes.
Currently, this option cannot be configured and always sets a default value
(empty string for reading and `""` for writing).
I think it'd be interesting to enable this option in the CSV reader/writer to
allow customizing these empty values.
--
This message was sent by Atlassian JIRA
(v7.6.3#76005)
---------------------------------------------------------------------
To unsubscribe, e-mail: [email protected]
For additional commands, e-mail: [email protected]
