Github user viirya commented on the issue:
https://github.com/apache/spark/pull/22171
Scientific notation is more efficient on saving the values in CSV. If there
are many zero values of high scale decimal type, this non scientific notation
can cost storage space and loading time.
I'm not sure if there is a standard for this. But I did a search roughly,
looks like it is common to save decimal values as scientific notation in CSV.
---
---------------------------------------------------------------------
To unsubscribe, e-mail: [email protected]
For additional commands, e-mail: [email protected]
