Do you mind if I ask which format you used to save the data?
I guess you used CSV and there is a related PR open here
https://github.com/apache/spark/pull/14279#issuecomment-237434591
2016-08-12 6:04 GMT+09:00 Jestin Ma :
> When I load in a timestamp column and try to save it immediately witho
When I load in a timestamp column and try to save it immediately without
any transformations, the output time is unix time with padded 0's until
there are 16 values.
For example,
loading in a time of August 3, 2016, 00:36:25 GMT, which is 1470184585 in
UNIX time, saves as 147018458500.
When I