I am loading CSV file from S3 bucket in RStudio which is running on EC2 cluster into Spark Data Frame using read.df() function. One of the columns is the Timestamp column. The Timestamp column is being loaded as String.
When I try to convert the Data type to Timestamp using Cast function, all the fields are becoming Null. My ultimate aim is to find difference of Timestamp values of consecutive rows in seconds but I wish to achieve by working on Spark Data Frame and not R Data Frame as it is comparatively slow. Need help for the same ! -- View this message in context: http://apache-spark-user-list.1001560.n3.nabble.com/Trouble-facing-with-Timestamp-column-in-SparkR-when-loading-CSV-file-from-S3-tp26636.html Sent from the Apache Spark User List mailing list archive at Nabble.com. --------------------------------------------------------------------- To unsubscribe, e-mail: user-unsubscr...@spark.apache.org For additional commands, e-mail: user-h...@spark.apache.org
