Not sure why you are dividing by 1000. from_unixtime expects a long type which is time in milliseconds from reference date.
The following should work:
val ds = dataset.withColumn("hour",hour(from_unixtime(dataset.col("ts"))))
--
Sent from: http://apache-spark-user-list.1001560.n3.nabble.com/
---------------------------------------------------------------------
To unsubscribe e-mail: user-unsubscr...@spark.apache.org
