Hi,
I need to add 8 hours to from_unixtimestamp
df.withColumn(from_unixtime(col("unix_timestamp"),fmt)) as "date_time"
I am try to joda time function
def unixToDateTime (unix_timestamp : String) : DateTime = {
val utcTS = new DateTime(unix_timestamp.toLong * 1000L)+ 8.hours
return utcTS
}
Its throwing error : java.lang.UnsupportedOperationException: Schema for
type com.github.nscala_time.time.Imports.DateTime is not supported
Would really appreciate the help.
Thanks,
Divya
