Re: casting timestamp into long fail in Spark 1.3.1

2015-04-30 Thread Michael Armbrust
(Column.scala:636) Is there any change in the casting logic which may lead to this failure? Thanks. Justin -- View this message in context: casting timestamp into long fail in Spark 1.3.1 http://apache-spark-user-list.1001560.n3.nabble.com/casting-timestamp-into-long

Re: casting timestamp into long fail in Spark 1.3.1

2015-04-30 Thread Justin Yip
-- View this message in context: casting timestamp into long fail in Spark 1.3.1 http://apache-spark-user-list.1001560.n3.nabble.com/casting-timestamp-into-long-fail-in-Spark-1-3-1-tp22727.html Sent from the Apache Spark User List mailing list archive http://apache-spark-user-list

casting timestamp into long fail in Spark 1.3.1

2015-04-30 Thread Justin Yip
Hello, I was able to cast a timestamp into long using df.withColumn(millis, $eventTime.cast(long) * 1000) in spark 1.3.0. However, this statement returns a failure with spark 1.3.1. I got the following exception: Exception in thread main org.apache.spark.sql.types.DataTypeException: Unsupported