Hossein Falaki created SPARK-17781: -------------------------------------- Summary: datetime is serialized as double inside dapply() Key: SPARK-17781 URL: https://issues.apache.org/jira/browse/SPARK-17781 Project: Spark Issue Type: Bug Components: SparkR Affects Versions: 2.0.1 Reporter: Hossein Falaki
When we ship a SparkDataFrame to workers for dapply family functions, inside the worker DateTime objects are serialized as double. To reproduce: {{code}} df <- createDataFrame(data.frame(id = 1:10, date = Sys.Date())) dapplyCollect(df, function(x) { return(x$date) }) {{code}} -- This message was sent by Atlassian JIRA (v6.3.4#6332) --------------------------------------------------------------------- To unsubscribe, e-mail: issues-unsubscr...@spark.apache.org For additional commands, e-mail: issues-h...@spark.apache.org