[jira] [Commented] (SPARK-17781) datetime is serialized as double inside dapply()

2016-10-13 Thread Felix Cheung (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-17781?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15574137#comment-15574137 ] Felix Cheung commented on SPARK-17781: -- Hmm.. I'm not quite sure what it is just yet - not seeing

[jira] [Commented] (SPARK-17781) datetime is serialized as double inside dapply()

2016-10-12 Thread Felix Cheung (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-17781?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15569325#comment-15569325 ] Felix Cheung commented on SPARK-17781: -- Thanks for the investigation. This might seem like a R

[jira] [Commented] (SPARK-17781) datetime is serialized as double inside dapply()

2016-10-11 Thread Hossein Falaki (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-17781?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15566541#comment-15566541 ] Hossein Falaki commented on SPARK-17781: [~shivaram] Thanks for looking into it. I think the

[jira] [Commented] (SPARK-17781) datetime is serialized as double inside dapply()

2016-10-11 Thread Shivaram Venkataraman (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-17781?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15566457#comment-15566457 ] Shivaram Venkataraman commented on SPARK-17781: --- [~falaki] I looked at this a bit more

[jira] [Commented] (SPARK-17781) datetime is serialized as double inside dapply()

2016-10-10 Thread Hossein Falaki (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-17781?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15563944#comment-15563944 ] Hossein Falaki commented on SPARK-17781: Yes, but somehow inside {{worker.R}} Date fields in the

[jira] [Commented] (SPARK-17781) datetime is serialized as double inside dapply()

2016-10-10 Thread Shivaram Venkataraman (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-17781?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15563862#comment-15563862 ] Shivaram Venkataraman commented on SPARK-17781: --- I'm not sure I follow. The class of the

[jira] [Commented] (SPARK-17781) datetime is serialized as double inside dapply()

2016-10-10 Thread Hossein Falaki (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-17781?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15563193#comment-15563193 ] Hossein Falaki commented on SPARK-17781: I investigated the issue. The root cause is that Date