[jira] [Commented] (SPARK-22629) incorrect handling of calls to random in UDFs

2017-12-25 Thread Xiao Li (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-22629?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16303480#comment-16303480 ] Xiao Li commented on SPARK-22629: - The reason is we assume all the UDF are deterministic. The problem

[jira] [Commented] (SPARK-22629) incorrect handling of calls to random in UDFs

2017-12-08 Thread Marco Gaido (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-22629?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16284166#comment-16284166 ] Marco Gaido commented on SPARK-22629: - This problem is related to SPARK-20586. I created a PR to add

[jira] [Commented] (SPARK-22629) incorrect handling of calls to random in UDFs

2017-12-08 Thread Apache Spark (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-22629?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16284164#comment-16284164 ] Apache Spark commented on SPARK-22629: -- User 'mgaido91' has created a pull request for this issue:

[jira] [Commented] (SPARK-22629) incorrect handling of calls to random in UDFs

2017-12-02 Thread Sean Owen (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-22629?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16275553#comment-16275553 ] Sean Owen commented on SPARK-22629: --- That case is a better question and I'm not sure, actually, whether

[jira] [Commented] (SPARK-22629) incorrect handling of calls to random in UDFs

2017-11-28 Thread Michael H (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-22629?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16268960#comment-16268960 ] Michael H commented on SPARK-22629: --- Hi Sean, Thanks for looking into this! I was worried this would

[jira] [Commented] (SPARK-22629) incorrect handling of calls to random in UDFs

2017-11-28 Thread Sean Owen (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-22629?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16268875#comment-16268875 ] Sean Owen commented on SPARK-22629: --- This is expected behavior. If your source of data changes or is