[jira] [Commented] (SPARK-17987) ML Evaluator fails to handle null values in the dataset

2016-10-19 Thread Sean Owen (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-17987?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15588085#comment-15588085 ] Sean Owen commented on SPARK-17987: --- In your example, a predictor is missing, not the predicted value.

[jira] [Commented] (SPARK-17987) ML Evaluator fails to handle null values in the dataset

2016-10-18 Thread bo song (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-17987?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15587530#comment-15587530 ] bo song commented on SPARK-17987: - There is a common case in cross validation, suppose f1 is a

[jira] [Commented] (SPARK-17987) ML Evaluator fails to handle null values in the dataset

2016-10-18 Thread Sean Owen (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-17987?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15585082#comment-15585082 ] Sean Owen commented on SPARK-17987: --- This amounts to assuming that any row that has no prediction

[jira] [Commented] (SPARK-17987) ML Evaluator fails to handle null values in the dataset

2016-10-18 Thread bo song (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-17987?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15585019#comment-15585019 ] bo song commented on SPARK-17987: - Thanks for your comments. When evaluation involves in cross

[jira] [Commented] (SPARK-17987) ML Evaluator fails to handle null values in the dataset

2016-10-18 Thread bo song (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-17987?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15585016#comment-15585016 ] bo song commented on SPARK-17987: - Thanks for your comments. When evaluation involves in cross

[jira] [Commented] (SPARK-17987) ML Evaluator fails to handle null values in the dataset

2016-10-18 Thread Sean Owen (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-17987?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15584956#comment-15584956 ] Sean Owen commented on SPARK-17987: --- I think this is on purpose. There's no meaningful way to handle a