[ https://issues.apache.org/jira/browse/SPARK-24024?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ]
DB Tsai resolved SPARK-24024. ----------------------------- Resolution: Fixed Fix Version/s: 2.4.0 > Fix deviance calculations in GLM to handle corner cases > ------------------------------------------------------- > > Key: SPARK-24024 > URL: https://issues.apache.org/jira/browse/SPARK-24024 > Project: Spark > Issue Type: Improvement > Components: ML > Affects Versions: 2.3.0 > Reporter: Teng Peng > Assignee: Teng Peng > Priority: Minor > Fix For: 2.4.0 > > > It is reported by Spark users that the deviance calculations does not handle > a corner case. Thus, the correct model summary cannot be obtained. The user > has confirmed the the issue is in > override def deviance(y: Double, mu: Double, weight: Double): Double = { > 2.0 * weight * (y * math.log(y / mu) - (y - mu)) > } > when y = 0. > > The user also mentioned there are many other places he believe we should > check the same thing. -- This message was sent by Atlassian JIRA (v7.6.3#76005) --------------------------------------------------------------------- To unsubscribe, e-mail: issues-unsubscr...@spark.apache.org For additional commands, e-mail: issues-h...@spark.apache.org