[jira] [Commented] (SPARK-7615) MLLIB Word2Vec wordVectors divided by Euclidean Norm equals to zero
[ https://issues.apache.org/jira/browse/SPARK-7615?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15091762#comment-15091762 ] Apache Spark commented on SPARK-7615: - User 'srowen' has created a pull request for this issue: https://github.com/apache/spark/pull/10696 > MLLIB Word2Vec wordVectors divided by Euclidean Norm equals to zero > > > Key: SPARK-7615 > URL: https://issues.apache.org/jira/browse/SPARK-7615 > Project: Spark > Issue Type: Bug > Components: MLlib >Affects Versions: 1.3.1 >Reporter: Eric Li >Priority: Minor > Original Estimate: 1h > Remaining Estimate: 1h > > In Word2VecModel, wordVecNorms may contains Euclidean Norm equals to zero. > This will cause incorrect calculation for cosine distance. when you do > cosineVec(ind) / wordVecNorms(ind). Cosine distance should be equal to 0 for > norm = 0. -- This message was sent by Atlassian JIRA (v6.3.4#6332) - To unsubscribe, e-mail: issues-unsubscr...@spark.apache.org For additional commands, e-mail: issues-h...@spark.apache.org
[jira] [Commented] (SPARK-7615) MLLIB Word2Vec wordVectors divided by Euclidean Norm equals to zero
[ https://issues.apache.org/jira/browse/SPARK-7615?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14549227#comment-14549227 ] Apache Spark commented on SPARK-7615: - User 'ezli' has created a pull request for this issue: https://github.com/apache/spark/pull/6245 MLLIB Word2Vec wordVectors divided by Euclidean Norm equals to zero Key: SPARK-7615 URL: https://issues.apache.org/jira/browse/SPARK-7615 Project: Spark Issue Type: Bug Components: MLlib Affects Versions: 1.3.1 Reporter: Eric Li Priority: Minor Original Estimate: 1h Remaining Estimate: 1h In Word2VecModel, wordVecNorms may contains Euclidean Norm equals to zero. This will cause incorrect calculation for cosine distance. when you do cosineVec(ind) / wordVecNorms(ind). Cosine distance should be equal to 0 for norm = 0. -- This message was sent by Atlassian JIRA (v6.3.4#6332) - To unsubscribe, e-mail: issues-unsubscr...@spark.apache.org For additional commands, e-mail: issues-h...@spark.apache.org
[jira] [Commented] (SPARK-7615) MLLIB Word2Vec wordVectors divided by Euclidean Norm equals to zero
[ https://issues.apache.org/jira/browse/SPARK-7615?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14543981#comment-14543981 ] Sean Owen commented on SPARK-7615: -- Yes the submitter is about to open another PR, as I understand it. MLLIB Word2Vec wordVectors divided by Euclidean Norm equals to zero Key: SPARK-7615 URL: https://issues.apache.org/jira/browse/SPARK-7615 Project: Spark Issue Type: Bug Components: MLlib Affects Versions: 1.3.1 Reporter: Eric Li Priority: Minor Original Estimate: 1h Remaining Estimate: 1h In Word2VecModel, wordVecNorms may contains Euclidean Norm equals to zero. This will cause incorrect calculation for cosine distance. when you do cosineVec(ind) / wordVecNorms(ind). Cosine distance should be equal to 0 for norm = 0. -- This message was sent by Atlassian JIRA (v6.3.4#6332) - To unsubscribe, e-mail: issues-unsubscr...@spark.apache.org For additional commands, e-mail: issues-h...@spark.apache.org
[jira] [Commented] (SPARK-7615) MLLIB Word2Vec wordVectors divided by Euclidean Norm equals to zero
[ https://issues.apache.org/jira/browse/SPARK-7615?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14543977#comment-14543977 ] Angel Martinez Gonzalez commented on SPARK-7615: Hi, is any body working on this (and SPARK-7617, SPARK-7618)? I have been using Spark for some time, and would like get started contributing. This looks like a trivial issue (good fo a newbie). Shall I provide a pull request for this? Would it make sense a pull request for the three related issues? MLLIB Word2Vec wordVectors divided by Euclidean Norm equals to zero Key: SPARK-7615 URL: https://issues.apache.org/jira/browse/SPARK-7615 Project: Spark Issue Type: Bug Components: MLlib Affects Versions: 1.3.1 Reporter: Eric Li Priority: Minor Original Estimate: 1h Remaining Estimate: 1h In Word2VecModel, wordVecNorms may contains Euclidean Norm equals to zero. This will cause incorrect calculation for cosine distance. when you do cosineVec(ind) / wordVecNorms(ind). Cosine distance should be equal to 0 for norm = 0. -- This message was sent by Atlassian JIRA (v6.3.4#6332) - To unsubscribe, e-mail: issues-unsubscr...@spark.apache.org For additional commands, e-mail: issues-h...@spark.apache.org