Liang-Chi Hsieh created SPARK-7641: -------------------------------------- Summary: Add subsampling of frequent words for Word2Vec Key: SPARK-7641 URL: https://issues.apache.org/jira/browse/SPARK-7641 Project: Spark Issue Type: Improvement Components: MLlib Reporter: Liang-Chi Hsieh
According to the paper [1], subsampling frequent words can accelerate learning and significantly improves the accuracy of the learned vectors. This ticket is proposed to add it into current Word2Vec. [1] Tomas Mikolov et al., "Distributed Representations of Words and Phrases and their Compositionality" -- This message was sent by Atlassian JIRA (v6.3.4#6332) --------------------------------------------------------------------- To unsubscribe, e-mail: issues-unsubscr...@spark.apache.org For additional commands, e-mail: issues-h...@spark.apache.org