Liquan Pei created SPARK-3097:
---------------------------------
Summary: Word2Vec Performance Improvement
Key: SPARK-3097
URL: https://issues.apache.org/jira/browse/SPARK-3097
Project: Spark
Issue Type: Improvement
Components: MLlib
Affects Versions: 1.1.0
Reporter: Liquan Pei
For each partition, the output model only contains words in that partition and
use reduceByKey to combine models in different partition to reduce shuffle
write and improve performance.
--
This message was sent by Atlassian JIRA
(v6.2#6252)
---------------------------------------------------------------------
To unsubscribe, e-mail: [email protected]
For additional commands, e-mail: [email protected]
