Sue Ann Hong created SPARK-19759:
------------------------------------
Summary: ALSModel.predict on Dataframes : potential optimization
by not using blas
Key: SPARK-19759
URL: https://issues.apache.org/jira/browse/SPARK-19759
Project: Spark
Issue Type: Improvement
Components: ML
Affects Versions: 2.3.0
Reporter: Sue Ann Hong
In the DataFrame ALS prediction function, we use blas.sdot which may be slower
due to the conversion to Arrays. We can try operating on Seqs or another data
structure to see if avoiding the conversion makes the operation faster. Ref:
https://github.com/apache/spark/pull/17090/files/707bc6b153a7f899fbf3fe2a5675cacba1f95711#diff-be65dd1d6adc53138156641b610fcada
--
This message was sent by Atlassian JIRA
(v6.3.15#6346)
---------------------------------------------------------------------
To unsubscribe, e-mail: [email protected]
For additional commands, e-mail: [email protected]
