[
https://issues.apache.org/jira/browse/SPARK-15027?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=15265228#comment-15265228
]
Nick Pentreath commented on SPARK-15027:
----------------------------------------
[~mengxr] are you intending this to be a more "superficial" change (as in,
change the signature of train to take a Dataset, but still operate on RDDs
inside the method), or try to have the entire algorithm operate on Dataset?
> ALS.train should use DataFrame instead of RDD
> ---------------------------------------------
>
> Key: SPARK-15027
> URL: https://issues.apache.org/jira/browse/SPARK-15027
> Project: Spark
> Issue Type: Improvement
> Components: ML, PySpark
> Affects Versions: 2.0.0
> Reporter: Xiangrui Meng
> Assignee: Xiangrui Meng
>
> This continue the work from SPARK-14412 to update
> `intermediateRDDStorageLevel` to `intermediateStorageLevel`, and
> `finalRDDStorageLevel` to `finalStoargeLevel`. We should also update
> `ALS.train` to use `Dataset` instead of `RDD`.
--
This message was sent by Atlassian JIRA
(v6.3.4#6332)
---------------------------------------------------------------------
To unsubscribe, e-mail: [email protected]
For additional commands, e-mail: [email protected]