Github user avulanov commented on the pull request:
https://github.com/apache/spark/pull/3677#issuecomment-69367747
I think this is a great work-around the current MLlib interfaces! What
bothers me is that batches will be created at every step of an algorithm, i.e.
iterator of vectors in partition is passed to Gradient and Gradient most
probably will stack vectors into matrix (every step!). I wonder if there is a
way to pass a matrix to Gradient instead of vector.
---
If your project is set up for it, you can reply to this email and have your
reply appear on GitHub as well. If your project does not have this feature
enabled and wishes so, or if the feature is enabled but not working, please
contact infrastructure at [email protected] or file a JIRA ticket
with INFRA.
---
---------------------------------------------------------------------
To unsubscribe, e-mail: [email protected]
For additional commands, e-mail: [email protected]
