Github user MLnick commented on the pull request: https://github.com/apache/incubator-spark/pull/575#issuecomment-35443064 @mengxr <https://github.com/mengxr> ok, that is interesting. I have always advocated for Breeze, but was told 6 months ago that it was a non-starter due to these performance overheads. If that has changed I'm super happy. Given that all we need for MLlib (for now anyway) is sparse vectors, I am still in favour of Breeze. Since I believe breeze-math has great potential to become the de facto numpy of Scala (is already really), I believe we should rather spend resources making Breeze better where necessary, which benefits Spark as well as the rest of the (growing) Scala scientific computing community.
--- If your project is set up for it, you can reply to this email and have your reply appear on GitHub as well. To do so, please top-post your response. If your project does not have this feature enabled and wishes so, or if the feature is enabled but not working, please contact infrastructure at infrastruct...@apache.org or file a JIRA ticket with INFRA. ---