[
https://issues.apache.org/jira/browse/SPARK-51031?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=18040114#comment-18040114
]
Weichen Xu commented on SPARK-51031:
------------------------------------
I think we can remove breeze dependency, spark has builtin vector / matrix
class to replace it. but it needs to update many code in spark mllib
ideally, all code in spark should use builtin Vector / Matrix type defined in
{{{}org.apache.spark.ml.linalg{}}}and for linear algebra operations, use APIs
in BLAS lib {{dev.ludovic.netlib.blas}}
like
[https://github.com/panbingkun/spark/blob/d0e3fb901440aa8f4073b60c9f9c5eb3b842e364/mllib-local/src/main/scala/org/apache/spark/ml/linalg/BLAS.scala]
> scalanlp/breeze future
> ----------------------
>
> Key: SPARK-51031
> URL: https://issues.apache.org/jira/browse/SPARK-51031
> Project: Spark
> Issue Type: Dependency upgrade
> Components: MLlib
> Affects Versions: 4.0.0
> Reporter: Kristopher Kane
> Priority: Minor
>
> [scalanlp/breeze|https://github.com/scalanlp/breeze] is going into
> maintenance mode as per the maintainer and it is compiled into mllib. Looks
> like there is a build for Scala 3 so at least some time to figure it out but
> I apologize as I don't have an alternative to offer up and only this notice.
> I can keep an eye on it and see if anyone takes the owner up on their offer.
> {code:java}
> Breeze is mostly retired at this point.
> I (@dlwh) will review bug fix PRs and sometimes answer questions, but that's
> about all I can offer. If someone wants to take of the reins I'd be happy to
> hand it off.
> {code}
>
--
This message was sent by Atlassian Jira
(v8.20.10#820010)
---------------------------------------------------------------------
To unsubscribe, e-mail: [email protected]
For additional commands, e-mail: [email protected]
