GitHub user dbtsai opened a pull request:
https://github.com/apache/spark/pull/12317
[SPARK-14549][ML][WIP] Copy the Vector and Matrix classes from mllib to ml
in mllib-local
## What changes were proposed in this pull request?
This task will copy the Vector and Matrix classes from mllib to ml package
in mllib-local jar. The UDTs and `since` annotation in ml vector and matrix
will be removed from now. UDTs will be achieved by #SPARK-14487, and `since`
will be replaced by /* @ since 1.2.0 */
The BLAS implementation will be copied, and some of the test utilities will
be copies as well.
## How was this patch tested?
unit tests
You can merge this pull request into a Git repository by running:
$ git pull https://github.com/dbtsai/spark dbtsai-ml-vector
Alternatively you can review and apply these changes as the patch at:
https://github.com/apache/spark/pull/12317.patch
To close this pull request, make a commit to your master/trunk branch
with (at least) the following in the commit message:
This closes #12317
----
commit f37e112bfe25e2937361a610c70576342f88efcf
Author: DB Tsai <[email protected]>
Date: 2016-04-11T22:59:31Z
Moved NumericParser.scala from mllib to mllib-local, and made it throw
`IllegalArgumentException` instead of `SparkException`.
commit 6c301836d463b572481c994993ac54b29907ebc4
Author: DB Tsai <[email protected]>
Date: 2016-04-11T23:04:42Z
Made NumericParser.scala be acceable from spark pacakge
commit 11ab7884ab53006e02bd3c7cf29610e1b46feddd
Author: DB Tsai <[email protected]>
Date: 2016-04-11T23:24:08Z
Copy files from mllib to mllib-local
commit fe26990448ae0f457dc44a55350a07e550216c4b
Author: DB Tsai <[email protected]>
Date: 2016-04-11T23:24:41Z
Some styling fix in MLUtilsSuite.scala
commit e09b1080f5d2d72bbe256c85c7b4caf6e63e323f
Author: DB Tsai <[email protected]>
Date: 2016-04-11T23:44:39Z
Rename from mllib to ml for the new added classes, and also fixed the
SparkFunSuite imports
commit 5795d54a3bf3225f40d5a5d1682138c272021ba9
Author: DB Tsai <[email protected]>
Date: 2016-04-12T01:29:28Z
Removed UDT and Since to compile the code
----
---
If your project is set up for it, you can reply to this email and have your
reply appear on GitHub as well. If your project does not have this feature
enabled and wishes so, or if the feature is enabled but not working, please
contact infrastructure at [email protected] or file a JIRA ticket
with INFRA.
---
---------------------------------------------------------------------
To unsubscribe, e-mail: [email protected]
For additional commands, e-mail: [email protected]
