[
https://issues.apache.org/jira/browse/SPARK-2335?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14069676#comment-14069676
]
Yu Ishikawa commented on SPARK-2335:
------------------------------------
Hi Braian,
I am implementing a approximate kNN-join algorithm in Spark.
I will try to send a patch about the algorithm.
Please read the reference materials for details.
- Efficient Parallel kNN Joins for Large Data in MapReduce
http://www.cs.utah.edu/~lifeifei/papers/mrknnj.pdf
> k-Nearest Neighbor classification and regression for MLLib
> ----------------------------------------------------------
>
> Key: SPARK-2335
> URL: https://issues.apache.org/jira/browse/SPARK-2335
> Project: Spark
> Issue Type: New Feature
> Components: MLlib
> Reporter: Brian Gawalt
> Priority: Minor
> Labels: features, newbie
>
> The k-Nearest Neighbor model for classification and regression problems is a
> simple and intuitive approach, offering a straightforward path to creating
> non-linear decision/estimation contours. It's downsides -- high variance
> (sensitivity to the known training data set) and computational intensity for
> estimating new point labels -- both play to Spark's big data strengths: lots
> of data mitigates data concerns; lots of workers mitigate computational
> latency.
> We should include kNN models as options in MLLib.
--
This message was sent by Atlassian JIRA
(v6.2#6252)
