[
https://issues.apache.org/jira/browse/SPARK-5992?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=15581416#comment-15581416
]
Yun Ni commented on SPARK-5992:
---
Yes, I have implemented cosine, jaccard, euclidean and hamm
[
https://issues.apache.org/jira/browse/SPARK-5992?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=15581412#comment-15581412
]
Yun Ni commented on SPARK-5992:
---
Yes, I do have comparison with full scan. Usually kNN with
[
https://issues.apache.org/jira/browse/SPARK-5992?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=15581366#comment-15581366
]
Debasish Das commented on SPARK-5992:
-
Also do you have hash function for euclidean di
[
https://issues.apache.org/jira/browse/SPARK-5992?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=15581361#comment-15581361
]
Debasish Das commented on SPARK-5992:
-
Did you compare with brute force knn ? Normally
[
https://issues.apache.org/jira/browse/SPARK-5992?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=15581345#comment-15581345
]
Yun Ni commented on SPARK-5992:
---
Some tests on the WEX Open Dataset, with steps and results:
[
https://issues.apache.org/jira/browse/SPARK-5992?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=15503971#comment-15503971
]
Apache Spark commented on SPARK-5992:
-
User 'Yunni' has created a pull request for thi
[
https://issues.apache.org/jira/browse/SPARK-5992?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=15502493#comment-15502493
]
Yun Ni commented on SPARK-5992:
---
Hi Joseph,
I have made an initial PR based on the design d
[
https://issues.apache.org/jira/browse/SPARK-5992?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=15478135#comment-15478135
]
Yun Ni commented on SPARK-5992:
---
Thank you very much for reviewing it, Joseph!
I will work
[
https://issues.apache.org/jira/browse/SPARK-5992?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=15478125#comment-15478125
]
Joseph K. Bradley commented on SPARK-5992:
--
The design doc LGTM! Thanks for upda
[
https://issues.apache.org/jira/browse/SPARK-5992?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=15453980#comment-15453980
]
Yun Ni commented on SPARK-5992:
---
Thanks very much for reviewing, Joseph!
Based on your comm
[
https://issues.apache.org/jira/browse/SPARK-5992?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=15451091#comment-15451091
]
Joseph K. Bradley commented on SPARK-5992:
--
Awesome, thanks! I made some comment
[
https://issues.apache.org/jira/browse/SPARK-5992?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=15432186#comment-15432186
]
Yun Ni commented on SPARK-5992:
---
Hi,
We are engineers from Uber. Here is our design doc for
[
https://issues.apache.org/jira/browse/SPARK-5992?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=15400751#comment-15400751
]
snehil suresh wakchaure commented on SPARK-5992:
Hello, just curious to kn
[
https://issues.apache.org/jira/browse/SPARK-5992?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=15389321#comment-15389321
]
tony commented on SPARK-5992:
-
Hi,
I am new to spark. How can I make a contribution to Spark
[
https://issues.apache.org/jira/browse/SPARK-5992?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=15345890#comment-15345890
]
Xiangrui Meng commented on SPARK-5992:
--
FYI, I had an offline discussion with Kelvin
[
https://issues.apache.org/jira/browse/SPARK-5992?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=15159679#comment-15159679
]
Karl Higley commented on SPARK-5992:
I've been working on [a Spark package for approxi
[
https://issues.apache.org/jira/browse/SPARK-5992?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=15029318#comment-15029318
]
Karl Higley commented on SPARK-5992:
I'm a bit confused by this section of the design
[
https://issues.apache.org/jira/browse/SPARK-5992?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=15010635#comment-15010635
]
Jonas Seiler commented on SPARK-5992:
-
Very nice!
Hope there will be soon a common in
[
https://issues.apache.org/jira/browse/SPARK-5992?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14904500#comment-14904500
]
Özgür Demir commented on SPARK-5992:
hi, we just open sourced an lsh topk implementati
[
https://issues.apache.org/jira/browse/SPARK-5992?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14721066#comment-14721066
]
Maruf Aytekin commented on SPARK-5992:
--
I have developed spark implementation of LSH
[
https://issues.apache.org/jira/browse/SPARK-5992?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14637337#comment-14637337
]
Maruf Aytekin commented on SPARK-5992:
--
In addition to Charikar's scheme for cosine [
[
https://issues.apache.org/jira/browse/SPARK-5992?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14575557#comment-14575557
]
Debasish Das commented on SPARK-5992:
-
Lsh is anyway optimized for cosine...I think we
[
https://issues.apache.org/jira/browse/SPARK-5992?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14575079#comment-14575079
]
Joseph K. Bradley commented on SPARK-5992:
--
I'm just noting here that [~yuu.ishik
[
https://issues.apache.org/jira/browse/SPARK-5992?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14575002#comment-14575002
]
Karl Higley commented on SPARK-5992:
To make it easier to define a common interface, i
[
https://issues.apache.org/jira/browse/SPARK-5992?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14574933#comment-14574933
]
Yu Ishikawa commented on SPARK-5992:
h2. Initial version of desing doc
https://github
[
https://issues.apache.org/jira/browse/SPARK-5992?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14574750#comment-14574750
]
Yu Ishikawa commented on SPARK-5992:
[~debasish83] Thank you for your comment. I haven
[
https://issues.apache.org/jira/browse/SPARK-5992?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14512843#comment-14512843
]
Debasish Das commented on SPARK-5992:
-
Did someone compared algebird LSH with spark mi
[
https://issues.apache.org/jira/browse/SPARK-5992?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14395415#comment-14395415
]
Yu Ishikawa commented on SPARK-5992:
Yes, I will try to write a design doc. Thank you
[
https://issues.apache.org/jira/browse/SPARK-5992?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14393017#comment-14393017
]
Joseph K. Bradley commented on SPARK-5992:
--
That sounds good; I'll try to take a
[
https://issues.apache.org/jira/browse/SPARK-5992?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14392366#comment-14392366
]
Yu Ishikawa commented on SPARK-5992:
As I said when we talked in Spark Summit East, I
[
https://issues.apache.org/jira/browse/SPARK-5992?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14357335#comment-14357335
]
Joseph K. Bradley commented on SPARK-5992:
--
I'm not sure what the most important
[
https://issues.apache.org/jira/browse/SPARK-5992?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14356507#comment-14356507
]
Yu Ishikawa commented on SPARK-5992:
What kind of LSH algorithms should we support at
32 matches
Mail list logo