[
https://issues.apache.org/jira/browse/SPARK-11583?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=15007600#comment-15007600
]
Apache Spark commented on SPARK-11583:
--
User 'davies' has created a pull request for
[
https://issues.apache.org/jira/browse/SPARK-11583?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=15004924#comment-15004924
]
Reynold Xin commented on SPARK-11583:
-
I will get somebody to take a look at this and
[
https://issues.apache.org/jira/browse/SPARK-11583?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=15003185#comment-15003185
]
Imran Rashid commented on SPARK-11583:
--
[~lemire] after reading a couple of comments
[
https://issues.apache.org/jira/browse/SPARK-11583?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=15003144#comment-15003144
]
Daniel Lemire commented on SPARK-11583:
---
[~irashid]
Sounds great.
Should the code
[
https://issues.apache.org/jira/browse/SPARK-11583?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=15003084#comment-15003084
]
Imran Rashid commented on SPARK-11583:
--
[~lemire] I thought Kent Yao's analysis was
[
https://issues.apache.org/jira/browse/SPARK-11583?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=15001986#comment-15001986
]
Apache Spark commented on SPARK-11583:
--
User 'yaooqinn' has created a pull request f
[
https://issues.apache.org/jira/browse/SPARK-11583?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=15001420#comment-15001420
]
Kent Yao commented on SPARK-11583:
--
Are these methods {noformat} r.add(0,20) {noform
[
https://issues.apache.org/jira/browse/SPARK-11583?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=15000339#comment-15000339
]
Daniel Lemire commented on SPARK-11583:
---
[~Qin Yao] [~aimran50]
If you guys want t
[
https://issues.apache.org/jira/browse/SPARK-11583?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=15000187#comment-15000187
]
Kent Yao commented on SPARK-11583:
--
@lemire [~imranr]
1. test cases
1.1 sparse case
[
https://issues.apache.org/jira/browse/SPARK-11583?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14999897#comment-14999897
]
Daniel Lemire commented on SPARK-11583:
---
[~Qin Yao]
The RoaringBitmap library is a
[
https://issues.apache.org/jira/browse/SPARK-11583?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14999882#comment-14999882
]
Daniel Lemire commented on SPARK-11583:
---
[~irashid]
Calling so many times a functi
[
https://issues.apache.org/jira/browse/SPARK-11583?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14999848#comment-14999848
]
Imran Rashid commented on SPARK-11583:
--
Hi [~Qin Yao] -- unfortunately that example
[
https://issues.apache.org/jira/browse/SPARK-11583?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14999835#comment-14999835
]
Kent Yao commented on SPARK-11583:
--
[~imranr] [~dlemire]
The JVM I use ： -Xmx256M -Xms3
[
https://issues.apache.org/jira/browse/SPARK-11583?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14999309#comment-14999309
]
Daniel Lemire commented on SPARK-11583:
---
[~irashid]
What I would suggest is a qua
[
https://issues.apache.org/jira/browse/SPARK-11583?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14999185#comment-14999185
]
Imran Rashid commented on SPARK-11583:
--
thanks [~lemire]. So I guess that means tha
[
https://issues.apache.org/jira/browse/SPARK-11583?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14999142#comment-14999142
]
Daniel Lemire commented on SPARK-11583:
---
[~Qin Yao] wrote:
"Roaringbitmap is same
[
https://issues.apache.org/jira/browse/SPARK-11583?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14999130#comment-14999130
]
Daniel Lemire commented on SPARK-11583:
---
> So, this is about compressing the in-mem
[
https://issues.apache.org/jira/browse/SPARK-11583?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14999117#comment-14999117
]
Daniel Lemire commented on SPARK-11583:
---
> When a set is nearly full, RoaringBitmap
[
https://issues.apache.org/jira/browse/SPARK-11583?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14999009#comment-14999009
]
Imran Rashid commented on SPARK-11583:
--
I think [~srowen] is right that we are going
[
https://issues.apache.org/jira/browse/SPARK-11583?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14996415#comment-14996415
]
Kent Yao commented on SPARK-11583:
--
I have reviewed my code and merged two classes. And
[
https://issues.apache.org/jira/browse/SPARK-11583?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14996266#comment-14996266
]
Sean Owen commented on SPARK-11583:
---
Yeah a lot of this depends on the savings in memor
[
https://issues.apache.org/jira/browse/SPARK-11583?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14996206#comment-14996206
]
Kent Yao commented on SPARK-11583:
--
1. The _Compressed_ in MapStatus means *Array[Long]*
[
https://issues.apache.org/jira/browse/SPARK-11583?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14996168#comment-14996168
]
Sean Owen commented on SPARK-11583:
---
Yes, I understand the idea of a 'compressed' bitse
[
https://issues.apache.org/jira/browse/SPARK-11583?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14996147#comment-14996147
]
Kent Yao commented on SPARK-11583:
--
[~srowen] MapStatus stores BlockManagerId where it l
[
https://issues.apache.org/jira/browse/SPARK-11583?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14996109#comment-14996109
]
Sean Owen commented on SPARK-11583:
---
[~Qin Yao] but you're just re-describing a sparse
[
https://issues.apache.org/jira/browse/SPARK-11583?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14996098#comment-14996098
]
Apache Spark commented on SPARK-11583:
--
User 'yaooqinn' has created a pull request f
26 matches
Mail list logo
