[
https://issues.apache.org/jira/browse/HBASE-11425?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16399010#comment-16399010
]
stack commented on HBASE-11425:
---
bq. We don't have any metric at the BBPool layer. That may be not needed
[
https://issues.apache.org/jira/browse/HBASE-11425?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16398935#comment-16398935
]
Anoop Sam John commented on HBASE-11425:
Nothing new very specific to the off heaping as such.
[
https://issues.apache.org/jira/browse/HBASE-11425?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16398748#comment-16398748
]
stack commented on HBASE-11425:
---
Nice RN [~anoopsamjohn]. Do you have metrics or other attributes operators
[
https://issues.apache.org/jira/browse/HBASE-11425?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16374801#comment-16374801
]
Anoop Sam John commented on HBASE-11425:
On read path off heaping doc in out book, not many new
[
https://issues.apache.org/jira/browse/HBASE-11425?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16374783#comment-16374783
]
ramkrishna.s.vasudevan commented on HBASE-11425:
Atleast as far as I know the read path
[
https://issues.apache.org/jira/browse/HBASE-11425?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16374689#comment-16374689
]
stack commented on HBASE-11425:
---
[~anoopsamjohn] [~ram_krish] Is there doc on this feature and the
[
https://issues.apache.org/jira/browse/HBASE-11425?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15121247#comment-15121247
]
stack commented on HBASE-11425:
---
Hurray!
> Cell/DBB end-to-end on the read-path
>
[
https://issues.apache.org/jira/browse/HBASE-11425?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=14961356#comment-14961356
]
stack commented on HBASE-11425:
---
My master branch is at this stage:
commit
[
https://issues.apache.org/jira/browse/HBASE-11425?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=14961355#comment-14961355
]
stack commented on HBASE-11425:
---
My master branch is at this stage:
commit
[
https://issues.apache.org/jira/browse/HBASE-11425?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=14961322#comment-14961322
]
stack commented on HBASE-11425:
---
Seems easy for me to reproduce. Just happened again. Here is the log.
>
[
https://issues.apache.org/jira/browse/HBASE-11425?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=14961753#comment-14961753
]
Anoop Sam John commented on HBASE-11425:
One doubt after seeing the logs... The OOME comes
[
https://issues.apache.org/jira/browse/HBASE-11425?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=14961754#comment-14961754
]
Anoop Sam John commented on HBASE-11425:
bq.It should not OOME. If it does, its broke?
Agree
[
https://issues.apache.org/jira/browse/HBASE-11425?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=14961733#comment-14961733
]
Anoop Sam John commented on HBASE-11425:
Is the log at the time of workload C (pure reads alone)?
[
https://issues.apache.org/jira/browse/HBASE-11425?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=14961738#comment-14961738
]
ramkrishna.s.vasudevan commented on HBASE-11425:
In the latest tests that we did,
[
https://issues.apache.org/jira/browse/HBASE-11425?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=14961735#comment-14961735
]
stack commented on HBASE-11425:
---
This is a different loading. This is me trying to run a suite of ycsb load
[
https://issues.apache.org/jira/browse/HBASE-11425?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=14958674#comment-14958674
]
ramkrishna.s.vasudevan commented on HBASE-11425:
I could run with OOME with even 2G of
[
https://issues.apache.org/jira/browse/HBASE-11425?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=14958505#comment-14958505
]
Yu Li commented on HBASE-11425:
---
>From the "Offheap reads in HBase using BBs_V2.pdf" doc, we could see a
[
https://issues.apache.org/jira/browse/HBASE-11425?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=14958409#comment-14958409
]
ramkrishna.s.vasudevan commented on HBASE-11425:
Just checking the code
bq.Or if it is
[
https://issues.apache.org/jira/browse/HBASE-11425?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=14958587#comment-14958587
]
ramkrishna.s.vasudevan commented on HBASE-11425:
Yes. We can . We will test once with LRU
[
https://issues.apache.org/jira/browse/HBASE-11425?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=14959007#comment-14959007
]
Yu Li commented on HBASE-11425:
---
Thanks for the update [~anoop.hbase], the number looks great and nice
[
https://issues.apache.org/jira/browse/HBASE-11425?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=14958968#comment-14958968
]
Anoop Sam John commented on HBASE-11425:
[~carp84]
I have done a quick multi get test using PE
[
https://issues.apache.org/jira/browse/HBASE-11425?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=14958244#comment-14958244
]
ramkrishna.s.vasudevan commented on HBASE-11425:
BTW - this behaviour are you seeing
[
https://issues.apache.org/jira/browse/HBASE-11425?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=14958253#comment-14958253
]
stack commented on HBASE-11425:
---
Workload c. Try 4g. I don't see why 4g should not be enough when
[
https://issues.apache.org/jira/browse/HBASE-11425?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=14958230#comment-14958230
]
ramkrishna.s.vasudevan commented on HBASE-11425:
bq.Have you fellas run this for a while?
[
https://issues.apache.org/jira/browse/HBASE-11425?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14693077#comment-14693077
]
Hudson commented on HBASE-11425:
FAILURE: Integrated in HBase-TRUNK #6717 (See
[
https://issues.apache.org/jira/browse/HBASE-11425?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14660142#comment-14660142
]
Hudson commented on HBASE-11425:
FAILURE: Integrated in HBase-TRUNK #6701 (See
[
https://issues.apache.org/jira/browse/HBASE-11425?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14585129#comment-14585129
]
Anoop Sam John commented on HBASE-11425:
[
https://issues.apache.org/jira/browse/HBASE-11425?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14584761#comment-14584761
]
stack commented on HBASE-11425:
---
[~anoopsamjohn] and [~ram_krish] as per chat this morning,
[
https://issues.apache.org/jira/browse/HBASE-11425?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14523448#comment-14523448
]
stack commented on HBASE-11425:
---
[~anoop.hbase] The write up is excellent -- especially the
[
https://issues.apache.org/jira/browse/HBASE-11425?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14493712#comment-14493712
]
stack commented on HBASE-11425:
---
Took another read of the doc (and above comments on it).
[
https://issues.apache.org/jira/browse/HBASE-11425?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14493832#comment-14493832
]
ramkrishna.s.vasudevan commented on HBASE-11425:
We will update all the
[
https://issues.apache.org/jira/browse/HBASE-11425?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14483658#comment-14483658
]
stack commented on HBASE-11425:
---
So, what is going on with this patch now? You want the
[
https://issues.apache.org/jira/browse/HBASE-11425?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14484678#comment-14484678
]
Anoop Sam John commented on HBASE-11425:
Yes, I would say we deal with
[
https://issues.apache.org/jira/browse/HBASE-11425?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14390984#comment-14390984
]
stack commented on HBASE-11425:
---
The patch is too big. I'm 7 pages in on a 13 page review.
[
https://issues.apache.org/jira/browse/HBASE-11425?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14391030#comment-14391030
]
ramkrishna.s.vasudevan commented on HBASE-11425:
Yes Stack. We have plans
[
https://issues.apache.org/jira/browse/HBASE-11425?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14391000#comment-14391000
]
Anoop Sam John commented on HBASE-11425:
Basically we have to split it into Sub
[
https://issues.apache.org/jira/browse/HBASE-11425?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14391033#comment-14391033
]
ramkrishna.s.vasudevan commented on HBASE-11425:
Also this patch would
[
https://issues.apache.org/jira/browse/HBASE-11425?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14388355#comment-14388355
]
ramkrishna.s.vasudevan commented on HBASE-11425:
RB link
[
https://issues.apache.org/jira/browse/HBASE-11425?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14388541#comment-14388541
]
Hadoop QA commented on HBASE-11425:
---
{color:red}-1 overall{color}. Here are the
[
https://issues.apache.org/jira/browse/HBASE-11425?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14380193#comment-14380193
]
ramkrishna.s.vasudevan commented on HBASE-11425:
Any comments/suggestions
[
https://issues.apache.org/jira/browse/HBASE-11425?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14367500#comment-14367500
]
ramkrishna.s.vasudevan commented on HBASE-11425:
Not able to add to RB.
[
https://issues.apache.org/jira/browse/HBASE-11425?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14355488#comment-14355488
]
Vladimir Rodionov commented on HBASE-11425:
---
{quote}
I think No. 4 (DBE - OFF,
[
https://issues.apache.org/jira/browse/HBASE-11425?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14355373#comment-14355373
]
Anoop Sam John commented on HBASE-11425:
Having block data in compressed form in
[
https://issues.apache.org/jira/browse/HBASE-11425?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14355375#comment-14355375
]
Anoop Sam John commented on HBASE-11425:
Having block data in compressed form in
[
https://issues.apache.org/jira/browse/HBASE-11425?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14356459#comment-14356459
]
Anoop Sam John commented on HBASE-11425:
You say about this case
[
https://issues.apache.org/jira/browse/HBASE-11425?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14356461#comment-14356461
]
Anoop Sam John commented on HBASE-11425:
You mean for all these case, the data is
[
https://issues.apache.org/jira/browse/HBASE-11425?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14356184#comment-14356184
]
ramkrishna.s.vasudevan commented on HBASE-11425:
Adding to what Anoop
[
https://issues.apache.org/jira/browse/HBASE-11425?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14356187#comment-14356187
]
ramkrishna.s.vasudevan commented on HBASE-11425:
bq.Would be good to get
[
https://issues.apache.org/jira/browse/HBASE-11425?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14356185#comment-14356185
]
ramkrishna.s.vasudevan commented on HBASE-11425:
Adding to what Anoop
[
https://issues.apache.org/jira/browse/HBASE-11425?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14355360#comment-14355360
]
Vladimir Rodionov commented on HBASE-11425:
---
I am quite skeptical to all this
[
https://issues.apache.org/jira/browse/HBASE-11425?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14355297#comment-14355297
]
stack commented on HBASE-11425:
---
Thanks for the writeup. Makes it easier discussing this
[
https://issues.apache.org/jira/browse/HBASE-11425?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14355376#comment-14355376
]
Anoop Sam John commented on HBASE-11425:
Having block data in compressed form in
[
https://issues.apache.org/jira/browse/HBASE-11425?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14355372#comment-14355372
]
Anoop Sam John commented on HBASE-11425:
Having block data in compressed form in
[
https://issues.apache.org/jira/browse/HBASE-11425?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14355374#comment-14355374
]
Anoop Sam John commented on HBASE-11425:
Having block data in compressed form in
[
https://issues.apache.org/jira/browse/HBASE-11425?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14356182#comment-14356182
]
ramkrishna.s.vasudevan commented on HBASE-11425:
bq.Should bucket size be
[
https://issues.apache.org/jira/browse/HBASE-11425?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14356281#comment-14356281
]
Anoop Sam John commented on HBASE-11425:
bq.We discussed on that ServerCell
[
https://issues.apache.org/jira/browse/HBASE-11425?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14356290#comment-14356290
]
stack commented on HBASE-11425:
---
[~ram_krish]
On this But I would argue not do that
[
https://issues.apache.org/jira/browse/HBASE-11425?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14355502#comment-14355502
]
stack commented on HBASE-11425:
---
I like [~vrodionov] 's grid. If only for illustration of
[
https://issues.apache.org/jira/browse/HBASE-11425?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14355518#comment-14355518
]
Vladimir Rodionov commented on HBASE-11425:
---
{quote}
BigBase open source
[
https://issues.apache.org/jira/browse/HBASE-11425?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14355465#comment-14355465
]
stack commented on HBASE-11425:
---
[~vrodionov]
Sortof.
This effort takes us further along
[
https://issues.apache.org/jira/browse/HBASE-11425?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14355478#comment-14355478
]
Vladimir Rodionov commented on HBASE-11425:
---
{quote}
The change is when the
[
https://issues.apache.org/jira/browse/HBASE-11425?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14355484#comment-14355484
]
Vladimir Rodionov commented on HBASE-11425:
---
{quote}
Would be cool if
[
https://issues.apache.org/jira/browse/HBASE-11425?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14355497#comment-14355497
]
stack commented on HBASE-11425:
---
bq. I wanted to come to this topic. This is hard coded
[
https://issues.apache.org/jira/browse/HBASE-11425?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14355378#comment-14355378
]
Anoop Sam John commented on HBASE-11425:
Having block data in compressed form in
[
https://issues.apache.org/jira/browse/HBASE-11425?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14355463#comment-14355463
]
Anoop Sam John commented on HBASE-11425:
bq.This ain't right, is it? Usually we
[
https://issues.apache.org/jira/browse/HBASE-11425?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14352989#comment-14352989
]
zhangduo commented on HBASE-11425:
--
I'm still a little worried about the ref counting
[
https://issues.apache.org/jira/browse/HBASE-11425?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14352996#comment-14352996
]
Anoop Sam John commented on HBASE-11425:
The ref count and increment/decrement
[
https://issues.apache.org/jira/browse/HBASE-11425?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14353001#comment-14353001
]
zhangduo commented on HBASE-11425:
--
[~anoopsamjohn] increment/decrement in one place
[
https://issues.apache.org/jira/browse/HBASE-11425?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14184075#comment-14184075
]
Anoop Sam John commented on HBASE-11425:
{quote}
Testing with a 2 million Cells
[
https://issues.apache.org/jira/browse/HBASE-11425?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14077656#comment-14077656
]
Anoop Sam John commented on HBASE-11425:
Testing with a 2 million Cells with
[
https://issues.apache.org/jira/browse/HBASE-11425?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14077868#comment-14077868
]
Andrew Purtell commented on HBASE-11425:
This is with BB or BR? How about 1kb
[
https://issues.apache.org/jira/browse/HBASE-11425?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14077898#comment-14077898
]
Anoop Sam John commented on HBASE-11425:
BB only. And not the actual read perf
[
https://issues.apache.org/jira/browse/HBASE-11425?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14077940#comment-14077940
]
Andrew Purtell commented on HBASE-11425:
Does it make a difference if using the
[
https://issues.apache.org/jira/browse/HBASE-11425?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14077991#comment-14077991
]
stack commented on HBASE-11425:
---
Nice [~anoop.hbase] Mind posting your little test tool so
[
https://issues.apache.org/jira/browse/HBASE-11425?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14073043#comment-14073043
]
Anoop Sam John commented on HBASE-11425:
bq.We need BR instead of BB to work
[
https://issues.apache.org/jira/browse/HBASE-11425?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14050050#comment-14050050
]
Anoop Sam John commented on HBASE-11425:
Yes we need ref counting. The
[
https://issues.apache.org/jira/browse/HBASE-11425?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14047590#comment-14047590
]
ramkrishna.s.vasudevan commented on HBASE-11425:
bq.Currently we copy the
[
https://issues.apache.org/jira/browse/HBASE-11425?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14047396#comment-14047396
]
stack commented on HBASE-11425:
---
Thanks for filing this one and yeah lets finish up the
[
https://issues.apache.org/jira/browse/HBASE-11425?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14046164#comment-14046164
]
Anoop Sam John commented on HBASE-11425:
Now one related Q is we go with BR
[
https://issues.apache.org/jira/browse/HBASE-11425?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14046224#comment-14046224
]
Andrew Purtell commented on HBASE-11425:
bq. Now one related Q is we go with BR
[
https://issues.apache.org/jira/browse/HBASE-11425?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14046726#comment-14046726
]
ramkrishna.s.vasudevan commented on HBASE-11425:
bq. Avoid
[
https://issues.apache.org/jira/browse/HBASE-11425?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14046730#comment-14046730
]
ramkrishna.s.vasudevan commented on HBASE-11425:
All the subtasks under
82 matches
Mail list logo