[jira] [Commented] (HBASE-16421) Introducing the CellChunkMap as a new additional index variant in the MemStore

[ https://issues.apache.org/jira/browse/HBASE-16421?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16235595#comment-16235595 ] Anastasia Braginsky commented on HBASE-16421: - Thank you [~anoop.hbase]! > Introducing the

[jira] [Commented] (HBASE-16421) Introducing the CellChunkMap as a new additional index variant in the MemStore

[ https://issues.apache.org/jira/browse/HBASE-16421?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16234404#comment-16234404 ] Anoop Sam John commented on HBASE-16421: Use the new config

[jira] [Commented] (HBASE-16421) Introducing the CellChunkMap as a new additional index variant in the MemStore

[ https://issues.apache.org/jira/browse/HBASE-16421?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16234014#comment-16234014 ] Anastasia Braginsky commented on HBASE-16421: - Hey [~anoop.hbase] and [~ram_krish]! I am now

[jira] [Commented] (HBASE-16421) Introducing the CellChunkMap as a new additional index variant in the MemStore

[ https://issues.apache.org/jira/browse/HBASE-16421?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15901984#comment-15901984 ] Edward Bortnikov commented on HBASE-16421: -- That's great - let's follow that path (via

[jira] [Commented] (HBASE-16421) Introducing the CellChunkMap as a new additional index variant in the MemStore

[ https://issues.apache.org/jira/browse/HBASE-16421?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15901592#comment-15901592 ] ramkrishna.s.vasudevan commented on HBASE-16421: Ok. If you feel this patch is fine then

[jira] [Commented] (HBASE-16421) Introducing the CellChunkMap as a new additional index variant in the MemStore

[ https://issues.apache.org/jira/browse/HBASE-16421?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15901173#comment-15901173 ] Anoop Sam John commented on HBASE-16421: +1 on what she says there... I will also help with

[jira] [Commented] (HBASE-16421) Introducing the CellChunkMap as a new additional index variant in the MemStore

[ https://issues.apache.org/jira/browse/HBASE-16421?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15901163#comment-15901163 ] Edward Bortnikov commented on HBASE-16421: -- Friends, What are you saying about [~anastas]'s

[jira] [Commented] (HBASE-16421) Introducing the CellChunkMap as a new additional index variant in the MemStore

[ https://issues.apache.org/jira/browse/HBASE-16421?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15899290#comment-15899290 ] ramkrishna.s.vasudevan commented on HBASE-16421: https://reviews.apache.org/r/57369/. Pls

[jira] [Commented] (HBASE-16421) Introducing the CellChunkMap as a new additional index variant in the MemStore

[ https://issues.apache.org/jira/browse/HBASE-16421?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15899198#comment-15899198 ] ramkrishna.s.vasudevan commented on HBASE-16421: I will like to reiterate here. It is not

[jira] [Commented] (HBASE-16421) Introducing the CellChunkMap as a new additional index variant in the MemStore

[ https://issues.apache.org/jira/browse/HBASE-16421?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15899084#comment-15899084 ] Edward Bortnikov commented on HBASE-16421: -- Okay we are making progress ... What I read from

[jira] [Commented] (HBASE-16421) Introducing the CellChunkMap as a new additional index variant in the MemStore

[ https://issues.apache.org/jira/browse/HBASE-16421?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15898684#comment-15898684 ] ramkrishna.s.vasudevan commented on HBASE-16421: [~ebortnik] Since we had done extensive

[jira] [Commented] (HBASE-16421) Introducing the CellChunkMap as a new additional index variant in the MemStore

[ https://issues.apache.org/jira/browse/HBASE-16421?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15897806#comment-15897806 ] Edward Bortnikov commented on HBASE-16421: -- Friends, We are currently still vague on the issue

[jira] [Commented] (HBASE-16421) Introducing the CellChunkMap as a new additional index variant in the MemStore

[ https://issues.apache.org/jira/browse/HBASE-16421?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15892370#comment-15892370 ] Edward Bortnikov commented on HBASE-16421: -- Also, we have to define the KPI's for this feature.

[jira] [Commented] (HBASE-16421) Introducing the CellChunkMap as a new additional index variant in the MemStore

[ https://issues.apache.org/jira/browse/HBASE-16421?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15889597#comment-15889597 ] Edward Bortnikov commented on HBASE-16421: -- For in-memory compaction per se it is not but for

[jira] [Commented] (HBASE-16421) Introducing the CellChunkMap as a new additional index variant in the MemStore

[ https://issues.apache.org/jira/browse/HBASE-16421?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15888587#comment-15888587 ] stack commented on HBASE-16421: --- I owe a summary of 2.0 state up on dev list. Will do in next day or so.

[jira] [Commented] (HBASE-16421) Introducing the CellChunkMap as a new additional index variant in the MemStore

[ https://issues.apache.org/jira/browse/HBASE-16421?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15888120#comment-15888120 ] Edward Bortnikov commented on HBASE-16421: -- More precisely, the question is about the deadline.

[jira] [Commented] (HBASE-16421) Introducing the CellChunkMap as a new additional index variant in the MemStore

[ https://issues.apache.org/jira/browse/HBASE-16421?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15887895#comment-15887895 ] Anoop Sam John commented on HBASE-16421: sure.. pls go ahead. Lets know whenever u need any

[jira] [Commented] (HBASE-16421) Introducing the CellChunkMap as a new additional index variant in the MemStore

[ https://issues.apache.org/jira/browse/HBASE-16421?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15886426#comment-15886426 ] Edward Bortnikov commented on HBASE-16421: -- Hi all, reviving this thread, it's been silent for a

[jira] [Commented] (HBASE-16421) Introducing the CellChunkMap as a new additional index variant in the MemStore

[ https://issues.apache.org/jira/browse/HBASE-16421?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15792240#comment-15792240 ] ramkrishna.s.vasudevan commented on HBASE-16421: I have used the default batch size. Did

[jira] [Commented] (HBASE-16421) Introducing the CellChunkMap as a new additional index variant in the MemStore

[ https://issues.apache.org/jira/browse/HBASE-16421?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15790008#comment-15790008 ] Eshcar Hillel commented on HBASE-16421: --- [~ram_krish] have you tried using batching? if so what is

[jira] [Commented] (HBASE-16421) Introducing the CellChunkMap as a new additional index variant in the MemStore

[ https://issues.apache.org/jira/browse/HBASE-16421?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15784518#comment-15784518 ] ramkrishna.s.vasudevan commented on HBASE-16421: Sure. I will try using this option. But

[jira] [Commented] (HBASE-16421) Introducing the CellChunkMap as a new additional index variant in the MemStore

[ https://issues.apache.org/jira/browse/HBASE-16421?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15782921#comment-15782921 ] Eshcar Hillel commented on HBASE-16421: --- *maxscanlength*: for scans, what is the maximum number of

[jira] [Commented] (HBASE-16421) Introducing the CellChunkMap as a new additional index variant in the MemStore

[ https://issues.apache.org/jira/browse/HBASE-16421?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15782884#comment-15782884 ] ramkrishna.s.vasudevan commented on HBASE-16421: Thanks [~eshcar]. bq. the proportion of

[jira] [Commented] (HBASE-16421) Introducing the CellChunkMap as a new additional index variant in the MemStore

[ https://issues.apache.org/jira/browse/HBASE-16421?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15782866#comment-15782866 ] Eshcar Hillel commented on HBASE-16421: --- [~ram_krish] when running YCSB you can have properties

[jira] [Commented] (HBASE-16421) Introducing the CellChunkMap as a new additional index variant in the MemStore

[ https://issues.apache.org/jira/browse/HBASE-16421?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15782856#comment-15782856 ] Edward Bortnikov commented on HBASE-16421: -- Question unrelated to the unfolding technical

[jira] [Commented] (HBASE-16421) Introducing the CellChunkMap as a new additional index variant in the MemStore

[ https://issues.apache.org/jira/browse/HBASE-16421?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15782176#comment-15782176 ] ramkrishna.s.vasudevan commented on HBASE-16421: bq. I assume that in all experiments

[jira] [Commented] (HBASE-16421) Introducing the CellChunkMap as a new additional index variant in the MemStore

[ https://issues.apache.org/jira/browse/HBASE-16421?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15782169#comment-15782169 ] ramkrishna.s.vasudevan commented on HBASE-16421: Ya this is the total GC time. My main

[jira] [Commented] (HBASE-16421) Introducing the CellChunkMap as a new additional index variant in the MemStore

[ https://issues.apache.org/jira/browse/HBASE-16421?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15780737#comment-15780737 ] stack commented on HBASE-16421: --- Maybe the total time is GC time [~ram_krish]? > Introducing the

[jira] [Commented] (HBASE-16421) Introducing the CellChunkMap as a new additional index variant in the MemStore

[ https://issues.apache.org/jira/browse/HBASE-16421?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15780733#comment-15780733 ] stack commented on HBASE-16421: --- Do you have total pause times too as well as GC count [~ram_krish]? What

[jira] [Commented] (HBASE-16421) Introducing the CellChunkMap as a new additional index variant in the MemStore

[ https://issues.apache.org/jira/browse/HBASE-16421?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15780313#comment-15780313 ] Anastasia Braginsky commented on HBASE-16421: - Hi [~ram_krish], First of all, thank you very

[jira] [Commented] (HBASE-16421) Introducing the CellChunkMap as a new additional index variant in the MemStore

[ https://issues.apache.org/jira/browse/HBASE-16421?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15779814#comment-15779814 ] ramkrishna.s.vasudevan commented on HBASE-16421: Attaching a one min profiler to show the

[jira] [Commented] (HBASE-16421) Introducing the CellChunkMap as a new additional index variant in the MemStore

[ https://issues.apache.org/jira/browse/HBASE-16421?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15779806#comment-15779806 ] ramkrishna.s.vasudevan commented on HBASE-16421: Another point to be noted - the tests

[jira] [Commented] (HBASE-16421) Introducing the CellChunkMap as a new additional index variant in the MemStore

[ https://issues.apache.org/jira/browse/HBASE-16421?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15779804#comment-15779804 ] ramkrishna.s.vasudevan commented on HBASE-16421: I did some experiments. This was my set

[jira] [Commented] (HBASE-16421) Introducing the CellChunkMap as a new additional index variant in the MemStore

[ https://issues.apache.org/jira/browse/HBASE-16421?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15779779#comment-15779779 ] ramkrishna.s.vasudevan commented on HBASE-16421: One change that could be done here bq.+

[jira] [Commented] (HBASE-16421) Introducing the CellChunkMap as a new additional index variant in the MemStore

[ https://issues.apache.org/jira/browse/HBASE-16421?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15778604#comment-15778604 ] ramkrishna.s.vasudevan commented on HBASE-16421: I will give a patch for the chunk id in

[jira] [Commented] (HBASE-16421) Introducing the CellChunkMap as a new additional index variant in the MemStore

[ https://issues.apache.org/jira/browse/HBASE-16421?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15778400#comment-15778400 ] Anastasia Braginsky commented on HBASE-16421: - Dear [~ram_krish], did you (or may be Anoop)

[jira] [Commented] (HBASE-16421) Introducing the CellChunkMap as a new additional index variant in the MemStore

[ https://issues.apache.org/jira/browse/HBASE-16421?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15764042#comment-15764042 ] Anastasia Braginsky commented on HBASE-16421: - A collective answer to part of the issues

[jira] [Commented] (HBASE-16421) Introducing the CellChunkMap as a new additional index variant in the MemStore

[ https://issues.apache.org/jira/browse/HBASE-16421?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15763176#comment-15763176 ] Anoop Sam John commented on HBASE-16421: Again sorry for me not being clear I dont mean that the

[jira] [Commented] (HBASE-16421) Introducing the CellChunkMap as a new additional index variant in the MemStore

[ https://issues.apache.org/jira/browse/HBASE-16421?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15762435#comment-15762435 ] Edward Bortnikov commented on HBASE-16421: -- Thanks [~anoop.hbase]. Still, I kind of do not get

[jira] [Commented] (HBASE-16421) Introducing the CellChunkMap as a new additional index variant in the MemStore

[ https://issues.apache.org/jira/browse/HBASE-16421?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15761031#comment-15761031 ] ramkrishna.s.vasudevan commented on HBASE-16421: bq.1. We need evaluation of how

[jira] [Commented] (HBASE-16421) Introducing the CellChunkMap as a new additional index variant in the MemStore

[ https://issues.apache.org/jira/browse/HBASE-16421?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15760395#comment-15760395 ] Anoop Sam John commented on HBASE-16421: There is a diff btw the read path off heaping work and

[jira] [Commented] (HBASE-16421) Introducing the CellChunkMap as a new additional index variant in the MemStore

[ https://issues.apache.org/jira/browse/HBASE-16421?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15760375#comment-15760375 ] Edward Bortnikov commented on HBASE-16421: -- Thanks [~anastas], [~anoop.hbase] and [~stack]. Two

[jira] [Commented] (HBASE-16421) Introducing the CellChunkMap as a new additional index variant in the MemStore

[ https://issues.apache.org/jira/browse/HBASE-16421?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15760286#comment-15760286 ] Anoop Sam John commented on HBASE-16421: We should also do 1. A way to flush (to disk) chunk

[jira] [Commented] (HBASE-16421) Introducing the CellChunkMap as a new additional index variant in the MemStore

[ https://issues.apache.org/jira/browse/HBASE-16421?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15760159#comment-15760159 ] stack commented on HBASE-16421: --- ... 'no upserted cells' Sorry... prob. w/ upserted cells is? Why would

[jira] [Commented] (HBASE-16421) Introducing the CellChunkMap as a new additional index variant in the MemStore

[ https://issues.apache.org/jira/browse/HBASE-16421?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15760122#comment-15760122 ] ramkrishna.s.vasudevan commented on HBASE-16421: We may need the new type of Cell which

[jira] [Commented] (HBASE-16421) Introducing the CellChunkMap as a new additional index variant in the MemStore

[ https://issues.apache.org/jira/browse/HBASE-16421?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15758850#comment-15758850 ] Anastasia Braginsky commented on HBASE-16421: - Hey Again, Here is the road-map for how we

[jira] [Commented] (HBASE-16421) Introducing the CellChunkMap as a new additional index variant in the MemStore

[ https://issues.apache.org/jira/browse/HBASE-16421?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15748154#comment-15748154 ] ramkrishna.s.vasudevan commented on HBASE-16421: I have not done that. But let me get

[jira] [Commented] (HBASE-16421) Introducing the CellChunkMap as a new additional index variant in the MemStore

[ https://issues.apache.org/jira/browse/HBASE-16421?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15748066#comment-15748066 ] Anastasia Braginsky commented on HBASE-16421: - Returning to this issue after a while.

[jira] [Commented] (HBASE-16421) Introducing the CellChunkMap as a new additional index variant in the MemStore

[ https://issues.apache.org/jira/browse/HBASE-16421?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15630214#comment-15630214 ] Anastasia Braginsky commented on HBASE-16421: - November 2nd Meeting Summary: First of all a

[jira] [Commented] (HBASE-16421) Introducing the CellChunkMap as a new additional index variant in the MemStore

[ https://issues.apache.org/jira/browse/HBASE-16421?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15629125#comment-15629125 ] Anastasia Braginsky commented on HBASE-16421: - IntroductiontoNewFlatandCompactMemStore.pdf is

[jira] [Commented] (HBASE-16421) Introducing the CellChunkMap as a new additional index variant in the MemStore

[ https://issues.apache.org/jira/browse/HBASE-16421?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15629057#comment-15629057 ] stack commented on HBASE-16421: --- For large Cells, should be onheap because allocation of one-offs offheap

[jira] [Commented] (HBASE-16421) Introducing the CellChunkMap as a new additional index variant in the MemStore

[ https://issues.apache.org/jira/browse/HBASE-16421?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15628942#comment-15628942 ] stack commented on HBASE-16421: --- On CellChunkMapRevived.pdf, what is this about: "When a cell is upserted

[jira] [Commented] (HBASE-16421) Introducing the CellChunkMap as a new additional index variant in the MemStore

[ https://issues.apache.org/jira/browse/HBASE-16421?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15628899#comment-15628899 ] stack commented on HBASE-16421: --- Thanks for updating the documents [~anastas]. There is an aside on

[jira] [Commented] (HBASE-16421) Introducing the CellChunkMap as a new additional index variant in the MemStore

[ https://issues.apache.org/jira/browse/HBASE-16421?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15628887#comment-15628887 ] Anoop Sam John commented on HBASE-16421: Thanks for the revived doc. Looks to cover all aspects

[jira] [Commented] (HBASE-16421) Introducing the CellChunkMap as a new additional index variant in the MemStore

[ https://issues.apache.org/jira/browse/HBASE-16421?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15625937#comment-15625937 ] Anastasia Braginsky commented on HBASE-16421: - Sure. We have our solutions we thought about

[jira] [Commented] (HBASE-16421) Introducing the CellChunkMap as a new additional index variant in the MemStore

[ https://issues.apache.org/jira/browse/HBASE-16421?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15625767#comment-15625767 ] Anoop Sam John commented on HBASE-16421: There are ways with which we can overcome the limitation

[jira] [Commented] (HBASE-16421) Introducing the CellChunkMap as a new additional index variant in the MemStore

[ https://issues.apache.org/jira/browse/HBASE-16421?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15607350#comment-15607350 ] stack commented on HBASE-16421: --- Copied this, the question we need to answer, over to HBASE-16436 >

[jira] [Commented] (HBASE-16421) Introducing the CellChunkMap as a new additional index variant in the MemStore

[ https://issues.apache.org/jira/browse/HBASE-16421?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15424818#comment-15424818 ] ramkrishna.s.vasudevan commented on HBASE-16421: Pls feel free to raise/assign sub-jiras

[jira] [Commented] (HBASE-16421) Introducing the CellChunkMap as a new additional index variant in the MemStore

[ https://issues.apache.org/jira/browse/HBASE-16421?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15424490#comment-15424490 ] Edward Bortnikov commented on HBASE-16421: -- Let's agree on who-does-what in this Jira. We are

[jira] [Commented] (HBASE-16421) Introducing the CellChunkMap as a new additional index variant in the MemStore

[ https://issues.apache.org/jira/browse/HBASE-16421?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15424223#comment-15424223 ] Anastasia Braginsky commented on HBASE-16421: - Linked as "as part of", hope it is good

[jira] [Commented] (HBASE-16421) Introducing the CellChunkMap as a new additional index variant in the MemStore

[ https://issues.apache.org/jira/browse/HBASE-16421?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15424192#comment-15424192 ] ramkrishna.s.vasudevan commented on HBASE-16421: You wanted a set of subtasks for this

[jira] [Commented] (HBASE-16421) Introducing the CellChunkMap as a new additional index variant in the MemStore

[ https://issues.apache.org/jira/browse/HBASE-16421?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15424188#comment-15424188 ] Anastasia Braginsky commented on HBASE-16421: - Is it possible to create umbrella JIRA under

[jira] [Commented] (HBASE-16421) Introducing the CellChunkMap as a new additional index variant in the MemStore

[ https://issues.apache.org/jira/browse/HBASE-16421?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15424174#comment-15424174 ] ramkrishna.s.vasudevan commented on HBASE-16421: I thought we could create this under

[jira] [Commented] (HBASE-16421) Introducing the CellChunkMap as a new additional index variant in the MemStore

[ https://issues.apache.org/jira/browse/HBASE-16421?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15422670#comment-15422670 ] Anastasia Braginsky commented on HBASE-16421: - The summary of the previous steps: In