[jira] [Commented] (HBASE-14918) In-Memory MemStore Flush and Compaction

2016-10-28 Thread Edward Bortnikov (JIRA)
[ https://issues.apache.org/jira/browse/HBASE-14918?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15615304#comment-15615304 ] Edward Bortnikov commented on HBASE-14918: -- Let's focus the discussion on HBASE-14617, that is

[jira] [Commented] (HBASE-14918) In-Memory MemStore Flush and Compaction

2016-10-28 Thread Anoop Sam John (JIRA)
[ https://issues.apache.org/jira/browse/HBASE-14918?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15614715#comment-15614715 ] Anoop Sam John commented on HBASE-14918: bq."For data compaction we do not use MSLABs​ to avoid

[jira] [Commented] (HBASE-14918) In-Memory MemStore Flush and Compaction

2016-10-27 Thread ramkrishna.s.vasudevan (JIRA)
[ https://issues.apache.org/jira/browse/HBASE-14918?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15614309#comment-15614309 ] ramkrishna.s.vasudevan commented on HBASE-14918: Thanks for the results. Looks great.

[jira] [Commented] (HBASE-14918) In-Memory MemStore Flush and Compaction

2016-10-27 Thread stack (JIRA)
[ https://issues.apache.org/jira/browse/HBASE-14918?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15614268#comment-15614268 ] stack commented on HBASE-14918: --- 12 virtual or physical cores? bq. "For data compaction we do not use

[jira] [Commented] (HBASE-14918) In-Memory MemStore Flush and Compaction

2016-10-27 Thread Anoop Sam John (JIRA)
[ https://issues.apache.org/jira/browse/HBASE-14918?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15612079#comment-15612079 ] Anoop Sam John commented on HBASE-14918: So no tests with NO index merge at all? When the #

[jira] [Commented] (HBASE-14918) In-Memory MemStore Flush and Compaction

2016-10-27 Thread Eshcar Hillel (JIRA)
[ https://issues.apache.org/jira/browse/HBASE-14918?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15612053#comment-15612053 ] Eshcar Hillel commented on HBASE-14918: --- It is default memstore. > In-Memory MemStore Flush and

[jira] [Commented] (HBASE-14918) In-Memory MemStore Flush and Compaction

2016-10-27 Thread Anoop Sam John (JIRA)
[ https://issues.apache.org/jira/browse/HBASE-14918?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15611957#comment-15611957 ] Anoop Sam John commented on HBASE-14918: Good work. In last fig, 'default' means Default

[jira] [Commented] (HBASE-14918) In-Memory MemStore Flush and Compaction

2016-08-31 Thread ramkrishna.s.vasudevan (JIRA)
[ https://issues.apache.org/jira/browse/HBASE-14918?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15451584#comment-15451584 ] ramkrishna.s.vasudevan commented on HBASE-14918: I think it was already raised as another

[jira] [Commented] (HBASE-14918) In-Memory MemStore Flush and Compaction

2016-08-31 Thread Edward Bortnikov (JIRA)
[ https://issues.apache.org/jira/browse/HBASE-14918?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15451505#comment-15451505 ] Edward Bortnikov commented on HBASE-14918: -- HBASE-16421 > In-Memory MemStore Flush and

[jira] [Commented] (HBASE-14918) In-Memory MemStore Flush and Compaction

2016-08-31 Thread Edward Bortnikov (JIRA)
[ https://issues.apache.org/jira/browse/HBASE-14918?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15451506#comment-15451506 ] Edward Bortnikov commented on HBASE-14918: -- HBASE-16421 > In-Memory MemStore Flush and

[jira] [Commented] (HBASE-14918) In-Memory MemStore Flush and Compaction

2016-08-31 Thread Anoop Sam John (JIRA)
[ https://issues.apache.org/jira/browse/HBASE-14918?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15451498#comment-15451498 ] Anoop Sam John commented on HBASE-14918: Which jira# tracks the CellChunkMap and related stuff

[jira] [Commented] (HBASE-14918) In-Memory MemStore Flush and Compaction

2016-08-21 Thread Edward Bortnikov (JIRA)
[ https://issues.apache.org/jira/browse/HBASE-14918?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15429728#comment-15429728 ] Edward Bortnikov commented on HBASE-14918: -- We've just attached a proposed simplified spec for

[jira] [Commented] (HBASE-14918) In-Memory MemStore Flush and Compaction

2016-08-17 Thread Edward Bortnikov (JIRA)
[ https://issues.apache.org/jira/browse/HBASE-14918?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15424488#comment-15424488 ] Edward Bortnikov commented on HBASE-14918: -- Let's agree on who-does-what in this Jira. We are

[jira] [Commented] (HBASE-14918) In-Memory MemStore Flush and Compaction

2016-08-17 Thread Edward Bortnikov (JIRA)
[ https://issues.apache.org/jira/browse/HBASE-14918?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15424487#comment-15424487 ] Edward Bortnikov commented on HBASE-14918: -- Let's agree on who-does-what in this Jira. We are

[jira] [Commented] (HBASE-14918) In-Memory MemStore Flush and Compaction

2016-03-20 Thread Eshcar Hillel (JIRA)
[ https://issues.apache.org/jira/browse/HBASE-14918?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15203266#comment-15203266 ] Eshcar Hillel commented on HBASE-14918: --- New patch is attached to task HBASE-14920 - new compacting

[jira] [Commented] (HBASE-14918) In-Memory MemStore Flush and Compaction

2016-02-26 Thread ramkrishna.s.vasudevan (JIRA)
[ https://issues.apache.org/jira/browse/HBASE-14918?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15170410#comment-15170410 ] ramkrishna.s.vasudevan commented on HBASE-14918: Yes we could move that to PRefixtree

[jira] [Commented] (HBASE-14918) In-Memory MemStore Flush and Compaction

2016-02-26 Thread stack (JIRA)
[ https://issues.apache.org/jira/browse/HBASE-14918?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15169406#comment-15169406 ] stack commented on HBASE-14918: --- Move ByteRange into the prefix-tree module? If prefix-tree is enabled,

[jira] [Commented] (HBASE-14918) In-Memory MemStore Flush and Compaction

2016-02-26 Thread ramkrishna.s.vasudevan (JIRA)
[ https://issues.apache.org/jira/browse/HBASE-14918?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15168669#comment-15168669 ] ramkrishna.s.vasudevan commented on HBASE-14918: Since BR is used heavily in the

[jira] [Commented] (HBASE-14918) In-Memory MemStore Flush and Compaction

2016-02-25 Thread Anoop Sam John (JIRA)
[ https://issues.apache.org/jira/browse/HBASE-14918?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15167514#comment-15167514 ] Anoop Sam John commented on HBASE-14918: Ya as BR can only handle on heap, we may have to move

[jira] [Commented] (HBASE-14918) In-Memory MemStore Flush and Compaction

2016-02-25 Thread stack (JIRA)
[ https://issues.apache.org/jira/browse/HBASE-14918?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15167497#comment-15167497 ] stack commented on HBASE-14918: --- Thanks [~ram_krish] See my comment above to [~anoop.hbase] on campaign to

[jira] [Commented] (HBASE-14918) In-Memory MemStore Flush and Compaction

2016-02-25 Thread stack (JIRA)
[ https://issues.apache.org/jira/browse/HBASE-14918?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15167496#comment-15167496 ] stack commented on HBASE-14918: --- bq. Our ByteBuff adds one unwanted wrap. We dont want multiple BB backing

[jira] [Commented] (HBASE-14918) In-Memory MemStore Flush and Compaction

2016-02-25 Thread Anastasia Braginsky (JIRA)
[ https://issues.apache.org/jira/browse/HBASE-14918?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15167347#comment-15167347 ] Anastasia Braginsky commented on HBASE-14918: - [~stack], [~anoop.hbase], [~ram_krish] and

[jira] [Commented] (HBASE-14918) In-Memory MemStore Flush and Compaction

2016-02-24 Thread ramkrishna.s.vasudevan (JIRA)
[ https://issues.apache.org/jira/browse/HBASE-14918?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15166882#comment-15166882 ] ramkrishna.s.vasudevan commented on HBASE-14918: bq.Yeah, lets align what you are doing

[jira] [Commented] (HBASE-14918) In-Memory MemStore Flush and Compaction

2016-02-24 Thread Anoop Sam John (JIRA)
[ https://issues.apache.org/jira/browse/HBASE-14918?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15166843#comment-15166843 ] Anoop Sam John commented on HBASE-14918: So the underlying data structure is array of Cells or

[jira] [Commented] (HBASE-14918) In-Memory MemStore Flush and Compaction

2016-02-24 Thread stack (JIRA)
[ https://issues.apache.org/jira/browse/HBASE-14918?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15163424#comment-15163424 ] stack commented on HBASE-14918: --- bq. the CellBlocks suggests to use ArrayList of PositionedByteRange as

[jira] [Commented] (HBASE-14918) In-Memory MemStore Flush and Compaction

2016-02-23 Thread Anastasia Braginsky (JIRA)
[ https://issues.apache.org/jira/browse/HBASE-14918?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15158983#comment-15158983 ] Anastasia Braginsky commented on HBASE-14918: - Thank you for your immediate attention

[jira] [Commented] (HBASE-14918) In-Memory MemStore Flush and Compaction

2016-02-22 Thread stack (JIRA)
[ https://issues.apache.org/jira/browse/HBASE-14918?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15157510#comment-15157510 ] stack commented on HBASE-14918: --- Sounds great Anastasia. bq. The HFile instance (with all its great

[jira] [Commented] (HBASE-14918) In-Memory MemStore Flush and Compaction

2016-02-22 Thread Anastasia Braginsky (JIRA)
[ https://issues.apache.org/jira/browse/HBASE-14918?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15156756#comment-15156756 ] Anastasia Braginsky commented on HBASE-14918: - Hi, We are now starting to progress with the

[jira] [Commented] (HBASE-14918) In-Memory MemStore Flush and Compaction

2016-01-28 Thread Anoop Sam John (JIRA)
[ https://issues.apache.org/jira/browse/HBASE-14918?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15121121#comment-15121121 ] Anoop Sam John commented on HBASE-14918: As per the present trunk code, we can move it out.. I

[jira] [Commented] (HBASE-14918) In-Memory MemStore Flush and Compaction

2016-01-28 Thread Eshcar Hillel (JIRA)
[ https://issues.apache.org/jira/browse/HBASE-14918?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15121094#comment-15121094 ] Eshcar Hillel commented on HBASE-14918: --- Thanks [~anoop.hbase]. I don't see how you can move MSLAB

[jira] [Commented] (HBASE-14918) In-Memory MemStore Flush and Compaction

2016-01-28 Thread Eshcar Hillel (JIRA)
[ https://issues.apache.org/jira/browse/HBASE-14918?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15121385#comment-15121385 ] Eshcar Hillel commented on HBASE-14918: --- I reviewed the mslab-move patch. Software-engineering-wise

[jira] [Commented] (HBASE-14918) In-Memory MemStore Flush and Compaction

2016-01-28 Thread Anoop Sam John (JIRA)
[ https://issues.apache.org/jira/browse/HBASE-14918?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15121402#comment-15121402 ] Anoop Sam John commented on HBASE-14918: Ya I said it already, with the new Memstore impls it

[jira] [Commented] (HBASE-14918) In-Memory MemStore Flush and Compaction

2016-01-28 Thread Anoop Sam John (JIRA)
[ https://issues.apache.org/jira/browse/HBASE-14918?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15121231#comment-15121231 ] Anoop Sam John commented on HBASE-14918: bq.Each block is a PositionedByteRange (essentially

[jira] [Commented] (HBASE-14918) In-Memory MemStore Flush and Compaction

2016-01-28 Thread Eshcar Hillel (JIRA)
[ https://issues.apache.org/jira/browse/HBASE-14918?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15121203#comment-15121203 ] Eshcar Hillel commented on HBASE-14918: --- ok. But even in the HBASE-15180 patch DefaultMemStore

[jira] [Commented] (HBASE-14918) In-Memory MemStore Flush and Compaction

2016-01-28 Thread Anoop Sam John (JIRA)
[ https://issues.apache.org/jira/browse/HBASE-14918?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15121216#comment-15121216 ] Anoop Sam John commented on HBASE-14918: No in those patch I have not done this move. I was

[jira] [Commented] (HBASE-14918) In-Memory MemStore Flush and Compaction

2016-01-27 Thread Anoop Sam John (JIRA)
[ https://issues.apache.org/jira/browse/HBASE-14918?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15119208#comment-15119208 ] Anoop Sam John commented on HBASE-14918: [~eshcar] In one of the subtask (infrastructure

[jira] [Commented] (HBASE-14918) In-Memory MemStore Flush and Compaction

2016-01-22 Thread stack (JIRA)
[ https://issues.apache.org/jira/browse/HBASE-14918?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15112950#comment-15112950 ] stack commented on HBASE-14918: --- [~anoop.hbase] You see above sir? > In-Memory MemStore Flush and

[jira] [Commented] (HBASE-14918) In-Memory MemStore Flush and Compaction

2016-01-22 Thread Anoop Sam John (JIRA)
[ https://issues.apache.org/jira/browse/HBASE-14918?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15113555#comment-15113555 ] Anoop Sam John commented on HBASE-14918: I dont know why when the name is being referred, am not

[jira] [Commented] (HBASE-14918) In-Memory MemStore Flush and Compaction

2016-01-21 Thread Eshcar Hillel (JIRA)
[ https://issues.apache.org/jira/browse/HBASE-14918?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15110274#comment-15110274 ] Eshcar Hillel commented on HBASE-14918: --- I submitted a patch in task 1 two days ago but didn't

[jira] [Commented] (HBASE-14918) In-Memory MemStore Flush and Compaction

2016-01-21 Thread Eshcar Hillel (JIRA)
[ https://issues.apache.org/jira/browse/HBASE-14918?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15110790#comment-15110790 ] Eshcar Hillel commented on HBASE-14918: --- I went through the code in HBASE-10713, and it seems we

[jira] [Commented] (HBASE-14918) In-Memory MemStore Flush and Compaction

2015-12-27 Thread Eshcar Hillel (JIRA)
[ https://issues.apache.org/jira/browse/HBASE-14918?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15072127#comment-15072127 ] Eshcar Hillel commented on HBASE-14918: --- Both patches got +1 overall in QA. Happy Holidays to those

[jira] [Commented] (HBASE-14918) In-Memory MemStore Flush and Compaction

2015-12-24 Thread Eshcar Hillel (JIRA)
[ https://issues.apache.org/jira/browse/HBASE-14918?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15070913#comment-15070913 ] Eshcar Hillel commented on HBASE-14918: --- Patches are available for task 1 and task 2. > In-Memory

[jira] [Commented] (HBASE-14918) In-Memory MemStore Flush and Compaction

2015-12-03 Thread Eshcar Hillel (JIRA)
[ https://issues.apache.org/jira/browse/HBASE-14918?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15037817#comment-15037817 ] Eshcar Hillel commented on HBASE-14918: --- Submitted patch for first sub-task > In-Memory MemStore