[jira] [Commented] (HBASE-18294) Reduce global heap pressure: flush based on heap occupancy

2018-02-11 Thread Eshcar Hillel (JIRA)
[ https://issues.apache.org/jira/browse/HBASE-18294?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16360087#comment-16360087 ] Eshcar Hillel commented on HBASE-18294: --- TestClientPushback is a flaky test, sometimes passes

[jira] [Commented] (HBASE-18294) Reduce global heap pressure: flush based on heap occupancy

2018-02-12 Thread Eshcar Hillel (JIRA)
[ https://issues.apache.org/jira/browse/HBASE-18294?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16360410#comment-16360410 ] Eshcar Hillel commented on HBASE-18294: --- QA passed. Any additional comments on the code? I plan to

[jira] [Commented] (HBASE-18294) Reduce global heap pressure: flush based on heap occupancy

2018-02-13 Thread Eshcar Hillel (JIRA)
[ https://issues.apache.org/jira/browse/HBASE-18294?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16362160#comment-16362160 ] Eshcar Hillel commented on HBASE-18294: --- I have updated the release notes, please see if this

[jira] [Updated] (HBASE-18294) Reduce global heap pressure: flush based on heap occupancy

2018-02-13 Thread Eshcar Hillel (JIRA)
[ https://issues.apache.org/jira/browse/HBASE-18294?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Eshcar Hillel updated HBASE-18294: -- Release Note: A region is flushed if its memory component exceeds the region flush threshold.

[jira] [Updated] (HBASE-18294) Reduce global heap pressure: flush based on heap occupancy

2018-02-14 Thread Eshcar Hillel (JIRA)
[ https://issues.apache.org/jira/browse/HBASE-18294?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Eshcar Hillel updated HBASE-18294: -- Release Note: A region is flushed if its memory component exceeds the region flush threshold.

[jira] [Commented] (HBASE-18294) Reduce global heap pressure: flush based on heap occupancy

2018-02-14 Thread Eshcar Hillel (JIRA)
[ https://issues.apache.org/jira/browse/HBASE-18294?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16363845#comment-16363845 ] Eshcar Hillel commented on HBASE-18294: --- Stack the barriers for the RS (global) level are more

[jira] [Commented] (HBASE-18294) Reduce global heap pressure: flush based on heap occupancy

2018-02-14 Thread Eshcar Hillel (JIRA)
[ https://issues.apache.org/jira/browse/HBASE-18294?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16364463#comment-16364463 ] Eshcar Hillel commented on HBASE-18294: --- Following a comment by Anoop on RB I made some additional

[jira] [Updated] (HBASE-18294) Reduce global heap pressure: flush based on heap occupancy

2018-02-14 Thread Eshcar Hillel (JIRA)
[ https://issues.apache.org/jira/browse/HBASE-18294?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Eshcar Hillel updated HBASE-18294: -- Attachment: HBASE-18294.01.patch > Reduce global heap pressure: flush based on heap occupancy

[jira] [Updated] (HBASE-18294) Reduce global heap pressure: flush based on heap occupancy

2018-02-15 Thread Eshcar Hillel (JIRA)
[ https://issues.apache.org/jira/browse/HBASE-18294?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Eshcar Hillel updated HBASE-18294: -- Attachment: HBASE-18294.01.patch > Reduce global heap pressure: flush based on heap occupancy

[jira] [Updated] (HBASE-18294) Reduce global heap pressure: flush based on heap occupancy

2018-02-19 Thread Eshcar Hillel (JIRA)
[ https://issues.apache.org/jira/browse/HBASE-18294?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Eshcar Hillel updated HBASE-18294: -- Resolution: Fixed Status: Resolved (was: Patch Available) > Reduce global heap

[jira] [Updated] (HBASE-18294) Reduce global heap pressure: flush based on heap occupancy

2018-02-18 Thread Eshcar Hillel (JIRA)
[ https://issues.apache.org/jira/browse/HBASE-18294?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Eshcar Hillel updated HBASE-18294: -- Attachment: HBASE-18294.branch-2.01.patch > Reduce global heap pressure: flush based on heap

[jira] [Commented] (HBASE-18294) Reduce global heap pressure: flush based on heap occupancy

2018-02-18 Thread Eshcar Hillel (JIRA)
[ https://issues.apache.org/jira/browse/HBASE-18294?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16368549#comment-16368549 ] Eshcar Hillel commented on HBASE-18294: --- Pushed to master and branch-2. No test failures on master

[jira] [Commented] (HBASE-20074) [FindBugs] Same code on both branches in CompactingMemStore#initMemStoreCompactor

2018-02-26 Thread Eshcar Hillel (JIRA)
[ https://issues.apache.org/jira/browse/HBASE-20074?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16376526#comment-16376526 ] Eshcar Hillel commented on HBASE-20074: --- Here is a summary of the throughput results of write-only

[jira] [Commented] (HBASE-20074) [FindBugs] Same code on both branches in CompactingMemStore#initMemStoreCompactor

2018-02-26 Thread Eshcar Hillel (JIRA)
[ https://issues.apache.org/jira/browse/HBASE-20074?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16376551#comment-16376551 ] Eshcar Hillel commented on HBASE-20074: --- So I would suggest to go with option 1 as first step.

[jira] [Commented] (HBASE-20074) [FindBugs] Same code on both branches in CompactingMemStore#initMemStoreCompactor

2018-02-26 Thread Eshcar Hillel (JIRA)
[ https://issues.apache.org/jira/browse/HBASE-20074?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16376594#comment-16376594 ] Eshcar Hillel commented on HBASE-20074: --- Gali already tried it and didn't see any change in the

[jira] [Updated] (HBASE-18294) Reduce global heap pressure: flush based on heap occupancy

2017-12-26 Thread Eshcar Hillel (JIRA)
[ https://issues.apache.org/jira/browse/HBASE-18294?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Eshcar Hillel updated HBASE-18294: -- Attachment: HBASE-18294.11.patch Test passes locally, trying to re-submit > Reduce global

[jira] [Commented] (HBASE-18294) Reduce global heap pressure: flush based on heap occupancy

2017-12-26 Thread Eshcar Hillel (JIRA)
[ https://issues.apache.org/jira/browse/HBASE-18294?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16303629#comment-16303629 ] Eshcar Hillel commented on HBASE-18294: --- I did not change the global level - see current patch in

[jira] [Commented] (HBASE-18294) Reduce global heap pressure: flush based on heap occupancy

2017-12-28 Thread Eshcar Hillel (JIRA)
[ https://issues.apache.org/jira/browse/HBASE-18294?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16305325#comment-16305325 ] Eshcar Hillel commented on HBASE-18294: --- Thanks [~stack] for the document, I think its a good

[jira] [Updated] (HBASE-18294) Reduce global heap pressure: flush based on heap occupancy

2017-12-26 Thread Eshcar Hillel (JIRA)
[ https://issues.apache.org/jira/browse/HBASE-18294?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Eshcar Hillel updated HBASE-18294: -- Attachment: HBASE-18294.12.patch > Reduce global heap pressure: flush based on heap occupancy

[jira] [Commented] (HBASE-18294) Reduce global heap pressure: flush based on heap occupancy

2017-12-26 Thread Eshcar Hillel (JIRA)
[ https://issues.apache.org/jira/browse/HBASE-18294?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16303858#comment-16303858 ] Eshcar Hillel commented on HBASE-18294: --- QA passed I would like to commit this in the next few

[jira] [Commented] (HBASE-18294) Reduce global heap pressure: flush based on heap occupancy

2017-12-28 Thread Eshcar Hillel (JIRA)
[ https://issues.apache.org/jira/browse/HBASE-18294?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16305509#comment-16305509 ] Eshcar Hillel commented on HBASE-18294: --- Thank you [~anoop.hbase] for explaining. I think I

[jira] [Commented] (HBASE-18294) Reduce global heap pressure: flush based on heap occupancy

2017-12-28 Thread Eshcar Hillel (JIRA)
[ https://issues.apache.org/jira/browse/HBASE-18294?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16305641#comment-16305641 ] Eshcar Hillel commented on HBASE-18294: --- OK let me prepare the patch. > Reduce global heap

[jira] [Updated] (HBASE-18294) Reduce global heap pressure: flush based on heap occupancy

2017-12-25 Thread Eshcar Hillel (JIRA)
[ https://issues.apache.org/jira/browse/HBASE-18294?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Eshcar Hillel updated HBASE-18294: -- Attachment: HBASE-18294.11.patch > Reduce global heap pressure: flush based on heap occupancy

[jira] [Commented] (HBASE-18294) Reduce global heap pressure: flush based on heap occupancy

2017-12-27 Thread Eshcar Hillel (JIRA)
[ https://issues.apache.org/jira/browse/HBASE-18294?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16304443#comment-16304443 ] Eshcar Hillel commented on HBASE-18294: --- Thanks all for the reviews, attached a new patch with the

[jira] [Updated] (HBASE-18294) Reduce global heap pressure: flush based on heap occupancy

2017-12-27 Thread Eshcar Hillel (JIRA)
[ https://issues.apache.org/jira/browse/HBASE-18294?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Eshcar Hillel updated HBASE-18294: -- Attachment: HBASE-18294.13.patch > Reduce global heap pressure: flush based on heap occupancy

[jira] [Updated] (HBASE-18294) Reduce global heap pressure: flush based on heap occupancy

2017-12-20 Thread Eshcar Hillel (JIRA)
[ https://issues.apache.org/jira/browse/HBASE-18294?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Eshcar Hillel updated HBASE-18294: -- Status: Open (was: Patch Available) > Reduce global heap pressure: flush based on heap

[jira] [Updated] (HBASE-18294) Reduce global heap pressure: flush based on heap occupancy

2017-12-20 Thread Eshcar Hillel (JIRA)
[ https://issues.apache.org/jira/browse/HBASE-18294?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Eshcar Hillel updated HBASE-18294: -- Status: Patch Available (was: Open) > Reduce global heap pressure: flush based on heap

[jira] [Commented] (HBASE-18294) Reduce global heap pressure: flush based on heap occupancy

2017-12-21 Thread Eshcar Hillel (JIRA)
[ https://issues.apache.org/jira/browse/HBASE-18294?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16300507#comment-16300507 ] Eshcar Hillel commented on HBASE-18294: --- Hey [~jmspaggi], We are definitely going to use the 128MB

[jira] [Commented] (HBASE-20074) [FindBugs] Same code on both branches in CompactingMemStore#initMemStoreCompactor

2018-02-25 Thread Eshcar Hillel (JIRA)
[ https://issues.apache.org/jira/browse/HBASE-20074?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16376005#comment-16376005 ] Eshcar Hillel commented on HBASE-20074: --- There are two options for handling this: (1) leave one

[jira] [Commented] (HBASE-20188) [TESTING] Performance

2018-07-31 Thread Eshcar Hillel (JIRA)
[ https://issues.apache.org/jira/browse/HBASE-20188?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16563885#comment-16563885 ] Eshcar Hillel commented on HBASE-20188: --- Hi, [~stack] I noticed you posted some additional

[jira] [Commented] (HBASE-20542) Better heap utilization for IMC with MSLABs

2018-07-04 Thread Eshcar Hillel (JIRA)
[ https://issues.apache.org/jira/browse/HBASE-20542?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16532354#comment-16532354 ] Eshcar Hillel commented on HBASE-20542: --- No the threshold is already set in TestHStore. It failed

[jira] [Commented] (HBASE-20542) Better heap utilization for IMC with MSLABs

2018-07-10 Thread Eshcar Hillel (JIRA)
[ https://issues.apache.org/jira/browse/HBASE-20542?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16538313#comment-16538313 ] Eshcar Hillel commented on HBASE-20542: --- TestHStore overrides the internal implementation of

[jira] [Commented] (HBASE-20542) Better heap utilization for IMC with MSLABs

2018-07-11 Thread Eshcar Hillel (JIRA)
[ https://issues.apache.org/jira/browse/HBASE-20542?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16539724#comment-16539724 ] Eshcar Hillel commented on HBASE-20542: --- Pushed to master and branch-2 > Better heap utilization

[jira] [Updated] (HBASE-20542) Better heap utilization for IMC with MSLABs

2018-07-08 Thread Eshcar Hillel (JIRA)
[ https://issues.apache.org/jira/browse/HBASE-20542?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Eshcar Hillel updated HBASE-20542: -- Attachment: HBASE-20542.master.005-addendum.patch > Better heap utilization for IMC with

[jira] [Updated] (HBASE-20542) Better heap utilization for IMC with MSLABs

2018-07-08 Thread Eshcar Hillel (JIRA)
[ https://issues.apache.org/jira/browse/HBASE-20542?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Eshcar Hillel updated HBASE-20542: -- Status: Patch Available (was: Reopened) > Better heap utilization for IMC with MSLABs >

[jira] [Updated] (HBASE-20542) Better heap utilization for IMC with MSLABs

2018-07-09 Thread Eshcar Hillel (JIRA)
[ https://issues.apache.org/jira/browse/HBASE-20542?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Eshcar Hillel updated HBASE-20542: -- Attachment: HBASE-20542-addendum.master.005.patch > Better heap utilization for IMC with

[jira] [Commented] (HBASE-20542) Better heap utilization for IMC with MSLABs

2018-07-09 Thread Eshcar Hillel (JIRA)
[ https://issues.apache.org/jira/browse/HBASE-20542?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16536901#comment-16536901 ] Eshcar Hillel commented on HBASE-20542: --- I will fix the style error and will commit the addendum

[jira] [Updated] (HBASE-18294) Reduce global heap pressure: flush based on heap occupancy

2018-01-24 Thread Eshcar Hillel (JIRA)
[ https://issues.apache.org/jira/browse/HBASE-18294?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Eshcar Hillel updated HBASE-18294: -- Attachment: HBASE-18294.master.01.patch > Reduce global heap pressure: flush based on heap

[jira] [Updated] (HBASE-18294) Reduce global heap pressure: flush based on heap occupancy

2018-01-22 Thread Eshcar Hillel (JIRA)
[ https://issues.apache.org/jira/browse/HBASE-18294?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Eshcar Hillel updated HBASE-18294: -- Attachment: HBASE-18294.01.patch > Reduce global heap pressure: flush based on heap occupancy

[jira] [Updated] (HBASE-18294) Reduce global heap pressure: flush based on heap occupancy

2018-01-22 Thread Eshcar Hillel (JIRA)
[ https://issues.apache.org/jira/browse/HBASE-18294?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Eshcar Hillel updated HBASE-18294: -- Attachment: (was: HBASE-18294.01.patch) > Reduce global heap pressure: flush based on heap

[jira] [Updated] (HBASE-18294) Reduce global heap pressure: flush based on heap occupancy

2018-01-22 Thread Eshcar Hillel (JIRA)
[ https://issues.apache.org/jira/browse/HBASE-18294?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Eshcar Hillel updated HBASE-18294: -- Status: Open (was: Patch Available) > Reduce global heap pressure: flush based on heap

[jira] [Updated] (HBASE-18294) Reduce global heap pressure: flush based on heap occupancy

2018-01-23 Thread Eshcar Hillel (JIRA)
[ https://issues.apache.org/jira/browse/HBASE-18294?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Eshcar Hillel updated HBASE-18294: -- Attachment: HBASE-18294.01.patch > Reduce global heap pressure: flush based on heap occupancy

[jira] [Updated] (HBASE-18294) Reduce global heap pressure: flush based on heap occupancy

2018-01-23 Thread Eshcar Hillel (JIRA)
[ https://issues.apache.org/jira/browse/HBASE-18294?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Eshcar Hillel updated HBASE-18294: -- Attachment: HBASE-18294.16.patch > Reduce global heap pressure: flush based on heap occupancy

[jira] [Updated] (HBASE-18294) Reduce global heap pressure: flush based on heap occupancy

2018-01-23 Thread Eshcar Hillel (JIRA)
[ https://issues.apache.org/jira/browse/HBASE-18294?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Eshcar Hillel updated HBASE-18294: -- Status: Open (was: Patch Available) > Reduce global heap pressure: flush based on heap

[jira] [Updated] (HBASE-18294) Reduce global heap pressure: flush based on heap occupancy

2018-01-23 Thread Eshcar Hillel (JIRA)
[ https://issues.apache.org/jira/browse/HBASE-18294?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Eshcar Hillel updated HBASE-18294: -- Status: Patch Available (was: Open) > Reduce global heap pressure: flush based on heap

[jira] [Updated] (HBASE-18294) Reduce global heap pressure: flush based on heap occupancy

2018-01-24 Thread Eshcar Hillel (JIRA)
[ https://issues.apache.org/jira/browse/HBASE-18294?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Eshcar Hillel updated HBASE-18294: -- Attachment: HBASE-18294.01.patch > Reduce global heap pressure: flush based on heap occupancy

[jira] [Comment Edited] (HBASE-20090) Properly handle Preconditions check failure in MemStoreFlusher$FlushHandler.run

2018-03-12 Thread Eshcar Hillel (JIRA)
[ https://issues.apache.org/jira/browse/HBASE-20090?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16395229#comment-16395229 ] Eshcar Hillel edited comment on HBASE-20090 at 3/12/18 1:27 PM: I am

[jira] [Commented] (HBASE-20090) Properly handle Preconditions check failure in MemStoreFlusher$FlushHandler.run

2018-03-12 Thread Eshcar Hillel (JIRA)
[ https://issues.apache.org/jira/browse/HBASE-20090?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16395229#comment-16395229 ] Eshcar Hillel commented on HBASE-20090: --- I am trying to see if I understand correctly the discussed

[jira] [Commented] (HBASE-20090) Properly handle Preconditions check failure in MemStoreFlusher$FlushHandler.run

2018-03-13 Thread Eshcar Hillel (JIRA)
[ https://issues.apache.org/jira/browse/HBASE-20090?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16397017#comment-16397017 ] Eshcar Hillel commented on HBASE-20090: --- So the suggested solution in v7 is to add region A into

[jira] [Commented] (HBASE-20090) Properly handle Preconditions check failure in MemStoreFlusher$FlushHandler.run

2018-03-13 Thread Eshcar Hillel (JIRA)
[ https://issues.apache.org/jira/browse/HBASE-20090?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16397086#comment-16397086 ] Eshcar Hillel commented on HBASE-20090: --- yes to this set > Properly handle Preconditions check

[jira] [Commented] (HBASE-20090) Properly handle Preconditions check failure in MemStoreFlusher$FlushHandler.run

2018-03-13 Thread Eshcar Hillel (JIRA)
[ https://issues.apache.org/jira/browse/HBASE-20090?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16397075#comment-16397075 ] Eshcar Hillel commented on HBASE-20090: --- What can go wrong if you do not add A into the list (just

[jira] [Commented] (HBASE-20090) Properly handle Preconditions check failure in MemStoreFlusher$FlushHandler.run

2018-03-14 Thread Eshcar Hillel (JIRA)
[ https://issues.apache.org/jira/browse/HBASE-20090?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16398277#comment-16398277 ] Eshcar Hillel commented on HBASE-20090: --- I am still not convinced it is necessary. You are not

[jira] [Commented] (HBASE-20090) Properly handle Preconditions check failure in MemStoreFlusher$FlushHandler.run

2018-03-14 Thread Eshcar Hillel (JIRA)
[ https://issues.apache.org/jira/browse/HBASE-20090?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16398504#comment-16398504 ] Eshcar Hillel commented on HBASE-20090: --- Yes, actually it makes sense to have all candidates sorted

[jira] [Commented] (HBASE-20090) Properly handle Preconditions check failure in MemStoreFlusher$FlushHandler.run

2018-03-15 Thread Eshcar Hillel (JIRA)
[ https://issues.apache.org/jira/browse/HBASE-20090?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16400190#comment-16400190 ] Eshcar Hillel commented on HBASE-20090: --- Still I am not convinced the code in the last patch covers

[jira] [Commented] (HBASE-20196) Maintain all regions with same size in memstore flusher

2018-03-15 Thread Eshcar Hillel (JIRA)
[ https://issues.apache.org/jira/browse/HBASE-20196?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16400196#comment-16400196 ] Eshcar Hillel commented on HBASE-20196: --- The code {code:java} if (!sortedRegions.containsKey(size))

[jira] [Updated] (HBASE-20188) [TESTING] Performance

2018-04-10 Thread Eshcar Hillel (JIRA)
[ https://issues.apache.org/jira/browse/HBASE-20188?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Eshcar Hillel updated HBASE-20188: -- Attachment: HBase 2.0 performance evaluation - 8GB(1).pdf > [TESTING] Performance >

[jira] [Commented] (HBASE-20188) [TESTING] Performance

2018-04-10 Thread Eshcar Hillel (JIRA)
[ https://issues.apache.org/jira/browse/HBASE-20188?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16432783#comment-16432783 ] Eshcar Hillel commented on HBASE-20188: --- Attaching additional benchmark results where we update and

[jira] [Commented] (HBASE-20188) [TESTING] Performance

2018-04-11 Thread Eshcar Hillel (JIRA)
[ https://issues.apache.org/jira/browse/HBASE-20188?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16433700#comment-16433700 ] Eshcar Hillel commented on HBASE-20188: --- Just to summarize the results again -- We see that in

[jira] [Commented] (HBASE-20188) [TESTING] Performance

2018-04-11 Thread Eshcar Hillel (JIRA)
[ https://issues.apache.org/jira/browse/HBASE-20188?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16433704#comment-16433704 ] Eshcar Hillel commented on HBASE-20188: --- re-attaching [^workloadx] from the most recent experiment

[jira] [Updated] (HBASE-20188) [TESTING] Performance

2018-04-11 Thread Eshcar Hillel (JIRA)
[ https://issues.apache.org/jira/browse/HBASE-20188?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Eshcar Hillel updated HBASE-20188: -- Attachment: workloadx > [TESTING] Performance > - > > Key:

[jira] [Commented] (HBASE-20188) [TESTING] Performance

2018-04-11 Thread Eshcar Hillel (JIRA)
[ https://issues.apache.org/jira/browse/HBASE-20188?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16433710#comment-16433710 ] Eshcar Hillel commented on HBASE-20188: --- And another thing, might be just a distraction but we

[jira] [Commented] (HBASE-20188) [TESTING] Performance

2018-04-11 Thread Eshcar Hillel (JIRA)
[ https://issues.apache.org/jira/browse/HBASE-20188?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16434384#comment-16434384 ] Eshcar Hillel commented on HBASE-20188: --- vq. I should add workloadx to the suite of tests I'm

[jira] [Created] (HBASE-20390) IMC Default Parameters for 2.0.0

2018-04-11 Thread Eshcar Hillel (JIRA)
Eshcar Hillel created HBASE-20390: - Summary: IMC Default Parameters for 2.0.0 Key: HBASE-20390 URL: https://issues.apache.org/jira/browse/HBASE-20390 Project: HBase Issue Type: Task

[jira] [Updated] (HBASE-20390) IMC Default Parameters for 2.0.0

2018-04-11 Thread Eshcar Hillel (JIRA)
[ https://issues.apache.org/jira/browse/HBASE-20390?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Eshcar Hillel updated HBASE-20390: -- Issue Type: Sub-task (was: Task) Parent: HBASE-20188 > IMC Default Parameters for

[jira] [Assigned] (HBASE-20390) IMC Default Parameters for 2.0.0

2018-04-11 Thread Eshcar Hillel (JIRA)
[ https://issues.apache.org/jira/browse/HBASE-20390?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Eshcar Hillel reassigned HBASE-20390: - Assignee: Eshcar Hillel > IMC Default Parameters for 2.0.0 >

[jira] [Commented] (HBASE-20188) [TESTING] Performance

2018-04-12 Thread Eshcar Hillel (JIRA)
[ https://issues.apache.org/jira/browse/HBASE-20188?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16435236#comment-16435236 ] Eshcar Hillel commented on HBASE-20188: --- We also ran the same experiments in HDD machines and

[jira] [Comment Edited] (HBASE-20188) [TESTING] Performance

2018-04-12 Thread Eshcar Hillel (JIRA)
[ https://issues.apache.org/jira/browse/HBASE-20188?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16434384#comment-16434384 ] Eshcar Hillel edited comment on HBASE-20188 at 4/12/18 9:25 AM: bq. I

[jira] [Commented] (HBASE-20188) [TESTING] Performance

2018-04-13 Thread Eshcar Hillel (JIRA)
[ https://issues.apache.org/jira/browse/HBASE-20188?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16437794#comment-16437794 ] Eshcar Hillel commented on HBASE-20188: --- [~anoop.hbase] can you post the command line or script +

[jira] [Updated] (HBASE-20188) [TESTING] Performance

2018-04-09 Thread Eshcar Hillel (JIRA)
[ https://issues.apache.org/jira/browse/HBASE-20188?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Eshcar Hillel updated HBASE-20188: -- Attachment: HBase 2.0 performance evaluation - 8GB.pdf > [TESTING] Performance >

[jira] [Updated] (HBASE-20188) [TESTING] Performance

2018-04-09 Thread Eshcar Hillel (JIRA)
[ https://issues.apache.org/jira/browse/HBASE-20188?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Eshcar Hillel updated HBASE-20188: -- Attachment: hbase-site.xml workloadx HBASE-20188-xac.sh >

[jira] [Commented] (HBASE-20188) [TESTING] Performance

2018-04-09 Thread Eshcar Hillel (JIRA)
[ https://issues.apache.org/jira/browse/HBASE-20188?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16431148#comment-16431148 ] Eshcar Hillel commented on HBASE-20188: --- I attached the results of some additional experiments we

[jira] [Commented] (HBASE-20188) [TESTING] Performance

2018-04-04 Thread Eshcar Hillel (JIRA)
[ https://issues.apache.org/jira/browse/HBASE-20188?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16426130#comment-16426130 ] Eshcar Hillel commented on HBASE-20188: --- I am trying to write a new workload that applies client

[jira] [Commented] (HBASE-20188) [TESTING] Performance

2018-04-04 Thread Eshcar Hillel (JIRA)
[ https://issues.apache.org/jira/browse/HBASE-20188?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16426134#comment-16426134 ] Eshcar Hillel commented on HBASE-20188: --- This is the code that initiates {{bufferedMutator}} in

[jira] [Commented] (HBASE-20188) [TESTING] Performance

2018-04-04 Thread Eshcar Hillel (JIRA)
[ https://issues.apache.org/jira/browse/HBASE-20188?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16426168#comment-16426168 ] Eshcar Hillel commented on HBASE-20188: --- I am running hbase12 client This is the code of the client

[jira] [Commented] (HBASE-20188) [TESTING] Performance

2018-04-17 Thread Eshcar Hillel (JIRA)
[ https://issues.apache.org/jira/browse/HBASE-20188?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16440582#comment-16440582 ] Eshcar Hillel commented on HBASE-20188: --- [~anoop.hbase] can you share the exact command line you

[jira] [Updated] (HBASE-20390) IMC Default Parameters for 2.0.0

2018-04-15 Thread Eshcar Hillel (JIRA)
[ https://issues.apache.org/jira/browse/HBASE-20390?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Eshcar Hillel updated HBASE-20390: -- Release Note: Changing in-memory compaction (IMC) defaults: (1) active segment is 2% of

[jira] [Updated] (HBASE-20390) IMC Default Parameters for 2.0.0

2018-04-15 Thread Eshcar Hillel (JIRA)
[ https://issues.apache.org/jira/browse/HBASE-20390?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Eshcar Hillel updated HBASE-20390: -- Attachment: HBASE-20390-branch-2.0-01.patch > IMC Default Parameters for 2.0.0 >

[jira] [Commented] (HBASE-20455) [IHC] Workloadx

2018-04-20 Thread Eshcar Hillel (JIRA)
[ https://issues.apache.org/jira/browse/HBASE-20455?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16445547#comment-16445547 ] Eshcar Hillel commented on HBASE-20455: --- In your experiment with workloadx you use buffer size=2MB

[jira] [Updated] (HBASE-20390) IMC Default Parameters for 2.0.0

2018-04-16 Thread Eshcar Hillel (JIRA)
[ https://issues.apache.org/jira/browse/HBASE-20390?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Eshcar Hillel updated HBASE-20390: -- Attachment: HBASE-20390.branch-2.0.002.patch > IMC Default Parameters for 2.0.0 >

[jira] [Commented] (HBASE-20411) Ameliorate MutableSegment synchronize

2018-04-16 Thread Eshcar Hillel (JIRA)
[ https://issues.apache.org/jira/browse/HBASE-20411?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16439140#comment-16439140 ] Eshcar Hillel commented on HBASE-20411: --- I briefly went over the code in RB. Did you had a chance

[jira] [Commented] (HBASE-20236) [locking] Write-time worst offenders

2018-03-28 Thread Eshcar Hillel (JIRA)
[ https://issues.apache.org/jira/browse/HBASE-20236?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16417228#comment-16417228 ] Eshcar Hillel commented on HBASE-20236: --- I can take a look into this. I see the semaphor used in

[jira] [Commented] (HBASE-20188) [TESTING] Performance

2018-03-29 Thread Eshcar Hillel (JIRA)
[ https://issues.apache.org/jira/browse/HBASE-20188?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16418735#comment-16418735 ] Eshcar Hillel commented on HBASE-20188: --- One way to explain the poor performance of reads with

[jira] [Commented] (HBASE-20188) [TESTING] Performance

2018-03-24 Thread Eshcar Hillel (JIRA)
[ https://issues.apache.org/jira/browse/HBASE-20188?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16412807#comment-16412807 ] Eshcar Hillel commented on HBASE-20188: --- Something to consider: When I ran the experiments to

[jira] [Commented] (HBASE-20188) [TESTING] Performance

2018-03-24 Thread Eshcar Hillel (JIRA)
[ https://issues.apache.org/jira/browse/HBASE-20188?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16412792#comment-16412792 ] Eshcar Hillel commented on HBASE-20188: --- Stack the table with throughput and latency numbers you

[jira] [Commented] (HBASE-20188) [TESTING] Performance

2018-04-02 Thread Eshcar Hillel (JIRA)
[ https://issues.apache.org/jira/browse/HBASE-20188?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16422176#comment-16422176 ] Eshcar Hillel commented on HBASE-20188: --- I agree the read performance degradation shown in

[jira] [Commented] (HBASE-20259) Doc configs for in-memory-compaction and add detail to in-memory-compaction logging

2018-04-02 Thread Eshcar Hillel (JIRA)
[ https://issues.apache.org/jira/browse/HBASE-20259?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16422191#comment-16422191 ] Eshcar Hillel commented on HBASE-20259: --- I also added a comment in RB – the description of Adaptive

[jira] [Updated] (HBASE-20188) [TESTING] Performance

2018-04-03 Thread Eshcar Hillel (JIRA)
[ https://issues.apache.org/jira/browse/HBASE-20188?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Eshcar Hillel updated HBASE-20188: -- Attachment: HBASE-20188.sh > [TESTING] Performance > - > >

[jira] [Updated] (HBASE-20188) [TESTING] Performance

2018-04-03 Thread Eshcar Hillel (JIRA)
[ https://issues.apache.org/jira/browse/HBASE-20188?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Eshcar Hillel updated HBASE-20188: -- Attachment: HBase 2.0 performance evaluation - Basic vs None_ system settings.pdf > [TESTING]

[jira] [Commented] (HBASE-20188) [TESTING] Performance

2018-04-03 Thread Eshcar Hillel (JIRA)
[ https://issues.apache.org/jira/browse/HBASE-20188?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16424604#comment-16424604 ] Eshcar Hillel commented on HBASE-20188: --- Attached are the results of evaluations over *SSD*

[jira] [Commented] (HBASE-20188) [TESTING] Performance

2018-04-04 Thread Eshcar Hillel (JIRA)
[ https://issues.apache.org/jira/browse/HBASE-20188?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16425146#comment-16425146 ] Eshcar Hillel commented on HBASE-20188: --- bq. can you please share how can we switch on

[jira] [Commented] (HBASE-20188) [TESTING] Performance

2018-04-04 Thread Eshcar Hillel (JIRA)
[ https://issues.apache.org/jira/browse/HBASE-20188?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16425142#comment-16425142 ] Eshcar Hillel commented on HBASE-20188: --- {quote}Did you use hbase defaults or did you change

[jira] [Commented] (HBASE-20188) [TESTING] Performance

2018-03-18 Thread Eshcar Hillel (JIRA)
[ https://issues.apache.org/jira/browse/HBASE-20188?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16403904#comment-16403904 ] Eshcar Hillel commented on HBASE-20188: --- Another reason flushes are too slow could be the disk

[jira] [Commented] (HBASE-19639) ITBLL can't go big because RegionTooBusyException... Above memstore limit

2018-03-18 Thread Eshcar Hillel (JIRA)
[ https://issues.apache.org/jira/browse/HBASE-19639?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16403890#comment-16403890 ] Eshcar Hillel commented on HBASE-19639: --- [~stack] any chance you can attach here the entire log

[jira] [Commented] (HBASE-20196) Maintain all regions with same size in memstore flusher

2018-03-18 Thread Eshcar Hillel (JIRA)
[ https://issues.apache.org/jira/browse/HBASE-20196?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16403909#comment-16403909 ] Eshcar Hillel commented on HBASE-20196: --- +1 > Maintain all regions with same size in memstore

[jira] [Commented] (HBASE-20090) Properly handle Preconditions check failure in MemStoreFlusher$FlushHandler.run

2018-03-18 Thread Eshcar Hillel (JIRA)
[ https://issues.apache.org/jira/browse/HBASE-20090?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16403908#comment-16403908 ] Eshcar Hillel commented on HBASE-20090: --- +1 > Properly handle Preconditions check failure in >

[jira] [Commented] (HBASE-19639) ITBLL can't go big because RegionTooBusyException... Above memstore limit

2018-03-20 Thread Eshcar Hillel (JIRA)
[ https://issues.apache.org/jira/browse/HBASE-19639?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16406124#comment-16406124 ] Eshcar Hillel commented on HBASE-19639: --- I might have misinterpreted a line in the log. How would

[jira] [Commented] (HBASE-19639) ITBLL can't go big because RegionTooBusyException... Above memstore limit

2018-03-20 Thread Eshcar Hillel (JIRA)
[ https://issues.apache.org/jira/browse/HBASE-19639?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16406022#comment-16406022 ] Eshcar Hillel commented on HBASE-19639: --- Thanks [~stack] I went over the log - didn't see any

[jira] [Commented] (HBASE-20188) [TESTING] Performance

2018-03-22 Thread Eshcar Hillel (JIRA)
[ https://issues.apache.org/jira/browse/HBASE-20188?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16409243#comment-16409243 ] Eshcar Hillel commented on HBASE-20188: --- What does load (in YCSB_load) stands for? Which

[jira] [Commented] (HBASE-20074) [FindBugs] Same code on both branches in CompactingMemStore#initMemStoreCompactor

2018-02-26 Thread Eshcar Hillel (JIRA)
[ https://issues.apache.org/jira/browse/HBASE-20074?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16376763#comment-16376763 ] Eshcar Hillel commented on HBASE-20074: --- Code solves the problem but still a warning in the report.

[jira] [Updated] (HBASE-20542) Better heap utilization for IMC with MSLABs

2018-06-28 Thread Eshcar Hillel (JIRA)
[ https://issues.apache.org/jira/browse/HBASE-20542?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Eshcar Hillel updated HBASE-20542: -- Attachment: HBASE-20542.branch-2.005.patch > Better heap utilization for IMC with MSLABs >

<    2   3   4   5   6   7   8   >