[jira] [Commented] (HBASE-17373) Reverse the order of snapshot creation in the CompactingMemStore

2017-01-04 Thread Eshcar Hillel (JIRA)
[ https://issues.apache.org/jira/browse/HBASE-17373?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=15797549#comment-15797549 ] Eshcar Hillel commented on HBASE-17373: --- [~ram_krish] I think you now have good und

[jira] [Commented] (HBASE-17407) Correct update of maxFlushedSeqId in HRegion

2017-01-04 Thread Eshcar Hillel (JIRA)
[ https://issues.apache.org/jira/browse/HBASE-17407?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=15797653#comment-15797653 ] Eshcar Hillel commented on HBASE-17407: --- Here is what I read: {code} void abortCa

[jira] [Commented] (HBASE-17379) Lack of synchronization in CompactionPipeline#getScanners()

2017-01-04 Thread Eshcar Hillel (JIRA)
[ https://issues.apache.org/jira/browse/HBASE-17379?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=15797876#comment-15797876 ] Eshcar Hillel commented on HBASE-17379: --- bq. Before HBASE-17081 - you mean the prob

[jira] [Commented] (HBASE-17379) Lack of synchronization in CompactionPipeline#getScanners()

2017-01-04 Thread Eshcar Hillel (JIRA)
[ https://issues.apache.org/jira/browse/HBASE-17379?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=15800664#comment-15800664 ] Eshcar Hillel commented on HBASE-17379: --- I went over the patch. Still it seems much

[jira] [Commented] (HBASE-17379) Lack of synchronization in CompactionPipeline#getScanners()

2017-01-05 Thread Eshcar Hillel (JIRA)
[ https://issues.apache.org/jira/browse/HBASE-17379?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=15800687#comment-15800687 ] Eshcar Hillel commented on HBASE-17379: --- I went over the trunk code again, and I no

[jira] [Commented] (HBASE-17379) Lack of synchronization in CompactionPipeline#getScanners()

2017-01-05 Thread Eshcar Hillel (JIRA)
[ https://issues.apache.org/jira/browse/HBASE-17379?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=15800700#comment-15800700 ] Eshcar Hillel commented on HBASE-17379: --- Meanwhile, until we decide which way to go

[jira] [Comment Edited] (HBASE-17379) Lack of synchronization in CompactionPipeline#getScanners()

2017-01-05 Thread Eshcar Hillel (JIRA)
[ https://issues.apache.org/jira/browse/HBASE-17379?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=15800687#comment-15800687 ] Eshcar Hillel edited comment on HBASE-17379 at 1/5/17 8:10 AM:

[jira] [Commented] (HBASE-17407) Correct update of maxFlushedSeqId in HRegion

2017-01-05 Thread Eshcar Hillel (JIRA)
[ https://issues.apache.org/jira/browse/HBASE-17407?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=15800723#comment-15800723 ] Eshcar Hillel commented on HBASE-17407: --- Thanks [~stack] your explanation is very h

[jira] [Created] (HBASE-17434) New Synchronization Scheme for Compaction Pipeline

2017-01-06 Thread Eshcar Hillel (JIRA)
Eshcar Hillel created HBASE-17434: - Summary: New Synchronization Scheme for Compaction Pipeline Key: HBASE-17434 URL: https://issues.apache.org/jira/browse/HBASE-17434 Project: HBase Issue Ty

[jira] [Updated] (HBASE-17434) New Synchronization Scheme for Compaction Pipeline

2017-01-06 Thread Eshcar Hillel (JIRA)
[ https://issues.apache.org/jira/browse/HBASE-17434?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Eshcar Hillel updated HBASE-17434: -- Attachment: HBASE-17434-V01.patch > New Synchronization Scheme for Compaction Pipeline > --

[jira] [Updated] (HBASE-17434) New Synchronization Scheme for Compaction Pipeline

2017-01-06 Thread Eshcar Hillel (JIRA)
[ https://issues.apache.org/jira/browse/HBASE-17434?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Eshcar Hillel updated HBASE-17434: -- Status: Patch Available (was: Open) > New Synchronization Scheme for Compaction Pipeline > ---

[jira] [Commented] (HBASE-17434) New Synchronization Scheme for Compaction Pipeline

2017-01-06 Thread Eshcar Hillel (JIRA)
[ https://issues.apache.org/jira/browse/HBASE-17434?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=15805355#comment-15805355 ] Eshcar Hillel commented on HBASE-17434: --- The design of the new scheme is discussed

[jira] [Commented] (HBASE-17379) Lack of synchronization in CompactionPipeline#getScanners()

2017-01-06 Thread Eshcar Hillel (JIRA)
[ https://issues.apache.org/jira/browse/HBASE-17379?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=15805369#comment-15805369 ] Eshcar Hillel commented on HBASE-17379: --- Created a new Jira HBASE-17434 to fix the

[jira] [Commented] (HBASE-17434) New Synchronization Scheme for Compaction Pipeline

2017-01-06 Thread Eshcar Hillel (JIRA)
[ https://issues.apache.org/jira/browse/HBASE-17434?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=15805502#comment-15805502 ] Eshcar Hillel commented on HBASE-17434: --- The problem reported in HBASE-17379 can be

[jira] [Commented] (HBASE-17434) New Synchronization Scheme for Compaction Pipeline

2017-01-06 Thread Eshcar Hillel (JIRA)
[ https://issues.apache.org/jira/browse/HBASE-17434?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=15805533#comment-15805533 ] Eshcar Hillel commented on HBASE-17434: --- The current patch implements copy-on-write

[jira] [Updated] (HBASE-17434) New Synchronization Scheme for Compaction Pipeline

2017-01-08 Thread Eshcar Hillel (JIRA)
[ https://issues.apache.org/jira/browse/HBASE-17434?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Eshcar Hillel updated HBASE-17434: -- Attachment: HBASE-17434-V02.patch > New Synchronization Scheme for Compaction Pipeline > --

[jira] [Commented] (HBASE-17434) New Synchronization Scheme for Compaction Pipeline

2017-01-08 Thread Eshcar Hillel (JIRA)
[ https://issues.apache.org/jira/browse/HBASE-17434?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=15810016#comment-15810016 ] Eshcar Hillel commented on HBASE-17434: --- I also prefer read-write lock over an excl

[jira] [Commented] (HBASE-17434) New Synchronization Scheme for Compaction Pipeline

2017-01-08 Thread Eshcar Hillel (JIRA)
[ https://issues.apache.org/jira/browse/HBASE-17434?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=15810038#comment-15810038 ] Eshcar Hillel commented on HBASE-17434: --- Making a copy inside the building block me

[jira] [Updated] (HBASE-17434) New Synchronization Scheme for Compaction Pipeline

2017-01-09 Thread Eshcar Hillel (JIRA)
[ https://issues.apache.org/jira/browse/HBASE-17434?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Eshcar Hillel updated HBASE-17434: -- Attachment: HBASE-17434-V03.patch > New Synchronization Scheme for Compaction Pipeline > --

[jira] [Commented] (HBASE-17434) New Synchronization Scheme for Compaction Pipeline

2017-01-09 Thread Eshcar Hillel (JIRA)
[ https://issues.apache.org/jira/browse/HBASE-17434?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=15811438#comment-15811438 ] Eshcar Hillel commented on HBASE-17434: --- Following HBASE-17373 the drain method is

[jira] [Commented] (HBASE-17434) New Synchronization Scheme for Compaction Pipeline

2017-01-09 Thread Eshcar Hillel (JIRA)
[ https://issues.apache.org/jira/browse/HBASE-17434?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=15811443#comment-15811443 ] Eshcar Hillel commented on HBASE-17434: --- V03 changes version to be volatile since i

[jira] [Commented] (HBASE-17434) New Synchronization Scheme for Compaction Pipeline

2017-01-09 Thread Eshcar Hillel (JIRA)
[ https://issues.apache.org/jira/browse/HBASE-17434?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=15811590#comment-15811590 ] Eshcar Hillel commented on HBASE-17434: --- The logic and timing of moving segments in

[jira] [Commented] (HBASE-17434) New Synchronization Scheme for Compaction Pipeline

2017-01-09 Thread Eshcar Hillel (JIRA)
[ https://issues.apache.org/jira/browse/HBASE-17434?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=15811593#comment-15811593 ] Eshcar Hillel commented on HBASE-17434: --- The comment by FindBugs can be ignored sin

[jira] [Commented] (HBASE-17434) New Synchronization Scheme for Compaction Pipeline

2017-01-09 Thread Eshcar Hillel (JIRA)
[ https://issues.apache.org/jira/browse/HBASE-17434?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=15811674#comment-15811674 ] Eshcar Hillel commented on HBASE-17434: --- This is the same as in DefaultMemstote - t

[jira] [Commented] (HBASE-17434) New Synchronization Scheme for Compaction Pipeline

2017-01-10 Thread Eshcar Hillel (JIRA)
[ https://issues.apache.org/jira/browse/HBASE-17434?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=15814318#comment-15814318 ] Eshcar Hillel commented on HBASE-17434: --- Thanks. So here are my answers (some are a

[jira] [Updated] (HBASE-17434) New Synchronization Scheme for Compaction Pipeline

2017-01-10 Thread Eshcar Hillel (JIRA)
[ https://issues.apache.org/jira/browse/HBASE-17434?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Eshcar Hillel updated HBASE-17434: -- Attachment: HBASE-17434-V04.patch > New Synchronization Scheme for Compaction Pipeline > --

[jira] [Commented] (HBASE-17434) New Synchronization Scheme for Compaction Pipeline

2017-01-10 Thread Eshcar Hillel (JIRA)
[ https://issues.apache.org/jira/browse/HBASE-17434?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=15814832#comment-15814832 ] Eshcar Hillel commented on HBASE-17434: --- Java does not have pointers. It has primit

[jira] [Updated] (HBASE-17434) New Synchronization Scheme for Compaction Pipeline

2017-01-10 Thread Eshcar Hillel (JIRA)
[ https://issues.apache.org/jira/browse/HBASE-17434?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Eshcar Hillel updated HBASE-17434: -- Attachment: HBASE-17434-V05.patch > New Synchronization Scheme for Compaction Pipeline > --

[jira] [Commented] (HBASE-17434) New Synchronization Scheme for Compaction Pipeline

2017-01-10 Thread Eshcar Hillel (JIRA)
[ https://issues.apache.org/jira/browse/HBASE-17434?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=15815057#comment-15815057 ] Eshcar Hillel commented on HBASE-17434: --- With the possibility of non-atomic initial

[jira] [Updated] (HBASE-17434) New Synchronization Scheme for Compaction Pipeline

2017-01-11 Thread Eshcar Hillel (JIRA)
[ https://issues.apache.org/jira/browse/HBASE-17434?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Eshcar Hillel updated HBASE-17434: -- Attachment: HBASE-17434-V06.patch > New Synchronization Scheme for Compaction Pipeline > --

[jira] [Commented] (HBASE-17434) New Synchronization Scheme for Compaction Pipeline

2017-01-12 Thread Eshcar Hillel (JIRA)
[ https://issues.apache.org/jira/browse/HBASE-17434?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=15820586#comment-15820586 ] Eshcar Hillel commented on HBASE-17434: --- No failures this time ;) Patch V06 fixes s

[jira] [Updated] (HBASE-17407) Correct update of maxFlushedSeqId in HRegion

2017-01-15 Thread Eshcar Hillel (JIRA)
[ https://issues.apache.org/jira/browse/HBASE-17407?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Eshcar Hillel updated HBASE-17407: -- Status: Patch Available (was: Open) > Correct update of maxFlushedSeqId in HRegion > -

[jira] [Updated] (HBASE-17407) Correct update of maxFlushedSeqId in HRegion

2017-01-15 Thread Eshcar Hillel (JIRA)
[ https://issues.apache.org/jira/browse/HBASE-17407?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Eshcar Hillel updated HBASE-17407: -- Attachment: HBASE-17407-V01.patch > Correct update of maxFlushedSeqId in HRegion >

[jira] [Commented] (HBASE-17081) Flush the entire CompactingMemStore content to disk

2017-01-17 Thread Eshcar Hillel (JIRA)
[ https://issues.apache.org/jira/browse/HBASE-17081?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=15826094#comment-15826094 ] Eshcar Hillel commented on HBASE-17081: --- +1 for committing :) > Flush the entire C

[jira] [Updated] (HBASE-17407) Correct update of maxFlushedSeqId in HRegion

2017-01-18 Thread Eshcar Hillel (JIRA)
[ https://issues.apache.org/jira/browse/HBASE-17407?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Eshcar Hillel updated HBASE-17407: -- Attachment: HBASE-17407-V02.patch HBASE-17407-V01.patch > Correct update of max

[jira] [Commented] (HBASE-17407) Correct update of maxFlushedSeqId in HRegion

2017-01-19 Thread Eshcar Hillel (JIRA)
[ https://issues.apache.org/jira/browse/HBASE-17407?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=15830504#comment-15830504 ] Eshcar Hillel commented on HBASE-17407: --- Please review the new patch (in RB). Meanw

[jira] [Commented] (HBASE-17407) Correct update of maxFlushedSeqId in HRegion

2017-01-19 Thread Eshcar Hillel (JIRA)
[ https://issues.apache.org/jira/browse/HBASE-17407?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=15830580#comment-15830580 ] Eshcar Hillel commented on HBASE-17407: --- V02 is already after rebase :) > Correct

[jira] [Commented] (HBASE-17407) Correct update of maxFlushedSeqId in HRegion

2017-01-22 Thread Eshcar Hillel (JIRA)
[ https://issues.apache.org/jira/browse/HBASE-17407?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=15833445#comment-15833445 ] Eshcar Hillel commented on HBASE-17407: --- bq. Let's just remove the old startCacheFl

[jira] [Updated] (HBASE-17407) Correct update of maxFlushedSeqId in HRegion

2017-01-22 Thread Eshcar Hillel (JIRA)
[ https://issues.apache.org/jira/browse/HBASE-17407?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Eshcar Hillel updated HBASE-17407: -- Attachment: HBASE-17407-V02.patch > Correct update of maxFlushedSeqId in HRegion >

[jira] [Updated] (HBASE-17339) Scan-Memory-First Optimization for Get Operations

2017-01-26 Thread Eshcar Hillel (JIRA)
[ https://issues.apache.org/jira/browse/HBASE-17339?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Eshcar Hillel updated HBASE-17339: -- Summary: Scan-Memory-First Optimization for Get Operations (was: Scan-Memory-First Optimizatio

[jira] [Updated] (HBASE-17339) Scan-Memory-First Optimization for Get Operations

2017-01-26 Thread Eshcar Hillel (JIRA)
[ https://issues.apache.org/jira/browse/HBASE-17339?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Eshcar Hillel updated HBASE-17339: -- Attachment: HBASE-17339-V02.patch > Scan-Memory-First Optimization for Get Operations > ---

[jira] [Commented] (HBASE-17339) Scan-Memory-First Optimization for Get Operations

2017-01-26 Thread Eshcar Hillel (JIRA)
[ https://issues.apache.org/jira/browse/HBASE-17339?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=15839458#comment-15839458 ] Eshcar Hillel commented on HBASE-17339: --- The attached patch is not complete and not

[jira] [Commented] (HBASE-17339) Scan-Memory-First Optimization for Get Operations

2017-01-26 Thread Eshcar Hillel (JIRA)
[ https://issues.apache.org/jira/browse/HBASE-17339?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=15839463#comment-15839463 ] Eshcar Hillel commented on HBASE-17339: --- Patch also available in review board. > S

[jira] [Assigned] (HBASE-17575) Towards Making BASIC the Default In-Memory Compaction Policy

2017-02-01 Thread Eshcar Hillel (JIRA)
[ https://issues.apache.org/jira/browse/HBASE-17575?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Eshcar Hillel reassigned HBASE-17575: - Assignee: Eshcar Hillel > Towards Making BASIC the Default In-Memory Compaction Policy >

[jira] [Created] (HBASE-17575) Towards Making BASIC the Default In-Memory Compaction Policy

2017-02-01 Thread Eshcar Hillel (JIRA)
Eshcar Hillel created HBASE-17575: - Summary: Towards Making BASIC the Default In-Memory Compaction Policy Key: HBASE-17575 URL: https://issues.apache.org/jira/browse/HBASE-17575 Project: HBase

[jira] [Updated] (HBASE-17575) Towards Making BASIC the Default In-Memory Compaction Policy

2017-02-01 Thread Eshcar Hillel (JIRA)
[ https://issues.apache.org/jira/browse/HBASE-17575?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Eshcar Hillel updated HBASE-17575: -- Attachment: HBASE-17575-V01.patch > Towards Making BASIC the Default In-Memory Compaction Polic

[jira] [Updated] (HBASE-17575) Towards Making BASIC the Default In-Memory Compaction Policy

2017-02-01 Thread Eshcar Hillel (JIRA)
[ https://issues.apache.org/jira/browse/HBASE-17575?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Eshcar Hillel updated HBASE-17575: -- Status: Patch Available (was: Open) > Towards Making BASIC the Default In-Memory Compaction Po

[jira] [Updated] (HBASE-17575) Towards Making BASIC the Default In-Memory Compaction Policy

2017-02-01 Thread Eshcar Hillel (JIRA)
[ https://issues.apache.org/jira/browse/HBASE-17575?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Eshcar Hillel updated HBASE-17575: -- Description: In preparation for switching the default in-memory compaction policy to BASIC, we

[jira] [Commented] (HBASE-17575) Towards Making BASIC the Default In-Memory Compaction Policy

2017-02-01 Thread Eshcar Hillel (JIRA)
[ https://issues.apache.org/jira/browse/HBASE-17575?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=15848371#comment-15848371 ] Eshcar Hillel commented on HBASE-17575: --- The bug fix in this patch is in MemStoreSe

[jira] [Updated] (HBASE-17575) Towards Making BASIC the Default In-Memory Compaction Policy

2017-02-01 Thread Eshcar Hillel (JIRA)
[ https://issues.apache.org/jira/browse/HBASE-17575?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Eshcar Hillel updated HBASE-17575: -- Attachment: HBASE-17575-V01.patch > Towards Making BASIC the Default In-Memory Compaction Polic

[jira] [Commented] (HBASE-17575) Towards Making BASIC the Default In-Memory Compaction Policy

2017-02-02 Thread Eshcar Hillel (JIRA)
[ https://issues.apache.org/jira/browse/HBASE-17575?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=15849690#comment-15849690 ] Eshcar Hillel commented on HBASE-17575: --- Definitely we plan to run the same set of

[jira] [Commented] (HBASE-17575) Run critical tests with each of the Inmemory Compaction Policies enabled (Towards Making BASIC the Default In-Memory Compaction Policy)

2017-02-05 Thread Eshcar Hillel (JIRA)
[ https://issues.apache.org/jira/browse/HBASE-17575?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=15853211#comment-15853211 ] Eshcar Hillel commented on HBASE-17575: --- Thanks [~stack] -- the new title is defini

[jira] [Updated] (HBASE-17575) Run critical tests with each of the Inmemory Compaction Policies enabled (Towards Making BASIC the Default In-Memory Compaction Policy)

2017-02-06 Thread Eshcar Hillel (JIRA)
[ https://issues.apache.org/jira/browse/HBASE-17575?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Eshcar Hillel updated HBASE-17575: -- Attachment: HBASE-17575-V02.patch > Run critical tests with each of the Inmemory Compaction Pol

[jira] [Commented] (HBASE-17575) Run critical tests with each of the Inmemory Compaction Policies enabled (Towards Making BASIC the Default In-Memory Compaction Policy)

2017-02-06 Thread Eshcar Hillel (JIRA)
[ https://issues.apache.org/jira/browse/HBASE-17575?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=15853964#comment-15853964 ] Eshcar Hillel commented on HBASE-17575: --- Applied Anoop's comments in new patch. bq

[jira] [Assigned] (HBASE-17339) Scan-Memory-First Optimization for Get Operations

2017-02-08 Thread Eshcar Hillel (JIRA)
[ https://issues.apache.org/jira/browse/HBASE-17339?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Eshcar Hillel reassigned HBASE-17339: - Assignee: Eshcar Hillel > Scan-Memory-First Optimization for Get Operations > --

[jira] [Updated] (HBASE-17339) Scan-Memory-First Optimization for Get Operations

2017-02-08 Thread Eshcar Hillel (JIRA)
[ https://issues.apache.org/jira/browse/HBASE-17339?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Eshcar Hillel updated HBASE-17339: -- Attachment: HBASE-17339-V03.patch > Scan-Memory-First Optimization for Get Operations > ---

[jira] [Updated] (HBASE-17339) Scan-Memory-First Optimization for Get Operations

2017-02-08 Thread Eshcar Hillel (JIRA)
[ https://issues.apache.org/jira/browse/HBASE-17339?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Eshcar Hillel updated HBASE-17339: -- Attachment: HBASE-17339-V03.patch > Scan-Memory-First Optimization for Get Operations > ---

[jira] [Updated] (HBASE-17339) Scan-Memory-First Optimization for Get Operations

2017-02-08 Thread Eshcar Hillel (JIRA)
[ https://issues.apache.org/jira/browse/HBASE-17339?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Eshcar Hillel updated HBASE-17339: -- Status: Patch Available (was: Open) > Scan-Memory-First Optimization for Get Operations >

[jira] [Commented] (HBASE-17339) Scan-Memory-First Optimization for Get Operations

2017-02-08 Thread Eshcar Hillel (JIRA)
[ https://issues.apache.org/jira/browse/HBASE-17339?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=15857616#comment-15857616 ] Eshcar Hillel commented on HBASE-17339: --- new patch is available Summary of changes:

[jira] [Comment Edited] (HBASE-17339) Scan-Memory-First Optimization for Get Operations

2017-02-08 Thread Eshcar Hillel (JIRA)
[ https://issues.apache.org/jira/browse/HBASE-17339?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=15857616#comment-15857616 ] Eshcar Hillel edited comment on HBASE-17339 at 2/8/17 8:08 AM:

[jira] [Updated] (HBASE-17339) Scan-Memory-First Optimization for Get Operations

2017-02-08 Thread Eshcar Hillel (JIRA)
[ https://issues.apache.org/jira/browse/HBASE-17339?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Eshcar Hillel updated HBASE-17339: -- Attachment: HBASE-17339-V04.patch > Scan-Memory-First Optimization for Get Operations > ---

[jira] [Commented] (HBASE-17339) Scan-Memory-First Optimization for Get Operations

2017-02-08 Thread Eshcar Hillel (JIRA)
[ https://issues.apache.org/jira/browse/HBASE-17339?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=15857939#comment-15857939 ] Eshcar Hillel commented on HBASE-17339: --- Currently the optimization is only on in T

[jira] [Commented] (HBASE-17575) Run critical tests with each of the Inmemory Compaction Policies enabled (Towards Making BASIC the Default In-Memory Compaction Policy)

2017-02-08 Thread Eshcar Hillel (JIRA)
[ https://issues.apache.org/jira/browse/HBASE-17575?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=15857969#comment-15857969 ] Eshcar Hillel commented on HBASE-17575: --- ping. [~stack]. commit? > Run critical te

[jira] [Updated] (HBASE-17339) Scan-Memory-First Optimization for Get Operations

2017-02-09 Thread Eshcar Hillel (JIRA)
[ https://issues.apache.org/jira/browse/HBASE-17339?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Eshcar Hillel updated HBASE-17339: -- Attachment: HBASE-17339-V05.patch > Scan-Memory-First Optimization for Get Operations > ---

[jira] [Commented] (HBASE-16417) In-Memory MemStore Policy for Flattening and Compactions

2017-02-12 Thread Eshcar Hillel (JIRA)
[ https://issues.apache.org/jira/browse/HBASE-16417?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=15862759#comment-15862759 ] Eshcar Hillel commented on HBASE-16417: --- Back to running large scale benchmarks !!

[jira] [Commented] (HBASE-16417) In-Memory MemStore Policy for Flattening and Compactions

2017-02-13 Thread Eshcar Hillel (JIRA)
[ https://issues.apache.org/jira/browse/HBASE-16417?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=15863364#comment-15863364 ] Eshcar Hillel commented on HBASE-16417: --- I realized the problem was that I didn't u

[jira] [Commented] (HBASE-16417) In-Memory MemStore Policy for Flattening and Compactions

2017-02-13 Thread Eshcar Hillel (JIRA)
[ https://issues.apache.org/jira/browse/HBASE-16417?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=15863623#comment-15863623 ] Eshcar Hillel commented on HBASE-16417: --- Thanks anoop and ramkrishna -- the columns

[jira] [Created] (HBASE-17655) Removing MemStoreScanner and SnapshotScanner

2017-02-16 Thread Eshcar Hillel (JIRA)
Eshcar Hillel created HBASE-17655: - Summary: Removing MemStoreScanner and SnapshotScanner Key: HBASE-17655 URL: https://issues.apache.org/jira/browse/HBASE-17655 Project: HBase Issue Type: Im

[jira] [Updated] (HBASE-17655) Removing MemStoreScanner and SnapshotScanner

2017-02-16 Thread Eshcar Hillel (JIRA)
[ https://issues.apache.org/jira/browse/HBASE-17655?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Eshcar Hillel updated HBASE-17655: -- Attachment: HBASE-17655-V01.patch > Removing MemStoreScanner and SnapshotScanner >

[jira] [Updated] (HBASE-17655) Removing MemStoreScanner and SnapshotScanner

2017-02-16 Thread Eshcar Hillel (JIRA)
[ https://issues.apache.org/jira/browse/HBASE-17655?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Eshcar Hillel updated HBASE-17655: -- Status: Patch Available (was: Open) > Removing MemStoreScanner and SnapshotScanner > -

[jira] [Updated] (HBASE-17655) Removing MemStoreScanner and SnapshotScanner

2017-02-16 Thread Eshcar Hillel (JIRA)
[ https://issues.apache.org/jira/browse/HBASE-17655?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Eshcar Hillel updated HBASE-17655: -- Description: With CompactingMemstore becoming the new default, a store comprises multiple memo

[jira] [Commented] (HBASE-17655) Removing MemStoreScanner and SnapshotScanner

2017-02-19 Thread Eshcar Hillel (JIRA)
[ https://issues.apache.org/jira/browse/HBASE-17655?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=15873530#comment-15873530 ] Eshcar Hillel commented on HBASE-17655: --- Cannot reproduce the failure locally. Mean

[jira] [Commented] (HBASE-17655) Removing MemStoreScanner and SnapshotScanner

2017-02-20 Thread Eshcar Hillel (JIRA)
[ https://issues.apache.org/jira/browse/HBASE-17655?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=15874183#comment-15874183 ] Eshcar Hillel commented on HBASE-17655: --- Thanks, [~ram_krish]. While working on HBA

[jira] [Commented] (HBASE-17655) Removing MemStoreScanner and SnapshotScanner

2017-02-27 Thread Eshcar Hillel (JIRA)
[ https://issues.apache.org/jira/browse/HBASE-17655?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=15885680#comment-15885680 ] Eshcar Hillel commented on HBASE-17655: --- attaching new patch after rebase and code

[jira] [Updated] (HBASE-17655) Removing MemStoreScanner and SnapshotScanner

2017-02-27 Thread Eshcar Hillel (JIRA)
[ https://issues.apache.org/jira/browse/HBASE-17655?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Eshcar Hillel updated HBASE-17655: -- Attachment: HBASE-17655-V02.patch > Removing MemStoreScanner and SnapshotScanner >

[jira] [Updated] (HBASE-17655) Removing MemStoreScanner and SnapshotScanner

2017-02-27 Thread Eshcar Hillel (JIRA)
[ https://issues.apache.org/jira/browse/HBASE-17655?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Eshcar Hillel updated HBASE-17655: -- Attachment: HBASE-17655-V03.patch > Removing MemStoreScanner and SnapshotScanner >

[jira] [Updated] (HBASE-17655) Removing MemStoreScanner and SnapshotScanner

2017-02-27 Thread Eshcar Hillel (JIRA)
[ https://issues.apache.org/jira/browse/HBASE-17655?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Eshcar Hillel updated HBASE-17655: -- Attachment: HBASE-17655-V04.patch Fixed test. Rerunning QA. > Removing MemStoreScanner and Sna

[jira] [Updated] (HBASE-17655) Removing MemStoreScanner and SnapshotScanner

2017-02-27 Thread Eshcar Hillel (JIRA)
[ https://issues.apache.org/jira/browse/HBASE-17655?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Eshcar Hillel updated HBASE-17655: -- Attachment: HBASE-17655-V05.patch fix findbugs warning > Removing MemStoreScanner and Snapsho

[jira] [Commented] (HBASE-17655) Removing MemStoreScanner and SnapshotScanner

2017-02-27 Thread Eshcar Hillel (JIRA)
[ https://issues.apache.org/jira/browse/HBASE-17655?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=15887335#comment-15887335 ] Eshcar Hillel commented on HBASE-17655: --- This test also fails locally in master. Ar

[jira] [Updated] (HBASE-17655) Removing MemStoreScanner and SnapshotScanner

2017-02-28 Thread Eshcar Hillel (JIRA)
[ https://issues.apache.org/jira/browse/HBASE-17655?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Eshcar Hillel updated HBASE-17655: -- Attachment: HBASE-17655-V05.patch > Removing MemStoreScanner and SnapshotScanner >

[jira] [Commented] (HBASE-17655) Removing MemStoreScanner and SnapshotScanner

2017-02-28 Thread Eshcar Hillel (JIRA)
[ https://issues.apache.org/jira/browse/HBASE-17655?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=15887938#comment-15887938 ] Eshcar Hillel commented on HBASE-17655: --- last patch is in review board > Removing

[jira] [Commented] (HBASE-16417) In-Memory MemStore Policy for Flattening and Compactions

2017-02-28 Thread Eshcar Hillel (JIRA)
[ https://issues.apache.org/jira/browse/HBASE-16417?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=15888180#comment-15888180 ] Eshcar Hillel commented on HBASE-16417: --- To measure write amplification in our benc

[jira] [Updated] (HBASE-17655) Removing MemStoreScanner and SnapshotScanner

2017-02-28 Thread Eshcar Hillel (JIRA)
[ https://issues.apache.org/jira/browse/HBASE-17655?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Eshcar Hillel updated HBASE-17655: -- Attachment: HBASE-17655-V06.patch > Removing MemStoreScanner and SnapshotScanner >

[jira] [Commented] (HBASE-16417) In-Memory MemStore Policy for Flattening and Compactions

2017-02-28 Thread Eshcar Hillel (JIRA)
[ https://issues.apache.org/jira/browse/HBASE-16417?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=15888755#comment-15888755 ] Eshcar Hillel commented on HBASE-16417: --- I am running YCSB, size of values is set t

[jira] [Commented] (HBASE-16417) In-Memory MemStore Policy for Flattening and Compactions

2017-02-28 Thread Eshcar Hillel (JIRA)
[ https://issues.apache.org/jira/browse/HBASE-16417?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=15889596#comment-15889596 ] Eshcar Hillel commented on HBASE-16417: --- I am not running the default values of YCS

[jira] [Comment Edited] (HBASE-16417) In-Memory MemStore Policy for Flattening and Compactions

2017-02-28 Thread Eshcar Hillel (JIRA)
[ https://issues.apache.org/jira/browse/HBASE-16417?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=15889596#comment-15889596 ] Eshcar Hillel edited comment on HBASE-16417 at 3/1/17 6:31 AM:

[jira] [Updated] (HBASE-17655) Removing MemStoreScanner and SnapshotScanner

2017-03-02 Thread Eshcar Hillel (JIRA)
[ https://issues.apache.org/jira/browse/HBASE-17655?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Eshcar Hillel updated HBASE-17655: -- Attachment: HBASE-17655-V07.patch > Removing MemStoreScanner and SnapshotScanner >

[jira] [Commented] (HBASE-17655) Removing MemStoreScanner and SnapshotScanner

2017-03-02 Thread Eshcar Hillel (JIRA)
[ https://issues.apache.org/jira/browse/HBASE-17655?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=15891822#comment-15891822 ] Eshcar Hillel commented on HBASE-17655: --- Added a method to RegionObserver with the

[jira] [Updated] (HBASE-16417) In-Memory MemStore Policy for Flattening and Compactions

2017-03-09 Thread Eshcar Hillel (JIRA)
[ https://issues.apache.org/jira/browse/HBASE-16417?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Eshcar Hillel updated HBASE-16417: -- Attachment: HBASE-16417-benchmarkresults-20170309.pdf > In-Memory MemStore Policy for Flattenin

[jira] [Commented] (HBASE-16417) In-Memory MemStore Policy for Flattening and Compactions

2017-03-09 Thread Eshcar Hillel (JIRA)
[ https://issues.apache.org/jira/browse/HBASE-16417?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=15903176#comment-15903176 ] Eshcar Hillel commented on HBASE-16417: --- NEW BENCHMARKS RESULTS ARE ATTACHED!!! We

[jira] [Commented] (HBASE-16417) In-Memory MemStore Policy for Flattening and Compactions

2017-03-10 Thread Eshcar Hillel (JIRA)
[ https://issues.apache.org/jira/browse/HBASE-16417?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=15904985#comment-15904985 ] Eshcar Hillel commented on HBASE-16417: --- We already ran some experiments with merge

[jira] [Commented] (HBASE-18056) Change CompactingMemStore in BASIC mode to merge multiple segments in pipeline

2017-05-21 Thread Eshcar Hillel (JIRA)
[ https://issues.apache.org/jira/browse/HBASE-18056?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=16018768#comment-16018768 ] Eshcar Hillel commented on HBASE-18056: --- I think we are missing the point here. The

[jira] [Commented] (HBASE-17339) Scan-Memory-First Optimization for Get Operations

2017-06-01 Thread Eshcar Hillel (JIRA)
[ https://issues.apache.org/jira/browse/HBASE-17339?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=16033707#comment-16033707 ] Eshcar Hillel commented on HBASE-17339: --- After some time away from this Jira, and s

[jira] [Commented] (HBASE-18010) Connect CellChunkMap to be used for flattening in CompactingMemStore

2017-06-15 Thread Eshcar Hillel (JIRA)
[ https://issues.apache.org/jira/browse/HBASE-18010?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=16050263#comment-16050263 ] Eshcar Hillel commented on HBASE-18010: --- I left some comments on review board, will

[jira] [Commented] (HBASE-18010) Connect CellChunkMap to be used for flattening in CompactingMemStore

2017-06-19 Thread Eshcar Hillel (JIRA)
[ https://issues.apache.org/jira/browse/HBASE-18010?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=16053700#comment-16053700 ] Eshcar Hillel commented on HBASE-18010: --- In RB I am suggesting to use a cell set fa

[jira] [Created] (HBASE-18294) Flush policy checks data size instead of heap size

2017-06-29 Thread Eshcar Hillel (JIRA)
Eshcar Hillel created HBASE-18294: - Summary: Flush policy checks data size instead of heap size Key: HBASE-18294 URL: https://issues.apache.org/jira/browse/HBASE-18294 Project: HBase Issue Ty

[jira] [Commented] (HBASE-18294) Flush policy checks data size instead of heap size

2017-06-29 Thread Eshcar Hillel (JIRA)
[ https://issues.apache.org/jira/browse/HBASE-18294?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=16068102#comment-16068102 ] Eshcar Hillel commented on HBASE-18294: --- While benchmarking, we noticed the number

[jira] [Commented] (HBASE-18294) Flush policy checks data size instead of heap size

2017-06-29 Thread Eshcar Hillel (JIRA)
[ https://issues.apache.org/jira/browse/HBASE-18294?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=16068379#comment-16068379 ] Eshcar Hillel commented on HBASE-18294: --- Currently the total memstore size in a reg

[jira] [Updated] (HBASE-18294) Flush is based on data size instead of heap size

2017-06-29 Thread Eshcar Hillel (JIRA)
[ https://issues.apache.org/jira/browse/HBASE-18294?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Eshcar Hillel updated HBASE-18294: -- Summary: Flush is based on data size instead of heap size (was: Flush policy checks data size

[jira] [Updated] (HBASE-18294) Flush is based on data size instead of heap size

2017-06-29 Thread Eshcar Hillel (JIRA)
[ https://issues.apache.org/jira/browse/HBASE-18294?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Eshcar Hillel updated HBASE-18294: -- Description: A region is flushed if its memory component exceed a threshold (default size is 1

<    1   2   3   4   5   6   7   8   >