[jira] [Created] (HBASE-20542) Better heap utilization for IMC with MSLABs

2018-05-08 Thread Eshcar Hillel (JIRA)
Eshcar Hillel created HBASE-20542: - Summary: Better heap utilization for IMC with MSLABs Key: HBASE-20542 URL: https://issues.apache.org/jira/browse/HBASE-20542 Project: HBase Issue Type

Re: [ANNOUNCE] Please welcome Francis Liu to the HBase PMC

2018-04-12 Thread Eshcar Hillel
Congrats Francis and good luck! On Wednesday, April 11, 2018, 11:04:17 PM GMT+3, Andrew Purtell wrote: On behalf of the Apache HBase PMC I am pleased to announce that Francis Liu has accepted our invitation to become a PMC member on the Apache HBase project. We appreciate Francis step

[jira] [Created] (HBASE-20390) IMC Default Parameters for 2.0.0

2018-04-11 Thread Eshcar Hillel (JIRA)
Eshcar Hillel created HBASE-20390: - Summary: IMC Default Parameters for 2.0.0 Key: HBASE-20390 URL: https://issues.apache.org/jira/browse/HBASE-20390 Project: HBase Issue Type: Task

Re: Questions about synchronization in compaction pipeline

2018-03-12 Thread Eshcar Hillel
I agree with Chia-Ping Tsai, read-only copy can be changed from LL to array list plus replacing getLast with get(size())However I am dubious about any of the suggested changes having any affect on the system performance.Would be very interesting to see the workload that can differentiate betwee

[jira] [Resolved] (HBASE-14918) In-Memory MemStore Flush and Compaction

2018-02-03 Thread Eshcar Hillel (JIRA)
[ https://issues.apache.org/jira/browse/HBASE-14918?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Eshcar Hillel resolved HBASE-14918. --- Resolution: Done > In-Memory MemStore Flush and Compact

Re: [DISCUSS] Performance degradation in master (compared to 2-alpha-1)

2017-11-29 Thread Eshcar Hillel
d the regressions? Also, I'm worried that the performance regression may be related to an important bug-fix, where before we may have had fast writes but also risked incorrect behavior somehow. Mike On Tue, Nov 28, 2017 at 2:48 AM, Eshcar Hillel wrote: > I agree, so will wait til

Re: [DISCUSS] Performance degradation in master (compared to 2-alpha-1)

2017-11-28 Thread Eshcar Hillel
notification is always welcomed. Thanks. Stack 于2017年11月25日 周六13:22写道: > On Thu, Nov 23, 2017 at 7:35 AM, Eshcar Hillel > wrote: > > > Happy Thanksgiving all, > > > > And to you Eshcar. > > > > > In recent benchmarks I ran in HBASE-18294 I discovered major

[DISCUSS] Performance degradation in master (compared to 2-alpha-1)

2017-11-23 Thread Eshcar Hillel
Happy Thanksgiving all, In recent benchmarks I ran in HBASE-18294 I discovered major performance degradation of master code w.r.t 2-alpha-1 code.I am running write-only workload (similar to the one reported in HBASE-16417). I am using the same hardware and same configuration settings (specifical

Re: [DISCUSS] Should flush decisions be made based on data size (key-value only) or based on heap size (including metadata overhead)?

2017-08-08 Thread Eshcar Hillel
so that added just one more variable dealing. -Anoop- On Mon, Jul 10, 2017 at 7:34 PM, Eshcar Hillel wrote: > Here is a suggestion:We can track both heap and off-heap sizes and have 2 > thresholds one for limiting heap size and one for limiting off-heap size.And > in all decisi

Re: [DISCUSS] Should flush decisions be made based on data size (key-value only) or based on heap size (including metadata overhead)?

2017-07-10 Thread Eshcar Hillel
usher: Blocking updates on >> > > hadoop0528.et2.tbsite.net,16020,1497336978160: >> > > global memstore heapsize 7.2 G is >= than blocking 7.2 G size >> > > 2017-07-03 16:11:57,571 INFO  [MemStoreFlusher.0] >> > > regionserver.MemSt

[DISCUSS] Should flush decisions be made based on data size (key-value only) or based on heap size (including metadata overhead)?

2017-07-05 Thread Eshcar Hillel
Hi All, I opened a new Jira https://issues.apache.org/jira/browse/HBASE-18294 to discuss this question. Flush decisions are taken at the region level and also at the region server level - there is the question of when to trigger a flush and then which region/store to flush.Regions track both the

[jira] [Created] (HBASE-18294) Flush policy checks data size instead of heap size

2017-06-29 Thread Eshcar Hillel (JIRA)
Eshcar Hillel created HBASE-18294: - Summary: Flush policy checks data size instead of heap size Key: HBASE-18294 URL: https://issues.apache.org/jira/browse/HBASE-18294 Project: HBase Issue

[jira] [Created] (HBASE-17655) Removing MemStoreScanner and SnapshotScanner

2017-02-16 Thread Eshcar Hillel (JIRA)
Eshcar Hillel created HBASE-17655: - Summary: Removing MemStoreScanner and SnapshotScanner Key: HBASE-17655 URL: https://issues.apache.org/jira/browse/HBASE-17655 Project: HBase Issue Type

[jira] [Created] (HBASE-17575) Towards Making BASIC the Default In-Memory Compaction Policy

2017-02-01 Thread Eshcar Hillel (JIRA)
Eshcar Hillel created HBASE-17575: - Summary: Towards Making BASIC the Default In-Memory Compaction Policy Key: HBASE-17575 URL: https://issues.apache.org/jira/browse/HBASE-17575 Project: HBase

[jira] [Created] (HBASE-17434) New Synchronization Scheme for Compaction Pipeline

2017-01-06 Thread Eshcar Hillel (JIRA)
Eshcar Hillel created HBASE-17434: - Summary: New Synchronization Scheme for Compaction Pipeline Key: HBASE-17434 URL: https://issues.apache.org/jira/browse/HBASE-17434 Project: HBase Issue

[jira] [Created] (HBASE-17407) Correct update of maxFlushedSeqId in HRegion

2017-01-03 Thread Eshcar Hillel (JIRA)
Eshcar Hillel created HBASE-17407: - Summary: Correct update of maxFlushedSeqId in HRegion Key: HBASE-17407 URL: https://issues.apache.org/jira/browse/HBASE-17407 Project: HBase Issue Type

[jira] [Created] (HBASE-17339) Scan-Memory-First Optimization

2016-12-19 Thread Eshcar Hillel (JIRA)
Eshcar Hillel created HBASE-17339: - Summary: Scan-Memory-First Optimization Key: HBASE-17339 URL: https://issues.apache.org/jira/browse/HBASE-17339 Project: HBase Issue Type: Improvement

[jira] [Created] (HBASE-17316) Addendum to HBASE-17294

2016-12-14 Thread Eshcar Hillel (JIRA)
Eshcar Hillel created HBASE-17316: - Summary: Addendum to HBASE-17294 Key: HBASE-17316 URL: https://issues.apache.org/jira/browse/HBASE-17316 Project: HBase Issue Type: Sub-task

[jira] [Created] (HBASE-17294) External Configuration for Memory Compaction

2016-12-12 Thread Eshcar Hillel (JIRA)
Eshcar Hillel created HBASE-17294: - Summary: External Configuration for Memory Compaction Key: HBASE-17294 URL: https://issues.apache.org/jira/browse/HBASE-17294 Project: HBase Issue Type

[jira] [Created] (HBASE-15359) Simplifying Segment hierarchy

2016-02-29 Thread Eshcar Hillel (JIRA)
Eshcar Hillel created HBASE-15359: - Summary: Simplifying Segment hierarchy Key: HBASE-15359 URL: https://issues.apache.org/jira/browse/HBASE-15359 Project: HBase Issue Type: Sub-task

[jira] [Created] (HBASE-15016) StoreServices facility in Region

2015-12-19 Thread Eshcar Hillel (JIRA)
Eshcar Hillel created HBASE-15016: - Summary: StoreServices facility in Region Key: HBASE-15016 URL: https://issues.apache.org/jira/browse/HBASE-15016 Project: HBase Issue Type: Sub-task

[jira] [Created] (HBASE-14921) Memory optimizations

2015-12-03 Thread Eshcar Hillel (JIRA)
Eshcar Hillel created HBASE-14921: - Summary: Memory optimizations Key: HBASE-14921 URL: https://issues.apache.org/jira/browse/HBASE-14921 Project: HBase Issue Type: Sub-task Affects

[jira] [Created] (HBASE-14920) Compacting Memstore

2015-12-03 Thread Eshcar Hillel (JIRA)
Eshcar Hillel created HBASE-14920: - Summary: Compacting Memstore Key: HBASE-14920 URL: https://issues.apache.org/jira/browse/HBASE-14920 Project: HBase Issue Type: Sub-task

[jira] [Created] (HBASE-14919) Infrastructure refactoring

2015-12-03 Thread Eshcar Hillel (JIRA)
Eshcar Hillel created HBASE-14919: - Summary: Infrastructure refactoring Key: HBASE-14919 URL: https://issues.apache.org/jira/browse/HBASE-14919 Project: HBase Issue Type: Sub-task

[jira] [Created] (HBASE-14918) In-Memory MemStore Flush and Compaction

2015-12-03 Thread Eshcar Hillel (JIRA)
Eshcar Hillel created HBASE-14918: - Summary: In-Memory MemStore Flush and Compaction Key: HBASE-14918 URL: https://issues.apache.org/jira/browse/HBASE-14918 Project: HBase Issue Type

[jira] [Created] (HBASE-13719) Asynchronous scanner -- cache size-in-bytes bug fix

2015-05-19 Thread Eshcar Hillel (JIRA)
Eshcar Hillel created HBASE-13719: - Summary: Asynchronous scanner -- cache size-in-bytes bug fix Key: HBASE-13719 URL: https://issues.apache.org/jira/browse/HBASE-13719 Project: HBase Issue

[jira] [Created] (HBASE-13408) HBase In-Memory Memstore Compaction

2015-04-05 Thread Eshcar Hillel (JIRA)
Eshcar Hillel created HBASE-13408: - Summary: HBase In-Memory Memstore Compaction Key: HBASE-13408 URL: https://issues.apache.org/jira/browse/HBASE-13408 Project: HBase Issue Type: New

[jira] [Created] (HBASE-13071) Hbase Streaming Scan Feature

2015-02-19 Thread Eshcar Hillel (JIRA)
Eshcar Hillel created HBASE-13071: - Summary: Hbase Streaming Scan Feature Key: HBASE-13071 URL: https://issues.apache.org/jira/browse/HBASE-13071 Project: HBase Issue Type: New Feature