[jira] [Commented] (HBASE-21916) Abstract an ByteBuffAllocator to allocate/free ByteBuffer in ByteBufferPool

2019-02-18 Thread Zheng Hu (JIRA)
[ https://issues.apache.org/jira/browse/HBASE-21916?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16771620#comment-16771620 ] Zheng Hu commented on HBASE-21916: -- bq. How do I extract info on how well the allocator is doing?

[jira] [Commented] (HBASE-21917) Make the HFileBlock#validateChecksum can accept ByteBuff as an input.

2019-02-18 Thread Zheng Hu (JIRA)
[ https://issues.apache.org/jira/browse/HBASE-21917?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16771601#comment-16771601 ] Zheng Hu commented on HBASE-21917: -- bq. If we could bring it local we could use it in meantime while

[jira] [Created] (HBASE-21928) TestServerCrashProcedureCarryingMetaStuck is always to be timeout

2019-02-18 Thread Zheng Hu (JIRA)
Zheng Hu created HBASE-21928: Summary: TestServerCrashProcedureCarryingMetaStuck is always to be timeout Key: HBASE-21928 URL: https://issues.apache.org/jira/browse/HBASE-21928 Project: HBase

[jira] [Commented] (HBASE-21916) Abstract an ByteBuffAllocator to allocate/free ByteBuffer in ByteBufferPool

2019-02-18 Thread Zheng Hu (JIRA)
[ https://issues.apache.org/jira/browse/HBASE-21916?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16771509#comment-16771509 ] Zheng Hu commented on HBASE-21916: -- Ping [~stack], [~anoop.hbase] for reviewing. > Abstract an

[jira] [Commented] (HBASE-21917) Make the HFileBlock#validateChecksum can accept ByteBuff as an input.

2019-02-18 Thread Zheng Hu (JIRA)
[ https://issues.apache.org/jira/browse/HBASE-21917?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16771501#comment-16771501 ] Zheng Hu commented on HBASE-21917: -- bq. IIRC, we want native checksum checking to cut in. Is that

[jira] [Updated] (HBASE-21917) Make the HFileBlock#validateChecksum can accept ByteBuff as an input.

2019-02-18 Thread Zheng Hu (JIRA)
[ https://issues.apache.org/jira/browse/HBASE-21917?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Zheng Hu updated HBASE-21917: - Attachment: HBASE-21917.v4.patch > Make the HFileBlock#validateChecksum can accept ByteBuff as an

[jira] [Updated] (HBASE-21917) Make the HFileBlock#validateChecksum can accept ByteBuff as an input.

2019-02-18 Thread Zheng Hu (JIRA)
[ https://issues.apache.org/jira/browse/HBASE-21917?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Zheng Hu updated HBASE-21917: - Attachment: HBASE-21917.v3.patch > Make the HFileBlock#validateChecksum can accept ByteBuff as an

[jira] [Updated] (HBASE-21917) Make the HFileBlock#validateChecksum can accept ByteBuff as an input.

2019-02-18 Thread Zheng Hu (JIRA)
[ https://issues.apache.org/jira/browse/HBASE-21917?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Zheng Hu updated HBASE-21917: - Attachment: (was: HBASE-21917.v3.patch) > Make the HFileBlock#validateChecksum can accept ByteBuff

[jira] [Updated] (HBASE-21917) Make the HFileBlock#validateChecksum can accept ByteBuff as an input.

2019-02-18 Thread Zheng Hu (JIRA)
[ https://issues.apache.org/jira/browse/HBASE-21917?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Zheng Hu updated HBASE-21917: - Attachment: HBASE-21917.v3.patch > Make the HFileBlock#validateChecksum can accept ByteBuff as an

[jira] [Updated] (HBASE-21916) Abstract an ByteBuffAllocator to allocate/free ByteBuffer in ByteBufferPool

2019-02-18 Thread Zheng Hu (JIRA)
[ https://issues.apache.org/jira/browse/HBASE-21916?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Zheng Hu updated HBASE-21916: - Attachment: HBASE-21916.v5.patch > Abstract an ByteBuffAllocator to allocate/free ByteBuffer in

[jira] [Updated] (HBASE-21917) Make the HFileBlock#validateChecksum can accept ByteBuff as an input.

2019-02-18 Thread Zheng Hu (JIRA)
[ https://issues.apache.org/jira/browse/HBASE-21917?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Zheng Hu updated HBASE-21917: - Attachment: HBASE-21917.v2.patch > Make the HFileBlock#validateChecksum can accept ByteBuff as an

[jira] [Updated] (HBASE-21917) Make the HFileBlock#validateChecksum can accept ByteBuff as an input.

2019-02-18 Thread Zheng Hu (JIRA)
[ https://issues.apache.org/jira/browse/HBASE-21917?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Zheng Hu updated HBASE-21917: - Status: Patch Available (was: Open) > Make the HFileBlock#validateChecksum can accept ByteBuff as an

[jira] [Updated] (HBASE-21917) Make the HFileBlock#validateChecksum can accept ByteBuff as an input.

2019-02-18 Thread Zheng Hu (JIRA)
[ https://issues.apache.org/jira/browse/HBASE-21917?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Zheng Hu updated HBASE-21917: - Attachment: HBASE-21917.v1.patch > Make the HFileBlock#validateChecksum can accept ByteBuff as an

[jira] [Commented] (HBASE-21917) Make the HFileBlock#validateChecksum can accept ByteBuff as an input.

2019-02-18 Thread Zheng Hu (JIRA)
[ https://issues.apache.org/jira/browse/HBASE-21917?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16770928#comment-16770928 ] Zheng Hu commented on HBASE-21917: -- Maybe we can new a very small heap size such as 256, and update(..)

[jira] [Commented] (HBASE-21917) Make the HFileBlock#validateChecksum can accept ByteBuff as an input.

2019-02-18 Thread Zheng Hu (JIRA)
[ https://issues.apache.org/jira/browse/HBASE-21917?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16770925#comment-16770925 ] Zheng Hu commented on HBASE-21917: -- Oh, our default bytesPerChecksum is 16KB. while there's no

[jira] [Updated] (HBASE-21921) Notify users if the ByteBufAllocator is always allocating ByteBuffers from heap which means the increacing GC pressure

2019-02-17 Thread Zheng Hu (JIRA)
[ https://issues.apache.org/jira/browse/HBASE-21921?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Zheng Hu updated HBASE-21921: - Description: As the javadoc of ByteBuffAllocator says: {code} There's possible that the desired memory

[jira] [Created] (HBASE-21921) Notify users if the ByteBufAllocator is always allocating ByteBuffers from heap which means the increacing GC pressure

2019-02-17 Thread Zheng Hu (JIRA)
Zheng Hu created HBASE-21921: Summary: Notify users if the ByteBufAllocator is always allocating ByteBuffers from heap which means the increacing GC pressure Key: HBASE-21921 URL:

[jira] [Updated] (HBASE-21916) Abstract an ByteBuffAllocator to allocate/free ByteBuffer in ByteBufferPool

2019-02-17 Thread Zheng Hu (JIRA)
[ https://issues.apache.org/jira/browse/HBASE-21916?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Zheng Hu updated HBASE-21916: - Attachment: HBASE-21916.v4.patch > Abstract an ByteBuffAllocator to allocate/free ByteBuffer in

[jira] [Commented] (HBASE-21916) Abstract an ByteBuffAllocator to allocate/free ByteBuffer in ByteBufferPool

2019-02-17 Thread Zheng Hu (JIRA)
[ https://issues.apache.org/jira/browse/HBASE-21916?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16770766#comment-16770766 ] Zheng Hu commented on HBASE-21916: -- Will be gratefull if [~anoop.hbase], or [~ram_krish] has some

[jira] [Updated] (HBASE-21916) Abstract an ByteBuffAllocator to allocate/free ByteBuffer in ByteBufferPool

2019-02-17 Thread Zheng Hu (JIRA)
[ https://issues.apache.org/jira/browse/HBASE-21916?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Zheng Hu updated HBASE-21916: - Attachment: HBASE-21916.v3.patch > Abstract an ByteBuffAllocator to allocate/free ByteBuffer in

[jira] [Created] (HBASE-21917) Make the HFileBlock#validateChecksum can accept ByteBuff as an input.

2019-02-17 Thread Zheng Hu (JIRA)
Zheng Hu created HBASE-21917: Summary: Make the HFileBlock#validateChecksum can accept ByteBuff as an input. Key: HBASE-21917 URL: https://issues.apache.org/jira/browse/HBASE-21917 Project: HBase

[jira] [Commented] (HBASE-21916) Abstract an ByteBuffAllocator to allocate/free ByteBuffer in ByteBufferPool

2019-02-16 Thread Zheng Hu (JIRA)
[ https://issues.apache.org/jira/browse/HBASE-21916?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16770096#comment-16770096 ] Zheng Hu commented on HBASE-21916: -- Patch.v2 : do not expose the ByteBufferPool to RpcServer again,

[jira] [Updated] (HBASE-21916) Abstract an ByteBuffAllocator to allocate/free ByteBuffer in ByteBufferPool

2019-02-16 Thread Zheng Hu (JIRA)
[ https://issues.apache.org/jira/browse/HBASE-21916?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Zheng Hu updated HBASE-21916: - Attachment: HBASE-21916.v2.patch > Abstract an ByteBuffAllocator to allocate/free ByteBuffer in

[jira] [Updated] (HBASE-21916) Abstract an ByteBuffAllocator to allocate/free ByteBuffer in ByteBufferPool

2019-02-16 Thread Zheng Hu (JIRA)
[ https://issues.apache.org/jira/browse/HBASE-21916?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Zheng Hu updated HBASE-21916: - Fix Version/s: 2.1.4 2.3.0 2.2.0 3.0.0

[jira] [Updated] (HBASE-21916) Abstract an ByteBuffAllocator to allocate/free ByteBuffer in ByteBufferPool

2019-02-16 Thread Zheng Hu (JIRA)
[ https://issues.apache.org/jira/browse/HBASE-21916?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Zheng Hu updated HBASE-21916: - Attachment: HBASE-21916.v1.patch > Abstract an ByteBuffAllocator to allocate/free ByteBuffer in

[jira] [Created] (HBASE-21916) Abstract an ByteBuffAllocator to allocate/free ByteBuffer in ByteBufferPool

2019-02-16 Thread Zheng Hu (JIRA)
Zheng Hu created HBASE-21916: Summary: Abstract an ByteBuffAllocator to allocate/free ByteBuffer in ByteBufferPool Key: HBASE-21916 URL: https://issues.apache.org/jira/browse/HBASE-21916 Project: HBase

[jira] [Commented] (HBASE-21879) Read HFile's block to ByteBuffer directly instead of to byte for reducing young gc purpose

2019-02-13 Thread Zheng Hu (JIRA)
[ https://issues.apache.org/jira/browse/HBASE-21879?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16767860#comment-16767860 ] Zheng Hu commented on HBASE-21879: -- bq. Sure Zheng Hu would you like to contribute a patch at

[jira] [Commented] (HBASE-21879) Read HFile's block to ByteBuffer directly instead of to byte for reducing young gc purpose

2019-02-13 Thread Zheng Hu (JIRA)
[ https://issues.apache.org/jira/browse/HBASE-21879?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16767850#comment-16767850 ] Zheng Hu commented on HBASE-21879: -- There's a issue HDFS-3246 for ByteBuffer pread before, but no

[jira] [Commented] (HBASE-21879) Read HFile's block to ByteBuffer directly instead of to byte for reducing young gc purpose

2019-02-13 Thread Zheng Hu (JIRA)
[ https://issues.apache.org/jira/browse/HBASE-21879?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16767152#comment-16767152 ] Zheng Hu commented on HBASE-21879: -- Thanks for your info, [~ram_krish]. I think we can do this

[jira] [Comment Edited] (HBASE-21879) Read HFile's block to ByteBuffer directly instead of to byte for reducing young gc purpose

2019-02-13 Thread Zheng Hu (JIRA)
[ https://issues.apache.org/jira/browse/HBASE-21879?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16767029#comment-16767029 ] Zheng Hu edited comment on HBASE-21879 at 2/13/19 10:28 AM: Still another

[jira] [Commented] (HBASE-21879) Read HFile's block to ByteBuffer directly instead of to byte for reducing young gc purpose

2019-02-13 Thread Zheng Hu (JIRA)
[ https://issues.apache.org/jira/browse/HBASE-21879?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16767029#comment-16767029 ] Zheng Hu commented on HBASE-21879: -- Still another problem is: the DFSInputStream did not support

[jira] [Commented] (HBASE-21879) Read HFile's block to ByteBuffer directly instead of to byte for reducing young gc purpose

2019-02-13 Thread Zheng Hu (JIRA)
[ https://issues.apache.org/jira/browse/HBASE-21879?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16766969#comment-16766969 ] Zheng Hu commented on HBASE-21879: -- Well, let me have a try. Thanks for your help. [~anoop.hbase] >

[jira] [Comment Edited] (HBASE-21879) Read HFile's block to ByteBuffer directly instead of to byte for reducing young gc purpose

2019-02-13 Thread Zheng Hu (JIRA)
[ https://issues.apache.org/jira/browse/HBASE-21879?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16766953#comment-16766953 ] Zheng Hu edited comment on HBASE-21879 at 2/13/19 9:10 AM: --- IMO, we can read

[jira] [Commented] (HBASE-21879) Read HFile's block to ByteBuffer directly instead of to byte for reducing young gc purpose

2019-02-13 Thread Zheng Hu (JIRA)
[ https://issues.apache.org/jira/browse/HBASE-21879?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16766953#comment-16766953 ] Zheng Hu commented on HBASE-21879: -- IMO, we can read the block into an ByteBuffer firstly for all kinds

[jira] [Commented] (HBASE-20060) Add details of off heap memstore into book.

2019-02-12 Thread Zheng Hu (JIRA)
[ https://issues.apache.org/jira/browse/HBASE-20060?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16766745#comment-16766745 ] Zheng Hu commented on HBASE-20060: -- Well, assigned to myself. > Add details of off heap memstore into

[jira] [Assigned] (HBASE-20060) Add details of off heap memstore into book.

2019-02-12 Thread Zheng Hu (JIRA)
[ https://issues.apache.org/jira/browse/HBASE-20060?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Zheng Hu reassigned HBASE-20060: Assignee: Zheng Hu (was: Anoop Sam John) > Add details of off heap memstore into book. >

[jira] [Updated] (HBASE-21879) Read HFile's block to ByteBuffer directly instead of to byte for reducing young gc purpose

2019-02-12 Thread Zheng Hu (JIRA)
[ https://issues.apache.org/jira/browse/HBASE-21879?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Zheng Hu updated HBASE-21879: - Attachment: (was: QPS-latencies-before-HBASE-21879.png) > Read HFile's block to ByteBuffer directly

[jira] [Updated] (HBASE-21879) Read HFile's block to ByteBuffer directly instead of to byte for reducing young gc purpose

2019-02-12 Thread Zheng Hu (JIRA)
[ https://issues.apache.org/jira/browse/HBASE-21879?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Zheng Hu updated HBASE-21879: - Attachment: QPS-latencies-before-HBASE-21879.png > Read HFile's block to ByteBuffer directly instead of

[jira] [Commented] (HBASE-21879) Read HFile's block to ByteBuffer directly instead of to byte for reducing young gc purpose

2019-02-12 Thread Zheng Hu (JIRA)
[ https://issues.apache.org/jira/browse/HBASE-21879?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16766650#comment-16766650 ] Zheng Hu commented on HBASE-21879: -- bq. Is this about HDFS-2834 that added

[jira] [Updated] (HBASE-21879) Read HFile's block to ByteBuffer directly instead of to byte for reducing young gc purpose

2019-02-12 Thread Zheng Hu (JIRA)
[ https://issues.apache.org/jira/browse/HBASE-21879?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Zheng Hu updated HBASE-21879: - Attachment: gc-data-before-HBASE-21879.png QPS-latencies-before-HBASE-21879.png > Read

[jira] [Created] (HBASE-21879) Read HFile's block to ByteBuffer directly instead of to byte for reducing young gc purpose

2019-02-12 Thread Zheng Hu (JIRA)
Zheng Hu created HBASE-21879: Summary: Read HFile's block to ByteBuffer directly instead of to byte for reducing young gc purpose Key: HBASE-21879 URL: https://issues.apache.org/jira/browse/HBASE-21879

[jira] [Updated] (HBASE-18484) VerifyRep by snapshot does not work when Yarn / SourceHBase / PeerHBase located in different HDFS clusters

2019-02-12 Thread Zheng Hu (JIRA)
[ https://issues.apache.org/jira/browse/HBASE-18484?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Zheng Hu updated HBASE-18484: - Fix Version/s: 2.3.0 > VerifyRep by snapshot does not work when Yarn / SourceHBase / PeerHBase >

[jira] [Commented] (HBASE-18484) VerifyRep by snapshot does not work when Yarn / SourceHBase / PeerHBase located in different HDFS clusters

2019-02-11 Thread Zheng Hu (JIRA)
[ https://issues.apache.org/jira/browse/HBASE-18484?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16765636#comment-16765636 ] Zheng Hu commented on HBASE-18484: -- Pushed to all branch-2.x & master, Thanks [~Apache9] for reviewing.

[jira] [Updated] (HBASE-18484) VerifyRep by snapshot does not work when Yarn / SourceHBase / PeerHBase located in different HDFS clusters

2019-02-11 Thread Zheng Hu (JIRA)
[ https://issues.apache.org/jira/browse/HBASE-18484?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Zheng Hu updated HBASE-18484: - Resolution: Fixed Hadoop Flags: Reviewed Status: Resolved (was: Patch Available) >

[jira] [Updated] (HBASE-18484) VerifyRep by snapshot does not work when Yarn / SourceHBase / PeerHBase located in different HDFS clusters

2019-02-11 Thread Zheng Hu (JIRA)
[ https://issues.apache.org/jira/browse/HBASE-18484?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Zheng Hu updated HBASE-18484: - Fix Version/s: 2.0.5 > VerifyRep by snapshot does not work when Yarn / SourceHBase / PeerHBase >

[jira] [Updated] (HBASE-18484) VerifyRep by snapshot does not work when Yarn / SourceHBase / PeerHBase located in different HDFS clusters

2019-02-11 Thread Zheng Hu (JIRA)
[ https://issues.apache.org/jira/browse/HBASE-18484?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Zheng Hu updated HBASE-18484: - Fix Version/s: 2.1.4 2.2.0 3.0.0 > VerifyRep by snapshot does

[jira] [Updated] (HBASE-18484) VerifyRep by snapshot does not work when Yarn / SourceHBase / PeerHBase located in different HDFS clusters

2019-02-11 Thread Zheng Hu (JIRA)
[ https://issues.apache.org/jira/browse/HBASE-18484?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Zheng Hu updated HBASE-18484: - Attachment: HBASE-18484.v3.patch > VerifyRep by snapshot does not work when Yarn / SourceHBase /

[jira] [Updated] (HBASE-18484) VerifyRep by snapshot does not work when Yarn / SourceHBase / PeerHBase located in different HDFS clusters

2019-02-10 Thread Zheng Hu (JIRA)
[ https://issues.apache.org/jira/browse/HBASE-18484?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Zheng Hu updated HBASE-18484: - Summary: VerifyRep by snapshot does not work when Yarn / SourceHBase / PeerHBase located in different

[jira] [Updated] (HBASE-18484) VerifyRep by snapshot does not work when Yarn / SourceHBase / PeerHBase located in three different HDFS clusters

2019-02-10 Thread Zheng Hu (JIRA)
[ https://issues.apache.org/jira/browse/HBASE-18484?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Zheng Hu updated HBASE-18484: - Attachment: HBASE-18484.v2.patch > VerifyRep by snapshot does not work when Yarn / SourceHBase /

[jira] [Commented] (HBASE-21748) Port HBASE-21738 (Remove all the CLSM#size operation in our memstore because it's an quite time consuming.) to branch-1

2019-02-10 Thread Zheng Hu (JIRA)
[ https://issues.apache.org/jira/browse/HBASE-21748?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16764629#comment-16764629 ] Zheng Hu commented on HBASE-21748: -- bq. without a quantified perf benefit I'd rather leave this out of

[jira] [Commented] (HBASE-21817) skip records with corrupted cells in WAL splitting

2019-01-31 Thread Zheng Hu (JIRA)
[ https://issues.apache.org/jira/browse/HBASE-21817?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16757943#comment-16757943 ] Zheng Hu commented on HBASE-21817: -- I believe we should try to reproduce the bug and find the root

[jira] [Updated] (HBASE-21764) Size of in-memory compaction thread pool should be configurable

2019-01-31 Thread Zheng Hu (JIRA)
[ https://issues.apache.org/jira/browse/HBASE-21764?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Zheng Hu updated HBASE-21764: - Resolution: Fixed Hadoop Flags: Reviewed Status: Resolved (was: Patch Available) >

[jira] [Commented] (HBASE-21764) Size of in-memory compaction thread pool should be configurable

2019-01-31 Thread Zheng Hu (JIRA)
[ https://issues.apache.org/jira/browse/HBASE-21764?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16757901#comment-16757901 ] Zheng Hu commented on HBASE-21764: -- Pushed to master/branch-2.0/branch-2.1/branch-2.2/branch-2, Thanks

[jira] [Updated] (HBASE-21764) Size of in-memory compaction thread pool shoud be configurable

2019-01-31 Thread Zheng Hu (JIRA)
[ https://issues.apache.org/jira/browse/HBASE-21764?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Zheng Hu updated HBASE-21764: - Attachment: HBASE-21764.v10.patch > Size of in-memory compaction thread pool shoud be configurable >

[jira] [Updated] (HBASE-21764) Size of in-memory compaction thread pool shoud be configurable

2019-01-30 Thread Zheng Hu (JIRA)
[ https://issues.apache.org/jira/browse/HBASE-21764?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Zheng Hu updated HBASE-21764: - Attachment: HBASE-21764.v9.patch > Size of in-memory compaction thread pool shoud be configurable >

[jira] [Updated] (HBASE-21764) Size of in-memory compaction thread pool shoud be configurable

2019-01-30 Thread Zheng Hu (JIRA)
[ https://issues.apache.org/jira/browse/HBASE-21764?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Zheng Hu updated HBASE-21764: - Attachment: HBASE-21764.v8.patch > Size of in-memory compaction thread pool shoud be configurable >

[jira] [Updated] (HBASE-21764) Size of in-memory compaction thread pool shoud be configurable

2019-01-30 Thread Zheng Hu (JIRA)
[ https://issues.apache.org/jira/browse/HBASE-21764?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Zheng Hu updated HBASE-21764: - Attachment: HBASE-21764.v7.patch > Size of in-memory compaction thread pool shoud be configurable >

[jira] [Commented] (HBASE-18822) Create table for peer cluster automatically when creating table in source cluster of using namespace replication.

2019-01-30 Thread Zheng Hu (JIRA)
[ https://issues.apache.org/jira/browse/HBASE-18822?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16756850#comment-16756850 ] Zheng Hu commented on HBASE-18822: -- Of course, [~nihaljain.cs] please go ahead. > Create table for

[jira] [Updated] (HBASE-21764) Size of in-memory compaction thread pool shoud be configurable

2019-01-30 Thread Zheng Hu (JIRA)
[ https://issues.apache.org/jira/browse/HBASE-21764?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Zheng Hu updated HBASE-21764: - Attachment: HBASE-21764.v6.patch > Size of in-memory compaction thread pool shoud be configurable >

[jira] [Updated] (HBASE-21764) Size of in-memory compaction thread pool shoud be configurable

2019-01-30 Thread Zheng Hu (JIRA)
[ https://issues.apache.org/jira/browse/HBASE-21764?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Zheng Hu updated HBASE-21764: - Attachment: HBASE-21764.v5.patch > Size of in-memory compaction thread pool shoud be configurable >

[jira] [Commented] (HBASE-21764) Size of in-memory compaction thread pool shoud be configurable

2019-01-30 Thread Zheng Hu (JIRA)
[ https://issues.apache.org/jira/browse/HBASE-21764?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16755838#comment-16755838 ] Zheng Hu commented on HBASE-21764: -- bq. Every region has an separate in-memory compaction pool? No,

[jira] [Updated] (HBASE-21764) Size of in-memory compaction thread pool shoud be configurable

2019-01-30 Thread Zheng Hu (JIRA)
[ https://issues.apache.org/jira/browse/HBASE-21764?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Zheng Hu updated HBASE-21764: - Attachment: (was: HBASE-21764.v1.patch) > Size of in-memory compaction thread pool shoud be

[jira] [Updated] (HBASE-21764) Size of in-memory compaction thread pool shoud be configurable

2019-01-30 Thread Zheng Hu (JIRA)
[ https://issues.apache.org/jira/browse/HBASE-21764?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Zheng Hu updated HBASE-21764: - Attachment: HBASE-21764.v4.patch > Size of in-memory compaction thread pool shoud be configurable >

[jira] [Updated] (HBASE-21764) Size of in-memory compaction thread pool shoud be configurable

2019-01-30 Thread Zheng Hu (JIRA)
[ https://issues.apache.org/jira/browse/HBASE-21764?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Zheng Hu updated HBASE-21764: - Attachment: HBASE-21764.v1.patch > Size of in-memory compaction thread pool shoud be configurable >

[jira] [Commented] (HBASE-21764) Size of in-memory compaction thread pool shoud be configurable

2019-01-29 Thread Zheng Hu (JIRA)
[ https://issues.apache.org/jira/browse/HBASE-21764?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16755141#comment-16755141 ] Zheng Hu commented on HBASE-21764: -- Thanks the +1 for [~stack].And see the [~Apache9]'s comment in

[jira] [Updated] (HBASE-21764) Size of in-memory compaction thread pool shoud be configurable

2019-01-29 Thread Zheng Hu (JIRA)
[ https://issues.apache.org/jira/browse/HBASE-21764?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Zheng Hu updated HBASE-21764: - Release Note: Introduced an new config key in this issue:

[jira] [Commented] (HBASE-21789) Rewrite MetaTableAccessor.multiMutate with Table.coprocessorService

2019-01-26 Thread Zheng Hu (JIRA)
[ https://issues.apache.org/jira/browse/HBASE-21789?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16753029#comment-16753029 ] Zheng Hu commented on HBASE-21789: -- +1 if hadoop QA OK. > Rewrite MetaTableAccessor.multiMutate with

[jira] [Commented] (HBASE-21748) Port HBASE-21738 (Remove all the CLSM#size operation in our memstore because it's an quite time consuming.) to branch-1

2019-01-25 Thread Zheng Hu (JIRA)
[ https://issues.apache.org/jira/browse/HBASE-21748?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16752122#comment-16752122 ] Zheng Hu commented on HBASE-21748: -- [~apurtell], I thinks this patch should applied to all branch-1.x

[jira] [Commented] (HBASE-21764) Size of in-memory compaction thread pool shoud be configurable

2019-01-24 Thread Zheng Hu (JIRA)
[ https://issues.apache.org/jira/browse/HBASE-21764?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16751937#comment-16751937 ] Zheng Hu commented on HBASE-21764: -- Ping [~Apache9] > Size of in-memory compaction thread pool shoud

[jira] [Updated] (HBASE-21764) Size of in-memory compaction thread pool shoud be configurable

2019-01-24 Thread Zheng Hu (JIRA)
[ https://issues.apache.org/jira/browse/HBASE-21764?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Zheng Hu updated HBASE-21764: - Attachment: HBASE-21764.v3.patch > Size of in-memory compaction thread pool shoud be configurable >

[jira] [Updated] (HBASE-21764) Size of in-memory compaction thread pool shoud be configurable

2019-01-23 Thread Zheng Hu (JIRA)
[ https://issues.apache.org/jira/browse/HBASE-21764?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Zheng Hu updated HBASE-21764: - Attachment: HBASE-21764.v2.patch > Size of in-memory compaction thread pool shoud be configurable >

[jira] [Updated] (HBASE-21764) Size of in-memory compaction thread pool shoud be configurable

2019-01-23 Thread Zheng Hu (JIRA)
[ https://issues.apache.org/jira/browse/HBASE-21764?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Zheng Hu updated HBASE-21764: - Attachment: HBASE-21764.v1.patch > Size of in-memory compaction thread pool shoud be configurable >

[jira] [Updated] (HBASE-21764) Size of in-memory compaction thread pool shoud be configurable

2019-01-23 Thread Zheng Hu (JIRA)
[ https://issues.apache.org/jira/browse/HBASE-21764?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Zheng Hu updated HBASE-21764: - Attachment: (was: HBASE-21764.v1.patch) > Size of in-memory compaction thread pool shoud be

[jira] [Updated] (HBASE-21764) Size of in-memory compaction thread pool shoud be configurable

2019-01-23 Thread Zheng Hu (JIRA)
[ https://issues.apache.org/jira/browse/HBASE-21764?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Zheng Hu updated HBASE-21764: - Attachment: HBASE-21764.v1.patch > Size of in-memory compaction thread pool shoud be configurable >

[jira] [Updated] (HBASE-21764) Size of in-memory compaction thread pool shoud be configurable

2019-01-23 Thread Zheng Hu (JIRA)
[ https://issues.apache.org/jira/browse/HBASE-21764?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Zheng Hu updated HBASE-21764: - Status: Patch Available (was: Open) > Size of in-memory compaction thread pool shoud be configurable >

[jira] [Created] (HBASE-21764) Size of in-memory compaction thread pool shoud be configurable

2019-01-23 Thread Zheng Hu (JIRA)
Zheng Hu created HBASE-21764: Summary: Size of in-memory compaction thread pool shoud be configurable Key: HBASE-21764 URL: https://issues.apache.org/jira/browse/HBASE-21764 Project: HBase

[jira] [Updated] (HBASE-21699) Create table failed when using SPLITS_FILE => 'splits.txt'

2019-01-22 Thread Zheng Hu (JIRA)
[ https://issues.apache.org/jira/browse/HBASE-21699?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Zheng Hu updated HBASE-21699: - Priority: Blocker (was: Minor) > Create table failed when using SPLITS_FILE => 'splits.txt' >

[jira] [Commented] (HBASE-21748) Port HBASE-21738 (Remove all the CLSM#size operation in our memstore because it's an quite time consuming.) to branch-1

2019-01-22 Thread Zheng Hu (JIRA)
[ https://issues.apache.org/jira/browse/HBASE-21748?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16749591#comment-16749591 ] Zheng Hu commented on HBASE-21748: -- [~apurtell], Thanks for your patch, skimmed the patch. Adding an

[jira] [Commented] (HBASE-21748) Port HBASE-21738 (Remove all the CLSM#size operation in our memstore because it's an quite time consuming.) to branch-1

2019-01-22 Thread Zheng Hu (JIRA)
[ https://issues.apache.org/jira/browse/HBASE-21748?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16749389#comment-16749389 ] Zheng Hu commented on HBASE-21748: -- [~apurtell], Thanks for you work. Mind share your patch ? I'll take

[jira] [Updated] (HBASE-21750) Most of KeyValueUtil#length can be replaced by cell#getSerializedSize for better performance because the latter one has been optimized

2019-01-22 Thread Zheng Hu (JIRA)
[ https://issues.apache.org/jira/browse/HBASE-21750?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Zheng Hu updated HBASE-21750: - Resolution: Fixed Hadoop Flags: Reviewed Status: Resolved (was: Patch Available) >

[jira] [Commented] (HBASE-21750) Most of KeyValueUtil#length can be replaced by cell#getSerializedSize for better performance because the latter one has been optimized

2019-01-22 Thread Zheng Hu (JIRA)
[ https://issues.apache.org/jira/browse/HBASE-21750?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16748678#comment-16748678 ] Zheng Hu commented on HBASE-21750: -- The timeout ut is not related to patch.v3, works fine under my

[jira] [Updated] (HBASE-21750) Most of KeyValueUtil#length can be replaced by cell#getSerializedSize for better performance because the latter one has been optimized

2019-01-22 Thread Zheng Hu (JIRA)
[ https://issues.apache.org/jira/browse/HBASE-21750?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Zheng Hu updated HBASE-21750: - Attachment: HBASE-21750.v3.patch > Most of KeyValueUtil#length can be replaced by

[jira] [Commented] (HBASE-21750) Most of KeyValueUtil#length can be replaced by cell#getSerializedSize for better performance because the latter one has been optimized

2019-01-22 Thread Zheng Hu (JIRA)
[ https://issues.apache.org/jira/browse/HBASE-21750?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16748487#comment-16748487 ] Zheng Hu commented on HBASE-21750: -- Re-attached patch.v3, trigger hadoop QA again. > Most of

[jira] [Updated] (HBASE-21734) Some optimization in FilterListWithOR

2019-01-21 Thread Zheng Hu (JIRA)
[ https://issues.apache.org/jira/browse/HBASE-21734?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Zheng Hu updated HBASE-21734: - Resolution: Fixed Status: Resolved (was: Patch Available) > Some optimization in

[jira] [Commented] (HBASE-21734) Some optimization in FilterListWithOR

2019-01-21 Thread Zheng Hu (JIRA)
[ https://issues.apache.org/jira/browse/HBASE-21734?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16748369#comment-16748369 ] Zheng Hu commented on HBASE-21734: -- Pushed to

[jira] [Updated] (HBASE-21734) Some optimization in FilterListWithOR

2019-01-21 Thread Zheng Hu (JIRA)
[ https://issues.apache.org/jira/browse/HBASE-21734?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Zheng Hu updated HBASE-21734: - Hadoop Flags: Reviewed Release Note: After HBASE-21620, the filterListWithOR has been a bit slow

[jira] [Updated] (HBASE-21734) Some optimization in FilterListWithOR

2019-01-21 Thread Zheng Hu (JIRA)
[ https://issues.apache.org/jira/browse/HBASE-21734?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Zheng Hu updated HBASE-21734: - Fix Version/s: 2.0.5 2.1.3 1.4.10 2.2.0

[jira] [Commented] (HBASE-21750) Most of KeyValueUtil#length can be replaced by cell#getSerializedSize for better performance because the latter one has been optimized

2019-01-21 Thread Zheng Hu (JIRA)
[ https://issues.apache.org/jira/browse/HBASE-21750?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16748353#comment-16748353 ] Zheng Hu commented on HBASE-21750: -- Well, It's a mistake which was introduced in HBASE-21657, for

[jira] [Updated] (HBASE-21750) Most of KeyValueUtil#length can be replaced by cell#getSerializedSize for better performance because the latter one has been optimized

2019-01-21 Thread Zheng Hu (JIRA)
[ https://issues.apache.org/jira/browse/HBASE-21750?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Zheng Hu updated HBASE-21750: - Attachment: HBASE-21750.v3.patch > Most of KeyValueUtil#length can be replaced by

[jira] [Updated] (HBASE-21750) Most of KeyValueUtil#length can be replaced by cell#getSerializedSize for better performance because the latter one has been optimized

2019-01-21 Thread Zheng Hu (JIRA)
[ https://issues.apache.org/jira/browse/HBASE-21750?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Zheng Hu updated HBASE-21750: - Attachment: HBASE-21750.v2.patch > Most of KeyValueUtil#length can be replaced by

[jira] [Commented] (HBASE-21750) Most of KeyValueUtil#length can be replaced by cell#getSerializedSize for better performance because the latter one has been optimized

2019-01-21 Thread Zheng Hu (JIRA)
[ https://issues.apache.org/jira/browse/HBASE-21750?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16748346#comment-16748346 ] Zheng Hu commented on HBASE-21750: -- The failed ut is indeed a problem, let me fix this. {code}

[jira] [Updated] (HBASE-21750) Most of KeyValueUtil#length can be replaced by cell#getSerializedSize for better performance because the latter one has been optimized

2019-01-21 Thread Zheng Hu (JIRA)
[ https://issues.apache.org/jira/browse/HBASE-21750?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Zheng Hu updated HBASE-21750: - Status: Patch Available (was: Open) > Most of KeyValueUtil#length can be replaced by

[jira] [Updated] (HBASE-21750) Most of KeyValueUtil#length can be replaced by cell#getSerializedSize for better performance because the latter one has been optimized

2019-01-21 Thread Zheng Hu (JIRA)
[ https://issues.apache.org/jira/browse/HBASE-21750?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Zheng Hu updated HBASE-21750: - Attachment: HBASE-21750.v1.patch > Most of KeyValueUtil#length can be replaced by

[jira] [Commented] (HBASE-21738) Remove all the CSLM#size operation in our memstore because it's an quite time consuming.

2019-01-21 Thread Zheng Hu (JIRA)
[ https://issues.apache.org/jira/browse/HBASE-21738?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16747958#comment-16747958 ] Zheng Hu commented on HBASE-21738: -- bq. Even in Segment also.. 1.x we were not having such locked areas

[jira] [Commented] (HBASE-21738) Remove all the CSLM#size operation in our memstore because it's an quite time consuming.

2019-01-21 Thread Zheng Hu (JIRA)
[ https://issues.apache.org/jira/browse/HBASE-21738?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16747809#comment-16747809 ] Zheng Hu commented on HBASE-21738: -- Pushed to branch-2/branch-2.0/branch-2.1/master, Thanks all for

[jira] [Updated] (HBASE-21738) Remove all the CSLM#size operation in our memstore because it's an quite time consuming.

2019-01-21 Thread Zheng Hu (JIRA)
[ https://issues.apache.org/jira/browse/HBASE-21738?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Zheng Hu updated HBASE-21738: - Resolution: Fixed Hadoop Flags: Reviewed Release Note: We found the memstore snapshotting

[jira] [Commented] (HBASE-21734) Some optimization in FilterListWithOR

2019-01-20 Thread Zheng Hu (JIRA)
[ https://issues.apache.org/jira/browse/HBASE-21734?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16747717#comment-16747717 ] Zheng Hu commented on HBASE-21734: -- Sorry for pinging [~anoop.hbase] & [~zghaobac] for reviewing again,

[jira] [Commented] (HBASE-21738) Remove all the CSLM#size operation in our memstore because it's an quite time consuming.

2019-01-20 Thread Zheng Hu (JIRA)
[ https://issues.apache.org/jira/browse/HBASE-21738?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16747712#comment-16747712 ] Zheng Hu commented on HBASE-21738: -- bq. BTW compared to 1.x based write flow, we have now some

[jira] [Comment Edited] (HBASE-21734) Some optimization in FilterListWithOR

2019-01-20 Thread Zheng Hu (JIRA)
[ https://issues.apache.org/jira/browse/HBASE-21734?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16747339#comment-16747339 ] Zheng Hu edited comment on HBASE-21734 at 1/21/19 7:36 AM: --- bq. So the old

[jira] [Updated] (HBASE-21750) Most of KeyValueUtil#length can be replaced by cell#getSerializedSize for better performance because the latter one has been optimized

2019-01-20 Thread Zheng Hu (JIRA)
[ https://issues.apache.org/jira/browse/HBASE-21750?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Zheng Hu updated HBASE-21750: - Description: After HBASE-21657, Most subclass of Cell has a cached serialized size (Except those cells

<    3   4   5   6   7   8   9   10   11   12   >