[jira] [Updated] (HBASE-19344) improve asyncWAL by using Independent thread for netty #IO in FanOutOneBlockAsyncDFSOutput

2017-11-25 Thread Chance Li (JIRA)
[ https://issues.apache.org/jira/browse/HBASE-19344?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Chance Li updated HBASE-19344: -- Attachment: ycsb_result_apache20_async_wal.pdf HBASE-19344-branch2.patch.2.POC

[jira] [Commented] (HBASE-19344) improve asyncWAL by using Independent thread for netty #IO in FanOutOneBlockAsyncDFSOutput

2017-11-26 Thread Chance Li (JIRA)
[ https://issues.apache.org/jira/browse/HBASE-19344?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16266113#comment-16266113 ] Chance Li commented on HBASE-19344: --- bq. For me, I will start working on implementing the new logic

[jira] [Commented] (HBASE-19344) improve asyncWAL by using Independent thread for netty #IO in FanOutOneBlockAsyncDFSOutput

2017-11-26 Thread Chance Li (JIRA)
[ https://issues.apache.org/jira/browse/HBASE-19344?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16266298#comment-16266298 ] Chance Li commented on HBASE-19344: --- bq. And I haven’t understand the second question on sync fail,

[jira] [Commented] (HBASE-19344) improve asyncWAL by using Independent thread for netty #IO in FanOutOneBlockAsyncDFSOutput

2017-11-26 Thread Chance Li (JIRA)
[ https://issues.apache.org/jira/browse/HBASE-19344?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16266309#comment-16266309 ] Chance Li commented on HBASE-19344: --- Thanks. sir Is it possible that we encounter this situation:

[jira] [Commented] (HBASE-19344) improve asyncWAL by using Independent thread for netty #IO in FanOutOneBlockAsyncDFSOutput

2017-11-26 Thread Chance Li (JIRA)
[ https://issues.apache.org/jira/browse/HBASE-19344?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16266330#comment-16266330 ] Chance Li commented on HBASE-19344: --- Get it. > improve asyncWAL by using Independent thread for netty

[jira] [Commented] (HBASE-16890) Analyze the performance of AsyncWAL and fix the same

2017-11-23 Thread Chance Li (JIRA)
[ https://issues.apache.org/jira/browse/HBASE-16890?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16263942#comment-16263942 ] Chance Li commented on HBASE-16890: --- [~ramkrishna] bq. One quesiton on the YCSB - so since you measure

[jira] [Updated] (HBASE-19389) RS's handlers are all busy when writing many columns (more than 1000 columns)

2017-11-30 Thread Chance Li (JIRA)
[ https://issues.apache.org/jira/browse/HBASE-19389?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Chance Li updated HBASE-19389: -- Attachment: CSLM-concurrent-write.png > RS's handlers are all busy when writing many columns (more

[jira] [Created] (HBASE-19389) RS's handlers are all busy when writing many columns (more than 1000 columns)

2017-11-30 Thread Chance Li (JIRA)
Chance Li created HBASE-19389: - Summary: RS's handlers are all busy when writing many columns (more than 1000 columns) Key: HBASE-19389 URL: https://issues.apache.org/jira/browse/HBASE-19389 Project:

[jira] [Updated] (HBASE-19389) RS's handlers are all busy when writing many columns (more than 1000 columns)

2017-11-30 Thread Chance Li (JIRA)
[ https://issues.apache.org/jira/browse/HBASE-19389?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Chance Li updated HBASE-19389: -- Attachment: ycsb-result.png > RS's handlers are all busy when writing many columns (more than 1000

[jira] [Commented] (HBASE-19389) RS's handlers are all busy when writing many columns (more than 1000 columns)

2017-11-30 Thread Chance Li (JIRA)
[ https://issues.apache.org/jira/browse/HBASE-19389?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16273004#comment-16273004 ] Chance Li commented on HBASE-19389: --- bq. For metrics-1.png, was the stat collected with or without

[jira] [Updated] (HBASE-19389) RS's handlers are all busy when writing many columns (more than 1000 columns)

2017-11-30 Thread Chance Li (JIRA)
[ https://issues.apache.org/jira/browse/HBASE-19389?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Chance Li updated HBASE-19389: -- Attachment: metrics-1.png > RS's handlers are all busy when writing many columns (more than 1000

[jira] [Commented] (HBASE-19389) RS's handlers are all busy when writing many columns (more than 1000 columns)

2017-11-30 Thread Chance Li (JIRA)
[ https://issues.apache.org/jira/browse/HBASE-19389?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16272941#comment-16272941 ] Chance Li commented on HBASE-19389: --- We have done some small tests for concurrent writing to CSLM, see

[jira] [Comment Edited] (HBASE-19344) improve asyncWAL by using Independent thread for netty #IO in FanOutOneBlockAsyncDFSOutput

2017-11-29 Thread Chance Li (JIRA)
[ https://issues.apache.org/jira/browse/HBASE-19344?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16272066#comment-16272066 ] Chance Li edited comment on HBASE-19344 at 11/30/17 3:32 AM: - These tests are

[jira] [Updated] (HBASE-19344) improve asyncWAL by using Independent thread for netty #IO in FanOutOneBlockAsyncDFSOutput

2017-11-29 Thread Chance Li (JIRA)
[ https://issues.apache.org/jira/browse/HBASE-19344?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Chance Li updated HBASE-19344: -- Attachment: HBASE-19344-branch.ycsb.png > improve asyncWAL by using Independent thread for netty #IO

[jira] [Commented] (HBASE-19344) improve asyncWAL by using Independent thread for netty #IO in FanOutOneBlockAsyncDFSOutput

2017-11-29 Thread Chance Li (JIRA)
[ https://issues.apache.org/jira/browse/HBASE-19344?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16272104#comment-16272104 ] Chance Li commented on HBASE-19344: --- !HBASE-19344-branch.ycsb.png! > improve asyncWAL by using

[jira] [Issue Comment Deleted] (HBASE-19344) improve asyncWAL by using Independent thread for netty #IO in FanOutOneBlockAsyncDFSOutput

2017-11-29 Thread Chance Li (JIRA)
[ https://issues.apache.org/jira/browse/HBASE-19344?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Chance Li updated HBASE-19344: -- Comment: was deleted (was: !HBASE-19344-branch.ycsb.png!) > improve asyncWAL by using Independent

[jira] [Issue Comment Deleted] (HBASE-19344) improve asyncWAL by using Independent thread for netty #IO in FanOutOneBlockAsyncDFSOutput

2017-11-29 Thread Chance Li (JIRA)
[ https://issues.apache.org/jira/browse/HBASE-19344?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Chance Li updated HBASE-19344: -- Comment: was deleted (was: !HBASE-19344-branch-ycsb-1.png!) > improve asyncWAL by using Independent

[jira] [Comment Edited] (HBASE-19344) improve asyncWAL by using Independent thread for netty #IO in FanOutOneBlockAsyncDFSOutput

2017-11-29 Thread Chance Li (JIRA)
[ https://issues.apache.org/jira/browse/HBASE-19344?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16272066#comment-16272066 ] Chance Li edited comment on HBASE-19344 at 11/30/17 3:34 AM: - These tests are

[jira] [Commented] (HBASE-19344) improve asyncWAL by using Independent thread for netty #IO in FanOutOneBlockAsyncDFSOutput

2017-11-29 Thread Chance Li (JIRA)
[ https://issues.apache.org/jira/browse/HBASE-19344?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16272108#comment-16272108 ] Chance Li commented on HBASE-19344: --- !HBASE-19344-branch-ycsb-1.png! > improve asyncWAL by using

[jira] [Updated] (HBASE-19344) improve asyncWAL by using Independent thread for netty #IO in FanOutOneBlockAsyncDFSOutput

2017-11-29 Thread Chance Li (JIRA)
[ https://issues.apache.org/jira/browse/HBASE-19344?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Chance Li updated HBASE-19344: -- Attachment: HBASE-19344-branch-ycsb-1.png > improve asyncWAL by using Independent thread for netty #IO

[jira] [Commented] (HBASE-19346) Use EventLoopGroup to create AsyncFSOutput

2017-11-27 Thread Chance Li (JIRA)
[ https://issues.apache.org/jira/browse/HBASE-19346?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16266530#comment-16266530 ] Chance Li commented on HBASE-19346: --- so, the action of remove the #waitingAckQueue in

[jira] [Commented] (HBASE-19346) Use EventLoopGroup to create AsyncFSOutput

2017-11-27 Thread Chance Li (JIRA)
[ https://issues.apache.org/jira/browse/HBASE-19346?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16266596#comment-16266596 ] Chance Li commented on HBASE-19346: --- ok. LGTM. > Use EventLoopGroup to create AsyncFSOutput >

[jira] [Updated] (HBASE-19344) improve asyncWAL by using Independent thread for netty #IO in FanOutOneBlockAsyncDFSOutput

2017-11-25 Thread Chance Li (JIRA)
[ https://issues.apache.org/jira/browse/HBASE-19344?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Chance Li updated HBASE-19344: -- Attachment: wal-1-test-result.png > improve asyncWAL by using Independent thread for netty #IO in >

[jira] [Commented] (HBASE-19344) improve asyncWAL by using Independent thread for netty #IO in FanOutOneBlockAsyncDFSOutput

2017-11-25 Thread Chance Li (JIRA)
[ https://issues.apache.org/jira/browse/HBASE-19344?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16265684#comment-16265684 ] Chance Li commented on HBASE-19344: --- Some of the related unit tests have passed now. There are still

[jira] [Updated] (HBASE-19344) improve asyncWAL by using Independent thread for netty #IO in FanOutOneBlockAsyncDFSOutput

2017-11-25 Thread Chance Li (JIRA)
[ https://issues.apache.org/jira/browse/HBASE-19344?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Chance Li updated HBASE-19344: -- Attachment: wal-8-test-result.png > improve asyncWAL by using Independent thread for netty #IO in >

[jira] [Updated] (HBASE-19344) improve asyncWAL by using Independent thread for netty #IO in FanOutOneBlockAsyncDFSOutput

2017-11-25 Thread Chance Li (JIRA)
[ https://issues.apache.org/jira/browse/HBASE-19344?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Chance Li updated HBASE-19344: -- Status: Patch Available (was: Open) > improve asyncWAL by using Independent thread for netty #IO in

[jira] [Updated] (HBASE-19344) improve asyncWAL by using Independent thread for netty #IO in FanOutOneBlockAsyncDFSOutput

2017-11-25 Thread Chance Li (JIRA)
[ https://issues.apache.org/jira/browse/HBASE-19344?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Chance Li updated HBASE-19344: -- Attachment: HBASE-19344-branch2.patch first patch. > improve asyncWAL by using Independent thread for

[jira] [Created] (HBASE-19344) improve asyncWAL by using Independent thread for netty #IO in FanOutOneBlockAsyncDFSOutput

2017-11-25 Thread Chance Li (JIRA)
Chance Li created HBASE-19344: - Summary: improve asyncWAL by using Independent thread for netty #IO in FanOutOneBlockAsyncDFSOutput Key: HBASE-19344 URL: https://issues.apache.org/jira/browse/HBASE-19344

[jira] [Commented] (HBASE-16890) Analyze the performance of AsyncWAL and fix the same

2017-11-22 Thread Chance Li (JIRA)
[ https://issues.apache.org/jira/browse/HBASE-16890?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16263280#comment-16263280 ] Chance Li commented on HBASE-16890: --- Thanks, sir. [~Apache9] The test result is not good enough but I

[jira] [Updated] (HBASE-16890) Analyze the performance of AsyncWAL and fix the same

2017-11-22 Thread Chance Li (JIRA)
[ https://issues.apache.org/jira/browse/HBASE-16890?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Chance Li updated HBASE-16890: -- Attachment: ycsb_FSHlog.vs.Async.png > Analyze the performance of AsyncWAL and fix the same >

[jira] [Comment Edited] (HBASE-16890) Analyze the performance of AsyncWAL and fix the same

2017-11-22 Thread Chance Li (JIRA)
[ https://issues.apache.org/jira/browse/HBASE-16890?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16263280#comment-16263280 ] Chance Li edited comment on HBASE-16890 at 11/22/17 8:10 PM: - Thanks, sir.

[jira] [Commented] (HBASE-19344) improve asyncWAL by using Independent thread for netty #IO in FanOutOneBlockAsyncDFSOutput

2017-11-29 Thread Chance Li (JIRA)
[ https://issues.apache.org/jira/browse/HBASE-19344?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16272066#comment-16272066 ] Chance Li commented on HBASE-19344: --- These tests are based on SSD. And the result is what we expect.

[jira] [Updated] (HBASE-19344) improve asyncWAL by using Independent thread for netty #IO in FanOutOneBlockAsyncDFSOutput

2017-11-29 Thread Chance Li (JIRA)
[ https://issues.apache.org/jira/browse/HBASE-19344?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Chance Li updated HBASE-19344: -- Attachment: HBASE-19344-branch.ycsb.png > improve asyncWAL by using Independent thread for netty #IO

[jira] [Updated] (HBASE-19389) Limit concurrency of put with dense (hundreds) columns to prevent write hander exhausted

2017-12-03 Thread Chance Li (JIRA)
[ https://issues.apache.org/jira/browse/HBASE-19389?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Chance Li updated HBASE-19389: -- Attachment: HBASE-19389-branch-2.patch.POC > Limit concurrency of put with dense (hundreds) columns to

[jira] [Commented] (HBASE-19389) Limit concurrency of put with dense (hundreds) columns to prevent write hander exhausted

2017-12-03 Thread Chance Li (JIRA)
[ https://issues.apache.org/jira/browse/HBASE-19389?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16276058#comment-16276058 ] Chance Li commented on HBASE-19389: --- The result is not as good as 1.x with patch(But it's still worked)

[jira] [Commented] (HBASE-19389) Limit concurrency of put with dense (hundreds) columns to prevent write hander exhausted

2017-12-01 Thread Chance Li (JIRA)
[ https://issues.apache.org/jira/browse/HBASE-19389?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16274786#comment-16274786 ] Chance Li commented on HBASE-19389: --- bq. In the solution - abt the concurrent max #columns . So this is

[jira] [Commented] (HBASE-19389) Limit concurrency of put with dense (hundreds) columns to prevent write hander exhausted

2017-12-01 Thread Chance Li (JIRA)
[ https://issues.apache.org/jira/browse/HBASE-19389?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16274831#comment-16274831 ] Chance Li commented on HBASE-19389: --- My writing is a bit confusing between parallel and concurrency.

[jira] [Comment Edited] (HBASE-19389) Limit concurrency of put with dense (hundreds) columns to prevent write hander exhausted

2017-12-01 Thread Chance Li (JIRA)
[ https://issues.apache.org/jira/browse/HBASE-19389?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16272941#comment-16272941 ] Chance Li edited comment on HBASE-19389 at 12/1/17 7:07 PM: We have done some

[jira] [Commented] (HBASE-16890) Analyze the performance of AsyncWAL and fix the same

2017-11-20 Thread Chance Li (JIRA)
[ https://issues.apache.org/jira/browse/HBASE-16890?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16259663#comment-16259663 ] Chance Li commented on HBASE-16890: --- It's very nice code. :) I will work on this. And I read the code

[jira] [Updated] (HBASE-19389) Limit concurrency of put with dense (hundreds) columns to prevent write hander exhausted

2017-12-05 Thread Chance Li (JIRA)
[ https://issues.apache.org/jira/browse/HBASE-19389?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Chance Li updated HBASE-19389: -- Attachment: HBASE-19389-branch-2-V2.patch > Limit concurrency of put with dense (hundreds) columns to

[jira] [Commented] (HBASE-19389) Limit concurrency of put with dense (hundreds) columns to prevent write hander exhausted

2017-12-05 Thread Chance Li (JIRA)
[ https://issues.apache.org/jira/browse/HBASE-19389?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16278866#comment-16278866 ] Chance Li commented on HBASE-19389: --- [~te...@apache.org] Thanks for the reviews. Update the patch. >

[jira] [Commented] (HBASE-18962) Support atomic BatchOperations through batchMutate()

2017-12-02 Thread Chance Li (JIRA)
[ https://issues.apache.org/jira/browse/HBASE-18962?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16275635#comment-16275635 ] Chance Li commented on HBASE-18962: --- try { doBatchOp(builder, region, quota, mutations,

[jira] [Comment Edited] (HBASE-18962) Support atomic BatchOperations through batchMutate()

2017-12-02 Thread Chance Li (JIRA)
[ https://issues.apache.org/jira/browse/HBASE-18962?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16275635#comment-16275635 ] Chance Li edited comment on HBASE-18962 at 12/2/17 4:13 PM: ``` try {

[jira] [Updated] (HBASE-19389) Limit concurrency of put with dense (hundreds) columns to prevent write hander exhausted

2017-12-04 Thread Chance Li (JIRA)
[ https://issues.apache.org/jira/browse/HBASE-19389?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Chance Li updated HBASE-19389: -- Attachment: (was: HBASE-19389-branch-2.patch.POC) > Limit concurrency of put with dense (hundreds)

[jira] [Commented] (HBASE-19389) Limit concurrency of put with dense (hundreds) columns to prevent write hander exhausted

2017-12-04 Thread Chance Li (JIRA)
[ https://issues.apache.org/jira/browse/HBASE-19389?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16276914#comment-16276914 ] Chance Li commented on HBASE-19389: --- [~carp84] I make a new patch. The result of test meet our

[jira] [Updated] (HBASE-19389) Limit concurrency of put with dense (hundreds) columns to prevent write hander exhausted

2017-12-04 Thread Chance Li (JIRA)
[ https://issues.apache.org/jira/browse/HBASE-19389?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Chance Li updated HBASE-19389: -- Fix Version/s: (was: 3.0.0) Status: Patch Available (was: Open) > Limit concurrency of

[jira] [Updated] (HBASE-19389) Limit concurrency of put with dense (hundreds) columns to prevent write hander exhausted

2017-12-04 Thread Chance Li (JIRA)
[ https://issues.apache.org/jira/browse/HBASE-19389?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Chance Li updated HBASE-19389: -- Attachment: HBASE-19389-branch-2.patch > Limit concurrency of put with dense (hundreds) columns to

[jira] [Commented] (HBASE-19389) Limit concurrency of put with dense (hundreds) columns to prevent write hander exhausted

2017-12-04 Thread Chance Li (JIRA)
[ https://issues.apache.org/jira/browse/HBASE-19389?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16276971#comment-16276971 ] Chance Li commented on HBASE-19389: --- https://reviews.apache.org/r/64300/ > Limit concurrency of put

[jira] [Updated] (HBASE-19389) Limit concurrency of put with dense (hundreds) columns to prevent write handler exhausted

2017-12-10 Thread Chance Li (JIRA)
[ https://issues.apache.org/jira/browse/HBASE-19389?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Chance Li updated HBASE-19389: -- Attachment: HBASE-19389-branch-2-V8.patch > Limit concurrency of put with dense (hundreds) columns to

[jira] [Commented] (HBASE-19389) Limit concurrency of put with dense (hundreds) columns to prevent write handler exhausted

2017-12-10 Thread Chance Li (JIRA)
[ https://issues.apache.org/jira/browse/HBASE-19389?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16285435#comment-16285435 ] Chance Li commented on HBASE-19389: --- checkstyle, run UT again. > Limit concurrency of put with dense

[jira] [Commented] (HBASE-18962) Support atomic BatchOperations through batchMutate()

2017-12-06 Thread Chance Li (JIRA)
[ https://issues.apache.org/jira/browse/HBASE-18962?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16279954#comment-16279954 ] Chance Li commented on HBASE-18962: --- [~uagashe] I have not done the test now, just read the code. So

[jira] [Commented] (HBASE-19389) Limit concurrency of put with dense (hundreds) columns to prevent write handler exhausted

2017-12-06 Thread Chance Li (JIRA)
[ https://issues.apache.org/jira/browse/HBASE-19389?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16281215#comment-16281215 ] Chance Li commented on HBASE-19389: --- patch v4 for checkstyle > Limit concurrency of put with dense

[jira] [Updated] (HBASE-19389) Limit concurrency of put with dense (hundreds) columns to prevent write handler exhausted

2017-12-06 Thread Chance Li (JIRA)
[ https://issues.apache.org/jira/browse/HBASE-19389?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Chance Li updated HBASE-19389: -- Attachment: HBASE-19389-branch-2-V4.patch > Limit concurrency of put with dense (hundreds) columns to

[jira] [Commented] (HBASE-19389) Limit concurrency of put with dense (hundreds) columns to prevent write handler exhausted

2017-12-09 Thread Chance Li (JIRA)
[ https://issues.apache.org/jira/browse/HBASE-19389?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16284728#comment-16284728 ] Chance Li commented on HBASE-19389: --- [~carp84] Thanks for the reviews. Update the patch. > Limit

[jira] [Updated] (HBASE-19389) Limit concurrency of put with dense (hundreds) columns to prevent write handler exhausted

2017-12-09 Thread Chance Li (JIRA)
[ https://issues.apache.org/jira/browse/HBASE-19389?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Chance Li updated HBASE-19389: -- Attachment: HBASE-19389-branch-2-V5.patch > Limit concurrency of put with dense (hundreds) columns to

[jira] [Commented] (HBASE-16890) Analyze the performance of AsyncWAL and fix the same

2017-12-10 Thread Chance Li (JIRA)
[ https://issues.apache.org/jira/browse/HBASE-16890?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16285168#comment-16285168 ] Chance Li commented on HBASE-16890: --- Hi Stack, do 24 thread(or 48 threads) mean "threadcount=24" on one

[jira] [Updated] (HBASE-19389) Limit concurrency of put with dense (hundreds) columns to prevent write handler exhausted

2017-12-10 Thread Chance Li (JIRA)
[ https://issues.apache.org/jira/browse/HBASE-19389?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Chance Li updated HBASE-19389: -- Attachment: HBASE-19389-branch-2-V6.patch > Limit concurrency of put with dense (hundreds) columns to

[jira] [Commented] (HBASE-19389) Limit concurrency of put with dense (hundreds) columns to prevent write handler exhausted

2017-12-10 Thread Chance Li (JIRA)
[ https://issues.apache.org/jira/browse/HBASE-19389?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16285145#comment-16285145 ] Chance Li commented on HBASE-19389: --- rebased, HBASE-19389-branch-2-V6.patch > Limit concurrency of put

[jira] [Updated] (HBASE-19389) Limit concurrency of put with dense (hundreds) columns to prevent write handler exhausted

2017-12-10 Thread Chance Li (JIRA)
[ https://issues.apache.org/jira/browse/HBASE-19389?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Chance Li updated HBASE-19389: -- Attachment: HBASE-19389-branch-2-V7.patch > Limit concurrency of put with dense (hundreds) columns to

[jira] [Commented] (HBASE-19389) Limit concurrency of put with dense (hundreds) columns to prevent write handler exhausted

2017-12-10 Thread Chance Li (JIRA)
[ https://issues.apache.org/jira/browse/HBASE-19389?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16285326#comment-16285326 ] Chance Li commented on HBASE-19389: --- sorry for the UT error. update patch HBASE-19389-branch-2-V7.patch

[jira] [Commented] (HBASE-18962) Support atomic BatchOperations through batchMutate()

2017-12-06 Thread Chance Li (JIRA)
[ https://issues.apache.org/jira/browse/HBASE-18962?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16280242#comment-16280242 ] Chance Li commented on HBASE-18962: --- [~uagashe] I will do some UT for this later. : ) I only see when

[jira] [Updated] (HBASE-19389) Limit concurrency of put with dense (hundreds) columns to prevent write handler exhausted

2017-12-06 Thread Chance Li (JIRA)
[ https://issues.apache.org/jira/browse/HBASE-19389?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Chance Li updated HBASE-19389: -- Attachment: HBASE-19389-branch-2-V3.patch > Limit concurrency of put with dense (hundreds) columns to

[jira] [Commented] (HBASE-19389) Limit concurrency of put with dense (hundreds) columns to prevent write handler exhausted

2017-12-06 Thread Chance Li (JIRA)
[ https://issues.apache.org/jira/browse/HBASE-19389?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16280301#comment-16280301 ] Chance Li commented on HBASE-19389: --- [~syuanjiang] [~ted_yu] Thanks for the reviews. Update the patch.

[jira] [Commented] (HBASE-19389) Limit concurrency of put with dense (hundreds) columns to prevent write handler exhausted

2017-12-06 Thread Chance Li (JIRA)
[ https://issues.apache.org/jira/browse/HBASE-19389?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16280308#comment-16280308 ] Chance Li commented on HBASE-19389: --- done [~ted_yu] > Limit concurrency of put with dense (hundreds)

[jira] [Commented] (HBASE-18294) Reduce global heap pressure: flush based on heap occupancy

2018-02-05 Thread Chance Li (JIRA)
[ https://issues.apache.org/jira/browse/HBASE-18294?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16352221#comment-16352221 ] Chance Li commented on HBASE-18294: --- [~eshcar] The store will known the detail about the

[jira] [Commented] (HBASE-18294) Reduce global heap pressure: flush based on heap occupancy

2018-02-05 Thread Chance Li (JIRA)
[ https://issues.apache.org/jira/browse/HBASE-18294?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16352158#comment-16352158 ] Chance Li commented on HBASE-18294: --- [~eshcar]  How about we conside the RAM of the Memstore as a

[jira] [Created] (HBASE-19959) How much RAM space is to be really consumed by the memstore?

2018-02-07 Thread Chance Li (JIRA)
Chance Li created HBASE-19959: - Summary: How much RAM space is to be really consumed by the memstore? Key: HBASE-19959 URL: https://issues.apache.org/jira/browse/HBASE-19959 Project: HBase

[jira] [Commented] (HBASE-19959) How much RAM space is to be really consumed by the memstore?

2018-02-11 Thread Chance Li (JIRA)
[ https://issues.apache.org/jira/browse/HBASE-19959?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16359868#comment-16359868 ] Chance Li commented on HBASE-19959: --- To flush all the data to make the memstore size is 0 .  > How

[jira] [Commented] (HBASE-19959) How much RAM space is to be really consumed by the memstore?

2018-02-08 Thread Chance Li (JIRA)
[ https://issues.apache.org/jira/browse/HBASE-19959?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16358014#comment-16358014 ] Chance Li commented on HBASE-19959: --- In this scenario, every chunk in pool was used at least once , and

[jira] [Commented] (HBASE-18294) Reduce global heap pressure: flush based on heap occupancy

2018-02-07 Thread Chance Li (JIRA)
[ https://issues.apache.org/jira/browse/HBASE-18294?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16355534#comment-16355534 ] Chance Li commented on HBASE-18294: --- [~anastas] Accutally, It's not a new thing. All cells in memstore

[jira] [Commented] (HBASE-20003) WALLess HBase on Persistent Memory

2018-02-24 Thread Chance Li (JIRA)
[ https://issues.apache.org/jira/browse/HBASE-20003?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16375425#comment-16375425 ] Chance Li commented on HBASE-20003: --- Cool. But it's maybe difficult for pipeline model to provide the

[jira] [Commented] (HBASE-19389) Limit concurrency of put with dense (hundreds) columns to prevent write handler exhausted

2018-03-06 Thread Chance Li (JIRA)
[ https://issues.apache.org/jira/browse/HBASE-19389?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16388970#comment-16388970 ] Chance Li commented on HBASE-19389: --- [~stack] thanks, sir. {quote}less throughput, but way less CPU

[jira] [Commented] (HBASE-19389) Limit concurrency of put with dense (hundreds) columns to prevent write handler exhausted

2018-03-06 Thread Chance Li (JIRA)
[ https://issues.apache.org/jira/browse/HBASE-19389?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16388962#comment-16388962 ] Chance Li commented on HBASE-19389: --- [~stack] thanks, sir. {quote} less throughput, but way less CPU

[jira] [Issue Comment Deleted] (HBASE-19389) Limit concurrency of put with dense (hundreds) columns to prevent write handler exhausted

2018-03-06 Thread Chance Li (JIRA)
[ https://issues.apache.org/jira/browse/HBASE-19389?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Chance Li updated HBASE-19389: -- Comment: was deleted (was: [~stack] thanks, sir. {quote} less throughput, but way less CPU used

[jira] [Issue Comment Deleted] (HBASE-12439) Procedure V2

2018-03-06 Thread Chance Li (JIRA)
[ https://issues.apache.org/jira/browse/HBASE-12439?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Chance Li updated HBASE-12439: -- Comment: was deleted (was: [~stack] thanks, sir. {quote}less throughput, but way less CPU used

[jira] [Commented] (HBASE-12439) Procedure V2

2018-03-06 Thread Chance Li (JIRA)
[ https://issues.apache.org/jira/browse/HBASE-12439?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16388965#comment-16388965 ] Chance Li commented on HBASE-12439: --- [~stack] thanks, sir. {quote}less throughput, but way less CPU

[jira] [Commented] (HBASE-19389) Limit concurrency of put with dense (hundreds) columns to prevent write handler exhausted

2018-03-08 Thread Chance Li (JIRA)
[ https://issues.apache.org/jira/browse/HBASE-19389?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16391023#comment-16391023 ] Chance Li commented on HBASE-19389: --- [~uagashe], Thanks, sir.  I should re-write javadoc or comments

[jira] [Commented] (HBASE-19389) Limit concurrency of put with dense (hundreds) columns to prevent write handler exhausted

2018-03-11 Thread Chance Li (JIRA)
[ https://issues.apache.org/jira/browse/HBASE-19389?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16394738#comment-16394738 ] Chance Li commented on HBASE-19389: --- checkstyle, run UT again > Limit concurrency of put with dense

[jira] [Updated] (HBASE-19389) Limit concurrency of put with dense (hundreds) columns to prevent write handler exhausted

2018-03-11 Thread Chance Li (JIRA)
[ https://issues.apache.org/jira/browse/HBASE-19389?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Chance Li updated HBASE-19389: -- Attachment: HBASE-19389.master.v2.patch > Limit concurrency of put with dense (hundreds) columns to

[jira] [Commented] (HBASE-19389) Limit concurrency of put with dense (hundreds) columns to prevent write handler exhausted

2018-03-11 Thread Chance Li (JIRA)
[ https://issues.apache.org/jira/browse/HBASE-19389?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16394484#comment-16394484 ] Chance Li commented on HBASE-19389: --- update patch HBASE-19389-branch-2-V8.patch, add 

[jira] [Updated] (HBASE-19389) Limit concurrency of put with dense (hundreds) columns to prevent write handler exhausted

2018-03-11 Thread Chance Li (JIRA)
[ https://issues.apache.org/jira/browse/HBASE-19389?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Chance Li updated HBASE-19389: -- Attachment: HBASE-19389.master.patch > Limit concurrency of put with dense (hundreds) columns to

[jira] [Updated] (HBASE-19389) Limit concurrency of put with dense (hundreds) columns to prevent write handler exhausted

2018-03-11 Thread Chance Li (JIRA)
[ https://issues.apache.org/jira/browse/HBASE-19389?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Chance Li updated HBASE-19389: -- Attachment: HBASE-19389-branch-2-V9.patch > Limit concurrency of put with dense (hundreds) columns to

[jira] [Updated] (HBASE-19389) Limit concurrency of put with dense (hundreds) columns to prevent write handler exhausted

2018-03-13 Thread Chance Li (JIRA)
[ https://issues.apache.org/jira/browse/HBASE-19389?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Chance Li updated HBASE-19389: -- Attachment: HBASE-19389-branch-2-V10.patch > Limit concurrency of put with dense (hundreds) columns to

[jira] [Commented] (HBASE-19389) Limit concurrency of put with dense (hundreds) columns to prevent write handler exhausted

2018-03-13 Thread Chance Li (JIRA)
[ https://issues.apache.org/jira/browse/HBASE-19389?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16397987#comment-16397987 ] Chance Li commented on HBASE-19389: --- HBASE-19389-branch-2-V10.patch for checkstyle updates, same as 

[jira] [Updated] (HBASE-20312) CCSMap: A faster, GC-friendly, less memory Concurrent Map for memstore

2018-04-07 Thread Chance Li (JIRA)
[ https://issues.apache.org/jira/browse/HBASE-20312?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Chance Li updated HBASE-20312: -- Attachment: HBASE-20312-master.v4.patch > CCSMap: A faster, GC-friendly, less memory Concurrent Map

[jira] [Updated] (HBASE-20312) CCSMap: A faster, GC-friendly, less memory Concurrent Map for memstore

2018-04-07 Thread Chance Li (JIRA)
[ https://issues.apache.org/jira/browse/HBASE-20312?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Chance Li updated HBASE-20312: -- Attachment: on-heap-test-put-master.png > CCSMap: A faster, GC-friendly, less memory Concurrent Map

[jira] [Commented] (HBASE-20312) CCSMap: A faster, GC-friendly, less memory Concurrent Map for memstore

2018-04-07 Thread Chance Li (JIRA)
[ https://issues.apache.org/jira/browse/HBASE-20312?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16429587#comment-16429587 ] Chance Li commented on HBASE-20312: --- HBASE-20312-master.v4.patch only fix the config error with

[jira] [Updated] (HBASE-20312) CCSMap: A faster, GC-friendly, less memory Concurrent Map for memstore

2018-04-07 Thread Chance Li (JIRA)
[ https://issues.apache.org/jira/browse/HBASE-20312?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Chance Li updated HBASE-20312: -- Attachment: off-heap-test-put-master.png > CCSMap: A faster, GC-friendly, less memory Concurrent Map

[jira] [Commented] (HBASE-20312) CCSMap: A faster, GC-friendly, less memory Concurrent Map for memstore

2018-04-07 Thread Chance Li (JIRA)
[ https://issues.apache.org/jira/browse/HBASE-20312?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16429615#comment-16429615 ] Chance Li commented on HBASE-20312: --- key configurations: 1. hbase-env.sh hbase-site.xml - -Xmx36864m

[jira] [Updated] (HBASE-20312) CCSMap: A faster, GC-friendly, less memory Concurrent Map for memstore

2018-04-18 Thread Chance Li (JIRA)
[ https://issues.apache.org/jira/browse/HBASE-20312?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Chance Li updated HBASE-20312: -- Attachment: HBASE-20312-master.v6.patch > CCSMap: A faster, GC-friendly, less memory Concurrent Map

[jira] [Commented] (HBASE-20312) CCSMap: A faster, GC-friendly, less memory Concurrent Map for memstore

2018-04-18 Thread Chance Li (JIRA)
[ https://issues.apache.org/jira/browse/HBASE-20312?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16442560#comment-16442560 ] Chance Li commented on HBASE-20312: --- HBASE-20312-master.v6.patch is for check-style and review. >

[jira] [Updated] (HBASE-20312) CCSMap: A faster, GC-friendly, less memory Concurrent Map for memstore

2018-04-17 Thread Chance Li (JIRA)
[ https://issues.apache.org/jira/browse/HBASE-20312?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Chance Li updated HBASE-20312: -- Attachment: HBASE-20312-master.v5.patch > CCSMap: A faster, GC-friendly, less memory Concurrent Map

[jira] [Commented] (HBASE-20312) CCSMap: A faster, GC-friendly, less memory Concurrent Map for memstore

2018-04-17 Thread Chance Li (JIRA)
[ https://issues.apache.org/jira/browse/HBASE-20312?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16440902#comment-16440902 ] Chance Li commented on HBASE-20312: --- HBASE-20312-master.v5.patch fix a bug in close method. > CCSMap:

[jira] [Updated] (HBASE-20312) CCSMap: A faster, GC-friendly, less memory Concurrent Map for memstore

2018-04-18 Thread Chance Li (JIRA)
[ https://issues.apache.org/jira/browse/HBASE-20312?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Chance Li updated HBASE-20312: -- Attachment: HBASE-20312-master.v7.patch > CCSMap: A faster, GC-friendly, less memory Concurrent Map

[jira] [Commented] (HBASE-20312) CCSMap: A faster, GC-friendly, less memory Concurrent Map for memstore

2018-04-18 Thread Chance Li (JIRA)
[ https://issues.apache.org/jira/browse/HBASE-20312?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16443092#comment-16443092 ] Chance Li commented on HBASE-20312: --- HBASE-20312-master.v7.patch update for UT and check-style again.

[jira] [Commented] (HBASE-20312) CCSMap: A faster, GC-friendly, less memory Concurrent Map for memstore

2018-04-19 Thread Chance Li (JIRA)
[ https://issues.apache.org/jira/browse/HBASE-20312?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16443617#comment-16443617 ] Chance Li commented on HBASE-20312: --- [~mdrob] sir, Making another project is not my propose. Let's me

[jira] [Commented] (HBASE-20312) CCSMap: A faster, GC-friendly, less memory Concurrent Map for memstore

2018-04-21 Thread Chance Li (JIRA)
[ https://issues.apache.org/jira/browse/HBASE-20312?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16447084#comment-16447084 ] Chance Li commented on HBASE-20312: --- Thanks, [~yuzhih...@gmail.com] HBASE-20312-master.v9.patch for 

[jira] [Updated] (HBASE-20312) CCSMap: A faster, GC-friendly, less memory Concurrent Map for memstore

2018-04-21 Thread Chance Li (JIRA)
[ https://issues.apache.org/jira/browse/HBASE-20312?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Chance Li updated HBASE-20312: -- Attachment: HBASE-20312-master.v9.patch > CCSMap: A faster, GC-friendly, less memory Concurrent Map

[jira] [Commented] (HBASE-20312) CCSMap: A faster, GC-friendly, less memory Concurrent Map for memstore

2018-04-21 Thread Chance Li (JIRA)
[ https://issues.apache.org/jira/browse/HBASE-20312?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16446891#comment-16446891 ] Chance Li commented on HBASE-20312: --- HBASE-20312-master.v8.patch update for review and check-style. >

[jira] [Updated] (HBASE-20312) CCSMap: A faster, GC-friendly, less memory Concurrent Map for memstore

2018-04-21 Thread Chance Li (JIRA)
[ https://issues.apache.org/jira/browse/HBASE-20312?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Chance Li updated HBASE-20312: -- Attachment: HBASE-20312-master.v8.patch > CCSMap: A faster, GC-friendly, less memory Concurrent Map

  1   2   >