[jira] [Created] (HBASE-12078) Missing Data when scanning using PREFIX_TREE DATA-BLOCK-ENCODING

2014-09-24 Thread zhangduo (JIRA)
zhangduo created HBASE-12078: Summary: Missing Data when scanning using PREFIX_TREE DATA-BLOCK-ENCODING Key: HBASE-12078 URL: https://issues.apache.org/jira/browse/HBASE-12078 Project: HBase

[jira] [Updated] (HBASE-12078) Missing Data when scanning using PREFIX_TREE DATA-BLOCK-ENCODING

2014-09-24 Thread zhangduo (JIRA)
[ https://issues.apache.org/jira/browse/HBASE-12078?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] zhangduo updated HBASE-12078: - Attachment: prefix_tree_error_fix.patch prefix_tree_error_test.patch testcase and our

[jira] [Updated] (HBASE-12078) Missing Data when scanning using PREFIX_TREE DATA-BLOCK-ENCODING

2014-09-24 Thread zhangduo (JIRA)
[ https://issues.apache.org/jira/browse/HBASE-12078?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] zhangduo updated HBASE-12078: - Attachment: prefix_tree_error.patch remove debug System.out output, combine test and fix Missing Data

[jira] [Updated] (HBASE-12078) Missing Data when scanning using PREFIX_TREE DATA-BLOCK-ENCODING

2014-09-24 Thread zhangduo (JIRA)
[ https://issues.apache.org/jira/browse/HBASE-12078?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] zhangduo updated HBASE-12078: - Attachment: (was: prefix_tree_error.patch) Missing Data when scanning using PREFIX_TREE

[jira] [Updated] (HBASE-12078) Missing Data when scanning using PREFIX_TREE DATA-BLOCK-ENCODING

2014-09-24 Thread zhangduo (JIRA)
[ https://issues.apache.org/jira/browse/HBASE-12078?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] zhangduo updated HBASE-12078: - Attachment: prefix_tree_error.patch forget to remove @author, sorry Missing Data when scanning using

[jira] [Updated] (HBASE-12078) Missing Data when scanning using PREFIX_TREE DATA-BLOCK-ENCODING

2014-09-24 Thread zhangduo (JIRA)
[ https://issues.apache.org/jira/browse/HBASE-12078?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] zhangduo updated HBASE-12078: - Attachment: (was: prefix_tree_error_fix.patch) Missing Data when scanning using PREFIX_TREE

[jira] [Updated] (HBASE-12078) Missing Data when scanning using PREFIX_TREE DATA-BLOCK-ENCODING

2014-09-24 Thread zhangduo (JIRA)
[ https://issues.apache.org/jira/browse/HBASE-12078?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] zhangduo updated HBASE-12078: - Attachment: (was: prefix_tree_error_test.patch) Missing Data when scanning using PREFIX_TREE

[jira] [Updated] (HBASE-12078) Missing Data when scanning using PREFIX_TREE DATA-BLOCK-ENCODING

2014-09-24 Thread zhangduo (JIRA)
[ https://issues.apache.org/jira/browse/HBASE-12078?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] zhangduo updated HBASE-12078: - Description: our row key is combined with two ints, and we found that sometimes when we using only the

[jira] [Commented] (HBASE-12078) Missing Data when scanning using PREFIX_TREE DATA-BLOCK-ENCODING

2014-09-24 Thread zhangduo (JIRA)
[ https://issues.apache.org/jira/browse/HBASE-12078?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14146080#comment-14146080 ] zhangduo commented on HBASE-12078: -- Thank you,ramkrishna.s.vasudevan. Sorry for my poor

[jira] [Commented] (HBASE-12078) Missing Data when scanning using PREFIX_TREE DATA-BLOCK-ENCODING

2014-09-24 Thread zhangduo (JIRA)
[ https://issues.apache.org/jira/browse/HBASE-12078?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14147127#comment-14147127 ] zhangduo commented on HBASE-12078: -- Put the testcase in hbase-prefix-tree module

[jira] [Updated] (HBASE-12078) Missing Data when scanning using PREFIX_TREE DATA-BLOCK-ENCODING

2014-09-24 Thread zhangduo (JIRA)
[ https://issues.apache.org/jira/browse/HBASE-12078?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] zhangduo updated HBASE-12078: - Attachment: HBASE-12078.patch rebase to master, fix compile error for annotation location change

[jira] [Commented] (HBASE-12078) Missing Data when scanning using PREFIX_TREE DATA-BLOCK-ENCODING

2014-09-25 Thread zhangduo (JIRA)
[ https://issues.apache.org/jira/browse/HBASE-12078?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14147726#comment-14147726 ] zhangduo commented on HBASE-12078: -- What is the error message? I tried the latest patch

[jira] [Updated] (HBASE-12078) Missing Data when scanning using PREFIX_TREE DATA-BLOCK-ENCODING

2014-09-26 Thread zhangduo (JIRA)
[ https://issues.apache.org/jira/browse/HBASE-12078?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] zhangduo updated HBASE-12078: - Attachment: HBASE-12078_1.patch Add testcase to TestPrefixTreeSearcher. Missing Data when scanning

[jira] [Commented] (HBASE-10087) Store should be locked during a memstore snapshot

2014-10-08 Thread zhangduo (JIRA)
[ https://issues.apache.org/jira/browse/HBASE-10087?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14163290#comment-14163290 ] zhangduo commented on HBASE-10087: -- I think the lock here is not used to prevent

[jira] [Updated] (HBASE-10201) Port 'Make flush decisions per column family' to trunk

2014-10-12 Thread zhangduo (JIRA)
[ https://issues.apache.org/jira/browse/HBASE-10201?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] zhangduo updated HBASE-10201: - Attachment: HBASE-10201-0.98.patch I port the 3149-trunk-v1.txt patch to branch 0.98(a just make it work

[jira] [Updated] (HBASE-10201) Port 'Make flush decisions per column family' to trunk

2014-10-14 Thread zhangduo (JIRA)
[ https://issues.apache.org/jira/browse/HBASE-10201?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] zhangduo updated HBASE-10201: - Attachment: HBASE-10201-0.98_1.patch According to Ted Yu's suggestion, add a testcase called

[jira] [Updated] (HBASE-10201) Port 'Make flush decisions per column family' to trunk

2014-10-14 Thread zhangduo (JIRA)
[ https://issues.apache.org/jira/browse/HBASE-10201?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] zhangduo updated HBASE-10201: - Attachment: HBASE-10201-0.98_2.patch Running with TestPerColumnFamilyFlush. 3 CFs, 16B value for CF1,

[jira] [Commented] (HBASE-10201) Port 'Make flush decisions per column family' to trunk

2014-10-15 Thread zhangduo (JIRA)
[ https://issues.apache.org/jira/browse/HBASE-10201?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14172250#comment-14172250 ] zhangduo commented on HBASE-10201: -- Run the same benchmark on a 3 regionservers

[jira] [Commented] (HBASE-10201) Port 'Make flush decisions per column family' to trunk

2014-10-19 Thread zhangduo (JIRA)
[ https://issues.apache.org/jira/browse/HBASE-10201?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14176532#comment-14176532 ] zhangduo commented on HBASE-10201: -- [~saint@gmail.com], [~eclark], [~eclark] excuse

[jira] [Commented] (HBASE-10201) Port 'Make flush decisions per column family' to trunk

2014-10-19 Thread zhangduo (JIRA)
[ https://issues.apache.org/jira/browse/HBASE-10201?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14176543#comment-14176543 ] zhangduo commented on HBASE-10201: -- sorry, should be [~stack] Port 'Make flush

[jira] [Commented] (HBASE-10201) Port 'Make flush decisions per column family' to trunk

2014-10-21 Thread zhangduo (JIRA)
[ https://issues.apache.org/jira/browse/HBASE-10201?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14179383#comment-14179383 ] zhangduo commented on HBASE-10201: -- [~gaurav.menghani] excuse me, I need some help of

[jira] [Commented] (HBASE-10201) Port 'Make flush decisions per column family' to trunk

2014-10-21 Thread zhangduo (JIRA)
[ https://issues.apache.org/jira/browse/HBASE-10201?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14179391#comment-14179391 ] zhangduo commented on HBASE-10201: -- just using numBytesCompactedCount/storeFileSize

[jira] [Commented] (HBASE-10201) Port 'Make flush decisions per column family' to trunk

2014-10-21 Thread zhangduo (JIRA)
[ https://issues.apache.org/jira/browse/HBASE-10201?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14179413#comment-14179413 ] zhangduo commented on HBASE-10201: -- The original patch is created about one year ago, so

[jira] [Commented] (HBASE-10201) Port 'Make flush decisions per column family' to trunk

2014-10-22 Thread zhangduo (JIRA)
[ https://issues.apache.org/jira/browse/HBASE-10201?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14179803#comment-14179803 ] zhangduo commented on HBASE-10201: -- After reading master's FSHLog carefully, I found

[jira] [Updated] (HBASE-10201) Port 'Make flush decisions per column family' to trunk

2014-10-27 Thread zhangduo (JIRA)
[ https://issues.apache.org/jira/browse/HBASE-10201?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] zhangduo updated HBASE-10201: - Attachment: HBASE-10201.patch Sorry I was wrong, getSequenceId in HLogKey will block until logSeqNum is

[jira] [Commented] (HBASE-10201) Port 'Make flush decisions per column family' to trunk

2014-10-27 Thread zhangduo (JIRA)
[ https://issues.apache.org/jira/browse/HBASE-10201?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14185013#comment-14185013 ] zhangduo commented on HBASE-10201: -- This step must be done here unless we change the

[jira] [Commented] (HBASE-10201) Port 'Make flush decisions per column family' to trunk

2014-10-27 Thread zhangduo (JIRA)
[ https://issues.apache.org/jira/browse/HBASE-10201?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14185023#comment-14185023 ] zhangduo commented on HBASE-10201: -- oh, I think there is a trick to optimize it. In

[jira] [Commented] (HBASE-10201) Port 'Make flush decisions per column family' to trunk

2014-10-27 Thread zhangduo (JIRA)
[ https://issues.apache.org/jira/browse/HBASE-10201?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14185050#comment-14185050 ] zhangduo commented on HBASE-10201: -- The original patch store the value in memstore so I

[jira] [Updated] (HBASE-10201) Port 'Make flush decisions per column family' to trunk

2014-10-27 Thread zhangduo (JIRA)
[ https://issues.apache.org/jira/browse/HBASE-10201?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] zhangduo updated HBASE-10201: - Attachment: HBASE-10201_1.patch Modified according to [~anoop.hbase] 's suggestion. Add a

[jira] [Updated] (HBASE-10201) Port 'Make flush decisions per column family' to trunk

2014-10-28 Thread zhangduo (JIRA)
[ https://issues.apache.org/jira/browse/HBASE-10201?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] zhangduo updated HBASE-10201: - Attachment: HBASE-10201_2.patch fix some typo rename some methods and fields use AtomicUtils.updateMin

[jira] [Commented] (HBASE-10201) Port 'Make flush decisions per column family' to trunk

2014-10-28 Thread zhangduo (JIRA)
[ https://issues.apache.org/jira/browse/HBASE-10201?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14186735#comment-14186735 ] zhangduo commented on HBASE-10201: -- {quote} Oh, seems like this is lower bound. Only

[jira] [Updated] (HBASE-10201) Port 'Make flush decisions per column family' to trunk

2014-10-28 Thread zhangduo (JIRA)
[ https://issues.apache.org/jira/browse/HBASE-10201?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] zhangduo updated HBASE-10201: - Attachment: HBASE-10201_3.patch Wrap lines. Port 'Make flush decisions per column family' to trunk

[jira] [Updated] (HBASE-10201) Port 'Make flush decisions per column family' to trunk

2014-10-28 Thread zhangduo (JIRA)
[ https://issues.apache.org/jira/browse/HBASE-10201?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] zhangduo updated HBASE-10201: - Attachment: HBASE-10201-0.99.patch Backport to branch-1. [~enis] I tried but failed to make

[jira] [Commented] (HBASE-10201) Port 'Make flush decisions per column family' to trunk

2014-10-29 Thread zhangduo (JIRA)
[ https://issues.apache.org/jira/browse/HBASE-10201?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14188093#comment-14188093 ] zhangduo commented on HBASE-10201: -- {quote} Out of interest, are you using the hbase

[jira] [Commented] (HBASE-10201) Port 'Make flush decisions per column family' to trunk

2014-10-29 Thread zhangduo (JIRA)
[ https://issues.apache.org/jira/browse/HBASE-10201?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14189517#comment-14189517 ] zhangduo commented on HBASE-10201: -- Yes, I run without the patch first, the result is

[jira] [Commented] (HBASE-10201) Port 'Make flush decisions per column family' to trunk

2014-10-30 Thread zhangduo (JIRA)
[ https://issues.apache.org/jira/browse/HBASE-10201?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14191091#comment-14191091 ] zhangduo commented on HBASE-10201: -- {quote} Sequenceids are region scoped. If we flush

[jira] [Updated] (HBASE-10201) Port 'Make flush decisions per column family' to trunk

2014-10-30 Thread zhangduo (JIRA)
[ https://issues.apache.org/jira/browse/HBASE-10201?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] zhangduo updated HBASE-10201: - Attachment: HBASE-10201_4.patch Port 'Make flush decisions per column family' to trunk

[jira] [Updated] (HBASE-10201) Port 'Make flush decisions per column family' to trunk

2014-10-30 Thread zhangduo (JIRA)
[ https://issues.apache.org/jira/browse/HBASE-10201?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] zhangduo updated HBASE-10201: - Attachment: HBASE-10201_5.patch rebase since master's HEAD has been moved. Port 'Make flush decisions

[jira] [Created] (HBASE-12405) WAL accounting by Store

2014-10-31 Thread zhangduo (JIRA)
zhangduo created HBASE-12405: Summary: WAL accounting by Store Key: HBASE-12405 URL: https://issues.apache.org/jira/browse/HBASE-12405 Project: HBase Issue Type: Improvement

[jira] [Updated] (HBASE-12405) WAL accounting by Store

2014-10-31 Thread zhangduo (JIRA)
[ https://issues.apache.org/jira/browse/HBASE-12405?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] zhangduo updated HBASE-12405: - Description: HBASE-10201 has made flush decisions per Store, but has not done enough work on HLog, so

[jira] [Updated] (HBASE-12405) WAL accounting by Store

2014-10-31 Thread zhangduo (JIRA)
[ https://issues.apache.org/jira/browse/HBASE-12405?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] zhangduo updated HBASE-12405: - Description: HBASE-10201 has made flush decisions per Store, but has not done enough work on HLog, so

[jira] [Updated] (HBASE-12405) WAL accounting by Store

2014-11-01 Thread zhangduo (JIRA)
[ https://issues.apache.org/jira/browse/HBASE-12405?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] zhangduo updated HBASE-12405: - Description: HBASE-10201 has made flush decisions per Store, but has not done enough work on HLog, so

[jira] [Commented] (HBASE-10201) Port 'Make flush decisions per column family' to trunk

2014-11-05 Thread zhangduo (JIRA)
[ https://issues.apache.org/jira/browse/HBASE-10201?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14198501#comment-14198501 ] zhangduo commented on HBASE-10201: -- No, I have not run the test on master branch yet. I

[jira] [Commented] (HBASE-10201) Port 'Make flush decisions per column family' to trunk

2014-11-05 Thread zhangduo (JIRA)
[ https://issues.apache.org/jira/browse/HBASE-10201?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14199822#comment-14199822 ] zhangduo commented on HBASE-10201: -- Results on master branch 2.0.0-SNAPSHOT,

[jira] [Commented] (HBASE-12451) IncreasingToUpperBoundRegionSplitPolicy may cause unnecessary region splits in rolling update of cluster

2014-11-10 Thread zhangduo (JIRA)
[ https://issues.apache.org/jira/browse/HBASE-12451?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14204741#comment-14204741 ] zhangduo commented on HBASE-12451: -- Setting minimum split size will delay the first

[jira] [Commented] (HBASE-12451) IncreasingToUpperBoundRegionSplitPolicy may cause unnecessary region splits in rolling update of cluster

2014-11-10 Thread zhangduo (JIRA)
[ https://issues.apache.org/jira/browse/HBASE-12451?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14205866#comment-14205866 ] zhangduo commented on HBASE-12451: -- I think there is a upper limit also, so the size

[jira] [Commented] (HBASE-12451) IncreasingToUpperBoundRegionSplitPolicy may cause unnecessary region splits in rolling update of cluster

2014-11-10 Thread zhangduo (JIRA)
[ https://issues.apache.org/jira/browse/HBASE-12451?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14206072#comment-14206072 ] zhangduo commented on HBASE-12451: -- {quote} the regions should be evenly spread across

[jira] [Commented] (HBASE-12451) IncreasingToUpperBoundRegionSplitPolicy may cause unnecessary region splits in rolling update of cluster

2014-11-11 Thread zhangduo (JIRA)
[ https://issues.apache.org/jira/browse/HBASE-12451?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14206394#comment-14206394 ] zhangduo commented on HBASE-12451: -- {quote} 1. Using the average region num of the table

[jira] [Updated] (HBASE-8329) Limit compaction speed

2014-11-11 Thread zhangduo (JIRA)
[ https://issues.apache.org/jira/browse/HBASE-8329?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] zhangduo updated HBASE-8329: Attachment: HBASE-8329-10.patch Seems the patch is generate using svn so git apply does not work... I port

[jira] [Updated] (HBASE-8329) Limit compaction speed

2014-11-11 Thread zhangduo (JIRA)
[ https://issues.apache.org/jira/browse/HBASE-8329?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] zhangduo updated HBASE-8329: Attachment: HBASE-8329-11.patch typo, sorry Limit compaction speed --

[jira] [Commented] (HBASE-8329) Limit compaction speed

2014-11-11 Thread zhangduo (JIRA)
[ https://issues.apache.org/jira/browse/HBASE-8329?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14207629#comment-14207629 ] zhangduo commented on HBASE-8329: - And I think we always need to limit compaction speed in

[jira] [Updated] (HBASE-8329) Limit compaction speed

2014-11-11 Thread zhangduo (JIRA)
[ https://issues.apache.org/jira/browse/HBASE-8329?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] zhangduo updated HBASE-8329: Attachment: HBASE-8329-12.patch Limit compaction speed -- Key:

[jira] [Updated] (HBASE-10201) Port 'Make flush decisions per column family' to trunk

2014-11-11 Thread zhangduo (JIRA)
[ https://issues.apache.org/jira/browse/HBASE-10201?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] zhangduo updated HBASE-10201: - Attachment: HBASE-10201_6.patch plan to start working on HBASE-12405, so rebase this patch to the latest

[jira] [Commented] (HBASE-12463) MemstoreLAB reduce #objects created

2014-11-12 Thread zhangduo (JIRA)
[ https://issues.apache.org/jira/browse/HBASE-12463?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14208021#comment-14208021 ] zhangduo commented on HBASE-12463: -- I think we need to add Do not cache return value to

[jira] [Commented] (HBASE-10201) Port 'Make flush decisions per column family' to trunk

2014-11-12 Thread zhangduo (JIRA)
[ https://issues.apache.org/jira/browse/HBASE-10201?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14208962#comment-14208962 ] zhangduo commented on HBASE-10201: -- I used to think this should go into master first as

[jira] [Commented] (HBASE-12451) IncreasingToUpperBoundRegionSplitPolicy may cause unnecessary region splits in rolling update of cluster

2014-11-14 Thread zhangduo (JIRA)
[ https://issues.apache.org/jira/browse/HBASE-12451?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14212024#comment-14212024 ] zhangduo commented on HBASE-12451: -- I think the goal of

[jira] [Commented] (HBASE-12451) IncreasingToUpperBoundRegionSplitPolicy may cause unnecessary region splits in rolling update of cluster

2014-11-14 Thread zhangduo (JIRA)
[ https://issues.apache.org/jira/browse/HBASE-12451?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14212067#comment-14212067 ] zhangduo commented on HBASE-12451: -- [~tianq] Can ConstantSizeSplitPolicy meet your

[jira] [Updated] (HBASE-10201) Port 'Make flush decisions per column family' to trunk

2014-11-17 Thread zhangduo (JIRA)
[ https://issues.apache.org/jira/browse/HBASE-10201?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] zhangduo updated HBASE-10201: - Attachment: HBASE-10201_7.patch Seems HBASE-12405 must be evaluated by HBASE-10201, so I combined the

[jira] [Commented] (HBASE-10201) Port 'Make flush decisions per column family' to trunk

2014-11-17 Thread zhangduo (JIRA)
[ https://issues.apache.org/jira/browse/HBASE-10201?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14215472#comment-14215472 ] zhangduo commented on HBASE-10201: -- {quote} Can you briefly describe the addition in

[jira] [Commented] (HBASE-10201) Port 'Make flush decisions per column family' to trunk

2014-11-17 Thread zhangduo (JIRA)
[ https://issues.apache.org/jira/browse/HBASE-10201?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14215501#comment-14215501 ] zhangduo commented on HBASE-10201: -- {quote} You could do something like Gaurav Menghani

[jira] [Updated] (HBASE-10201) Port 'Make flush decisions per column family' to trunk

2014-11-17 Thread zhangduo (JIRA)
[ https://issues.apache.org/jira/browse/HBASE-10201?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] zhangduo updated HBASE-10201: - Attachment: HBASE-10201_8.patch The pressure on log truncating is solved by LogRoller and we already

[jira] [Commented] (HBASE-10201) Port 'Make flush decisions per column family' to trunk

2014-11-17 Thread zhangduo (JIRA)
[ https://issues.apache.org/jira/browse/HBASE-10201?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14215740#comment-14215740 ] zhangduo commented on HBASE-10201: -- {quote} To be clear, you are suggesting that we

[jira] [Updated] (HBASE-10201) Port 'Make flush decisions per column family' to trunk

2014-11-20 Thread zhangduo (JIRA)
[ https://issues.apache.org/jira/browse/HBASE-10201?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] zhangduo updated HBASE-10201: - Attachment: HBASE-10201_9.patch rebase for WAL refactoring Port 'Make flush decisions per column

[jira] [Updated] (HBASE-10201) Port 'Make flush decisions per column family' to trunk

2014-11-21 Thread zhangduo (JIRA)
[ https://issues.apache.org/jira/browse/HBASE-10201?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] zhangduo updated HBASE-10201: - Attachment: HBASE-10201_10.patch [~busbey]'s comment on rb Port 'Make flush decisions per column

[jira] [Commented] (HBASE-12588) Need to fail writes when row lock can't be acquired

2014-11-26 Thread zhangduo (JIRA)
[ https://issues.apache.org/jira/browse/HBASE-12588?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14227059#comment-14227059 ] zhangduo commented on HBASE-12588: -- I think doMiniBatchMutation will not apply rows that

[jira] [Updated] (HBASE-10201) Port 'Make flush decisions per column family' to trunk

2014-11-27 Thread zhangduo (JIRA)
[ https://issues.apache.org/jira/browse/HBASE-10201?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] zhangduo updated HBASE-10201: - Attachment: HBASE-10201_11.patch rebase and some simple change Port 'Make flush decisions per column

[jira] [Commented] (HBASE-12588) Need to fail writes when row lock can't be acquired

2014-11-29 Thread zhangduo (JIRA)
[ https://issues.apache.org/jira/browse/HBASE-12588?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14228991#comment-14228991 ] zhangduo commented on HBASE-12588: -- [~stack] Maybe we need to call mutateRowsWithLocks

[jira] [Updated] (HBASE-10201) Port 'Make flush decisions per column family' to trunk

2014-12-01 Thread zhangduo (JIRA)
[ https://issues.apache.org/jira/browse/HBASE-10201?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] zhangduo updated HBASE-10201: - Attachment: HBASE-10201_12.patch [~tedyu]'s comments on rb Port 'Make flush decisions per column

[jira] [Updated] (HBASE-10201) Port 'Make flush decisions per column family' to trunk

2014-12-04 Thread zhangduo (JIRA)
[ https://issues.apache.org/jira/browse/HBASE-10201?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] zhangduo updated HBASE-10201: - Attachment: HBASE-10201_13.patch Use a FlushPolicy instead of

[jira] [Commented] (HBASE-10201) Port 'Make flush decisions per column family' to trunk

2014-12-04 Thread zhangduo (JIRA)
[ https://issues.apache.org/jira/browse/HBASE-10201?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14234975#comment-14234975 ] zhangduo commented on HBASE-10201: -- {quote} Suggest you drop memstore from the names of

[jira] [Updated] (HBASE-10201) Port 'Make flush decisions per column family' to trunk

2014-12-05 Thread zhangduo (JIRA)
[ https://issues.apache.org/jira/browse/HBASE-10201?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] zhangduo updated HBASE-10201: - Attachment: HBASE-10201_14.patch Ted Yu's suggestion on rb. Fix typo, add FlushPolicyFactory. Port

[jira] [Commented] (HBASE-10201) Port 'Make flush decisions per column family' to trunk

2014-12-05 Thread zhangduo (JIRA)
[ https://issues.apache.org/jira/browse/HBASE-10201?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14236647#comment-14236647 ] zhangduo commented on HBASE-10201: -- {quote} I see less compactions and less hfiles (so

[jira] [Updated] (HBASE-10201) Port 'Make flush decisions per column family' to trunk

2014-12-07 Thread zhangduo (JIRA)
[ https://issues.apache.org/jira/browse/HBASE-10201?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] zhangduo updated HBASE-10201: - Attachment: (was: HBASE-10201_14.patch) Port 'Make flush decisions per column family' to trunk

[jira] [Updated] (HBASE-10201) Port 'Make flush decisions per column family' to trunk

2014-12-07 Thread zhangduo (JIRA)
[ https://issues.apache.org/jira/browse/HBASE-10201?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] zhangduo updated HBASE-10201: - Attachment: HBASE-10201_14.patch Seems previous hadoop QA run was exited abnormally. Rebase and retry.

[jira] [Updated] (HBASE-10201) Port 'Make flush decisions per column family' to trunk

2014-12-07 Thread zhangduo (JIRA)
[ https://issues.apache.org/jira/browse/HBASE-10201?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] zhangduo updated HBASE-10201: - Attachment: HBASE-10201_15.patch fix a javadoc issue. Port 'Make flush decisions per column family' to

[jira] [Updated] (HBASE-10201) Port 'Make flush decisions per column family' to trunk

2014-12-07 Thread zhangduo (JIRA)
[ https://issues.apache.org/jira/browse/HBASE-10201?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] zhangduo updated HBASE-10201: - Attachment: HBASE-10201_16.patch trivial change to remove javadoc warnings Port 'Make flush decisions

[jira] [Updated] (HBASE-10201) Port 'Make flush decisions per column family' to trunk

2014-12-07 Thread zhangduo (JIRA)
[ https://issues.apache.org/jira/browse/HBASE-10201?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] zhangduo updated HBASE-10201: - Attachment: HBASE-10201_17.patch line length Port 'Make flush decisions per column family' to trunk

[jira] [Commented] (HBASE-10201) Port 'Make flush decisions per column family' to trunk

2014-12-08 Thread zhangduo (JIRA)
[ https://issues.apache.org/jira/browse/HBASE-10201?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14239084#comment-14239084 ] zhangduo commented on HBASE-10201: -- [~stack] I followed RegionSplitPolicy to write

[jira] [Commented] (HBASE-10201) Port 'Make flush decisions per column family' to trunk

2014-12-09 Thread zhangduo (JIRA)
[ https://issues.apache.org/jira/browse/HBASE-10201?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14240419#comment-14240419 ] zhangduo commented on HBASE-10201: -- {quote} 1) There may be a correctness issue for same

[jira] [Commented] (HBASE-10201) Port 'Make flush decisions per column family' to trunk

2014-12-09 Thread zhangduo (JIRA)
[ https://issues.apache.org/jira/browse/HBASE-10201?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14240436#comment-14240436 ] zhangduo commented on HBASE-10201: -- {quote} OK. Its his fault then. {quote} It's not his

[jira] [Commented] (HBASE-10201) Port 'Make flush decisions per column family' to trunk

2014-12-09 Thread zhangduo (JIRA)
[ https://issues.apache.org/jira/browse/HBASE-10201?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14240528#comment-14240528 ] zhangduo commented on HBASE-10201: -- [~jeffreyz] I think flushSeqId is ambiguous here. We

[jira] [Commented] (HBASE-10201) Port 'Make flush decisions per column family' to trunk

2014-12-09 Thread zhangduo (JIRA)
[ https://issues.apache.org/jira/browse/HBASE-10201?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14240568#comment-14240568 ] zhangduo commented on HBASE-10201: -- {quote} You don't have to change this because log

[jira] [Commented] (HBASE-10201) Port 'Make flush decisions per column family' to trunk

2014-12-09 Thread zhangduo (JIRA)
[ https://issues.apache.org/jira/browse/HBASE-10201?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14240619#comment-14240619 ] zhangduo commented on HBASE-10201: -- Oh, after digging into the code I found that the

[jira] [Commented] (HBASE-10201) Port 'Make flush decisions per column family' to trunk

2014-12-09 Thread zhangduo (JIRA)
[ https://issues.apache.org/jira/browse/HBASE-10201?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14240754#comment-14240754 ] zhangduo commented on HBASE-10201: -- {quote} 3. is a 'known' cost. Good to know that DLR

[jira] [Commented] (HBASE-10201) Port 'Make flush decisions per column family' to trunk

2014-12-09 Thread zhangduo (JIRA)
[ https://issues.apache.org/jira/browse/HBASE-10201?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14240779#comment-14240779 ] zhangduo commented on HBASE-10201: -- {quote} 2) We have a feature where we force a flush

[jira] [Updated] (HBASE-10201) Port 'Make flush decisions per column family' to trunk

2014-12-10 Thread zhangduo (JIRA)
[ https://issues.apache.org/jira/browse/HBASE-10201?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] zhangduo updated HBASE-10201: - Attachment: HBASE-10201_18.patch Rename lastFlushSeqId to maxFlushedSeqId in HRegion. Always generate a

[jira] [Commented] (HBASE-10201) Port 'Make flush decisions per column family' to trunk

2014-12-10 Thread zhangduo (JIRA)
[ https://issues.apache.org/jira/browse/HBASE-10201?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14241121#comment-14241121 ] zhangduo commented on HBASE-10201: -- I ran the performance test in

[jira] [Commented] (HBASE-10201) Port 'Make flush decisions per column family' to trunk

2014-12-10 Thread zhangduo (JIRA)
[ https://issues.apache.org/jira/browse/HBASE-10201?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14241985#comment-14241985 ] zhangduo commented on HBASE-10201: -- {quote} but anyway we should maintain the semantics

[jira] [Commented] (HBASE-10201) Port 'Make flush decisions per column family' to trunk

2014-12-11 Thread zhangduo (JIRA)
[ https://issues.apache.org/jira/browse/HBASE-10201?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14243610#comment-14243610 ] zhangduo commented on HBASE-10201: -- [~stack] In your scenario, I think we will use #1 to

[jira] [Commented] (HBASE-10201) Port 'Make flush decisions per column family' to trunk

2014-12-11 Thread zhangduo (JIRA)
[ https://issues.apache.org/jira/browse/HBASE-10201?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14243728#comment-14243728 ] zhangduo commented on HBASE-10201: -- {quote} I'm wondering how to make a unit test.

[jira] [Updated] (HBASE-10201) Port 'Make flush decisions per column family' to trunk

2014-12-12 Thread zhangduo (JIRA)
[ https://issues.apache.org/jira/browse/HBASE-10201?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] zhangduo updated HBASE-10201: - Attachment: HBASE-10201_19.patch Addressed the issue on rb Port 'Make flush decisions per column

[jira] [Updated] (HBASE-10201) Port 'Make flush decisions per column family' to trunk

2014-12-12 Thread zhangduo (JIRA)
[ https://issues.apache.org/jira/browse/HBASE-10201?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] zhangduo updated HBASE-10201: - Attachment: (was: HBASE-10201_19.patch) Port 'Make flush decisions per column family' to trunk

[jira] [Updated] (HBASE-10201) Port 'Make flush decisions per column family' to trunk

2014-12-12 Thread zhangduo (JIRA)
[ https://issues.apache.org/jira/browse/HBASE-10201?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] zhangduo updated HBASE-10201: - Attachment: HBASE-10201_19.patch Port 'Make flush decisions per column family' to trunk

[jira] [Commented] (HBASE-10201) Port 'Make flush decisions per column family' to trunk

2014-12-16 Thread zhangduo (JIRA)
[ https://issues.apache.org/jira/browse/HBASE-10201?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14249199#comment-14249199 ] zhangduo commented on HBASE-10201: -- {quote} I forgot to say thank you zhangduo for your

[jira] [Commented] (HBASE-8329) Limit compaction speed

2014-12-17 Thread zhangduo (JIRA)
[ https://issues.apache.org/jira/browse/HBASE-8329?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14251252#comment-14251252 ] zhangduo commented on HBASE-8329: - I met the problem recently. Sometimes Compaction

[jira] [Commented] (HBASE-12713) IncreasingToUpperBoundRegionSplitPolicy invalid when region count greater than 100

2014-12-17 Thread zhangduo (JIRA)
[ https://issues.apache.org/jira/browse/HBASE-12713?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14251324#comment-14251324 ] zhangduo commented on HBASE-12713: -- maybe something like HBASE-12451?

[jira] [Created] (HBASE-12715) Should pass regionName to HRegionServer.getLastSequenceId instead of encodedRegionName

2014-12-18 Thread zhangduo (JIRA)
zhangduo created HBASE-12715: Summary: Should pass regionName to HRegionServer.getLastSequenceId instead of encodedRegionName Key: HBASE-12715 URL: https://issues.apache.org/jira/browse/HBASE-12715

[jira] [Updated] (HBASE-12715) Should pass regionName to HRegionServer.getLastSequenceId instead of encodedRegionName

2014-12-18 Thread zhangduo (JIRA)
[ https://issues.apache.org/jira/browse/HBASE-12715?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] zhangduo updated HBASE-12715: - Description: When addressing HBASE-12405 I found that LastSequenceId.getLastSequenceId(it is renamed in

[jira] [Commented] (HBASE-12715) Should pass regionName to HRegionServer.getLastSequenceId instead of encodedRegionName

2014-12-18 Thread zhangduo (JIRA)
[ https://issues.apache.org/jira/browse/HBASE-12715?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14251579#comment-14251579 ] zhangduo commented on HBASE-12715: -- Seems that HLogKey does not have a getRegionName

[jira] [Commented] (HBASE-12713) IncreasingToUpperBoundRegionSplitPolicy invalid when region count greater than 100

2014-12-18 Thread zhangduo (JIRA)
[ https://issues.apache.org/jira/browse/HBASE-12713?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14252597#comment-14252597 ] zhangduo commented on HBASE-12713: -- {quote} I find that the policy of region split which

  1   2   3   4   5   6   >