[jira] [Commented] (HBASE-14906) Improvements on FlushLargeStoresPolicy

2015-12-03 Thread Yu Li (JIRA)
[ https://issues.apache.org/jira/browse/HBASE-14906?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=15039665#comment-15039665 ] Yu Li commented on HBASE-14906: --- Thanks for the review and comments Duo! > Improvements on

[jira] [Commented] (HBASE-14790) Implement a new DFSOutputStream for logging WAL only

2015-12-04 Thread Yu Li (JIRA)
[ https://issues.apache.org/jira/browse/HBASE-14790?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=15041761#comment-15041761 ] Yu Li commented on HBASE-14790: --- bq. hsync periodically, for example, default per 1000ms AF

[jira] [Commented] (HBASE-14004) [Replication] Inconsistency between Memstore and WAL may result in data in remote cluster that is not in the origin

2015-12-05 Thread Yu Li (JIRA)
[ https://issues.apache.org/jira/browse/HBASE-14004?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=15043721#comment-15043721 ] Yu Li commented on HBASE-14004: --- Nice discussion [~yangzhe1991] and [~Apache9]. FWIW, two

[jira] [Commented] (HBASE-14906) Improvements on FlushLargeStoresPolicy

2015-12-06 Thread Yu Li (JIRA)
[ https://issues.apache.org/jira/browse/HBASE-14906?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=15043916#comment-15043916 ] Yu Li commented on HBASE-14906: --- [~stack] and [~gaurav.menghani], any comments on this one?

[jira] [Commented] (HBASE-14004) [Replication] Inconsistency between Memstore and WAL may result in data in remote cluster that is not in the origin

2015-12-06 Thread Yu Li (JIRA)
[ https://issues.apache.org/jira/browse/HBASE-14004?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=15044355#comment-15044355 ] Yu Li commented on HBASE-14004: --- bq. if we add a hsync logic, will there be degradation of

[jira] [Commented] (HBASE-14004) [Replication] Inconsistency between Memstore and WAL may result in data in remote cluster that is not in the origin

2015-12-07 Thread Yu Li (JIRA)
[ https://issues.apache.org/jira/browse/HBASE-14004?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=15046226#comment-15046226 ] Yu Li commented on HBASE-14004: --- bq. My idea may be more fast because it needn't send reque

[jira] [Commented] (HBASE-14004) [Replication] Inconsistency between Memstore and WAL may result in data in remote cluster that is not in the origin

2015-12-07 Thread Yu Li (JIRA)
[ https://issues.apache.org/jira/browse/HBASE-14004?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=15046371#comment-15046371 ] Yu Li commented on HBASE-14004: --- It seems to me that replication queue only records where t

[jira] [Commented] (HBASE-14004) [Replication] Inconsistency between Memstore and WAL may result in data in remote cluster that is not in the origin

2015-12-07 Thread Yu Li (JIRA)
[ https://issues.apache.org/jira/browse/HBASE-14004?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=15046385#comment-15046385 ] Yu Li commented on HBASE-14004: --- Assume this situation: 1. RS received an ack from DFSClien

[jira] [Commented] (HBASE-14004) [Replication] Inconsistency between Memstore and WAL may result in data in remote cluster that is not in the origin

2015-12-07 Thread Yu Li (JIRA)
[ https://issues.apache.org/jira/browse/HBASE-14004?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=15046401#comment-15046401 ] Yu Li commented on HBASE-14004: --- bq. then the file will finally be closed by NN I don't thi

[jira] [Commented] (HBASE-14004) [Replication] Inconsistency between Memstore and WAL may result in data in remote cluster that is not in the origin

2015-12-07 Thread Yu Li (JIRA)
[ https://issues.apache.org/jira/browse/HBASE-14004?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=15046439#comment-15046439 ] Yu Li commented on HBASE-14004: --- bq. HBase uses NN to do fencing which means HMaster will o

[jira] [Commented] (HBASE-14004) [Replication] Inconsistency between Memstore and WAL may result in data in remote cluster that is not in the origin

2015-12-07 Thread Yu Li (JIRA)
[ https://issues.apache.org/jira/browse/HBASE-14004?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=15046475#comment-15046475 ] Yu Li commented on HBASE-14004: --- You are right Heng, and Duo also explained about this. Tha

[jira] [Commented] (HBASE-4830) Regionserver BLOCKED on WAITING DFSClient$DFSOutputStream.waitForAckedSeqno running 0.20.205.0+

2015-12-08 Thread Yu Li (JIRA)
[ https://issues.apache.org/jira/browse/HBASE-4830?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=15046571#comment-15046571 ] Yu Li commented on HBASE-4830: -- [~stack] two of our online machines met with OOME and aborted

[jira] [Commented] (HBASE-14004) [Replication] Inconsistency between Memstore and WAL may result in data in remote cluster that is not in the origin

2015-12-10 Thread Yu Li (JIRA)
[ https://issues.apache.org/jira/browse/HBASE-14004?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=15050322#comment-15050322 ] Yu Li commented on HBASE-14004: --- bq. Yu, is it still a problem after we not using hsync? My

[jira] [Commented] (HBASE-14004) [Replication] Inconsistency between Memstore and WAL may result in data in remote cluster that is not in the origin

2015-12-10 Thread Yu Li (JIRA)
[ https://issues.apache.org/jira/browse/HBASE-14004?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=15050409#comment-15050409 ] Yu Li commented on HBASE-14004: --- Let me confirm, do you mean we never rollback the memstore

[jira] [Commented] (HBASE-14906) Improvements on FlushLargeStoresPolicy

2015-12-10 Thread Yu Li (JIRA)
[ https://issues.apache.org/jira/browse/HBASE-14906?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=15051291#comment-15051291 ] Yu Li commented on HBASE-14906: --- Ping [~stack] [~Apache9] :-) > Improvements on FlushLarge

[jira] [Commented] (HBASE-14906) Improvements on FlushLargeStoresPolicy

2015-12-10 Thread Yu Li (JIRA)
[ https://issues.apache.org/jira/browse/HBASE-14906?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=15052062#comment-15052062 ] Yu Li commented on HBASE-14906: --- Thanks for help review and commit sir! [~stack] > Improve

[jira] [Created] (HBASE-14969) Add throughput controller for flush

2015-12-12 Thread Yu Li (JIRA)
Yu Li created HBASE-14969: - Summary: Add throughput controller for flush Key: HBASE-14969 URL: https://issues.apache.org/jira/browse/HBASE-14969 Project: HBase Issue Type: Improvement Affects Ver

[jira] [Updated] (HBASE-14969) Add throughput controller for flush

2015-12-12 Thread Yu Li (JIRA)
[ https://issues.apache.org/jira/browse/HBASE-14969?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Yu Li updated HBASE-14969: -- Attachment: HBASE-14969.patch Attaching the initial patch Since the main control logic is the same with compac

[jira] [Commented] (HBASE-14969) Add throughput controller for flush

2015-12-17 Thread Yu Li (JIRA)
[ https://issues.apache.org/jira/browse/HBASE-14969?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=15063370#comment-15063370 ] Yu Li commented on HBASE-14969: --- Thanks [~Apache9] for the follow up. bq. do you have some

[jira] [Commented] (HBASE-14306) Refine RegionGroupingProvider: fix issues and make it more scalable

2015-12-17 Thread Yu Li (JIRA)
[ https://issues.apache.org/jira/browse/HBASE-14306?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=15063645#comment-15063645 ] Yu Li commented on HBASE-14306: --- bq. please add a release note that folks relying specifyin

[jira] [Updated] (HBASE-14306) Refine RegionGroupingProvider: fix issues and make it more scalable

2015-12-17 Thread Yu Li (JIRA)
[ https://issues.apache.org/jira/browse/HBASE-14306?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Yu Li updated HBASE-14306: -- Release Note: In HBASE-14306 we've changed default strategy of RegionGroupingProvider from "identify" to "bound

[jira] [Commented] (HBASE-14306) Refine RegionGroupingProvider: fix issues and make it more scalable

2015-12-17 Thread Yu Li (JIRA)
[ https://issues.apache.org/jira/browse/HBASE-14306?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=15063653#comment-15063653 ] Yu Li commented on HBASE-14306: --- Release note added per above comments, please review and l

[jira] [Updated] (HBASE-14306) Refine RegionGroupingProvider: fix issues and make it more scalable

2015-12-22 Thread Yu Li (JIRA)
[ https://issues.apache.org/jira/browse/HBASE-14306?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Yu Li updated HBASE-14306: -- Release Note: In HBASE-14306 we've changed default strategy of RegionGroupingProvider from "identify" to "boun

[jira] [Created] (HBASE-15028) Minor fix on RegionGroupingProvider

2015-12-22 Thread Yu Li (JIRA)
Yu Li created HBASE-15028: - Summary: Minor fix on RegionGroupingProvider Key: HBASE-15028 URL: https://issues.apache.org/jira/browse/HBASE-15028 Project: HBase Issue Type: Bug Components: w

[jira] [Updated] (HBASE-15028) Minor fix on RegionGroupingProvider

2015-12-22 Thread Yu Li (JIRA)
[ https://issues.apache.org/jira/browse/HBASE-15028?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Yu Li updated HBASE-15028: -- Fix Version/s: 1.3.0 2.0.0 Status: Patch Available (was: Open) > Minor fix on Re

[jira] [Updated] (HBASE-15028) Minor fix on RegionGroupingProvider

2015-12-22 Thread Yu Li (JIRA)
[ https://issues.apache.org/jira/browse/HBASE-15028?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Yu Li updated HBASE-15028: -- Attachment: HBASE-15028.patch A straight forward patch > Minor fix on RegionGroupingProvider > ---

[jira] [Commented] (HBASE-14969) Add throughput controller for flush

2015-12-22 Thread Yu Li (JIRA)
[ https://issues.apache.org/jira/browse/HBASE-14969?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=15067930#comment-15067930 ] Yu Li commented on HBASE-14969: --- The javadoc issue is not introduced by this JIRA and alrea

[jira] [Commented] (HBASE-15028) Minor fix on RegionGroupingProvider

2015-12-22 Thread Yu Li (JIRA)
[ https://issues.apache.org/jira/browse/HBASE-15028?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=15069060#comment-15069060 ] Yu Li commented on HBASE-15028: --- Thanks for help review and commit, Ted > Minor fix on Reg

[jira] [Updated] (HBASE-14969) Add throughput controller for flush

2015-12-30 Thread Yu Li (JIRA)
[ https://issues.apache.org/jira/browse/HBASE-14969?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Yu Li updated HBASE-14969: -- Attachment: HBASE-14969_v2.patch Sorry for the late response, here is the latest patch. Let's see how it goes

[jira] [Created] (HBASE-15931) Add log for long-running tasks in AsyncProcess

2016-06-01 Thread Yu Li (JIRA)
Yu Li created HBASE-15931: - Summary: Add log for long-running tasks in AsyncProcess Key: HBASE-15931 URL: https://issues.apache.org/jira/browse/HBASE-15931 Project: HBase Issue Type: Improvement

[jira] [Updated] (HBASE-15931) Add log for long-running tasks in AsyncProcess

2016-06-01 Thread Yu Li (JIRA)
[ https://issues.apache.org/jira/browse/HBASE-15931?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Yu Li updated HBASE-15931: -- Attachment: HBASE-15931.patch Here's the initial patch. Introduce two thresholds for the detailed logging: {{

[jira] [Updated] (HBASE-15931) Add log for long-running tasks in AsyncProcess

2016-06-01 Thread Yu Li (JIRA)
[ https://issues.apache.org/jira/browse/HBASE-15931?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Yu Li updated HBASE-15931: -- Status: Patch Available (was: Open) Submit patch for HadoopQA to check > Add log for long-running tasks in As

[jira] [Commented] (HBASE-15931) Add log for long-running tasks in AsyncProcess

2016-06-01 Thread Yu Li (JIRA)
[ https://issues.apache.org/jira/browse/HBASE-15931?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=15311697#comment-15311697 ] Yu Li commented on HBASE-15931: --- Pushed into master and branch-1. Thanks [~stack] for revie

[jira] [Updated] (HBASE-15931) Add log for long-running tasks in AsyncProcess

2016-06-01 Thread Yu Li (JIRA)
[ https://issues.apache.org/jira/browse/HBASE-15931?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Yu Li updated HBASE-15931: -- Fix Version/s: 1.4.0 2.0.0 Release Note: After HBASE-15931, we will log more details fo

[jira] [Updated] (HBASE-15931) Add log for long-running tasks in AsyncProcess

2016-06-03 Thread Yu Li (JIRA)
[ https://issues.apache.org/jira/browse/HBASE-15931?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Yu Li updated HBASE-15931: -- Resolution: Fixed Hadoop Flags: Reviewed Status: Resolved (was: Patch Available) Close issue,

[jira] [Created] (HBASE-16032) Possible memory leak in StoreScanner

2016-06-15 Thread Yu Li (JIRA)
Yu Li created HBASE-16032: - Summary: Possible memory leak in StoreScanner Key: HBASE-16032 URL: https://issues.apache.org/jira/browse/HBASE-16032 Project: HBase Issue Type: Bug Reporter:

[jira] [Updated] (HBASE-16032) Possible memory leak in StoreScanner

2016-06-15 Thread Yu Li (JIRA)
[ https://issues.apache.org/jira/browse/HBASE-16032?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Yu Li updated HBASE-16032: -- Attachment: HBASE-16032.patch To solve the problem, we should catch exceptions after {{addChangedReaderObserve

[jira] [Updated] (HBASE-16032) Possible memory leak in StoreScanner

2016-06-15 Thread Yu Li (JIRA)
[ https://issues.apache.org/jira/browse/HBASE-16032?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Yu Li updated HBASE-16032: -- Fix Version/s: 0.98.21 1.1.6 1.2.2 1.3.

[jira] [Created] (HBASE-16033) Add more details in logging of responseTooSlow/TooLarge

2016-06-15 Thread Yu Li (JIRA)
Yu Li created HBASE-16033: - Summary: Add more details in logging of responseTooSlow/TooLarge Key: HBASE-16033 URL: https://issues.apache.org/jira/browse/HBASE-16033 Project: HBase Issue Type: Bug

[jira] [Updated] (HBASE-16033) Add more details in logging of responseTooSlow/TooLarge

2016-06-15 Thread Yu Li (JIRA)
[ https://issues.apache.org/jira/browse/HBASE-16033?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Yu Li updated HBASE-16033: -- Attachment: HBASE-16033.patch A straight-forward patch. Log after patch would look like: {noformat} 2016-06-15

[jira] [Updated] (HBASE-16033) Add more details in logging of responseTooSlow/TooLarge

2016-06-15 Thread Yu Li (JIRA)
[ https://issues.apache.org/jira/browse/HBASE-16033?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Yu Li updated HBASE-16033: -- Fix Version/s: 1.3.0 2.0.0 Status: Patch Available (was: Open) Submit patch for

[jira] [Commented] (HBASE-16032) Possible memory leak in StoreScanner

2016-06-15 Thread Yu Li (JIRA)
[ https://issues.apache.org/jira/browse/HBASE-16032?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=15332998#comment-15332998 ] Yu Li commented on HBASE-16032: --- Yes, this was my first choice. I changed to use try-catch

[jira] [Commented] (HBASE-16032) Possible memory leak in StoreScanner

2016-06-15 Thread Yu Li (JIRA)
[ https://issues.apache.org/jira/browse/HBASE-16032?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=15333000#comment-15333000 ] Yu Li commented on HBASE-16032: --- Unfortunately, the logging level of RpcServer in the probl

[jira] [Updated] (HBASE-16032) Possible memory leak in StoreScanner

2016-06-15 Thread Yu Li (JIRA)
[ https://issues.apache.org/jira/browse/HBASE-16032?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Yu Li updated HBASE-16032: -- Attachment: HBASE-16032_v2.patch Update the patch, covering missed exception-thrown handling on the {{HRegion#

[jira] [Updated] (HBASE-16032) Possible memory leak in StoreScanner

2016-06-15 Thread Yu Li (JIRA)
[ https://issues.apache.org/jira/browse/HBASE-16032?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Yu Li updated HBASE-16032: -- Description: We observed frequent fullGC of RS in our production environment, and after analyzing the heapdump

[jira] [Updated] (HBASE-16033) Add more details in logging of responseTooSlow/TooLarge

2016-06-15 Thread Yu Li (JIRA)
[ https://issues.apache.org/jira/browse/HBASE-16033?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Yu Li updated HBASE-16033: -- Attachment: HBASE-16033.patch > Add more details in logging of responseTooSlow/TooLarge > -

[jira] [Commented] (HBASE-16033) Add more details in logging of responseTooSlow/TooLarge

2016-06-15 Thread Yu Li (JIRA)
[ https://issues.apache.org/jira/browse/HBASE-16033?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=15333027#comment-15333027 ] Yu Li commented on HBASE-16033: --- Thanks for review [~enis] It seems the UT log is cleared

[jira] [Commented] (HBASE-16032) Possible memory leak in StoreScanner

2016-06-15 Thread Yu Li (JIRA)
[ https://issues.apache.org/jira/browse/HBASE-16032?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=15333110#comment-15333110 ] Yu Li commented on HBASE-16032: --- Thanks for the reference [~zghaobac], will do a code rebas

[jira] [Updated] (HBASE-16033) Add more details in logging of responseTooSlow/TooLarge

2016-06-15 Thread Yu Li (JIRA)
[ https://issues.apache.org/jira/browse/HBASE-16033?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Yu Li updated HBASE-16033: -- Attachment: HBASE-16033.patch > Add more details in logging of responseTooSlow/TooLarge > -

[jira] [Commented] (HBASE-16032) Possible memory leak in StoreScanner

2016-06-15 Thread Yu Li (JIRA)
[ https://issues.apache.org/jira/browse/HBASE-16032?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=15333145#comment-15333145 ] Yu Li commented on HBASE-16032: --- I think we should handle the {{additionalScanners}}, so we

[jira] [Updated] (HBASE-16032) Possible memory leak in StoreScanner

2016-06-15 Thread Yu Li (JIRA)
[ https://issues.apache.org/jira/browse/HBASE-16032?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Yu Li updated HBASE-16032: -- Attachment: HBASE-16032_v3.patch > Possible memory leak in StoreScanner >

[jira] [Commented] (HBASE-16032) Possible memory leak in StoreScanner

2016-06-15 Thread Yu Li (JIRA)
[ https://issues.apache.org/jira/browse/HBASE-16032?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=15333164#comment-15333164 ] Yu Li commented on HBASE-16032: --- Seems Jenkins have some problem now? Mind take a look sir?

[jira] [Commented] (HBASE-16032) Possible memory leak in StoreScanner

2016-06-15 Thread Yu Li (JIRA)
[ https://issues.apache.org/jira/browse/HBASE-16032?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=15333169#comment-15333169 ] Yu Li commented on HBASE-16032: --- I guess some configured server is missing the JAVA_HOME se

[jira] [Commented] (HBASE-16033) Add more details in logging of responseTooSlow/TooLarge

2016-06-16 Thread Yu Li (JIRA)
[ https://issues.apache.org/jira/browse/HBASE-16033?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=1545#comment-1545 ] Yu Li commented on HBASE-16033: --- Checked the failed UT cases: 1. org.apache.hadoop.hbase.re

[jira] [Updated] (HBASE-16033) Add more details in logging of responseTooSlow/TooLarge

2016-06-16 Thread Yu Li (JIRA)
[ https://issues.apache.org/jira/browse/HBASE-16033?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Yu Li updated HBASE-16033: -- Resolution: Fixed Hadoop Flags: Reviewed Status: Resolved (was: Patch Available) Pushed into m

[jira] [Commented] (HBASE-16032) Possible memory leak in StoreScanner

2016-06-16 Thread Yu Li (JIRA)
[ https://issues.apache.org/jira/browse/HBASE-16032?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=15333621#comment-15333621 ] Yu Li commented on HBASE-16032: --- Ok, thanks for the message [~mantonov] > Possible memory

[jira] [Commented] (HBASE-15619) Performance regression observed: Empty random read(get) performance of branch-1 worse than 0.98

2016-06-16 Thread Yu Li (JIRA)
[ https://issues.apache.org/jira/browse/HBASE-15619?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=15333640#comment-15333640 ] Yu Li commented on HBASE-15619: --- It seems HBASE-15971 has resolved the problem. > Performa

[jira] [Commented] (HBASE-15971) Regression: Random Read/WorkloadC slower in 1.x than 0.98

2016-06-16 Thread Yu Li (JIRA)
[ https://issues.apache.org/jira/browse/HBASE-15971?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=15333641#comment-15333641 ] Yu Li commented on HBASE-15971: --- Seems to miss the party, again... Great work sir [~stack]!

[jira] [Commented] (HBASE-15619) Performance regression observed: Empty random read(get) performance of branch-1 worse than 0.98

2016-06-16 Thread Yu Li (JIRA)
[ https://issues.apache.org/jira/browse/HBASE-15619?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=15335276#comment-15335276 ] Yu Li commented on HBASE-15619: --- Yep, the whole work is still not completely done but still

[jira] [Comment Edited] (HBASE-15619) Performance regression observed: Empty random read(get) performance of branch-1 worse than 0.98

2016-06-16 Thread Yu Li (JIRA)
[ https://issues.apache.org/jira/browse/HBASE-15619?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=15335276#comment-15335276 ] Yu Li edited comment on HBASE-15619 at 6/17/16 2:56 AM: Yep, the

[jira] [Commented] (HBASE-15619) Performance regression observed: Empty random read(get) performance of branch-1 worse than 0.98

2016-06-16 Thread Yu Li (JIRA)
[ https://issues.apache.org/jira/browse/HBASE-15619?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=15335287#comment-15335287 ] Yu Li commented on HBASE-15619: --- I see, then HBASE-15971 is more likely to resolve the prob

[jira] [Commented] (HBASE-16032) Possible memory leak in StoreScanner

2016-06-16 Thread Yu Li (JIRA)
[ https://issues.apache.org/jira/browse/HBASE-16032?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=15335429#comment-15335429 ] Yu Li commented on HBASE-16032: --- Thanks [~busbey]! > Possible memory leak in StoreScanner

[jira] [Commented] (HBASE-16032) Possible memory leak in StoreScanner

2016-06-16 Thread Yu Li (JIRA)
[ https://issues.apache.org/jira/browse/HBASE-16032?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=15335432#comment-15335432 ] Yu Li commented on HBASE-16032: --- Thanks for review [~ted_yu], will commit soon if no object

[jira] [Commented] (HBASE-16032) Possible memory leak in StoreScanner

2016-06-18 Thread Yu Li (JIRA)
[ https://issues.apache.org/jira/browse/HBASE-16032?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=15337686#comment-15337686 ] Yu Li commented on HBASE-16032: --- Yes, this is really something I neglected, thanks for poin

[jira] [Updated] (HBASE-16032) Possible memory leak in StoreScanner

2016-06-18 Thread Yu Li (JIRA)
[ https://issues.apache.org/jira/browse/HBASE-16032?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Yu Li updated HBASE-16032: -- Attachment: HBASE-16032_v4.patch Update patch resolving the issue Enis pointed out, rollback to use the try-ca

[jira] [Created] (HBASE-16066) Resolve RpC_REPEATED_CONDITIONAL_TEST findbugs warnings in HMaster

2016-06-19 Thread Yu Li (JIRA)
Yu Li created HBASE-16066: - Summary: Resolve RpC_REPEATED_CONDITIONAL_TEST findbugs warnings in HMaster Key: HBASE-16066 URL: https://issues.apache.org/jira/browse/HBASE-16066 Project: HBase Issue T

[jira] [Updated] (HBASE-16066) Resolve RpC_REPEATED_CONDITIONAL_TEST findbugs warnings in HMaster

2016-06-19 Thread Yu Li (JIRA)
[ https://issues.apache.org/jira/browse/HBASE-16066?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Yu Li updated HBASE-16066: -- Attachment: HBASE-16066.patch Attach a straight-forward patch > Resolve RpC_REPEATED_CONDITIONAL_TEST findbugs

[jira] [Updated] (HBASE-16066) Resolve RpC_REPEATED_CONDITIONAL_TEST findbugs warnings in HMaster

2016-06-19 Thread Yu Li (JIRA)
[ https://issues.apache.org/jira/browse/HBASE-16066?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Yu Li updated HBASE-16066: -- Status: Patch Available (was: Open) Submit patch for HadoopQA > Resolve RpC_REPEATED_CONDITIONAL_TEST findbug

[jira] [Commented] (HBASE-16032) Possible memory leak in StoreScanner

2016-06-19 Thread Yu Li (JIRA)
[ https://issues.apache.org/jira/browse/HBASE-16032?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=15338447#comment-15338447 ] Yu Li commented on HBASE-16032: --- Checked and confirmed the findbugs issue is irrelative to

[jira] [Commented] (HBASE-16066) Resolve RpC_REPEATED_CONDITIONAL_TEST findbugs warnings in HMaster

2016-06-19 Thread Yu Li (JIRA)
[ https://issues.apache.org/jira/browse/HBASE-16066?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=15338450#comment-15338450 ] Yu Li commented on HBASE-16066: --- Since this is a simple and straight-forward fix, allow me

[jira] [Updated] (HBASE-16066) Resolve RpC_REPEATED_CONDITIONAL_TEST findbugs warnings in HMaster

2016-06-19 Thread Yu Li (JIRA)
[ https://issues.apache.org/jira/browse/HBASE-16066?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Yu Li updated HBASE-16066: -- Resolution: Fixed Status: Resolved (was: Patch Available) Pushed into master branch, closing issue. >

[jira] [Commented] (HBASE-16032) Possible memory leak in StoreScanner

2016-06-19 Thread Yu Li (JIRA)
[ https://issues.apache.org/jira/browse/HBASE-16032?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=15338452#comment-15338452 ] Yu Li commented on HBASE-16032: --- Seems we are good to move on? [~enis] > Possible memory l

[jira] [Commented] (HBASE-16032) Possible memory leak in StoreScanner

2016-06-21 Thread Yu Li (JIRA)
[ https://issues.apache.org/jira/browse/HBASE-16032?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=15341639#comment-15341639 ] Yu Li commented on HBASE-16032: --- Ok, let me put this in and do addendum if necessary. Thank

[jira] [Commented] (HBASE-16032) Possible memory leak in StoreScanner

2016-06-21 Thread Yu Li (JIRA)
[ https://issues.apache.org/jira/browse/HBASE-16032?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=15342365#comment-15342365 ] Yu Li commented on HBASE-16032: --- Checked the failed cases: {noformat} Test Result (Fail) or

[jira] [Updated] (HBASE-16032) Possible memory leak in StoreScanner

2016-06-21 Thread Yu Li (JIRA)
[ https://issues.apache.org/jira/browse/HBASE-16032?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Yu Li updated HBASE-16032: -- Resolution: Fixed Hadoop Flags: Reviewed Status: Resolved (was: Patch Available) No problem, t

[jira] [Commented] (HBASE-16032) Possible memory leak in StoreScanner

2016-06-21 Thread Yu Li (JIRA)
[ https://issues.apache.org/jira/browse/HBASE-16032?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=15342420#comment-15342420 ] Yu Li commented on HBASE-16032: --- Checking the failed case: {noformat} org.apache.hadoop.hba

[jira] [Commented] (HBASE-16012) Major compaction can't work because left scanner read point in RegionServer

2016-06-21 Thread Yu Li (JIRA)
[ https://issues.apache.org/jira/browse/HBASE-16012?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=15342421#comment-15342421 ] Yu Li commented on HBASE-16012: --- Yes, this need to be rebased since HBASE-16032 already in,

[jira] [Commented] (HBASE-16012) Major compaction can't work because left scanner read point in RegionServer

2016-06-21 Thread Yu Li (JIRA)
[ https://issues.apache.org/jira/browse/HBASE-16012?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=15343253#comment-15343253 ] Yu Li commented on HBASE-16012: --- v5 lgtm, +1 > Major compaction can't work because left sc

[jira] [Commented] (HBASE-16090) ResultScanner is not closed in SyncTable#finishRemainingHashRanges()

2016-06-22 Thread Yu Li (JIRA)
[ https://issues.apache.org/jira/browse/HBASE-16090?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=15345685#comment-15345685 ] Yu Li commented on HBASE-16090: --- +1, patch lgtm, too. > ResultScanner is not closed in Syn

[jira] [Commented] (HBASE-16032) Possible memory leak in StoreScanner

2016-06-22 Thread Yu Li (JIRA)
[ https://issues.apache.org/jira/browse/HBASE-16032?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=15345794#comment-15345794 ] Yu Li commented on HBASE-16032: --- Observed such an exception caused by HDFS issue again from

[jira] [Commented] (HBASE-16032) Possible memory leak in StoreScanner

2016-06-22 Thread Yu Li (JIRA)
[ https://issues.apache.org/jira/browse/HBASE-16032?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=15345801#comment-15345801 ] Yu Li commented on HBASE-16032: --- Link HBASE-16012 and this issue since they are all problem

[jira] [Commented] (HBASE-15496) Throw RowTooBigException only for user scan/get

2016-06-22 Thread Yu Li (JIRA)
[ https://issues.apache.org/jira/browse/HBASE-15496?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=15345865#comment-15345865 ] Yu Li commented on HBASE-15496: --- Mind talking more about this "internal compaction" sir? [~

[jira] [Commented] (HBASE-15900) RS stuck in get lock of HStore

2016-06-23 Thread Yu Li (JIRA)
[ https://issues.apache.org/jira/browse/HBASE-15900?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=15346220#comment-15346220 ] Yu Li commented on HBASE-15900: --- We were running 0.98.12 with hadoop 2.6.2 for a long time

[jira] [Commented] (HBASE-16132) Scan does not return all the result when regionserver is busy

2016-06-29 Thread Yu Li (JIRA)
[ https://issues.apache.org/jira/browse/HBASE-16132?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=15356395#comment-15356395 ] Yu Li commented on HBASE-16132: --- Let me add some background here: This is a problem we ran

[jira] [Updated] (HBASE-16132) Scan does not return all the result when regionserver is busy

2016-06-29 Thread Yu Li (JIRA)
[ https://issues.apache.org/jira/browse/HBASE-16132?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Yu Li updated HBASE-16132: -- Assignee: Yu Li Temporarily assign to my self to attach some file > Scan does not return all the result when r

[jira] [Updated] (HBASE-16132) Scan does not return all the result when regionserver is busy

2016-06-29 Thread Yu Li (JIRA)
[ https://issues.apache.org/jira/browse/HBASE-16132?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Yu Li updated HBASE-16132: -- Attachment: TestScanMissingData.java Here's the class for reproducing the problem > Scan does not return all t

[jira] [Updated] (HBASE-16132) Scan does not return all the result when regionserver is busy

2016-06-29 Thread Yu Li (JIRA)
[ https://issues.apache.org/jira/browse/HBASE-16132?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Yu Li updated HBASE-16132: -- Assignee: binlijin (was: Yu Li) w/o the patch here, the test scan will return quickly while there're still qu

[jira] [Commented] (HBASE-16132) Scan does not return all the result when regionserver is busy

2016-06-29 Thread Yu Li (JIRA)
[ https://issues.apache.org/jira/browse/HBASE-16132?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=15356481#comment-15356481 ] Yu Li commented on HBASE-16132: --- Maybe we could create some UT case following the sanity te

[jira] [Commented] (HBASE-16132) Scan does not return all the result when regionserver is busy

2016-06-29 Thread Yu Li (JIRA)
[ https://issues.apache.org/jira/browse/HBASE-16132?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=15356517#comment-15356517 ] Yu Li commented on HBASE-16132: --- Thanks for review and help check UT result [~tedyu] Will

[jira] [Commented] (HBASE-16132) Scan does not return all the result when regionserver is busy

2016-07-01 Thread Yu Li (JIRA)
[ https://issues.apache.org/jira/browse/HBASE-16132?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=15358843#comment-15358843 ] Yu Li commented on HBASE-16132: --- >From current code it seems to me that RpcRetryingCallerWi

[jira] [Commented] (HBASE-16132) Scan does not return all the result when regionserver is busy

2016-07-01 Thread Yu Li (JIRA)
[ https://issues.apache.org/jira/browse/HBASE-16132?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=15359972#comment-15359972 ] Yu Li commented on HBASE-16132: --- Thanks for further clarification, got your point now. So

[jira] [Comment Edited] (HBASE-16132) Scan does not return all the result when regionserver is busy

2016-07-01 Thread Yu Li (JIRA)
[ https://issues.apache.org/jira/browse/HBASE-16132?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=15358843#comment-15358843 ] Yu Li edited comment on HBASE-16132 at 7/2/16 4:26 AM: --- >From curre

[jira] [Created] (HBASE-16172) Unify the retry logic in ScannerCallableWithReplicas and RpcRetryingCallerWithReadReplicas

2016-07-04 Thread Yu Li (JIRA)
Yu Li created HBASE-16172: - Summary: Unify the retry logic in ScannerCallableWithReplicas and RpcRetryingCallerWithReadReplicas Key: HBASE-16172 URL: https://issues.apache.org/jira/browse/HBASE-16172 Project:

[jira] [Commented] (HBASE-16132) Scan does not return all the result when regionserver is busy

2016-07-04 Thread Yu Li (JIRA)
[ https://issues.apache.org/jira/browse/HBASE-16132?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=15361332#comment-15361332 ] Yu Li commented on HBASE-16132: --- Have opened HBASE-16172 as a follow up > Scan does not re

[jira] [Updated] (HBASE-16132) Scan does not return all the result when regionserver is busy

2016-07-04 Thread Yu Li (JIRA)
[ https://issues.apache.org/jira/browse/HBASE-16132?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Yu Li updated HBASE-16132: -- Resolution: Fixed Hadoop Flags: Reviewed Fix Version/s: 1.3.0 2.0.0 St

[jira] [Updated] (HBASE-16172) Unify the retry logic in ScannerCallableWithReplicas and RpcRetryingCallerWithReadReplicas

2016-07-05 Thread Yu Li (JIRA)
[ https://issues.apache.org/jira/browse/HBASE-16172?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Yu Li updated HBASE-16172: -- Assignee: Ted Yu (was: Yu Li) Re-assign to Ted since already some work done (and thanks [~chenheng] for follo

[jira] [Commented] (HBASE-16074) ITBLL fails, reports lost big or tiny families

2016-07-05 Thread Yu Li (JIRA)
[ https://issues.apache.org/jira/browse/HBASE-16074?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=15363675#comment-15363675 ] Yu Li commented on HBASE-16074: --- Got a chance to try HBASE-16132? That's a problem existing

[jira] [Commented] (HBASE-16183) Correct errors in example program of coprocessor in Ref Guide

2016-07-06 Thread Yu Li (JIRA)
[ https://issues.apache.org/jira/browse/HBASE-16183?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=15363947#comment-15363947 ] Yu Li commented on HBASE-16183: --- [~water] Please add more details about the error and how t

[jira] [Commented] (HBASE-16172) Unify the retry logic in ScannerCallableWithReplicas and RpcRetryingCallerWithReadReplicas

2016-07-06 Thread Yu Li (JIRA)
[ https://issues.apache.org/jira/browse/HBASE-16172?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=15365577#comment-15365577 ] Yu Li commented on HBASE-16172: --- Comparing with ScannerCallableWithReplicas, I'm wondering

[jira] [Commented] (HBASE-16172) Unify the retry logic in ScannerCallableWithReplicas and RpcRetryingCallerWithReadReplicas

2016-07-06 Thread Yu Li (JIRA)
[ https://issues.apache.org/jira/browse/HBASE-16172?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=15365614#comment-15365614 ] Yu Li commented on HBASE-16172: --- Agreed to fix in another issue for the timeout part. > Un

<    1   2   3   4   5   6   7   8   9   10   >