[jira] [Commented] (HBASE-14891) Add log for uncaught exception in RegionServerMetricsWrapperRunnable

2015-11-26 Thread Heng Chen (JIRA)
[ https://issues.apache.org/jira/browse/HBASE-14891?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=15029479#comment-15029479 ] Heng Chen commented on HBASE-14891: --- Indent seems not right. :) > Add log for uncaught

[jira] [Commented] (HBASE-7743) Replace *SortReducers with Hadoop Secondary Sort

2015-11-27 Thread Heng Chen (JIRA)
[ https://issues.apache.org/jira/browse/HBASE-7743?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=15029690#comment-15029690 ] Heng Chen commented on HBASE-7743: -- Any progress? IMO we can remove TreeSet at least to

[jira] [Commented] (HBASE-14891) Add log for uncaught exception in RegionServerMetricsWrapperRunnable

2015-11-29 Thread Heng Chen (JIRA)
[ https://issues.apache.org/jira/browse/HBASE-14891?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=15031258#comment-15031258 ] Heng Chen commented on HBASE-14891: --- LGTM. +1 > Add log for uncaught exception in Regi

[jira] [Updated] (HBASE-14891) Add log for uncaught exception in RegionServerMetricsWrapperRunnable

2015-11-29 Thread Heng Chen (JIRA)
[ https://issues.apache.org/jira/browse/HBASE-14891?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Heng Chen updated HBASE-14891: -- Fix Version/s: 2.0.0 Status: Patch Available (was: Open) > Add log for uncaught exception i

[jira] [Commented] (HBASE-14891) Add log for uncaught exception in RegionServerMetricsWrapperRunnable

2015-11-30 Thread Heng Chen (JIRA)
[ https://issues.apache.org/jira/browse/HBASE-14891?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=15031483#comment-15031483 ] Heng Chen commented on HBASE-14891: --- After QA passed, i will push it. :) [~stack] >

[jira] [Updated] (HBASE-14891) Add log for uncaught exception in RegionServerMetricsWrapperRunnable

2015-11-30 Thread Heng Chen (JIRA)
[ https://issues.apache.org/jira/browse/HBASE-14891?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Heng Chen updated HBASE-14891: -- Attachment: HBASE-14891.v2.patch > Add log for uncaught exception in RegionServerMetricsWrapperRunnable

[jira] [Updated] (HBASE-14891) Add log for uncaught exception in RegionServerMetricsWrapperRunnable

2015-11-30 Thread Heng Chen (JIRA)
[ https://issues.apache.org/jira/browse/HBASE-14891?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Heng Chen updated HBASE-14891: -- Resolution: Fixed Status: Resolved (was: Patch Available) push to master. Thanks Yu for for ni

[jira] [Created] (HBASE-14897) TestTableLockManager.testReapAllTableLocks is flakey

2015-11-30 Thread Heng Chen (JIRA)
Heng Chen created HBASE-14897: - Summary: TestTableLockManager.testReapAllTableLocks is flakey Key: HBASE-14897 URL: https://issues.apache.org/jira/browse/HBASE-14897 Project: HBase Issue Type: Bu

[jira] [Updated] (HBASE-14897) TestTableLockManager.testReapAllTableLocks is flakey

2015-11-30 Thread Heng Chen (JIRA)
[ https://issues.apache.org/jira/browse/HBASE-14897?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Heng Chen updated HBASE-14897: -- Attachment: HBASE-14897.patch upload the real patch > TestTableLockManager.testReapAllTableLocks is fl

[jira] [Updated] (HBASE-14897) TestTableLockManager.testReapAllTableLocks is flakey

2015-11-30 Thread Heng Chen (JIRA)
[ https://issues.apache.org/jira/browse/HBASE-14897?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Heng Chen updated HBASE-14897: -- Status: Patch Available (was: Open) > TestTableLockManager.testReapAllTableLocks is flakey > -

[jira] [Updated] (HBASE-14897) TestTableLockManager.testReapAllTableLocks is flakey

2015-11-30 Thread Heng Chen (JIRA)
[ https://issues.apache.org/jira/browse/HBASE-14897?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Heng Chen updated HBASE-14897: -- Attachment: reproduce.patch > TestTableLockManager.testReapAllTableLocks is flakey > --

[jira] [Commented] (HBASE-14897) TestTableLockManager.testReapAllTableLocks is flakey

2015-11-30 Thread Heng Chen (JIRA)
[ https://issues.apache.org/jira/browse/HBASE-14897?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=15032963#comment-15032963 ] Heng Chen commented on HBASE-14897: --- push to master. Thanks [~stack] and [~enis] for y

[jira] [Commented] (HBASE-14891) Add log for uncaught exception in RegionServerMetricsWrapperRunnable

2015-12-01 Thread Heng Chen (JIRA)
[ https://issues.apache.org/jira/browse/HBASE-14891?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=15033390#comment-15033390 ] Heng Chen commented on HBASE-14891: --- Failed testcase has no relates with this patch. Pu

[jira] [Updated] (HBASE-14891) Add log for uncaught exception in RegionServerMetricsWrapperRunnable

2015-12-01 Thread Heng Chen (JIRA)
[ https://issues.apache.org/jira/browse/HBASE-14891?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Heng Chen updated HBASE-14891: -- Resolution: Fixed Status: Resolved (was: Patch Available) > Add log for uncaught exception in

[jira] [Commented] (HBASE-14905) VerifyReplication does not honour versions option

2015-12-01 Thread Heng Chen (JIRA)
[ https://issues.apache.org/jira/browse/HBASE-14905?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=15035384#comment-15035384 ] Heng Chen commented on HBASE-14905: --- How does it happened? Why target table has more r

[jira] [Commented] (HBASE-14905) VerifyReplication does not honour versions option

2015-12-01 Thread Heng Chen (JIRA)
[ https://issues.apache.org/jira/browse/HBASE-14905?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=15035396#comment-15035396 ] Heng Chen commented on HBASE-14905: --- Oh, I see... Let me test it locally. Thanks [~v

[jira] [Commented] (HBASE-14905) VerifyReplication does not honour versions option

2015-12-02 Thread Heng Chen (JIRA)
[ https://issues.apache.org/jira/browse/HBASE-14905?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=15035473#comment-15035473 ] Heng Chen commented on HBASE-14905: --- Hi, [~vishk] I can't reproduce it locally, if r

[jira] [Updated] (HBASE-14905) VerifyReplication does not honour versions option

2015-12-02 Thread Heng Chen (JIRA)
[ https://issues.apache.org/jira/browse/HBASE-14905?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Heng Chen updated HBASE-14905: -- Attachment: test.patch upload my test patch. > VerifyReplication does not honour versions option > ---

[jira] [Commented] (HBASE-14905) VerifyReplication does not honour versions option

2015-12-02 Thread Heng Chen (JIRA)
[ https://issues.apache.org/jira/browse/HBASE-14905?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=15035921#comment-15035921 ] Heng Chen commented on HBASE-14905: --- You are right, in distributed cluster, tasks cou

[jira] [Commented] (HBASE-14895) Seek only to the newly flushed file on scanner reset on flush

2015-12-02 Thread Heng Chen (JIRA)
[ https://issues.apache.org/jira/browse/HBASE-14895?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=15035956#comment-15035956 ] Heng Chen commented on HBASE-14895: --- It seems we could add some code in StoreScanner.up

[jira] [Commented] (HBASE-14905) VerifyReplication does not honour versions option

2015-12-02 Thread Heng Chen (JIRA)
[ https://issues.apache.org/jira/browse/HBASE-14905?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=15037043#comment-15037043 ] Heng Chen commented on HBASE-14905: --- Oh, [~tedyu] the patch i uploaded is not completed

[jira] [Updated] (HBASE-14905) VerifyReplication does not honour versions option

2015-12-02 Thread Heng Chen (JIRA)
[ https://issues.apache.org/jira/browse/HBASE-14905?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Heng Chen updated HBASE-14905: -- Attachment: HBASE-14905_v3.patch Finish it. :) > VerifyReplication does not honour versions option > -

[jira] [Commented] (HBASE-14866) VerifyReplication should use peer configuration in peer connection

2015-12-02 Thread Heng Chen (JIRA)
[ https://issues.apache.org/jira/browse/HBASE-14866?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=15037134#comment-15037134 ] Heng Chen commented on HBASE-14866: --- {quote} Should transformClusterKey just use standa

[jira] [Commented] (HBASE-14895) Seek only to the newly flushed file on scanner reset on flush

2015-12-02 Thread Heng Chen (JIRA)
[ https://issues.apache.org/jira/browse/HBASE-14895?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=15037292#comment-15037292 ] Heng Chen commented on HBASE-14895: --- I see.. It seems StoreScanner has a great change

[jira] [Updated] (HBASE-14915) Hanging test : org.apache.hadoop.hbase.mapreduce.TestImportExport

2015-12-03 Thread Heng Chen (JIRA)
[ https://issues.apache.org/jira/browse/HBASE-14915?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Heng Chen updated HBASE-14915: -- Attachment: HBASE-14915-branch-1.2.patch Try this patch. [~stack] :) We should wait puts complete befo

[jira] [Commented] (HBASE-14905) VerifyReplication does not honour versions option

2015-12-03 Thread Heng Chen (JIRA)
[ https://issues.apache.org/jira/browse/HBASE-14905?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=15037784#comment-15037784 ] Heng Chen commented on HBASE-14905: --- please fix Indent errors in patch v4. > VerifyRep

[jira] [Commented] (HBASE-14925) Develop HBase shell command/tool to list table's region info through command line

2015-12-03 Thread Heng Chen (JIRA)
[ https://issues.apache.org/jira/browse/HBASE-14925?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=15039611#comment-15039611 ] Heng Chen commented on HBASE-14925: --- Maybe we could add arguments in 'list' command. e

[jira] [Commented] (HBASE-14866) VerifyReplication should use peer configuration in peer connection

2015-12-03 Thread Heng Chen (JIRA)
[ https://issues.apache.org/jira/browse/HBASE-14866?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=15039694#comment-15039694 ] Heng Chen commented on HBASE-14866: --- {quote} This could even be ZKConfig, moved from hb

[jira] [Commented] (HBASE-14790) Implement a new DFSOutputStream for logging WAL only

2015-12-03 Thread Heng Chen (JIRA)
[ https://issues.apache.org/jira/browse/HBASE-14790?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=15040781#comment-15040781 ] Heng Chen commented on HBASE-14790: --- {quote} And for keeping an "acked length", I think

[jira] [Comment Edited] (HBASE-14790) Implement a new DFSOutputStream for logging WAL only

2015-12-03 Thread Heng Chen (JIRA)
[ https://issues.apache.org/jira/browse/HBASE-14790?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=15040781#comment-15040781 ] Heng Chen edited comment on HBASE-14790 at 12/4/15 6:20 AM: {

[jira] [Commented] (HBASE-14790) Implement a new DFSOutputStream for logging WAL only

2015-12-03 Thread Heng Chen (JIRA)
[ https://issues.apache.org/jira/browse/HBASE-14790?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=15041145#comment-15041145 ] Heng Chen commented on HBASE-14790: --- Make sense... Let's just keep here as original.

[jira] [Commented] (HBASE-14790) Implement a new DFSOutputStream for logging WAL only

2015-12-03 Thread Heng Chen (JIRA)
[ https://issues.apache.org/jira/browse/HBASE-14790?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=15041196#comment-15041196 ] Heng Chen commented on HBASE-14790: --- {quote} DataStreamer#block tracks the "number of b

[jira] [Commented] (HBASE-14790) Implement a new DFSOutputStream for logging WAL only

2015-12-04 Thread Heng Chen (JIRA)
[ https://issues.apache.org/jira/browse/HBASE-14790?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=15041307#comment-15041307 ] Heng Chen commented on HBASE-14790: --- {quote} hsync periodically, for example, default p

[jira] [Commented] (HBASE-14915) Hanging test : org.apache.hadoop.hbase.mapreduce.TestImportExport

2015-12-05 Thread Heng Chen (JIRA)
[ https://issues.apache.org/jira/browse/HBASE-14915?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=15043669#comment-15043669 ] Heng Chen commented on HBASE-14915: --- Oh, [~stack] I notice this information in QA info

[jira] [Commented] (HBASE-14004) [Replication] Inconsistency between Memstore and WAL may result in data in remote cluster that is not in the origin

2015-12-06 Thread Heng Chen (JIRA)
[ https://issues.apache.org/jira/browse/HBASE-14004?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=15044308#comment-15044308 ] Heng Chen commented on HBASE-14004: --- {quote} To be clear, this means we will hold the W

[jira] [Commented] (HBASE-14004) [Replication] Inconsistency between Memstore and WAL may result in data in remote cluster that is not in the origin

2015-12-06 Thread Heng Chen (JIRA)
[ https://issues.apache.org/jira/browse/HBASE-14004?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=15044318#comment-15044318 ] Heng Chen commented on HBASE-14004: --- {quote} If only RS crashed, DNs not, there is no d

[jira] [Commented] (HBASE-14004) [Replication] Inconsistency between Memstore and WAL may result in data in remote cluster that is not in the origin

2015-12-06 Thread Heng Chen (JIRA)
[ https://issues.apache.org/jira/browse/HBASE-14004?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=15044327#comment-15044327 ] Heng Chen commented on HBASE-14004: --- {quote} No. You can close old WAL using any length

[jira] [Commented] (HBASE-14004) [Replication] Inconsistency between Memstore and WAL may result in data in remote cluster that is not in the origin

2015-12-06 Thread Heng Chen (JIRA)
[ https://issues.apache.org/jira/browse/HBASE-14004?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=15044341#comment-15044341 ] Heng Chen commented on HBASE-14004: --- {quote} Now HBase only use hflush, if we add a hsy

[jira] [Commented] (HBASE-14866) VerifyReplication should use peer configuration in peer connection

2015-12-06 Thread Heng Chen (JIRA)
[ https://issues.apache.org/jira/browse/HBASE-14866?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=15044347#comment-15044347 ] Heng Chen commented on HBASE-14866: --- +1 > VerifyReplication should use peer configurat

[jira] [Updated] (HBASE-14703) not collect stats when call HTable.mutateRow

2015-12-06 Thread Heng Chen (JIRA)
[ https://issues.apache.org/jira/browse/HBASE-14703?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Heng Chen updated HBASE-14703: -- Attachment: HBASE-14703_v10.patch Update patch as [~jesse_yates] suggestions in RB. I also update RB.

[jira] [Commented] (HBASE-14915) Hanging test : org.apache.hadoop.hbase.mapreduce.TestImportExport

2015-12-06 Thread Heng Chen (JIRA)
[ https://issues.apache.org/jira/browse/HBASE-14915?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=15044358#comment-15044358 ] Heng Chen commented on HBASE-14915: --- [~stack] I think QA report which you post show tha

[jira] [Commented] (HBASE-14004) [Replication] Inconsistency between Memstore and WAL may result in data in remote cluster that is not in the origin

2015-12-06 Thread Heng Chen (JIRA)
[ https://issues.apache.org/jira/browse/HBASE-14004?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=15044368#comment-15044368 ] Heng Chen commented on HBASE-14004: --- {quote} btw, could see quite some discussion here

[jira] [Commented] (HBASE-14895) Seek only to the newly flushed file on scanner reset on flush

2015-12-06 Thread Heng Chen (JIRA)
[ https://issues.apache.org/jira/browse/HBASE-14895?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=15044451#comment-15044451 ] Heng Chen commented on HBASE-14895: --- {code} -List scanners = getScannersNoCompactio

[jira] [Commented] (HBASE-14004) [Replication] Inconsistency between Memstore and WAL may result in data in remote cluster that is not in the origin

2015-12-07 Thread Heng Chen (JIRA)
[ https://issues.apache.org/jira/browse/HBASE-14004?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=15044563#comment-15044563 ] Heng Chen commented on HBASE-14004: --- Looks good. Except one thing. {code} If we get tim

[jira] [Commented] (HBASE-14934) Applying PrefixFilter to a scan should implicitly limit startrow

2015-12-07 Thread Heng Chen (JIRA)
[ https://issues.apache.org/jira/browse/HBASE-14934?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=15044573#comment-15044573 ] Heng Chen commented on HBASE-14934: --- {code} /** * Set a filter (using stopRow and

[jira] [Commented] (HBASE-14004) [Replication] Inconsistency between Memstore and WAL may result in data in remote cluster that is not in the origin

2015-12-07 Thread Heng Chen (JIRA)
[ https://issues.apache.org/jira/browse/HBASE-14004?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=15044603#comment-15044603 ] Heng Chen commented on HBASE-14004: --- It seems that WAL reader is designed for one WAL,

[jira] [Commented] (HBASE-14004) [Replication] Inconsistency between Memstore and WAL may result in data in remote cluster that is not in the origin

2015-12-07 Thread Heng Chen (JIRA)
[ https://issues.apache.org/jira/browse/HBASE-14004?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=15044666#comment-15044666 ] Heng Chen commented on HBASE-14004: --- {quote} You are right, the logic that ignores logs

[jira] [Commented] (HBASE-14936) CombinedBlockCache should overwrite CacheStats#rollMetricsPeriod()

2015-12-07 Thread Heng Chen (JIRA)
[ https://issues.apache.org/jira/browse/HBASE-14936?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=15044686#comment-15044686 ] Heng Chen commented on HBASE-14936: --- looks good. Could you add a test case for it? > C

[jira] [Commented] (HBASE-14004) [Replication] Inconsistency between Memstore and WAL may result in data in remote cluster that is not in the origin

2015-12-07 Thread Heng Chen (JIRA)
[ https://issues.apache.org/jira/browse/HBASE-14004?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=15046292#comment-15046292 ] Heng Chen commented on HBASE-14004: --- {quote} I guess we need to persist the acked lengt

[jira] [Updated] (HBASE-14703) not collect stats when call HTable.mutateRow

2015-12-07 Thread Heng Chen (JIRA)
[ https://issues.apache.org/jira/browse/HBASE-14703?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Heng Chen updated HBASE-14703: -- Attachment: HBASE-14703_v10.patch resubmit to trigger QA > not collect stats when call HTable.mutateRo

[jira] [Commented] (HBASE-14004) [Replication] Inconsistency between Memstore and WAL may result in data in remote cluster that is not in the origin

2015-12-07 Thread Heng Chen (JIRA)
[ https://issues.apache.org/jira/browse/HBASE-14004?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=15046414#comment-15046414 ] Heng Chen commented on HBASE-14004: --- Why we need 'where to end' when recover replicatio

[jira] [Issue Comment Deleted] (HBASE-14004) [Replication] Inconsistency between Memstore and WAL may result in data in remote cluster that is not in the origin

2015-12-07 Thread Heng Chen (JIRA)
[ https://issues.apache.org/jira/browse/HBASE-14004?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Heng Chen updated HBASE-14004: -- Comment: was deleted (was: Why we need 'where to end' when recover replication? We just need to star

[jira] [Commented] (HBASE-14004) [Replication] Inconsistency between Memstore and WAL may result in data in remote cluster that is not in the origin

2015-12-07 Thread Heng Chen (JIRA)
[ https://issues.apache.org/jira/browse/HBASE-14004?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=15046416#comment-15046416 ] Heng Chen commented on HBASE-14004: --- Why we need 'where to end' when recover replicatio

[jira] [Commented] (HBASE-14004) [Replication] Inconsistency between Memstore and WAL may result in data in remote cluster that is not in the origin

2015-12-07 Thread Heng Chen (JIRA)
[ https://issues.apache.org/jira/browse/HBASE-14004?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=15046415#comment-15046415 ] Heng Chen commented on HBASE-14004: --- Why we need 'where to end' when recover replicatio

[jira] [Issue Comment Deleted] (HBASE-14004) [Replication] Inconsistency between Memstore and WAL may result in data in remote cluster that is not in the origin

2015-12-07 Thread Heng Chen (JIRA)
[ https://issues.apache.org/jira/browse/HBASE-14004?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Heng Chen updated HBASE-14004: -- Comment: was deleted (was: Why we need 'where to end' when recover replication? We just need to star

[jira] [Comment Edited] (HBASE-14004) [Replication] Inconsistency between Memstore and WAL may result in data in remote cluster that is not in the origin

2015-12-07 Thread Heng Chen (JIRA)
[ https://issues.apache.org/jira/browse/HBASE-14004?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=15046414#comment-15046414 ] Heng Chen edited comment on HBASE-14004 at 12/8/15 6:01 AM: W

[jira] [Comment Edited] (HBASE-14004) [Replication] Inconsistency between Memstore and WAL may result in data in remote cluster that is not in the origin

2015-12-07 Thread Heng Chen (JIRA)
[ https://issues.apache.org/jira/browse/HBASE-14004?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=15046414#comment-15046414 ] Heng Chen edited comment on HBASE-14004 at 12/8/15 6:12 AM: W

[jira] [Created] (HBASE-14949) Skip duplicate entries when replay WAL.

2015-12-08 Thread Heng Chen (JIRA)
Heng Chen created HBASE-14949: - Summary: Skip duplicate entries when replay WAL. Key: HBASE-14949 URL: https://issues.apache.org/jira/browse/HBASE-14949 Project: HBase Issue Type: Improvement

[jira] [Commented] (HBASE-14004) [Replication] Inconsistency between Memstore and WAL may result in data in remote cluster that is not in the origin

2015-12-08 Thread Heng Chen (JIRA)
[ https://issues.apache.org/jira/browse/HBASE-14004?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=15046584#comment-15046584 ] Heng Chen commented on HBASE-14004: --- I make a patch for skip duplicate entries when rep

[jira] [Updated] (HBASE-14949) Skip duplicate entries when replay WAL.

2015-12-08 Thread Heng Chen (JIRA)
[ https://issues.apache.org/jira/browse/HBASE-14949?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Heng Chen updated HBASE-14949: -- Attachment: hbase-14949.patch Because the wal is named by its maxSeqId in it. And when replay, it will

[jira] [Updated] (HBASE-14949) Skip duplicate entries when replay WAL.

2015-12-08 Thread Heng Chen (JIRA)
[ https://issues.apache.org/jira/browse/HBASE-14949?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Heng Chen updated HBASE-14949: -- Issue Type: Sub-task (was: Improvement) Parent: HBASE-14004 > Skip duplicate entries when repl

[jira] [Comment Edited] (HBASE-14949) Skip duplicate entries when replay WAL.

2015-12-08 Thread Heng Chen (JIRA)
[ https://issues.apache.org/jira/browse/HBASE-14949?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=15046604#comment-15046604 ] Heng Chen edited comment on HBASE-14949 at 12/8/15 9:02 AM: T

[jira] [Commented] (HBASE-14949) Skip duplicate entries when replay WAL.

2015-12-08 Thread Heng Chen (JIRA)
[ https://issues.apache.org/jira/browse/HBASE-14949?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=15046604#comment-15046604 ] Heng Chen commented on HBASE-14949: --- There are something error in this patch, maybe th

[jira] [Comment Edited] (HBASE-14949) Skip duplicate entries when replay WAL.

2015-12-08 Thread Heng Chen (JIRA)
[ https://issues.apache.org/jira/browse/HBASE-14949?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=15046604#comment-15046604 ] Heng Chen edited comment on HBASE-14949 at 12/8/15 9:05 AM: T

[jira] [Commented] (HBASE-14949) Skip duplicate entries when replay WAL.

2015-12-08 Thread Heng Chen (JIRA)
[ https://issues.apache.org/jira/browse/HBASE-14949?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=15046669#comment-15046669 ] Heng Chen commented on HBASE-14949: --- {quote} name them by startID_endID {quote} Yeah, i

[jira] [Updated] (HBASE-14949) Skip duplicate entries when replay WAL.

2015-12-08 Thread Heng Chen (JIRA)
[ https://issues.apache.org/jira/browse/HBASE-14949?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Heng Chen updated HBASE-14949: -- Attachment: HBASE-14949.patch update patch. I use the feature wal entry id is increased one by one,

[jira] [Updated] (HBASE-14949) Skip duplicate entries when replay WAL.

2015-12-08 Thread Heng Chen (JIRA)
[ https://issues.apache.org/jira/browse/HBASE-14949?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Heng Chen updated HBASE-14949: -- Attachment: (was: hbase-14949.patch) > Skip duplicate entries when replay WAL. > --

[jira] [Commented] (HBASE-14004) [Replication] Inconsistency between Memstore and WAL may result in data in remote cluster that is not in the origin

2015-12-08 Thread Heng Chen (JIRA)
[ https://issues.apache.org/jira/browse/HBASE-14004?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=15047929#comment-15047929 ] Heng Chen commented on HBASE-14004: --- {quote} Have to be careful how we do this. We have

[jira] [Commented] (HBASE-14949) Skip duplicate entries when replay WAL.

2015-12-08 Thread Heng Chen (JIRA)
[ https://issues.apache.org/jira/browse/HBASE-14949?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=15047981#comment-15047981 ] Heng Chen commented on HBASE-14949: --- {quote} I use the feature wal entry id is increase

[jira] [Commented] (HBASE-14004) [Replication] Inconsistency between Memstore and WAL may result in data in remote cluster that is not in the origin

2015-12-08 Thread Heng Chen (JIRA)
[ https://issues.apache.org/jira/browse/HBASE-14004?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=15047986#comment-15047986 ] Heng Chen commented on HBASE-14004: --- {quote} But I think there should be a follow-up w

[jira] [Commented] (HBASE-14915) Hanging test : org.apache.hadoop.hbase.mapreduce.TestImportExport

2015-12-08 Thread Heng Chen (JIRA)
[ https://issues.apache.org/jira/browse/HBASE-14915?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=15048002#comment-15048002 ] Heng Chen commented on HBASE-14915: --- Oh, this time it really seems org.apache.hadoop.

[jira] [Commented] (HBASE-14915) Hanging test : org.apache.hadoop.hbase.mapreduce.TestImportExport

2015-12-08 Thread Heng Chen (JIRA)
[ https://issues.apache.org/jira/browse/HBASE-14915?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=15048127#comment-15048127 ] Heng Chen commented on HBASE-14915: --- There is no log about TestImportExport in https:

[jira] [Commented] (HBASE-14897) TestTableLockManager.testReapAllTableLocks is flakey

2015-12-08 Thread Heng Chen (JIRA)
[ https://issues.apache.org/jira/browse/HBASE-14897?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=15048138#comment-15048138 ] Heng Chen commented on HBASE-14897: --- https://builds.apache.org/view/H-L/view/HBase/job/

[jira] [Updated] (HBASE-14897) TestTableLockManager.testReapAllTableLocks is flakey

2015-12-08 Thread Heng Chen (JIRA)
[ https://issues.apache.org/jira/browse/HBASE-14897?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Heng Chen updated HBASE-14897: -- Resolution: Fixed Fix Version/s: 2.0.0 Status: Resolved (was: Patch Available) > Tes

[jira] [Commented] (HBASE-14915) Hanging test : org.apache.hadoop.hbase.mapreduce.TestImportExport

2015-12-08 Thread Heng Chen (JIRA)
[ https://issues.apache.org/jira/browse/HBASE-14915?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=15048160#comment-15048160 ] Heng Chen commented on HBASE-14915: --- Sorry for my arbitrary judgement. Thanks [~stac

[jira] [Commented] (HBASE-14004) [Replication] Inconsistency between Memstore and WAL may result in data in remote cluster that is not in the origin

2015-12-08 Thread Heng Chen (JIRA)
[ https://issues.apache.org/jira/browse/HBASE-14004?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=15048171#comment-15048171 ] Heng Chen commented on HBASE-14004: --- {quote} And if we don't use hsync, I think we need

[jira] [Commented] (HBASE-14915) Hanging test : org.apache.hadoop.hbase.mapreduce.TestImportExport

2015-12-09 Thread Heng Chen (JIRA)
[ https://issues.apache.org/jira/browse/HBASE-14915?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=15048348#comment-15048348 ] Heng Chen commented on HBASE-14915: --- I found something interesting. Each failed test in

[jira] [Comment Edited] (HBASE-14915) Hanging test : org.apache.hadoop.hbase.mapreduce.TestImportExport

2015-12-09 Thread Heng Chen (JIRA)
[ https://issues.apache.org/jira/browse/HBASE-14915?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=15048348#comment-15048348 ] Heng Chen edited comment on HBASE-14915 at 12/9/15 10:17 AM: -

[jira] [Commented] (HBASE-14004) [Replication] Inconsistency between Memstore and WAL may result in data in remote cluster that is not in the origin

2015-12-09 Thread Heng Chen (JIRA)
[ https://issues.apache.org/jira/browse/HBASE-14004?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=15049947#comment-15049947 ] Heng Chen commented on HBASE-14004: --- {quote} 1, 2, 3, 4, 5---this is normal order 1, 3,

[jira] [Commented] (HBASE-14949) Skip duplicate entries when replay WAL.

2015-12-09 Thread Heng Chen (JIRA)
[ https://issues.apache.org/jira/browse/HBASE-14949?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=15050250#comment-15050250 ] Heng Chen commented on HBASE-14949: --- I check current logic and found that we need to do

[jira] [Resolved] (HBASE-14949) Skip duplicate entries when replay WAL.

2015-12-09 Thread Heng Chen (JIRA)
[ https://issues.apache.org/jira/browse/HBASE-14949?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Heng Chen resolved HBASE-14949. --- Resolution: Invalid > Skip duplicate entries when replay WAL. > -

[jira] [Reopened] (HBASE-14949) Skip duplicate entries when replay WAL.

2015-12-09 Thread Heng Chen (JIRA)
[ https://issues.apache.org/jira/browse/HBASE-14949?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Heng Chen reopened HBASE-14949: --- > Skip duplicate entries when replay WAL. > --- > > K

[jira] [Comment Edited] (HBASE-14949) Skip duplicate entries when replay WAL.

2015-12-09 Thread Heng Chen (JIRA)
[ https://issues.apache.org/jira/browse/HBASE-14949?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=15050250#comment-15050250 ] Heng Chen edited comment on HBASE-14949 at 12/10/15 7:45 AM: -

[jira] [Comment Edited] (HBASE-14949) Skip duplicate entries when replay WAL.

2015-12-09 Thread Heng Chen (JIRA)
[ https://issues.apache.org/jira/browse/HBASE-14949?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=15050250#comment-15050250 ] Heng Chen edited comment on HBASE-14949 at 12/10/15 7:52 AM: -

[jira] [Commented] (HBASE-14004) [Replication] Inconsistency between Memstore and WAL may result in data in remote cluster that is not in the origin

2015-12-10 Thread Heng Chen (JIRA)
[ https://issues.apache.org/jira/browse/HBASE-14004?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=15050333#comment-15050333 ] Heng Chen commented on HBASE-14004: --- That is my plan. > [Replication] Inconsistency be

[jira] [Commented] (HBASE-14004) [Replication] Inconsistency between Memstore and WAL may result in data in remote cluster that is not in the origin

2015-12-10 Thread Heng Chen (JIRA)
[ https://issues.apache.org/jira/browse/HBASE-14004?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=15050332#comment-15050332 ] Heng Chen commented on HBASE-14004: --- That is my plan. > [Replication] Inconsistency be

[jira] [Issue Comment Deleted] (HBASE-14004) [Replication] Inconsistency between Memstore and WAL may result in data in remote cluster that is not in the origin

2015-12-10 Thread Heng Chen (JIRA)
[ https://issues.apache.org/jira/browse/HBASE-14004?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Heng Chen updated HBASE-14004: -- Comment: was deleted (was: That is my plan.) > [Replication] Inconsistency between Memstore and WAL ma

[jira] [Commented] (HBASE-14004) [Replication] Inconsistency between Memstore and WAL may result in data in remote cluster that is not in the origin

2015-12-10 Thread Heng Chen (JIRA)
[ https://issues.apache.org/jira/browse/HBASE-14004?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=15050376#comment-15050376 ] Heng Chen commented on HBASE-14004: --- {quote} 2. WAL logger tries to re-write the buffer

[jira] [Commented] (HBASE-14004) [Replication] Inconsistency between Memstore and WAL may result in data in remote cluster that is not in the origin

2015-12-10 Thread Heng Chen (JIRA)
[ https://issues.apache.org/jira/browse/HBASE-14004?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=15050418#comment-15050418 ] Heng Chen commented on HBASE-14004: --- {quote} Let me confirm, do you mean we never rollb

[jira] [Commented] (HBASE-14004) [Replication] Inconsistency between Memstore and WAL may result in data in remote cluster that is not in the origin

2015-12-10 Thread Heng Chen (JIRA)
[ https://issues.apache.org/jira/browse/HBASE-14004?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=15050438#comment-15050438 ] Heng Chen commented on HBASE-14004: --- IMO we should handle this situation, if we failed

[jira] [Commented] (HBASE-14949) Skip duplicate entries when replay WAL.

2015-12-10 Thread Heng Chen (JIRA)
[ https://issues.apache.org/jira/browse/HBASE-14949?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=15050958#comment-15050958 ] Heng Chen commented on HBASE-14949: --- This issue seems not as simple as i have thought y

[jira] [Updated] (HBASE-14949) Skip duplicate entries when replay WAL.

2015-12-10 Thread Heng Chen (JIRA)
[ https://issues.apache.org/jira/browse/HBASE-14949?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Heng Chen updated HBASE-14949: -- Attachment: HBASE-14949_v1.patch > Skip duplicate entries when replay WAL. > --

[jira] [Commented] (HBASE-14949) Skip duplicate entries when replay WAL.

2015-12-10 Thread Heng Chen (JIRA)
[ https://issues.apache.org/jira/browse/HBASE-14949?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=15052248#comment-15052248 ] Heng Chen commented on HBASE-14949: --- {quote} And I checked the code again, for increme

[jira] [Updated] (HBASE-14949) Skip duplicate entries when replay WAL.

2015-12-11 Thread Heng Chen (JIRA)
[ https://issues.apache.org/jira/browse/HBASE-14949?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Heng Chen updated HBASE-14949: -- Attachment: HBASE-14949_v2.patch Fixing of WAL file name conflict after splitting and add one testcase

[jira] [Commented] (HBASE-14915) Hanging test : org.apache.hadoop.hbase.mapreduce.TestImportExport

2015-12-11 Thread Heng Chen (JIRA)
[ https://issues.apache.org/jira/browse/HBASE-14915?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=15054034#comment-15054034 ] Heng Chen commented on HBASE-14915: --- I make a patch, remove MRCluster in TestImportExp

[jira] [Updated] (HBASE-14915) Hanging test : org.apache.hadoop.hbase.mapreduce.TestImportExport

2015-12-11 Thread Heng Chen (JIRA)
[ https://issues.apache.org/jira/browse/HBASE-14915?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Heng Chen updated HBASE-14915: -- Attachment: HBASE-14915_v1-branch-1.2.patch > Hanging test : org.apache.hadoop.hbase.mapreduce.TestImpo

[jira] [Updated] (HBASE-14915) Hanging test : org.apache.hadoop.hbase.mapreduce.TestImportExport

2015-12-11 Thread Heng Chen (JIRA)
[ https://issues.apache.org/jira/browse/HBASE-14915?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Heng Chen updated HBASE-14915: -- Status: Patch Available (was: Open) > Hanging test : org.apache.hadoop.hbase.mapreduce.TestImportExpor

[jira] [Updated] (HBASE-14915) Hanging test : org.apache.hadoop.hbase.mapreduce.TestImportExport

2015-12-12 Thread Heng Chen (JIRA)
[ https://issues.apache.org/jira/browse/HBASE-14915?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Heng Chen updated HBASE-14915: -- Attachment: HBASE-14915_v2-branch-1.2.patch Fix failed testcase > Hanging test : org.apache.hadoop.hba

[jira] [Commented] (HBASE-14915) Hanging test : org.apache.hadoop.hbase.mapreduce.TestImportExport

2015-12-12 Thread Heng Chen (JIRA)
[ https://issues.apache.org/jira/browse/HBASE-14915?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=15054736#comment-15054736 ] Heng Chen commented on HBASE-14915: --- Failed test case TestExportSnapshot.testExportFail

[jira] [Updated] (HBASE-14915) Hanging test : org.apache.hadoop.hbase.mapreduce.TestImportExport

2015-12-12 Thread Heng Chen (JIRA)
[ https://issues.apache.org/jira/browse/HBASE-14915?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Heng Chen updated HBASE-14915: -- Attachment: HBASE-14915_v2-branch-1.2.patch > Hanging test : org.apache.hadoop.hbase.mapreduce.TestImpo

<    4   5   6   7   8   9   10   11   12   13   >