[jira] [Commented] (HBASE-14949) Skip duplicate entries when replay WAL.

2015-12-08 Thread Phil Yang (JIRA)
[ https://issues.apache.org/jira/browse/HBASE-14949?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15046654#comment-15046654 ] Phil Yang commented on HBASE-14949: --- It may be not easy to sort files with or without dup suffix. I

[jira] [Commented] (HBASE-14004) [Replication] Inconsistency between Memstore and WAL may result in data in remote cluster that is not in the origin

2015-12-07 Thread Phil Yang (JIRA)
[ https://issues.apache.org/jira/browse/HBASE-14004?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15044970#comment-15044970 ] Phil Yang commented on HBASE-14004: --- Furthermore, I find another issue that since HDFS-744 supported

[jira] [Commented] (HBASE-14790) Implement a new DFSOutputStream for logging WAL only

2015-12-03 Thread Phil Yang (JIRA)
[ https://issues.apache.org/jira/browse/HBASE-14790?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15041234#comment-15041234 ] Phil Yang commented on HBASE-14790: --- Considering these features: Hflush is much faster than hsync,

[jira] [Commented] (HBASE-14004) [Replication] Inconsistency between Memstore and WAL may result in data in remote cluster that is not in the origin

2015-12-06 Thread Phil Yang (JIRA)
[ https://issues.apache.org/jira/browse/HBASE-14004?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15044315#comment-15044315 ] Phil Yang commented on HBASE-14004: --- {quote} If RS crashed at this time, what will happen? {quote} If

[jira] [Commented] (HBASE-14004) [Replication] Inconsistency between Memstore and WAL may result in data in remote cluster that is not in the origin

2015-12-06 Thread Phil Yang (JIRA)
[ https://issues.apache.org/jira/browse/HBASE-14004?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15044380#comment-15044380 ] Phil Yang commented on HBASE-14004: --- Sure, I'm going to draft a document for summarizing our ideas.

[jira] [Commented] (HBASE-14004) [Replication] Inconsistency between Memstore and WAL may result in data in remote cluster that is not in the origin

2015-12-06 Thread Phil Yang (JIRA)
[ https://issues.apache.org/jira/browse/HBASE-14004?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15044333#comment-15044333 ] Phil Yang commented on HBASE-14004: --- I have a new concern about the configuration. Now HBase only use

[jira] [Commented] (HBASE-14004) [Replication] Inconsistency between Memstore and WAL may result in data in remote cluster that is not in the origin

2015-12-07 Thread Phil Yang (JIRA)
[ https://issues.apache.org/jira/browse/HBASE-14004?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15044643#comment-15044643 ] Phil Yang commented on HBASE-14004: --- {quote} It seems that WAL reader is designed for one WAL, we can't

[jira] [Commented] (HBASE-14004) [Replication] Inconsistency between Memstore and WAL may result in data in remote cluster that is not in the origin

2015-12-07 Thread Phil Yang (JIRA)
[ https://issues.apache.org/jira/browse/HBASE-14004?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15044685#comment-15044685 ] Phil Yang commented on HBASE-14004: --- {quote} Guess this may be the original design since there is TODO

[jira] [Commented] (HBASE-14004) [Replication] Inconsistency between Memstore and WAL may result in data in remote cluster that is not in the origin

2015-12-07 Thread Phil Yang (JIRA)
[ https://issues.apache.org/jira/browse/HBASE-14004?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15044576#comment-15044576 ] Phil Yang commented on HBASE-14004: --- {quote} Some entries in new WAL may have smaller seqid than

[jira] [Commented] (HBASE-14004) [Replication] Inconsistency between Memstore and WAL may result in data in remote cluster that is not in the origin

2015-12-07 Thread Phil Yang (JIRA)
[ https://issues.apache.org/jira/browse/HBASE-14004?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15044835#comment-15044835 ] Phil Yang commented on HBASE-14004: --- {quote} In another word, the client needn't discriminate between

[jira] [Commented] (HBASE-14004) [Replication] Inconsistency between Memstore and WAL may result in data in remote cluster that is not in the origin

2015-12-08 Thread Phil Yang (JIRA)
[ https://issues.apache.org/jira/browse/HBASE-14004?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15047976#comment-15047976 ] Phil Yang commented on HBASE-14004: --- {quote} And as our design, we only use hsync to ensure data

[jira] [Commented] (HBASE-14004) [Replication] Inconsistency between Memstore and WAL may result in data in remote cluster that is not in the origin

2015-12-08 Thread Phil Yang (JIRA)
[ https://issues.apache.org/jira/browse/HBASE-14004?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15048137#comment-15048137 ] Phil Yang commented on HBASE-14004: --- {quote} And in this issue, i suppose we just ensure correctness

[jira] [Commented] (HBASE-14004) [Replication] Inconsistency between Memstore and WAL may result in data in remote cluster that is not in the origin

2015-12-09 Thread Phil Yang (JIRA)
[ https://issues.apache.org/jira/browse/HBASE-14004?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15048552#comment-15048552 ] Phil Yang commented on HBASE-14004: --- You are right, we should change the logic of replicator. And I am

[jira] [Commented] (HBASE-14004) [Replication] Inconsistency between Memstore and WAL may result in data in remote cluster that is not in the origin

2015-12-09 Thread Phil Yang (JIRA)
[ https://issues.apache.org/jira/browse/HBASE-14004?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15049048#comment-15049048 ] Phil Yang commented on HBASE-14004: --- The reason I asked this question is if we don't have to make sure

[jira] [Commented] (HBASE-14004) [Replication] Inconsistency between Memstore and WAL may result in data in remote cluster that is not in the origin

2015-12-04 Thread Phil Yang (JIRA)
[ https://issues.apache.org/jira/browse/HBASE-14004?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15042694#comment-15042694 ] Phil Yang commented on HBASE-14004: --- After discussion in HBASE-14790 , we can move forward now. Let me

[jira] [Commented] (HBASE-14004) [Replication] Inconsistency between Memstore and WAL may result in data in remote cluster that is not in the origin

2015-12-05 Thread Phil Yang (JIRA)
[ https://issues.apache.org/jira/browse/HBASE-14004?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15042765#comment-15042765 ] Phil Yang commented on HBASE-14004: --- Is it required to use the size of serialized binary data? I don't

[jira] [Commented] (HBASE-14790) Implement a new DFSOutputStream for logging WAL only

2015-12-04 Thread Phil Yang (JIRA)
[ https://issues.apache.org/jira/browse/HBASE-14790?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15041910#comment-15041910 ] Phil Yang commented on HBASE-14790: --- Currently there are two scenarios which may result in

[jira] [Commented] (HBASE-14004) [Replication] Inconsistency between Memstore and WAL may result in data in remote cluster that is not in the origin

2015-12-07 Thread Phil Yang (JIRA)
[ https://issues.apache.org/jira/browse/HBASE-14004?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15046286#comment-15046286 ] Phil Yang commented on HBASE-14004: --- {quote} I guess we need to persist the acked length to somewhere

[jira] [Commented] (HBASE-14004) [Replication] Inconsistency between Memstore and WAL may result in data in remote cluster that is not in the origin

2015-12-09 Thread Phil Yang (JIRA)
[ https://issues.apache.org/jira/browse/HBASE-14004?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15050165#comment-15050165 ] Phil Yang commented on HBASE-14004: --- I have revised the doc

[jira] [Commented] (HBASE-14004) [Replication] Inconsistency between Memstore and WAL may result in data in remote cluster that is not in the origin

2015-12-10 Thread Phil Yang (JIRA)
[ https://issues.apache.org/jira/browse/HBASE-14004?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15050467#comment-15050467 ] Phil Yang commented on HBASE-14004: --- We can not rollback even if buffered-entries rewrite failed, or we

[jira] [Commented] (HBASE-14004) [Replication] Inconsistency between Memstore and WAL may result in data in remote cluster that is not in the origin

2015-12-10 Thread Phil Yang (JIRA)
[ https://issues.apache.org/jira/browse/HBASE-14004?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15050308#comment-15050308 ] Phil Yang commented on HBASE-14004: --- [~chenheng] it seems that HBASE-14949 only handle replaying logs

[jira] [Commented] (HBASE-9465) HLog entries are not pushed to peer clusters serially when region-move or RS failure in master cluster

2016-06-05 Thread Phil Yang (JIRA)
[ https://issues.apache.org/jira/browse/HBASE-9465?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15315781#comment-15315781 ] Phil Yang commented on HBASE-9465: -- {quote} Can we use hbase:replication instead of hbase:meta for

[jira] [Updated] (HBASE-15968) Strong semantics of versions

2016-06-06 Thread Phil Yang (JIRA)
[ https://issues.apache.org/jira/browse/HBASE-15968?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Phil Yang updated HBASE-15968: -- Description: In HBase book, we have a section in Versions called "Current Limitations" see

[jira] [Commented] (HBASE-15968) Strong semantics of versions

2016-06-07 Thread Phil Yang (JIRA)
[ https://issues.apache.org/jira/browse/HBASE-15968?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15319861#comment-15319861 ] Phil Yang commented on HBASE-15968: --- Yes, if we enable this feature, we will not remove the sequence id

[jira] [Commented] (HBASE-15968) Strong semantics of versions

2016-06-08 Thread Phil Yang (JIRA)
[ https://issues.apache.org/jira/browse/HBASE-15968?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15320111#comment-15320111 ] Phil Yang commented on HBASE-15968: --- If we have a Put with ts=1/mvcc=2 and a Delete with ts=2/mvcc=1,

[jira] [Created] (HBASE-15968) Strong semantics of versions

2016-06-06 Thread Phil Yang (JIRA)
Phil Yang created HBASE-15968: - Summary: Strong semantics of versions Key: HBASE-15968 URL: https://issues.apache.org/jira/browse/HBASE-15968 Project: HBase Issue Type: New Feature

[jira] [Commented] (HBASE-9465) HLog entries are not pushed to peer clusters serially when region-move or RS failure in master cluster

2016-06-03 Thread Phil Yang (JIRA)
[ https://issues.apache.org/jira/browse/HBASE-9465?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15313770#comment-15313770 ] Phil Yang commented on HBASE-9465: -- Upload a design doc,

[jira] [Assigned] (HBASE-9465) HLog entries are not pushed to peer clusters serially when region-move or RS failure in master cluster

2016-06-03 Thread Phil Yang (JIRA)
[ https://issues.apache.org/jira/browse/HBASE-9465?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Phil Yang reassigned HBASE-9465: Assignee: Phil Yang > HLog entries are not pushed to peer clusters serially when region-move or RS

[jira] [Commented] (HBASE-15968) Strong semantics of versions

2016-06-12 Thread Phil Yang (JIRA)
[ https://issues.apache.org/jira/browse/HBASE-15968?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15326212#comment-15326212 ] Phil Yang commented on HBASE-15968: --- upload an implementation doc in

[jira] [Commented] (HBASE-9465) HLog entries are not pushed to peer clusters serially when region-move or RS failure in master cluster

2016-06-01 Thread Phil Yang (JIRA)
[ https://issues.apache.org/jira/browse/HBASE-9465?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15311691#comment-15311691 ] Phil Yang commented on HBASE-9465: -- Hi all, I'm going to pick up this issue to make replication log

[jira] [Commented] (HBASE-16051) TestScannerHeartbeatMessages fails on some machines

2016-06-21 Thread Phil Yang (JIRA)
[ https://issues.apache.org/jira/browse/HBASE-16051?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15341392#comment-15341392 ] Phil Yang commented on HBASE-16051: --- Hi Mikhail I did some work on scanner heartbeat and familiar with

[jira] [Updated] (HBASE-16051) TestScannerHeartbeatMessages fails on some machines

2016-06-21 Thread Phil Yang (JIRA)
[ https://issues.apache.org/jira/browse/HBASE-16051?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Phil Yang updated HBASE-16051: -- Attachment: HBASE-16051-v1.patch The timeout settings in this test doesn't follow what comment says.

[jira] [Assigned] (HBASE-16051) TestScannerHeartbeatMessages fails on some machines

2016-06-21 Thread Phil Yang (JIRA)
[ https://issues.apache.org/jira/browse/HBASE-16051?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Phil Yang reassigned HBASE-16051: - Assignee: Phil Yang > TestScannerHeartbeatMessages fails on some machines >

[jira] [Updated] (HBASE-16051) TestScannerHeartbeatMessages fails on some machines

2016-06-21 Thread Phil Yang (JIRA)
[ https://issues.apache.org/jira/browse/HBASE-16051?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Phil Yang updated HBASE-16051: -- Status: Patch Available (was: Open) > TestScannerHeartbeatMessages fails on some machines >

[jira] [Commented] (HBASE-16051) TestScannerHeartbeatMessages fails on some machines

2016-06-22 Thread Phil Yang (JIRA)
[ https://issues.apache.org/jira/browse/HBASE-16051?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15345813#comment-15345813 ] Phil Yang commented on HBASE-16051: --- Thanks [~tedyu] for the review :) > TestScannerHeartbeatMessages

[jira] [Comment Edited] (HBASE-16132) Scan does not return all the result when regionserver is busy

2016-06-28 Thread Phil Yang (JIRA)
[ https://issues.apache.org/jira/browse/HBASE-16132?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15352694#comment-15352694 ] Phil Yang edited comment on HBASE-16132 at 6/28/16 9:50 AM: Hi [~aoxiang]

[jira] [Commented] (HBASE-16132) Scan does not return all the result when regionserver is busy

2016-06-28 Thread Phil Yang (JIRA)
[ https://issues.apache.org/jira/browse/HBASE-16132?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15352694#comment-15352694 ] Phil Yang commented on HBASE-16132: --- Hi [~aoxiang] {when cs.poll timeout and do not return any result ,

[jira] [Commented] (HBASE-16144) Replication queue's lock will live forever if RS acquiring the lock has dead

2016-06-29 Thread Phil Yang (JIRA)
[ https://issues.apache.org/jira/browse/HBASE-16144?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15354697#comment-15354697 ] Phil Yang commented on HBASE-16144: --- We will set hbase.zookeeper.useMulti=false if we have many peers

[jira] [Created] (HBASE-16144) Replication queue's lock will live forever if RS acquiring the lock has dead

2016-06-29 Thread Phil Yang (JIRA)
Phil Yang created HBASE-16144: - Summary: Replication queue's lock will live forever if RS acquiring the lock has dead Key: HBASE-16144 URL: https://issues.apache.org/jira/browse/HBASE-16144 Project:

[jira] [Commented] (HBASE-14949) Skip duplicate entries when replay WAL.

2016-02-08 Thread Phil Yang (JIRA)
[ https://issues.apache.org/jira/browse/HBASE-14949?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15137089#comment-15137089 ] Phil Yang commented on HBASE-14949: --- I think we needn't wait for upgrading finished. If we solve this

[jira] [Commented] (HBASE-15302) Reenable the other tests disabled by HBASE-14678

2016-02-24 Thread Phil Yang (JIRA)
[ https://issues.apache.org/jira/browse/HBASE-15302?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15162922#comment-15162922 ] Phil Yang commented on HBASE-15302: --- I port the patch to branch-1, but TestAssignmentManager failed

[jira] [Created] (HBASE-15358) canEnforceTimeLimitFromScope should use timeScope instead of sizeScope

2016-02-29 Thread Phil Yang (JIRA)
Phil Yang created HBASE-15358: - Summary: canEnforceTimeLimitFromScope should use timeScope instead of sizeScope Key: HBASE-15358 URL: https://issues.apache.org/jira/browse/HBASE-15358 Project: HBase

[jira] [Updated] (HBASE-15358) canEnforceTimeLimitFromScope should use timeScope instead of sizeScope

2016-02-29 Thread Phil Yang (JIRA)
[ https://issues.apache.org/jira/browse/HBASE-15358?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Phil Yang updated HBASE-15358: -- Affects Version/s: 1.2.0 1.1.3 > canEnforceTimeLimitFromScope should use

[jira] [Updated] (HBASE-15358) canEnforceTimeLimitFromScope should use timeScope instead of sizeScope

2016-02-29 Thread Phil Yang (JIRA)
[ https://issues.apache.org/jira/browse/HBASE-15358?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Phil Yang updated HBASE-15358: -- Attachment: HBASE-15358-v1.txt > canEnforceTimeLimitFromScope should use timeScope instead of

[jira] [Commented] (HBASE-15358) canEnforceTimeLimitFromScope should use timeScope instead of sizeScope

2016-02-29 Thread Phil Yang (JIRA)
[ https://issues.apache.org/jira/browse/HBASE-15358?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15171583#comment-15171583 ] Phil Yang commented on HBASE-15358: --- This patch can be and should be applied to branch-1.1 branch-1.2

[jira] [Commented] (HBASE-15358) canEnforceTimeLimitFromScope should use timeScope instead of sizeScope

2016-02-29 Thread Phil Yang (JIRA)
[ https://issues.apache.org/jira/browse/HBASE-15358?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15171613#comment-15171613 ] Phil Yang commented on HBASE-15358: --- {code} final LimitScope sizeScope = allowPartialResults ?

[jira] [Updated] (HBASE-15302) Reenable the other tests disabled by HBASE-14678

2016-02-24 Thread Phil Yang (JIRA)
[ https://issues.apache.org/jira/browse/HBASE-15302?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Phil Yang updated HBASE-15302: -- Attachment: HBASE-15302-branch-1-v1.txt Remove TestAssignmentManager temporarily to see if others can

[jira] [Updated] (HBASE-15325) ResultScanner allowing partial result will missing the rest of the row if the region is moved between two rpc requests

2016-02-25 Thread Phil Yang (JIRA)
[ https://issues.apache.org/jira/browse/HBASE-15325?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Phil Yang updated HBASE-15325: -- Description: HBASE-11544 allow scan rpc return partial of a row to reduce memory usage for one rpc

[jira] [Updated] (HBASE-15325) ResultScanner allowing partial result will missing the rest of the row if the region is moved between two rpc requests

2016-02-25 Thread Phil Yang (JIRA)
[ https://issues.apache.org/jira/browse/HBASE-15325?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Phil Yang updated HBASE-15325: -- Summary: ResultScanner allowing partial result will missing the rest of the row if the region is moved

[jira] [Updated] (HBASE-15325) ResultScanner allowing partial result will reset to the start of the row if the region is moved between two rpc requests

2016-02-24 Thread Phil Yang (JIRA)
[ https://issues.apache.org/jira/browse/HBASE-15325?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Phil Yang updated HBASE-15325: -- Attachment: 15325-test.txt Upload two tests for this issue. The testPartialResultWhenRegionMove will

[jira] [Commented] (HBASE-15325) ResultScanner allowing partial result will reset to the start of the row if the region is moved between two rpc requests

2016-02-24 Thread Phil Yang (JIRA)
[ https://issues.apache.org/jira/browse/HBASE-15325?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15166811#comment-15166811 ] Phil Yang commented on HBASE-15325: --- I think we have two solutions: Cache the last cell of the last

[jira] [Commented] (HBASE-15325) ResultScanner allowing partial result will reset to the start of the row if the region is moved between two rpc requests

2016-02-24 Thread Phil Yang (JIRA)
[ https://issues.apache.org/jira/browse/HBASE-15325?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15166821#comment-15166821 ] Phil Yang commented on HBASE-15325: --- NotServingRegionException extends IOException so it is not

[jira] [Updated] (HBASE-15325) ResultScanner allowing partial result will missing the rest of the row if the region is moved between two rpc requests

2016-02-25 Thread Phil Yang (JIRA)
[ https://issues.apache.org/jira/browse/HBASE-15325?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Phil Yang updated HBASE-15325: -- Attachment: HBASE-15325-v1.txt > ResultScanner allowing partial result will missing the rest of the

[jira] [Commented] (HBASE-15325) ResultScanner allowing partial result will missing the rest of the row if the region is moved between two rpc requests

2016-02-25 Thread Phil Yang (JIRA)
[ https://issues.apache.org/jira/browse/HBASE-15325?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15167149#comment-15167149 ] Phil Yang commented on HBASE-15325: --- Upload the patch for master > ResultScanner allowing partial

[jira] [Updated] (HBASE-15325) ResultScanner allowing partial result will missing the rest of the row if the region is moved between two rpc requests

2016-02-25 Thread Phil Yang (JIRA)
[ https://issues.apache.org/jira/browse/HBASE-15325?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Phil Yang updated HBASE-15325: -- Status: Patch Available (was: Open) > ResultScanner allowing partial result will missing the rest of

[jira] [Updated] (HBASE-15325) ResultScanner allowing partial result will missing the rest of the row if the region is moved between two rpc requests

2016-02-25 Thread Phil Yang (JIRA)
[ https://issues.apache.org/jira/browse/HBASE-15325?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Phil Yang updated HBASE-15325: -- Affects Version/s: 1.2.0 > ResultScanner allowing partial result will missing the rest of the row if

[jira] [Created] (HBASE-15325) ResultScanner allowing partial result will reset to the start of the row if the region is moved between two rpc requests

2016-02-24 Thread Phil Yang (JIRA)
Phil Yang created HBASE-15325: - Summary: ResultScanner allowing partial result will reset to the start of the row if the region is moved between two rpc requests Key: HBASE-15325 URL:

[jira] [Commented] (HBASE-15325) ResultScanner allowing partial result will reset to the start of the row if the region is moved between two rpc requests

2016-02-25 Thread Phil Yang (JIRA)
[ https://issues.apache.org/jira/browse/HBASE-15325?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15166948#comment-15166948 ] Phil Yang commented on HBASE-15325: --- Sorry, I had a mistake. The test failed on asserting row key, the

[jira] [Commented] (HBASE-15325) ResultScanner allowing partial result will missing the rest of the row if the region is moved between two rpc requests

2016-02-25 Thread Phil Yang (JIRA)
[ https://issues.apache.org/jira/browse/HBASE-15325?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15167018#comment-15167018 ] Phil Yang commented on HBASE-15325: --- Yes, we need do this as you said. More clearly, we need set the

[jira] [Updated] (HBASE-15325) ResultScanner allowing partial result will miss the rest of the row if the region is moved between two rpc requests

2016-02-29 Thread Phil Yang (JIRA)
[ https://issues.apache.org/jira/browse/HBASE-15325?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Phil Yang updated HBASE-15325: -- Attachment: (was: HBASE-15325-v4.txt) > ResultScanner allowing partial result will miss the rest

[jira] [Updated] (HBASE-15325) ResultScanner allowing partial result will miss the rest of the row if the region is moved between two rpc requests

2016-02-29 Thread Phil Yang (JIRA)
[ https://issues.apache.org/jira/browse/HBASE-15325?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Phil Yang updated HBASE-15325: -- Attachment: HBASE-15325-v5.txt remove all test about deleting then regionMove since we do not define

[jira] [Updated] (HBASE-15325) ResultScanner allowing partial result will miss the rest of the row if the region is moved between two rpc requests

2016-02-29 Thread Phil Yang (JIRA)
[ https://issues.apache.org/jira/browse/HBASE-15325?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Phil Yang updated HBASE-15325: -- Attachment: HBASE-15325-v4.txt Set balancer off and make sure each regionMove will not move the region

[jira] [Commented] (HBASE-15302) Reenable the other tests disabled by HBASE-14678

2016-02-26 Thread Phil Yang (JIRA)
[ https://issues.apache.org/jira/browse/HBASE-15302?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15169125#comment-15169125 ] Phil Yang commented on HBASE-15302: --- This patch only adds tests and changes an interface, no logic

[jira] [Commented] (HBASE-15325) ResultScanner allowing partial result will miss the rest of the row if the region is moved between two rpc requests

2016-02-26 Thread Phil Yang (JIRA)
[ https://issues.apache.org/jira/browse/HBASE-15325?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15169381#comment-15169381 ] Phil Yang commented on HBASE-15325: --- [~tedyu] Thank you for reviewing. {quote} What if allResultSkipped

[jira] [Updated] (HBASE-15325) ResultScanner allowing partial result will miss the rest of the row if the region is moved between two rpc requests

2016-02-26 Thread Phil Yang (JIRA)
[ https://issues.apache.org/jira/browse/HBASE-15325?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Phil Yang updated HBASE-15325: -- Attachment: HBASE-15325-v2.txt upload v2 to fix bug and typo > ResultScanner allowing partial result

[jira] [Commented] (HBASE-15325) ResultScanner allowing partial result will miss the rest of the row if the region is moved between two rpc requests

2016-02-26 Thread Phil Yang (JIRA)
[ https://issues.apache.org/jira/browse/HBASE-15325?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15169454#comment-15169454 ] Phil Yang commented on HBASE-15325: --- [~cuijianwei] Agree with you, there is another bug. I am

[jira] [Commented] (HBASE-15325) ResultScanner allowing partial result will miss the rest of the row if the region is moved between two rpc requests

2016-02-26 Thread Phil Yang (JIRA)
[ https://issues.apache.org/jira/browse/HBASE-15325?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15169501#comment-15169501 ] Phil Yang commented on HBASE-15325: --- And I find that my tests may fail randomly with low probability on

[jira] [Updated] (HBASE-15325) ResultScanner allowing partial result will miss the rest of the row if the region is moved between two rpc requests

2016-02-26 Thread Phil Yang (JIRA)
[ https://issues.apache.org/jira/browse/HBASE-15325?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Phil Yang updated HBASE-15325: -- Attachment: HBASE-15325-v3.txt fix batching bug > ResultScanner allowing partial result will miss the

[jira] [Commented] (HBASE-14678) Experiment: Temporarily disable balancer and a few others to see if root of crashed/timedout JVMs

2016-02-19 Thread Phil Yang (JIRA)
[ https://issues.apache.org/jira/browse/HBASE-14678?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15154131#comment-15154131 ] Phil Yang commented on HBASE-14678: --- Hi [~stack], it seems that some test cases are deleted by this

[jira] [Commented] (HBASE-14678) Experiment: Temporarily disable balancer and a few others to see if root of crashed/timedout JVMs

2016-02-21 Thread Phil Yang (JIRA)
[ https://issues.apache.org/jira/browse/HBASE-14678?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15156431#comment-15156431 ] Phil Yang commented on HBASE-14678: --- I have created a subtask to add them back. Working on it :) >

[jira] [Created] (HBASE-15302) Reenable the other tests disabled by HBASE-14678

2016-02-21 Thread Phil Yang (JIRA)
Phil Yang created HBASE-15302: - Summary: Reenable the other tests disabled by HBASE-14678 Key: HBASE-15302 URL: https://issues.apache.org/jira/browse/HBASE-15302 Project: HBase Issue Type:

[jira] [Updated] (HBASE-15302) Reenable the other tests disabled by HBASE-14678

2016-02-21 Thread Phil Yang (JIRA)
[ https://issues.apache.org/jira/browse/HBASE-15302?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Phil Yang updated HBASE-15302: -- Status: Patch Available (was: Open) > Reenable the other tests disabled by HBASE-14678 >

[jira] [Commented] (HBASE-15302) Reenable the other tests disabled by HBASE-14678

2016-02-21 Thread Phil Yang (JIRA)
[ https://issues.apache.org/jira/browse/HBASE-15302?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15156560#comment-15156560 ] Phil Yang commented on HBASE-15302: --- I find no test set it to false, and I use a temp file name to be

[jira] [Updated] (HBASE-15302) Reenable the other tests disabled by HBASE-14678

2016-02-21 Thread Phil Yang (JIRA)
[ https://issues.apache.org/jira/browse/HBASE-15302?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Phil Yang updated HBASE-15302: -- Attachment: HBASE-15302-v1.txt Submit a patch. Change some cases on Put.add -> Put.addColumn. And

[jira] [Updated] (HBASE-15325) ResultScanner allowing partial result will miss the rest of the row if the region is moved between two rpc requests

2016-02-29 Thread Phil Yang (JIRA)
[ https://issues.apache.org/jira/browse/HBASE-15325?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Phil Yang updated HBASE-15325: -- Attachment: HBASE-15325-v6.txt Fix typo according to review and add more assert on isPartial to detect

[jira] [Updated] (HBASE-15325) ResultScanner allowing partial result will miss the rest of the row if the region is moved between two rpc requests

2016-03-18 Thread Phil Yang (JIRA)
[ https://issues.apache.org/jira/browse/HBASE-15325?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Phil Yang updated HBASE-15325: -- Attachment: (was: HBASE-15325-v11.patch) > ResultScanner allowing partial result will miss the

[jira] [Updated] (HBASE-15302) Reenable the other tests disabled by HBASE-14678

2016-03-18 Thread Phil Yang (JIRA)
[ https://issues.apache.org/jira/browse/HBASE-15302?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Phil Yang updated HBASE-15302: -- Attachment: HBASE-15302-branch-1-v1.patch rebuild on QA since branch-1 changed these days. > Reenable

[jira] [Commented] (HBASE-15302) Reenable the other tests disabled by HBASE-14678

2016-03-18 Thread Phil Yang (JIRA)
[ https://issues.apache.org/jira/browse/HBASE-15302?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15201435#comment-15201435 ] Phil Yang commented on HBASE-15302: --- There are many warnings and they seems not caused by this patch.

[jira] [Commented] (HBASE-15325) ResultScanner allowing partial result will miss the rest of the row if the region is moved between two rpc requests

2016-03-15 Thread Phil Yang (JIRA)
[ https://issues.apache.org/jira/browse/HBASE-15325?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15196633#comment-15196633 ] Phil Yang commented on HBASE-15325: --- {quote} But the results that is already stored and the one that we

[jira] [Commented] (HBASE-15325) ResultScanner allowing partial result will miss the rest of the row if the region is moved between two rpc requests

2016-03-13 Thread Phil Yang (JIRA)
[ https://issues.apache.org/jira/browse/HBASE-15325?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15192679#comment-15192679 ] Phil Yang commented on HBASE-15325: --- {quote} Now the new scan is being created with start row = current

[jira] [Commented] (HBASE-15398) Cells loss or disorder when using family essential filter and partial scanning protocol

2016-03-14 Thread Phil Yang (JIRA)
[ https://issues.apache.org/jira/browse/HBASE-15398?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15192875#comment-15192875 ] Phil Yang commented on HBASE-15398: --- {quote} The following comparator will work for user-space results

[jira] [Updated] (HBASE-15325) ResultScanner allowing partial result will miss the rest of the row if the region is moved between two rpc requests

2016-03-14 Thread Phil Yang (JIRA)
[ https://issues.apache.org/jira/browse/HBASE-15325?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Phil Yang updated HBASE-15325: -- Attachment: HBASE-15325-v7.patch Upload new patch with the conclusion we have. It is a little more

[jira] [Updated] (HBASE-15325) ResultScanner allowing partial result will miss the rest of the row if the region is moved between two rpc requests

2016-03-15 Thread Phil Yang (JIRA)
[ https://issues.apache.org/jira/browse/HBASE-15325?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Phil Yang updated HBASE-15325: -- Attachment: HBASE-15325-v9.patch v8 missed tests on batching. Upload v9. v9 only fix cell missing

[jira] [Updated] (HBASE-15325) ResultScanner allowing partial result will miss the rest of the row if the region is moved between two rpc requests

2016-03-15 Thread Phil Yang (JIRA)
[ https://issues.apache.org/jira/browse/HBASE-15325?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Phil Yang updated HBASE-15325: -- Attachment: HBASE-15325-v10.patch Revise according to reviews > ResultScanner allowing partial result

[jira] [Commented] (HBASE-15325) ResultScanner allowing partial result will miss the rest of the row if the region is moved between two rpc requests

2016-03-15 Thread Phil Yang (JIRA)
[ https://issues.apache.org/jira/browse/HBASE-15325?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15195135#comment-15195135 ] Phil Yang commented on HBASE-15325: --- If you don't setBatch or setAllowPartial(true), you will not miss

[jira] [Commented] (HBASE-15325) ResultScanner allowing partial result will miss the rest of the row if the region is moved between two rpc requests

2016-03-15 Thread Phil Yang (JIRA)
[ https://issues.apache.org/jira/browse/HBASE-15325?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15195134#comment-15195134 ] Phil Yang commented on HBASE-15325: --- If you don't setBatch or setAllowPartial(true), you will not miss

[jira] [Commented] (HBASE-15325) ResultScanner allowing partial result will miss the rest of the row if the region is moved between two rpc requests

2016-03-15 Thread Phil Yang (JIRA)
[ https://issues.apache.org/jira/browse/HBASE-15325?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15194898#comment-15194898 ] Phil Yang commented on HBASE-15325: --- {quote} Here in test we allow partial results but we have

[jira] [Commented] (HBASE-15325) ResultScanner allowing partial result will miss the rest of the row if the region is moved between two rpc requests

2016-03-08 Thread Phil Yang (JIRA)
[ https://issues.apache.org/jira/browse/HBASE-15325?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15186363#comment-15186363 ] Phil Yang commented on HBASE-15325: --- Yes, the main work is at client side. And we need add

[jira] [Commented] (HBASE-15398) Cells loss or disorder when using family essential filter and partial scanning protocol

2016-03-08 Thread Phil Yang (JIRA)
[ https://issues.apache.org/jira/browse/HBASE-15398?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15186339#comment-15186339 ] Phil Yang commented on HBASE-15398: --- Still working :) I refactor RegionSannerImpl.nextInternal so I

[jira] [Commented] (HBASE-15325) ResultScanner allowing partial result will miss the rest of the row if the region is moved between two rpc requests

2016-03-08 Thread Phil Yang (JIRA)
[ https://issues.apache.org/jira/browse/HBASE-15325?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15186393#comment-15186393 ] Phil Yang commented on HBASE-15325: --- Oh I get your point now. Sounds reasonable. So we need also judge

[jira] [Updated] (HBASE-15378) Scanner can not handle a heartbeat message with no results

2016-03-08 Thread Phil Yang (JIRA)
[ https://issues.apache.org/jira/browse/HBASE-15378?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Phil Yang updated HBASE-15378: -- Attachment: HBASE-15378-v4.patch remove printStackTrace and ignore it > Scanner can not handle a

[jira] [Commented] (HBASE-15378) Scanner can not handle a heartbeat message with no results

2016-03-08 Thread Phil Yang (JIRA)
[ https://issues.apache.org/jira/browse/HBASE-15378?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15186400#comment-15186400 ] Phil Yang commented on HBASE-15378: --- Done, thanks. > Scanner can not handle a heartbeat message with

[jira] [Updated] (HBASE-15378) Scanner can not handle a heartbeat message with no results

2016-03-08 Thread Phil Yang (JIRA)
[ https://issues.apache.org/jira/browse/HBASE-15378?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Phil Yang updated HBASE-15378: -- Attachment: HBASE-15378-v5.patch > Scanner can not handle a heartbeat message with no results >

[jira] [Commented] (HBASE-15398) Cells loss or disorder when using family essential filter and partial scanning protocol

2016-03-08 Thread Phil Yang (JIRA)
[ https://issues.apache.org/jira/browse/HBASE-15398?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15186526#comment-15186526 ] Phil Yang commented on HBASE-15398: --- It seems that if we put all cf into joinedHeap, we will not scan

[jira] [Commented] (HBASE-15398) Cells loss or disorder when using family essential filter and partial scanning protocol

2016-03-08 Thread Phil Yang (JIRA)
[ https://issues.apache.org/jira/browse/HBASE-15398?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15186635#comment-15186635 ] Phil Yang commented on HBASE-15398: --- I find if I add a client-side logic to judge if joinedHeap will

[jira] [Commented] (HBASE-15378) Scanner can not handle a heartbeat message with no results

2016-03-09 Thread Phil Yang (JIRA)
[ https://issues.apache.org/jira/browse/HBASE-15378?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15186948#comment-15186948 ] Phil Yang commented on HBASE-15378: --- Seems each job in

[jira] [Commented] (HBASE-15325) ResultScanner allowing partial result will miss the rest of the row if the region is moved between two rpc requests

2016-03-11 Thread Phil Yang (JIRA)
[ https://issues.apache.org/jira/browse/HBASE-15325?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15190916#comment-15190916 ] Phil Yang commented on HBASE-15325: --- I am still working on this. Will submit new patch this weekend or

[jira] [Updated] (HBASE-15398) Cells loss or disorder when using family essential filter and partial scanning protocol

2016-03-19 Thread Phil Yang (JIRA)
[ https://issues.apache.org/jira/browse/HBASE-15398?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Phil Yang updated HBASE-15398: -- Attachment: HBASE-15398-v5.patch Ban filters which will use joinedHeap and hasFilterRow return false.

[jira] [Updated] (HBASE-15484) Correct the semantic of batch and partial

2016-03-19 Thread Phil Yang (JIRA)
[ https://issues.apache.org/jira/browse/HBASE-15484?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Phil Yang updated HBASE-15484: -- Attachment: HBASE-15484-v1.patch > Correct the semantic of batch and partial >

[jira] [Commented] (HBASE-15325) ResultScanner allowing partial result will miss the rest of the row if the region is moved between two rpc requests

2016-03-19 Thread Phil Yang (JIRA)
[ https://issues.apache.org/jira/browse/HBASE-15325?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15200887#comment-15200887 ] Phil Yang commented on HBASE-15325: --- TestPartialResultsFromClientSide is one of tests removed by

  1   2   3   4   5   6   7   8   9   10   >