[jira] [Commented] (HBASE-13811) Splitting WALs, we are filtering out too many edits - DATALOSS

2015-06-04 Thread Duo Zhang (JIRA)
[ https://issues.apache.org/jira/browse/HBASE-13811?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14573900#comment-14573900 ] Duo Zhang commented on HBASE-13811: --- {quote} Rather than add a new method that does

[jira] [Commented] (HBASE-13811) Splitting WALs, we are filtering out too many edits - DATALOSS

2015-06-03 Thread Duo Zhang (JIRA)
[ https://issues.apache.org/jira/browse/HBASE-13811?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14571917#comment-14571917 ] Duo Zhang commented on HBASE-13811: --- {code} flushOpSeqId = getNextSequenceId(wal);

[jira] [Commented] (HBASE-13811) Splitting WALs, we are filtering out too many edits - DATALOSS

2015-06-05 Thread Duo Zhang (JIRA)
[ https://issues.apache.org/jira/browse/HBASE-13811?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14574311#comment-14574311 ] Duo Zhang commented on HBASE-13811: --- {quote} We can actually tell when we are flushing

[jira] [Commented] (HBASE-13811) Splitting WALs, we are filtering out too many edits - DATALOSS

2015-06-05 Thread Duo Zhang (JIRA)
[ https://issues.apache.org/jira/browse/HBASE-13811?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14574227#comment-14574227 ] Duo Zhang commented on HBASE-13811: --- {quote} Pardon me, I don't see the problem here?

[jira] [Updated] (HBASE-13811) Splitting WALs, we are filtering out too many edits - DATALOSS

2015-06-05 Thread Duo Zhang (JIRA)
[ https://issues.apache.org/jira/browse/HBASE-13811?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Duo Zhang updated HBASE-13811: -- Attachment: startCacheFlush.diff Implement flushedSeqId calculation inside startCacheFlush.

[jira] [Commented] (HBASE-13811) Splitting WALs, we are filtering out too many edits - DATALOSS

2015-06-05 Thread Duo Zhang (JIRA)
[ https://issues.apache.org/jira/browse/HBASE-13811?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14575398#comment-14575398 ] Duo Zhang commented on HBASE-13811: --- +1 on the latest version. Hope it can pass ITBLL.

[jira] [Commented] (HBASE-13853) ITBLL data loss in HBase-1.1

2015-06-07 Thread Duo Zhang (JIRA)
[ https://issues.apache.org/jira/browse/HBASE-13853?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14576573#comment-14576573 ] Duo Zhang commented on HBASE-13853: --- HBASE-13811 ? ITBLL data loss in HBase-1.1

[jira] [Commented] (HBASE-13853) ITBLL data loss in HBase-1.1

2015-06-07 Thread Duo Zhang (JIRA)
[ https://issues.apache.org/jira/browse/HBASE-13853?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14576576#comment-14576576 ] Duo Zhang commented on HBASE-13853: --- And what's the failures with DLR? DLR doesn't get

[jira] [Commented] (HBASE-13853) ITBLL data loss in HBase-1.1

2015-06-07 Thread Duo Zhang (JIRA)
[ https://issues.apache.org/jira/browse/HBASE-13853?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14576585#comment-14576585 ] Duo Zhang commented on HBASE-13853: --- I indicated in HBASE-13811 that this issue could

[jira] [Commented] (HBASE-13853) ITBLL data loss in HBase-1.1

2015-06-07 Thread Duo Zhang (JIRA)
[ https://issues.apache.org/jira/browse/HBASE-13853?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14576598#comment-14576598 ] Duo Zhang commented on HBASE-13853: --- I think we could back port the patch on

[jira] [Updated] (HBASE-13811) Splitting WALs, we are filtering out too many edits - DATALOSS

2015-06-08 Thread Duo Zhang (JIRA)
[ https://issues.apache.org/jira/browse/HBASE-13811?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Duo Zhang updated HBASE-13811: -- Attachment: HBASE-13811-branch-1.1.patch [~enis] patch for 1.1. Splitting WALs, we are filtering out

[jira] [Commented] (HBASE-13811) Splitting WALs, we are filtering out too many edits - DATALOSS

2015-06-02 Thread Duo Zhang (JIRA)
[ https://issues.apache.org/jira/browse/HBASE-13811?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14570013#comment-14570013 ] Duo Zhang commented on HBASE-13811: --- My fault, haven't seen hbase jira these

[jira] [Commented] (HBASE-13811) Splitting WALs, we are filtering out too many edits - DATALOSS

2015-06-04 Thread Duo Zhang (JIRA)
[ https://issues.apache.org/jira/browse/HBASE-13811?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14572388#comment-14572388 ] Duo Zhang commented on HBASE-13811: --- {quote} I just set it to the flush sequenceid

[jira] [Commented] (HBASE-13811) Splitting WALs, we are filtering out too many edits - DATALOSS

2015-06-03 Thread Duo Zhang (JIRA)
[ https://issues.apache.org/jira/browse/HBASE-13811?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14572051#comment-14572051 ] Duo Zhang commented on HBASE-13811: --- If we flush all data in memstore, then use the

[jira] [Commented] (HBASE-13877) Interrupt to flush from TableFlushProcedure causes dataloss in ITBLL

2015-06-09 Thread Duo Zhang (JIRA)
[ https://issues.apache.org/jira/browse/HBASE-13877?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14579783#comment-14579783 ] Duo Zhang commented on HBASE-13877: --- In MemStoreFlusher we catch

[jira] [Commented] (HBASE-13877) Interrupt to flush from TableFlushProcedure causes dataloss in ITBLL

2015-06-09 Thread Duo Zhang (JIRA)
[ https://issues.apache.org/jira/browse/HBASE-13877?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14579870#comment-14579870 ] Duo Zhang commented on HBASE-13877: --- {code} i've added extra abort() statement to

[jira] [Comment Edited] (HBASE-13877) Interrupt to flush from TableFlushProcedure causes dataloss in ITBLL

2015-06-09 Thread Duo Zhang (JIRA)
[ https://issues.apache.org/jira/browse/HBASE-13877?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14579870#comment-14579870 ] Duo Zhang edited comment on HBASE-13877 at 6/10/15 2:16 AM:

[jira] [Commented] (HBASE-13937) Partially revert HBASE-13172

2015-06-19 Thread Duo Zhang (JIRA)
[ https://issues.apache.org/jira/browse/HBASE-13937?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14594157#comment-14594157 ] Duo Zhang commented on HBASE-13937: --- {quote} thus guaranteeing that the region server

[jira] [Updated] (HBASE-13970) NPE during compaction in trunk

2015-06-25 Thread Duo Zhang (JIRA)
[ https://issues.apache.org/jira/browse/HBASE-13970?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Duo Zhang updated HBASE-13970: -- Attachment: HBASE-13970.patch A simple patch that add an increment AtomicInteger as the suffix of

[jira] [Commented] (HBASE-13970) NPE during compaction in trunk

2015-06-25 Thread Duo Zhang (JIRA)
[ https://issues.apache.org/jira/browse/HBASE-13970?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14601295#comment-14601295 ] Duo Zhang commented on HBASE-13970: --- Oh, this should be a bug on all branches which

[jira] [Updated] (HBASE-13970) NPE during compaction in trunk

2015-06-25 Thread Duo Zhang (JIRA)
[ https://issues.apache.org/jira/browse/HBASE-13970?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Duo Zhang updated HBASE-13970: -- Fix Version/s: 1.1.2 1.2.0 0.98.14 Affects

[jira] [Updated] (HBASE-13970) NPE during compaction in trunk

2015-06-25 Thread Duo Zhang (JIRA)
[ https://issues.apache.org/jira/browse/HBASE-13970?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Duo Zhang updated HBASE-13970: -- Attachment: HBASE-13970-v1.patch Overflow is OK as what [~anoopsamjohn] said, we only need unique

[jira] [Commented] (HBASE-13937) Partially revert HBASE-13172

2015-06-18 Thread Duo Zhang (JIRA)
[ https://issues.apache.org/jira/browse/HBASE-13937?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14592928#comment-14592928 ] Duo Zhang commented on HBASE-13937: --- {quote} In theory we should not have

[jira] [Commented] (HBASE-13937) Partially revert HBASE-13172

2015-06-18 Thread Duo Zhang (JIRA)
[ https://issues.apache.org/jira/browse/HBASE-13937?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14592814#comment-14592814 ] Duo Zhang commented on HBASE-13937: --- For isServerReachable, I think we can say a server

[jira] [Commented] (HBASE-13899) Jacoco instrumentation fails under jdk8

2015-06-14 Thread Duo Zhang (JIRA)
[ https://issues.apache.org/jira/browse/HBASE-13899?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14585042#comment-14585042 ] Duo Zhang commented on HBASE-13899: --- Seems our jacoco version is really old {code}

[jira] [Updated] (HBASE-13899) Jacoco instrumentation fails under jdk8

2015-06-14 Thread Duo Zhang (JIRA)
[ https://issues.apache.org/jira/browse/HBASE-13899?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Duo Zhang updated HBASE-13899: -- Assignee: Duo Zhang Affects Version/s: 2.0.0 Status: Patch Available (was:

[jira] [Updated] (HBASE-13899) Jacoco instrumentation fails under jdk8

2015-06-14 Thread Duo Zhang (JIRA)
[ https://issues.apache.org/jira/browse/HBASE-13899?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Duo Zhang updated HBASE-13899: -- Attachment: HBASE-13899.patch One line patch. Jacoco instrumentation fails under jdk8

[jira] [Updated] (HBASE-13899) Jacoco instrumentation fails under jdk8

2015-06-14 Thread Duo Zhang (JIRA)
[ https://issues.apache.org/jira/browse/HBASE-13899?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Duo Zhang updated HBASE-13899: -- Resolution: Fixed Hadoop Flags: Reviewed Status: Resolved (was: Patch Available)

[jira] [Commented] (HBASE-13903) Speedup IdLock

2015-06-15 Thread Duo Zhang (JIRA)
[ https://issues.apache.org/jira/browse/HBASE-13903?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14587266#comment-14587266 ] Duo Zhang commented on HBASE-13903: --- What about just use a StripedLock and give each

[jira] [Commented] (HBASE-13877) Interrupt to flush from TableFlushProcedure causes dataloss in ITBLL

2015-06-11 Thread Duo Zhang (JIRA)
[ https://issues.apache.org/jira/browse/HBASE-13877?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14582742#comment-14582742 ] Duo Zhang commented on HBASE-13877: --- +1 on patch v3. Interrupt to flush from

[jira] [Comment Edited] (HBASE-13811) Splitting WALs, we are filtering out too many edits - DATALOSS

2015-06-02 Thread Duo Zhang (JIRA)
[ https://issues.apache.org/jira/browse/HBASE-13811?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14570198#comment-14570198 ] Duo Zhang edited comment on HBASE-13811 at 6/3/15 3:02 AM: ---

[jira] [Updated] (HBASE-13811) Splitting WALs, we are filtering out too many edits - DATALOSS

2015-06-02 Thread Duo Zhang (JIRA)
[ https://issues.apache.org/jira/browse/HBASE-13811?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Duo Zhang updated HBASE-13811: -- Attachment: HBASE-13811.testcase.patch Write a testcase. It fails for me with {noformat}

[jira] [Commented] (HBASE-13811) Splitting WALs, we are filtering out too many edits - DATALOSS

2015-06-02 Thread Duo Zhang (JIRA)
[ https://issues.apache.org/jira/browse/HBASE-13811?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14570273#comment-14570273 ] Duo Zhang commented on HBASE-13811: --- Yeah, with the patch in place {code}

[jira] [Updated] (HBASE-13811) Splitting WALs, we are filtering out too many edits - DATALOSS

2015-06-02 Thread Duo Zhang (JIRA)
[ https://issues.apache.org/jira/browse/HBASE-13811?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Duo Zhang updated HBASE-13811: -- Attachment: HBASE-13811-v1.testcase.patch [~stack] Try this one? Just make a RegionServerReport

[jira] [Commented] (HBASE-13970) NPE during compaction in trunk

2015-06-30 Thread Duo Zhang (JIRA)
[ https://issues.apache.org/jira/browse/HBASE-13970?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14609386#comment-14609386 ] Duo Zhang commented on HBASE-13970: --- [~ram_krish] Any progress? Thanks. NPE during

[jira] [Updated] (HBASE-13970) NPE during compaction in trunk

2015-07-02 Thread Duo Zhang (JIRA)
[ https://issues.apache.org/jira/browse/HBASE-13970?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Duo Zhang updated HBASE-13970: -- Resolution: Fixed Assignee: Duo Zhang (was: ramkrishna.s.vasudevan) Hadoop Flags:

[jira] [Commented] (HBASE-14262) Big Trunk unit tests failing with OutOfMemoryError: unable to create new native thread

2015-08-19 Thread Duo Zhang (JIRA)
[ https://issues.apache.org/jira/browse/HBASE-14262?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14704233#comment-14704233 ] Duo Zhang commented on HBASE-14262: --- {quote} If I revert HBASE-13065,

[jira] [Commented] (HBASE-13970) NPE during compaction in trunk

2015-06-26 Thread Duo Zhang (JIRA)
[ https://issues.apache.org/jira/browse/HBASE-13970?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14602704#comment-14602704 ] Duo Zhang commented on HBASE-13970: --- No, counter can not be same for 2 threads. For a

[jira] [Commented] (HBASE-14178) regionserver blocks because of waiting for offsetLock

2015-08-02 Thread Duo Zhang (JIRA)
[ https://issues.apache.org/jira/browse/HBASE-14178?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14650729#comment-14650729 ] Duo Zhang commented on HBASE-14178: --- I think the problem here is we only allow one

[jira] [Commented] (HBASE-14178) regionserver blocks because of waiting for offsetLock

2015-08-04 Thread Duo Zhang (JIRA)
[ https://issues.apache.org/jira/browse/HBASE-14178?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14653201#comment-14653201 ] Duo Zhang commented on HBASE-14178: --- [~anoopsamjohn] {{CacheConfig}} is a bit

[jira] [Commented] (HBASE-14178) regionserver blocks because of waiting for offsetLock

2015-08-04 Thread Duo Zhang (JIRA)
[ https://issues.apache.org/jira/browse/HBASE-14178?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14653415#comment-14653415 ] Duo Zhang commented on HBASE-14178: --- Yes, the problem here is the lock, not when to

[jira] [Updated] (HBASE-14178) regionserver blocks because of waiting for offsetLock

2015-08-05 Thread Duo Zhang (JIRA)
[ https://issues.apache.org/jira/browse/HBASE-14178?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Duo Zhang updated HBASE-14178: -- Attachment: (was: HBASE-14178_v6.patch) regionserver blocks because of waiting for offsetLock

[jira] [Updated] (HBASE-14178) regionserver blocks because of waiting for offsetLock

2015-08-05 Thread Duo Zhang (JIRA)
[ https://issues.apache.org/jira/browse/HBASE-14178?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Duo Zhang updated HBASE-14178: -- Attachment: HBASE-14178_v6.patch A flaky test(TestFastFail) failed in pre-commit. Retry.

[jira] [Updated] (HBASE-14178) regionserver blocks because of waiting for offsetLock

2015-08-05 Thread Duo Zhang (JIRA)
[ https://issues.apache.org/jira/browse/HBASE-14178?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Duo Zhang updated HBASE-14178: -- Attachment: (was: HBASE-14178_v6.patch) regionserver blocks because of waiting for offsetLock

[jira] [Updated] (HBASE-14178) regionserver blocks because of waiting for offsetLock

2015-08-05 Thread Duo Zhang (JIRA)
[ https://issues.apache.org/jira/browse/HBASE-14178?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Duo Zhang updated HBASE-14178: -- Attachment: HBASE-14178_v6.patch Retry. regionserver blocks because of waiting for offsetLock

[jira] [Commented] (HBASE-14178) regionserver blocks because of waiting for offsetLock

2015-08-04 Thread Duo Zhang (JIRA)
[ https://issues.apache.org/jira/browse/HBASE-14178?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14654613#comment-14654613 ] Duo Zhang commented on HBASE-14178: --- Oh, I looked into wrong ling number... It is the

[jira] [Updated] (HBASE-14178) regionserver blocks because of waiting for offsetLock

2015-08-04 Thread Duo Zhang (JIRA)
[ https://issues.apache.org/jira/browse/HBASE-14178?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Duo Zhang updated HBASE-14178: -- Attachment: HBASE-14178_v6.patch Retry. regionserver blocks because of waiting for offsetLock

[jira] [Updated] (HBASE-14178) regionserver blocks because of waiting for offsetLock

2015-08-04 Thread Duo Zhang (JIRA)
[ https://issues.apache.org/jira/browse/HBASE-14178?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Duo Zhang updated HBASE-14178: -- Attachment: (was: HBASE-14178_v6.patch) regionserver blocks because of waiting for offsetLock

[jira] [Commented] (HBASE-14178) regionserver blocks because of waiting for offsetLock

2015-08-04 Thread Duo Zhang (JIRA)
[ https://issues.apache.org/jira/browse/HBASE-14178?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14654607#comment-14654607 ] Duo Zhang commented on HBASE-14178: --- [~tedyu] If {{blockType}} is {{null}} then we can

[jira] [Commented] (HBASE-13408) HBase In-Memory Memstore Compaction

2015-07-30 Thread Duo Zhang (JIRA)
[ https://issues.apache.org/jira/browse/HBASE-13408?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14647348#comment-14647348 ] Duo Zhang commented on HBASE-13408: --- OK, I get your point. After a memstore compaction

[jira] [Commented] (HBASE-13408) HBase In-Memory Memstore Compaction

2015-07-29 Thread Duo Zhang (JIRA)
[ https://issues.apache.org/jira/browse/HBASE-13408?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14646101#comment-14646101 ] Duo Zhang commented on HBASE-13408: --- Things we talking here are all 'In Memory', so I

[jira] [Commented] (HBASE-14178) regionserver blocks because of waiting for offsetLock

2015-08-05 Thread Duo Zhang (JIRA)
[ https://issues.apache.org/jira/browse/HBASE-14178?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14659524#comment-14659524 ] Duo Zhang commented on HBASE-14178: --- Yes, we doing more round of check with lock

[jira] [Comment Edited] (HBASE-14178) regionserver blocks because of waiting for offsetLock

2015-08-06 Thread Duo Zhang (JIRA)
[ https://issues.apache.org/jira/browse/HBASE-14178?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14659574#comment-14659574 ] Duo Zhang edited comment on HBASE-14178 at 8/6/15 6:46 AM: ---

[jira] [Commented] (HBASE-14178) regionserver blocks because of waiting for offsetLock

2015-08-06 Thread Duo Zhang (JIRA)
[ https://issues.apache.org/jira/browse/HBASE-14178?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14659574#comment-14659574 ] Duo Zhang commented on HBASE-14178: --- [~ram_krish] A bit strange but now,

[jira] [Commented] (HBASE-14178) regionserver blocks because of waiting for offsetLock

2015-08-06 Thread Duo Zhang (JIRA)
[ https://issues.apache.org/jira/browse/HBASE-14178?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14659614#comment-14659614 ] Duo Zhang commented on HBASE-14178: --- [~anoopsamjohn] [~ram_krish] Any concerns on patch

[jira] [Updated] (HBASE-14178) regionserver blocks because of waiting for offsetLock

2015-08-06 Thread Duo Zhang (JIRA)
[ https://issues.apache.org/jira/browse/HBASE-14178?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Duo Zhang updated HBASE-14178: -- Assignee: Heng Chen Priority: Major (was: Critical) Fix Version/s: (was: 0.98.6)

[jira] [Updated] (HBASE-14178) regionserver blocks because of waiting for offsetLock

2015-08-06 Thread Duo Zhang (JIRA)
[ https://issues.apache.org/jira/browse/HBASE-14178?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Duo Zhang updated HBASE-14178: -- Resolution: Fixed Hadoop Flags: Reviewed Status: Resolved (was: Patch Available)

[jira] [Comment Edited] (HBASE-14178) regionserver blocks because of waiting for offsetLock

2015-08-06 Thread Duo Zhang (JIRA)
[ https://issues.apache.org/jira/browse/HBASE-14178?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14659728#comment-14659728 ] Duo Zhang edited comment on HBASE-14178 at 8/6/15 9:23 AM: ---

[jira] [Commented] (HBASE-14178) regionserver blocks because of waiting for offsetLock

2015-08-06 Thread Duo Zhang (JIRA)
[ https://issues.apache.org/jira/browse/HBASE-14178?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14659681#comment-14659681 ] Duo Zhang commented on HBASE-14178: --- [~chenheng] Could you please also prepare patch

[jira] [Commented] (HBASE-14178) regionserver blocks because of waiting for offsetLock

2015-08-05 Thread Duo Zhang (JIRA)
[ https://issues.apache.org/jira/browse/HBASE-14178?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14659274#comment-14659274 ] Duo Zhang commented on HBASE-14178: --- [~anoopsamjohn] Any concerns of patch v6? Thanks.

[jira] [Commented] (HBASE-14100) Fix high priority findbugs warnings

2015-07-16 Thread Duo Zhang (JIRA)
[ https://issues.apache.org/jira/browse/HBASE-14100?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14629735#comment-14629735 ] Duo Zhang commented on HBASE-14100: --- [~ram_krish] Fine. Is HBASE-12213 almost done? If

[jira] [Commented] (HBASE-14100) Fix high priority findbugs warnings

2015-07-16 Thread Duo Zhang (JIRA)
[ https://issues.apache.org/jira/browse/HBASE-14100?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14629695#comment-14629695 ] Duo Zhang commented on HBASE-14100: --- {code:title=WALSplitter.java} 1208 for

[jira] [Commented] (HBASE-14100) Fix high priority findbugs warnings

2015-07-16 Thread Duo Zhang (JIRA)
[ https://issues.apache.org/jira/browse/HBASE-14100?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14629672#comment-14629672 ] Duo Zhang commented on HBASE-14100: --- {{DMI_INVOKING_TOSTRING_ON_ARRAY}}

[jira] [Updated] (HBASE-14100) Fix high priority findbugs warnings

2015-07-16 Thread Duo Zhang (JIRA)
[ https://issues.apache.org/jira/browse/HBASE-14100?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Duo Zhang updated HBASE-14100: -- Status: Patch Available (was: Open) Fix high priority findbugs warnings

[jira] [Updated] (HBASE-14100) Fix high priority findbugs warnings

2015-07-16 Thread Duo Zhang (JIRA)
[ https://issues.apache.org/jira/browse/HBASE-14100?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Duo Zhang updated HBASE-14100: -- Attachment: HBASE-14100.patch Fix high priority findbugs warnings

[jira] [Created] (HBASE-14100) Fix high priority findbugs warnings

2015-07-16 Thread Duo Zhang (JIRA)
Duo Zhang created HBASE-14100: - Summary: Fix high priority findbugs warnings Key: HBASE-14100 URL: https://issues.apache.org/jira/browse/HBASE-14100 Project: HBase Issue Type: Bug

[jira] [Commented] (HBASE-14100) Fix high priority findbugs warnings

2015-07-16 Thread Duo Zhang (JIRA)
[ https://issues.apache.org/jira/browse/HBASE-14100?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14629690#comment-14629690 ] Duo Zhang commented on HBASE-14100: --- {{IL_INFINITE_RECURSIVE_LOOP}}

[jira] [Commented] (HBASE-14100) Fix high priority findbugs warnings

2015-07-16 Thread Duo Zhang (JIRA)
[ https://issues.apache.org/jira/browse/HBASE-14100?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14630679#comment-14630679 ] Duo Zhang commented on HBASE-14100: --- {{BloomFilterUtil}} is master only.

[jira] [Resolved] (HBASE-14113) Compile failed on master

2015-07-16 Thread Duo Zhang (JIRA)
[ https://issues.apache.org/jira/browse/HBASE-14113?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Duo Zhang resolved HBASE-14113. --- Resolution: Cannot Reproduce Fixed by running {{mvn clean}} first. Compile failed on master

[jira] [Updated] (HBASE-14100) Fix high priority findbugs warnings

2015-07-16 Thread Duo Zhang (JIRA)
[ https://issues.apache.org/jira/browse/HBASE-14100?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Duo Zhang updated HBASE-14100: -- Resolution: Fixed Fix Version/s: 1.3.0 1.1.2 1.2.0

[jira] [Commented] (HBASE-14059) We should add a RS to the dead servers list if admin calls fail more than a threshold

2015-07-19 Thread Duo Zhang (JIRA)
[ https://issues.apache.org/jira/browse/HBASE-14059?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14633048#comment-14633048 ] Duo Zhang commented on HBASE-14059: --- {quote} In the issue I ran into it was a bad

[jira] [Commented] (HBASE-14126) I'm using play framework, creating a sample Hbase project. And I keep getting this error: tried to access method com.google.common.base.Stopwatch.init()V from class

2015-07-20 Thread Duo Zhang (JIRA)
[ https://issues.apache.org/jira/browse/HBASE-14126?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14634301#comment-14634301 ] Duo Zhang commented on HBASE-14126: --- HBase uses an early version of guava. See this

[jira] [Commented] (HBASE-14004) [Replication] Inconsistency between Memstore and WAL may result in data in remote cluster that is not in the origin

2015-10-27 Thread Duo Zhang (JIRA)
[ https://issues.apache.org/jira/browse/HBASE-14004?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=14977769#comment-14977769 ] Duo Zhang commented on HBASE-14004: --- The problem here not only effects replication. {quote} As a

[jira] [Commented] (HBASE-14004) [Replication] Inconsistency between Memstore and WAL may result in data in remote cluster that is not in the origin

2015-10-28 Thread Duo Zhang (JIRA)
[ https://issues.apache.org/jira/browse/HBASE-14004?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=14978108#comment-14978108 ] Duo Zhang commented on HBASE-14004: --- [~carp84] This is an inherent problem of RPC based systems due to

[jira] [Commented] (HBASE-12959) Compact never end when table's dataBlockEncoding using PREFIX_TREE

2015-11-09 Thread Duo Zhang (JIRA)
[ https://issues.apache.org/jira/browse/HBASE-12959?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=14997903#comment-14997903 ] Duo Zhang commented on HBASE-12959: --- I sent an email to [~bdifn] long time ago to confirm whether

[jira] [Commented] (HBASE-12959) Compact never end when table's dataBlockEncoding using PREFIX_TREE

2015-11-10 Thread Duo Zhang (JIRA)
[ https://issues.apache.org/jira/browse/HBASE-12959?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=14998232#comment-14998232 ] Duo Zhang commented on HBASE-12959: --- No, I haven't met this problem yet. > Compact never end when

[jira] [Commented] (HBASE-14790) Implement a new DFSOutputStream for logging WAL only

2015-11-12 Thread Duo Zhang (JIRA)
[ https://issues.apache.org/jira/browse/HBASE-14790?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15003595#comment-15003595 ] Duo Zhang commented on HBASE-14790: --- HTTP/2 has its own problems that we haven't finish the read path

[jira] [Updated] (HBASE-14806) Missing sources.jar for several modules when building HBase

2015-11-13 Thread Duo Zhang (JIRA)
[ https://issues.apache.org/jira/browse/HBASE-14806?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Duo Zhang updated HBASE-14806: -- Attachment: HBASE-14806.patch Seems only hbase-common and hbase-external-blockcache missing

[jira] [Updated] (HBASE-14806) Missing sources.jar for several modules when building HBase

2015-11-13 Thread Duo Zhang (JIRA)
[ https://issues.apache.org/jira/browse/HBASE-14806?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Duo Zhang updated HBASE-14806: -- Assignee: Duo Zhang Affects Version/s: 2.0.0 Status: Patch Available (was:

[jira] [Created] (HBASE-14806) Missing sources.jar for several modules when building HBase

2015-11-12 Thread Duo Zhang (JIRA)
Duo Zhang created HBASE-14806: - Summary: Missing sources.jar for several modules when building HBase Key: HBASE-14806 URL: https://issues.apache.org/jira/browse/HBASE-14806 Project: HBase Issue

[jira] [Commented] (HBASE-14790) Implement a new DFSOutputStream for logging WAL only

2015-11-12 Thread Duo Zhang (JIRA)
[ https://issues.apache.org/jira/browse/HBASE-14790?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15003469#comment-15003469 ] Duo Zhang commented on HBASE-14790: --- The new implementation will be event-driven which means we could

[jira] [Commented] (HBASE-14806) Missing sources.jar for several modules when building HBase

2015-11-13 Thread Duo Zhang (JIRA)
[ https://issues.apache.org/jira/browse/HBASE-14806?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15005116#comment-15005116 ] Duo Zhang commented on HBASE-14806: --- The META-INF directory contained in the generated sources.jar

[jira] [Updated] (HBASE-14806) Missing sources.jar for several modules when building HBase

2015-11-16 Thread Duo Zhang (JIRA)
[ https://issues.apache.org/jira/browse/HBASE-14806?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Duo Zhang updated HBASE-14806: -- Affects Version/s: 1.1.3 1.3.0 1.2.0

[jira] [Updated] (HBASE-14806) Missing sources.jar for several modules when building HBase

2015-11-16 Thread Duo Zhang (JIRA)
[ https://issues.apache.org/jira/browse/HBASE-14806?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Duo Zhang updated HBASE-14806: -- Resolution: Fixed Hadoop Flags: Reviewed Status: Resolved (was: Patch Available)

[jira] [Commented] (HBASE-14790) Implement a new DFSOutputStream for logging WAL only

2015-11-10 Thread Duo Zhang (JIRA)
[ https://issues.apache.org/jira/browse/HBASE-14790?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=14998397#comment-14998397 ] Duo Zhang commented on HBASE-14790: --- The root reason of HBASE-14004 is that, HBase and HDFS may not

[jira] [Commented] (HBASE-14790) Implement a new DFSOutputStream for logging WAL only

2015-11-10 Thread Duo Zhang (JIRA)
[ https://issues.apache.org/jira/browse/HBASE-14790?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=14998407#comment-14998407 ] Duo Zhang commented on HBASE-14790: --- {quote} As for this, IMO we can set a limit, if exceed the limits,

[jira] [Commented] (HBASE-14790) Implement a new DFSOutputStream for logging WAL only

2015-11-10 Thread Duo Zhang (JIRA)
[ https://issues.apache.org/jira/browse/HBASE-14790?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=1417#comment-1417 ] Duo Zhang commented on HBASE-14790: --- {{DFSOutputStream}} has pipeline recovery, so it is hard to say

[jira] [Created] (HBASE-14790) Implement a new DFSOutputStream for logging WAL only

2015-11-09 Thread Duo Zhang (JIRA)
Duo Zhang created HBASE-14790: - Summary: Implement a new DFSOutputStream for logging WAL only Key: HBASE-14790 URL: https://issues.apache.org/jira/browse/HBASE-14790 Project: HBase Issue Type:

[jira] [Commented] (HBASE-14759) Avoid using Math.abs when selecting SyncRunner in FSHLog

2015-11-04 Thread Duo Zhang (JIRA)
[ https://issues.apache.org/jira/browse/HBASE-14759?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=14990744#comment-14990744 ] Duo Zhang commented on HBASE-14759: --- {code} this.syncRunnerIndex = (this.syncRunnerIndex + 1) %

[jira] [Updated] (HBASE-14759) Avoid using Math.abs when selecting SyncRunner in FSHLog

2015-11-04 Thread Duo Zhang (JIRA)
[ https://issues.apache.org/jira/browse/HBASE-14759?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Duo Zhang updated HBASE-14759: -- Affects Version/s: 1.2.0 2.0.0 1.0.2

[jira] [Commented] (HBASE-14759) Avoid using Math.abs when selecting SyncRunner in FSHLog

2015-11-06 Thread Duo Zhang (JIRA)
[ https://issues.apache.org/jira/browse/HBASE-14759?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=14994772#comment-14994772 ] Duo Zhang commented on HBASE-14759: --- OK, Thanks. Let me commit this. > Avoid using Math.abs when

[jira] [Updated] (HBASE-14759) Avoid using Math.abs when selecting SyncRunner in FSHLog

2015-11-06 Thread Duo Zhang (JIRA)
[ https://issues.apache.org/jira/browse/HBASE-14759?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Duo Zhang updated HBASE-14759: -- Resolution: Fixed Hadoop Flags: Reviewed Status: Resolved (was: Patch Available)

[jira] [Updated] (HBASE-14759) Avoid using Math.abs when selecting SyncRunner in FSHLog

2015-11-05 Thread Duo Zhang (JIRA)
[ https://issues.apache.org/jira/browse/HBASE-14759?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Duo Zhang updated HBASE-14759: -- Affects Version/s: 1.3.0 Fix Version/s: 1.3.0 > Avoid using Math.abs when selecting SyncRunner

[jira] [Created] (HBASE-14759) Avoid using Math.abs when selecting SyncRunner in FSHLog

2015-11-04 Thread Duo Zhang (JIRA)
Duo Zhang created HBASE-14759: - Summary: Avoid using Math.abs when selecting SyncRunner in FSHLog Key: HBASE-14759 URL: https://issues.apache.org/jira/browse/HBASE-14759 Project: HBase Issue

[jira] [Commented] (HBASE-14759) Avoid using Math.abs when selecting SyncRunner in FSHLog

2015-11-04 Thread Duo Zhang (JIRA)
[ https://issues.apache.org/jira/browse/HBASE-14759?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=14989229#comment-14989229 ] Duo Zhang commented on HBASE-14759: --- Add a simple testcase in TestFSHLog {code} @Test public void

[jira] [Updated] (HBASE-14759) Avoid using Math.abs when selecting SyncRunner in FSHLog

2015-11-04 Thread Duo Zhang (JIRA)
[ https://issues.apache.org/jira/browse/HBASE-14759?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Duo Zhang updated HBASE-14759: -- Attachment: HBASE-14759.patch > Avoid using Math.abs when selecting SyncRunner in FSHLog >

[jira] [Updated] (HBASE-14759) Avoid using Math.abs when selecting SyncRunner in FSHLog

2015-11-04 Thread Duo Zhang (JIRA)
[ https://issues.apache.org/jira/browse/HBASE-14759?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Duo Zhang updated HBASE-14759: -- Assignee: Duo Zhang Status: Patch Available (was: Open) > Avoid using Math.abs when selecting

[jira] [Commented] (HBASE-14586) Use a maven profile to run Jacoco analysis

2015-10-13 Thread Duo Zhang (JIRA)
[ https://issues.apache.org/jira/browse/HBASE-14586?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=14956135#comment-14956135 ] Duo Zhang commented on HBASE-14586: --- +1 > Use a maven profile to run Jacoco analysis >

[jira] [Commented] (HBASE-13082) Coarsen StoreScanner locks to RegionScanner

2015-10-19 Thread Duo Zhang (JIRA)
[ https://issues.apache.org/jira/browse/HBASE-13082?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=14964555#comment-14964555 ] Duo Zhang commented on HBASE-13082: --- I mean maybe we could have a fast path without locking for normal

[jira] [Commented] (HBASE-13082) Coarsen StoreScanner locks to RegionScanner

2015-10-19 Thread Duo Zhang (JIRA)
[ https://issues.apache.org/jira/browse/HBASE-13082?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=14964481#comment-14964481 ] Duo Zhang commented on HBASE-13082: --- {quote} On flush, what if we let all Scans complete before letting

  1   2   3   4   5   6   7   8   9   10   >