[jira] [Commented] (HBASE-15389) Write out multiple files when compaction

2016-03-21 Thread Duo Zhang (JIRA)
[ https://issues.apache.org/jira/browse/HBASE-15389?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15205653#comment-15205653 ] Duo Zhang commented on HBASE-15389: --- So let's set the fix version to 1.4.0? Then we have plenty of time

[jira] [Commented] (HBASE-15389) Write out multiple files when compaction

2016-03-21 Thread Duo Zhang (JIRA)
[ https://issues.apache.org/jira/browse/HBASE-15389?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15205608#comment-15205608 ] Duo Zhang commented on HBASE-15389: --- [~enis] [~davelatham] [~clarax98007] If no new concerns, let's

[jira] [Updated] (HBASE-15265) Implement an asynchronous FSHLog

2016-03-21 Thread Duo Zhang (JIRA)
[ https://issues.apache.org/jira/browse/HBASE-15265?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Duo Zhang updated HBASE-15265: -- Attachment: (was: HBASE-15265-v8.patch) > Implement an asynchronous FSHLog >

[jira] [Updated] (HBASE-15389) Write out multiple files when compaction

2016-03-21 Thread Duo Zhang (JIRA)
[ https://issues.apache.org/jira/browse/HBASE-15389?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Duo Zhang updated HBASE-15389: -- Affects Version/s: (was: 1.3.0) 1.4.0 Fix Version/s: (was:

[jira] [Commented] (HBASE-15360) Fix flaky TestSimpleRpcScheduler

2016-03-21 Thread Duo Zhang (JIRA)
[ https://issues.apache.org/jira/browse/HBASE-15360?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15205594#comment-15205594 ] Duo Zhang commented on HBASE-15360: --- Let's open a new issue for this? [~tedyu] The patch uploaded here

[jira] [Commented] (HBASE-15495) Connection leak in FanOutOneBlockAsyncDFSOutputHelper

2016-03-21 Thread Duo Zhang (JIRA)
[ https://issues.apache.org/jira/browse/HBASE-15495?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15205610#comment-15205610 ] Duo Zhang commented on HBASE-15495: --- Let me see the hadoop compatibility issues... > Connection leak

[jira] [Updated] (HBASE-15495) Connection leak in FanOutOneBlockAsyncDFSOutputHelper

2016-03-21 Thread Duo Zhang (JIRA)
[ https://issues.apache.org/jira/browse/HBASE-15495?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Duo Zhang updated HBASE-15495: -- Attachment: HBASE-15495-v2.patch Addressing the hadoop compatibility issue. > Connection leak in

[jira] [Updated] (HBASE-15389) Write out multiple files when compaction

2016-03-22 Thread Duo Zhang (JIRA)
[ https://issues.apache.org/jira/browse/HBASE-15389?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Duo Zhang updated HBASE-15389: -- Attachment: HBASE-15389-0.98.v1.patch > Write out multiple files when compaction >

[jira] [Updated] (HBASE-15389) Write out multiple files when compaction

2016-03-21 Thread Duo Zhang (JIRA)
[ https://issues.apache.org/jira/browse/HBASE-15389?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Duo Zhang updated HBASE-15389: -- Attachment: (was: HBASE-15389-v1-0.98.patch) > Write out multiple files when compaction >

[jira] [Updated] (HBASE-15360) Fix flaky TestSimpleRpcScheduler

2016-03-22 Thread Duo Zhang (JIRA)
[ https://issues.apache.org/jira/browse/HBASE-15360?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Duo Zhang updated HBASE-15360: -- Attachment: HBASE-15360-addendum.patch Use EnvironmentEdge to get a stable result. And also fix a typo

[jira] [Updated] (HBASE-15360) Fix flaky TestSimpleRpcScheduler

2016-03-22 Thread Duo Zhang (JIRA)
[ https://issues.apache.org/jira/browse/HBASE-15360?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Duo Zhang updated HBASE-15360: -- Affects Version/s: 1.4.0 Status: Patch Available (was: Reopened) > Fix flaky

[jira] [Updated] (HBASE-15360) Fix flaky TestSimpleRpcScheduler

2016-03-22 Thread Duo Zhang (JIRA)
[ https://issues.apache.org/jira/browse/HBASE-15360?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Duo Zhang updated HBASE-15360: -- Attachment: HBASE-15360-addendum.patch Try again to see if TestSimpleRpcScheduler can still pass. >

[jira] [Commented] (HBASE-15495) Connection leak in FanOutOneBlockAsyncDFSOutputHelper

2016-03-22 Thread Duo Zhang (JIRA)
[ https://issues.apache.org/jira/browse/HBASE-15495?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15206263#comment-15206263 ] Duo Zhang commented on HBASE-15495: --- '304m 48s', really slow... I think the failed and timed outd tests

[jira] [Updated] (HBASE-15389) Write out multiple files when compaction

2016-03-22 Thread Duo Zhang (JIRA)
[ https://issues.apache.org/jira/browse/HBASE-15389?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Duo Zhang updated HBASE-15389: -- Attachment: HBASE-15389-v14.patch rebase for master. > Write out multiple files when compaction >

[jira] [Commented] (HBASE-15265) Implement an asynchronous FSHLog

2016-03-22 Thread Duo Zhang (JIRA)
[ https://issues.apache.org/jira/browse/HBASE-15265?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15207562#comment-15207562 ] Duo Zhang commented on HBASE-15265: --- Seems not related? I do not change the default WAL implementation.

[jira] [Commented] (HBASE-15520) Fix broken TestAsyncIPC

2016-03-23 Thread Duo Zhang (JIRA)
[ https://issues.apache.org/jira/browse/HBASE-15520?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15209659#comment-15209659 ] Duo Zhang commented on HBASE-15520: --- Checked locally, the checkstyle errors in

[jira] [Updated] (HBASE-15520) Fix broken TestAsyncIPC

2016-03-23 Thread Duo Zhang (JIRA)
[ https://issues.apache.org/jira/browse/HBASE-15520?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Duo Zhang updated HBASE-15520: -- Resolution: Fixed Hadoop Flags: Reviewed Status: Resolved (was: Patch Available)

[jira] [Commented] (HBASE-15389) Write out multiple files when compaction

2016-03-23 Thread Duo Zhang (JIRA)
[ https://issues.apache.org/jira/browse/HBASE-15389?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15209575#comment-15209575 ] Duo Zhang commented on HBASE-15389: --- Oh, the patch for 0.98 should be stale. I will provide a new one

[jira] [Updated] (HBASE-15520) Fix broken TestAsyncIPC

2016-03-23 Thread Duo Zhang (JIRA)
[ https://issues.apache.org/jira/browse/HBASE-15520?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Duo Zhang updated HBASE-15520: -- Attachment: HBASE-15520-v1.patch Fix the checkstyle issues > Fix broken TestAsyncIPC >

[jira] [Commented] (HBASE-15265) Implement an asynchronous FSHLog

2016-03-24 Thread Duo Zhang (JIRA)
[ https://issues.apache.org/jira/browse/HBASE-15265?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15210112#comment-15210112 ] Duo Zhang commented on HBASE-15265: --- [~stack] This time we stopped at TestHFile...Let's wait for the

[jira] [Commented] (HBASE-15389) Write out multiple files when compaction

2016-03-24 Thread Duo Zhang (JIRA)
[ https://issues.apache.org/jira/browse/HBASE-15389?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15210082#comment-15210082 ] Duo Zhang commented on HBASE-15389: --- There is test failing introduced by HBASE-15475, and it is also a

[jira] [Commented] (HBASE-15384) Avoid using '/tmp' directory in TestBulkLoad

2016-03-24 Thread Duo Zhang (JIRA)
[ https://issues.apache.org/jira/browse/HBASE-15384?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15210150#comment-15210150 ] Duo Zhang commented on HBASE-15384: --- +1. > Avoid using '/tmp' directory in TestBulkLoad >

[jira] [Commented] (HBASE-15454) Archive store files older than max age

2016-03-24 Thread Duo Zhang (JIRA)
[ https://issues.apache.org/jira/browse/HBASE-15454?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15210130#comment-15210130 ] Duo Zhang commented on HBASE-15454: --- No completed design yet but I prefer doing it automatically. Will

[jira] [Comment Edited] (HBASE-15475) Allow TimestampsFilter to provide a seek hint

2016-03-24 Thread Duo Zhang (JIRA)
[ https://issues.apache.org/jira/browse/HBASE-15475?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15210076#comment-15210076 ] Duo Zhang edited comment on HBASE-15475 at 3/24/16 11:03 AM: - The

[jira] [Commented] (HBASE-15475) Allow TimestampsFilter to provide a seek hint

2016-03-24 Thread Duo Zhang (JIRA)
[ https://issues.apache.org/jira/browse/HBASE-15475?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15210076#comment-15210076 ] Duo Zhang commented on HBASE-15475: --- The TestHFile.testShortMidpointSameQual added by this patch can

[jira] [Updated] (HBASE-15389) Write out multiple files when compaction

2016-03-24 Thread Duo Zhang (JIRA)
[ https://issues.apache.org/jira/browse/HBASE-15389?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Duo Zhang updated HBASE-15389: -- Attachment: HBASE-15389-branch-1.v1.patch > Write out multiple files when compaction >

[jira] [Commented] (HBASE-15389) Write out multiple files when compaction

2016-03-25 Thread Duo Zhang (JIRA)
[ https://issues.apache.org/jira/browse/HBASE-15389?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15211479#comment-15211479 ] Duo Zhang commented on HBASE-15389: --- Finally... Will commit shortly. > Write out multiple files when

[jira] [Updated] (HBASE-15407) Add SASL support for fan out OutputStream

2016-03-25 Thread Duo Zhang (JIRA)
[ https://issues.apache.org/jira/browse/HBASE-15407?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Duo Zhang updated HBASE-15407: -- Attachment: HBASE-15407-v2.patch Addressing the compatibility issue. > Add SASL support for fan out

[jira] [Updated] (HBASE-15389) Write out multiple files when compaction

2016-03-25 Thread Duo Zhang (JIRA)
[ https://issues.apache.org/jira/browse/HBASE-15389?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Duo Zhang updated HBASE-15389: -- Resolution: Fixed Hadoop Flags: Reviewed Fix Version/s: 1.3.0 Status: Resolved

[jira] [Created] (HBASE-15527) Refactor Compactor related classes

2016-03-25 Thread Duo Zhang (JIRA)
Duo Zhang created HBASE-15527: - Summary: Refactor Compactor related classes Key: HBASE-15527 URL: https://issues.apache.org/jira/browse/HBASE-15527 Project: HBase Issue Type: Sub-task

[jira] [Updated] (HBASE-15265) Implement an asynchronous FSHLog

2016-03-25 Thread Duo Zhang (JIRA)
[ https://issues.apache.org/jira/browse/HBASE-15265?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Duo Zhang updated HBASE-15265: -- Attachment: HBASE-15265-v8.patch I think the failing is not related but let's try again. [~stack] Is

[jira] [Updated] (HBASE-15407) Add SASL support for fan out OutputStream

2016-03-25 Thread Duo Zhang (JIRA)
[ https://issues.apache.org/jira/browse/HBASE-15407?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Duo Zhang updated HBASE-15407: -- Attachment: HBASE-15407-v3.patch Oh the getParameterCount method is introduced in jdk1.8... > Add

[jira] [Commented] (HBASE-15389) Write out multiple files when compaction

2016-03-25 Thread Duo Zhang (JIRA)
[ https://issues.apache.org/jira/browse/HBASE-15389?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15211849#comment-15211849 ] Duo Zhang commented on HBASE-15389: --- Oh I have fixed the checkstyle errors before committing. You can

[jira] [Updated] (HBASE-15495) Connection leak in FanOutOneBlockAsyncDFSOutputHelper

2016-03-21 Thread Duo Zhang (JIRA)
[ https://issues.apache.org/jira/browse/HBASE-15495?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Duo Zhang updated HBASE-15495: -- Attachment: HBASE-15495.patch It is not easy to test this problem because we do not have the reference

[jira] [Updated] (HBASE-15407) Add SASL support for fan out OutputStream

2016-03-21 Thread Duo Zhang (JIRA)
[ https://issues.apache.org/jira/browse/HBASE-15407?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Duo Zhang updated HBASE-15407: -- Attachment: HBASE-15407-v1.patch Implement crypto. > Add SASL support for fan out OutputStream >

[jira] [Created] (HBASE-15495) Connection leak in FanOutOneBlockAsyncDFSOutputHelper

2016-03-21 Thread Duo Zhang (JIRA)
Duo Zhang created HBASE-15495: - Summary: Connection leak in FanOutOneBlockAsyncDFSOutputHelper Key: HBASE-15495 URL: https://issues.apache.org/jira/browse/HBASE-15495 Project: HBase Issue Type:

[jira] [Updated] (HBASE-15495) Connection leak in FanOutOneBlockAsyncDFSOutputHelper

2016-03-21 Thread Duo Zhang (JIRA)
[ https://issues.apache.org/jira/browse/HBASE-15495?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Duo Zhang updated HBASE-15495: -- Status: Patch Available (was: Open) > Connection leak in FanOutOneBlockAsyncDFSOutputHelper >

[jira] [Updated] (HBASE-15495) Connection leak in FanOutOneBlockAsyncDFSOutputHelper

2016-03-21 Thread Duo Zhang (JIRA)
[ https://issues.apache.org/jira/browse/HBASE-15495?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Duo Zhang updated HBASE-15495: -- Attachment: HBASE-15495-v1.patch Use Log instead of printStackTrace. > Connection leak in

[jira] [Updated] (HBASE-15389) Write out multiple files when compaction

2016-03-25 Thread Duo Zhang (JIRA)
[ https://issues.apache.org/jira/browse/HBASE-15389?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Duo Zhang updated HBASE-15389: -- Description: Add {{DateTieredCompactor}} and {{DateTieredMultiFileWriter}} to support writing out

[jira] [Commented] (HBASE-15265) Implement an asynchronous FSHLog

2016-03-25 Thread Duo Zhang (JIRA)
[ https://issues.apache.org/jira/browse/HBASE-15265?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15212675#comment-15212675 ] Duo Zhang commented on HBASE-15265: --- The failing tests are unrelated. Can fix the checkstyle issue when

[jira] [Commented] (HBASE-15389) Write out multiple files when compaction

2016-03-25 Thread Duo Zhang (JIRA)
[ https://issues.apache.org/jira/browse/HBASE-15389?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15212631#comment-15212631 ] Duo Zhang commented on HBASE-15389: --- Add a simple description. HBASE-15400 will make this feature

[jira] [Updated] (HBASE-15265) Implement an asynchronous FSHLog

2016-03-26 Thread Duo Zhang (JIRA)
[ https://issues.apache.org/jira/browse/HBASE-15265?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Duo Zhang updated HBASE-15265: -- Resolution: Fixed Hadoop Flags: Reviewed Status: Resolved (was: Patch Available)

[jira] [Created] (HBASE-15538) Implement secure async protobuf wal reader and writer

2016-03-26 Thread Duo Zhang (JIRA)
Duo Zhang created HBASE-15538: - Summary: Implement secure async protobuf wal reader and writer Key: HBASE-15538 URL: https://issues.apache.org/jira/browse/HBASE-15538 Project: HBase Issue Type:

[jira] [Created] (HBASE-15537) Add multi WAL support for AsyncFSWAL

2016-03-26 Thread Duo Zhang (JIRA)
Duo Zhang created HBASE-15537: - Summary: Add multi WAL support for AsyncFSWAL Key: HBASE-15537 URL: https://issues.apache.org/jira/browse/HBASE-15537 Project: HBase Issue Type: Sub-task

[jira] [Created] (HBASE-15536) Make AsyncFSWAL as our default WAL

2016-03-26 Thread Duo Zhang (JIRA)
Duo Zhang created HBASE-15536: - Summary: Make AsyncFSWAL as our default WAL Key: HBASE-15536 URL: https://issues.apache.org/jira/browse/HBASE-15536 Project: HBase Issue Type: Sub-task

[jira] [Updated] (HBASE-15407) Add SASL support for fan out OutputStream

2016-03-26 Thread Duo Zhang (JIRA)
[ https://issues.apache.org/jira/browse/HBASE-15407?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Duo Zhang updated HBASE-15407: -- Attachment: HBASE-15407-v4.patch > Add SASL support for fan out OutputStream >

[jira] [Updated] (HBASE-15538) Implement secure async protobuf wal writer

2016-03-26 Thread Duo Zhang (JIRA)
[ https://issues.apache.org/jira/browse/HBASE-15538?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Duo Zhang updated HBASE-15538: -- Summary: Implement secure async protobuf wal writer (was: Implement secure async protobuf wal reader

[jira] [Updated] (HBASE-15407) Add SASL support for fan out OutputStream

2016-03-27 Thread Duo Zhang (JIRA)
[ https://issues.apache.org/jira/browse/HBASE-15407?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Duo Zhang updated HBASE-15407: -- Attachment: HBASE-15407-v5.patch Addressing comments on RB. > Add SASL support for fan out

[jira] [Updated] (HBASE-15538) Implement secure async protobuf wal writer

2016-03-27 Thread Duo Zhang (JIRA)
[ https://issues.apache.org/jira/browse/HBASE-15538?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Duo Zhang updated HBASE-15538: -- Assignee: Duo Zhang Fix Version/s: 2.0.0 Status: Patch Available (was: Open) >

[jira] [Updated] (HBASE-15538) Implement secure async protobuf wal writer

2016-03-27 Thread Duo Zhang (JIRA)
[ https://issues.apache.org/jira/browse/HBASE-15538?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Duo Zhang updated HBASE-15538: -- Attachment: HBASE-15538.patch > Implement secure async protobuf wal writer >

[jira] [Commented] (HBASE-15407) Add SASL support for fan out OutputStream

2016-03-27 Thread Duo Zhang (JIRA)
[ https://issues.apache.org/jira/browse/HBASE-15407?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15213476#comment-15213476 ] Duo Zhang commented on HBASE-15407: --- I think this is a very common pattern used in for loop? For

[jira] [Updated] (HBASE-15495) Connection leak in FanOutOneBlockAsyncDFSOutputHelper

2016-03-22 Thread Duo Zhang (JIRA)
[ https://issues.apache.org/jira/browse/HBASE-15495?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Duo Zhang updated HBASE-15495: -- Resolution: Fixed Hadoop Flags: Reviewed Fix Version/s: 2.0.0 Status: Resolved

[jira] [Updated] (HBASE-15265) Implement an asynchronous FSHLog

2016-03-22 Thread Duo Zhang (JIRA)
[ https://issues.apache.org/jira/browse/HBASE-15265?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Duo Zhang updated HBASE-15265: -- Attachment: HBASE-15265-v8.patch Seems we haven't run the large tests... > Implement an asynchronous

[jira] [Updated] (HBASE-15520) Fix broken TestAsyncIPC

2016-03-23 Thread Duo Zhang (JIRA)
[ https://issues.apache.org/jira/browse/HBASE-15520?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Duo Zhang updated HBASE-15520: -- Attachment: (was: HBASE-15520.patch) > Fix broken TestAsyncIPC > --- > >

[jira] [Created] (HBASE-15520) Fix broken TestAsyncIPC

2016-03-22 Thread Duo Zhang (JIRA)
Duo Zhang created HBASE-15520: - Summary: Fix broken TestAsyncIPC Key: HBASE-15520 URL: https://issues.apache.org/jira/browse/HBASE-15520 Project: HBase Issue Type: Bug Reporter: Duo

[jira] [Commented] (HBASE-15212) RRCServer should enforce max request size

2016-03-22 Thread Duo Zhang (JIRA)
[ https://issues.apache.org/jira/browse/HBASE-15212?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15207879#comment-15207879 ] Duo Zhang commented on HBASE-15212: --- Seems this cause TestAsyncIPC.testRpcMaxRequestSize fail? >

[jira] [Updated] (HBASE-15520) Fix broken TestAsyncIPC

2016-03-22 Thread Duo Zhang (JIRA)
[ https://issues.apache.org/jira/browse/HBASE-15520?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Duo Zhang updated HBASE-15520: -- Fix Version/s: 1.4.0 1.3.0 2.0.0 Affects

[jira] [Commented] (HBASE-15407) Add SASL support for fan out OutputStream

2016-03-22 Thread Duo Zhang (JIRA)
[ https://issues.apache.org/jira/browse/HBASE-15407?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15207791#comment-15207791 ] Duo Zhang commented on HBASE-15407: --- Let me try addressing the compatibility issue. > Add SASL support

[jira] [Updated] (HBASE-15520) Fix broken TestAsyncIPC

2016-03-22 Thread Duo Zhang (JIRA)
[ https://issues.apache.org/jira/browse/HBASE-15520?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Duo Zhang updated HBASE-15520: -- Attachment: HBASE-15520.patch > Fix broken TestAsyncIPC > --- > >

[jira] [Updated] (HBASE-15360) Fix flaky TestSimpleRpcScheduler

2016-03-19 Thread Duo Zhang (JIRA)
[ https://issues.apache.org/jira/browse/HBASE-15360?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Duo Zhang updated HBASE-15360: -- Attachment: HBASE-15360.patch I think the problem is testSoftAndHardQueueLimits. Add this can make it

[jira] [Updated] (HBASE-15389) Write out multiple files when compaction

2016-03-19 Thread Duo Zhang (JIRA)
[ https://issues.apache.org/jira/browse/HBASE-15389?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Duo Zhang updated HBASE-15389: -- Attachment: HBASE-15389-v11.patch Add debug log for maxSeqId and isMajor. > Write out multiple files

[jira] [Updated] (HBASE-15265) Implement an asynchronous FSHLog

2016-03-24 Thread Duo Zhang (JIRA)
[ https://issues.apache.org/jira/browse/HBASE-15265?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Duo Zhang updated HBASE-15265: -- Attachment: HBASE-15265-v8.patch > Implement an asynchronous FSHLog >

[jira] [Updated] (HBASE-15389) Write out multiple files when compaction

2016-03-23 Thread Duo Zhang (JIRA)
[ https://issues.apache.org/jira/browse/HBASE-15389?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Duo Zhang updated HBASE-15389: -- Attachment: (was: HBASE-15389-v14.patch) > Write out multiple files when compaction >

[jira] [Updated] (HBASE-15389) Write out multiple files when compaction

2016-03-23 Thread Duo Zhang (JIRA)
[ https://issues.apache.org/jira/browse/HBASE-15389?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Duo Zhang updated HBASE-15389: -- Attachment: HBASE-15389-v14.patch > Write out multiple files when compaction >

[jira] [Updated] (HBASE-15389) Write out multiple files when compaction

2016-03-23 Thread Duo Zhang (JIRA)
[ https://issues.apache.org/jira/browse/HBASE-15389?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Duo Zhang updated HBASE-15389: -- Attachment: HBASE-15389-0.98.v2.patch > Write out multiple files when compaction >

[jira] [Commented] (HBASE-15389) Write out multiple files when compaction

2016-03-24 Thread Duo Zhang (JIRA)
[ https://issues.apache.org/jira/browse/HBASE-15389?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15209829#comment-15209829 ] Duo Zhang commented on HBASE-15389: --- {quote} Since regression tests didn't find them, could you double

[jira] [Updated] (HBASE-15265) Implement an asynchronous FSHLog

2016-03-24 Thread Duo Zhang (JIRA)
[ https://issues.apache.org/jira/browse/HBASE-15265?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Duo Zhang updated HBASE-15265: -- Attachment: HBASE-15265-v8.patch retry. > Implement an asynchronous FSHLog >

[jira] [Updated] (HBASE-15389) Write out multiple files when compaction

2016-03-24 Thread Duo Zhang (JIRA)
[ https://issues.apache.org/jira/browse/HBASE-15389?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Duo Zhang updated HBASE-15389: -- Attachment: HBASE-15389-0.98.v3.patch > Write out multiple files when compaction >

[jira] [Commented] (HBASE-15389) Write out multiple files when compaction

2016-03-24 Thread Duo Zhang (JIRA)
[ https://issues.apache.org/jira/browse/HBASE-15389?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15209877#comment-15209877 ] Duo Zhang commented on HBASE-15389: --- Oh I got it, the former should be DROP, not RETAIN. Let me fix it.

[jira] [Updated] (HBASE-15389) Write out multiple files when compaction

2016-03-24 Thread Duo Zhang (JIRA)
[ https://issues.apache.org/jira/browse/HBASE-15389?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Duo Zhang updated HBASE-15389: -- Attachment: (was: HBASE-15389-v14.patch) > Write out multiple files when compaction >

[jira] [Updated] (HBASE-15389) Write out multiple files when compaction

2016-03-24 Thread Duo Zhang (JIRA)
[ https://issues.apache.org/jira/browse/HBASE-15389?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Duo Zhang updated HBASE-15389: -- Attachment: HBASE-15389-v14.patch > Write out multiple files when compaction >

[jira] [Commented] (HBASE-15389) Write out multiple files when compaction

2016-03-07 Thread Duo Zhang (JIRA)
[ https://issues.apache.org/jira/browse/HBASE-15389?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15182916#comment-15182916 ] Duo Zhang commented on HBASE-15389: ---

[jira] [Updated] (HBASE-15389) Write out multiple files when compaction

2016-03-07 Thread Duo Zhang (JIRA)
[ https://issues.apache.org/jira/browse/HBASE-15389?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Duo Zhang updated HBASE-15389: -- Attachment: HBASE-15389-v2.patch Addressing the findbugs warning. > Write out multiple files when

[jira] [Updated] (HBASE-15265) Implement an asynchronous FSHLog

2016-03-07 Thread Duo Zhang (JIRA)
[ https://issues.apache.org/jira/browse/HBASE-15265?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Duo Zhang updated HBASE-15265: -- Attachment: HBASE-15265-v6.patch Fix a typo that cause negative value of metrics. > Implement an

[jira] [Commented] (HBASE-15400) Use DateTieredCompactor for Date Tiered Compaction

2016-03-07 Thread Duo Zhang (JIRA)
[ https://issues.apache.org/jira/browse/HBASE-15400?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15184215#comment-15184215 ] Duo Zhang commented on HBASE-15400: --- [~clarax98007] I haven't include {{DateTieredCompactionRequest}}

[jira] [Commented] (HBASE-15265) Implement an asynchronous FSHLog

2016-03-07 Thread Duo Zhang (JIRA)
[ https://issues.apache.org/jira/browse/HBASE-15265?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15184421#comment-15184421 ] Duo Zhang commented on HBASE-15265: --- [~stack] I have run a WALPE on a 5 node cluster. On master branch

[jira] [Commented] (HBASE-15338) Add a option to disable the data block cache for testing the performance of underlying file system

2016-03-07 Thread Duo Zhang (JIRA)
[ https://issues.apache.org/jira/browse/HBASE-15338?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15184230#comment-15184230 ] Duo Zhang commented on HBASE-15338: ---

[jira] [Commented] (HBASE-15389) Write out multiple files when compaction

2016-03-07 Thread Duo Zhang (JIRA)
[ https://issues.apache.org/jira/browse/HBASE-15389?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15184201#comment-15184201 ] Duo Zhang commented on HBASE-15389: --- AFAICT, {{CompactionPolicy}} is only used to select files for

[jira] [Commented] (HBASE-15265) Implement an asynchronous FSHLog

2016-03-07 Thread Duo Zhang (JIRA)
[ https://issues.apache.org/jira/browse/HBASE-15265?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15184500#comment-15184500 ] Duo Zhang commented on HBASE-15265: --- Run WALPE with 5 threads {noformat} ./bin/hbase

[jira] [Commented] (HBASE-15420) TestCacheConfig failed after HBASE-15338

2016-03-07 Thread Duo Zhang (JIRA)
[ https://issues.apache.org/jira/browse/HBASE-15420?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15184319#comment-15184319 ] Duo Zhang commented on HBASE-15420: --- +1 > TestCacheConfig failed after HBASE-15338 >

[jira] [Updated] (HBASE-15389) Write out multiple files when compaction

2016-03-08 Thread Duo Zhang (JIRA)
[ https://issues.apache.org/jira/browse/HBASE-15389?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Duo Zhang updated HBASE-15389: -- Attachment: HBASE-15389-v3.patch Addressing the comments on rb. > Write out multiple files when

[jira] [Updated] (HBASE-15389) Write out multiple files when compaction

2016-03-08 Thread Duo Zhang (JIRA)
[ https://issues.apache.org/jira/browse/HBASE-15389?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Duo Zhang updated HBASE-15389: -- Attachment: HBASE-15389-v4.patch Fix complication error on jdk7... > Write out multiple files when

[jira] [Updated] (HBASE-15389) Write out multiple files when compaction

2016-03-03 Thread Duo Zhang (JIRA)
[ https://issues.apache.org/jira/browse/HBASE-15389?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Duo Zhang updated HBASE-15389: -- Attachment: HBASE-15389-uc.patch I have to attend a training course today and it is Friday in China so

[jira] [Created] (HBASE-15389) Write out multiple files when compaction

2016-03-03 Thread Duo Zhang (JIRA)
Duo Zhang created HBASE-15389: - Summary: Write out multiple files when compaction Key: HBASE-15389 URL: https://issues.apache.org/jira/browse/HBASE-15389 Project: HBase Issue Type: Sub-task

[jira] [Commented] (HBASE-15339) Improve DateTieredCompactionPolicy

2016-03-03 Thread Duo Zhang (JIRA)
[ https://issues.apache.org/jira/browse/HBASE-15339?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15179137#comment-15179137 ] Duo Zhang commented on HBASE-15339: --- Is it possible to write data directly into BlockCache when

[jira] [Commented] (HBASE-15339) Improve DateTieredCompactionPolicy

2016-03-03 Thread Duo Zhang (JIRA)
[ https://issues.apache.org/jira/browse/HBASE-15339?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15179324#comment-15179324 ] Duo Zhang commented on HBASE-15339: --- {quote} What I imagine we want is to be able to write to block

[jira] [Commented] (HBASE-15389) Write out multiple files when compaction

2016-03-03 Thread Duo Zhang (JIRA)
[ https://issues.apache.org/jira/browse/HBASE-15389?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15179326#comment-15179326 ] Duo Zhang commented on HBASE-15389: --- {quote} We can add sorting in DateTierCompactionPolicy that uses

[jira] [Commented] (HBASE-15400) Using Multiple Output for Date Tiered Compaction

2016-03-05 Thread Duo Zhang (JIRA)
[ https://issues.apache.org/jira/browse/HBASE-15400?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15181990#comment-15181990 ] Duo Zhang commented on HBASE-15400: --- {quote} 4. Since we will assign the same seq id for all output

[jira] [Commented] (HBASE-15389) Write out multiple files when compaction

2016-03-06 Thread Duo Zhang (JIRA)
[ https://issues.apache.org/jira/browse/HBASE-15389?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15182079#comment-15182079 ] Duo Zhang commented on HBASE-15389: --- Fine, let me write a testcase for the compactor and see how to

[jira] [Commented] (HBASE-15400) Using Multiple Output for Date Tiered Compaction

2016-03-06 Thread Duo Zhang (JIRA)
[ https://issues.apache.org/jira/browse/HBASE-15400?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15182080#comment-15182080 ] Duo Zhang commented on HBASE-15400: --- For minor compaction, we can only assign different seqIds which

[jira] [Commented] (HBASE-15389) Write out multiple files when compaction

2016-03-06 Thread Duo Zhang (JIRA)
[ https://issues.apache.org/jira/browse/HBASE-15389?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15182504#comment-15182504 ] Duo Zhang commented on HBASE-15389: --- OK, you will include the StoreEngine in your patch? This is should

[jira] [Created] (HBASE-15407) Add SASL support for fan out OutputStream

2016-03-06 Thread Duo Zhang (JIRA)
Duo Zhang created HBASE-15407: - Summary: Add SASL support for fan out OutputStream Key: HBASE-15407 URL: https://issues.apache.org/jira/browse/HBASE-15407 Project: HBase Issue Type: Sub-task

[jira] [Commented] (HBASE-15389) Write out multiple files when compaction

2016-03-06 Thread Duo Zhang (JIRA)
[ https://issues.apache.org/jira/browse/HBASE-15389?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15182459#comment-15182459 ] Duo Zhang commented on HBASE-15389: --- I think we can work parallel but to commit with two separated

[jira] [Commented] (HBASE-15391) Avoid too large "deleted from META" info log

2016-03-06 Thread Duo Zhang (JIRA)
[ https://issues.apache.org/jira/browse/HBASE-15391?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15182610#comment-15182610 ] Duo Zhang commented on HBASE-15391: --- {code} +if (LOG.isDebugEnabled()) { +

[jira] [Commented] (HBASE-15389) Write out multiple files when compaction

2016-03-07 Thread Duo Zhang (JIRA)
[ https://issues.apache.org/jira/browse/HBASE-15389?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15182745#comment-15182745 ] Duo Zhang commented on HBASE-15389: --- Oh, typo, let me fix it. > Write out multiple files when

[jira] [Updated] (HBASE-15389) Write out multiple files when compaction

2016-03-07 Thread Duo Zhang (JIRA)
[ https://issues.apache.org/jira/browse/HBASE-15389?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Duo Zhang updated HBASE-15389: -- Attachment: HBASE-15389-v1.patch > Write out multiple files when compaction >

[jira] [Updated] (HBASE-15365) Do not write to '/tmp' in TestHBaseConfiguration

2016-03-01 Thread Duo Zhang (JIRA)
[ https://issues.apache.org/jira/browse/HBASE-15365?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Duo Zhang updated HBASE-15365: -- Resolution: Fixed Hadoop Flags: Reviewed Fix Version/s: 1.4.0 0.98.18

[jira] [Commented] (HBASE-15373) DEPRECATED_NAME_OF_NO_LIMIT_THROUGHPUT_CONTROLLER_CLASS value is wrong in CompactionThroughputControllerFactory

2016-03-01 Thread Duo Zhang (JIRA)
[ https://issues.apache.org/jira/browse/HBASE-15373?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15174955#comment-15174955 ] Duo Zhang commented on HBASE-15373: --- +1 > DEPRECATED_NAME_OF_NO_LIMIT_THROUGHPUT_CONTROLLER_CLASS

[jira] [Updated] (HBASE-15375) Do not write to '/tmp' in TestRegionMover

2016-03-01 Thread Duo Zhang (JIRA)
[ https://issues.apache.org/jira/browse/HBASE-15375?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Duo Zhang updated HBASE-15375: -- Status: Patch Available (was: Open) > Do not write to '/tmp' in TestRegionMover >

[jira] [Updated] (HBASE-15375) Do not write to '/tmp' in TestRegionMover

2016-03-01 Thread Duo Zhang (JIRA)
[ https://issues.apache.org/jira/browse/HBASE-15375?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Duo Zhang updated HBASE-15375: -- Attachment: HBASE-15375.patch > Do not write to '/tmp' in TestRegionMover >

<    1   2   3   4   5   6   7   8   9   10   >