[jira] [Created] (HDFS-8302) Consolidate log purging logic in QJM and FJM

2015-04-30 Thread Zhe Zhang (JIRA)
Zhe Zhang created HDFS-8302: --- Summary: Consolidate log purging logic in QJM and FJM Key: HDFS-8302 URL: https://issues.apache.org/jira/browse/HDFS-8302 Project: Hadoop HDFS Issue Type: Improvement

[jira] [Commented] (HDFS-8276) LazyPersistFileScrubber should be disabled if scrubber interval configured zero

2015-04-30 Thread surendra singh lilhore (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-8276?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14521996#comment-14521996 ] surendra singh lilhore commented on HDFS-8276: -- Thanks [~arpitagarwal] for

[jira] [Commented] (HDFS-8276) LazyPersistFileScrubber should be disabled if scrubber interval configured zero

2015-04-30 Thread Arpit Agarwal (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-8276?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14521804#comment-14521804 ] Arpit Agarwal commented on HDFS-8276: - Thanks for the update and adding a test case.

[jira] [Updated] (HDFS-8299) HDFS reporting missing blocks when they are actually present due to read-only filesystem

2015-04-30 Thread Arpit Agarwal (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-8299?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Arpit Agarwal updated HDFS-8299: Description: Fsck shows missing blocks when the blocks can be found on a datanode's filesystem and

[jira] [Commented] (HDFS-8193) Add the ability to delay replica deletion for a period of time

2015-04-30 Thread Suresh Srinivas (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-8193?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14521887#comment-14521887 ] Suresh Srinivas commented on HDFS-8193: --- [~zhz], I am not clear on what use case this

[jira] [Commented] (HDFS-8283) DataStreamer cleanup and some minor improvement

2015-04-30 Thread Jing Zhao (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-8283?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14521891#comment-14521891 ] Jing Zhao commented on HDFS-8283: - bq. It seems this patch introduced a findbugs warning.

[jira] [Created] (HDFS-8301) Create a separate document for tag storage type explicitly.

2015-04-30 Thread Xiaoyu Yao (JIRA)
Xiaoyu Yao created HDFS-8301: Summary: Create a separate document for tag storage type explicitly. Key: HDFS-8301 URL: https://issues.apache.org/jira/browse/HDFS-8301 Project: Hadoop HDFS

[jira] [Created] (HDFS-8300) Fix unit test failures and findbugs warning caused by HDFS-8283

2015-04-30 Thread Jing Zhao (JIRA)
Jing Zhao created HDFS-8300: --- Summary: Fix unit test failures and findbugs warning caused by HDFS-8283 Key: HDFS-8300 URL: https://issues.apache.org/jira/browse/HDFS-8300 Project: Hadoop HDFS

[jira] [Created] (HDFS-8304) Separate out shared log purging methods for QJM (Paxos directory) and FJM

2015-04-30 Thread Zhe Zhang (JIRA)
Zhe Zhang created HDFS-8304: --- Summary: Separate out shared log purging methods for QJM (Paxos directory) and FJM Key: HDFS-8304 URL: https://issues.apache.org/jira/browse/HDFS-8304 Project: Hadoop HDFS

[jira] [Commented] (HDFS-8298) HA: NameNode should not shut down completely without quorum, doesn't recover from temporary network outages

2015-04-30 Thread Jing Zhao (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-8298?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14521912#comment-14521912 ] Jing Zhao commented on HDFS-8298: - Thanks for reporting this, Hari. Currently the active NN

[jira] [Commented] (HDFS-8276) LazyPersistFileScrubber should be disabled if scrubber interval configured zero

2015-04-30 Thread Hadoop QA (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-8276?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14521950#comment-14521950 ] Hadoop QA commented on HDFS-8276: - \\ \\ | (x) *{color:red}-1 overall{color}* | \\ \\ ||

[jira] [Assigned] (HDFS-8300) Fix unit test failures and findbugs warning caused by HDFS-8283

2015-04-30 Thread Jing Zhao (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-8300?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Jing Zhao reassigned HDFS-8300: --- Assignee: Jing Zhao Fix unit test failures and findbugs warning caused by HDFS-8283

[jira] [Created] (HDFS-8303) QJM should purge old logs in the current directory through FJM

2015-04-30 Thread Zhe Zhang (JIRA)
Zhe Zhang created HDFS-8303: --- Summary: QJM should purge old logs in the current directory through FJM Key: HDFS-8303 URL: https://issues.apache.org/jira/browse/HDFS-8303 Project: Hadoop HDFS

[jira] [Commented] (HDFS-8276) LazyPersistFileScrubber should be disabled if scrubber interval configured zero

2015-04-30 Thread Arpit Agarwal (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-8276?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14522011#comment-14522011 ] Arpit Agarwal commented on HDFS-8276: - Yes failed tests are likely due to HDFS-8300.

[jira] [Commented] (HDFS-8283) DataStreamer cleanup and some minor improvement

2015-04-30 Thread Tsz Wo Nicholas Sze (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-8283?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14522080#comment-14522080 ] Tsz Wo Nicholas Sze commented on HDFS-8283: --- Thanks Chris and Jing for reporting

[jira] [Updated] (HDFS-8303) QJM should purge old logs in the current directory through FJM

2015-04-30 Thread Zhe Zhang (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-8303?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Zhe Zhang updated HDFS-8303: Attachment: HDFS-8303.0.patch QJM should purge old logs in the current directory through FJM

[jira] [Updated] (HDFS-8300) Fix unit test failures and findbugs warning caused by HDFS-8283

2015-04-30 Thread Jing Zhao (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-8300?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Jing Zhao updated HDFS-8300: Target Version/s: 2.8.0 Fix unit test failures and findbugs warning caused by HDFS-8283

[jira] [Commented] (HDFS-8213) DFSClient should use hdfs.client.htrace HTrace configuration prefix rather than hadoop.htrace

2015-04-30 Thread stack (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-8213?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14522264#comment-14522264 ] stack commented on HDFS-8213: - +1 from me. DFSClient should use hdfs.client.htrace HTrace

[jira] [Created] (HDFS-8307) Spurious DNS Queries from hdfs shell

2015-04-30 Thread Anu Engineer (JIRA)
Anu Engineer created HDFS-8307: -- Summary: Spurious DNS Queries from hdfs shell Key: HDFS-8307 URL: https://issues.apache.org/jira/browse/HDFS-8307 Project: Hadoop HDFS Issue Type: Bug

[jira] [Commented] (HDFS-7678) Erasure coding: DFSInputStream with decode functionality

2015-04-30 Thread Hadoop QA (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-7678?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14522293#comment-14522293 ] Hadoop QA commented on HDFS-7678: - \\ \\ | (x) *{color:red}-1 overall{color}* | \\ \\ ||

[jira] [Updated] (HDFS-8303) QJM should purge old logs in the current directory through FJM

2015-04-30 Thread Zhe Zhang (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-8303?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Zhe Zhang updated HDFS-8303: Attachment: (was: HDFS-8303.0.patch) QJM should purge old logs in the current directory through FJM

[jira] [Updated] (HDFS-8303) QJM should purge old logs in the current directory through FJM

2015-04-30 Thread Zhe Zhang (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-8303?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Zhe Zhang updated HDFS-8303: Description: As the first step of the consolidation effort, QJM should call its FJM to purge the current

[jira] [Updated] (HDFS-8200) Refactor FSDirStatAndListingOp

2015-04-30 Thread Haohui Mai (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-8200?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Haohui Mai updated HDFS-8200: - Resolution: Fixed Fix Version/s: 2.8.0 Hadoop Flags: Reviewed Status: Resolved

[jira] [Updated] (HDFS-7442) Optimization for decommission-in-progress check

2015-04-30 Thread Harsh J (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-7442?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Harsh J updated HDFS-7442: -- Affects Version/s: 2.6.0 Optimization for decommission-in-progress check

[jira] [Updated] (HDFS-8303) QJM should purge old logs in the current directory through FJM

2015-04-30 Thread Zhe Zhang (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-8303?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Zhe Zhang updated HDFS-8303: Attachment: (was: HDFS-8303.0.patch) QJM should purge old logs in the current directory through FJM

[jira] [Updated] (HDFS-8303) QJM should purge old logs in the current directory through FJM

2015-04-30 Thread Zhe Zhang (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-8303?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Zhe Zhang updated HDFS-8303: Attachment: HDFS-8303.0.patch QJM should purge old logs in the current directory through FJM

[jira] [Updated] (HDFS-8305) HDFS INotify: the destination field of RenameOp should always end with the file name

2015-04-30 Thread Colin Patrick McCabe (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-8305?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Colin Patrick McCabe updated HDFS-8305: --- Attachment: HDFS-8305.001.patch HDFS INotify: the destination field of RenameOp

[jira] [Updated] (HDFS-8300) Fix unit test failures and findbugs warning caused by HDFS-8283

2015-04-30 Thread Jing Zhao (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-8300?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Jing Zhao updated HDFS-8300: Status: Patch Available (was: Open) Fix unit test failures and findbugs warning caused by HDFS-8283

[jira] [Updated] (HDFS-8300) Fix unit test failures and findbugs warning caused by HDFS-8283

2015-04-30 Thread Jing Zhao (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-8300?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Jing Zhao updated HDFS-8300: Attachment: HDFS-8300.000.patch Fix unit test failures and findbugs warning caused by HDFS-8283

[jira] [Updated] (HDFS-8300) Fix unit test failures and findbugs warning caused by HDFS-8283

2015-04-30 Thread Jing Zhao (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-8300?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Jing Zhao updated HDFS-8300: Affects Version/s: 2.8.0 Fix unit test failures and findbugs warning caused by HDFS-8283

[jira] [Updated] (HDFS-7678) Erasure coding: DFSInputStream with decode functionality

2015-04-30 Thread Zhe Zhang (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-7678?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Zhe Zhang updated HDFS-7678: Attachment: HDFS-7678-HDFS-7285.005.patch Rebased for HDFS-8282 Erasure coding: DFSInputStream with decode

[jira] [Updated] (HDFS-7442) Optimization for decommission-in-progress check

2015-04-30 Thread Harsh J (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-7442?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Harsh J updated HDFS-7442: -- Component/s: namenode Optimization for decommission-in-progress check

[jira] [Updated] (HDFS-8303) QJM should purge old logs in the current directory through FJM

2015-04-30 Thread Zhe Zhang (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-8303?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Zhe Zhang updated HDFS-8303: Attachment: HDFS-8303.0.patch Attaching a simple change to check if it passes all unit tests. Will add a new

[jira] [Updated] (HDFS-8288) Refactor DFSStripedOutputStream and StripedDataStreamer

2015-04-30 Thread Tsz Wo Nicholas Sze (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-8288?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Tsz Wo Nicholas Sze updated HDFS-8288: -- Attachment: HDFS-8288-HDFS-7285.20150430.patch Sure let's try

[jira] [Commented] (HDFS-8249) Separate HdfsConstants into the client and the server side class

2015-04-30 Thread Haohui Mai (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-8249?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14522163#comment-14522163 ] Haohui Mai commented on HDFS-8249: -- The test failures look unrelated. Separate

[jira] [Created] (HDFS-8306) Generate ACL and Xattr outputs in OIV XML outputs

2015-04-30 Thread Lei (Eddy) Xu (JIRA)
Lei (Eddy) Xu created HDFS-8306: --- Summary: Generate ACL and Xattr outputs in OIV XML outputs Key: HDFS-8306 URL: https://issues.apache.org/jira/browse/HDFS-8306 Project: Hadoop HDFS Issue

[jira] [Updated] (HDFS-8303) QJM should purge old logs in the current directory through FJM

2015-04-30 Thread Zhe Zhang (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-8303?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Zhe Zhang updated HDFS-8303: Attachment: HDFS-8303.0.patch QJM should purge old logs in the current directory through FJM

[jira] [Updated] (HDFS-8303) QJM should purge old logs in the current directory through FJM

2015-04-30 Thread Zhe Zhang (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-8303?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Zhe Zhang updated HDFS-8303: Description: As the first step of the consolidation effort, QJM should call its FJM to purge the current

[jira] [Updated] (HDFS-8303) QJM should purge old logs in the current directory through FJM

2015-04-30 Thread Zhe Zhang (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-8303?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Zhe Zhang updated HDFS-8303: Attachment: (was: HDFS-8303.0.patch) QJM should purge old logs in the current directory through FJM

[jira] [Updated] (HDFS-6757) Simplify lease manager with INodeID

2015-04-30 Thread Haohui Mai (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-6757?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Haohui Mai updated HDFS-6757: - Attachment: HDFS-6757.011.patch Simplify lease manager with INodeID ---

[jira] [Commented] (HDFS-6757) Simplify lease manager with INodeID

2015-04-30 Thread Hadoop QA (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-6757?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14522075#comment-14522075 ] Hadoop QA commented on HDFS-6757: - \\ \\ | (x) *{color:red}-1 overall{color}* | \\ \\ ||

[jira] [Updated] (HDFS-6757) Simplify lease manager with INodeID

2015-04-30 Thread Haohui Mai (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-6757?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Haohui Mai updated HDFS-6757: - Attachment: HDFS-6757.012.patch Simplify lease manager with INodeID ---

[jira] [Updated] (HDFS-8303) QJM should purge old logs in the current directory through FJM

2015-04-30 Thread Zhe Zhang (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-8303?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Zhe Zhang updated HDFS-8303: Description: As the first step of the consolidation effort, QJM should call its FJM to purge the current

[jira] [Commented] (HDFS-8200) Refactor FSDirStatAndListingOp

2015-04-30 Thread Brandon Li (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-8200?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14522192#comment-14522192 ] Brandon Li commented on HDFS-8200: -- +1. Refactor FSDirStatAndListingOp

[jira] [Updated] (HDFS-8305) HDFS INotify: the destination field of RenameOp should always end with the file name

2015-04-30 Thread Colin Patrick McCabe (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-8305?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Colin Patrick McCabe updated HDFS-8305: --- Status: Patch Available (was: Open) HDFS INotify: the destination field of RenameOp

[jira] [Updated] (HDFS-8303) QJM should purge old logs in the current directory through FJM

2015-04-30 Thread Zhe Zhang (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-8303?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Zhe Zhang updated HDFS-8303: Status: Patch Available (was: Open) QJM should purge old logs in the current directory through FJM

[jira] [Updated] (HDFS-8305) HDFS INotify: the destination field of RenameOp should always end with the file name

2015-04-30 Thread Colin Patrick McCabe (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-8305?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Colin Patrick McCabe updated HDFS-8305: --- Summary: HDFS INotify: the destination field of RenameOp should always end with the

[jira] [Created] (HDFS-8305) HDFS INotify: the destination argument to RenameOp should always end with the file name

2015-04-30 Thread Colin Patrick McCabe (JIRA)
Colin Patrick McCabe created HDFS-8305: -- Summary: HDFS INotify: the destination argument to RenameOp should always end with the file name Key: HDFS-8305 URL: https://issues.apache.org/jira/browse/HDFS-8305

[jira] [Updated] (HDFS-8305) HDFS INotify: the destination field of RenameOp should always end with the file name

2015-04-30 Thread Colin Patrick McCabe (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-8305?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Colin Patrick McCabe updated HDFS-8305: --- Description: HDFS INotify: the destination field of RenameOp should always end with

[jira] [Updated] (HDFS-8306) Generate ACL and Xattr outputs in OIV XML outputs

2015-04-30 Thread Lei (Eddy) Xu (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-8306?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Lei (Eddy) Xu updated HDFS-8306: Attachment: HDFS-8306.000.patch This patch generates ACLs and Xattrs in OIV XML outputs, and

[jira] [Updated] (HDFS-8306) Generate ACL and Xattr outputs in OIV XML outputs

2015-04-30 Thread Lei (Eddy) Xu (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-8306?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Lei (Eddy) Xu updated HDFS-8306: Status: Patch Available (was: Open) Generate ACL and Xattr outputs in OIV XML outputs

[jira] [Commented] (HDFS-7348) Erasure Coding: striped block recovery

2015-04-30 Thread Zhe Zhang (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-7348?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14522760#comment-14522760 ] Zhe Zhang commented on HDFS-7348: - Please find my full review below. The overall patch

[jira] [Commented] (HDFS-7678) Erasure coding: DFSInputStream with decode functionality

2015-04-30 Thread Zhe Zhang (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-7678?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14522795#comment-14522795 ] Zhe Zhang commented on HDFS-7678: - Jenkins on HDFS-7285 branch is not stable recently. Will

[jira] [Commented] (HDFS-8281) Erasure Coding: implement parallel stateful reading for striped layout

2015-04-30 Thread Zhe Zhang (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-8281?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14522770#comment-14522770 ] Zhe Zhang commented on HDFS-8281: - Great work Jing! I like the elegant logic of reading at

[jira] [Commented] (HDFS-7281) Missing block is marked as corrupted block

2015-04-30 Thread Yongjun Zhang (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-7281?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14522804#comment-14522804 ] Yongjun Zhang commented on HDFS-7281: - The test failure is unrelated, I reran all

[jira] [Updated] (HDFS-8178) QJM doesn't move aside stale inprogress edits files

2015-04-30 Thread Zhe Zhang (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-8178?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Zhe Zhang updated HDFS-8178: Attachment: HDFS-8178.002.patch We can also combine this patch with HDFS-8303 and close one of them as dup.

[jira] [Commented] (HDFS-8281) Erasure Coding: implement parallel stateful reading for striped layout

2015-04-30 Thread Zhe Zhang (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-8281?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14522367#comment-14522367 ] Zhe Zhang commented on HDFS-8281: - Thanks Jing for the update! I'm reviewing now. A quick

[jira] [Updated] (HDFS-8281) Erasure Coding: implement parallel stateful reading for striped layout

2015-04-30 Thread Jing Zhao (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-8281?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Jing Zhao updated HDFS-8281: Attachment: HDFS-8281-HDFS-7285.001.patch Thanks Zhe! Rebase the patch. Erasure Coding: implement parallel

[jira] [Updated] (HDFS-8245) Standby namenode doesn't process DELETED_BLOCK if the add block request is in edit log.

2015-04-30 Thread Rushabh S Shah (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-8245?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Rushabh S Shah updated HDFS-8245: - Status: Patch Available (was: Open) Standby namenode doesn't process DELETED_BLOCK if the add

[jira] [Updated] (HDFS-8134) Using OpenJDK on HDFS

2015-04-30 Thread Yingqi Lu (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-8134?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Yingqi Lu updated HDFS-8134: Attachment: pic2.png pic1.png Hi All, Here are the most recent data on OpenJDK with HDFS.

[jira] [Commented] (HDFS-6757) Simplify lease manager with INodeID

2015-04-30 Thread Hadoop QA (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-6757?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14522566#comment-14522566 ] Hadoop QA commented on HDFS-6757: - \\ \\ | (x) *{color:red}-1 overall{color}* | \\ \\ ||

[jira] [Commented] (HDFS-7739) ZKFC - transitionToActive is indefinitely waiting to complete fenceOldActive

2015-04-30 Thread Brahma Reddy Battula (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-7739?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14522565#comment-14522565 ] Brahma Reddy Battula commented on HDFS-7739: [~cnauroth] and [~vinayrpet] any

[jira] [Commented] (HDFS-8292) Move conditional in fmt_time from dfs-dust.js to status.html

2015-04-30 Thread Charles Lamb (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-8292?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14522637#comment-14522637 ] Charles Lamb commented on HDFS-8292: Yes, I tested it manually. Thanks Andrew. Move

[jira] [Commented] (HDFS-8303) QJM should purge old logs in the current directory through FJM

2015-04-30 Thread Hadoop QA (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-8303?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14522652#comment-14522652 ] Hadoop QA commented on HDFS-8303: - \\ \\ | (x) *{color:red}-1 overall{color}* | \\ \\ ||

[jira] [Commented] (HDFS-7980) Incremental BlockReport will dramatically slow down the startup of a namenode

2015-04-30 Thread Hadoop QA (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-7980?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14522654#comment-14522654 ] Hadoop QA commented on HDFS-7980: - (!) The patch artifact directory has been removed! This

[jira] [Commented] (HDFS-8290) WebHDFS calls before namesystem initialization can cause NullPointerException.

2015-04-30 Thread Chris Nauroth (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-8290?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14522700#comment-14522700 ] Chris Nauroth commented on HDFS-8290: - The test failures and findbugs warning have been

[jira] [Commented] (HDFS-7739) ZKFC - transitionToActive is indefinitely waiting to complete fenceOldActive

2015-04-30 Thread Brahma Reddy Battula (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-7739?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14522717#comment-14522717 ] Brahma Reddy Battula commented on HDFS-7739: Thanks a lot for look into this

[jira] [Commented] (HDFS-8303) QJM should purge old logs in the current directory through FJM

2015-04-30 Thread Hadoop QA (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-8303?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14522729#comment-14522729 ] Hadoop QA commented on HDFS-8303: - \\ \\ | (x) *{color:red}-1 overall{color}* | \\ \\ ||

[jira] [Commented] (HDFS-8161) Both Namenodes are in standby State

2015-04-30 Thread Brahma Reddy Battula (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-8161?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14522555#comment-14522555 ] Brahma Reddy Battula commented on HDFS-8161: Thanks a lot [~cnauroth] looking

[jira] [Commented] (HDFS-8303) QJM should purge old logs in the current directory through FJM

2015-04-30 Thread Hadoop QA (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-8303?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14522598#comment-14522598 ] Hadoop QA commented on HDFS-8303: - \\ \\ | (x) *{color:red}-1 overall{color}* | \\ \\ ||

[jira] [Commented] (HDFS-8292) Move conditional in fmt_time from dfs-dust.js to status.html

2015-04-30 Thread Andrew Wang (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-8292?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14522612#comment-14522612 ] Andrew Wang commented on HDFS-8292: --- +1 will commit shortly, assuming you tested

[jira] [Commented] (HDFS-8213) DFSClient should use hdfs.client.htrace HTrace configuration prefix rather than hadoop.htrace

2015-04-30 Thread Hadoop QA (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-8213?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14522645#comment-14522645 ] Hadoop QA commented on HDFS-8213: - \\ \\ | (x) *{color:red}-1 overall{color}* | \\ \\ ||

[jira] [Commented] (HDFS-8305) HDFS INotify: the destination field of RenameOp should always end with the file name

2015-04-30 Thread Hadoop QA (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-8305?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14522664#comment-14522664 ] Hadoop QA commented on HDFS-8305: - \\ \\ | (x) *{color:red}-1 overall{color}* | \\ \\ ||

[jira] [Comment Edited] (HDFS-8213) DFSClient should use hdfs.client.htrace HTrace configuration prefix rather than hadoop.htrace

2015-04-30 Thread Colin Patrick McCabe (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-8213?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14522663#comment-14522663 ] Colin Patrick McCabe edited comment on HDFS-8213 at 5/1/15 2:12 AM:

[jira] [Commented] (HDFS-8213) DFSClient should use hdfs.client.htrace HTrace configuration prefix rather than hadoop.htrace

2015-04-30 Thread Colin Patrick McCabe (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-8213?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14522663#comment-14522663 ] Colin Patrick McCabe commented on HDFS-8213: findbugs warning is bogus. patch

[jira] [Commented] (HDFS-7739) ZKFC - transitionToActive is indefinitely waiting to complete fenceOldActive

2015-04-30 Thread Chris Nauroth (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-7739?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14522710#comment-14522710 ] Chris Nauroth commented on HDFS-7739: - Hi [~brahmareddy]. From the stack trace, it

[jira] [Commented] (HDFS-8306) Generate ACL and Xattr outputs in OIV XML outputs

2015-04-30 Thread Hadoop QA (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-8306?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14522722#comment-14522722 ] Hadoop QA commented on HDFS-8306: - \\ \\ | (x) *{color:red}-1 overall{color}* | \\ \\ ||

[jira] [Updated] (HDFS-8300) Fix unit test failures and findbugs warning caused by HDFS-8283

2015-04-30 Thread Jing Zhao (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-8300?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Jing Zhao updated HDFS-8300: Resolution: Fixed Fix Version/s: 2.8.0 Status: Resolved (was: Patch Available) Thanks for

[jira] [Commented] (HDFS-8283) DataStreamer cleanup and some minor improvement

2015-04-30 Thread Hudson (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-8283?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14522705#comment-14522705 ] Hudson commented on HDFS-8283: -- FAILURE: Integrated in Hadoop-trunk-Commit #7710 (See

[jira] [Commented] (HDFS-8300) Fix unit test failures and findbugs warning caused by HDFS-8283

2015-04-30 Thread Hudson (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-8300?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14522703#comment-14522703 ] Hudson commented on HDFS-8300: -- FAILURE: Integrated in Hadoop-trunk-Commit #7710 (See

[jira] [Commented] (HDFS-8292) Move conditional in fmt_time from dfs-dust.js to status.html

2015-04-30 Thread Hudson (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-8292?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14522704#comment-14522704 ] Hudson commented on HDFS-8292: -- FAILURE: Integrated in Hadoop-trunk-Commit #7710 (See

[jira] [Updated] (HDFS-8308) Erasure Coding: NameNode may get blocked in waitForLoadingFSImage() when loading editlog

2015-04-30 Thread Tsz Wo Nicholas Sze (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-8308?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Tsz Wo Nicholas Sze updated HDFS-8308: -- Hadoop Flags: Reviewed +1 patch looks good. Erasure Coding: NameNode may get blocked

[jira] [Updated] (HDFS-8292) Move conditional in fmt_time from dfs-dust.js to status.html

2015-04-30 Thread Andrew Wang (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-8292?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Andrew Wang updated HDFS-8292: -- Resolution: Fixed Fix Version/s: 2.8.0 Status: Resolved (was: Patch Available)

[jira] [Commented] (HDFS-8300) Fix unit test failures and findbugs warning caused by HDFS-8283

2015-04-30 Thread Hadoop QA (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-8300?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14522627#comment-14522627 ] Hadoop QA commented on HDFS-8300: - \\ \\ | (x) *{color:red}-1 overall{color}* | \\ \\ ||

[jira] [Resolved] (HDFS-8308) Erasure Coding: NameNode may get blocked in waitForLoadingFSImage() when loading editlog

2015-04-30 Thread Jing Zhao (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-8308?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Jing Zhao resolved HDFS-8308. - Resolution: Fixed Fix Version/s: HDFS-7285 Thanks for the review, Nicholas! I've committed this.

[jira] [Commented] (HDFS-8294) Erasure Coding: Fix Findbug warnings present in erasure coding

2015-04-30 Thread Rakesh R (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-8294?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14522740#comment-14522740 ] Rakesh R commented on HDFS-8294: oops again it got ABORTED, please see [jenkins

[jira] [Commented] (HDFS-8200) Refactor FSDirStatAndListingOp

2015-04-30 Thread Hudson (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-8200?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14522324#comment-14522324 ] Hudson commented on HDFS-8200: -- FAILURE: Integrated in Hadoop-trunk-Commit #7708 (See

[jira] [Updated] (HDFS-8245) Standby namenode doesn't process DELETED_BLOCK if the add block request is in edit log.

2015-04-30 Thread Rushabh S Shah (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-8245?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Rushabh S Shah updated HDFS-8245: - Attachment: HDFS-8245.patch I have just added a check in BlockManager#removeStoredBlock to add to

[jira] [Commented] (HDFS-8299) HDFS reporting missing blocks when they are actually present due to read-only filesystem

2015-04-30 Thread Tsz Wo Nicholas Sze (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-8299?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14522450#comment-14522450 ] Tsz Wo Nicholas Sze commented on HDFS-8299: --- {code} 2015-04-30 14:11:08,235 WARN

[jira] [Created] (HDFS-8308) Erasure Coding: NameNode may get blocked in waitForLoadingFSImage() when loading editlog

2015-04-30 Thread Jing Zhao (JIRA)
Jing Zhao created HDFS-8308: --- Summary: Erasure Coding: NameNode may get blocked in waitForLoadingFSImage() when loading editlog Key: HDFS-8308 URL: https://issues.apache.org/jira/browse/HDFS-8308 Project:

[jira] [Commented] (HDFS-7281) Missing block is marked as corrupted block

2015-04-30 Thread Hadoop QA (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-7281?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14522507#comment-14522507 ] Hadoop QA commented on HDFS-7281: - \\ \\ | (x) *{color:red}-1 overall{color}* | \\ \\ ||

[jira] [Updated] (HDFS-8308) Erasure Coding: NameNode may get blocked in waitForLoadingFSImage() when loading editlog

2015-04-30 Thread Jing Zhao (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-8308?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Jing Zhao updated HDFS-8308: Attachment: HDFS-8308.000.patch Upload a patch to fix. The main fix is actually just one line: {code} -

[jira] [Updated] (HDFS-8178) QJM doesn't move aside stale inprogress edits files

2015-04-30 Thread Zhe Zhang (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-8178?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Zhe Zhang updated HDFS-8178: Attachment: HDFS-8178.003.patch Combined with HDFS-8303 patch. QJM doesn't move aside stale inprogress

[jira] [Updated] (HDFS-8300) Fix unit test failures and findbugs warning caused by HDFS-8283

2015-04-30 Thread Tsz Wo Nicholas Sze (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-8300?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Tsz Wo Nicholas Sze updated HDFS-8300: -- Description: - findbugs warning Class org.apache.hadoop.hdfs.DataStreamer$LastException

[jira] [Assigned] (HDFS-8289) DFSStripedOutputStream uses an additional rpc all to getErasureCodingInfo

2015-04-30 Thread Jing Zhao (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-8289?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Jing Zhao reassigned HDFS-8289: --- Assignee: Jing Zhao (was: Tsz Wo Nicholas Sze) DFSStripedOutputStream uses an additional rpc all to

[jira] [Updated] (HDFS-8303) QJM should purge old logs in the current directory through FJM

2015-04-30 Thread Zhe Zhang (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-8303?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Zhe Zhang updated HDFS-8303: Attachment: HDFS-8303.1.patch The below code is actually needed to avoid purging current in-progress file:

[jira] [Assigned] (HDFS-4176) EditLogTailer should call rollEdits with a timeout

2015-04-30 Thread Zhe Zhang (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-4176?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Zhe Zhang reassigned HDFS-4176: --- Assignee: Zhe Zhang EditLogTailer should call rollEdits with a timeout

[jira] [Commented] (HDFS-7836) BlockManager Scalability Improvements

2015-04-30 Thread Colin Patrick McCabe (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-7836?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14522480#comment-14522480 ] Colin Patrick McCabe commented on HDFS-7836: Hi [~xinwei], The discussion on

[jira] [Commented] (HDFS-8229) LAZY_PERSIST file gets deleted after NameNode restart.

2015-04-30 Thread Hadoop QA (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-8229?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14522306#comment-14522306 ] Hadoop QA commented on HDFS-8229: - \\ \\ | (x) *{color:red}-1 overall{color}* | \\ \\ ||

[jira] [Updated] (HDFS-8281) Erasure Coding: implement parallel stateful reading for striped layout

2015-04-30 Thread Jing Zhao (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-8281?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Jing Zhao updated HDFS-8281: Attachment: HDFS-8281-HDFS-7285.001.patch Thanks for the review, Nicholas! Update the patch to address your

<    1   2   3   >