[jira] [Updated] (HDFS-9406) FSImage may get corrupted after deleting snapshot

2016-02-01 Thread Yongjun Zhang (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-9406?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Yongjun Zhang updated HDFS-9406: Summary: FSImage may get corrupted after deleting snapshot (was: FSImage corruption after taking

[jira] [Commented] (HDFS-9638) Improve DistCp Help and documentation

2016-02-01 Thread Wei-Chiu Chuang (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-9638?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15126872#comment-15126872 ] Wei-Chiu Chuang commented on HDFS-9638: --- Thanks [~yzhangal] for commit and [~drankye] for reviews and

[jira] [Commented] (HDFS-9701) DN may deadlock when hot-swapping under load

2016-02-01 Thread Hudson (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-9701?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15127069#comment-15127069 ] Hudson commented on HDFS-9701: -- FAILURE: Integrated in Hadoop-trunk-Commit #9217 (See

[jira] [Commented] (HDFS-9494) Parallel optimization of DFSStripedOutputStream#flushAllInternals( )

2016-02-01 Thread Hudson (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-9494?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15127070#comment-15127070 ] Hudson commented on HDFS-9494: -- FAILURE: Integrated in Hadoop-trunk-Commit #9217 (See

[jira] [Commented] (HDFS-9731) Erasure Coding: Improve naming of classes, methods, and variables related to EC recovery

2016-02-01 Thread Rakesh R (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-9731?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15126790#comment-15126790 ] Rakesh R commented on HDFS-9731: [~zhz], I've attached {{HDFS-7955-5.patch}} here in this jira. Could you

[jira] [Updated] (HDFS-9731) Erasure Coding: Improve naming of classes, methods, and variables related to EC recovery

2016-02-01 Thread Rakesh R (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-9731?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Rakesh R updated HDFS-9731: --- Attachment: HDFS-9731-001.patch > Erasure Coding: Improve naming of classes, methods, and variables related to

[jira] [Commented] (HDFS-9719) Refactoring ErasureCodingWorker into smaller reusable constructs

2016-02-01 Thread Hadoop QA (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-9719?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15126950#comment-15126950 ] Hadoop QA commented on HDFS-9719: - | (x) *{color:red}-1 overall{color}* | \\ \\ || Vote || Subsystem ||

[jira] [Updated] (HDFS-9494) Parallel optimization of DFSStripedOutputStream#flushAllInternals( )

2016-02-01 Thread Jing Zhao (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-9494?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Jing Zhao updated HDFS-9494: Resolution: Fixed Status: Resolved (was: Patch Available) I've committed the patch to trunk. Thanks

[jira] [Updated] (HDFS-9731) Erasure Coding: Improve naming of classes, methods, and variables related to EC recovery

2016-02-01 Thread Rakesh R (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-9731?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Rakesh R updated HDFS-9731: --- Status: Patch Available (was: Open) > Erasure Coding: Improve naming of classes, methods, and variables

[jira] [Commented] (HDFS-9721) Allow Delimited PB OIV tool to run upon fsimage that contains INodeReference

2016-02-01 Thread Lei (Eddy) Xu (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-9721?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15126858#comment-15126858 ] Lei (Eddy) Xu commented on HDFS-9721: - Hi, [~xiaochen] Thanks a lot for addressing the above comments.

[jira] [Commented] (HDFS-9637) Add test for HADOOP-12702

2016-02-01 Thread Hadoop QA (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-9637?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15127079#comment-15127079 ] Hadoop QA commented on HDFS-9637: - | (x) *{color:red}-1 overall{color}* | \\ \\ || Vote || Subsystem ||

[jira] [Commented] (HDFS-9708) FSNamesystem.initAuditLoggers() doesn't trim classnames

2016-02-01 Thread Mingliang Liu (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-9708?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15126802#comment-15126802 ] Mingliang Liu commented on HDFS-9708: - Thanks for the review and commit! We can resolve this issue ? >

[jira] [Commented] (HDFS-9658) Erasure Coding: allow to use multiple EC policies in striping related tests

2016-02-01 Thread Zhe Zhang (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-9658?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15126823#comment-15126823 ] Zhe Zhang commented on HDFS-9658: - Thanks [~lirui] for the fix. The patch LGTM, except for a minor

[jira] [Updated] (HDFS-9701) DN may deadlock when hot-swapping under load

2016-02-01 Thread Lei (Eddy) Xu (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-9701?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Lei (Eddy) Xu updated HDFS-9701: Resolution: Fixed Hadoop Flags: Reviewed Fix Version/s: 2.8.0

[jira] [Updated] (HDFS-9210) Fix some misuse of %n in VolumeScanner#printStats

2016-02-01 Thread Xiaoyu Yao (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-9210?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Xiaoyu Yao updated HDFS-9210: - Resolution: Fixed Status: Resolved (was: Patch Available) Thanks all for the reviews. I've commit

[jira] [Commented] (HDFS-9210) Fix some misuse of %n in VolumeScanner#printStats

2016-02-01 Thread Hudson (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-9210?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15126946#comment-15126946 ] Hudson commented on HDFS-9210: -- FAILURE: Integrated in Hadoop-trunk-Commit #9216 (See

[jira] [Commented] (HDFS-9732) Remove DelegationTokenIdentifier.toString() —for better logging output

2016-02-01 Thread Hadoop QA (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-9732?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15126958#comment-15126958 ] Hadoop QA commented on HDFS-9732: - | (x) *{color:red}-1 overall{color}* | \\ \\ || Vote || Subsystem ||

[jira] [Updated] (HDFS-9731) Erasure Coding: Rename BlockECRecoveryCommand to BlockECReconstructionCommand

2016-02-01 Thread Zhe Zhang (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-9731?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Zhe Zhang updated HDFS-9731: Summary: Erasure Coding: Rename BlockECRecoveryCommand to BlockECReconstructionCommand (was: Erasure

[jira] [Commented] (HDFS-9731) Erasure Coding: Improve naming of classes, methods, and variables related to EC recovery

2016-02-01 Thread Zhe Zhang (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-9731?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15127027#comment-15127027 ] Zhe Zhang commented on HDFS-9731: - Thanks Rakesh! +1 on the patch pending Jenkins. > Erasure Coding:

[jira] [Commented] (HDFS-9731) Erasure Coding: Rename BlockECRecoveryCommand to BlockECReconstructionCommand

2016-02-01 Thread Zhe Zhang (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-9731?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15127028#comment-15127028 ] Zhe Zhang commented on HDFS-9731: - Updating the title to reflect the change. > Erasure Coding: Rename

[jira] [Commented] (HDFS-9734) Refactoring of checksum failure report related codes

2016-02-01 Thread Kai Zheng (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-9734?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15127192#comment-15127192 ] Kai Zheng commented on HDFS-9734: - Thanks [~jingzhao] for the help with the converting! Will rename and

[jira] [Updated] (HDFS-9406) FSImage may get corrupted after deleting snapshot

2016-02-01 Thread Yongjun Zhang (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-9406?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Yongjun Zhang updated HDFS-9406: Attachment: HDFS-9406.branch-2.7.patch > FSImage may get corrupted after deleting snapshot >

[jira] [Commented] (HDFS-9731) Erasure Coding: Rename BlockECRecoveryCommand to BlockECReconstructionCommand

2016-02-01 Thread Hadoop QA (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-9731?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15127211#comment-15127211 ] Hadoop QA commented on HDFS-9731: - | (x) *{color:red}-1 overall{color}* | \\ \\ || Vote || Subsystem ||

[jira] [Commented] (HDFS-9406) FSImage may get corrupted after deleting snapshot

2016-02-01 Thread Jing Zhao (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-9406?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15127232#comment-15127232 ] Jing Zhao commented on HDFS-9406: - Thanks a lot Yongjun! The 2.7 patch looks good to me. +1. Shall we also

[jira] [Updated] (HDFS-9406) FSImage may get corrupted after deleting snapshot

2016-02-01 Thread Yongjun Zhang (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-9406?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Yongjun Zhang updated HDFS-9406: Fix Version/s: 2.8.0 > FSImage may get corrupted after deleting snapshot >

[jira] [Commented] (HDFS-9701) DN may deadlock when hot-swapping under load

2016-02-01 Thread Xiao Chen (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-9701?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15127117#comment-15127117 ] Xiao Chen commented on HDFS-9701: - Thanks for the review and commit Eddy, and thanks Vinay and Xiaobing for

[jira] [Updated] (HDFS-9733) Refactor DFSClient#getFileChecksum and DataXceiver#blockChecksum

2016-02-01 Thread Kai Zheng (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-9733?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Kai Zheng updated HDFS-9733: Status: Patch Available (was: Open) > Refactor DFSClient#getFileChecksum and DataXceiver#blockChecksum >

[jira] [Commented] (HDFS-9406) FSImage may get corrupted after deleting snapshot

2016-02-01 Thread Yongjun Zhang (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-9406?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15127197#comment-15127197 ] Yongjun Zhang commented on HDFS-9406: - Hi [~jingzhao], I committed to trunk, branch-2, branch-2.8.

[jira] [Commented] (HDFS-9260) Improve performance and GC friendliness of startup and FBRs

2016-02-01 Thread Colin Patrick McCabe (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-9260?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15127238#comment-15127238 ] Colin Patrick McCabe commented on HDFS-9260: Thanks, [~sfriberg]. The unit test failures

[jira] [Resolved] (HDFS-9697) NN fails to restart due to corrupt fsimage caused by snapshot handling

2016-02-01 Thread Yongjun Zhang (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-9697?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Yongjun Zhang resolved HDFS-9697. - Resolution: Duplicate > NN fails to restart due to corrupt fsimage caused by snapshot handling >

[jira] [Updated] (HDFS-9406) FSImage may get corrupted after deleting snapshot

2016-02-01 Thread Yongjun Zhang (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-9406?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Yongjun Zhang updated HDFS-9406: Resolution: Fixed Hadoop Flags: Reviewed Fix Version/s: 2.7.3 Status: Resolved

[jira] [Created] (HDFS-9736) Fix typo in defaultFS warning message

2016-02-01 Thread Andrew Wang (JIRA)
Andrew Wang created HDFS-9736: - Summary: Fix typo in defaultFS warning message Key: HDFS-9736 URL: https://issues.apache.org/jira/browse/HDFS-9736 Project: Hadoop HDFS Issue Type: Bug

[jira] [Commented] (HDFS-9730) Storage ID update does not happen when there is a layout change

2016-02-01 Thread Chris Trezzo (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-9730?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15127085#comment-15127085 ] Chris Trezzo commented on HDFS-9730: Thanks [~kihwal] for the catch. I am not quite sure I understand

[jira] [Updated] (HDFS-9721) Allow Delimited PB OIV tool to run upon fsimage that contains INodeReference

2016-02-01 Thread Xiao Chen (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-9721?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Xiao Chen updated HDFS-9721: Attachment: HDFS-9721.05.patch Thanks for the review Eddy! Patch 5 addresses all comments above.

[jira] [Commented] (HDFS-9730) Storage ID update does not happen when there is a layout change

2016-02-01 Thread Chris Trezzo (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-9730?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15127089#comment-15127089 ] Chris Trezzo commented on HDFS-9730: (As well as 2.7.3) > Storage ID update does not happen when there

[jira] [Moved] (HDFS-9734) Refactoring of checksum failure report related codes

2016-02-01 Thread Jing Zhao (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-9734?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Jing Zhao moved HADOOP-12744 to HDFS-9734: -- Key: HDFS-9734 (was: HADOOP-12744) Project: Hadoop HDFS (was: Hadoop

[jira] [Updated] (HDFS-9734) Refactoring of checksum failure report related codes

2016-02-01 Thread Kai Zheng (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-9734?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Kai Zheng updated HDFS-9734: Attachment: HDFS-9734-v3.patch Renamed the patch to reflect the issue ID change. > Refactoring of checksum

[jira] [Commented] (HDFS-9733) Refactor DFSClient#getFileChecksum and DataXceiver#blockChecksum

2016-02-01 Thread Hadoop QA (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-9733?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15127273#comment-15127273 ] Hadoop QA commented on HDFS-9733: - | (x) *{color:red}-1 overall{color}* | \\ \\ || Vote || Subsystem ||

[jira] [Updated] (HDFS-9072) Fix random failures in TestJMXGet

2016-02-01 Thread Kihwal Lee (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-9072?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Kihwal Lee updated HDFS-9072: - Attachment: HDFS-9072-br27.patch The two test cases are also failing in branch-2.7. The trunk patch

[jira] [Commented] (HDFS-9719) Refactoring ErasureCodingWorker into smaller reusable constructs

2016-02-01 Thread Kai Zheng (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-9719?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15127187#comment-15127187 ] Kai Zheng commented on HDFS-9719: - When HADOOP-12744 is resolved and this is rebased, the patch here should

[jira] [Commented] (HDFS-9730) Storage ID update does not happen when there is a layout change

2016-02-01 Thread Kihwal Lee (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-9730?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15127193#comment-15127193 ] Kihwal Lee commented on HDFS-9730: -- bq. I am not quite sure I understand why the current unit tests are

[jira] [Resolved] (HDFS-9696) Garbage snapshot records lingering forever

2016-02-01 Thread Yongjun Zhang (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-9696?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Yongjun Zhang resolved HDFS-9696. - Resolution: Duplicate Hi [~kihwal], Thanks a lot for reporting the issue here. Upon

[jira] [Updated] (HDFS-9715) Check storage ID uniqueness on datanode startup

2016-02-01 Thread Lei (Eddy) Xu (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-9715?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Lei (Eddy) Xu updated HDFS-9715: Attachment: HDFS-9715.01.patch Hey, [~vinayrpet] Thanks a lot for the review. I updated to patch to

[jira] [Commented] (HDFS-9721) Allow Delimited PB OIV tool to run upon fsimage that contains INodeReference

2016-02-01 Thread Xiao Chen (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-9721?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15127121#comment-15127121 ] Xiao Chen commented on HDFS-9721: - Hm, BTW, should we mark this as incompatible change, due to the added

[jira] [Created] (HDFS-9733) Refactor DFSClient#getFileChecksum and DataXceiver#blockChecksum

2016-02-01 Thread Kai Zheng (JIRA)
Kai Zheng created HDFS-9733: --- Summary: Refactor DFSClient#getFileChecksum and DataXceiver#blockChecksum Key: HDFS-9733 URL: https://issues.apache.org/jira/browse/HDFS-9733 Project: Hadoop HDFS

[jira] [Commented] (HDFS-9694) Make existing DFSClient#getFileChecksum() work for striped blocks

2016-02-01 Thread Kai Zheng (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-9694?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15127141#comment-15127141 ] Kai Zheng commented on HDFS-9694: - As the patch is too large, opened HDFS-9733 to do the refactoring of

[jira] [Commented] (HDFS-9406) FSImage may get corrupted after deleting snapshot

2016-02-01 Thread Hudson (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-9406?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15127226#comment-15127226 ] Hudson commented on HDFS-9406: -- FAILURE: Integrated in Hadoop-trunk-Commit #9218 (See

[jira] [Created] (HDFS-9735) DiskBalancer : Refactor moveBlockAcrossStorage to be used by disk balancer

2016-02-01 Thread Anu Engineer (JIRA)
Anu Engineer created HDFS-9735: -- Summary: DiskBalancer : Refactor moveBlockAcrossStorage to be used by disk balancer Key: HDFS-9735 URL: https://issues.apache.org/jira/browse/HDFS-9735 Project: Hadoop

[jira] [Commented] (HDFS-9730) Storage ID update does not happen when there is a layout change

2016-02-01 Thread Tsz Wo Nicholas Sze (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-9730?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15127235#comment-15127235 ] Tsz Wo Nicholas Sze commented on HDFS-9730: --- Hi [~kihwal], thanks for reporting this. > This is

[jira] [Commented] (HDFS-9697) NN fails to restart due to corrupt fsimage caused by snapshot handling

2016-02-01 Thread Yongjun Zhang (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-9697?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15127263#comment-15127263 ] Yongjun Zhang commented on HDFS-9697: - Resolved as duplicate of HDFS-9406. Thanks. > NN fails to

[jira] [Commented] (HDFS-8829) Make SO_RCVBUF and SO_SNDBUF size configurable for DataTransferProtocol sockets and allow configuring auto-tuning

2016-02-01 Thread Colin Patrick McCabe (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-8829?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15127097#comment-15127097 ] Colin Patrick McCabe commented on HDFS-8829: bq. There is one corner cases: Old linux kernels

[jira] [Assigned] (HDFS-9730) Storage ID update does not happen when there is a layout change

2016-02-01 Thread Tsz Wo Nicholas Sze (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-9730?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Tsz Wo Nicholas Sze reassigned HDFS-9730: - Assignee: Tsz Wo Nicholas Sze > Storage ID update does not happen when there is a

[jira] [Updated] (HDFS-9735) DiskBalancer : Refactor moveBlockAcrossStorage to be used by disk balancer

2016-02-01 Thread Anu Engineer (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-9735?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Anu Engineer updated HDFS-9735: --- Attachment: HDFS-9735-HDFS-1312.001.patch This patch depends on HDFS-9720. Uploading for early code

[jira] [Commented] (HDFS-9406) FSImage may get corrupted after deleting snapshot

2016-02-01 Thread Yongjun Zhang (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-9406?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15127249#comment-15127249 ] Yongjun Zhang commented on HDFS-9406: - Thanks Jing! Yes, I planned to do so after committing. Am doing

[jira] [Updated] (HDFS-9736) Fix typo in defaultFS warning message

2016-02-01 Thread Andrew Wang (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-9736?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Andrew Wang updated HDFS-9736: -- Priority: Trivial (was: Major) > Fix typo in defaultFS warning message >

[jira] [Updated] (HDFS-9733) Refactor DFSClient#getFileChecksum and DataXceiver#blockChecksum

2016-02-01 Thread Kai Zheng (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-9733?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Kai Zheng updated HDFS-9733: Attachment: HDFS-9733-v1.patch Uploaded the patch to do the refactoring. > Refactor

[jira] [Commented] (HDFS-7866) Erasure coding: NameNode manages multiple erasure coding policies

2016-02-01 Thread Zhe Zhang (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-7866?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15127149#comment-15127149 ] Zhe Zhang commented on HDFS-7866: - Thanks Rui for the work. I think HDFS-9658 is almost ready. I think the

[jira] [Commented] (HDFS-9688) Test the effect of nested encryption zones in HDFS downgrade

2016-02-01 Thread Andrew Wang (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-9688?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15127243#comment-15127243 ] Andrew Wang commented on HDFS-9688: --- IIUC for trash support, we need to be able to rename a nested EZ to

[jira] [Commented] (HDFS-9406) FSImage may get corrupted after deleting snapshot

2016-02-01 Thread Hadoop QA (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-9406?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15127322#comment-15127322 ] Hadoop QA commented on HDFS-9406: - | (x) *{color:red}-1 overall{color}* | \\ \\ || Vote || Subsystem ||

[jira] [Commented] (HDFS-9715) Check storage ID uniqueness on datanode startup

2016-02-01 Thread Andrew Wang (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-9715?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15127293#comment-15127293 ] Andrew Wang commented on HDFS-9715: --- Smallest nit ever, the javadoc for the activateVolume method still

[jira] [Commented] (HDFS-9734) Refactoring of checksum failure report related codes

2016-02-01 Thread Hadoop QA (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-9734?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15127310#comment-15127310 ] Hadoop QA commented on HDFS-9734: - | (x) *{color:red}-1 overall{color}* | \\ \\ || Vote || Subsystem ||

[jira] [Updated] (HDFS-8791) block ID-based DN storage layout can be very slow for datanode on ext4

2016-02-01 Thread Junping Du (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-8791?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Junping Du updated HDFS-8791: - Target Version/s: 2.8.0, 2.7.3, 2.6.5 (was: 2.8.0, 2.7.3, 2.6.4) > block ID-based DN storage layout can

[jira] [Updated] (HDFS-9106) Transfer failure during pipeline recovery causes permanent write failures

2016-02-01 Thread Junping Du (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-9106?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Junping Du updated HDFS-9106: - Target Version/s: 2.8.0, 2.6.5 (was: 2.8.0, 2.6.4) > Transfer failure during pipeline recovery causes

[jira] [Commented] (HDFS-9503) Replace -namenode option with -fs for NNThroughputBenchmark

2016-02-01 Thread Konstantin Shvachko (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-9503?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15127376#comment-15127376 ] Konstantin Shvachko commented on HDFS-9503: --- Sorry, it was my fault, I used some old eclipse,

[jira] [Commented] (HDFS-9727) Improve the exception's log output in DataXceiver

2016-02-01 Thread Lin Yiqun (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-9727?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15127405#comment-15127405 ] Lin Yiqun commented on HDFS-9727: - The failed test looks not related, thanks reviewing! > Improve the

[jira] [Commented] (HDFS-9244) Support nested encryption zones

2016-02-01 Thread Andrew Wang (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-9244?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15127413#comment-15127413 ] Andrew Wang commented on HDFS-9244: --- Thanks for working on this Zhe, some code review comments: *

[jira] [Commented] (HDFS-9727) Improve the exception's log output in DataXceiver

2016-02-01 Thread Mingliang Liu (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-9727?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15127501#comment-15127501 ] Mingliang Liu commented on HDFS-9727: - Specifically, {{hadoop.hdfs.TestRecoverStripedFile}} seems flaky

[jira] [Commented] (HDFS-9716) o.a.h.hdfs.TestRecoverStripedFile fails intermittently in trunk

2016-02-01 Thread Mingliang Liu (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-9716?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15127498#comment-15127498 ] Mingliang Liu commented on HDFS-9716: - Sample *Error Message* is like: {code} expected:<131072> but

[jira] [Updated] (HDFS-9698) Long running Balancer should renew TGT

2016-02-01 Thread Junping Du (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-9698?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Junping Du updated HDFS-9698: - Target Version/s: 2.6.5 (was: 2.6.4) > Long running Balancer should renew TGT >

[jira] [Commented] (HDFS-8995) Flaw in registration bookeeping can make DN die on reconnect

2016-02-01 Thread Junping Du (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-8995?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15127560#comment-15127560 ] Junping Du commented on HDFS-8995: -- Move it out of 2.6.4 to 2.6.5 as haven't updated for a while. > Flaw

[jira] [Commented] (HDFS-8676) Delayed rolling upgrade finalization can cause heartbeat expiration and write failures

2016-02-01 Thread Junping Du (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-8676?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15127552#comment-15127552 ] Junping Du commented on HDFS-8676: -- Move it out of 2.6.4 to 2.6.5 as this jira haven't update for a while.

[jira] [Commented] (HDFS-8791) block ID-based DN storage layout can be very slow for datanode on ext4

2016-02-01 Thread Junping Du (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-8791?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15127566#comment-15127566 ] Junping Du commented on HDFS-8791: -- Move this out of 2.6.4 to 2.6.5 as haven't updated for a while. >

[jira] [Commented] (HDFS-2139) Fast copy for HDFS.

2016-02-01 Thread M. C. Srivas (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-2139?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15127543#comment-15127543 ] M. C. Srivas commented on HDFS-2139: Just a curiosity ... why was this method chosen? Why not simply

[jira] [Updated] (HDFS-8676) Delayed rolling upgrade finalization can cause heartbeat expiration and write failures

2016-02-01 Thread Junping Du (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-8676?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Junping Du updated HDFS-8676: - Target Version/s: 2.7.2, 2.6.5 (was: 2.7.2, 2.6.4) > Delayed rolling upgrade finalization can cause

[jira] [Commented] (HDFS-9106) Transfer failure during pipeline recovery causes permanent write failures

2016-02-01 Thread Junping Du (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-9106?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15127557#comment-15127557 ] Junping Du commented on HDFS-9106: -- Move it out of 2.6.4 to 2.6.5 as this JIRA haven't being updated for a

[jira] [Updated] (HDFS-9688) Test the effect of nested encryption zones in HDFS downgrade

2016-02-01 Thread Junping Du (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-9688?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Junping Du updated HDFS-9688: - Target Version/s: 2.8.0, 2.7.3, 2.6.5 (was: 2.8.0, 2.7.3, 2.6.4) > Test the effect of nested encryption

[jira] [Updated] (HDFS-9263) tests are using /test/build/data; breaking Jenkins

2016-02-01 Thread Junping Du (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-9263?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Junping Du updated HDFS-9263: - Target Version/s: 3.0.0, 2.7.3, 2.6.5 (was: 3.0.0, 2.7.3, 2.6.4) > tests are using /test/build/data;

[jira] [Updated] (HDFS-9244) Support nested encryption zones

2016-02-01 Thread Zhe Zhang (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-9244?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Zhe Zhang updated HDFS-9244: Attachment: HDFS-9244.03.patch Updating the patch per comments from Xiaoyu and Andrew under HDFS-9688. I

[jira] [Updated] (HDFS-9503) Replace -namenode option with -fs for NNThroughputBenchmark

2016-02-01 Thread Mingliang Liu (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-9503?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Mingliang Liu updated HDFS-9503: Attachment: HDFS-9053.005.patch Nice catch, [~shv]. The v5 patch is to address your latest two

[jira] [Commented] (HDFS-9658) Erasure Coding: allow to use multiple EC policies in striping related tests

2016-02-01 Thread Rui Li (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-9658?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15127428#comment-15127428 ] Rui Li commented on HDFS-9658: -- Hi [~zhz], thanks for the review! I kept {{dnIndexSuite}} so that the new

[jira] [Commented] (HDFS-9715) Check storage ID uniqueness on datanode startup

2016-02-01 Thread Hadoop QA (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-9715?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15127484#comment-15127484 ] Hadoop QA commented on HDFS-9715: - | (x) *{color:red}-1 overall{color}* | \\ \\ || Vote || Subsystem ||

[jira] [Updated] (HDFS-9715) Check storage ID uniqueness on datanode startup

2016-02-01 Thread Lei (Eddy) Xu (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-9715?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Lei (Eddy) Xu updated HDFS-9715: Attachment: HDFS-9715.02.patch Thanks for the reviews, [~andrew.wang] Updated the patch to address

[jira] [Commented] (HDFS-9503) Replace -namenode option with -fs for NNThroughputBenchmark

2016-02-01 Thread Mingliang Liu (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-9503?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15127378#comment-15127378 ] Mingliang Liu commented on HDFS-9503: - s/desirable/not desirable/ Sorry about this. > Replace

[jira] [Commented] (HDFS-2139) Fast copy for HDFS.

2016-02-01 Thread cuixin (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-2139?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15127423#comment-15127423 ] cuixin commented on HDFS-2139: -- Thanks your code diff. Do we have a plan to release this patch? > Fast copy

[jira] [Commented] (HDFS-9260) Improve performance and GC friendliness of startup and FBRs

2016-02-01 Thread Hadoop QA (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-9260?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15127435#comment-15127435 ] Hadoop QA commented on HDFS-9260: - | (x) *{color:red}-1 overall{color}* | \\ \\ || Vote || Subsystem ||

[jira] [Commented] (HDFS-9721) Allow Delimited PB OIV tool to run upon fsimage that contains INodeReference

2016-02-01 Thread Hadoop QA (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-9721?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15127502#comment-15127502 ] Hadoop QA commented on HDFS-9721: - | (x) *{color:red}-1 overall{color}* | \\ \\ || Vote || Subsystem ||

[jira] [Commented] (HDFS-9494) Parallel optimization of DFSStripedOutputStream#flushAllInternals( )

2016-02-01 Thread Hadoop QA (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-9494?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15125975#comment-15125975 ] Hadoop QA commented on HDFS-9494: - | (x) *{color:red}-1 overall{color}* | \\ \\ || Vote || Subsystem ||

[jira] [Commented] (HDFS-9566) Remove expensive 'BlocksMap#getStorages(Block b, final DatanodeStorage.State state)' method

2016-02-01 Thread Hudson (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-9566?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15125919#comment-15125919 ] Hudson commented on HDFS-9566: -- FAILURE: Integrated in Hadoop-trunk-Commit #9213 (See

[jira] [Commented] (HDFS-9659) EditLogTailerThread to Active Namenode RPC should timeout

2016-02-01 Thread Kai Zheng (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-9659?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15125928#comment-15125928 ] Kai Zheng commented on HDFS-9659: - Sorry just saw this. I thought Vinay's comment makes sense to me for

[jira] [Commented] (HDFS-7708) Balancer should delete its pid file when it completes rebalance

2016-02-01 Thread Akira AJISAKA (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-7708?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15125929#comment-15125929 ] Akira AJISAKA commented on HDFS-7708: - Hi [~rakeshr], how is this issue going on? I'd like to take it

[jira] [Commented] (HDFS-9659) EditLogTailerThread to Active Namenode RPC should timeout

2016-02-01 Thread Hudson (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-9659?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15125961#comment-15125961 ] Hudson commented on HDFS-9659: -- FAILURE: Integrated in Hadoop-trunk-Commit #9214 (See

[jira] [Commented] (HDFS-9726) Refactor IBR code to a new class

2016-02-01 Thread Hadoop QA (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-9726?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15125963#comment-15125963 ] Hadoop QA commented on HDFS-9726: - | (x) *{color:red}-1 overall{color}* | \\ \\ || Vote || Subsystem ||

[jira] [Comment Edited] (HDFS-9659) EditLogTailerThread to Active Namenode RPC should timeout

2016-02-01 Thread Vinayakumar B (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-9659?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15125937#comment-15125937 ] Vinayakumar B edited comment on HDFS-9659 at 2/1/16 8:35 AM: - bq. waitForProxy

[jira] [Updated] (HDFS-9659) EditLogTailerThread to Active Namenode RPC should timeout

2016-02-01 Thread Vinayakumar B (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-9659?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Vinayakumar B updated HDFS-9659: Resolution: Fixed Hadoop Flags: Reviewed Fix Version/s: 3.0.0 Status: Resolved

[jira] [Updated] (HDFS-9566) Remove expensive 'BlocksMap#getStorages(Block b, final DatanodeStorage.State state)' method

2016-02-01 Thread Vinayakumar B (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-9566?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Vinayakumar B updated HDFS-9566: Resolution: Fixed Hadoop Flags: Reviewed Fix Version/s: 2.8.0 Status: Resolved

[jira] [Commented] (HDFS-9659) EditLogTailerThread to Active Namenode RPC should timeout

2016-02-01 Thread Vinayakumar B (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-9659?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15125933#comment-15125933 ] Vinayakumar B commented on HDFS-9659: - Oh!. Now I seen the first patch, which is same as latest.

[jira] [Updated] (HDFS-9718) HAUtil#getConfForOtherNodes don't unset the independent property while it is not assign on others nnId

2016-02-01 Thread Vinayakumar B (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-9718?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Vinayakumar B updated HDFS-9718: Status: Patch Available (was: Open) > HAUtil#getConfForOtherNodes don't unset the independent

[jira] [Commented] (HDFS-9718) HAUtil#getConfForOtherNodes don't unset the independent property while it is not assign on others nnId

2016-02-01 Thread Vinayakumar B (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-9718?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15125960#comment-15125960 ] Vinayakumar B commented on HDFS-9718: - Patch looks good. some code-formatting might be required. Anyway

[jira] [Commented] (HDFS-9727) Improve the exception's log output in DataXceiver

2016-02-01 Thread Hadoop QA (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-9727?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15125930#comment-15125930 ] Hadoop QA commented on HDFS-9727: - | (x) *{color:red}-1 overall{color}* | \\ \\ || Vote || Subsystem ||

[jira] [Created] (HDFS-9729) Use null to replace DataNode.EMPTY_DEL_HINT

2016-02-01 Thread Tsz Wo Nicholas Sze (JIRA)
Tsz Wo Nicholas Sze created HDFS-9729: - Summary: Use null to replace DataNode.EMPTY_DEL_HINT Key: HDFS-9729 URL: https://issues.apache.org/jira/browse/HDFS-9729 Project: Hadoop HDFS

  1   2   >