[jira] [Updated] (HDFS-11468) Ozone: SCM: Add Node Metrics for SCM

2017-10-16 Thread Yiqun Lin (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-11468?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Yiqun Lin updated HDFS-11468: - Attachment: HDFS-11468-HDFS-7240.002.patch Attach the updated patch for improving the UT, fixing

[jira] [Updated] (HDFS-11467) Support ErasureCoding section in OIV XML/ReverseXML

2017-10-16 Thread Huafeng Wang (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-11467?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Huafeng Wang updated HDFS-11467: Attachment: HDFS-11467.002.patch > Support ErasureCoding section in OIV XML/ReverseXML >

[jira] [Commented] (HDFS-11468) Ozone: SCM: Add Node Metrics for SCM

2017-10-16 Thread Hadoop QA (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-11468?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16205614#comment-16205614 ] Hadoop QA commented on HDFS-11468: -- | (x) *{color:red}-1 overall{color}* | \\ \\ || Vote || Subsystem ||

[jira] [Commented] (HDFS-12310) [SPS]: Provide an option to track the status of in progress requests

2017-10-16 Thread Rakesh R (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-12310?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16205650#comment-16205650 ] Rakesh R commented on HDFS-12310: - Thanks [~surendrasingh]. Good work! Adding few comments on the patch.

[jira] [Comment Edited] (HDFS-12638) NameNode exits due to ReplicationMonitor thread received Runtime exception in ReplicationWork#chooseTargets

2017-10-16 Thread Jiandan Yang (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-12638?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16205739#comment-16205739 ] Jiandan Yang edited comment on HDFS-12638 at 10/16/17 11:15 AM: - Doing

[jira] [Updated] (HDFS-12638) NameNode exits due to ReplicationMonitor thread received Runtime exception in ReplicationWork#chooseTargets

2017-10-16 Thread Jiandan Yang (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-12638?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Jiandan Yang updated HDFS-12638: - Attachment: HDFS-12638-branch-2.8.2.001.patch > NameNode exits due to ReplicationMonitor thread

[jira] [Commented] (HDFS-11467) Support ErasureCoding section in OIV XML/ReverseXML

2017-10-16 Thread Huafeng Wang (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-11467?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16205654#comment-16205654 ] Huafeng Wang commented on HDFS-11467: - Thanks [~jojochuang], [~Sammi] for your reviews, I just updated

[jira] [Commented] (HDFS-12638) NameNode exits due to ReplicationMonitor thread received Runtime exception in ReplicationWork#chooseTargets

2017-10-16 Thread Jiandan Yang (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-12638?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16205739#comment-16205739 ] Jiandan Yang commented on HDFS-12638: -- Doing truncate & delete files when cluster is RollingUpgrade

[jira] [Updated] (HDFS-12638) NameNode exits due to ReplicationMonitor thread received Runtime exception in ReplicationWork#chooseTargets

2017-10-16 Thread Jiandan Yang (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-12638?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Jiandan Yang updated HDFS-12638: - Status: Patch Available (was: Open) > NameNode exits due to ReplicationMonitor thread received

[jira] [Updated] (HDFS-11902) [READ] Merge BlockFormatProvider and FileRegionProvider.

2017-10-16 Thread Ewan Higgs (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-11902?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Ewan Higgs updated HDFS-11902: -- Status: Patch Available (was: Open) > [READ] Merge BlockFormatProvider and FileRegionProvider. >

[jira] [Updated] (HDFS-11902) [READ] Merge BlockFormatProvider and FileRegionProvider.

2017-10-16 Thread Ewan Higgs (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-11902?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Ewan Higgs updated HDFS-11902: -- Status: Open (was: Patch Available) > [READ] Merge BlockFormatProvider and FileRegionProvider. >

[jira] [Commented] (HDFS-12638) NameNode exits due to ReplicationMonitor thread received Runtime exception in ReplicationWork#chooseTargets

2017-10-16 Thread Weiwei Yang (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-12638?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16205861#comment-16205861 ] Weiwei Yang commented on HDFS-12638: Hi [~yangjiandan] Thanks for narrowing down the root cause and

[jira] [Commented] (HDFS-11902) [READ] Merge BlockFormatProvider and FileRegionProvider.

2017-10-16 Thread Ewan Higgs (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-11902?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16205819#comment-16205819 ] Ewan Higgs commented on HDFS-11902: --- I removed patch 10 as it included errors and was only intended to

[jira] [Updated] (HDFS-11902) [READ] Merge BlockFormatProvider and FileRegionProvider.

2017-10-16 Thread Ewan Higgs (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-11902?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Ewan Higgs updated HDFS-11902: -- Attachment: (was: HDFS-11902-HDFS-9806.010.patch) > [READ] Merge BlockFormatProvider and

[jira] [Commented] (HDFS-11467) Support ErasureCoding section in OIV XML/ReverseXML

2017-10-16 Thread Hadoop QA (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-11467?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16205827#comment-16205827 ] Hadoop QA commented on HDFS-11467: -- | (/) *{color:green}+1 overall{color}* | \\ \\ || Vote || Subsystem

[jira] [Created] (HDFS-12665) [AliasMap] Create a version of the AliasMap that runs in memory in the Namenode (leveldb)

2017-10-16 Thread Ewan Higgs (JIRA)
Ewan Higgs created HDFS-12665: - Summary: [AliasMap] Create a version of the AliasMap that runs in memory in the Namenode (leveldb) Key: HDFS-12665 URL: https://issues.apache.org/jira/browse/HDFS-12665

[jira] [Comment Edited] (HDFS-12036) Add audit log for some erasure coding operations

2017-10-16 Thread Kuhu Shukla (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-12036?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16206071#comment-16206071 ] Kuhu Shukla edited comment on HDFS-12036 at 10/16/17 3:58 PM: --

[jira] [Updated] (HDFS-12620) Backporting HDFS-10467 to branch-2

2017-10-16 Thread JIRA
[ https://issues.apache.org/jira/browse/HDFS-12620?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Íñigo Goiri updated HDFS-12620: --- Attachment: HDFS-10467-branch-2.004.patch Rebasing to latest branch-2 just in case. > Backporting

[jira] [Updated] (HDFS-12594) SnapshotDiff - snapshotDiff fails if the snapshotDiff report exceeds the RPC response limit

2017-10-16 Thread Shashikant Banerjee (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-12594?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Shashikant Banerjee updated HDFS-12594: --- Attachment: (was: HDFS-12594.001.patch) > SnapshotDiff - snapshotDiff fails if

[jira] [Updated] (HDFS-12594) SnapshotDiff - snapshotDiff fails if the snapshotDiff report exceeds the RPC response limit

2017-10-16 Thread Shashikant Banerjee (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-12594?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Shashikant Banerjee updated HDFS-12594: --- Status: Open (was: Patch Available) Missed a few changes in this patch.. Cancelling

[jira] [Updated] (HDFS-11246) FSNameSystem#logAuditEvent should be called outside the read or write locks

2017-10-16 Thread Kuhu Shukla (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-11246?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Kuhu Shukla updated HDFS-11246: --- Attachment: HDFS-11246.003.patch Rebased patch. > FSNameSystem#logAuditEvent should be called

[jira] [Created] (HDFS-12666) Provided Storage Mount Manager (PSMM) mount

2017-10-16 Thread Ewan Higgs (JIRA)
Ewan Higgs created HDFS-12666: - Summary: Provided Storage Mount Manager (PSMM) mount Key: HDFS-12666 URL: https://issues.apache.org/jira/browse/HDFS-12666 Project: Hadoop HDFS Issue Type:

[jira] [Commented] (HDFS-12659) Update TestDeadDatanode#testNonDFSUsedONDeadNodeReReg to increase heartbeat recheck interval

2017-10-16 Thread Ajay Kumar (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-12659?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16206060#comment-16206060 ] Ajay Kumar commented on HDFS-12659: --- [~xiaochen], Thanks!! > Update

[jira] [Commented] (HDFS-12664) Ozone: Documentation: Add version specific documentation site to KSM

2017-10-16 Thread Elek, Marton (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-12664?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16206134#comment-16206134 ] Elek, Marton commented on HDFS-12664: - 1. src/main/docs would be better than src/main/java, I think.

[jira] [Updated] (HDFS-12594) SnapshotDiff - snapshotDiff fails if the snapshotDiff report exceeds the RPC response limit

2017-10-16 Thread Shashikant Banerjee (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-12594?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Shashikant Banerjee updated HDFS-12594: --- Attachment: HDFS-12594.001.patch > SnapshotDiff - snapshotDiff fails if the

[jira] [Updated] (HDFS-12594) SnapshotDiff - snapshotDiff fails if the snapshotDiff report exceeds the RPC response limit

2017-10-16 Thread Shashikant Banerjee (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-12594?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Shashikant Banerjee updated HDFS-12594: --- Status: Patch Available (was: Open) > SnapshotDiff - snapshotDiff fails if the

[jira] [Commented] (HDFS-11754) Make FsServerDefaults cache configurable.

2017-10-16 Thread Rushabh S Shah (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-11754?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16206106#comment-16206106 ] Rushabh S Shah commented on HDFS-11754: --- Hi [~erofeev], Thanks for the latest patch. The patch looks

[jira] [Commented] (HDFS-12664) Ozone: Documentation: Add version specific documentation site to KSM

2017-10-16 Thread Anu Engineer (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-12664?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16206142#comment-16206142 ] Anu Engineer commented on HDFS-12664: - Thanks for the review comments. bq. src/main/docs would be

[jira] [Commented] (HDFS-12603) Enable async edit logging by default

2017-10-16 Thread Xiao Chen (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-12603?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16206171#comment-16206171 ] Xiao Chen commented on HDFS-12603: -- +1, committing this. > Enable async edit logging by default >

[jira] [Assigned] (HDFS-12660) Enable async edit logging test cases in TestFailureToReadEdits

2017-10-16 Thread Ajay Kumar (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-12660?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Ajay Kumar reassigned HDFS-12660: - Assignee: Ajay Kumar > Enable async edit logging test cases in TestFailureToReadEdits >

[jira] [Updated] (HDFS-12594) SnapshotDiff - snapshotDiff fails if the snapshotDiff report exceeds the RPC response limit

2017-10-16 Thread Shashikant Banerjee (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-12594?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Shashikant Banerjee updated HDFS-12594: --- Attachment: HDFS-12594.001.patch The patch implements the design changes to compute

[jira] [Updated] (HDFS-12594) SnapshotDiff - snapshotDiff fails if the snapshotDiff report exceeds the RPC response limit

2017-10-16 Thread Shashikant Banerjee (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-12594?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Shashikant Banerjee updated HDFS-12594: --- Attachment: (was: SnapshotDiff_Improvemnets .pdf) > SnapshotDiff - snapshotDiff

[jira] [Updated] (HDFS-12594) SnapshotDiff - snapshotDiff fails if the snapshotDiff report exceeds the RPC response limit

2017-10-16 Thread Shashikant Banerjee (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-12594?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Shashikant Banerjee updated HDFS-12594: --- Status: Patch Available (was: Open) > SnapshotDiff - snapshotDiff fails if the

[jira] [Updated] (HDFS-12594) SnapshotDiff - snapshotDiff fails if the snapshotDiff report exceeds the RPC response limit

2017-10-16 Thread Shashikant Banerjee (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-12594?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Shashikant Banerjee updated HDFS-12594: --- Attachment: SnapshotDiff_Improvemnets .pdf Replacing the earlier uploaded doc with

[jira] [Updated] (HDFS-12650) Use slf4j instead of log4j in LeaseManager

2017-10-16 Thread Ajay Kumar (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-12650?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Ajay Kumar updated HDFS-12650: -- Attachment: HDFS-12650.02.patch [~ajisakaa], thanks for review. Addressed suggested changes in patch

[jira] [Commented] (HDFS-12620) Backporting HDFS-10467 to branch-2

2017-10-16 Thread Hadoop QA (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-12620?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16206145#comment-16206145 ] Hadoop QA commented on HDFS-12620: -- | (x) *{color:red}-1 overall{color}* | \\ \\ || Vote || Subsystem ||

[jira] [Updated] (HDFS-12603) Enable async edit logging by default

2017-10-16 Thread Xiao Chen (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-12603?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Xiao Chen updated HDFS-12603: - Resolution: Fixed Hadoop Flags: Reviewed Fix Version/s: 3.0.0 2.8.3

[jira] [Updated] (HDFS-12642) Log block and datanode details in BlockRecoveryWorker

2017-10-16 Thread Xiao Chen (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-12642?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Xiao Chen updated HDFS-12642: - Resolution: Fixed Hadoop Flags: Reviewed Fix Version/s: 3.0.0 2.8.3

[jira] [Commented] (HDFS-12613) Native EC coder should implement release() as idempotent function.

2017-10-16 Thread Lei (Eddy) Xu (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-12613?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16206270#comment-16206270 ] Lei (Eddy) Xu commented on HDFS-12613: -- [~drankye] Good point. It is very hard for me to find a

[jira] [Commented] (HDFS-12612) DFSStripedOutputStream#close will throw if called a second time with a failed streamer

2017-10-16 Thread Andrew Wang (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-12612?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16206306#comment-16206306 ] Andrew Wang commented on HDFS-12612: Thanks for working on this Eddy, looks good overall, though we

[jira] [Updated] (HDFS-12521) Ozone: SCM should read all Container info into memory when booting up

2017-10-16 Thread Lokesh Jain (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-12521?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Lokesh Jain updated HDFS-12521: --- Status: Patch Available (was: Reopened) > Ozone: SCM should read all Container info into memory when

[jira] [Updated] (HDFS-12521) Ozone: SCM should read all Container info into memory when booting up

2017-10-16 Thread Lokesh Jain (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-12521?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Lokesh Jain updated HDFS-12521: --- Attachment: HDFS-12521-HDFS-7240.001.patch This patch fixes the issues with TestSCMCli and adds a

[jira] [Created] (HDFS-12667) KMSClientProvider#ValueQueue does synchronous fetch of edeks in background async thread.

2017-10-16 Thread Rushabh S Shah (JIRA)
Rushabh S Shah created HDFS-12667: - Summary: KMSClientProvider#ValueQueue does synchronous fetch of edeks in background async thread. Key: HDFS-12667 URL: https://issues.apache.org/jira/browse/HDFS-12667

[jira] [Commented] (HDFS-12642) Log block and datanode details in BlockRecoveryWorker

2017-10-16 Thread Hudson (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-12642?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16206363#comment-16206363 ] Hudson commented on HDFS-12642: --- SUCCESS: Integrated in Jenkins build Hadoop-trunk-Commit #13090 (See

[jira] [Updated] (HDFS-12620) Backporting HDFS-10467 to branch-2

2017-10-16 Thread JIRA
[ https://issues.apache.org/jira/browse/HDFS-12620?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Íñigo Goiri updated HDFS-12620: --- Attachment: HDFS-12620-branch-2.005.patch > Backporting HDFS-10467 to branch-2 >

[jira] [Updated] (HDFS-12637) Extend TestDistributedFileSystemWithECFile with a random EC policy

2017-10-16 Thread Xiao Chen (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-12637?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Xiao Chen updated HDFS-12637: - Resolution: Fixed Hadoop Flags: Reviewed Fix Version/s: 3.0.0 Status: Resolved

[jira] [Commented] (HDFS-12664) Ozone: Documentation: Add version specific documentation site to KSM

2017-10-16 Thread Elek, Marton (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-12664?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16206194#comment-16206194 ] Elek, Marton commented on HDFS-12664: - Yes, 3 is more like a long-term plan. I will do more

[jira] [Commented] (HDFS-12642) Log block and datanode details in BlockRecoveryWorker

2017-10-16 Thread Xiao Chen (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-12642?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16206253#comment-16206253 ] Xiao Chen commented on HDFS-12642: -- Thanks Yongjun. Failed test is not related to the change. No tests

[jira] [Commented] (HDFS-12518) Re-encryption should handle task cancellation and progress better

2017-10-16 Thread Wei-Chiu Chuang (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-12518?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16206375#comment-16206375 ] Wei-Chiu Chuang commented on HDFS-12518: Hi [~xiaochen] thanks for the patch. I gave it an initial

[jira] [Commented] (HDFS-12628) libhdfs crashes on thread exit for JNI+libhdfs applications

2017-10-16 Thread James Clampffer (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-12628?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16206312#comment-16206312 ] James Clampffer commented on HDFS-12628: [~aw], I agree. Going to send out a [discuss] email out

[jira] [Comment Edited] (HDFS-12521) Ozone: SCM should read all Container info into memory when booting up

2017-10-16 Thread Lokesh Jain (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-12521?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16206310#comment-16206310 ] Lokesh Jain edited comment on HDFS-12521 at 10/16/17 6:08 PM: -- I have

[jira] [Commented] (HDFS-11885) createEncryptionZone should not block on initializing EDEK cache

2017-10-16 Thread Rushabh S Shah (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-11885?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16206361#comment-16206361 ] Rushabh S Shah commented on HDFS-11885: --- I tried to upmerge my internal 2.8 version of patch to

[jira] [Updated] (HDFS-12620) Backporting HDFS-10467 to branch-2

2017-10-16 Thread JIRA
[ https://issues.apache.org/jira/browse/HDFS-12620?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Íñigo Goiri updated HDFS-12620: --- Attachment: HDFS-12620-branch-2.005.patch > Backporting HDFS-10467 to branch-2 >

[jira] [Updated] (HDFS-12620) Backporting HDFS-10467 to branch-2

2017-10-16 Thread JIRA
[ https://issues.apache.org/jira/browse/HDFS-12620?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Íñigo Goiri updated HDFS-12620: --- Attachment: (was: HDFS-12620-branch-2.005.patch) > Backporting HDFS-10467 to branch-2 >

[jira] [Commented] (HDFS-12485) expunge may not remove trash from encryption zone

2017-10-16 Thread Wei-Chiu Chuang (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-12485?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16206192#comment-16206192 ] Wei-Chiu Chuang commented on HDFS-12485: Committing the rev 001 patch based on [~xyao]'s +1 >

[jira] [Commented] (HDFS-12621) Inconsistency/confusion around ViewFileSystem.getDelagation

2017-10-16 Thread Erik Krogen (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-12621?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16206309#comment-16206309 ] Erik Krogen commented on HDFS-12621: I don't think Option 2 is the right approach; this goes against

[jira] [Updated] (HDFS-12667) KMSClientProvider#ValueQueue does synchronous fetch of edeks in background async thread.

2017-10-16 Thread Rushabh S Shah (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-12667?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Rushabh S Shah updated HDFS-12667: -- Description: There are couple of issues in KMSClientProvider#ValueQueue. 1.

[jira] [Commented] (HDFS-12637) Extend TestDistributedFileSystemWithECFile with a random EC policy

2017-10-16 Thread Xiao Chen (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-12637?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16206186#comment-16206186 ] Xiao Chen commented on HDFS-12637: -- +1, committing this. > Extend TestDistributedFileSystemWithECFile

[jira] [Commented] (HDFS-12603) Enable async edit logging by default

2017-10-16 Thread Hudson (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-12603?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16206235#comment-16206235 ] Hudson commented on HDFS-12603: --- SUCCESS: Integrated in Jenkins build Hadoop-trunk-Commit #13089 (See

[jira] [Commented] (HDFS-12637) Extend TestDistributedFileSystemWithECFile with a random EC policy

2017-10-16 Thread Hudson (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-12637?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16206236#comment-16206236 ] Hudson commented on HDFS-12637: --- SUCCESS: Integrated in Jenkins build Hadoop-trunk-Commit #13089 (See

[jira] [Updated] (HDFS-12620) Backporting HDFS-10467 to branch-2

2017-10-16 Thread JIRA
[ https://issues.apache.org/jira/browse/HDFS-12620?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Íñigo Goiri updated HDFS-12620: --- Attachment: (was: HDFS-10467-branch-2.004.patch) > Backporting HDFS-10467 to branch-2 >

[jira] [Updated] (HDFS-11902) [READ] Merge BlockFormatProvider and FileRegionProvider.

2017-10-16 Thread Virajith Jalaparti (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-11902?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Virajith Jalaparti updated HDFS-11902: -- Status: Open (was: Patch Available) > [READ] Merge BlockFormatProvider and

[jira] [Updated] (HDFS-11902) [READ] Merge BlockFormatProvider and FileRegionProvider.

2017-10-16 Thread Virajith Jalaparti (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-11902?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Virajith Jalaparti updated HDFS-11902: -- Status: Open (was: Patch Available) > [READ] Merge BlockFormatProvider and

[jira] [Updated] (HDFS-11902) [READ] Merge BlockFormatProvider and FileRegionProvider.

2017-10-16 Thread Virajith Jalaparti (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-11902?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Virajith Jalaparti updated HDFS-11902: -- Attachment: HDFS-11902-HDFS-9806.009.patch > [READ] Merge BlockFormatProvider and

[jira] [Updated] (HDFS-11902) [READ] Merge BlockFormatProvider and FileRegionProvider.

2017-10-16 Thread Virajith Jalaparti (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-11902?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Virajith Jalaparti updated HDFS-11902: -- Status: Patch Available (was: Open) > [READ] Merge BlockFormatProvider and

[jira] [Updated] (HDFS-11902) [READ] Merge BlockFormatProvider and FileRegionProvider.

2017-10-16 Thread Virajith Jalaparti (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-11902?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Virajith Jalaparti updated HDFS-11902: -- Attachment: (was: HDFS-11902-HDFS-9806.009.patch) > [READ] Merge

[jira] [Created] (HDFS-12670) can't renew HDFS tokens with only the hdfs client jar

2017-10-16 Thread Thomas Graves (JIRA)
Thomas Graves created HDFS-12670: Summary: can't renew HDFS tokens with only the hdfs client jar Key: HDFS-12670 URL: https://issues.apache.org/jira/browse/HDFS-12670 Project: Hadoop HDFS

[jira] [Updated] (HDFS-12654) APPEND API call is different in HTTPFS and NameNode REST

2017-10-16 Thread Andrew Wang (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-12654?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Andrew Wang updated HDFS-12654: --- Target Version/s: 2.8.0, 2.7.0, 2.6.0, 3.0.0 (was: 2.6.0, 2.7.0, 2.8.0, 3.0.0-beta1) > APPEND API

[jira] [Commented] (HDFS-12036) Add audit log for some erasure coding operations

2017-10-16 Thread Kuhu Shukla (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-12036?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16206071#comment-16206071 ] Kuhu Shukla commented on HDFS-12036: [~HuafengWang], [~drankye], was the intent of this patch to log

[jira] [Commented] (HDFS-12594) SnapshotDiff - snapshotDiff fails if the snapshotDiff report exceeds the RPC response limit

2017-10-16 Thread Hadoop QA (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-12594?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16206410#comment-16206410 ] Hadoop QA commented on HDFS-12594: -- | (x) *{color:red}-1 overall{color}* | \\ \\ || Vote || Subsystem ||

[jira] [Created] (HDFS-12668) MetricsSystemImpl should consistently check minicluster mode

2017-10-16 Thread Xiao Chen (JIRA)
Xiao Chen created HDFS-12668: Summary: MetricsSystemImpl should consistently check minicluster mode Key: HDFS-12668 URL: https://issues.apache.org/jira/browse/HDFS-12668 Project: Hadoop HDFS

[jira] [Commented] (HDFS-12650) Use slf4j instead of log4j in LeaseManager

2017-10-16 Thread Hadoop QA (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-12650?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16206427#comment-16206427 ] Hadoop QA commented on HDFS-12650: -- | (x) *{color:red}-1 overall{color}* | \\ \\ || Vote || Subsystem ||

[jira] [Updated] (HDFS-12502) nntop should support a category based on FilesInGetListingOps

2017-10-16 Thread Zhe Zhang (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-12502?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Zhe Zhang updated HDFS-12502: - Attachment: HDFS-12502.04.patch Thanks [~ywskycn]! Attaching new patch to address the comment. > nntop

[jira] [Updated] (HDFS-11902) [READ] Merge BlockFormatProvider and FileRegionProvider.

2017-10-16 Thread Virajith Jalaparti (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-11902?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Virajith Jalaparti updated HDFS-11902: -- Status: Patch Available (was: Open) > [READ] Merge BlockFormatProvider and

[jira] [Commented] (HDFS-12612) DFSStripedOutputStream#close will throw if called a second time with a failed streamer

2017-10-16 Thread Hadoop QA (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-12612?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16206710#comment-16206710 ] Hadoop QA commented on HDFS-12612: -- | (x) *{color:red}-1 overall{color}* | \\ \\ || Vote || Subsystem ||

[jira] [Updated] (HDFS-12534) Provide logical BlockLocations for EC files for better split calculation

2017-10-16 Thread Andrew Wang (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-12534?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Andrew Wang updated HDFS-12534: --- Labels: hdfs-ec-3.0-nice-to-have (was: hdfs-ec-3.0-must-do) > Provide logical BlockLocations for EC

[jira] [Updated] (HDFS-12671) [READ] Test NameNode restarts

2017-10-16 Thread Virajith Jalaparti (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-12671?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Virajith Jalaparti updated HDFS-12671: -- Attachment: HDFS-12671-HDFS-9806.001.patch > [READ] Test NameNode restarts >

[jira] [Comment Edited] (HDFS-12642) Log block and datanode details in BlockRecoveryWorker

2017-10-16 Thread Yongjun Zhang (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-12642?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16205432#comment-16205432 ] Yongjun Zhang edited comment on HDFS-12642 at 10/16/17 11:54 PM: - Makes

[jira] [Work started] (HDFS-7466) Allow different values for dfs.datanode.balance.max.concurrent.moves per datanode

2017-10-16 Thread Benoy Antony (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-7466?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Work on HDFS-7466 started by Benoy Antony. -- > Allow different values for dfs.datanode.balance.max.concurrent.moves per >

[jira] [Created] (HDFS-12671) Test NameNode restarts

2017-10-16 Thread Virajith Jalaparti (JIRA)
Virajith Jalaparti created HDFS-12671: - Summary: Test NameNode restarts Key: HDFS-12671 URL: https://issues.apache.org/jira/browse/HDFS-12671 Project: Hadoop HDFS Issue Type: Sub-task

[jira] [Updated] (HDFS-12671) [READ] Test NameNode restarts

2017-10-16 Thread Virajith Jalaparti (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-12671?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Virajith Jalaparti updated HDFS-12671: -- Summary: [READ] Test NameNode restarts (was: Test NameNode restarts) > [READ] Test

[jira] [Commented] (HDFS-12638) NameNode exits due to ReplicationMonitor thread received Runtime exception in ReplicationWork#chooseTargets

2017-10-16 Thread Hadoop QA (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-12638?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16206786#comment-16206786 ] Hadoop QA commented on HDFS-12638: -- | (x) *{color:red}-1 overall{color}* | \\ \\ || Vote || Subsystem ||

[jira] [Commented] (HDFS-7466) Allow different values for dfs.datanode.balance.max.concurrent.moves per datanode

2017-10-16 Thread Benoy Antony (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-7466?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16206818#comment-16206818 ] Benoy Antony commented on HDFS-7466: I think [~dan...@cloudera.com]'s suggestion makes a lot of sense.

[jira] [Updated] (HDFS-12485) expunge may fail to remove trash from encryption zone

2017-10-16 Thread Wei-Chiu Chuang (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-12485?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Wei-Chiu Chuang updated HDFS-12485: --- Summary: expunge may fail to remove trash from encryption zone (was: expunge may not remove

[jira] [Commented] (HDFS-12485) expunge may fail to remove trash from encryption zone

2017-10-16 Thread Hudson (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-12485?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16206567#comment-16206567 ] Hudson commented on HDFS-12485: --- SUCCESS: Integrated in Jenkins build Hadoop-trunk-Commit #13091 (See

[jira] [Commented] (HDFS-12521) Ozone: SCM should read all Container info into memory when booting up

2017-10-16 Thread Hadoop QA (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-12521?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16206439#comment-16206439 ] Hadoop QA commented on HDFS-12521: -- | (x) *{color:red}-1 overall{color}* | \\ \\ || Vote || Subsystem ||

[jira] [Resolved] (HDFS-5290) Port Encryption Support in DataTransfer protocol to Hadoop 1

2017-10-16 Thread Benoy Antony (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-5290?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Benoy Antony resolved HDFS-5290. Resolution: Won't Do Cleaning up jiras which is not relevant anymore. > Port Encryption Support in

[jira] [Updated] (HDFS-12612) DFSStripedOutputStream#close will throw if called a second time with a failed streamer

2017-10-16 Thread Lei (Eddy) Xu (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-12612?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Lei (Eddy) Xu updated HDFS-12612: - Attachment: HDFS-12612.02.patch Thanks for the suggestions [~andrew.wang] Updated to fix

[jira] [Resolved] (HDFS-4823) Inode.toString () should return the full path

2017-10-16 Thread Benoy Antony (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-4823?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Benoy Antony resolved HDFS-4823. Resolution: Won't Do Cleaning up jiras which is not relevant anymore. > Inode.toString () should

[jira] [Created] (HDFS-12669) Implement toString() for EditLogInputStream

2017-10-16 Thread Chao Sun (JIRA)
Chao Sun created HDFS-12669: --- Summary: Implement toString() for EditLogInputStream Key: HDFS-12669 URL: https://issues.apache.org/jira/browse/HDFS-12669 Project: Hadoop HDFS Issue Type:

[jira] [Commented] (HDFS-12669) Implement toString() for EditLogInputStream

2017-10-16 Thread Chao Sun (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-12669?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16206604#comment-16206604 ] Chao Sun commented on HDFS-12669: - I want to assign this to myself and start contributing to HDFS. [~zhz],

[jira] [Commented] (HDFS-12564) Add the documents of swebhdfs configurations on the client side

2017-10-16 Thread Takanobu Asanuma (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-12564?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16206973#comment-16206973 ] Takanobu Asanuma commented on HDFS-12564: - Hi [~jojochuang], sorry to ping again. The patch still

[jira] [Commented] (HDFS-12588) Use GenericOptionsParser for scm and ksm daemon

2017-10-16 Thread Weiwei Yang (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-12588?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16206975#comment-16206975 ] Weiwei Yang commented on HDFS-12588: Hi [~elek] Thanks for working on this. I have a few comments to

[jira] [Updated] (HDFS-12518) Re-encryption should handle task cancellation and progress better

2017-10-16 Thread Xiao Chen (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-12518?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Xiao Chen updated HDFS-12518: - Attachment: HDFS-12518.02.patch Thanks for the review [~jojochuang]! Patch 2 addressed first 2 comments.

[jira] [Updated] (HDFS-12638) NameNode exits due to ReplicationMonitor thread received Runtime exception in ReplicationWork#chooseTargets

2017-10-16 Thread Konstantin Shvachko (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-12638?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Konstantin Shvachko updated HDFS-12638: --- Status: Open (was: Patch Available) Was looking at the unit test attached.

[jira] [Created] (HDFS-12672) Verify erasure coding native code on Windows platform

2017-10-16 Thread SammiChen (JIRA)
SammiChen created HDFS-12672: Summary: Verify erasure coding native code on Windows platform Key: HDFS-12672 URL: https://issues.apache.org/jira/browse/HDFS-12672 Project: Hadoop HDFS Issue

[jira] [Assigned] (HDFS-12672) Verify erasure coding native code on Windows platform

2017-10-16 Thread SammiChen (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-12672?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] SammiChen reassigned HDFS-12672: Assignee: SammiChen > Verify erasure coding native code on Windows platform >

[jira] [Commented] (HDFS-12613) Native EC coder should implement release() as idempotent function.

2017-10-16 Thread SammiChen (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-12613?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16206917#comment-16206917 ] SammiChen commented on HDFS-12613: -- HDFS-12672 is fired for track. Will prepare a Window environment

[jira] [Commented] (HDFS-12638) NameNode exits due to ReplicationMonitor thread received Runtime exception in ReplicationWork#chooseTargets

2017-10-16 Thread Weiwei Yang (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-12638?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16206921#comment-16206921 ] Weiwei Yang commented on HDFS-12638: Hi [~shv], the actual deletion of those blocks are running in

[jira] [Commented] (HDFS-12613) Native EC coder should implement release() as idempotent function.

2017-10-16 Thread Lei (Eddy) Xu (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-12613?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16206937#comment-16206937 ] Lei (Eddy) Xu commented on HDFS-12613: -- Thanks a lot for the reviews and create HDFS-12672 to track

  1   2   >