[jira] [Updated] (HDFS-13106) Need to exercise all HDFS APIs for EC

[ https://issues.apache.org/jira/browse/HDFS-13106?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Haibo Yan updated HDFS-13106: - Attachment: HDFS-13106.002.patch > Need to exercise all HDFS APIs for EC >

[jira] [Updated] (HDFS-13113) Use Log.*(Object, Throwable) overload to log exceptions

[ https://issues.apache.org/jira/browse/HDFS-13113?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Steve Loughran updated HDFS-13113: -- Status: Patch Available (was: Open) > Use Log.*(Object, Throwable) overload to log exceptions

[jira] [Commented] (HDFS-13097) [SPS]: Fix the branch review comments(Part1)

[ https://issues.apache.org/jira/browse/HDFS-13097?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16354381#comment-16354381 ] genericqa commented on HDFS-13097: -- | (x) *{color:red}-1 overall{color}* | \\ \\ || Vote || Subsystem ||

[jira] [Updated] (HDFS-13112) Token expiration edits may cause log corruption or deadlock

[ https://issues.apache.org/jira/browse/HDFS-13112?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Daryn Sharp updated HDFS-13112: --- Attachment: HDFS-13112.patch > Token expiration edits may cause log corruption or deadlock >

[jira] [Commented] (HDFS-13099) RBF: Refactor RBF relevant settings

[ https://issues.apache.org/jira/browse/HDFS-13099?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16354285#comment-16354285 ] Íñigo Goiri commented on HDFS-13099: +1 on [^HDFS-13099.002.patch]. Thanks [~linyiqun]. > RBF:

[jira] [Commented] (HDFS-10453) ReplicationMonitor thread could stuck for long time due to the race between replication and delete of same file in a large cluster.

[ https://issues.apache.org/jira/browse/HDFS-10453?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16354286#comment-16354286 ] Chen Liang commented on HDFS-10453: --- Thanks for the follow up [~hexiaoqiao]! bq. if check if(targets ==

[jira] [Commented] (HDFS-11701) NPE from Unresolved Host causes permanent DFSInputStream failures

[ https://issues.apache.org/jira/browse/HDFS-11701?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16354215#comment-16354215 ] Lokesh Jain commented on HDFS-11701: [~jnp] Thanks for reviewing the patch! v3 patch adds a unit test.

[jira] [Updated] (HDFS-13113) Use Log.*(Object, Throwable) overload to log exceptions

[ https://issues.apache.org/jira/browse/HDFS-13113?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Steve Loughran updated HDFS-13113: -- Attachment: HADOOP-10571.05.patch > Use Log.*(Object, Throwable) overload to log exceptions >

[jira] [Comment Edited] (HDFS-10453) ReplicationMonitor thread could stuck for long time due to the race between replication and delete of same file in a large cluster.

[ https://issues.apache.org/jira/browse/HDFS-10453?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16354286#comment-16354286 ] Chen Liang edited comment on HDFS-10453 at 2/6/18 6:22 PM: --- Thanks for the

[jira] [Commented] (HDFS-13111) Close recovery may incorrectly mark blocks corrupt

[ https://issues.apache.org/jira/browse/HDFS-13111?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16354076#comment-16354076 ] Kihwal Lee commented on HDFS-13111: --- Here is relevant log lines of the latest example. This node was

[jira] [Created] (HDFS-13112) Token expiration edits may cause log corruption or deadlock

Daryn Sharp created HDFS-13112: -- Summary: Token expiration edits may cause log corruption or deadlock Key: HDFS-13112 URL: https://issues.apache.org/jira/browse/HDFS-13112 Project: Hadoop HDFS

[jira] [Commented] (HDFS-13051) dead lock occurs when rolleditlog rpc call happen and editPendingQ is full

[ https://issues.apache.org/jira/browse/HDFS-13051?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16354195#comment-16354195 ] Daryn Sharp commented on HDFS-13051: Unit testing was virtually unable to reproduce the issue.

[jira] [Created] (HDFS-13113) Use Log.*(Object, Throwable) overload to log exceptions

Steve Loughran created HDFS-13113: - Summary: Use Log.*(Object, Throwable) overload to log exceptions Key: HDFS-13113 URL: https://issues.apache.org/jira/browse/HDFS-13113 Project: Hadoop HDFS

[jira] [Commented] (HDFS-13106) Need to exercise all HDFS APIs for EC

[ https://issues.apache.org/jira/browse/HDFS-13106?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16354320#comment-16354320 ] Lei (Eddy) Xu commented on HDFS-13106: -- Hi, [~billyean] Thanks again for the updates. I have a few

[jira] [Updated] (HDFS-11701) NPE from Unresolved Host causes permanent DFSInputStream failures

[ https://issues.apache.org/jira/browse/HDFS-11701?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Lokesh Jain updated HDFS-11701: --- Attachment: HDFS-11701.003.patch > NPE from Unresolved Host causes permanent DFSInputStream failures

[jira] [Commented] (HDFS-13106) Need to exercise all HDFS APIs for EC

[ https://issues.apache.org/jira/browse/HDFS-13106?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16354233#comment-16354233 ] Haibo Yan commented on HDFS-13106: -- [~eddyxu] [~mackrorysd] fixed the checkstyle issue and removed set

[jira] [Commented] (HDFS-13112) Token expiration edits may cause log corruption or deadlock

[ https://issues.apache.org/jira/browse/HDFS-13112?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16354240#comment-16354240 ] Daryn Sharp commented on HDFS-13112: Submit is pending HADOOP-15212. > Token expiration edits may

[jira] [Updated] (HDFS-12794) Ozone: Parallelize ChunkOutputSream Writes to container

[ https://issues.apache.org/jira/browse/HDFS-12794?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Shashikant Banerjee updated HDFS-12794: --- Attachment: HDFS-12794-HDFS-7240.010.patch > Ozone: Parallelize ChunkOutputSream

[jira] [Commented] (HDFS-12794) Ozone: Parallelize ChunkOutputSream Writes to container

[ https://issues.apache.org/jira/browse/HDFS-12794?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16353639#comment-16353639 ] Shashikant Banerjee commented on HDFS-12794: patch v10 addresses the OOM issue by limiting the

[jira] [Created] (HDFS-13110) [SPS]: Reduce the number of APIs in NamenodeProtocol used by external satisfier

Rakesh R created HDFS-13110: --- Summary: [SPS]: Reduce the number of APIs in NamenodeProtocol used by external satisfier Key: HDFS-13110 URL: https://issues.apache.org/jira/browse/HDFS-13110 Project: Hadoop

[jira] [Commented] (HDFS-12947) Limit the number of Snapshots allowed to be created for a Snapshottable Directory

[ https://issues.apache.org/jira/browse/HDFS-12947?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16353736#comment-16353736 ] Shashikant Banerjee commented on HDFS-12947: Thanks [~szetszwo] for the review comments. Patch

[jira] [Updated] (HDFS-12947) Limit the number of Snapshots allowed to be created for a Snapshottable Directory

[ https://issues.apache.org/jira/browse/HDFS-12947?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Shashikant Banerjee updated HDFS-12947: --- Attachment: HDFS-12947.004.patch > Limit the number of Snapshots allowed to be

[jira] [Commented] (HDFS-13110) [SPS]: Reduce the number of APIs in NamenodeProtocol used by external satisfier

[ https://issues.apache.org/jira/browse/HDFS-13110?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16353738#comment-16353738 ] Rakesh R commented on HDFS-13110: - I'm attaching patch addressing the below cases. I hope below

[jira] [Updated] (HDFS-13110) [SPS]: Reduce the number of APIs in NamenodeProtocol used by external satisfier

[ https://issues.apache.org/jira/browse/HDFS-13110?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Rakesh R updated HDFS-13110: Description: This task is to address the following [~daryn]'s comments. Please refer  HDFS-10285 to see

[jira] [Updated] (HDFS-13110) [SPS]: Reduce the number of APIs in NamenodeProtocol used by external satisfier

[ https://issues.apache.org/jira/browse/HDFS-13110?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Rakesh R updated HDFS-13110: Description: This task is to address the following [~daryn]'s comments. Please refer  HDFS-10285 to see

[jira] [Commented] (HDFS-13110) [SPS]: Reduce the number of APIs in NamenodeProtocol used by external satisfier

[ https://issues.apache.org/jira/browse/HDFS-13110?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16353750#comment-16353750 ] Rakesh R commented on HDFS-13110: - Note: Attached patch [^HDFS-13110-HDFS-10285-00.patch], is prepared on

[jira] [Comment Edited] (HDFS-13110) [SPS]: Reduce the number of APIs in NamenodeProtocol used by external satisfier

[ https://issues.apache.org/jira/browse/HDFS-13110?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16353750#comment-16353750 ] Rakesh R edited comment on HDFS-13110 at 2/6/18 11:34 AM: -- Note: Attached patch

[jira] [Updated] (HDFS-12794) Ozone: Parallelize ChunkOutputSream Writes to container

[ https://issues.apache.org/jira/browse/HDFS-12794?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Shashikant Banerjee updated HDFS-12794: --- Status: Patch Available (was: Reopened) > Ozone: Parallelize ChunkOutputSream Writes

[jira] [Commented] (HDFS-13097) [SPS]: Fix the branch review comments(Part1)

[ https://issues.apache.org/jira/browse/HDFS-13097?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16353683#comment-16353683 ] genericqa commented on HDFS-13097: -- | (x) *{color:red}-1 overall{color}* | \\ \\ || Vote || Subsystem ||

[jira] [Commented] (HDFS-12051) Reimplement NameCache in NameNode: Intern duplicate byte[] arrays (mainly those denoting file/directory names) to save memory

[ https://issues.apache.org/jira/browse/HDFS-12051?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16353655#comment-16353655 ] genericqa commented on HDFS-12051: -- | (x) *{color:red}-1 overall{color}* | \\ \\ || Vote || Subsystem ||

[jira] [Updated] (HDFS-13110) [SPS]: Reduce the number of APIs in NamenodeProtocol used by external satisfier

[ https://issues.apache.org/jira/browse/HDFS-13110?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Rakesh R updated HDFS-13110: Attachment: HDFS-13110-HDFS-10285-00.patch > [SPS]: Reduce the number of APIs in NamenodeProtocol used by

[jira] [Commented] (HDFS-13097) [SPS]: Fix the branch review comments(Part1)

[ https://issues.apache.org/jira/browse/HDFS-13097?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16353781#comment-16353781 ] Uma Maheswara Rao G commented on HDFS-13097: Thanks for updating the patch. Sorry for coming

[jira] [Commented] (HDFS-13106) Need to exercise all HDFS APIs for EC

[ https://issues.apache.org/jira/browse/HDFS-13106?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16354617#comment-16354617 ] Lei (Eddy) Xu commented on HDFS-13106: -- +1 Pending jenkins for 003 patch. Thanks [~billyean]! >

[jira] [Commented] (HDFS-12947) Limit the number of Snapshots allowed to be created for a Snapshottable Directory

[ https://issues.apache.org/jira/browse/HDFS-12947?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16354708#comment-16354708 ] Hudson commented on HDFS-12947: --- SUCCESS: Integrated in Jenkins build Hadoop-trunk-Commit #13623 (See

[jira] [Comment Edited] (HDFS-10453) ReplicationMonitor thread could stuck for long time due to the race between replication and delete of same file in a large cluster.

[ https://issues.apache.org/jira/browse/HDFS-10453?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16354711#comment-16354711 ] Erik Krogen edited comment on HDFS-10453 at 2/6/18 11:33 PM: - Hey

[jira] [Updated] (HDFS-12933) Improve logging when DFSStripedOutputStream failed to read some blocks

[ https://issues.apache.org/jira/browse/HDFS-12933?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Lei (Eddy) Xu updated HDFS-12933: - Target Version/s: 3.0.2 (was: 3.0.1) > Improve logging when DFSStripedOutputStream failed to

[jira] [Commented] (HDFS-13106) Need to exercise all HDFS APIs for EC

[ https://issues.apache.org/jira/browse/HDFS-13106?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16354767#comment-16354767 ] Sean Mackrory commented on HDFS-13106: -- Committed to trunk. > Need to exercise all HDFS APIs for EC

[jira] [Updated] (HDFS-13106) Need to exercise all HDFS APIs for EC

[ https://issues.apache.org/jira/browse/HDFS-13106?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Sean Mackrory updated HDFS-13106: - Resolution: Fixed Status: Resolved (was: Patch Available) > Need to exercise all HDFS

[jira] [Commented] (HDFS-13106) Need to exercise all HDFS APIs for EC

[ https://issues.apache.org/jira/browse/HDFS-13106?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16354513#comment-16354513 ] Haibo Yan commented on HDFS-13106: -- Thanks your review [~eddyxu], I updated the patch again, do you want

[jira] [Commented] (HDFS-11701) NPE from Unresolved Host causes permanent DFSInputStream failures

[ https://issues.apache.org/jira/browse/HDFS-11701?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16354518#comment-16354518 ] genericqa commented on HDFS-11701: -- | (x) *{color:red}-1 overall{color}* | \\ \\ || Vote || Subsystem ||

[jira] [Commented] (HDFS-13107) Add Mover Unit Tests for Federated cluster

[ https://issues.apache.org/jira/browse/HDFS-13107?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16354595#comment-16354595 ] genericqa commented on HDFS-13107: -- | (x) *{color:red}-1 overall{color}* | \\ \\ || Vote || Subsystem ||

[jira] [Commented] (HDFS-12990) Change default NameNode RPC port back to 8020

[ https://issues.apache.org/jira/browse/HDFS-12990?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16354638#comment-16354638 ] Hudson commented on HDFS-12990: --- SUCCESS: Integrated in Jenkins build Hadoop-trunk-Commit #13621 (See

[jira] [Commented] (HDFS-12990) Change default NameNode RPC port back to 8020

[ https://issues.apache.org/jira/browse/HDFS-12990?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16354631#comment-16354631 ] Lei (Eddy) Xu commented on HDFS-12990: -- Thank you [~anu] for the help! > Change default NameNode

[jira] [Updated] (HDFS-12947) Limit the number of Snapshots allowed to be created for a Snapshottable Directory

[ https://issues.apache.org/jira/browse/HDFS-12947?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Tsz Wo Nicholas Sze updated HDFS-12947: --- Resolution: Fixed Status: Resolved (was: Patch Available) I have committed

[jira] [Commented] (HDFS-12051) Reimplement NameCache in NameNode: Intern duplicate byte[] arrays (mainly those denoting file/directory names) to save memory

[ https://issues.apache.org/jira/browse/HDFS-12051?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16354707#comment-16354707 ] Tsz Wo Nicholas Sze commented on HDFS-12051: Thanks, [~mi...@cloudera.com] for running

[jira] [Commented] (HDFS-12990) Change default NameNode RPC port back to 8020

[ https://issues.apache.org/jira/browse/HDFS-12990?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16354715#comment-16354715 ] genericqa commented on HDFS-12990: -- | (x) *{color:red}-1 overall{color}* | \\ \\ || Vote || Subsystem ||

[jira] [Commented] (HDFS-13106) Need to exercise all HDFS APIs for EC

[ https://issues.apache.org/jira/browse/HDFS-13106?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16354728#comment-16354728 ] Sean Mackrory commented on HDFS-13106: -- +1 from me too. Unit test failures are unrelated, new tests

[jira] [Commented] (HDFS-13058) Fix dfs.namenode.shared.edits.dir in TestJournalNode

[ https://issues.apache.org/jira/browse/HDFS-13058?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16354645#comment-16354645 ] genericqa commented on HDFS-13058: -- | (x) *{color:red}-1 overall{color}* | \\ \\ || Vote || Subsystem ||

[jira] [Commented] (HDFS-10453) ReplicationMonitor thread could stuck for long time due to the race between replication and delete of same file in a large cluster.

[ https://issues.apache.org/jira/browse/HDFS-10453?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16354677#comment-16354677 ] Arpit Agarwal commented on HDFS-10453: -- Hi [~hexiaoqiao], I assume this is the key part of the fix in

[jira] [Commented] (HDFS-13106) Need to exercise all HDFS APIs for EC

[ https://issues.apache.org/jira/browse/HDFS-13106?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16354704#comment-16354704 ] genericqa commented on HDFS-13106: -- | (x) *{color:red}-1 overall{color}* | \\ \\ || Vote || Subsystem ||

[jira] [Commented] (HDFS-13109) Support fully qualified hdfs path in "crypto" commands path argument

[ https://issues.apache.org/jira/browse/HDFS-13109?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16354792#comment-16354792 ] genericqa commented on HDFS-13109: -- | (x) *{color:red}-1 overall{color}* | \\ \\ || Vote || Subsystem ||

[jira] [Commented] (HDFS-13112) Token expiration edits may cause log corruption or deadlock

[ https://issues.apache.org/jira/browse/HDFS-13112?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16354790#comment-16354790 ] genericqa commented on HDFS-13112: -- | (x) *{color:red}-1 overall{color}* | \\ \\ || Vote || Subsystem ||

[jira] [Updated] (HDFS-12990) Change default NameNode RPC port back to 8020

[ https://issues.apache.org/jira/browse/HDFS-12990?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Anu Engineer updated HDFS-12990: Resolution: Fixed Hadoop Flags: Incompatible change,Reviewed (was: Incompatible change)

[jira] [Commented] (HDFS-13113) Use Log.*(Object, Throwable) overload to log exceptions

[ https://issues.apache.org/jira/browse/HDFS-13113?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16354641#comment-16354641 ] genericqa commented on HDFS-13113: -- | (x) *{color:red}-1 overall{color}* | \\ \\ || Vote || Subsystem ||

[jira] [Updated] (HDFS-12947) Limit the number of Snapshots allowed to be created for a Snapshottable Directory

[ https://issues.apache.org/jira/browse/HDFS-12947?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Tsz Wo Nicholas Sze updated HDFS-12947: --- Hadoop Flags: Reviewed Component/s: snapshots +1 the 004 patch looks good. >

[jira] [Updated] (HDFS-13109) Support fully qualified hdfs path in "crypto" commands path argument

[ https://issues.apache.org/jira/browse/HDFS-13109?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Hanisha Koneru updated HDFS-13109: -- Attachment: HDFS-13109.001.patch > Support fully qualified hdfs path in "crypto" commands path

[jira] [Commented] (HDFS-12990) Change default NameNode RPC port back to 8020

[ https://issues.apache.org/jira/browse/HDFS-12990?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16354761#comment-16354761 ] Xiao Chen commented on HDFS-12990: -- Thanks [~anu] for pushing this through the finish line, and all for

[jira] [Updated] (HDFS-13112) Token expiration edits may cause log corruption or deadlock

[ https://issues.apache.org/jira/browse/HDFS-13112?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Daryn Sharp updated HDFS-13112: --- Status: Patch Available (was: Open) > Token expiration edits may cause log corruption or deadlock >

[jira] [Updated] (HDFS-13102) Implement SnapshotSkipList class to store Multi level DirectoryDiffs

[ https://issues.apache.org/jira/browse/HDFS-13102?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Tsz Wo Nicholas Sze updated HDFS-13102: --- Status: Patch Available (was: Open) > Implement SnapshotSkipList class to store

[jira] [Commented] (HDFS-10453) ReplicationMonitor thread could stuck for long time due to the race between replication and delete of same file in a large cluster.

[ https://issues.apache.org/jira/browse/HDFS-10453?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16354711#comment-16354711 ] Erik Krogen commented on HDFS-10453: Hey [~arpitagarwal], IIUC it doesn't need to see the most recent

[jira] [Commented] (HDFS-10453) ReplicationMonitor thread could stuck for long time due to the race between replication and delete of same file in a large cluster.

[ https://issues.apache.org/jira/browse/HDFS-10453?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16354717#comment-16354717 ] Arpit Agarwal commented on HDFS-10453: -- bq. However, going through this makes me realize, a more

[jira] [Commented] (HDFS-13109) Support fully qualified hdfs path in "crypto" commands path argument

[ https://issues.apache.org/jira/browse/HDFS-13109?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16354732#comment-16354732 ] Hanisha Koneru commented on HDFS-13109: --- Uploaded patch v01. Changed {{provisionEZTrash()}} to

[jira] [Updated] (HDFS-13109) Support fully qualified hdfs path in "crypto" commands path argument

[ https://issues.apache.org/jira/browse/HDFS-13109?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Hanisha Koneru updated HDFS-13109: -- Status: Patch Available (was: Open) > Support fully qualified hdfs path in "crypto" commands

[jira] [Commented] (HDFS-13106) Need to exercise all HDFS APIs for EC

[ https://issues.apache.org/jira/browse/HDFS-13106?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16354754#comment-16354754 ] Hudson commented on HDFS-13106: --- SUCCESS: Integrated in Jenkins build Hadoop-trunk-Commit #13624 (See

[jira] [Created] (HDFS-13114) CryptoAdmin#ReencryptZoneCommand should resolve Namespace info from path

Hanisha Koneru created HDFS-13114: - Summary: CryptoAdmin#ReencryptZoneCommand should resolve Namespace info from path Key: HDFS-13114 URL: https://issues.apache.org/jira/browse/HDFS-13114 Project:

[jira] [Updated] (HDFS-11096) Support rolling upgrade between 2.x and 3.x

[ https://issues.apache.org/jira/browse/HDFS-11096?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Lei (Eddy) Xu updated HDFS-11096: - Target Version/s: 3.0.2 (was: 3.0.1) > Support rolling upgrade between 2.x and 3.x >

[jira] [Commented] (HDFS-13106) Need to exercise all HDFS APIs for EC

[ https://issues.apache.org/jira/browse/HDFS-13106?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16354532#comment-16354532 ] genericqa commented on HDFS-13106: -- | (x) *{color:red}-1 overall{color}* | \\ \\ || Vote || Subsystem ||

[jira] [Commented] (HDFS-13058) Fix dfs.namenode.shared.edits.dir in TestJournalNode

[ https://issues.apache.org/jira/browse/HDFS-13058?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16354434#comment-16354434 ] Hanisha Koneru commented on HDFS-13058: --- Re-triggered Jenkins run. > Fix

[jira] [Commented] (HDFS-12512) RBF: Add WebHDFS

[ https://issues.apache.org/jira/browse/HDFS-12512?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16354456#comment-16354456 ] Wei Yan commented on HDFS-12512: Splitting out hadoop-hdfs-project/hadoop-contracts may still have the

[jira] [Resolved] (HDFS-7913) HADOOP_HDFS_LOG_DIR should be HDFS_LOG_DIR in deprecations

[ https://issues.apache.org/jira/browse/HDFS-7913?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Allen Wittenauer resolved HDFS-7913. Resolution: Won't Fix > HADOOP_HDFS_LOG_DIR should be HDFS_LOG_DIR in deprecations >

[jira] [Commented] (HDFS-13022) Block Storage: Kubernetes dynamic persistent volume provisioner

[ https://issues.apache.org/jira/browse/HDFS-13022?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16354562#comment-16354562 ] Elek, Marton commented on HDFS-13022: - Moving back to PATCH_AVAILABLE. This is the last version, with

[jira] [Updated] (HDFS-13022) Block Storage: Kubernetes dynamic persistent volume provisioner

[ https://issues.apache.org/jira/browse/HDFS-13022?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Elek, Marton updated HDFS-13022: Status: Patch Available (was: In Progress) > Block Storage: Kubernetes dynamic persistent volume

[jira] [Updated] (HDFS-13055) Aggregate usage statistics from datanodes

[ https://issues.apache.org/jira/browse/HDFS-13055?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Ajay Kumar updated HDFS-13055: -- Attachment: HDFS-13055.002.patch > Aggregate usage statistics from datanodes >

[jira] [Issue Comment Deleted] (HDFS-12512) RBF: Add WebHDFS

[ https://issues.apache.org/jira/browse/HDFS-12512?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Allen Wittenauer updated HDFS-12512: Comment: was deleted (was: Yes. ) > RBF: Add WebHDFS > > >

[jira] [Assigned] (HDFS-12711) deadly hdfs test

[ https://issues.apache.org/jira/browse/HDFS-12711?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Allen Wittenauer reassigned HDFS-12711: --- Assignee: Allen Wittenauer > deadly hdfs test > > >

[jira] [Commented] (HDFS-11096) Support rolling upgrade between 2.x and 3.x

[ https://issues.apache.org/jira/browse/HDFS-11096?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16354504#comment-16354504 ] genericqa commented on HDFS-11096: -- | (x) *{color:red}-1 overall{color}* | \\ \\ || Vote || Subsystem ||

[jira] [Updated] (HDFS-13109) Support fully qualified hdfs path in "crypto" commands path argument

[ https://issues.apache.org/jira/browse/HDFS-13109?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Hanisha Koneru updated HDFS-13109: -- Description: When creating an Encryption Zone, if the fully qualified path is specified in the

[jira] [Commented] (HDFS-12512) RBF: Add WebHDFS

[ https://issues.apache.org/jira/browse/HDFS-12512?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16354457#comment-16354457 ] Allen Wittenauer commented on HDFS-12512: - Yes. > RBF: Add WebHDFS > > >

[jira] [Updated] (HDFS-12711) deadly hdfs test

[ https://issues.apache.org/jira/browse/HDFS-12711?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Allen Wittenauer updated HDFS-12711: Resolution: Incomplete Status: Resolved (was: Patch Available) I think I'm going

[jira] [Commented] (HDFS-12512) RBF: Add WebHDFS

[ https://issues.apache.org/jira/browse/HDFS-12512?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16354482#comment-16354482 ] Allen Wittenauer commented on HDFS-12512: - {quote}Splitting out

[jira] [Updated] (HDFS-12920) HDFS default value change (with adding time unit) breaks old version MR tarball work with new version (3.0) of hadoop

[ https://issues.apache.org/jira/browse/HDFS-12920?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Lei (Eddy) Xu updated HDFS-12920: - Target Version/s: 3.0.2 (was: 3.0.1) > HDFS default value change (with adding time unit) breaks

[jira] [Comment Edited] (HDFS-13106) Need to exercise all HDFS APIs for EC

[ https://issues.apache.org/jira/browse/HDFS-13106?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16354513#comment-16354513 ] Haibo Yan edited comment on HDFS-13106 at 2/6/18 8:38 PM: -- Thanks your review

[jira] [Updated] (HDFS-13106) Need to exercise all HDFS APIs for EC

[ https://issues.apache.org/jira/browse/HDFS-13106?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Haibo Yan updated HDFS-13106: - Attachment: HDFS-13106.003.patch > Need to exercise all HDFS APIs for EC >

[jira] [Commented] (HDFS-12990) Change default NameNode RPC port back to 8020

[ https://issues.apache.org/jira/browse/HDFS-12990?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16354587#comment-16354587 ] Anu Engineer commented on HDFS-12990: - Since we don't have any -1; I will commit this shortly to trunk

[jira] [Commented] (HDFS-12051) Reimplement NameCache in NameNode: Intern duplicate byte[] arrays (mainly those denoting file/directory names) to save memory

[ https://issues.apache.org/jira/browse/HDFS-12051?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16354588#comment-16354588 ] Misha Dmitriev commented on HDFS-12051: --- [~szetszwo] I've done more benchmarking per your request.

[jira] [Updated] (HDFS-13022) Block Storage: Kubernetes dynamic persistent volume provisioner

[ https://issues.apache.org/jira/browse/HDFS-13022?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Elek, Marton updated HDFS-13022: Attachment: HDFS-13022-HDFS-7240.004.patch > Block Storage: Kubernetes dynamic persistent volume

[jira] [Commented] (HDFS-10453) ReplicationMonitor thread could stuck for long time due to the race between replication and delete of same file in a large cluster.

[ https://issues.apache.org/jira/browse/HDFS-10453?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16354571#comment-16354571 ] Ajay Kumar commented on HDFS-10453: --- LGTM. > ReplicationMonitor thread could stuck for long time due

[jira] [Created] (HDFS-13111) Close recovery may incorrectly mark blocks corrupt

Daryn Sharp created HDFS-13111: -- Summary: Close recovery may incorrectly mark blocks corrupt Key: HDFS-13111 URL: https://issues.apache.org/jira/browse/HDFS-13111 Project: Hadoop HDFS Issue

[jira] [Commented] (HDFS-13097) [SPS]: Fix the branch review comments(Part1)

[ https://issues.apache.org/jira/browse/HDFS-13097?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16354035#comment-16354035 ] Rakesh R commented on HDFS-13097: - Attached new patch addressing the above comments. Please review it

[jira] [Updated] (HDFS-13097) [SPS]: Fix the branch review comments(Part1)

[ https://issues.apache.org/jira/browse/HDFS-13097?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Rakesh R updated HDFS-13097: Attachment: HDFS-13097-HDFS-10285.03.patch > [SPS]: Fix the branch review comments(Part1) >

[jira] [Commented] (HDFS-13111) Close recovery may incorrectly mark blocks corrupt

[ https://issues.apache.org/jira/browse/HDFS-13111?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16354015#comment-16354015 ] Daryn Sharp commented on HDFS-13111: In two studied cases, the pipeline succeeded but the client

[jira] [Updated] (HDFS-13107) Add Mover Cli Unit Tests for Federated cluster

[ https://issues.apache.org/jira/browse/HDFS-13107?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Tsz Wo Nicholas Sze updated HDFS-13107: --- Resolution: Fixed Fix Version/s: 3.1.0 Status: Resolved (was: Patch

[jira] [Updated] (HDFS-13107) Add Mover Cli Unit Tests for Federated cluster

[ https://issues.apache.org/jira/browse/HDFS-13107?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Tsz Wo Nicholas Sze updated HDFS-13107: --- Component/s: test balancer & mover > Add Mover Cli Unit Tests for

[jira] [Updated] (HDFS-13115) In getNumUnderConstructionBlocks(), ignore the inodeIds for which the inodes have been deleted

[ https://issues.apache.org/jira/browse/HDFS-13115?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Yongjun Zhang updated HDFS-13115: - Attachment: HADOOP-13115.001.patch > In getNumUnderConstructionBlocks(), ignore the inodeIds for

[jira] [Updated] (HDFS-13115) In getNumUnderConstructionBlocks(), ignore the inodeIds for which the inodes have been deleted

[ https://issues.apache.org/jira/browse/HDFS-13115?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Yongjun Zhang updated HDFS-13115: - Status: Patch Available (was: Open) > In getNumUnderConstructionBlocks(), ignore the inodeIds

[jira] [Commented] (HDFS-13102) Implement SnapshotSkipList class to store Multi level DirectoryDiffs

[ https://issues.apache.org/jira/browse/HDFS-13102?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16354860#comment-16354860 ] genericqa commented on HDFS-13102: -- | (x) *{color:red}-1 overall{color}* | \\ \\ || Vote || Subsystem ||

[jira] [Commented] (HDFS-13115) In getNumUnderConstructionBlocks(), ignore the inodeIds for which the inodes have been deleted

[ https://issues.apache.org/jira/browse/HDFS-13115?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16354879#comment-16354879 ] Haibo Yan commented on HDFS-13115: -- [~yzhangal] Maybe you can add some debug info for null inode id that

[jira] [Commented] (HDFS-13099) RBF: Refactor RBF relevant settings

[ https://issues.apache.org/jira/browse/HDFS-13099?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16354904#comment-16354904 ] Yiqun Lin commented on HDFS-13099: -- Just found the default value missing to update in class

[jira] [Updated] (HDFS-13099) RBF: Refactor RBF relevant settings

[ https://issues.apache.org/jira/browse/HDFS-13099?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Yiqun Lin updated HDFS-13099: - Attachment: HDFS-13099.003.patch > RBF: Refactor RBF relevant settings >

[jira] [Commented] (HDFS-13115) In getNumUnderConstructionBlocks(), ignore the inodeIds for which the inodes have been deleted

[ https://issues.apache.org/jira/browse/HDFS-13115?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16354921#comment-16354921 ] Yongjun Zhang commented on HDFS-13115: -- Thanks for the review [~billyean] and [~jojochuang]. I had

  1   2   >