[jira] [Commented] (HDFS-13639) SlotReleaser is not fast enough

[ https://issues.apache.org/jira/browse/HDFS-13639?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17105030#comment-17105030 ] Lisheng Sun commented on HDFS-13639: hi [~sodonnell]  [~ayushtkn] Could you have time to help review

[jira] [Commented] (HDFS-15350) Set dfs.client.failover.random.order to true as default

[ https://issues.apache.org/jira/browse/HDFS-15350?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17105022#comment-17105022 ] Takanobu Asanuma commented on HDFS-15350: - [~weichiu] In the case of Multiple Standby NameNodes,

[jira] [Updated] (HDFS-15352) WebHdfsFileSystem does not log the exception that causes retries

[ https://issues.apache.org/jira/browse/HDFS-15352?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Simbarashe Dzinamarira updated HDFS-15352: -- Priority: Minor (was: Major) > WebHdfsFileSystem does not log the exception

[jira] [Updated] (HDFS-15352) WebHdfsFileSystem does not log the exception that causes retries

[ https://issues.apache.org/jira/browse/HDFS-15352?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Simbarashe Dzinamarira updated HDFS-15352: -- Attachment: HDFS-15352.001.patch > WebHdfsFileSystem does not log the

[jira] [Created] (HDFS-15352) WebHdfsFileSystem does not log the exception that causes retries

Simbarashe Dzinamarira created HDFS-15352: - Summary: WebHdfsFileSystem does not log the exception that causes retries Key: HDFS-15352 URL: https://issues.apache.org/jira/browse/HDFS-15352

[jira] [Updated] (HDFS-15305) Extend ViewFS and provide ViewFSOverloadScheme implementation with scheme configurable.

[ https://issues.apache.org/jira/browse/HDFS-15305?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Virajith Jalaparti updated HDFS-15305: -- Fix Version/s: 3.2.2 > Extend ViewFS and provide ViewFSOverloadScheme implementation

[jira] [Commented] (HDFS-15308) TestReconstructStripedFile.testNNSendsErasureCodingTasks is flaky

[ https://issues.apache.org/jira/browse/HDFS-15308?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17104919#comment-17104919 ] Hadoop QA commented on HDFS-15308: -- | (x) *{color:red}-1 overall{color}* | \\ \\ || Vote || Subsystem ||

[jira] [Commented] (HDFS-15270) Account for *env == NULL in hdfsThreadDestructor

[ https://issues.apache.org/jira/browse/HDFS-15270?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17104897#comment-17104897 ] Wei-Chiu Chuang commented on HDFS-15270: Thanks for the reminder. It's cherrypicked to branch-3.3

[jira] [Updated] (HDFS-15270) Account for *env == NULL in hdfsThreadDestructor

[ https://issues.apache.org/jira/browse/HDFS-15270?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Wei-Chiu Chuang updated HDFS-15270: --- Fix Version/s: 3.1.5 3.3.1 3.2.2 > Account for *env ==

[jira] [Commented] (HDFS-15351) Blocks Scheduled Count was wrong on Truncate

[ https://issues.apache.org/jira/browse/HDFS-15351?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17104889#comment-17104889 ] Hadoop QA commented on HDFS-15351: -- | (x) *{color:red}-1 overall{color}* | \\ \\ || Vote || Subsystem ||

[jira] [Commented] (HDFS-15348) [SBN Read] IllegalStateException happened when doing failover

[ https://issues.apache.org/jira/browse/HDFS-15348?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17104771#comment-17104771 ] Kihwal Lee commented on HDFS-15348: --- A dupe of HDFS-15323? > [SBN Read] IllegalStateException happened

[jira] [Comment Edited] (HDFS-15308) TestReconstructStripedFile.testNNSendsErasureCodingTasks is flaky

[ https://issues.apache.org/jira/browse/HDFS-15308?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17104747#comment-17104747 ] hemanthboyina edited comment on HDFS-15308 at 5/11/20, 6:47 PM: thanks

[jira] [Commented] (HDFS-15308) TestReconstructStripedFile.testNNSendsErasureCodingTasks is flaky

[ https://issues.apache.org/jira/browse/HDFS-15308?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17104747#comment-17104747 ] hemanthboyina commented on HDFS-15308: -- thanks for the work here i think 

[jira] [Updated] (HDFS-15308) TestReconstructStripedFile.testNNSendsErasureCodingTasks is flaky

[ https://issues.apache.org/jira/browse/HDFS-15308?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] hemanthboyina updated HDFS-15308: - Attachment: HDFS-15308.001.patch Status: Patch Available (was: Open) >

[jira] [Updated] (HDFS-15351) Blocks Scheduled Count was wrong on Truncate

[ https://issues.apache.org/jira/browse/HDFS-15351?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] hemanthboyina updated HDFS-15351: - Attachment: HDFS-15351.001.patch Status: Patch Available (was: Open) > Blocks Scheduled

[jira] [Updated] (HDFS-15351) Blocks Scheduled Count was wrong on Truncate

[ https://issues.apache.org/jira/browse/HDFS-15351?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] hemanthboyina updated HDFS-15351: - Description: On truncate and append we remove the blocks from Reconstruction Queue  On removing

[jira] [Created] (HDFS-15351) Blocks Scheduled Count was wrong on Truncate

hemanthboyina created HDFS-15351: Summary: Blocks Scheduled Count was wrong on Truncate Key: HDFS-15351 URL: https://issues.apache.org/jira/browse/HDFS-15351 Project: Hadoop HDFS Issue

[jira] [Commented] (HDFS-15345) RBF: RouterPermissionChecker#checkSuperuserPrivilege should use UGI#getGroups after HADOOP-13442

[ https://issues.apache.org/jira/browse/HDFS-15345?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17104648#comment-17104648 ] Xiaoyu Yao commented on HDFS-15345: --- https://github.com/apache/hadoop/pull/2005 > RBF:

[jira] [Commented] (HDFS-15344) DataNode#checkSuperuserPrivilege should use UGI#getGroups after HADOOP-13442

[ https://issues.apache.org/jira/browse/HDFS-15344?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17104646#comment-17104646 ] Xiaoyu Yao commented on HDFS-15344: --- https://github.com/apache/hadoop/pull/2004 This is submit via

[jira] [Commented] (HDFS-15098) Add SM4 encryption method for HDFS

[ https://issues.apache.org/jira/browse/HDFS-15098?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17104641#comment-17104641 ] Wei-Chiu Chuang commented on HDFS-15098: [~Andrea_Julianos_one] can you check the error message

[jira] [Commented] (HDFS-15350) Set dfs.client.failover.random.order to true as default

[ https://issues.apache.org/jira/browse/HDFS-15350?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17104638#comment-17104638 ] Wei-Chiu Chuang commented on HDFS-15350: What would this mean when you have multiple standby

[jira] [Commented] (HDFS-15293) Relax the condition for accepting a fsimage when receiving a checkpoint

[ https://issues.apache.org/jira/browse/HDFS-15293?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17104510#comment-17104510 ] Kihwal Lee commented on HDFS-15293: --- {quote}Because the checks only skip an image if BOTH conditions

[jira] [Commented] (HDFS-15243) Child directory should not be deleted or renamed if parent directory is a protected directory

[ https://issues.apache.org/jira/browse/HDFS-15243?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17104503#comment-17104503 ] Ayush Saxena commented on HDFS-15243: - Thanx [~rain_lyy] for the update. v006 LGTM +1 Test failures

[jira] [Resolved] (HDFS-1820) FTPFileSystem attempts to close the outputstream even when it is not initialised

[ https://issues.apache.org/jira/browse/HDFS-1820?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Mikhail Pryakhin resolved HDFS-1820. Resolution: Fixed a regression introduced in this patch will be fixed as 

[jira] [Reopened] (HDFS-1820) FTPFileSystem attempts to close the outputstream even when it is not initialised

[ https://issues.apache.org/jira/browse/HDFS-1820?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Mikhail Pryakhin reopened HDFS-1820: looks like this is causing HADOOP-17036. > FTPFileSystem attempts to close the outputstream

[jira] [Commented] (HDFS-1820) FTPFileSystem attempts to close the outputstream even when it is not initialised

[ https://issues.apache.org/jira/browse/HDFS-1820?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17104460#comment-17104460 ] Mikhail Pryakhin commented on HDFS-1820: hi Steve, sure! will provide a fix shortly, my apologies

[jira] [Commented] (HDFS-1820) FTPFileSystem attempts to close the outputstream even when it is not initialised

[ https://issues.apache.org/jira/browse/HDFS-1820?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17104399#comment-17104399 ] Steve Loughran commented on HDFS-1820: -- hey, looks like this is causing HADOOP-17036. [~m.pryahin]

[jira] [Commented] (HDFS-15338) listOpenFiles() should throw InvalidPathException in case of invalid paths

[ https://issues.apache.org/jira/browse/HDFS-15338?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17104362#comment-17104362 ] Hudson commented on HDFS-15338: --- SUCCESS: Integrated in Jenkins build Hadoop-trunk-Commit #18233 (See

[jira] [Updated] (HDFS-15338) listOpenFiles() should throw InvalidPathException in case of invalid paths

[ https://issues.apache.org/jira/browse/HDFS-15338?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Ayush Saxena updated HDFS-15338: Fix Version/s: 3.4.0 3.3.1 Hadoop Flags: Reviewed Resolution: Fixed

[jira] [Commented] (HDFS-15338) listOpenFiles() should throw InvalidPathException in case of invalid paths

[ https://issues.apache.org/jira/browse/HDFS-15338?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17104353#comment-17104353 ] Ayush Saxena commented on HDFS-15338: - +1 on v005 Committed to trunk and branch-3.3 Thanx

[jira] [Updated] (HDFS-15338) listOpenFiles() should throw InvalidPathException in case of invalid paths

[ https://issues.apache.org/jira/browse/HDFS-15338?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Ayush Saxena updated HDFS-15338: Summary: listOpenFiles() should throw InvalidPathException in case of invalid paths (was:

[jira] [Created] (HDFS-15350) Set dfs.client.failover.random.order to true as default

Takanobu Asanuma created HDFS-15350: --- Summary: Set dfs.client.failover.random.order to true as default Key: HDFS-15350 URL: https://issues.apache.org/jira/browse/HDFS-15350 Project: Hadoop HDFS

[jira] [Commented] (HDFS-15338) listOpenFiles() should throw InvalidPathException to remind the admin.

[ https://issues.apache.org/jira/browse/HDFS-15338?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17104285#comment-17104285 ] Hadoop QA commented on HDFS-15338: -- | (x) *{color:red}-1 overall{color}* | \\ \\ || Vote || Subsystem ||

[jira] [Commented] (HDFS-15338) listOpenFiles() should throw InvalidPathException to remind the admin.

[ https://issues.apache.org/jira/browse/HDFS-15338?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17104256#comment-17104256 ] Hadoop QA commented on HDFS-15338: -- | (/) *{color:green}+1 overall{color}* | \\ \\ || Vote || Subsystem

[jira] [Commented] (HDFS-15098) Add SM4 encryption method for HDFS

[ https://issues.apache.org/jira/browse/HDFS-15098?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17104253#comment-17104253 ] Andrea commented on HDFS-15098: --- [~zZtai]    Hi, I found a bugs, when I input 'hadoop key create key1

[jira] [Commented] (HDFS-15338) listOpenFiles() should throw InvalidPathException to remind the admin.

[ https://issues.apache.org/jira/browse/HDFS-15338?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17104251#comment-17104251 ] Ayush Saxena commented on HDFS-15338: - Thanx [~LiJinglun] for the patch. v004 LGTM +1, test failures

[jira] [Commented] (HDFS-15349) Adapt the netty4 ARM support switch(YARN-9898)

[ https://issues.apache.org/jira/browse/HDFS-15349?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17104245#comment-17104245 ] Ayush Saxena commented on HDFS-15349: - You haven't defined {{${netty4.group}}} that is why seems the

[jira] [Commented] (HDFS-15175) Multiple CloseOp shared block instance causes the standby namenode to crash when rolling editlog

[ https://issues.apache.org/jira/browse/HDFS-15175?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17104187#comment-17104187 ] Yicong Cai commented on HDFS-15175: --- Hi, [~wanchang] We solved this problem by completely resetting

[jira] [Updated] (HDFS-15338) listOpenFiles() should throw InvalidPathException to remind the admin.

[ https://issues.apache.org/jira/browse/HDFS-15338?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Jinglun updated HDFS-15338: --- Attachment: HDFS-15338.005.patch > listOpenFiles() should throw InvalidPathException to remind the admin. >

[jira] [Commented] (HDFS-15338) listOpenFiles() should throw InvalidPathException to remind the admin.

[ https://issues.apache.org/jira/browse/HDFS-15338?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17104114#comment-17104114 ] Jinglun commented on HDFS-15338: Hi [~ayushtkn], thanks your comments. Upload v05. > listOpenFiles()

[jira] [Commented] (HDFS-15340) RBF: Balance data across federation namespaces with DistCp and snapshot diff / Step 1: The State Machine(BalanceProcedureScheduler)

[ https://issues.apache.org/jira/browse/HDFS-15340?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17104112#comment-17104112 ] Hadoop QA commented on HDFS-15340: -- | (x) *{color:red}-1 overall{color}* | \\ \\ || Vote || Subsystem ||

[jira] [Commented] (HDFS-15243) Child directory should not be deleted or renamed if parent directory is a protected directory

[ https://issues.apache.org/jira/browse/HDFS-15243?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17104110#comment-17104110 ] Hadoop QA commented on HDFS-15243: -- | (x) *{color:red}-1 overall{color}* | \\ \\ || Vote || Subsystem ||

[jira] [Updated] (HDFS-15338) listOpenFiles() should throw InvalidPathException to remind the admin.

[ https://issues.apache.org/jira/browse/HDFS-15338?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Jinglun updated HDFS-15338: --- Attachment: (was: HDFS-15338.005.patch) > listOpenFiles() should throw InvalidPathException to remind

[jira] [Updated] (HDFS-15338) listOpenFiles() should throw InvalidPathException to remind the admin.

[ https://issues.apache.org/jira/browse/HDFS-15338?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Jinglun updated HDFS-15338: --- Attachment: HDFS-15338.005.patch > listOpenFiles() should throw InvalidPathException to remind the admin. >