[jira] [Work logged] (HADOOP-17995) Stale record should be remove when DataNodePeerMetrics#dumpSendPacketDownstreamAvgInfoAsJson

2021-11-22 Thread ASF GitHub Bot (Jira)
[ https://issues.apache.org/jira/browse/HADOOP-17995?focusedWorklogId=685100=com.atlassian.jira.plugin.system.issuetabpanels:worklog-tabpanel#worklog-685100 ] ASF GitHub Bot logged work on HADOOP-17995: --- Author: ASF GitHub Bot

[GitHub] [hadoop] haiyang1987 commented on pull request #3630: HADOOP-17995. Stale record should be remove when DataNodePeerMetrics#dumpSendPacketDownstreamAvgInfoAsJson

2021-11-22 Thread GitBox
haiyang1987 commented on pull request #3630: URL: https://github.com/apache/hadoop/pull/3630#issuecomment-976229923 In the tests setRecordValidityMs method is set synchronized >@VisibleForTesting > public synchronized void setRecordValidityMs(long value) { >

[GitHub] [hadoop] GuoPhilipse commented on pull request #3696: HDFS-16345. Fix test case fail in TestBlockStoragePolicy

2021-11-22 Thread GitBox
GuoPhilipse commented on pull request #3696: URL: https://github.com/apache/hadoop/pull/3696#issuecomment-976220112 cc @aajisaka @ayushtkn here are several PR tests fail for BindException of `TestBlockStoragePolicy` class.

[jira] [Resolved] (HADOOP-18020) Avoid breaking changes in Configuration

2021-11-22 Thread Andras Gyori (Jira)
[ https://issues.apache.org/jira/browse/HADOOP-18020?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Andras Gyori resolved HADOOP-18020. --- Resolution: Duplicate > Avoid breaking changes in Configuration >

[jira] [Updated] (HADOOP-18020) Avoid breaking changes in Configuration

2021-11-22 Thread Andras Gyori (Jira)
[ https://issues.apache.org/jira/browse/HADOOP-18020?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Andras Gyori updated HADOOP-18020: -- Description: YARN-10838 and YARN-10911 introduced an unfortunate change in Configuration

[jira] [Created] (HADOOP-18020) Avoid breaking changes in Configuration

2021-11-22 Thread Andras Gyori (Jira)
Andras Gyori created HADOOP-18020: - Summary: Avoid breaking changes in Configuration Key: HADOOP-18020 URL: https://issues.apache.org/jira/browse/HADOOP-18020 Project: Hadoop Common Issue

[GitHub] [hadoop] GuoPhilipse commented on pull request #3684: HDFS-16338. Correct fsimage error configuration message

2021-11-22 Thread GitBox
GuoPhilipse commented on pull request #3684: URL: https://github.com/apache/hadoop/pull/3684#issuecomment-976211471 @cxorm Thanks for your review :) -- This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use the URL above to go

[GitHub] [hadoop] minni31 commented on a change in pull request #3632: YARN-10822. Containers going from New to Scheduled transition for kil…

2021-11-22 Thread GitBox
minni31 commented on a change in pull request #3632: URL: https://github.com/apache/hadoop/pull/3632#discussion_r754834569 ## File path:

[GitHub] [hadoop] minni31 commented on a change in pull request #3632: YARN-10822. Containers going from New to Scheduled transition for kil…

2021-11-22 Thread GitBox
minni31 commented on a change in pull request #3632: URL: https://github.com/apache/hadoop/pull/3632#discussion_r754833465 ## File path:

[GitHub] [hadoop] dependabot[bot] opened a new pull request #3706: Bump mina-core from 2.0.16 to 2.1.5 in /hadoop-project

2021-11-22 Thread GitBox
dependabot[bot] opened a new pull request #3706: URL: https://github.com/apache/hadoop/pull/3706 Bumps [mina-core](https://github.com/apache/mina) from 2.0.16 to 2.1.5. Commits https://github.com/apache/mina/commit/bc9bb230f112f58854bf70660c443cfd52c2bcff;>bc9bb23

[GitHub] [hadoop] minni31 commented on a change in pull request #3632: YARN-10822. Containers going from New to Scheduled transition for kil…

2021-11-22 Thread GitBox
minni31 commented on a change in pull request #3632: URL: https://github.com/apache/hadoop/pull/3632#discussion_r754832828 ## File path:

[jira] [Resolved] (HADOOP-18017) unguava: remove Preconditions from hadoop-yarn-project modules

2021-11-22 Thread Takanobu Asanuma (Jira)
[ https://issues.apache.org/jira/browse/HADOOP-18017?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Takanobu Asanuma resolved HADOOP-18017. --- Fix Version/s: 3.4.0 Resolution: Fixed > unguava: remove Preconditions from

[jira] [Resolved] (HADOOP-18018) unguava: remove Preconditions from hadoop-tools modules

2021-11-22 Thread Takanobu Asanuma (Jira)
[ https://issues.apache.org/jira/browse/HADOOP-18018?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Takanobu Asanuma resolved HADOOP-18018. --- Fix Version/s: 3.4.0 Resolution: Fixed > unguava: remove Preconditions from

[jira] [Work logged] (HADOOP-18017) unguava: remove Preconditions from hadoop-yarn-project modules

2021-11-22 Thread ASF GitHub Bot (Jira)
[ https://issues.apache.org/jira/browse/HADOOP-18017?focusedWorklogId=685060=com.atlassian.jira.plugin.system.issuetabpanels:worklog-tabpanel#worklog-685060 ] ASF GitHub Bot logged work on HADOOP-18017: --- Author: ASF GitHub Bot

[jira] [Work logged] (HADOOP-18017) unguava: remove Preconditions from hadoop-yarn-project modules

2021-11-22 Thread ASF GitHub Bot (Jira)
[ https://issues.apache.org/jira/browse/HADOOP-18017?focusedWorklogId=685059=com.atlassian.jira.plugin.system.issuetabpanels:worklog-tabpanel#worklog-685059 ] ASF GitHub Bot logged work on HADOOP-18017: --- Author: ASF GitHub Bot

[GitHub] [hadoop] tasanuma commented on pull request #3687: HADOOP-18017. unguava: remove Preconditions from hadoop-yarn-project modules

2021-11-22 Thread GitBox
tasanuma commented on pull request #3687: URL: https://github.com/apache/hadoop/pull/3687#issuecomment-976162823 Thanks, @virajjasani! -- This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use the URL above to go to the

[GitHub] [hadoop] tasanuma merged pull request #3687: HADOOP-18017. unguava: remove Preconditions from hadoop-yarn-project modules

2021-11-22 Thread GitBox
tasanuma merged pull request #3687: URL: https://github.com/apache/hadoop/pull/3687 -- This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use the URL above to go to the specific comment. To unsubscribe, e-mail:

[jira] [Work logged] (HADOOP-18018) unguava: remove Preconditions from hadoop-tools modules

2021-11-22 Thread ASF GitHub Bot (Jira)
[ https://issues.apache.org/jira/browse/HADOOP-18018?focusedWorklogId=685057=com.atlassian.jira.plugin.system.issuetabpanels:worklog-tabpanel#worklog-685057 ] ASF GitHub Bot logged work on HADOOP-18018: --- Author: ASF GitHub Bot

[jira] [Work logged] (HADOOP-18018) unguava: remove Preconditions from hadoop-tools modules

2021-11-22 Thread ASF GitHub Bot (Jira)
[ https://issues.apache.org/jira/browse/HADOOP-18018?focusedWorklogId=685058=com.atlassian.jira.plugin.system.issuetabpanels:worklog-tabpanel#worklog-685058 ] ASF GitHub Bot logged work on HADOOP-18018: --- Author: ASF GitHub Bot

[GitHub] [hadoop] tasanuma commented on pull request #3688: HADOOP-18018. unguava: remove Preconditions from hadoop-tools modules

2021-11-22 Thread GitBox
tasanuma commented on pull request #3688: URL: https://github.com/apache/hadoop/pull/3688#issuecomment-976162044 Thanks for your contribution, @virajjasani. -- This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use the URL

[GitHub] [hadoop] tasanuma merged pull request #3688: HADOOP-18018. unguava: remove Preconditions from hadoop-tools modules

2021-11-22 Thread GitBox
tasanuma merged pull request #3688: URL: https://github.com/apache/hadoop/pull/3688 -- This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use the URL above to go to the specific comment. To unsubscribe, e-mail:

[jira] [Work logged] (HADOOP-18014) CallerContext should not include some characters

2021-11-22 Thread ASF GitHub Bot (Jira)
[ https://issues.apache.org/jira/browse/HADOOP-18014?focusedWorklogId=685055=com.atlassian.jira.plugin.system.issuetabpanels:worklog-tabpanel#worklog-685055 ] ASF GitHub Bot logged work on HADOOP-18014: --- Author: ASF GitHub Bot

[GitHub] [hadoop] tasanuma commented on a change in pull request #3698: HADOOP-18014. CallerContext should not include some characters.

2021-11-22 Thread GitBox
tasanuma commented on a change in pull request #3698: URL: https://github.com/apache/hadoop/pull/3698#discussion_r754797701 ## File path: hadoop-hdfs-project/hadoop-hdfs/src/test/java/org/apache/hadoop/hdfs/server/namenode/TestAuditLogger.java ## @@ -599,6 +599,33 @@ public

[jira] [Work logged] (HADOOP-18014) CallerContext should not include some characters

2021-11-22 Thread ASF GitHub Bot (Jira)
[ https://issues.apache.org/jira/browse/HADOOP-18014?focusedWorklogId=685038=com.atlassian.jira.plugin.system.issuetabpanels:worklog-tabpanel#worklog-685038 ] ASF GitHub Bot logged work on HADOOP-18014: --- Author: ASF GitHub Bot

[GitHub] [hadoop] hadoop-yetus commented on pull request #3698: HADOOP-18014. CallerContext should not include some characters.

2021-11-22 Thread GitBox
hadoop-yetus commented on pull request #3698: URL: https://github.com/apache/hadoop/pull/3698#issuecomment-976109122 :broken_heart: **-1 overall** | Vote | Subsystem | Runtime | Logfile | Comment | |::|--:|:|::|:---:| | +0

[GitHub] [hadoop] tomscut commented on pull request #3682: HDFS-16337. Show start time of Datanode on Web

2021-11-22 Thread GitBox
tomscut commented on pull request #3682: URL: https://github.com/apache/hadoop/pull/3682#issuecomment-976107310 Thanks @jojochuang for the review and the merge. -- This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use the URL

[GitHub] [hadoop] jojochuang merged pull request #3682: HDFS-16337. Show start time of Datanode on Web

2021-11-22 Thread GitBox
jojochuang merged pull request #3682: URL: https://github.com/apache/hadoop/pull/3682 -- This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use the URL above to go to the specific comment. To unsubscribe, e-mail:

[GitHub] [hadoop] tomscut commented on pull request #3682: HDFS-16337. Show start time of Datanode on Web

2021-11-22 Thread GitBox
tomscut commented on pull request #3682: URL: https://github.com/apache/hadoop/pull/3682#issuecomment-976039892 Hi @jojochuang @aajisaka @tasanuma @ferhui, please also take a look. Thanks. -- This is an automated message from the Apache Git Service. To respond to the message, please log

[GitHub] [hadoop] hadoop-yetus commented on pull request #3705: HDFS-16322. Fix that ClientProtocol.truncate(...) can cause data loss.

2021-11-22 Thread GitBox
hadoop-yetus commented on pull request #3705: URL: https://github.com/apache/hadoop/pull/3705#issuecomment-975986313 :broken_heart: **-1 overall** | Vote | Subsystem | Runtime | Logfile | Comment | |::|--:|:|::|:---:| | +0

[GitHub] [hadoop] hadoop-yetus commented on pull request #3704: HDFS-16348. Mark slownode as badnode to recover pipeline

2021-11-22 Thread GitBox
hadoop-yetus commented on pull request #3704: URL: https://github.com/apache/hadoop/pull/3704#issuecomment-975905230 :confetti_ball: **+1 overall** | Vote | Subsystem | Runtime | Logfile | Comment | |::|--:|:|::|:---:| | +0

[jira] [Work logged] (HADOOP-17409) Remove S3Guard - no longer needed

2021-11-22 Thread ASF GitHub Bot (Jira)
[ https://issues.apache.org/jira/browse/HADOOP-17409?focusedWorklogId=684952=com.atlassian.jira.plugin.system.issuetabpanels:worklog-tabpanel#worklog-684952 ] ASF GitHub Bot logged work on HADOOP-17409: --- Author: ASF GitHub Bot

[GitHub] [hadoop] hadoop-yetus commented on pull request #3534: HADOOP-17409. Remove s3guard from S3A module

2021-11-22 Thread GitBox
hadoop-yetus commented on pull request #3534: URL: https://github.com/apache/hadoop/pull/3534#issuecomment-975888432 :broken_heart: **-1 overall** | Vote | Subsystem | Runtime | Logfile | Comment | |::|--:|:|::|:---:| | +0

[jira] [Work logged] (HADOOP-18014) CallerContext should not include some characters

2021-11-22 Thread ASF GitHub Bot (Jira)
[ https://issues.apache.org/jira/browse/HADOOP-18014?focusedWorklogId=684919=com.atlassian.jira.plugin.system.issuetabpanels:worklog-tabpanel#worklog-684919 ] ASF GitHub Bot logged work on HADOOP-18014: --- Author: ASF GitHub Bot

[GitHub] [hadoop] virajjasani commented on a change in pull request #3698: HADOOP-18014. CallerContext should not include some characters.

2021-11-22 Thread GitBox
virajjasani commented on a change in pull request #3698: URL: https://github.com/apache/hadoop/pull/3698#discussion_r754547513 ## File path: hadoop-hdfs-project/hadoop-hdfs/src/test/java/org/apache/hadoop/hdfs/server/namenode/TestAuditLogger.java ## @@ -599,6 +599,33 @@

[GitHub] [hadoop] hadoop-yetus commented on pull request #3592: YARN-10991. Fix to ignore the grouping "[]" for resourcesStr in parse…

2021-11-22 Thread GitBox
hadoop-yetus commented on pull request #3592: URL: https://github.com/apache/hadoop/pull/3592#issuecomment-975816234 :confetti_ball: **+1 overall** | Vote | Subsystem | Runtime | Logfile | Comment | |::|--:|:|::|:---:| | +0

[GitHub] [hadoop] hadoop-yetus commented on pull request #3592: YARN-10991. Fix to ignore the grouping "[]" for resourcesStr in parse…

2021-11-22 Thread GitBox
hadoop-yetus commented on pull request #3592: URL: https://github.com/apache/hadoop/pull/3592#issuecomment-975802078 :confetti_ball: **+1 overall** | Vote | Subsystem | Runtime | Logfile | Comment | |::|--:|:|::|:---:| | +0

[GitHub] [hadoop] hadoop-yetus commented on pull request #3703: HDFS-16347. Fix directory scan throttle default value

2021-11-22 Thread GitBox
hadoop-yetus commented on pull request #3703: URL: https://github.com/apache/hadoop/pull/3703#issuecomment-975791101 :broken_heart: **-1 overall** | Vote | Subsystem | Runtime | Logfile | Comment | |::|--:|:|::|:---:| | +0

[GitHub] [hadoop] sodonnel commented on pull request #3675: HDFS-16303. Improve handling of datanode lost while decommissioning

2021-11-22 Thread GitBox
sodonnel commented on pull request #3675: URL: https://github.com/apache/hadoop/pull/3675#issuecomment-975785577 Ah yes, the BackoffMonitor gets calls the method below which is indeed limits by max Tracked Nodes: ``` private void processPendingNodes() { while

[GitHub] [hadoop] KevinWikant edited a comment on pull request #3675: HDFS-16303. Improve handling of datanode lost while decommissioning

2021-11-22 Thread GitBox
KevinWikant edited a comment on pull request #3675: URL: https://github.com/apache/hadoop/pull/3675#issuecomment-975776386 > The DatanodeAdminBackoffMonitor is probably rarely used, if it is used at all, but it does not have a tracking limit I think at the moment. Perhaps it should have,

[GitHub] [hadoop] KevinWikant commented on pull request #3675: HDFS-16303. Improve handling of datanode lost while decommissioning

2021-11-22 Thread GitBox
KevinWikant commented on pull request #3675: URL: https://github.com/apache/hadoop/pull/3675#issuecomment-975778252 > If a DN goes dead and then re-registers, it will be added back into the pending nodes, so I don't think we need to continue to track it in the decommission monitor when it

[GitHub] [hadoop] KevinWikant commented on pull request #3675: HDFS-16303. Improve handling of datanode lost while decommissioning

2021-11-22 Thread GitBox
KevinWikant commented on pull request #3675: URL: https://github.com/apache/hadoop/pull/3675#issuecomment-975776386 > The DatanodeAdminBackoffMonitor is probably rarely used, if it is used at all, but it does not have a tracking limit I think at the moment. Perhaps it should have, it it

[GitHub] [hadoop] sodonnel commented on pull request #3675: HDFS-16303. Improve handling of datanode lost while decommissioning

2021-11-22 Thread GitBox
sodonnel commented on pull request #3675: URL: https://github.com/apache/hadoop/pull/3675#issuecomment-975769423 In `DatanodeManager.registerDatanode()`, it has logic to add a node into the decommission workflow if the node has a DECOMMISSIONED status in the hosts / combined hosts file,

[GitHub] [hadoop] KevinWikant edited a comment on pull request #3675: HDFS-16303. Improve handling of datanode lost while decommissioning

2021-11-22 Thread GitBox
KevinWikant edited a comment on pull request #3675: URL: https://github.com/apache/hadoop/pull/3675#issuecomment-975759431 > If a node goes dead while decommissioning, would it not be better to just remove it from the decommission monitor rather than keep tracking it there at all? If the

[GitHub] [hadoop] KevinWikant commented on pull request #3675: HDFS-16303. Improve handling of datanode lost while decommissioning

2021-11-22 Thread GitBox
KevinWikant commented on pull request #3675: URL: https://github.com/apache/hadoop/pull/3675#issuecomment-975759431 > If a node goes dead while decommissioning, would it not be better to just remove it from the decommission monitor rather than keep tracking it there at all? If the node

[GitHub] [hadoop] Nsupyq opened a new pull request #3705: HDFS-16322. Fix that ClientProtocol.truncate(...) can cause data loss.

2021-11-22 Thread GitBox
Nsupyq opened a new pull request #3705: URL: https://github.com/apache/hadoop/pull/3705 ### Description of PR This PR fix [HDFS-16322](https://issues.apache.org/jira/browse/HDFS-16322). The NameNode implementation of ClientProtocol.truncate(...) can cause data loss. If

[jira] [Work logged] (HADOOP-18014) CallerContext should not include some characters

2021-11-22 Thread ASF GitHub Bot (Jira)
[ https://issues.apache.org/jira/browse/HADOOP-18014?focusedWorklogId=684854=com.atlassian.jira.plugin.system.issuetabpanels:worklog-tabpanel#worklog-684854 ] ASF GitHub Bot logged work on HADOOP-18014: --- Author: ASF GitHub Bot

[GitHub] [hadoop] tasanuma commented on a change in pull request #3698: HADOOP-18014. CallerContext should not include some characters.

2021-11-22 Thread GitBox
tasanuma commented on a change in pull request #3698: URL: https://github.com/apache/hadoop/pull/3698#discussion_r754471862 ## File path: hadoop-hdfs-project/hadoop-hdfs/src/test/java/org/apache/hadoop/hdfs/server/namenode/TestAuditLogger.java ## @@ -599,6 +599,36 @@ public

[GitHub] [hadoop] KevinWikant commented on a change in pull request #3675: HDFS-16303. Improve handling of datanode lost while decommissioning

2021-11-22 Thread GitBox
KevinWikant commented on a change in pull request #3675: URL: https://github.com/apache/hadoop/pull/3675#discussion_r754456231 ## File path: hadoop-hdfs-project/hadoop-hdfs/src/test/java/org/apache/hadoop/hdfs/TestDecommission.java ## @@ -1654,4 +1658,139 @@ public Boolean

[GitHub] [hadoop] ashutoshcipher commented on a change in pull request #3592: YARN-10991. Fix to ignore the grouping "[]" for resourcesStr in parse…

2021-11-22 Thread GitBox
ashutoshcipher commented on a change in pull request #3592: URL: https://github.com/apache/hadoop/pull/3592#discussion_r754453752 ## File path:

[GitHub] [hadoop] ashutoshcipher commented on a change in pull request #3592: YARN-10991. Fix to ignore the grouping "[]" for resourcesStr in parse…

2021-11-22 Thread GitBox
ashutoshcipher commented on a change in pull request #3592: URL: https://github.com/apache/hadoop/pull/3592#discussion_r754453411 ## File path:

[jira] [Work logged] (HADOOP-17975) Fallback to simple auth does not work for a secondary DistributedFileSystem instance

2021-11-22 Thread ASF GitHub Bot (Jira)
[ https://issues.apache.org/jira/browse/HADOOP-17975?focusedWorklogId=684845=com.atlassian.jira.plugin.system.issuetabpanels:worklog-tabpanel#worklog-684845 ] ASF GitHub Bot logged work on HADOOP-17975: --- Author: ASF GitHub Bot

[GitHub] [hadoop] hadoop-yetus commented on pull request #3579: HADOOP-17975 Fallback to simple auth does not work for a secondary DistributedFileSystem instance.

2021-11-22 Thread GitBox
hadoop-yetus commented on pull request #3579: URL: https://github.com/apache/hadoop/pull/3579#issuecomment-975708923 :confetti_ball: **+1 overall** | Vote | Subsystem | Runtime | Logfile | Comment | |::|--:|:|::|:---:| | +0

[jira] [Work logged] (HADOOP-17975) Fallback to simple auth does not work for a secondary DistributedFileSystem instance

2021-11-22 Thread ASF GitHub Bot (Jira)
[ https://issues.apache.org/jira/browse/HADOOP-17975?focusedWorklogId=684842=com.atlassian.jira.plugin.system.issuetabpanels:worklog-tabpanel#worklog-684842 ] ASF GitHub Bot logged work on HADOOP-17975: --- Author: ASF GitHub Bot

[GitHub] [hadoop] hadoop-yetus commented on pull request #3579: HADOOP-17975 Fallback to simple auth does not work for a secondary DistributedFileSystem instance.

2021-11-22 Thread GitBox
hadoop-yetus commented on pull request #3579: URL: https://github.com/apache/hadoop/pull/3579#issuecomment-975698386 :confetti_ball: **+1 overall** | Vote | Subsystem | Runtime | Logfile | Comment | |::|--:|:|::|:---:| | +0

[jira] [Updated] (HADOOP-17998) Allow get command to run with multi threads.

2021-11-22 Thread Stephen O'Donnell (Jira)
[ https://issues.apache.org/jira/browse/HADOOP-17998?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Stephen O'Donnell updated HADOOP-17998: --- Resolution: Fixed Status: Resolved (was: Patch Available) Committed down

[jira] [Updated] (HADOOP-17998) Allow get command to run with multi threads.

2021-11-22 Thread Stephen O'Donnell (Jira)
[ https://issues.apache.org/jira/browse/HADOOP-17998?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Stephen O'Donnell updated HADOOP-17998: --- Fix Version/s: 3.2.3 > Allow get command to run with multi threads. >

[jira] [Work started] (HADOOP-18013) ABFS: add resilient trash policy

2021-11-22 Thread Steve Loughran (Jira)
[ https://issues.apache.org/jira/browse/HADOOP-18013?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Work on HADOOP-18013 started by Steve Loughran. --- > ABFS: add resilient trash policy > >

[jira] [Assigned] (HADOOP-18013) ABFS: add resilient trash policy

2021-11-22 Thread Steve Loughran (Jira)
[ https://issues.apache.org/jira/browse/HADOOP-18013?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Steve Loughran reassigned HADOOP-18013: --- Assignee: Steve Loughran > ABFS: add resilient trash policy >

[GitHub] [hadoop] sodonnel commented on pull request #3694: HDFS-16343. Add some debug logs when the dfsUsed are not used during Datanode startup.

2021-11-22 Thread GitBox
sodonnel commented on pull request #3694: URL: https://github.com/apache/hadoop/pull/3694#issuecomment-975639015 This change LGTM, but there is one checkstyle violation. Can you fix it please, and then we can commit. -- This is an automated message from the Apache Git Service. To

[GitHub] [hadoop] symious commented on pull request #3654: HDFS-16320. Datanode retrieve slownode information from NameNode

2021-11-22 Thread GitBox
symious commented on pull request #3654: URL: https://github.com/apache/hadoop/pull/3654#issuecomment-975606845 @ferhui @tasanuma @Hexiaoqiao Thank you for the review. The follow-up ticket is https://issues.apache.org/jira/browse/HDFS-16348. Please help to check. -- This is an

[GitHub] [hadoop] symious commented on pull request #3704: HDFS-16348. Mark slownode as badnode to recover pipeline

2021-11-22 Thread GitBox
symious commented on pull request #3704: URL: https://github.com/apache/hadoop/pull/3704#issuecomment-975605920 @ferhui @tasanuma @Hexiaoqiao Could you help to review this PR? -- This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub

[GitHub] [hadoop] symious opened a new pull request #3704: HDFS-16348. Mark slownode as badnode to recover pipeline

2021-11-22 Thread GitBox
symious opened a new pull request #3704: URL: https://github.com/apache/hadoop/pull/3704 ### Description of PR In HDFS-16320, the DataNode can retrieve the SLOW status from each NameNode. This ticket is to send this information back to Clients who are writing blocks.

[jira] [Updated] (HADOOP-17998) Allow get command to run with multi threads.

2021-11-22 Thread Stephen O'Donnell (Jira)
[ https://issues.apache.org/jira/browse/HADOOP-17998?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Stephen O'Donnell updated HADOOP-17998: --- Fix Version/s: 3.2.4 > Allow get command to run with multi threads. >

[GitHub] [hadoop] hadoop-yetus commented on pull request #3440: ABFS: Support for Encryption Context

2021-11-22 Thread GitBox
hadoop-yetus commented on pull request #3440: URL: https://github.com/apache/hadoop/pull/3440#issuecomment-975595092 :broken_heart: **-1 overall** | Vote | Subsystem | Runtime | Logfile | Comment | |::|--:|:|::|:---:| | +0

[GitHub] [hadoop] hadoop-yetus commented on pull request #3470: YARN-10965. Centralize queue resource calculation based on CapacityVectors

2021-11-22 Thread GitBox
hadoop-yetus commented on pull request #3470: URL: https://github.com/apache/hadoop/pull/3470#issuecomment-975594228 :confetti_ball: **+1 overall** | Vote | Subsystem | Runtime | Logfile | Comment | |::|--:|:|::|:---:| | +0

[jira] [Work logged] (HADOOP-18014) CallerContext should not include some characters

2021-11-22 Thread ASF GitHub Bot (Jira)
[ https://issues.apache.org/jira/browse/HADOOP-18014?focusedWorklogId=684745=com.atlassian.jira.plugin.system.issuetabpanels:worklog-tabpanel#worklog-684745 ] ASF GitHub Bot logged work on HADOOP-18014: --- Author: ASF GitHub Bot

[GitHub] [hadoop] hadoop-yetus commented on pull request #3698: HADOOP-18014. CallerContext should not include some characters.

2021-11-22 Thread GitBox
hadoop-yetus commented on pull request #3698: URL: https://github.com/apache/hadoop/pull/3698#issuecomment-975588397 :broken_heart: **-1 overall** | Vote | Subsystem | Runtime | Logfile | Comment | |::|--:|:|::|:---:| | +0

[GitHub] [hadoop] hadoop-yetus commented on pull request #3684: HDFS-16338. Correct fsimage error configuration message

2021-11-22 Thread GitBox
hadoop-yetus commented on pull request #3684: URL: https://github.com/apache/hadoop/pull/3684#issuecomment-975534957 :confetti_ball: **+1 overall** | Vote | Subsystem | Runtime | Logfile | Comment | |::|--:|:|::|:---:| | +0

[jira] [Updated] (HADOOP-17998) Allow get command to run with multi threads.

2021-11-22 Thread Stephen O'Donnell (Jira)
[ https://issues.apache.org/jira/browse/HADOOP-17998?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Stephen O'Donnell updated HADOOP-17998: --- Fix Version/s: 3.4.0 3.3.2 > Allow get command to run with

[jira] [Work logged] (HADOOP-18016) Make certain methods LimitedPrivate in S3AUtils.java to provide proxy support

2021-11-22 Thread ASF GitHub Bot (Jira)
[ https://issues.apache.org/jira/browse/HADOOP-18016?focusedWorklogId=684688=com.atlassian.jira.plugin.system.issuetabpanels:worklog-tabpanel#worklog-684688 ] ASF GitHub Bot logged work on HADOOP-18016: --- Author: ASF GitHub Bot

[GitHub] [hadoop] mukund-thakur commented on a change in pull request #3685: HADOOP-18016. Make certain methods LimitedPrivate in S3AUtils.java to provide proxy support

2021-11-22 Thread GitBox
mukund-thakur commented on a change in pull request #3685: URL: https://github.com/apache/hadoop/pull/3685#discussion_r754271959 ## File path: hadoop-tools/hadoop-aws/src/main/java/org/apache/hadoop/fs/s3a/S3AUtils.java ## @@ -96,6 +96,9 @@ /** * Utility methods for S3A

[GitHub] [hadoop] mukund-thakur commented on a change in pull request #3499: HADOOP-11867. Add a high performance vectored read API to file system.

2021-11-22 Thread GitBox
mukund-thakur commented on a change in pull request #3499: URL: https://github.com/apache/hadoop/pull/3499#discussion_r754266715 ## File path: hadoop-common-project/benchmark/src/main/java/org/apache/hadoop/benchmark/AsyncBenchmark.java ## @@ -0,0 +1,242 @@ +/* + * Licensed

[jira] [Work logged] (HADOOP-11867) FS API: Add a high-performance vectored Read to FSDataInputStream API

2021-11-22 Thread ASF GitHub Bot (Jira)
[ https://issues.apache.org/jira/browse/HADOOP-11867?focusedWorklogId=684682=com.atlassian.jira.plugin.system.issuetabpanels:worklog-tabpanel#worklog-684682 ] ASF GitHub Bot logged work on HADOOP-11867: --- Author: ASF GitHub Bot

[GitHub] [hadoop] hadoop-yetus commented on pull request #3618: YARN-11000. Replace queue resource calculation logic in updateClusterResource

2021-11-22 Thread GitBox
hadoop-yetus commented on pull request #3618: URL: https://github.com/apache/hadoop/pull/3618#issuecomment-975510726 :broken_heart: **-1 overall** | Vote | Subsystem | Runtime | Logfile | Comment | |::|--:|:|::|:---:| | +0

[GitHub] [hadoop] hadoop-yetus commented on pull request #3702: YARN-11012. Add version and process startup time on Router web page

2021-11-22 Thread GitBox
hadoop-yetus commented on pull request #3702: URL: https://github.com/apache/hadoop/pull/3702#issuecomment-975492275 :broken_heart: **-1 overall** | Vote | Subsystem | Runtime | Logfile | Comment | |::|--:|:|::|:---:| | +0

[jira] [Work logged] (HADOOP-17975) Fallback to simple auth does not work for a secondary DistributedFileSystem instance

2021-11-22 Thread ASF GitHub Bot (Jira)
[ https://issues.apache.org/jira/browse/HADOOP-17975?focusedWorklogId=684666=com.atlassian.jira.plugin.system.issuetabpanels:worklog-tabpanel#worklog-684666 ] ASF GitHub Bot logged work on HADOOP-17975: --- Author: ASF GitHub Bot

[jira] [Work logged] (HADOOP-17975) Fallback to simple auth does not work for a secondary DistributedFileSystem instance

2021-11-22 Thread ASF GitHub Bot (Jira)
[ https://issues.apache.org/jira/browse/HADOOP-17975?focusedWorklogId=684667=com.atlassian.jira.plugin.system.issuetabpanels:worklog-tabpanel#worklog-684667 ] ASF GitHub Bot logged work on HADOOP-17975: --- Author: ASF GitHub Bot

[GitHub] [hadoop] fapifta commented on pull request #3579: HADOOP-17975 Fallback to simple auth does not work for a secondary DistributedFileSystem instance.

2021-11-22 Thread GitBox
fapifta commented on pull request #3579: URL: https://github.com/apache/hadoop/pull/3579#issuecomment-975483356 At the end of the day after an extensive discussion, we agreed with @symious [here](https://github.com/apache/hadoop/pull/3658#discussion_r752898939), to continue with this

[GitHub] [hadoop] GuoPhilipse opened a new pull request #3703: HDFS-16347. Fix directory scan throttle default value

2021-11-22 Thread GitBox
GuoPhilipse opened a new pull request #3703: URL: https://github.com/apache/hadoop/pull/3703 `dfs.datanode.directoryscan.throttle.limit.ms.per.sec` was changed from `1000` to `-1` by default after HDFS-13947, we can improve the doc -- This is an automated message from the Apache Git

[jira] [Work logged] (HADOOP-17975) Fallback to simple auth does not work for a secondary DistributedFileSystem instance

2021-11-22 Thread ASF GitHub Bot (Jira)
[ https://issues.apache.org/jira/browse/HADOOP-17975?focusedWorklogId=684664=com.atlassian.jira.plugin.system.issuetabpanels:worklog-tabpanel#worklog-684664 ] ASF GitHub Bot logged work on HADOOP-17975: --- Author: ASF GitHub Bot

[jira] [Work logged] (HADOOP-17975) Fallback to simple auth does not work for a secondary DistributedFileSystem instance

2021-11-22 Thread ASF GitHub Bot (Jira)
[ https://issues.apache.org/jira/browse/HADOOP-17975?focusedWorklogId=684663=com.atlassian.jira.plugin.system.issuetabpanels:worklog-tabpanel#worklog-684663 ] ASF GitHub Bot logged work on HADOOP-17975: --- Author: ASF GitHub Bot

[GitHub] [hadoop] fapifta closed pull request #3658: HADOOP-17975 Fallback to simple auth does not work for a secondary DistributedFileSystem instance

2021-11-22 Thread GitBox
fapifta closed pull request #3658: URL: https://github.com/apache/hadoop/pull/3658 -- This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use the URL above to go to the specific comment. To unsubscribe, e-mail:

[GitHub] [hadoop] fapifta commented on a change in pull request #3658: HADOOP-17975 Fallback to simple auth does not work for a secondary DistributedFileSystem instance

2021-11-22 Thread GitBox
fapifta commented on a change in pull request #3658: URL: https://github.com/apache/hadoop/pull/3658#discussion_r754235193 ## File path: hadoop-common-project/hadoop-common/src/main/java/org/apache/hadoop/ipc/Client.java ## @@ -1679,11 +1679,13 @@ private Connection

[GitHub] [hadoop] hadoop-yetus commented on pull request #3618: YARN-11000. Replace queue resource calculation logic in updateClusterResource

2021-11-22 Thread GitBox
hadoop-yetus commented on pull request #3618: URL: https://github.com/apache/hadoop/pull/3618#issuecomment-975470860 :broken_heart: **-1 overall** | Vote | Subsystem | Runtime | Logfile | Comment | |::|--:|:|::|:---:| | +0

[jira] [Work logged] (HADOOP-17409) Remove S3Guard - no longer needed

2021-11-22 Thread ASF GitHub Bot (Jira)
[ https://issues.apache.org/jira/browse/HADOOP-17409?focusedWorklogId=684655=com.atlassian.jira.plugin.system.issuetabpanels:worklog-tabpanel#worklog-684655 ] ASF GitHub Bot logged work on HADOOP-17409: --- Author: ASF GitHub Bot

[GitHub] [hadoop] steveloughran commented on pull request #3534: HADOOP-17409. Remove s3guard from S3A module

2021-11-22 Thread GitBox
steveloughran commented on pull request #3534: URL: https://github.com/apache/hadoop/pull/3534#issuecomment-975468562 minor spotbugs to fix up -- This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use the URL above to go to

[GitHub] [hadoop] hadoop-yetus commented on pull request #3470: YARN-10965. Centralize queue resource calculation based on CapacityVectors

2021-11-22 Thread GitBox
hadoop-yetus commented on pull request #3470: URL: https://github.com/apache/hadoop/pull/3470#issuecomment-975451419 :confetti_ball: **+1 overall** | Vote | Subsystem | Runtime | Logfile | Comment | |::|--:|:|::|:---:| | +0

[GitHub] [hadoop] hadoop-yetus commented on pull request #3661: HDFS-16324. fix error log in BlockManagerSafeMode

2021-11-22 Thread GitBox
hadoop-yetus commented on pull request #3661: URL: https://github.com/apache/hadoop/pull/3661#issuecomment-975444966 :confetti_ball: **+1 overall** | Vote | Subsystem | Runtime | Logfile | Comment | |::|--:|:|::|:---:| | +0

[jira] [Assigned] (HADOOP-17998) Allow get command to run with multi threads.

2021-11-22 Thread Stephen O'Donnell (Jira)

[jira] [Updated] (HADOOP-17998) Allow get command to run with multi threads.

2021-11-22 Thread Stephen O'Donnell (Jira)
[ https://issues.apache.org/jira/browse/HADOOP-17998?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Stephen O'Donnell updated HADOOP-17998: --- Summary: Allow get command to run with multi threads. (was: Enable get command

[jira] [Work logged] (HADOOP-17998) Enable get command run with multi-thread

2021-11-22 Thread ASF GitHub Bot (Jira)
[ https://issues.apache.org/jira/browse/HADOOP-17998?focusedWorklogId=684640=com.atlassian.jira.plugin.system.issuetabpanels:worklog-tabpanel#worklog-684640 ] ASF GitHub Bot logged work on HADOOP-17998: --- Author: ASF GitHub Bot

[GitHub] [hadoop] sodonnel merged pull request #3645: HADOOP-17998. Enable get command run with multi-thread.

2021-11-22 Thread GitBox
sodonnel merged pull request #3645: URL: https://github.com/apache/hadoop/pull/3645 -- This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use the URL above to go to the specific comment. To unsubscribe, e-mail:

[GitHub] [hadoop] better3471 opened a new pull request #3702: YARN-11012. Add version and process startup time on Router web page

2021-11-22 Thread GitBox
better3471 opened a new pull request #3702: URL: https://github.com/apache/hadoop/pull/3702 ### Description of PR Router web page should show hadoop version and startup time like other YARN componment, so we can add a tab 'ServerInfo' to show these informations. -- This is an

[jira] [Commented] (HADOOP-16779) Support dynamic change Kerberos user and KDC to access multiple Hadoop clusters

2021-11-22 Thread vincent zeng (Jira)
[ https://issues.apache.org/jira/browse/HADOOP-16779?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17447299#comment-17447299 ] vincent zeng commented on HADOOP-16779: --- Any progress on this? > Support dynamic change Kerberos

[GitHub] [hadoop] hadoop-yetus commented on pull request #3701: YARN-11011. Make YARN Router throw Exception to client clearly

2021-11-22 Thread GitBox
hadoop-yetus commented on pull request #3701: URL: https://github.com/apache/hadoop/pull/3701#issuecomment-975375244 :broken_heart: **-1 overall** | Vote | Subsystem | Runtime | Logfile | Comment | |::|--:|:|::|:---:| | +0

[GitHub] [hadoop] ferhui commented on pull request #3654: HDFS-16320. Datanode retrieve slownode information from NameNode

2021-11-22 Thread GitBox
ferhui commented on pull request #3654: URL: https://github.com/apache/hadoop/pull/3654#issuecomment-975355750 @symious Thanks for contribution. @tasanuma Thanks for review. Merged to trunk. Please go ahead. -- This is an automated message from the Apache Git Service. To respond to

[GitHub] [hadoop] ferhui merged pull request #3654: HDFS-16320. Datanode retrieve slownode information from NameNode

2021-11-22 Thread GitBox
ferhui merged pull request #3654: URL: https://github.com/apache/hadoop/pull/3654 -- This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use the URL above to go to the specific comment. To unsubscribe, e-mail:

[jira] [Work logged] (HADOOP-18014) CallerContext should not include some characters

2021-11-22 Thread ASF GitHub Bot (Jira)
[ https://issues.apache.org/jira/browse/HADOOP-18014?focusedWorklogId=684591=com.atlassian.jira.plugin.system.issuetabpanels:worklog-tabpanel#worklog-684591 ] ASF GitHub Bot logged work on HADOOP-18014: --- Author: ASF GitHub Bot

[GitHub] [hadoop] virajjasani commented on a change in pull request #3698: HADOOP-18014. CallerContext should not include some characters.

2021-11-22 Thread GitBox
virajjasani commented on a change in pull request #3698: URL: https://github.com/apache/hadoop/pull/3698#discussion_r754099463 ## File path: hadoop-hdfs-project/hadoop-hdfs/src/test/java/org/apache/hadoop/hdfs/server/namenode/TestAuditLogger.java ## @@ -599,6 +599,36 @@

[jira] [Work logged] (HADOOP-18001) Update to Jetty 9.4.44

2021-11-22 Thread ASF GitHub Bot (Jira)
[ https://issues.apache.org/jira/browse/HADOOP-18001?focusedWorklogId=684576=com.atlassian.jira.plugin.system.issuetabpanels:worklog-tabpanel#worklog-684576 ] ASF GitHub Bot logged work on HADOOP-18001: --- Author: ASF GitHub Bot

  1   2   >