[jira] [Work logged] (HADOOP-17596) ABFS: Change default Readahead Queue Depth from num(processors) to const

2021-06-08 Thread ASF GitHub Bot (Jira)
[ https://issues.apache.org/jira/browse/HADOOP-17596?focusedWorklogId=608930=com.atlassian.jira.plugin.system.issuetabpanels:worklog-tabpanel#worklog-608930 ] ASF GitHub Bot logged work on HADOOP-17596: --- Author: ASF GitHub Bot

[GitHub] [hadoop] sumangala-patki commented on pull request #2795: HADOOP-17596. ABFS: Change default Readahead Queue Depth from num(processors) to const

2021-06-08 Thread GitBox
sumangala-patki commented on pull request #2795: URL: https://github.com/apache/hadoop/pull/2795#issuecomment-857390775 @surendralilhore thanks for updating the JIRA @steveloughran yes, but planning to ensure a gap (maybe a week or two) between check-in to trunk and backport of PRs.

[jira] [Updated] (HADOOP-17715) ABFS: Append blob tests with non HNS accounts fail

2021-06-08 Thread Surendra Singh Lilhore (Jira)
[ https://issues.apache.org/jira/browse/HADOOP-17715?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Surendra Singh Lilhore updated HADOOP-17715: Fix Version/s: 3.4.0 > ABFS: Append blob tests with non HNS accounts

[jira] [Work logged] (HADOOP-17715) ABFS: Append blob tests with non HNS accounts fail

2021-06-08 Thread ASF GitHub Bot (Jira)
[ https://issues.apache.org/jira/browse/HADOOP-17715?focusedWorklogId=608927=com.atlassian.jira.plugin.system.issuetabpanels:worklog-tabpanel#worklog-608927 ] ASF GitHub Bot logged work on HADOOP-17715: --- Author: ASF GitHub Bot

[GitHub] [hadoop] surendralilhore merged pull request #3028: HADOOP-17715 ABFS: Append blob tests with non HNS accounts fail

2021-06-08 Thread GitBox
surendralilhore merged pull request #3028: URL: https://github.com/apache/hadoop/pull/3028 -- This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use the URL above to go to the specific comment. For queries about this

[jira] [Work logged] (HADOOP-17715) ABFS: Append blob tests with non HNS accounts fail

2021-06-08 Thread ASF GitHub Bot (Jira)
[ https://issues.apache.org/jira/browse/HADOOP-17715?focusedWorklogId=608926=com.atlassian.jira.plugin.system.issuetabpanels:worklog-tabpanel#worklog-608926 ] ASF GitHub Bot logged work on HADOOP-17715: --- Author: ASF GitHub Bot

[GitHub] [hadoop] surendralilhore commented on pull request #3028: HADOOP-17715 ABFS: Append blob tests with non HNS accounts fail

2021-06-08 Thread GitBox
surendralilhore commented on pull request #3028: URL: https://github.com/apache/hadoop/pull/3028#issuecomment-857384805 +1 -- This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use the URL above to go to the specific comment.

[jira] [Work logged] (HADOOP-17596) ABFS: Change default Readahead Queue Depth from num(processors) to const

2021-06-08 Thread ASF GitHub Bot (Jira)
[ https://issues.apache.org/jira/browse/HADOOP-17596?focusedWorklogId=608923=com.atlassian.jira.plugin.system.issuetabpanels:worklog-tabpanel#worklog-608923 ] ASF GitHub Bot logged work on HADOOP-17596: --- Author: ASF GitHub Bot

[GitHub] [hadoop] surendralilhore commented on pull request #2795: HADOOP-17596. ABFS: Change default Readahead Queue Depth from num(processors) to const

2021-06-08 Thread GitBox
surendralilhore commented on pull request #2795: URL: https://github.com/apache/hadoop/pull/2795#issuecomment-857378838 @steveloughran , I updated the Jira. > Are there any plans to backport to branch-3.3? A retest of the cherrypick is all which should be needed Yes,

[jira] [Updated] (HADOOP-17596) ABFS: Change default Readahead Queue Depth from num(processors) to const

2021-06-08 Thread Surendra Singh Lilhore (Jira)
[ https://issues.apache.org/jira/browse/HADOOP-17596?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Surendra Singh Lilhore updated HADOOP-17596: Fix Version/s: 3.4.0 > ABFS: Change default Readahead Queue Depth from

[jira] [Updated] (HADOOP-17752) Remove lock contention in REGISTRY of Configuration

2021-06-08 Thread ASF GitHub Bot (Jira)
[ https://issues.apache.org/jira/browse/HADOOP-17752?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] ASF GitHub Bot updated HADOOP-17752: Labels: pull-request-available (was: ) > Remove lock contention in REGISTRY of

[jira] [Work logged] (HADOOP-17752) Remove lock contention in REGISTRY of Configuration

2021-06-08 Thread ASF GitHub Bot (Jira)
[ https://issues.apache.org/jira/browse/HADOOP-17752?focusedWorklogId=608913=com.atlassian.jira.plugin.system.issuetabpanels:worklog-tabpanel#worklog-608913 ] ASF GitHub Bot logged work on HADOOP-17752: --- Author: ASF GitHub Bot

[GitHub] [hadoop] liangxs opened a new pull request #3085: HADOOP-17752. Remove lock contention in REGISTRY of Configuration

2021-06-08 Thread GitBox
liangxs opened a new pull request #3085: URL: https://github.com/apache/hadoop/pull/3085 JIRA: [HADOOP-17752](https://issues.apache.org/jira/browse/HADOOP-17752) -- This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use

[GitHub] [hadoop] aajisaka commented on a change in pull request #3065: HDFS-13671. Namenode deletes large dir slowly caused by FoldedTreeSet#removeAndGet

2021-06-08 Thread GitBox
aajisaka commented on a change in pull request #3065: URL: https://github.com/apache/hadoop/pull/3065#discussion_r647951023 ## File path: hadoop-hdfs-project/hadoop-hdfs/src/main/java/org/apache/hadoop/hdfs/server/namenode/FSNamesystem.java ## @@ -1996,7 +1996,12 @@ private

[GitHub] [hadoop] hadoop-yetus commented on pull request #3075: YARN-10805. Replace Guava Lists usage by Hadoop's own Lists in hadoop-yarn-project

2021-06-08 Thread GitBox
hadoop-yetus commented on pull request #3075: URL: https://github.com/apache/hadoop/pull/3075#issuecomment-857346126 :broken_heart: **-1 overall** | Vote | Subsystem | Runtime | Logfile | Comment | |::|--:|:|::|:---:| | +0

[GitHub] [hadoop] hadoop-yetus commented on pull request #3078: HDFS-16055. Quota is not preserved in snapshot INode

2021-06-08 Thread GitBox
hadoop-yetus commented on pull request #3078: URL: https://github.com/apache/hadoop/pull/3078#issuecomment-857345327 :broken_heart: **-1 overall** | Vote | Subsystem | Runtime | Logfile | Comment | |::|--:|:|::|:---:| | +0

[GitHub] [hadoop] hadoop-yetus commented on pull request #3073: HDFS-16054. Replace Guava Lists usage by Hadoop's own Lists in hadoop-hdfs-project

2021-06-08 Thread GitBox
hadoop-yetus commented on pull request #3073: URL: https://github.com/apache/hadoop/pull/3073#issuecomment-857329518 :broken_heart: **-1 overall** | Vote | Subsystem | Runtime | Logfile | Comment | |::|--:|:|::|:---:| | +0

[GitHub] [hadoop] hadoop-yetus commented on pull request #3073: HDFS-16054. Replace Guava Lists usage by Hadoop's own Lists in hadoop-hdfs-project

2021-06-08 Thread GitBox
hadoop-yetus commented on pull request #3073: URL: https://github.com/apache/hadoop/pull/3073#issuecomment-857328284 :broken_heart: **-1 overall** | Vote | Subsystem | Runtime | Logfile | Comment | |::|--:|:|::|:---:| | +0

[jira] [Created] (HADOOP-17752) Remove lock contention in REGISTRY of Configuration

2021-06-08 Thread Xuesen Liang (Jira)
Xuesen Liang created HADOOP-17752: - Summary: Remove lock contention in REGISTRY of Configuration Key: HADOOP-17752 URL: https://issues.apache.org/jira/browse/HADOOP-17752 Project: Hadoop Common

[GitHub] [hadoop] jojochuang merged pull request #3081: YARN-10809. Missing dependency causing NoClassDefFoundError in TestHBaseTimelineStorageUtils

2021-06-08 Thread GitBox
jojochuang merged pull request #3081: URL: https://github.com/apache/hadoop/pull/3081 -- This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use the URL above to go to the specific comment. For queries about this service,

[GitHub] [hadoop] jojochuang merged pull request #3056: HDFS-15916. Addendum. DistCp: Backward compatibility: Distcp fails from Hadoop 3 to Hadoop 2 for snapshotdiff.

2021-06-08 Thread GitBox
jojochuang merged pull request #3056: URL: https://github.com/apache/hadoop/pull/3056 -- This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use the URL above to go to the specific comment. For queries about this service,

[GitHub] [hadoop] jojochuang commented on pull request #3054: HDFS-15916. DistCp: Backward compatibility: Distcp fails from Hadoop 3 to Hadoop 2 for snapshotdiff. (#2863). Contributed by Ayush Saxena.

2021-06-08 Thread GitBox
jojochuang commented on pull request #3054: URL: https://github.com/apache/hadoop/pull/3054#issuecomment-857323813 Merging it. No test failures. -- This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use the URL above to go to

[GitHub] [hadoop] tasanuma commented on pull request #3075: YARN-10805. Replace Guava Lists usage by Hadoop's own Lists in hadoop-yarn-project

2021-06-08 Thread GitBox
tasanuma commented on pull request #3075: URL: https://github.com/apache/hadoop/pull/3075#issuecomment-857323736 +1, pending Jenkins. -- This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use the URL above to go to the

[GitHub] [hadoop] jojochuang merged pull request #3054: HDFS-15916. DistCp: Backward compatibility: Distcp fails from Hadoop 3 to Hadoop 2 for snapshotdiff. (#2863). Contributed by Ayush Saxena.

2021-06-08 Thread GitBox
jojochuang merged pull request #3054: URL: https://github.com/apache/hadoop/pull/3054 -- This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use the URL above to go to the specific comment. For queries about this service,

[GitHub] [hadoop] tomscut commented on pull request #3084: HDFS-16057. Make sure the order for location in ENTERING_MAINTENANCE …

2021-06-08 Thread GitBox
tomscut commented on pull request #3084: URL: https://github.com/apache/hadoop/pull/3084#issuecomment-857320247 > The fix makes sense to me. > > It would be great if the test is written as a unit test for DatanodeManager rather than a cluster test. Thank @jojochuang for your

[jira] [Updated] (HADOOP-17751) Reduce lock contention in org.apache.hadoop.conf.Configuration

2021-06-08 Thread Xuesen Liang (Jira)
[ https://issues.apache.org/jira/browse/HADOOP-17751?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Xuesen Liang updated HADOOP-17751: -- Labels: Umbrella (was: ) > Reduce lock contention in org.apache.hadoop.conf.Configuration >

[jira] [Created] (HADOOP-17751) Reduce lock contention in org.apache.hadoop.conf.Configuration

2021-06-08 Thread Xuesen Liang (Jira)
Xuesen Liang created HADOOP-17751: - Summary: Reduce lock contention in org.apache.hadoop.conf.Configuration Key: HADOOP-17751 URL: https://issues.apache.org/jira/browse/HADOOP-17751 Project: Hadoop

[GitHub] [hadoop] tomscut commented on pull request #3084: HDFS-16057. Make sure the order for location in ENTERING_MAINTENANCE …

2021-06-08 Thread GitBox
tomscut commented on pull request #3084: URL: https://github.com/apache/hadoop/pull/3084#issuecomment-857305808 Hi @zhe-thoughts @rakeshadr @umbrant @yzhangal , could you please review the code? Thanks you. -- This is an automated message from the Apache Git Service. To respond to the

[GitHub] [hadoop] ferhui commented on a change in pull request #3065: HDFS-13671. Namenode deletes large dir slowly caused by FoldedTreeSet#removeAndGet

2021-06-08 Thread GitBox
ferhui commented on a change in pull request #3065: URL: https://github.com/apache/hadoop/pull/3065#discussion_r647902665 ## File path: hadoop-hdfs-project/hadoop-hdfs/src/main/java/org/apache/hadoop/hdfs/server/namenode/FSNamesystem.java ## @@ -1996,7 +1996,12 @@ private

[GitHub] [hadoop] hadoop-yetus commented on pull request #3082: [Do not commit] Exclude JSON files from RAT check

2021-06-08 Thread GitBox
hadoop-yetus commented on pull request #3082: URL: https://github.com/apache/hadoop/pull/3082#issuecomment-857292313 :broken_heart: **-1 overall** | Vote | Subsystem | Runtime | Logfile | Comment | |::|--:|:|::|:---:| | +0

[GitHub] [hadoop] hadoop-yetus commented on pull request #2998: HDFS-16016. BPServiceActor to provide new thread to handle IBR

2021-06-08 Thread GitBox
hadoop-yetus commented on pull request #2998: URL: https://github.com/apache/hadoop/pull/2998#issuecomment-857230783 :broken_heart: **-1 overall** | Vote | Subsystem | Runtime | Logfile | Comment | |::|--:|:|::|:---:| | +0

[GitHub] [hadoop] hadoop-yetus commented on pull request #2998: HDFS-16016. BPServiceActor to provide new thread to handle IBR

2021-06-08 Thread GitBox
hadoop-yetus commented on pull request #2998: URL: https://github.com/apache/hadoop/pull/2998#issuecomment-857228763 :broken_heart: **-1 overall** | Vote | Subsystem | Runtime | Logfile | Comment | |::|--:|:|::|:---:| | +0

[GitHub] [hadoop] hadoop-yetus commented on pull request #3075: YARN-10805. Replace Guava Lists usage by Hadoop's own Lists in hadoop-yarn-project

2021-06-08 Thread GitBox
hadoop-yetus commented on pull request #3075: URL: https://github.com/apache/hadoop/pull/3075#issuecomment-857221708 :broken_heart: **-1 overall** | Vote | Subsystem | Runtime | Logfile | Comment | |::|--:|:|::|:---:| | +0

[jira] [Work logged] (HADOOP-17745) ADLS client can throw an IOException when it should throw an InterruptedIOException

2021-06-08 Thread ASF GitHub Bot (Jira)
[ https://issues.apache.org/jira/browse/HADOOP-17745?focusedWorklogId=608761=com.atlassian.jira.plugin.system.issuetabpanels:worklog-tabpanel#worklog-608761 ] ASF GitHub Bot logged work on HADOOP-17745: --- Author: ASF GitHub Bot

[GitHub] [hadoop] steveloughran commented on a change in pull request #3076: HADOOP-17745. Wrap IOException with InterruptedException cause properly

2021-06-08 Thread GitBox
steveloughran commented on a change in pull request #3076: URL: https://github.com/apache/hadoop/pull/3076#discussion_r647799533 ## File path: hadoop-common-project/hadoop-common/src/main/java/org/apache/hadoop/io/IOUtils.java ## @@ -482,6 +482,12 @@ public static IOException

[jira] [Work logged] (HADOOP-17745) ADLS client can throw an IOException when it should throw an InterruptedIOException

2021-06-08 Thread ASF GitHub Bot (Jira)
[ https://issues.apache.org/jira/browse/HADOOP-17745?focusedWorklogId=608757=com.atlassian.jira.plugin.system.issuetabpanels:worklog-tabpanel#worklog-608757 ] ASF GitHub Bot logged work on HADOOP-17745: --- Author: ASF GitHub Bot

[GitHub] [hadoop] steveloughran commented on pull request #3076: HADOOP-17745. Wrap IOException with InterruptedException cause properly

2021-06-08 Thread GitBox
steveloughran commented on pull request #3076: URL: https://github.com/apache/hadoop/pull/3076#issuecomment-857157506 aah, you need to look at the [Testing Azure](https://github.com/apache/hadoop/blob/trunk/hadoop-tools/hadoop-azure/src/site/markdown/testing_azure.md) doc. I can see the

[jira] [Work logged] (HADOOP-17725) Improve error message for token providers in ABFS

2021-06-08 Thread ASF GitHub Bot (Jira)
[ https://issues.apache.org/jira/browse/HADOOP-17725?focusedWorklogId=608756=com.atlassian.jira.plugin.system.issuetabpanels:worklog-tabpanel#worklog-608756 ] ASF GitHub Bot logged work on HADOOP-17725: --- Author: ASF GitHub Bot

[GitHub] [hadoop] steveloughran commented on pull request #3041: HADOOP-17725. Improve error message for token providers in ABFS

2021-06-08 Thread GitBox
steveloughran commented on pull request #3041: URL: https://github.com/apache/hadoop/pull/3041#issuecomment-857155825 ..and its done. Thank you everyone for your work. -- This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use

[jira] [Resolved] (HADOOP-17631) Configuration ${env.VAR:-FALLBACK} should eval FALLBACK when restrictSystemProps=true

2021-06-08 Thread Steve Loughran (Jira)
[ https://issues.apache.org/jira/browse/HADOOP-17631?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Steve Loughran resolved HADOOP-17631. - Fix Version/s: 3.3.2 Resolution: Fixed > Configuration ${env.VAR:-FALLBACK}

[jira] [Resolved] (HADOOP-17725) Improve error message for token providers in ABFS

2021-06-08 Thread Steve Loughran (Jira)
[ https://issues.apache.org/jira/browse/HADOOP-17725?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Steve Loughran resolved HADOOP-17725. - Fix Version/s: 3.3.2 Resolution: Fixed > Improve error message for token

[jira] [Work logged] (HADOOP-17725) Improve error message for token providers in ABFS

2021-06-08 Thread ASF GitHub Bot (Jira)
[ https://issues.apache.org/jira/browse/HADOOP-17725?focusedWorklogId=608750=com.atlassian.jira.plugin.system.issuetabpanels:worklog-tabpanel#worklog-608750 ] ASF GitHub Bot logged work on HADOOP-17725: --- Author: ASF GitHub Bot

[jira] [Work logged] (HADOOP-17725) Improve error message for token providers in ABFS

2021-06-08 Thread ASF GitHub Bot (Jira)
[ https://issues.apache.org/jira/browse/HADOOP-17725?focusedWorklogId=608749=com.atlassian.jira.plugin.system.issuetabpanels:worklog-tabpanel#worklog-608749 ] ASF GitHub Bot logged work on HADOOP-17725: --- Author: ASF GitHub Bot

[GitHub] [hadoop] steveloughran commented on pull request #3041: HADOOP-17725. Improve error message for token providers in ABFS

2021-06-08 Thread GitBox
steveloughran commented on pull request #3041: URL: https://github.com/apache/hadoop/pull/3041#issuecomment-857145495 merged into trunk; will cherrypick to branch-3.3 with a recompile to verify all is good. leaving JIRA open until then -- This is an automated message from the Apache Git

[GitHub] [hadoop] steveloughran merged pull request #3041: HADOOP-17725. Improve error message for token providers in ABFS

2021-06-08 Thread GitBox
steveloughran merged pull request #3041: URL: https://github.com/apache/hadoop/pull/3041 -- This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use the URL above to go to the specific comment. For queries about this service,

[GitHub] [hadoop] steveloughran commented on a change in pull request #2971: MAPREDUCE-7341. Intermediate Manifest Committer

2021-06-08 Thread GitBox
steveloughran commented on a change in pull request #2971: URL: https://github.com/apache/hadoop/pull/2971#discussion_r647789479 ## File path:

[GitHub] [hadoop] hadoop-yetus removed a comment on pull request #2971: MAPREDUCE-7341. Intermediate Manifest Committer

2021-06-08 Thread GitBox
hadoop-yetus removed a comment on pull request #2971: URL: https://github.com/apache/hadoop/pull/2971#issuecomment-849569296 -- This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use the URL above to go to the specific comment.

[GitHub] [hadoop] steveloughran commented on a change in pull request #2971: MAPREDUCE-7341. Intermediate Manifest Committer

2021-06-08 Thread GitBox
steveloughran commented on a change in pull request #2971: URL: https://github.com/apache/hadoop/pull/2971#discussion_r647788743 ## File path:

[jira] [Work logged] (HADOOP-17631) Configuration ${env.VAR:-FALLBACK} should eval FALLBACK when restrictSystemProps=true

2021-06-08 Thread ASF GitHub Bot (Jira)
[ https://issues.apache.org/jira/browse/HADOOP-17631?focusedWorklogId=608745=com.atlassian.jira.plugin.system.issuetabpanels:worklog-tabpanel#worklog-608745 ] ASF GitHub Bot logged work on HADOOP-17631: --- Author: ASF GitHub Bot

[GitHub] [hadoop] steveloughran merged pull request #2977: HADOOP-17631. Configuration ${env.VAR:-FALLBACK} to eval FALLBACK when restrictSystemProps=true

2021-06-08 Thread GitBox
steveloughran merged pull request #2977: URL: https://github.com/apache/hadoop/pull/2977 -- This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use the URL above to go to the specific comment. For queries about this service,

[jira] [Commented] (HADOOP-16878) FileUtil.copy() to throw IOException if the source and destination are the same

2021-06-08 Thread Steve Loughran (Jira)
[ https://issues.apache.org/jira/browse/HADOOP-16878?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17359564#comment-17359564 ] Steve Loughran commented on HADOOP-16878: - ok, but if I do a command on the CLI, isn't it only

[jira] [Commented] (HADOOP-11461) Namenode stdout log contains IllegalAccessException

2021-06-08 Thread Steve Loughran (Jira)
[ https://issues.apache.org/jira/browse/HADOOP-11461?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17359563#comment-17359563 ] Steve Loughran commented on HADOOP-11461: - bq. Should I be worried? no, though its a warning

[jira] [Work logged] (HADOOP-17596) ABFS: Change default Readahead Queue Depth from num(processors) to const

2021-06-08 Thread ASF GitHub Bot (Jira)
[ https://issues.apache.org/jira/browse/HADOOP-17596?focusedWorklogId=608720=com.atlassian.jira.plugin.system.issuetabpanels:worklog-tabpanel#worklog-608720 ] ASF GitHub Bot logged work on HADOOP-17596: --- Author: ASF GitHub Bot

[GitHub] [hadoop] steveloughran commented on pull request #2795: HADOOP-17596. ABFS: Change default Readahead Queue Depth from num(processors) to const

2021-06-08 Thread GitBox
steveloughran commented on pull request #2795: URL: https://github.com/apache/hadoop/pull/2795#issuecomment-857108374 1. Now this has been merged, the JIRA MUST be updated with fix version 2. Are there any plans to backport to branch-3.3? A retest of the cherrypick is all which should

[GitHub] [hadoop] smengcl commented on pull request #3078: HDFS-16055. Quota is not preserved in snapshot INode

2021-06-08 Thread GitBox
smengcl commented on pull request #3078: URL: https://github.com/apache/hadoop/pull/3078#issuecomment-857033639 The cause of the UT failure `testRenameDirAndDeleteSnapshot_1` is that features in the stream are returned as **references**. While this is fine for AclFeature or XAttrFeature.

[GitHub] [hadoop] aajisaka commented on pull request #3082: [Do not commit] Exclude JSON files from RAT check

2021-06-08 Thread GitBox
aajisaka commented on pull request #3082: URL: https://github.com/apache/hadoop/pull/3082#issuecomment-856968401 It is duplicate of HADOOP-17750 (#3083). Thanks. -- This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use the

[GitHub] [hadoop] hadoop-yetus commented on pull request #3073: HDFS-16054. Replace Guava Lists usage by Hadoop's own Lists in hadoop-hdfs-project

2021-06-08 Thread GitBox
hadoop-yetus commented on pull request #3073: URL: https://github.com/apache/hadoop/pull/3073#issuecomment-856948626 :broken_heart: **-1 overall** | Vote | Subsystem | Runtime | Logfile | Comment | |::|--:|:|::|:---:| | +0

[GitHub] [hadoop] hadoop-yetus commented on pull request #3084: HDFS-16057. Make sure the order for location in ENTERING_MAINTENANCE …

2021-06-08 Thread GitBox
hadoop-yetus commented on pull request #3084: URL: https://github.com/apache/hadoop/pull/3084#issuecomment-856924189 :broken_heart: **-1 overall** | Vote | Subsystem | Runtime | Logfile | Comment | |::|--:|:|::|:---:| | +0

[GitHub] [hadoop] kihwal merged pull request #3058: HDFS-16042. DatanodeAdminMonitor scan should be delay based

2021-06-08 Thread GitBox
kihwal merged pull request #3058: URL: https://github.com/apache/hadoop/pull/3058 -- This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use the URL above to go to the specific comment. For queries about this service, please

[GitHub] [hadoop] amahussein commented on pull request #3058: HDFS-16042. DatanodeAdminMonitor scan should be delay based

2021-06-08 Thread GitBox
amahussein commented on pull request #3058: URL: https://github.com/apache/hadoop/pull/3058#issuecomment-856894824 @kihwal and @jbrennan333 I have tested the three unit tests `TestDecommissioningStatus`, `TestDFSShell`, `TestDecommissioningStatusWithBackoffMonitor` in a loop for

[GitHub] [hadoop] aajisaka commented on a change in pull request #3065: HDFS-13671. Namenode deletes large dir slowly caused by FoldedTreeSet#removeAndGet

2021-06-08 Thread GitBox
aajisaka commented on a change in pull request #3065: URL: https://github.com/apache/hadoop/pull/3065#discussion_r647396463 ## File path: hadoop-hdfs-project/hadoop-hdfs/src/main/java/org/apache/hadoop/hdfs/server/namenode/FSNamesystem.java ## @@ -1996,7 +1996,12 @@ private

[GitHub] [hadoop] aajisaka commented on a change in pull request #3065: HDFS-13671. Namenode deletes large dir slowly caused by FoldedTreeSet#removeAndGet

2021-06-08 Thread GitBox
aajisaka commented on a change in pull request #3065: URL: https://github.com/apache/hadoop/pull/3065#discussion_r647396463 ## File path: hadoop-hdfs-project/hadoop-hdfs/src/main/java/org/apache/hadoop/hdfs/server/namenode/FSNamesystem.java ## @@ -1996,7 +1996,12 @@ private

[GitHub] [hadoop] aajisaka commented on a change in pull request #3065: HDFS-13671. Namenode deletes large dir slowly caused by FoldedTreeSet#removeAndGet

2021-06-08 Thread GitBox
aajisaka commented on a change in pull request #3065: URL: https://github.com/apache/hadoop/pull/3065#discussion_r647396463 ## File path: hadoop-hdfs-project/hadoop-hdfs/src/main/java/org/apache/hadoop/hdfs/server/namenode/FSNamesystem.java ## @@ -1996,7 +1996,12 @@ private

[GitHub] [hadoop] ferhui commented on a change in pull request #3065: HDFS-13671. Namenode deletes large dir slowly caused by FoldedTreeSet#removeAndGet

2021-06-08 Thread GitBox
ferhui commented on a change in pull request #3065: URL: https://github.com/apache/hadoop/pull/3065#discussion_r647387834 ## File path: hadoop-hdfs-project/hadoop-hdfs/src/main/java/org/apache/hadoop/hdfs/server/namenode/FSNamesystem.java ## @@ -1996,7 +1996,12 @@ private

[GitHub] [hadoop] aajisaka closed pull request #3059: #HDFS-13729 Removed extra space

2021-06-08 Thread GitBox
aajisaka closed pull request #3059: URL: https://github.com/apache/hadoop/pull/3059 -- This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use the URL above to go to the specific comment. For queries about this service,

[GitHub] [hadoop] aajisaka commented on pull request #3068: YARN-10803. [JDK 11] TestRMFailoverProxyProvider and TestNoHaRMFailoverProxyProvier fails by ClassCastException

2021-06-08 Thread GitBox
aajisaka commented on pull request #3068: URL: https://github.com/apache/hadoop/pull/3068#issuecomment-856713356 Thank you @bogthe! @tasanuma Would you review this? -- This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and

[GitHub] [hadoop] aajisaka commented on a change in pull request #3065: HDFS-13671. Namenode deletes large dir slowly caused by FoldedTreeSet#removeAndGet

2021-06-08 Thread GitBox
aajisaka commented on a change in pull request #3065: URL: https://github.com/apache/hadoop/pull/3065#discussion_r647376745 ## File path: hadoop-hdfs-project/hadoop-hdfs/src/main/java/org/apache/hadoop/hdfs/server/namenode/FSNamesystem.java ## @@ -1996,7 +1996,12 @@ private

[GitHub] [hadoop] aajisaka commented on a change in pull request #3065: HDFS-13671. Namenode deletes large dir slowly caused by FoldedTreeSet#removeAndGet

2021-06-08 Thread GitBox
aajisaka commented on a change in pull request #3065: URL: https://github.com/apache/hadoop/pull/3065#discussion_r647376745 ## File path: hadoop-hdfs-project/hadoop-hdfs/src/main/java/org/apache/hadoop/hdfs/server/namenode/FSNamesystem.java ## @@ -1996,7 +1996,12 @@ private

[GitHub] [hadoop] hadoop-yetus commented on pull request #3013: TestDFSMkdir fails with multiple partitions

2021-06-08 Thread GitBox
hadoop-yetus commented on pull request #3013: URL: https://github.com/apache/hadoop/pull/3013#issuecomment-856704328 :broken_heart: **-1 overall** | Vote | Subsystem | Runtime | Logfile | Comment | |::|--:|:|::|:---:| | +0

[GitHub] [hadoop] aajisaka commented on a change in pull request #3065: HDFS-13671. Namenode deletes large dir slowly caused by FoldedTreeSet#removeAndGet

2021-06-08 Thread GitBox
aajisaka commented on a change in pull request #3065: URL: https://github.com/apache/hadoop/pull/3065#discussion_r647363773 ## File path: hadoop-hdfs-project/hadoop-hdfs/src/main/java/org/apache/hadoop/hdfs/server/blockmanagement/BlockManager.java ## @@ -3111,106 +3042,127 @@

[jira] [Work logged] (HADOOP-17749) Remove lock contention in SelectorPool of SocketIOWithTimeout

2021-06-08 Thread ASF GitHub Bot (Jira)
[ https://issues.apache.org/jira/browse/HADOOP-17749?focusedWorklogId=608418=com.atlassian.jira.plugin.system.issuetabpanels:worklog-tabpanel#worklog-608418 ] ASF GitHub Bot logged work on HADOOP-17749: --- Author: ASF GitHub Bot

[GitHub] [hadoop] liangxs commented on pull request #3080: HADOOP-17749. Remove lock contention in SelectorPool of SocketIOWithTimeout

2021-06-08 Thread GitBox
liangxs commented on pull request #3080: URL: https://github.com/apache/hadoop/pull/3080#issuecomment-856703041 Could someone please review this PR? -- This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use the URL above to go

[GitHub] [hadoop] ferhui commented on a change in pull request #3065: HDFS-13671. Namenode deletes large dir slowly caused by FoldedTreeSet#removeAndGet

2021-06-08 Thread GitBox
ferhui commented on a change in pull request #3065: URL: https://github.com/apache/hadoop/pull/3065#discussion_r647357273 ## File path: hadoop-hdfs-project/hadoop-hdfs/src/main/java/org/apache/hadoop/hdfs/server/namenode/FSNamesystem.java ## @@ -1996,7 +1996,12 @@ private

[GitHub] [hadoop] hadoop-yetus commented on pull request #3084: HDFS-16057. Make sure the order for location in ENTERING_MAINTENANCE …

2021-06-08 Thread GitBox
hadoop-yetus commented on pull request #3084: URL: https://github.com/apache/hadoop/pull/3084#issuecomment-856650629 :broken_heart: **-1 overall** | Vote | Subsystem | Runtime | Logfile | Comment | |::|--:|:|::|:---:| | +0

[GitHub] [hadoop] hadoop-yetus commented on pull request #3075: YARN-10805. Replace Guava Lists usage by Hadoop's own Lists in hadoop-yarn-project

2021-06-08 Thread GitBox
hadoop-yetus commented on pull request #3075: URL: https://github.com/apache/hadoop/pull/3075#issuecomment-856644751 :broken_heart: **-1 overall** | Vote | Subsystem | Runtime | Logfile | Comment | |::|--:|:|::|:---:| | +0

[GitHub] [hadoop] aajisaka commented on a change in pull request #3065: HDFS-13671. Namenode deletes large dir slowly caused by FoldedTreeSet#removeAndGet

2021-06-08 Thread GitBox
aajisaka commented on a change in pull request #3065: URL: https://github.com/apache/hadoop/pull/3065#discussion_r647294150 ## File path: hadoop-hdfs-project/hadoop-hdfs/src/main/java/org/apache/hadoop/hdfs/server/datanode/fsdataset/impl/ReplicaMap.java ## @@ -238,9 +221,10

[GitHub] [hadoop] hadoop-yetus commented on pull request #3075: YARN-10805. Replace Guava Lists usage by Hadoop's own Lists in hadoop-yarn-project

2021-06-08 Thread GitBox
hadoop-yetus commented on pull request #3075: URL: https://github.com/apache/hadoop/pull/3075#issuecomment-856635662 :broken_heart: **-1 overall** | Vote | Subsystem | Runtime | Logfile | Comment | |::|--:|:|::|:---:| | +0

[GitHub] [hadoop] tomscut opened a new pull request #3084: HDFS-16057. Make sure the order for location in ENTERING_MAINTENANCE …

2021-06-08 Thread GitBox
tomscut opened a new pull request #3084: URL: https://github.com/apache/hadoop/pull/3084 JIRA: [HDFS-16057](https://issues.apache.org/jira/browse/HDFS-16057). We use compactor to sort locations in getBlockLocations(), and the expected result is: live -> stale -> entering_maintenance

[jira] [Updated] (HADOOP-17750) Fix asf license errors in newly added files by HADOOP-17727

2021-06-08 Thread Takanobu Asanuma (Jira)
[ https://issues.apache.org/jira/browse/HADOOP-17750?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Takanobu Asanuma updated HADOOP-17750: -- Labels: (was: pull-request-available) Status: Patch Available (was: Open) >

[jira] [Work logged] (HADOOP-17750) Fix asf license errors in newly added files by HADOOP-17727

2021-06-08 Thread ASF GitHub Bot (Jira)
[ https://issues.apache.org/jira/browse/HADOOP-17750?focusedWorklogId=608361=com.atlassian.jira.plugin.system.issuetabpanels:worklog-tabpanel#worklog-608361 ] ASF GitHub Bot logged work on HADOOP-17750: --- Author: ASF GitHub Bot

[jira] [Updated] (HADOOP-17750) Fix asf license errors in newly added files by HADOOP-17727

2021-06-08 Thread ASF GitHub Bot (Jira)
[ https://issues.apache.org/jira/browse/HADOOP-17750?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] ASF GitHub Bot updated HADOOP-17750: Labels: pull-request-available (was: ) > Fix asf license errors in newly added files by

[GitHub] [hadoop] tasanuma opened a new pull request #3083: HADOOP-17750. Fix asf license errors in newly added files by HADOOP-17727

2021-06-08 Thread GitBox
tasanuma opened a new pull request #3083: URL: https://github.com/apache/hadoop/pull/3083 JIRA: HADOOP-17750 -- This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use the URL above to go to the specific comment. For queries

[jira] [Updated] (HADOOP-17750) Fix asf license errors in newly added files by HADOOP-17727

2021-06-08 Thread Takanobu Asanuma (Jira)
[ https://issues.apache.org/jira/browse/HADOOP-17750?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Takanobu Asanuma updated HADOOP-17750: -- Issue Type: Bug (was: Wish) > Fix asf license errors in newly added files by

[jira] [Created] (HADOOP-17750) Fix asf license errors in newly added files by HADOOP-17727

2021-06-08 Thread Takanobu Asanuma (Jira)
Takanobu Asanuma created HADOOP-17750: - Summary: Fix asf license errors in newly added files by HADOOP-17727 Key: HADOOP-17750 URL: https://issues.apache.org/jira/browse/HADOOP-17750 Project:

[GitHub] [hadoop] smengcl commented on a change in pull request #2998: HDFS-16016. BPServiceActor to provide new thread to handle IBR

2021-06-08 Thread GitBox
smengcl commented on a change in pull request #2998: URL: https://github.com/apache/hadoop/pull/2998#discussion_r647197192 ## File path: hadoop-hdfs-project/hadoop-hdfs/src/main/java/org/apache/hadoop/hdfs/server/datanode/BPServiceActor.java ## @@ -1104,6 +1122,34 @@ private

[GitHub] [hadoop] mukund-thakur commented on a change in pull request #2971: MAPREDUCE-7341. Intermediate Manifest Committer

2021-06-08 Thread GitBox
mukund-thakur commented on a change in pull request #2971: URL: https://github.com/apache/hadoop/pull/2971#discussion_r646548513 ## File path:

[GitHub] [hadoop] tomscut commented on pull request #3021: HDFS-15814. Make some parameters configurable for DataNodeDiskMetrics…

2021-06-08 Thread GitBox
tomscut commented on pull request #3021: URL: https://github.com/apache/hadoop/pull/3021#issuecomment-856531233 > Thanks @tomscut Thanks @jojochuang for the merge. -- This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and

[GitHub] [hadoop] tomscut commented on pull request #3062: HDFS-16048. RBF: Print network topology on the router web

2021-06-08 Thread GitBox
tomscut commented on pull request #3062: URL: https://github.com/apache/hadoop/pull/3062#issuecomment-856530371 > Merged. Thanks for your contribution, @tomscut. > Thanks for your reviews, @goiri, @hemanthboyina and @aajisaka. Thanks @tasanuma for the merge. -- This is an

[GitHub] [hadoop] tasanuma commented on pull request #3062: HDFS-16048. RBF: Print network topology on the router web

2021-06-08 Thread GitBox
tasanuma commented on pull request #3062: URL: https://github.com/apache/hadoop/pull/3062#issuecomment-856519262 Merged. Thanks for your contribution, @tomscut. Thanks for your reviews, @goiri, @hemanthboyina and @aajisaka. -- This is an automated message from the Apache Git Service.

[GitHub] [hadoop] tasanuma merged pull request #3062: HDFS-16048. RBF: Print network topology on the router web

2021-06-08 Thread GitBox
tasanuma merged pull request #3062: URL: https://github.com/apache/hadoop/pull/3062 -- This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use the URL above to go to the specific comment. For queries about this service,

[GitHub] [hadoop] hadoop-yetus commented on pull request #3081: YARN-10809. Missing dependency causing NoClassDefFoundError in TestHBaseTimelineStorageUtils

2021-06-08 Thread GitBox
hadoop-yetus commented on pull request #3081: URL: https://github.com/apache/hadoop/pull/3081#issuecomment-856518648 :broken_heart: **-1 overall** | Vote | Subsystem | Runtime | Logfile | Comment | |::|--:|:|::|:---:| | +0

[GitHub] [hadoop] jojochuang commented on pull request #3021: HDFS-15814. Make some parameters configurable for DataNodeDiskMetrics…

2021-06-08 Thread GitBox
jojochuang commented on pull request #3021: URL: https://github.com/apache/hadoop/pull/3021#issuecomment-856516859 Thanks @tomscut -- This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use the URL above to go to the specific

[GitHub] [hadoop] jojochuang merged pull request #3021: HDFS-15814. Make some parameters configurable for DataNodeDiskMetrics…

2021-06-08 Thread GitBox
jojochuang merged pull request #3021: URL: https://github.com/apache/hadoop/pull/3021 -- This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use the URL above to go to the specific comment. For queries about this service,

[GitHub] [hadoop] GauthamBanasandra opened a new pull request #3082: [Do not commit] Exclude JSON files from RAT check

2021-06-08 Thread GitBox
GauthamBanasandra opened a new pull request #3082: URL: https://github.com/apache/hadoop/pull/3082 Need to exclude the JSON files from RAT check since we can't add ASF license header as a comment. -- This is an automated message from the Apache Git Service. To respond to the

[GitHub] [hadoop] tomscut commented on pull request #3062: HDFS-16048. RBF: Print network topology on the router web

2021-06-08 Thread GitBox
tomscut commented on pull request #3062: URL: https://github.com/apache/hadoop/pull/3062#issuecomment-856480193 Hi @goiri @tasanuma @aajisaka , could you please help merge the code? Thank you. -- This is an automated message from the Apache Git Service. To respond to the message, please

[jira] [Commented] (HADOOP-15327) Upgrade MR ShuffleHandler to use Netty4

2021-06-08 Thread Wei-Chiu Chuang (Jira)
[ https://issues.apache.org/jira/browse/HADOOP-15327?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17359058#comment-17359058 ] Wei-Chiu Chuang commented on HADOOP-15327: -- Thanks... 1. Change category #5, closing channels