[jira] [Work logged] (HADOOP-17715) ABFS: Append blob tests with non HNS accounts fail

2021-06-08 Thread ASF GitHub Bot (Jira)
[ https://issues.apache.org/jira/browse/HADOOP-17715?focusedWorklogId=608958&page=com.atlassian.jira.plugin.system.issuetabpanels:worklog-tabpanel#worklog-608958 ] ASF GitHub Bot logged work on HADOOP-17715: --- Author: ASF GitHub B

[GitHub] [hadoop] surendralilhore commented on pull request #3028: HADOOP-17715 ABFS: Append blob tests with non HNS accounts fail

2021-06-08 Thread GitBox
surendralilhore commented on pull request #3028: URL: https://github.com/apache/hadoop/pull/3028#issuecomment-857429622 Committed to trunk, please raise PR for 3.2 and 3.3 -- This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and u

[jira] [Updated] (HADOOP-17750) Fix asf license errors in newly added files by HADOOP-17727

2021-06-08 Thread Takanobu Asanuma (Jira)
[ https://issues.apache.org/jira/browse/HADOOP-17750?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Takanobu Asanuma updated HADOOP-17750: -- Fix Version/s: 3.4.0 Resolution: Fixed Status: Resolved (was: Patch

[jira] [Work logged] (HADOOP-17750) Fix asf license errors in newly added files by HADOOP-17727

2021-06-08 Thread ASF GitHub Bot (Jira)
[ https://issues.apache.org/jira/browse/HADOOP-17750?focusedWorklogId=608954&page=com.atlassian.jira.plugin.system.issuetabpanels:worklog-tabpanel#worklog-608954 ] ASF GitHub Bot logged work on HADOOP-17750: --- Author: ASF GitHub B

[GitHub] [hadoop] tasanuma merged pull request #3083: HADOOP-17750. Fix asf license errors in newly added files by HADOOP-17727

2021-06-08 Thread GitBox
tasanuma merged pull request #3083: URL: https://github.com/apache/hadoop/pull/3083 -- This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use the URL above to go to the specific comment. For queries about this service, please

[jira] [Work logged] (HADOOP-17750) Fix asf license errors in newly added files by HADOOP-17727

2021-06-08 Thread ASF GitHub Bot (Jira)
[ https://issues.apache.org/jira/browse/HADOOP-17750?focusedWorklogId=608952&page=com.atlassian.jira.plugin.system.issuetabpanels:worklog-tabpanel#worklog-608952 ] ASF GitHub Bot logged work on HADOOP-17750: --- Author: ASF GitHub B

[jira] [Updated] (HADOOP-17750) Fix asf license errors in newly added files by HADOOP-17727

2021-06-08 Thread ASF GitHub Bot (Jira)
[ https://issues.apache.org/jira/browse/HADOOP-17750?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] ASF GitHub Bot updated HADOOP-17750: Labels: pull-request-available (was: ) > Fix asf license errors in newly added files by

[GitHub] [hadoop] tasanuma commented on pull request #3083: HADOOP-17750. Fix asf license errors in newly added files by HADOOP-17727

2021-06-08 Thread GitBox
tasanuma commented on pull request #3083: URL: https://github.com/apache/hadoop/pull/3083#issuecomment-857420711 Thanks for reviewing it, all. Unfortunately, CI had run over 20h and failed due to timeout. I confirmed `mvn clean apache-rat:check` succeeds with this PR. I will merge it.

[GitHub] [hadoop] hadoop-yetus commented on pull request #3084: HDFS-16057. Make sure the order for location in ENTERING_MAINTENANCE …

2021-06-08 Thread GitBox
hadoop-yetus commented on pull request #3084: URL: https://github.com/apache/hadoop/pull/3084#issuecomment-857419235 :broken_heart: **-1 overall** | Vote | Subsystem | Runtime | Logfile | Comment | |::|--:|:|::|:---:| | +0 :ok

[GitHub] [hadoop] tasanuma merged pull request #3075: YARN-10805. Replace Guava Lists usage by Hadoop's own Lists in hadoop-yarn-project

2021-06-08 Thread GitBox
tasanuma merged pull request #3075: URL: https://github.com/apache/hadoop/pull/3075 -- This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use the URL above to go to the specific comment. For queries about this service, please

[GitHub] [hadoop] tasanuma commented on pull request #3075: YARN-10805. Replace Guava Lists usage by Hadoop's own Lists in hadoop-yarn-project

2021-06-08 Thread GitBox
tasanuma commented on pull request #3075: URL: https://github.com/apache/hadoop/pull/3075#issuecomment-857412757 Thanks for your contribution, @virajjasani. -- This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use the URL abov

[GitHub] [hadoop] tasanuma commented on pull request #3075: YARN-10805. Replace Guava Lists usage by Hadoop's own Lists in hadoop-yarn-project

2021-06-08 Thread GitBox
tasanuma commented on pull request #3075: URL: https://github.com/apache/hadoop/pull/3075#issuecomment-857412387 The failed tests passed in my local environment. -- This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use the URL

[GitHub] [hadoop] tasanuma commented on pull request #3073: HDFS-16054. Replace Guava Lists usage by Hadoop's own Lists in hadoop-hdfs-project

2021-06-08 Thread GitBox
tasanuma commented on pull request #3073: URL: https://github.com/apache/hadoop/pull/3073#issuecomment-857410973 Merged. Thanks again, @virajjasani. -- This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use the URL above to go

[GitHub] [hadoop] tasanuma merged pull request #3073: HDFS-16054. Replace Guava Lists usage by Hadoop's own Lists in hadoop-hdfs-project

2021-06-08 Thread GitBox
tasanuma merged pull request #3073: URL: https://github.com/apache/hadoop/pull/3073 -- This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use the URL above to go to the specific comment. For queries about this service, please

[GitHub] [hadoop] tasanuma commented on pull request #3073: HDFS-16054. Replace Guava Lists usage by Hadoop's own Lists in hadoop-hdfs-project

2021-06-08 Thread GitBox
tasanuma commented on pull request #3073: URL: https://github.com/apache/hadoop/pull/3073#issuecomment-857410626 The failed tests succeeded in my local environment. -- This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use the

[jira] [Updated] (HADOOP-17752) Remove lock contention in REGISTRY of Configuration

2021-06-08 Thread Xuesen Liang (Jira)
[ https://issues.apache.org/jira/browse/HADOOP-17752?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Xuesen Liang updated HADOOP-17752: -- Parent: HADOOP-17751 Issue Type: Sub-task (was: Improvement) > Remove lock contentio

[jira] [Work logged] (HADOOP-17596) ABFS: Change default Readahead Queue Depth from num(processors) to const

2021-06-08 Thread ASF GitHub Bot (Jira)
[ https://issues.apache.org/jira/browse/HADOOP-17596?focusedWorklogId=608930&page=com.atlassian.jira.plugin.system.issuetabpanels:worklog-tabpanel#worklog-608930 ] ASF GitHub Bot logged work on HADOOP-17596: --- Author: ASF GitHub B

[GitHub] [hadoop] sumangala-patki commented on pull request #2795: HADOOP-17596. ABFS: Change default Readahead Queue Depth from num(processors) to const

2021-06-08 Thread GitBox
sumangala-patki commented on pull request #2795: URL: https://github.com/apache/hadoop/pull/2795#issuecomment-857390775 @surendralilhore thanks for updating the JIRA @steveloughran yes, but planning to ensure a gap (maybe a week or two) between check-in to trunk and backport of PRs. Will

[jira] [Updated] (HADOOP-17715) ABFS: Append blob tests with non HNS accounts fail

2021-06-08 Thread Surendra Singh Lilhore (Jira)
[ https://issues.apache.org/jira/browse/HADOOP-17715?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Surendra Singh Lilhore updated HADOOP-17715: Fix Version/s: 3.4.0 > ABFS: Append blob tests with non HNS accounts fail

[jira] [Work logged] (HADOOP-17715) ABFS: Append blob tests with non HNS accounts fail

2021-06-08 Thread ASF GitHub Bot (Jira)
[ https://issues.apache.org/jira/browse/HADOOP-17715?focusedWorklogId=608927&page=com.atlassian.jira.plugin.system.issuetabpanels:worklog-tabpanel#worklog-608927 ] ASF GitHub Bot logged work on HADOOP-17715: --- Author: ASF GitHub B

[GitHub] [hadoop] surendralilhore merged pull request #3028: HADOOP-17715 ABFS: Append blob tests with non HNS accounts fail

2021-06-08 Thread GitBox
surendralilhore merged pull request #3028: URL: https://github.com/apache/hadoop/pull/3028 -- This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use the URL above to go to the specific comment. For queries about this service,

[jira] [Work logged] (HADOOP-17715) ABFS: Append blob tests with non HNS accounts fail

2021-06-08 Thread ASF GitHub Bot (Jira)
[ https://issues.apache.org/jira/browse/HADOOP-17715?focusedWorklogId=608926&page=com.atlassian.jira.plugin.system.issuetabpanels:worklog-tabpanel#worklog-608926 ] ASF GitHub Bot logged work on HADOOP-17715: --- Author: ASF GitHub B

[GitHub] [hadoop] surendralilhore commented on pull request #3028: HADOOP-17715 ABFS: Append blob tests with non HNS accounts fail

2021-06-08 Thread GitBox
surendralilhore commented on pull request #3028: URL: https://github.com/apache/hadoop/pull/3028#issuecomment-857384805 +1 -- This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use the URL above to go to the specific comment.

[jira] [Work logged] (HADOOP-17596) ABFS: Change default Readahead Queue Depth from num(processors) to const

2021-06-08 Thread ASF GitHub Bot (Jira)
[ https://issues.apache.org/jira/browse/HADOOP-17596?focusedWorklogId=608923&page=com.atlassian.jira.plugin.system.issuetabpanels:worklog-tabpanel#worklog-608923 ] ASF GitHub Bot logged work on HADOOP-17596: --- Author: ASF GitHub B

[GitHub] [hadoop] surendralilhore commented on pull request #2795: HADOOP-17596. ABFS: Change default Readahead Queue Depth from num(processors) to const

2021-06-08 Thread GitBox
surendralilhore commented on pull request #2795: URL: https://github.com/apache/hadoop/pull/2795#issuecomment-857378838 @steveloughran , I updated the Jira. > Are there any plans to backport to branch-3.3? A retest of the cherrypick is all which should be needed Yes, @sum

[jira] [Updated] (HADOOP-17596) ABFS: Change default Readahead Queue Depth from num(processors) to const

2021-06-08 Thread Surendra Singh Lilhore (Jira)
[ https://issues.apache.org/jira/browse/HADOOP-17596?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Surendra Singh Lilhore updated HADOOP-17596: Fix Version/s: 3.4.0 > ABFS: Change default Readahead Queue Depth from nu

[jira] [Updated] (HADOOP-17752) Remove lock contention in REGISTRY of Configuration

2021-06-08 Thread ASF GitHub Bot (Jira)
[ https://issues.apache.org/jira/browse/HADOOP-17752?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] ASF GitHub Bot updated HADOOP-17752: Labels: pull-request-available (was: ) > Remove lock contention in REGISTRY of Configura

[jira] [Work logged] (HADOOP-17752) Remove lock contention in REGISTRY of Configuration

2021-06-08 Thread ASF GitHub Bot (Jira)
[ https://issues.apache.org/jira/browse/HADOOP-17752?focusedWorklogId=608913&page=com.atlassian.jira.plugin.system.issuetabpanels:worklog-tabpanel#worklog-608913 ] ASF GitHub Bot logged work on HADOOP-17752: --- Author: ASF GitHub B

[GitHub] [hadoop] liangxs opened a new pull request #3085: HADOOP-17752. Remove lock contention in REGISTRY of Configuration

2021-06-08 Thread GitBox
liangxs opened a new pull request #3085: URL: https://github.com/apache/hadoop/pull/3085 JIRA: [HADOOP-17752](https://issues.apache.org/jira/browse/HADOOP-17752) -- This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use the

[GitHub] [hadoop] aajisaka commented on a change in pull request #3065: HDFS-13671. Namenode deletes large dir slowly caused by FoldedTreeSet#removeAndGet

2021-06-08 Thread GitBox
aajisaka commented on a change in pull request #3065: URL: https://github.com/apache/hadoop/pull/3065#discussion_r647951023 ## File path: hadoop-hdfs-project/hadoop-hdfs/src/main/java/org/apache/hadoop/hdfs/server/namenode/FSNamesystem.java ## @@ -1996,7 +1996,12 @@ private vo

[GitHub] [hadoop] hadoop-yetus commented on pull request #3075: YARN-10805. Replace Guava Lists usage by Hadoop's own Lists in hadoop-yarn-project

2021-06-08 Thread GitBox
hadoop-yetus commented on pull request #3075: URL: https://github.com/apache/hadoop/pull/3075#issuecomment-857346126 :broken_heart: **-1 overall** | Vote | Subsystem | Runtime | Logfile | Comment | |::|--:|:|::|:---:| | +0 :ok

[GitHub] [hadoop] hadoop-yetus commented on pull request #3078: HDFS-16055. Quota is not preserved in snapshot INode

2021-06-08 Thread GitBox
hadoop-yetus commented on pull request #3078: URL: https://github.com/apache/hadoop/pull/3078#issuecomment-857345327 :broken_heart: **-1 overall** | Vote | Subsystem | Runtime | Logfile | Comment | |::|--:|:|::|:---:| | +0 :ok

[GitHub] [hadoop] hadoop-yetus commented on pull request #3073: HDFS-16054. Replace Guava Lists usage by Hadoop's own Lists in hadoop-hdfs-project

2021-06-08 Thread GitBox
hadoop-yetus commented on pull request #3073: URL: https://github.com/apache/hadoop/pull/3073#issuecomment-857329518 :broken_heart: **-1 overall** | Vote | Subsystem | Runtime | Logfile | Comment | |::|--:|:|::|:---:| | +0 :ok

[GitHub] [hadoop] hadoop-yetus commented on pull request #3073: HDFS-16054. Replace Guava Lists usage by Hadoop's own Lists in hadoop-hdfs-project

2021-06-08 Thread GitBox
hadoop-yetus commented on pull request #3073: URL: https://github.com/apache/hadoop/pull/3073#issuecomment-857328284 :broken_heart: **-1 overall** | Vote | Subsystem | Runtime | Logfile | Comment | |::|--:|:|::|:---:| | +0 :ok

[jira] [Created] (HADOOP-17752) Remove lock contention in REGISTRY of Configuration

2021-06-08 Thread Xuesen Liang (Jira)
Xuesen Liang created HADOOP-17752: - Summary: Remove lock contention in REGISTRY of Configuration Key: HADOOP-17752 URL: https://issues.apache.org/jira/browse/HADOOP-17752 Project: Hadoop Common

[GitHub] [hadoop] jojochuang merged pull request #3081: YARN-10809. Missing dependency causing NoClassDefFoundError in TestHBaseTimelineStorageUtils

2021-06-08 Thread GitBox
jojochuang merged pull request #3081: URL: https://github.com/apache/hadoop/pull/3081 -- This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use the URL above to go to the specific comment. For queries about this service, plea

[GitHub] [hadoop] jojochuang merged pull request #3056: HDFS-15916. Addendum. DistCp: Backward compatibility: Distcp fails from Hadoop 3 to Hadoop 2 for snapshotdiff.

2021-06-08 Thread GitBox
jojochuang merged pull request #3056: URL: https://github.com/apache/hadoop/pull/3056 -- This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use the URL above to go to the specific comment. For queries about this service, plea

[GitHub] [hadoop] jojochuang commented on pull request #3054: HDFS-15916. DistCp: Backward compatibility: Distcp fails from Hadoop 3 to Hadoop 2 for snapshotdiff. (#2863). Contributed by Ayush Saxena.

2021-06-08 Thread GitBox
jojochuang commented on pull request #3054: URL: https://github.com/apache/hadoop/pull/3054#issuecomment-857323813 Merging it. No test failures. -- This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use the URL above to go to t

[GitHub] [hadoop] tasanuma commented on pull request #3075: YARN-10805. Replace Guava Lists usage by Hadoop's own Lists in hadoop-yarn-project

2021-06-08 Thread GitBox
tasanuma commented on pull request #3075: URL: https://github.com/apache/hadoop/pull/3075#issuecomment-857323736 +1, pending Jenkins. -- This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use the URL above to go to the specific

[GitHub] [hadoop] jojochuang merged pull request #3054: HDFS-15916. DistCp: Backward compatibility: Distcp fails from Hadoop 3 to Hadoop 2 for snapshotdiff. (#2863). Contributed by Ayush Saxena.

2021-06-08 Thread GitBox
jojochuang merged pull request #3054: URL: https://github.com/apache/hadoop/pull/3054 -- This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use the URL above to go to the specific comment. For queries about this service, plea

[GitHub] [hadoop] tomscut commented on pull request #3084: HDFS-16057. Make sure the order for location in ENTERING_MAINTENANCE …

2021-06-08 Thread GitBox
tomscut commented on pull request #3084: URL: https://github.com/apache/hadoop/pull/3084#issuecomment-857320247 > The fix makes sense to me. > > It would be great if the test is written as a unit test for DatanodeManager rather than a cluster test. Thank @jojochuang for your r

[jira] [Updated] (HADOOP-17751) Reduce lock contention in org.apache.hadoop.conf.Configuration

2021-06-08 Thread Xuesen Liang (Jira)
[ https://issues.apache.org/jira/browse/HADOOP-17751?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Xuesen Liang updated HADOOP-17751: -- Labels: Umbrella (was: ) > Reduce lock contention in org.apache.hadoop.conf.Configuration >

[jira] [Created] (HADOOP-17751) Reduce lock contention in org.apache.hadoop.conf.Configuration

2021-06-08 Thread Xuesen Liang (Jira)
Xuesen Liang created HADOOP-17751: - Summary: Reduce lock contention in org.apache.hadoop.conf.Configuration Key: HADOOP-17751 URL: https://issues.apache.org/jira/browse/HADOOP-17751 Project: Hadoop Co

[GitHub] [hadoop] tomscut commented on pull request #3084: HDFS-16057. Make sure the order for location in ENTERING_MAINTENANCE …

2021-06-08 Thread GitBox
tomscut commented on pull request #3084: URL: https://github.com/apache/hadoop/pull/3084#issuecomment-857305808 Hi @zhe-thoughts @rakeshadr @umbrant @yzhangal , could you please review the code? Thanks you. -- This is an automated message from the Apache Git Service. To respond to the m

[GitHub] [hadoop] ferhui commented on a change in pull request #3065: HDFS-13671. Namenode deletes large dir slowly caused by FoldedTreeSet#removeAndGet

2021-06-08 Thread GitBox
ferhui commented on a change in pull request #3065: URL: https://github.com/apache/hadoop/pull/3065#discussion_r647902665 ## File path: hadoop-hdfs-project/hadoop-hdfs/src/main/java/org/apache/hadoop/hdfs/server/namenode/FSNamesystem.java ## @@ -1996,7 +1996,12 @@ private void

[GitHub] [hadoop] hadoop-yetus commented on pull request #3082: [Do not commit] Exclude JSON files from RAT check

2021-06-08 Thread GitBox
hadoop-yetus commented on pull request #3082: URL: https://github.com/apache/hadoop/pull/3082#issuecomment-857292313 :broken_heart: **-1 overall** | Vote | Subsystem | Runtime | Logfile | Comment | |::|--:|:|::|:---:| | +0 :ok

[GitHub] [hadoop] hadoop-yetus commented on pull request #2998: HDFS-16016. BPServiceActor to provide new thread to handle IBR

2021-06-08 Thread GitBox
hadoop-yetus commented on pull request #2998: URL: https://github.com/apache/hadoop/pull/2998#issuecomment-857230783 :broken_heart: **-1 overall** | Vote | Subsystem | Runtime | Logfile | Comment | |::|--:|:|::|:---:| | +0 :ok

[GitHub] [hadoop] hadoop-yetus commented on pull request #2998: HDFS-16016. BPServiceActor to provide new thread to handle IBR

2021-06-08 Thread GitBox
hadoop-yetus commented on pull request #2998: URL: https://github.com/apache/hadoop/pull/2998#issuecomment-857228763 :broken_heart: **-1 overall** | Vote | Subsystem | Runtime | Logfile | Comment | |::|--:|:|::|:---:| | +0 :ok

[GitHub] [hadoop] hadoop-yetus commented on pull request #3075: YARN-10805. Replace Guava Lists usage by Hadoop's own Lists in hadoop-yarn-project

2021-06-08 Thread GitBox
hadoop-yetus commented on pull request #3075: URL: https://github.com/apache/hadoop/pull/3075#issuecomment-857221708 :broken_heart: **-1 overall** | Vote | Subsystem | Runtime | Logfile | Comment | |::|--:|:|::|:---:| | +0 :ok

[jira] [Work logged] (HADOOP-17745) ADLS client can throw an IOException when it should throw an InterruptedIOException

2021-06-08 Thread ASF GitHub Bot (Jira)
[ https://issues.apache.org/jira/browse/HADOOP-17745?focusedWorklogId=608761&page=com.atlassian.jira.plugin.system.issuetabpanels:worklog-tabpanel#worklog-608761 ] ASF GitHub Bot logged work on HADOOP-17745: --- Author: ASF GitHub B

[GitHub] [hadoop] steveloughran commented on a change in pull request #3076: HADOOP-17745. Wrap IOException with InterruptedException cause properly

2021-06-08 Thread GitBox
steveloughran commented on a change in pull request #3076: URL: https://github.com/apache/hadoop/pull/3076#discussion_r647799533 ## File path: hadoop-common-project/hadoop-common/src/main/java/org/apache/hadoop/io/IOUtils.java ## @@ -482,6 +482,12 @@ public static IOException

[jira] [Work logged] (HADOOP-17745) ADLS client can throw an IOException when it should throw an InterruptedIOException

2021-06-08 Thread ASF GitHub Bot (Jira)
[ https://issues.apache.org/jira/browse/HADOOP-17745?focusedWorklogId=608757&page=com.atlassian.jira.plugin.system.issuetabpanels:worklog-tabpanel#worklog-608757 ] ASF GitHub Bot logged work on HADOOP-17745: --- Author: ASF GitHub B

[GitHub] [hadoop] steveloughran commented on pull request #3076: HADOOP-17745. Wrap IOException with InterruptedException cause properly

2021-06-08 Thread GitBox
steveloughran commented on pull request #3076: URL: https://github.com/apache/hadoop/pull/3076#issuecomment-857157506 aah, you need to look at the [Testing Azure](https://github.com/apache/hadoop/blob/trunk/hadoop-tools/hadoop-azure/src/site/markdown/testing_azure.md) doc. I can see the co

[jira] [Work logged] (HADOOP-17725) Improve error message for token providers in ABFS

2021-06-08 Thread ASF GitHub Bot (Jira)
[ https://issues.apache.org/jira/browse/HADOOP-17725?focusedWorklogId=608756&page=com.atlassian.jira.plugin.system.issuetabpanels:worklog-tabpanel#worklog-608756 ] ASF GitHub Bot logged work on HADOOP-17725: --- Author: ASF GitHub B

[GitHub] [hadoop] steveloughran commented on pull request #3041: HADOOP-17725. Improve error message for token providers in ABFS

2021-06-08 Thread GitBox
steveloughran commented on pull request #3041: URL: https://github.com/apache/hadoop/pull/3041#issuecomment-857155825 ..and its done. Thank you everyone for your work. -- This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use t

[jira] [Resolved] (HADOOP-17631) Configuration ${env.VAR:-FALLBACK} should eval FALLBACK when restrictSystemProps=true

2021-06-08 Thread Steve Loughran (Jira)
[ https://issues.apache.org/jira/browse/HADOOP-17631?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Steve Loughran resolved HADOOP-17631. - Fix Version/s: 3.3.2 Resolution: Fixed > Configuration ${env.VAR:-FALLBACK} shou

[jira] [Resolved] (HADOOP-17725) Improve error message for token providers in ABFS

2021-06-08 Thread Steve Loughran (Jira)
[ https://issues.apache.org/jira/browse/HADOOP-17725?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Steve Loughran resolved HADOOP-17725. - Fix Version/s: 3.3.2 Resolution: Fixed > Improve error message for token provide

[jira] [Work logged] (HADOOP-17725) Improve error message for token providers in ABFS

2021-06-08 Thread ASF GitHub Bot (Jira)
[ https://issues.apache.org/jira/browse/HADOOP-17725?focusedWorklogId=608750&page=com.atlassian.jira.plugin.system.issuetabpanels:worklog-tabpanel#worklog-608750 ] ASF GitHub Bot logged work on HADOOP-17725: --- Author: ASF GitHub B

[jira] [Work logged] (HADOOP-17725) Improve error message for token providers in ABFS

2021-06-08 Thread ASF GitHub Bot (Jira)
[ https://issues.apache.org/jira/browse/HADOOP-17725?focusedWorklogId=608749&page=com.atlassian.jira.plugin.system.issuetabpanels:worklog-tabpanel#worklog-608749 ] ASF GitHub Bot logged work on HADOOP-17725: --- Author: ASF GitHub B

[GitHub] [hadoop] steveloughran commented on pull request #3041: HADOOP-17725. Improve error message for token providers in ABFS

2021-06-08 Thread GitBox
steveloughran commented on pull request #3041: URL: https://github.com/apache/hadoop/pull/3041#issuecomment-857145495 merged into trunk; will cherrypick to branch-3.3 with a recompile to verify all is good. leaving JIRA open until then -- This is an automated message from the Apache Git

[GitHub] [hadoop] steveloughran merged pull request #3041: HADOOP-17725. Improve error message for token providers in ABFS

2021-06-08 Thread GitBox
steveloughran merged pull request #3041: URL: https://github.com/apache/hadoop/pull/3041 -- This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use the URL above to go to the specific comment. For queries about this service, p

[GitHub] [hadoop] steveloughran commented on a change in pull request #2971: MAPREDUCE-7341. Intermediate Manifest Committer

2021-06-08 Thread GitBox
steveloughran commented on a change in pull request #2971: URL: https://github.com/apache/hadoop/pull/2971#discussion_r647789479 ## File path: hadoop-mapreduce-project/hadoop-mapreduce-client/hadoop-mapreduce-client-core/src/main/java/org/apache/hadoop/mapreduce/lib/output/committer/m

[GitHub] [hadoop] hadoop-yetus removed a comment on pull request #2971: MAPREDUCE-7341. Intermediate Manifest Committer

2021-06-08 Thread GitBox
hadoop-yetus removed a comment on pull request #2971: URL: https://github.com/apache/hadoop/pull/2971#issuecomment-849569296 -- This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use the URL above to go to the specific comment.

[GitHub] [hadoop] steveloughran commented on a change in pull request #2971: MAPREDUCE-7341. Intermediate Manifest Committer

2021-06-08 Thread GitBox
steveloughran commented on a change in pull request #2971: URL: https://github.com/apache/hadoop/pull/2971#discussion_r647788743 ## File path: hadoop-mapreduce-project/hadoop-mapreduce-client/hadoop-mapreduce-client-core/src/main/java/org/apache/hadoop/mapreduce/lib/output/committer/m

[jira] [Work logged] (HADOOP-17631) Configuration ${env.VAR:-FALLBACK} should eval FALLBACK when restrictSystemProps=true

2021-06-08 Thread ASF GitHub Bot (Jira)
[ https://issues.apache.org/jira/browse/HADOOP-17631?focusedWorklogId=608745&page=com.atlassian.jira.plugin.system.issuetabpanels:worklog-tabpanel#worklog-608745 ] ASF GitHub Bot logged work on HADOOP-17631: --- Author: ASF GitHub B

[GitHub] [hadoop] steveloughran merged pull request #2977: HADOOP-17631. Configuration ${env.VAR:-FALLBACK} to eval FALLBACK when restrictSystemProps=true

2021-06-08 Thread GitBox
steveloughran merged pull request #2977: URL: https://github.com/apache/hadoop/pull/2977 -- This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use the URL above to go to the specific comment. For queries about this service, p

[jira] [Commented] (HADOOP-16878) FileUtil.copy() to throw IOException if the source and destination are the same

2021-06-08 Thread Steve Loughran (Jira)
[ https://issues.apache.org/jira/browse/HADOOP-16878?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=17359564#comment-17359564 ] Steve Loughran commented on HADOOP-16878: - ok, but if I do a command on the CLI

[jira] [Commented] (HADOOP-11461) Namenode stdout log contains IllegalAccessException

2021-06-08 Thread Steve Loughran (Jira)
[ https://issues.apache.org/jira/browse/HADOOP-11461?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=17359563#comment-17359563 ] Steve Loughran commented on HADOOP-11461: - bq. Should I be worried? no, though

[jira] [Work logged] (HADOOP-17596) ABFS: Change default Readahead Queue Depth from num(processors) to const

2021-06-08 Thread ASF GitHub Bot (Jira)
[ https://issues.apache.org/jira/browse/HADOOP-17596?focusedWorklogId=608720&page=com.atlassian.jira.plugin.system.issuetabpanels:worklog-tabpanel#worklog-608720 ] ASF GitHub Bot logged work on HADOOP-17596: --- Author: ASF GitHub B

[GitHub] [hadoop] steveloughran commented on pull request #2795: HADOOP-17596. ABFS: Change default Readahead Queue Depth from num(processors) to const

2021-06-08 Thread GitBox
steveloughran commented on pull request #2795: URL: https://github.com/apache/hadoop/pull/2795#issuecomment-857108374 1. Now this has been merged, the JIRA MUST be updated with fix version 2. Are there any plans to backport to branch-3.3? A retest of the cherrypick is all which should be

[GitHub] [hadoop] smengcl commented on pull request #3078: HDFS-16055. Quota is not preserved in snapshot INode

2021-06-08 Thread GitBox
smengcl commented on pull request #3078: URL: https://github.com/apache/hadoop/pull/3078#issuecomment-857033639 The cause of the UT failure `testRenameDirAndDeleteSnapshot_1` is that features in the stream are returned as **references**. While this is fine for AclFeature or XAttrFeature. A

[GitHub] [hadoop] aajisaka commented on pull request #3082: [Do not commit] Exclude JSON files from RAT check

2021-06-08 Thread GitBox
aajisaka commented on pull request #3082: URL: https://github.com/apache/hadoop/pull/3082#issuecomment-856968401 It is duplicate of HADOOP-17750 (#3083). Thanks. -- This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use the URL

[GitHub] [hadoop] hadoop-yetus commented on pull request #3073: HDFS-16054. Replace Guava Lists usage by Hadoop's own Lists in hadoop-hdfs-project

2021-06-08 Thread GitBox
hadoop-yetus commented on pull request #3073: URL: https://github.com/apache/hadoop/pull/3073#issuecomment-856948626 :broken_heart: **-1 overall** | Vote | Subsystem | Runtime | Logfile | Comment | |::|--:|:|::|:---:| | +0 :ok

[GitHub] [hadoop] hadoop-yetus commented on pull request #3084: HDFS-16057. Make sure the order for location in ENTERING_MAINTENANCE …

2021-06-08 Thread GitBox
hadoop-yetus commented on pull request #3084: URL: https://github.com/apache/hadoop/pull/3084#issuecomment-856924189 :broken_heart: **-1 overall** | Vote | Subsystem | Runtime | Logfile | Comment | |::|--:|:|::|:---:| | +0 :ok

[GitHub] [hadoop] kihwal merged pull request #3058: HDFS-16042. DatanodeAdminMonitor scan should be delay based

2021-06-08 Thread GitBox
kihwal merged pull request #3058: URL: https://github.com/apache/hadoop/pull/3058 -- This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use the URL above to go to the specific comment. For queries about this service, please c

[GitHub] [hadoop] amahussein commented on pull request #3058: HDFS-16042. DatanodeAdminMonitor scan should be delay based

2021-06-08 Thread GitBox
amahussein commented on pull request #3058: URL: https://github.com/apache/hadoop/pull/3058#issuecomment-856894824 @kihwal and @jbrennan333 I have tested the three unit tests `TestDecommissioningStatus`, `TestDFSShell`, `TestDecommissioningStatusWithBackoffMonitor` in a loop for coupl

[GitHub] [hadoop] aajisaka commented on a change in pull request #3065: HDFS-13671. Namenode deletes large dir slowly caused by FoldedTreeSet#removeAndGet

2021-06-08 Thread GitBox
aajisaka commented on a change in pull request #3065: URL: https://github.com/apache/hadoop/pull/3065#discussion_r647396463 ## File path: hadoop-hdfs-project/hadoop-hdfs/src/main/java/org/apache/hadoop/hdfs/server/namenode/FSNamesystem.java ## @@ -1996,7 +1996,12 @@ private vo

[GitHub] [hadoop] aajisaka commented on a change in pull request #3065: HDFS-13671. Namenode deletes large dir slowly caused by FoldedTreeSet#removeAndGet

2021-06-08 Thread GitBox
aajisaka commented on a change in pull request #3065: URL: https://github.com/apache/hadoop/pull/3065#discussion_r647396463 ## File path: hadoop-hdfs-project/hadoop-hdfs/src/main/java/org/apache/hadoop/hdfs/server/namenode/FSNamesystem.java ## @@ -1996,7 +1996,12 @@ private vo

[GitHub] [hadoop] aajisaka commented on a change in pull request #3065: HDFS-13671. Namenode deletes large dir slowly caused by FoldedTreeSet#removeAndGet

2021-06-08 Thread GitBox
aajisaka commented on a change in pull request #3065: URL: https://github.com/apache/hadoop/pull/3065#discussion_r647396463 ## File path: hadoop-hdfs-project/hadoop-hdfs/src/main/java/org/apache/hadoop/hdfs/server/namenode/FSNamesystem.java ## @@ -1996,7 +1996,12 @@ private vo

[GitHub] [hadoop] ferhui commented on a change in pull request #3065: HDFS-13671. Namenode deletes large dir slowly caused by FoldedTreeSet#removeAndGet

2021-06-08 Thread GitBox
ferhui commented on a change in pull request #3065: URL: https://github.com/apache/hadoop/pull/3065#discussion_r647387834 ## File path: hadoop-hdfs-project/hadoop-hdfs/src/main/java/org/apache/hadoop/hdfs/server/namenode/FSNamesystem.java ## @@ -1996,7 +1996,12 @@ private void

[GitHub] [hadoop] aajisaka closed pull request #3059: #HDFS-13729 Removed extra space

2021-06-08 Thread GitBox
aajisaka closed pull request #3059: URL: https://github.com/apache/hadoop/pull/3059 -- This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use the URL above to go to the specific comment. For queries about this service, please

[GitHub] [hadoop] aajisaka commented on pull request #3068: YARN-10803. [JDK 11] TestRMFailoverProxyProvider and TestNoHaRMFailoverProxyProvier fails by ClassCastException

2021-06-08 Thread GitBox
aajisaka commented on pull request #3068: URL: https://github.com/apache/hadoop/pull/3068#issuecomment-856713356 Thank you @bogthe! @tasanuma Would you review this? -- This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and u

[GitHub] [hadoop] aajisaka commented on a change in pull request #3065: HDFS-13671. Namenode deletes large dir slowly caused by FoldedTreeSet#removeAndGet

2021-06-08 Thread GitBox
aajisaka commented on a change in pull request #3065: URL: https://github.com/apache/hadoop/pull/3065#discussion_r647376745 ## File path: hadoop-hdfs-project/hadoop-hdfs/src/main/java/org/apache/hadoop/hdfs/server/namenode/FSNamesystem.java ## @@ -1996,7 +1996,12 @@ private vo

[GitHub] [hadoop] aajisaka commented on a change in pull request #3065: HDFS-13671. Namenode deletes large dir slowly caused by FoldedTreeSet#removeAndGet

2021-06-08 Thread GitBox
aajisaka commented on a change in pull request #3065: URL: https://github.com/apache/hadoop/pull/3065#discussion_r647376745 ## File path: hadoop-hdfs-project/hadoop-hdfs/src/main/java/org/apache/hadoop/hdfs/server/namenode/FSNamesystem.java ## @@ -1996,7 +1996,12 @@ private vo

[GitHub] [hadoop] hadoop-yetus commented on pull request #3013: TestDFSMkdir fails with multiple partitions

2021-06-08 Thread GitBox
hadoop-yetus commented on pull request #3013: URL: https://github.com/apache/hadoop/pull/3013#issuecomment-856704328 :broken_heart: **-1 overall** | Vote | Subsystem | Runtime | Logfile | Comment | |::|--:|:|::|:---:| | +0 :ok

[GitHub] [hadoop] aajisaka commented on a change in pull request #3065: HDFS-13671. Namenode deletes large dir slowly caused by FoldedTreeSet#removeAndGet

2021-06-08 Thread GitBox
aajisaka commented on a change in pull request #3065: URL: https://github.com/apache/hadoop/pull/3065#discussion_r647363773 ## File path: hadoop-hdfs-project/hadoop-hdfs/src/main/java/org/apache/hadoop/hdfs/server/blockmanagement/BlockManager.java ## @@ -3111,106 +3042,127 @@

[jira] [Work logged] (HADOOP-17749) Remove lock contention in SelectorPool of SocketIOWithTimeout

2021-06-08 Thread ASF GitHub Bot (Jira)
[ https://issues.apache.org/jira/browse/HADOOP-17749?focusedWorklogId=608418&page=com.atlassian.jira.plugin.system.issuetabpanels:worklog-tabpanel#worklog-608418 ] ASF GitHub Bot logged work on HADOOP-17749: --- Author: ASF GitHub B

[GitHub] [hadoop] liangxs commented on pull request #3080: HADOOP-17749. Remove lock contention in SelectorPool of SocketIOWithTimeout

2021-06-08 Thread GitBox
liangxs commented on pull request #3080: URL: https://github.com/apache/hadoop/pull/3080#issuecomment-856703041 Could someone please review this PR? -- This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use the URL above to go

[GitHub] [hadoop] ferhui commented on a change in pull request #3065: HDFS-13671. Namenode deletes large dir slowly caused by FoldedTreeSet#removeAndGet

2021-06-08 Thread GitBox
ferhui commented on a change in pull request #3065: URL: https://github.com/apache/hadoop/pull/3065#discussion_r647357273 ## File path: hadoop-hdfs-project/hadoop-hdfs/src/main/java/org/apache/hadoop/hdfs/server/namenode/FSNamesystem.java ## @@ -1996,7 +1996,12 @@ private void

[GitHub] [hadoop] hadoop-yetus commented on pull request #3084: HDFS-16057. Make sure the order for location in ENTERING_MAINTENANCE …

2021-06-08 Thread GitBox
hadoop-yetus commented on pull request #3084: URL: https://github.com/apache/hadoop/pull/3084#issuecomment-856650629 :broken_heart: **-1 overall** | Vote | Subsystem | Runtime | Logfile | Comment | |::|--:|:|::|:---:| | +0 :ok

[GitHub] [hadoop] hadoop-yetus commented on pull request #3075: YARN-10805. Replace Guava Lists usage by Hadoop's own Lists in hadoop-yarn-project

2021-06-08 Thread GitBox
hadoop-yetus commented on pull request #3075: URL: https://github.com/apache/hadoop/pull/3075#issuecomment-856644751 :broken_heart: **-1 overall** | Vote | Subsystem | Runtime | Logfile | Comment | |::|--:|:|::|:---:| | +0 :ok

[GitHub] [hadoop] aajisaka commented on a change in pull request #3065: HDFS-13671. Namenode deletes large dir slowly caused by FoldedTreeSet#removeAndGet

2021-06-08 Thread GitBox
aajisaka commented on a change in pull request #3065: URL: https://github.com/apache/hadoop/pull/3065#discussion_r647294150 ## File path: hadoop-hdfs-project/hadoop-hdfs/src/main/java/org/apache/hadoop/hdfs/server/datanode/fsdataset/impl/ReplicaMap.java ## @@ -238,9 +221,10 @@

[GitHub] [hadoop] hadoop-yetus commented on pull request #3075: YARN-10805. Replace Guava Lists usage by Hadoop's own Lists in hadoop-yarn-project

2021-06-08 Thread GitBox
hadoop-yetus commented on pull request #3075: URL: https://github.com/apache/hadoop/pull/3075#issuecomment-856635662 :broken_heart: **-1 overall** | Vote | Subsystem | Runtime | Logfile | Comment | |::|--:|:|::|:---:| | +0 :ok

[GitHub] [hadoop] tomscut opened a new pull request #3084: HDFS-16057. Make sure the order for location in ENTERING_MAINTENANCE …

2021-06-08 Thread GitBox
tomscut opened a new pull request #3084: URL: https://github.com/apache/hadoop/pull/3084 JIRA: [HDFS-16057](https://issues.apache.org/jira/browse/HDFS-16057). We use compactor to sort locations in getBlockLocations(), and the expected result is: live -> stale -> entering_maintenance

[jira] [Updated] (HADOOP-17750) Fix asf license errors in newly added files by HADOOP-17727

2021-06-08 Thread Takanobu Asanuma (Jira)
[ https://issues.apache.org/jira/browse/HADOOP-17750?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Takanobu Asanuma updated HADOOP-17750: -- Labels: (was: pull-request-available) Status: Patch Available (was: Open) > Fi

[jira] [Work logged] (HADOOP-17750) Fix asf license errors in newly added files by HADOOP-17727

2021-06-08 Thread ASF GitHub Bot (Jira)
[ https://issues.apache.org/jira/browse/HADOOP-17750?focusedWorklogId=608361&page=com.atlassian.jira.plugin.system.issuetabpanels:worklog-tabpanel#worklog-608361 ] ASF GitHub Bot logged work on HADOOP-17750: --- Author: ASF GitHub B

[jira] [Updated] (HADOOP-17750) Fix asf license errors in newly added files by HADOOP-17727

2021-06-08 Thread ASF GitHub Bot (Jira)
[ https://issues.apache.org/jira/browse/HADOOP-17750?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] ASF GitHub Bot updated HADOOP-17750: Labels: pull-request-available (was: ) > Fix asf license errors in newly added files by

[GitHub] [hadoop] tasanuma opened a new pull request #3083: HADOOP-17750. Fix asf license errors in newly added files by HADOOP-17727

2021-06-08 Thread GitBox
tasanuma opened a new pull request #3083: URL: https://github.com/apache/hadoop/pull/3083 JIRA: HADOOP-17750 -- This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use the URL above to go to the specific comment. For queries ab

[jira] [Updated] (HADOOP-17750) Fix asf license errors in newly added files by HADOOP-17727

2021-06-08 Thread Takanobu Asanuma (Jira)
[ https://issues.apache.org/jira/browse/HADOOP-17750?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Takanobu Asanuma updated HADOOP-17750: -- Issue Type: Bug (was: Wish) > Fix asf license errors in newly added files by HADOOP-

[jira] [Created] (HADOOP-17750) Fix asf license errors in newly added files by HADOOP-17727

2021-06-08 Thread Takanobu Asanuma (Jira)
Takanobu Asanuma created HADOOP-17750: - Summary: Fix asf license errors in newly added files by HADOOP-17727 Key: HADOOP-17750 URL: https://issues.apache.org/jira/browse/HADOOP-17750 Project: Hado

  1   2   >