[GitHub] [hadoop] aajisaka merged pull request #3444: HDFS-16218 RBF: Use HdfsConfiguration for passing in Router principle

2021-09-15 Thread GitBox
aajisaka merged pull request #3444: URL: https://github.com/apache/hadoop/pull/3444 -- This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use the URL above to go to the specific comment. To unsubscribe, e-mail:

[GitHub] [hadoop] virajjasani commented on a change in pull request #3429: HDFS-16227. De-flake TestMover#testMoverWithStripedFile

2021-09-15 Thread GitBox
virajjasani commented on a change in pull request #3429: URL: https://github.com/apache/hadoop/pull/3429#discussion_r709800511 ## File path: hadoop-hdfs-project/hadoop-hdfs/src/test/java/org/apache/hadoop/hdfs/server/mover/TestMover.java ## @@ -958,13 +957,29 @@ public void

[GitHub] [hadoop] virajjasani commented on a change in pull request #3429: HDFS-16227. De-flake TestMover#testMoverWithStripedFile

2021-09-15 Thread GitBox
virajjasani commented on a change in pull request #3429: URL: https://github.com/apache/hadoop/pull/3429#discussion_r709800030 ## File path: hadoop-hdfs-project/hadoop-hdfs/src/test/java/org/apache/hadoop/hdfs/server/mover/TestMover.java ## @@ -872,7 +872,6 @@ void

[GitHub] [hadoop] virajjasani commented on a change in pull request #3429: HDFS-16227. De-flake TestMover#testMoverWithStripedFile

2021-09-15 Thread GitBox
virajjasani commented on a change in pull request #3429: URL: https://github.com/apache/hadoop/pull/3429#discussion_r709800030 ## File path: hadoop-hdfs-project/hadoop-hdfs/src/test/java/org/apache/hadoop/hdfs/server/mover/TestMover.java ## @@ -872,7 +872,6 @@ void

[GitHub] [hadoop] hadoop-yetus commented on pull request #3438: YARN-10951. Move async scheduling logic to a new AsyncSchedulingManager

2021-09-15 Thread GitBox
hadoop-yetus commented on pull request #3438: URL: https://github.com/apache/hadoop/pull/3438#issuecomment-920596481 :broken_heart: **-1 overall** | Vote | Subsystem | Runtime | Logfile | Comment | |::|--:|:|::|:---:| | +0

[jira] [Work logged] (HADOOP-17914) Print RPC response length in the exception message

2021-09-15 Thread ASF GitHub Bot (Jira)
[ https://issues.apache.org/jira/browse/HADOOP-17914?focusedWorklogId=651463=com.atlassian.jira.plugin.system.issuetabpanels:worklog-tabpanel#worklog-651463 ] ASF GitHub Bot logged work on HADOOP-17914: --- Author: ASF GitHub Bot

[GitHub] [hadoop] hadoop-yetus commented on pull request #3436: HADOOP-17914. Print RPC response length in the exception message

2021-09-15 Thread GitBox
hadoop-yetus commented on pull request #3436: URL: https://github.com/apache/hadoop/pull/3436#issuecomment-920582506 :broken_heart: **-1 overall** | Vote | Subsystem | Runtime | Logfile | Comment | |::|--:|:|::|:---:| | +0

[GitHub] [hadoop] jianghuazhu commented on pull request #3417: HDFS-16220.[FGL]Configurable INodeMap#NAMESPACE_KEY_DEPTH_RANGES_STATIC.

2021-09-15 Thread GitBox
jianghuazhu commented on pull request #3417: URL: https://github.com/apache/hadoop/pull/3417#issuecomment-920560953 @xinglin, can you help review? There are some spotbugs tips in jenkins, for example: `This code increments a volatile field. Increments of volatile fields aren't

[GitHub] [hadoop] jojochuang commented on a change in pull request #3429: HDFS-16227. De-flake TestMover#testMoverWithStripedFile

2021-09-15 Thread GitBox
jojochuang commented on a change in pull request #3429: URL: https://github.com/apache/hadoop/pull/3429#discussion_r709725746 ## File path: hadoop-hdfs-project/hadoop-hdfs/src/test/java/org/apache/hadoop/hdfs/server/mover/TestMover.java ## @@ -958,13 +957,29 @@ public void

[GitHub] [hadoop] hadoop-yetus commented on pull request #3386: HDFS-16213. De-flake TestFsDatasetImpl#testDnRestartWithHardLink

2021-09-15 Thread GitBox
hadoop-yetus commented on pull request #3386: URL: https://github.com/apache/hadoop/pull/3386#issuecomment-920548456 :broken_heart: **-1 overall** | Vote | Subsystem | Runtime | Logfile | Comment | |::|--:|:|::|:---:| | +0

[GitHub] [hadoop] hadoop-yetus commented on pull request #3425: HDFS-16224. testBalancerWithObserverWithFailedNode times out

2021-09-15 Thread GitBox
hadoop-yetus commented on pull request #3425: URL: https://github.com/apache/hadoop/pull/3425#issuecomment-920540943 :confetti_ball: **+1 overall** | Vote | Subsystem | Runtime | Logfile | Comment | |::|--:|:|::|:---:| | +0

[jira] [Work logged] (HADOOP-17891) lz4-java and snappy-java should be excluded from relocation in shaded Hadoop libraries

2021-09-15 Thread ASF GitHub Bot (Jira)
[ https://issues.apache.org/jira/browse/HADOOP-17891?focusedWorklogId=651447=com.atlassian.jira.plugin.system.issuetabpanels:worklog-tabpanel#worklog-651447 ] ASF GitHub Bot logged work on HADOOP-17891: --- Author: ASF GitHub Bot

[GitHub] [hadoop] hadoop-yetus commented on pull request #3386: HDFS-16213. De-flake TestFsDatasetImpl#testDnRestartWithHardLink

2021-09-15 Thread GitBox
hadoop-yetus commented on pull request #3386: URL: https://github.com/apache/hadoop/pull/3386#issuecomment-920532949 :broken_heart: **-1 overall** | Vote | Subsystem | Runtime | Logfile | Comment | |::|--:|:|::|:---:| | +0

[GitHub] [hadoop] viirya commented on pull request #3441: HADOOP-17891. Fix compilation error under skipShade (ADDENDUM)

2021-09-15 Thread GitBox
viirya commented on pull request #3441: URL: https://github.com/apache/hadoop/pull/3441#issuecomment-920532855 The -1 from shadedclient is for branch-shadedclient.txt. But why branch build uses the updated `dev-support/bin/hadoop.sh` too? -- This is an automated message from the Apache

[jira] [Work logged] (HADOOP-17891) lz4-java and snappy-java should be excluded from relocation in shaded Hadoop libraries

2021-09-15 Thread ASF GitHub Bot (Jira)
[ https://issues.apache.org/jira/browse/HADOOP-17891?focusedWorklogId=651446=com.atlassian.jira.plugin.system.issuetabpanels:worklog-tabpanel#worklog-651446 ] ASF GitHub Bot logged work on HADOOP-17891: --- Author: ASF GitHub Bot

[GitHub] [hadoop] viirya commented on pull request #3441: HADOOP-17891. Fix compilation error under skipShade (ADDENDUM)

2021-09-15 Thread GitBox
viirya commented on pull request #3441: URL: https://github.com/apache/hadoop/pull/3441#issuecomment-920532199 Seems okay now. patch-shadedclient.txt was passed. -- This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use the

[jira] [Commented] (HADOOP-17177) Java 17 support

2021-09-15 Thread Akira Ajisaka (Jira)
[ https://issues.apache.org/jira/browse/HADOOP-17177?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17415832#comment-17415832 ] Akira Ajisaka commented on HADOOP-17177: The "jdk11" profile is automatically activated if the

[jira] [Commented] (HADOOP-17910) [JDK 17] TestNetUtils fails

2021-09-15 Thread Akira Ajisaka (Jira)
[ https://issues.apache.org/jira/browse/HADOOP-17910?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17415831#comment-17415831 ] Akira Ajisaka commented on HADOOP-17910: Sure! Assigned. > [JDK 17] TestNetUtils fails >

[jira] [Assigned] (HADOOP-17910) [JDK 17] TestNetUtils fails

2021-09-15 Thread Akira Ajisaka (Jira)
[ https://issues.apache.org/jira/browse/HADOOP-17910?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Akira Ajisaka reassigned HADOOP-17910: -- Assignee: Viraj Jasani > [JDK 17] TestNetUtils fails > ---

[GitHub] [hadoop] hadoop-yetus commented on pull request #3444: HDFS-16218 RBF: Use HdfsConfiguration for passing in Router principle

2021-09-15 Thread GitBox
hadoop-yetus commented on pull request #3444: URL: https://github.com/apache/hadoop/pull/3444#issuecomment-920516837 :broken_heart: **-1 overall** | Vote | Subsystem | Runtime | Logfile | Comment | |::|--:|:|::|:---:| | +0

[jira] [Work logged] (HADOOP-17914) Print RPC response length in the exception message

2021-09-15 Thread ASF GitHub Bot (Jira)
[ https://issues.apache.org/jira/browse/HADOOP-17914?focusedWorklogId=651434=com.atlassian.jira.plugin.system.issuetabpanels:worklog-tabpanel#worklog-651434 ] ASF GitHub Bot logged work on HADOOP-17914: --- Author: ASF GitHub Bot

[GitHub] [hadoop] hadoop-yetus commented on pull request #3436: HADOOP-17914. Print RPC response length in the exception message

2021-09-15 Thread GitBox
hadoop-yetus commented on pull request #3436: URL: https://github.com/apache/hadoop/pull/3436#issuecomment-920515696 :broken_heart: **-1 overall** | Vote | Subsystem | Runtime | Logfile | Comment | |::|--:|:|::|:---:| | +0

[GitHub] [hadoop] jianghuazhu commented on pull request #2281: HDFS-15516.Add info for create flags in NameNode audit logs.

2021-09-15 Thread GitBox
jianghuazhu commented on pull request #2281: URL: https://github.com/apache/hadoop/pull/2281#issuecomment-920509892 @ayushtkn, I made some changes, can you review it? thank you very much. -- This is an automated message from the Apache Git Service. To respond to the message,

[jira] [Work logged] (HADOOP-17891) lz4-java and snappy-java should be excluded from relocation in shaded Hadoop libraries

2021-09-15 Thread ASF GitHub Bot (Jira)
[ https://issues.apache.org/jira/browse/HADOOP-17891?focusedWorklogId=651429=com.atlassian.jira.plugin.system.issuetabpanels:worklog-tabpanel#worklog-651429 ] ASF GitHub Bot logged work on HADOOP-17891: --- Author: ASF GitHub Bot

[GitHub] [hadoop] hadoop-yetus removed a comment on pull request #3441: HADOOP-17891. Fix compilation error under skipShade (ADDENDUM)

2021-09-15 Thread GitBox
hadoop-yetus removed a comment on pull request #3441: URL: https://github.com/apache/hadoop/pull/3441#issuecomment-920436566 :broken_heart: **-1 overall** | Vote | Subsystem | Runtime | Logfile | Comment | |::|--:|:|::|:---:|

[jira] [Work logged] (HADOOP-17891) lz4-java and snappy-java should be excluded from relocation in shaded Hadoop libraries

2021-09-15 Thread ASF GitHub Bot (Jira)
[ https://issues.apache.org/jira/browse/HADOOP-17891?focusedWorklogId=651427=com.atlassian.jira.plugin.system.issuetabpanels:worklog-tabpanel#worklog-651427 ] ASF GitHub Bot logged work on HADOOP-17891: --- Author: ASF GitHub Bot

[GitHub] [hadoop] hadoop-yetus commented on pull request #3441: HADOOP-17891. Fix compilation error under skipShade (ADDENDUM)

2021-09-15 Thread GitBox
hadoop-yetus commented on pull request #3441: URL: https://github.com/apache/hadoop/pull/3441#issuecomment-920497973 :broken_heart: **-1 overall** | Vote | Subsystem | Runtime | Logfile | Comment | |::|--:|:|::|:---:| | +0

[GitHub] [hadoop] tomscut commented on pull request #3366: HDFS-16203. Discover datanodes with unbalanced block pool usage by th…

2021-09-15 Thread GitBox
tomscut commented on pull request #3366: URL: https://github.com/apache/hadoop/pull/3366#issuecomment-920496593 Thanks @tasanuma @ferhui for your review and merge. -- This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use the

[GitHub] [hadoop] tasanuma commented on pull request #3366: HDFS-16203. Discover datanodes with unbalanced block pool usage by th…

2021-09-15 Thread GitBox
tasanuma commented on pull request #3366: URL: https://github.com/apache/hadoop/pull/3366#issuecomment-920494267 Merged it. Thanks for the contribution, @tomscut. Thanks for reviewing it, @ferhui. -- This is an automated message from the Apache Git Service. To respond to the message,

[GitHub] [hadoop] tasanuma merged pull request #3366: HDFS-16203. Discover datanodes with unbalanced block pool usage by th…

2021-09-15 Thread GitBox
tasanuma merged pull request #3366: URL: https://github.com/apache/hadoop/pull/3366 -- This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use the URL above to go to the specific comment. To unsubscribe, e-mail:

[GitHub] [hadoop] tomscut commented on pull request #3366: HDFS-16203. Discover datanodes with unbalanced block pool usage by th…

2021-09-15 Thread GitBox
tomscut commented on pull request #3366: URL: https://github.com/apache/hadoop/pull/3366#issuecomment-920480429 The failed unit tests ```TestBlockTokenWithDFSStriped``` and ```TestBalancerWithHANameNodes``` are unrelated to the change, and work fine locally. -- This is an automated

[jira] [Work logged] (HADOOP-17891) lz4-java and snappy-java should be excluded from relocation in shaded Hadoop libraries

2021-09-15 Thread ASF GitHub Bot (Jira)
[ https://issues.apache.org/jira/browse/HADOOP-17891?focusedWorklogId=651395=com.atlassian.jira.plugin.system.issuetabpanels:worklog-tabpanel#worklog-651395 ] ASF GitHub Bot logged work on HADOOP-17891: --- Author: ASF GitHub Bot

[GitHub] [hadoop] hadoop-yetus commented on pull request #3441: HADOOP-17891. Fix compilation error under skipShade (ADDENDUM)

2021-09-15 Thread GitBox
hadoop-yetus commented on pull request #3441: URL: https://github.com/apache/hadoop/pull/3441#issuecomment-920466295 (!) A patch to the testing environment has been detected. Re-executing against the patched versions to perform further tests. The console is at

[jira] [Work logged] (HADOOP-17891) lz4-java and snappy-java should be excluded from relocation in shaded Hadoop libraries

2021-09-15 Thread ASF GitHub Bot (Jira)
[ https://issues.apache.org/jira/browse/HADOOP-17891?focusedWorklogId=651392=com.atlassian.jira.plugin.system.issuetabpanels:worklog-tabpanel#worklog-651392 ] ASF GitHub Bot logged work on HADOOP-17891: --- Author: ASF GitHub Bot

[GitHub] [hadoop] viirya commented on pull request #3441: HADOOP-17891. Fix compilation error under skipShade (ADDENDUM)

2021-09-15 Thread GitBox
viirya commented on pull request #3441: URL: https://github.com/apache/hadoop/pull/3441#issuecomment-920464858 Oops! Fixed. Thanks. -- This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use the URL above to go to the specific

[GitHub] [hadoop] fengnanli opened a new pull request #3444: HDFS-16218 RBF: Use HdfsConfiguration for passing in Router principle

2021-09-15 Thread GitBox
fengnanli opened a new pull request #3444: URL: https://github.com/apache/hadoop/pull/3444 ### Description of PR ### How was this patch tested? ### For code changes: - [ ] Does the title or this PR starts with the corresponding JIRA issue id (e.g.

[jira] [Work logged] (HADOOP-17891) lz4-java and snappy-java should be excluded from relocation in shaded Hadoop libraries

2021-09-15 Thread ASF GitHub Bot (Jira)
[ https://issues.apache.org/jira/browse/HADOOP-17891?focusedWorklogId=651381=com.atlassian.jira.plugin.system.issuetabpanels:worklog-tabpanel#worklog-651381 ] ASF GitHub Bot logged work on HADOOP-17891: --- Author: ASF GitHub Bot

[GitHub] [hadoop] sunchao commented on pull request #3441: HADOOP-17891. Fix compilation error under skipShade (ADDENDUM)

2021-09-15 Thread GitBox
sunchao commented on pull request #3441: URL: https://github.com/apache/hadoop/pull/3441#issuecomment-920441724 @viirya I think you should use `-DskipShade` instead of `-PskipShade`. The test still doesn't run properly. -- This is an automated message from the Apache Git Service. To

[jira] [Work logged] (HADOOP-17891) lz4-java and snappy-java should be excluded from relocation in shaded Hadoop libraries

2021-09-15 Thread ASF GitHub Bot (Jira)
[ https://issues.apache.org/jira/browse/HADOOP-17891?focusedWorklogId=651380=com.atlassian.jira.plugin.system.issuetabpanels:worklog-tabpanel#worklog-651380 ] ASF GitHub Bot logged work on HADOOP-17891: --- Author: ASF GitHub Bot

[GitHub] [hadoop] hadoop-yetus commented on pull request #3441: HADOOP-17891. Fix compilation error under skipShade (ADDENDUM)

2021-09-15 Thread GitBox
hadoop-yetus commented on pull request #3441: URL: https://github.com/apache/hadoop/pull/3441#issuecomment-920436566 :broken_heart: **-1 overall** | Vote | Subsystem | Runtime | Logfile | Comment | |::|--:|:|::|:---:| | +0

[jira] [Work logged] (HADOOP-17915) ABFS AbfsDelegationTokenManager to generate canonicalServiceName if DT plugin doesn't

2021-09-15 Thread ASF GitHub Bot (Jira)
[ https://issues.apache.org/jira/browse/HADOOP-17915?focusedWorklogId=651379=com.atlassian.jira.plugin.system.issuetabpanels:worklog-tabpanel#worklog-651379 ] ASF GitHub Bot logged work on HADOOP-17915: --- Author: ASF GitHub Bot

[GitHub] [hadoop] hadoop-yetus commented on pull request #3442: HADOOP-17915. ABFS AbfsDelegationTokenManager to generate canonicalServiceName if DT plugin doesn't

2021-09-15 Thread GitBox
hadoop-yetus commented on pull request #3442: URL: https://github.com/apache/hadoop/pull/3442#issuecomment-920434697 :confetti_ball: **+1 overall** | Vote | Subsystem | Runtime | Logfile | Comment | |::|--:|:|::|:---:| | +0

[GitHub] [hadoop] goiri commented on a change in pull request #3429: HDFS-16227. De-flake TestMover#testMoverWithStripedFile

2021-09-15 Thread GitBox
goiri commented on a change in pull request #3429: URL: https://github.com/apache/hadoop/pull/3429#discussion_r709590783 ## File path: hadoop-hdfs-project/hadoop-hdfs/src/test/java/org/apache/hadoop/hdfs/server/mover/TestMover.java ## @@ -872,7 +872,6 @@ void

[jira] [Work logged] (HADOOP-17195) Intermittent OutOfMemory error while performing hdfs CopyFromLocal to abfs

2021-09-15 Thread ASF GitHub Bot (Jira)
[ https://issues.apache.org/jira/browse/HADOOP-17195?focusedWorklogId=651344=com.atlassian.jira.plugin.system.issuetabpanels:worklog-tabpanel#worklog-651344 ] ASF GitHub Bot logged work on HADOOP-17195: --- Author: ASF GitHub Bot

[jira] [Work logged] (HADOOP-17871) S3A CSE: minor tuning

2021-09-15 Thread ASF GitHub Bot (Jira)
[ https://issues.apache.org/jira/browse/HADOOP-17871?focusedWorklogId=651346=com.atlassian.jira.plugin.system.issuetabpanels:worklog-tabpanel#worklog-651346 ] ASF GitHub Bot logged work on HADOOP-17871: --- Author: ASF GitHub Bot

[GitHub] [hadoop] steveloughran merged pull request #3412: HADOOP-17871. S3A CSE: minor tuning

2021-09-15 Thread GitBox
steveloughran merged pull request #3412: URL: https://github.com/apache/hadoop/pull/3412 -- This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use the URL above to go to the specific comment. To unsubscribe, e-mail:

[GitHub] [hadoop] steveloughran commented on pull request #3406: HADOOP-17195. OutOfMemory error while performing hdfs CopyFromLocal to ABFS

2021-09-15 Thread GitBox
steveloughran commented on pull request #3406: URL: https://github.com/apache/hadoop/pull/3406#issuecomment-920396035 @mehakmeet , sorry, accidentally merged this to trunk as I thought I was committing the CSE Branch. Reverted-but this branch is closed. please can you create a new one

[jira] [Work logged] (HADOOP-17195) Intermittent OutOfMemory error while performing hdfs CopyFromLocal to abfs

2021-09-15 Thread ASF GitHub Bot (Jira)
[ https://issues.apache.org/jira/browse/HADOOP-17195?focusedWorklogId=651342=com.atlassian.jira.plugin.system.issuetabpanels:worklog-tabpanel#worklog-651342 ] ASF GitHub Bot logged work on HADOOP-17195: --- Author: ASF GitHub Bot

[jira] [Work logged] (HADOOP-17195) Intermittent OutOfMemory error while performing hdfs CopyFromLocal to abfs

2021-09-15 Thread ASF GitHub Bot (Jira)
[ https://issues.apache.org/jira/browse/HADOOP-17195?focusedWorklogId=651341=com.atlassian.jira.plugin.system.issuetabpanels:worklog-tabpanel#worklog-651341 ] ASF GitHub Bot logged work on HADOOP-17195: --- Author: ASF GitHub Bot

[jira] [Work logged] (HADOOP-17195) Intermittent OutOfMemory error while performing hdfs CopyFromLocal to abfs

2021-09-15 Thread ASF GitHub Bot (Jira)
[ https://issues.apache.org/jira/browse/HADOOP-17195?focusedWorklogId=651340=com.atlassian.jira.plugin.system.issuetabpanels:worklog-tabpanel#worklog-651340 ] ASF GitHub Bot logged work on HADOOP-17195: --- Author: ASF GitHub Bot

[GitHub] [hadoop] steveloughran merged pull request #3443: Revert "HADOOP-17195. OutOfMemory error while performing hdfs CopyFromLocal to ABFS"

2021-09-15 Thread GitBox
steveloughran merged pull request #3443: URL: https://github.com/apache/hadoop/pull/3443 -- This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use the URL above to go to the specific comment. To unsubscribe, e-mail:

[GitHub] [hadoop] steveloughran opened a new pull request #3443: Revert "HADOOP-17195. OutOfMemory error while performing hdfs CopyFromLocal to ABFS"

2021-09-15 Thread GitBox
steveloughran opened a new pull request #3443: URL: https://github.com/apache/hadoop/pull/3443 Reverts apache/hadoop#3406 -- This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use the URL above to go to the specific comment.

[GitHub] [hadoop] steveloughran merged pull request #3406: HADOOP-17195. OutOfMemory error while performing hdfs CopyFromLocal to ABFS

2021-09-15 Thread GitBox
steveloughran merged pull request #3406: URL: https://github.com/apache/hadoop/pull/3406 -- This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use the URL above to go to the specific comment. To unsubscribe, e-mail:

[jira] [Work logged] (HADOOP-17891) lz4-java and snappy-java should be excluded from relocation in shaded Hadoop libraries

2021-09-15 Thread ASF GitHub Bot (Jira)
[ https://issues.apache.org/jira/browse/HADOOP-17891?focusedWorklogId=651325=com.atlassian.jira.plugin.system.issuetabpanels:worklog-tabpanel#worklog-651325 ] ASF GitHub Bot logged work on HADOOP-17891: --- Author: ASF GitHub Bot

[jira] [Updated] (HADOOP-17915) ABFS AbfsDelegationTokenManager to generate canonicalServiceName if DT plugin doesn't

2021-09-15 Thread ASF GitHub Bot (Jira)
[ https://issues.apache.org/jira/browse/HADOOP-17915?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] ASF GitHub Bot updated HADOOP-17915: Labels: pull-request-available (was: ) > ABFS AbfsDelegationTokenManager to generate

[jira] [Work logged] (HADOOP-17915) ABFS AbfsDelegationTokenManager to generate canonicalServiceName if DT plugin doesn't

2021-09-15 Thread ASF GitHub Bot (Jira)
[ https://issues.apache.org/jira/browse/HADOOP-17915?focusedWorklogId=651327=com.atlassian.jira.plugin.system.issuetabpanels:worklog-tabpanel#worklog-651327 ] ASF GitHub Bot logged work on HADOOP-17915: --- Author: ASF GitHub Bot

[GitHub] [hadoop] steveloughran opened a new pull request #3442: HADOOP-17915. ABFS AbfsDelegationTokenManager to generate canonicalServiceName if DT plugin doesn't

2021-09-15 Thread GitBox
steveloughran opened a new pull request #3442: URL: https://github.com/apache/hadoop/pull/3442 This PR ensures that * `FileSystem.getCanonicalServiceName()` is *never* used to build an abfs service name from the IPaddr of the storage account's endpoint. * Instead, if DTs are

[jira] [Work logged] (HADOOP-17891) lz4-java and snappy-java should be excluded from relocation in shaded Hadoop libraries

2021-09-15 Thread ASF GitHub Bot (Jira)
[ https://issues.apache.org/jira/browse/HADOOP-17891?focusedWorklogId=651324=com.atlassian.jira.plugin.system.issuetabpanels:worklog-tabpanel#worklog-651324 ] ASF GitHub Bot logged work on HADOOP-17891: --- Author: ASF GitHub Bot

[GitHub] [hadoop] hadoop-yetus commented on pull request #3441: HADOOP-17891. Fix compilation error under skipShade (ADDENDUM)

2021-09-15 Thread GitBox
hadoop-yetus commented on pull request #3441: URL: https://github.com/apache/hadoop/pull/3441#issuecomment-920369908 (!) A patch to the testing environment has been detected. Re-executing against the patched versions to perform further tests. The console is at

[GitHub] [hadoop] sunchao commented on pull request #3441: HADOOP-17891. Fix compilation error under skipShade (ADDENDUM)

2021-09-15 Thread GitBox
sunchao commented on pull request #3441: URL: https://github.com/apache/hadoop/pull/3441#issuecomment-920369872 cc @ayushtkn too -- This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use the URL above to go to the specific

[jira] [Work logged] (HADOOP-17891) lz4-java and snappy-java should be excluded from relocation in shaded Hadoop libraries

2021-09-15 Thread ASF GitHub Bot (Jira)
[ https://issues.apache.org/jira/browse/HADOOP-17891?focusedWorklogId=651323=com.atlassian.jira.plugin.system.issuetabpanels:worklog-tabpanel#worklog-651323 ] ASF GitHub Bot logged work on HADOOP-17891: --- Author: ASF GitHub Bot

[GitHub] [hadoop] viirya commented on pull request #3441: HADOOP-17891. Fix compilation error under skipShade

2021-09-15 Thread GitBox
viirya commented on pull request #3441: URL: https://github.com/apache/hadoop/pull/3441#issuecomment-920368947 cc @sunchao -- This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use the URL above to go to the specific comment.

[jira] [Work logged] (HADOOP-17891) lz4-java and snappy-java should be excluded from relocation in shaded Hadoop libraries

2021-09-15 Thread ASF GitHub Bot (Jira)
[ https://issues.apache.org/jira/browse/HADOOP-17891?focusedWorklogId=651322=com.atlassian.jira.plugin.system.issuetabpanels:worklog-tabpanel#worklog-651322 ] ASF GitHub Bot logged work on HADOOP-17891: --- Author: ASF GitHub Bot

[GitHub] [hadoop] viirya opened a new pull request #3441: HADOOP-17891.

2021-09-15 Thread GitBox
viirya opened a new pull request #3441: URL: https://github.com/apache/hadoop/pull/3441 ### Description of PR ### How was this patch tested? ### For code changes: - [ ] Does the title or this PR starts with the corresponding JIRA issue id (e.g.

[jira] [Commented] (HADOOP-17891) lz4-java and snappy-java should be excluded from relocation in shaded Hadoop libraries

2021-09-15 Thread Chao Sun (Jira)
[ https://issues.apache.org/jira/browse/HADOOP-17891?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17415752#comment-17415752 ] Chao Sun commented on HADOOP-17891: --- Thanks [~ebadger] and [~ayushtkn]! sorry for introducing the

[jira] [Commented] (HADOOP-17891) lz4-java and snappy-java should be excluded from relocation in shaded Hadoop libraries

2021-09-15 Thread Ayush Saxena (Jira)
[ https://issues.apache.org/jira/browse/HADOOP-17891?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17415739#comment-17415739 ] Ayush Saxena commented on HADOOP-17891: --- The build is failing for me as well. I tried to fix it,

[jira] [Updated] (HADOOP-17891) lz4-java and snappy-java should be excluded from relocation in shaded Hadoop libraries

2021-09-15 Thread Ayush Saxena (Jira)
[ https://issues.apache.org/jira/browse/HADOOP-17891?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Ayush Saxena updated HADOOP-17891: -- Attachment: HADOOP-17891-Addendum-01.patch > lz4-java and snappy-java should be excluded

[GitHub] [hadoop] hadoop-yetus commented on pull request #1867: HADOOP-16983. Update ADLS client credential creation docs.

2021-09-15 Thread GitBox
hadoop-yetus commented on pull request #1867: URL: https://github.com/apache/hadoop/pull/1867#issuecomment-920346663 :broken_heart: **-1 overall** | Vote | Subsystem | Runtime | Logfile | Comment | |::|--:|:|::|:---:| | +0

[jira] [Work logged] (HADOOP-17195) Intermittent OutOfMemory error while performing hdfs CopyFromLocal to abfs

2021-09-15 Thread ASF GitHub Bot (Jira)
[ https://issues.apache.org/jira/browse/HADOOP-17195?focusedWorklogId=651299=com.atlassian.jira.plugin.system.issuetabpanels:worklog-tabpanel#worklog-651299 ] ASF GitHub Bot logged work on HADOOP-17195: --- Author: ASF GitHub Bot

[GitHub] [hadoop] hadoop-yetus commented on pull request #3406: HADOOP-17195. OutOfMemory error while performing hdfs CopyFromLocal to ABFS

2021-09-15 Thread GitBox
hadoop-yetus commented on pull request #3406: URL: https://github.com/apache/hadoop/pull/3406#issuecomment-920326946 :broken_heart: **-1 overall** | Vote | Subsystem | Runtime | Logfile | Comment | |::|--:|:|::|:---:| | +0

[jira] [Commented] (HADOOP-17891) lz4-java and snappy-java should be excluded from relocation in shaded Hadoop libraries

2021-09-15 Thread Eric Badger (Jira)
[ https://issues.apache.org/jira/browse/HADOOP-17891?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17415717#comment-17415717 ] Eric Badger commented on HADOOP-17891: -- Looks like the issue manifests when adding the

[jira] [Commented] (HADOOP-17891) lz4-java and snappy-java should be excluded from relocation in shaded Hadoop libraries

2021-09-15 Thread L. C. Hsieh (Jira)
[ https://issues.apache.org/jira/browse/HADOOP-17891?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17415713#comment-17415713 ] L. C. Hsieh commented on HADOOP-17891: -- Trying to reproduce it locally. > lz4-java and

[GitHub] [hadoop] hadoop-yetus commented on pull request #3438: YARN-10951. Move async scheduling logic to a new AsyncSchedulingManager

2021-09-15 Thread GitBox
hadoop-yetus commented on pull request #3438: URL: https://github.com/apache/hadoop/pull/3438#issuecomment-920302940 :broken_heart: **-1 overall** | Vote | Subsystem | Runtime | Logfile | Comment | |::|--:|:|::|:---:| | +0

[GitHub] [hadoop] hadoop-yetus commented on pull request #3366: HDFS-16203. Discover datanodes with unbalanced block pool usage by th…

2021-09-15 Thread GitBox
hadoop-yetus commented on pull request #3366: URL: https://github.com/apache/hadoop/pull/3366#issuecomment-920294476 :broken_heart: **-1 overall** | Vote | Subsystem | Runtime | Logfile | Comment | |::|--:|:|::|:---:| | +0

[GitHub] [hadoop] hadoop-yetus commented on pull request #3440: ABFS: Support for Encryption Context

2021-09-15 Thread GitBox
hadoop-yetus commented on pull request #3440: URL: https://github.com/apache/hadoop/pull/3440#issuecomment-920287300 :broken_heart: **-1 overall** | Vote | Subsystem | Runtime | Logfile | Comment | |::|--:|:|::|:---:| | +0

[GitHub] [hadoop] hadoop-yetus commented on pull request #2281: HDFS-15516.Add info for create flags in NameNode audit logs.

2021-09-15 Thread GitBox
hadoop-yetus commented on pull request #2281: URL: https://github.com/apache/hadoop/pull/2281#issuecomment-920286882 :confetti_ball: **+1 overall** | Vote | Subsystem | Runtime | Logfile | Comment | |::|--:|:|::|:---:| | +0

[GitHub] [hadoop] hadoop-yetus commented on pull request #3386: HDFS-16213. De-flake TestFsDatasetImpl#testDnRestartWithHardLink

2021-09-15 Thread GitBox
hadoop-yetus commented on pull request #3386: URL: https://github.com/apache/hadoop/pull/3386#issuecomment-920264187 :broken_heart: **-1 overall** | Vote | Subsystem | Runtime | Logfile | Comment | |::|--:|:|::|:---:| | +0

[GitHub] [hadoop] hadoop-yetus commented on pull request #3439: YARN-10957. Using invokeConcurrent Overload with Collection in getClusterMetrics

2021-09-15 Thread GitBox
hadoop-yetus commented on pull request #3439: URL: https://github.com/apache/hadoop/pull/3439#issuecomment-920259548 :confetti_ball: **+1 overall** | Vote | Subsystem | Runtime | Logfile | Comment | |::|--:|:|::|:---:| | +0

[jira] [Resolved] (HADOOP-17907) FileUtil#fullyDelete deletes contents of sym-linked directory when symlink cannot be deleted because of local fs fault

2021-09-15 Thread Ayush Saxena (Jira)
[ https://issues.apache.org/jira/browse/HADOOP-17907?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Ayush Saxena resolved HADOOP-17907. --- Fix Version/s: 3.4.0 Hadoop Flags: Reviewed Resolution: Fixed >

[jira] [Assigned] (HADOOP-17907) FileUtil#fullyDelete deletes contents of sym-linked directory when symlink cannot be deleted because of local fs fault

2021-09-15 Thread Ayush Saxena (Jira)
[ https://issues.apache.org/jira/browse/HADOOP-17907?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Ayush Saxena reassigned HADOOP-17907: - Assignee: Weihao Zheng > FileUtil#fullyDelete deletes contents of sym-linked

[jira] [Commented] (HADOOP-17907) FileUtil#fullyDelete deletes contents of sym-linked directory when symlink cannot be deleted because of local fs fault

2021-09-15 Thread Ayush Saxena (Jira)
[ https://issues.apache.org/jira/browse/HADOOP-17907?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17415667#comment-17415667 ] Ayush Saxena commented on HADOOP-17907: --- Committed to trunk. Thanx [~Weihao Zheng] for the

[jira] [Work logged] (HADOOP-15566) Support OpenTelemetry

2021-09-15 Thread ASF GitHub Bot (Jira)
[ https://issues.apache.org/jira/browse/HADOOP-15566?focusedWorklogId=651252=com.atlassian.jira.plugin.system.issuetabpanels:worklog-tabpanel#worklog-651252 ] ASF GitHub Bot logged work on HADOOP-15566: --- Author: ASF GitHub Bot

[GitHub] [hadoop] minni31 commented on pull request #2816: HADOOP-15566 initial changes for opentelemetry - WIP

2021-09-15 Thread GitBox
minni31 commented on pull request #2816: URL: https://github.com/apache/hadoop/pull/2816#issuecomment-920243825 @ArkenKiran, would you mind sharing the steps you used to verify the changes locally ? Thanks -- This is an automated message from the Apache Git Service. To respond to the

[jira] [Commented] (HADOOP-17891) lz4-java and snappy-java should be excluded from relocation in shaded Hadoop libraries

2021-09-15 Thread Eric Badger (Jira)
[ https://issues.apache.org/jira/browse/HADOOP-17891?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17415665#comment-17415665 ] Eric Badger commented on HADOOP-17891: -- {noformat} mvn clean install -Pdist,native -Dtar

[GitHub] [hadoop] hadoop-yetus commented on pull request #3420: YARN-10913. AbstractCSQueue: Group preemption methods and fields into a separate class

2021-09-15 Thread GitBox
hadoop-yetus commented on pull request #3420: URL: https://github.com/apache/hadoop/pull/3420#issuecomment-920231721 :broken_heart: **-1 overall** | Vote | Subsystem | Runtime | Logfile | Comment | |::|--:|:|::|:---:| | +0

[jira] [Work logged] (HADOOP-17907) FileUtil#fullyDelete deletes contents of sym-linked directory when symlink cannot be deleted because of local fs fault

2021-09-15 Thread ASF GitHub Bot (Jira)
[ https://issues.apache.org/jira/browse/HADOOP-17907?focusedWorklogId=651243=com.atlassian.jira.plugin.system.issuetabpanels:worklog-tabpanel#worklog-651243 ] ASF GitHub Bot logged work on HADOOP-17907: --- Author: ASF GitHub Bot

[GitHub] [hadoop] ayushtkn merged pull request #3431: HADOOP-17907. FileUtil#fullyDelete deletes contents of sym-linked directory when symlink cannot be deleted because of local fs fault

2021-09-15 Thread GitBox
ayushtkn merged pull request #3431: URL: https://github.com/apache/hadoop/pull/3431 -- This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use the URL above to go to the specific comment. To unsubscribe, e-mail:

[jira] [Work logged] (HADOOP-17195) Intermittent OutOfMemory error while performing hdfs CopyFromLocal to abfs

2021-09-15 Thread ASF GitHub Bot (Jira)
[ https://issues.apache.org/jira/browse/HADOOP-17195?focusedWorklogId=651221=com.atlassian.jira.plugin.system.issuetabpanels:worklog-tabpanel#worklog-651221 ] ASF GitHub Bot logged work on HADOOP-17195: --- Author: ASF GitHub Bot

[GitHub] [hadoop] xkrogen commented on pull request #3317: HDFS-16181. [SBN Read] Fix metric of RpcRequestCacheMissAmount can't display when tailEditLog form JN

2021-09-15 Thread GitBox
xkrogen commented on pull request #3317: URL: https://github.com/apache/hadoop/pull/3317#issuecomment-920210134 Merged to trunk and backported to branch-3.3, branch-3.2, branch-3.1, branch-2.10. Thanks @wzhallright ! -- This is an automated message from the Apache Git

[GitHub] [hadoop] mehakmeet edited a comment on pull request #3406: HADOOP-17195. OutOfMemory error while performing hdfs CopyFromLocal to ABFS

2021-09-15 Thread GitBox
mehakmeet edited a comment on pull request #3406: URL: https://github.com/apache/hadoop/pull/3406#issuecomment-920146490 Adding 2 new test files: - hadoop-common-project/hadoop-common/src/test/java/org/apache/hadoop/fs/store/TestDataBlocks.java -

[jira] [Work logged] (HADOOP-17905) Modify Text.ensureCapacity() to efficiently max out the backing array size

2021-09-15 Thread ASF GitHub Bot (Jira)
[ https://issues.apache.org/jira/browse/HADOOP-17905?focusedWorklogId=651220=com.atlassian.jira.plugin.system.issuetabpanels:worklog-tabpanel#worklog-651220 ] ASF GitHub Bot logged work on HADOOP-17905: --- Author: ASF GitHub Bot

[GitHub] [hadoop] hadoop-yetus commented on pull request #3423: HADOOP-17905. Modify Text.ensureCapacity() to efficiently max out the…

2021-09-15 Thread GitBox
hadoop-yetus commented on pull request #3423: URL: https://github.com/apache/hadoop/pull/3423#issuecomment-920209887 :broken_heart: **-1 overall** | Vote | Subsystem | Runtime | Logfile | Comment | |::|--:|:|::|:---:| | +0

[jira] [Work logged] (HADOOP-17905) Modify Text.ensureCapacity() to efficiently max out the backing array size

2021-09-15 Thread ASF GitHub Bot (Jira)
[ https://issues.apache.org/jira/browse/HADOOP-17905?focusedWorklogId=651216=com.atlassian.jira.plugin.system.issuetabpanels:worklog-tabpanel#worklog-651216 ] ASF GitHub Bot logged work on HADOOP-17905: --- Author: ASF GitHub Bot

[GitHub] [hadoop] hadoop-yetus commented on pull request #3423: HADOOP-17905. Modify Text.ensureCapacity() to efficiently max out the…

2021-09-15 Thread GitBox
hadoop-yetus commented on pull request #3423: URL: https://github.com/apache/hadoop/pull/3423#issuecomment-920207873 :broken_heart: **-1 overall** | Vote | Subsystem | Runtime | Logfile | Comment | |::|--:|:|::|:---:| | +0

[GitHub] [hadoop] xkrogen merged pull request #3317: HDFS-16181. [SBN Read] Fix metric of RpcRequestCacheMissAmount can't display when tailEditLog form JN

2021-09-15 Thread GitBox
xkrogen merged pull request #3317: URL: https://github.com/apache/hadoop/pull/3317 -- This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use the URL above to go to the specific comment. To unsubscribe, e-mail:

[GitHub] [hadoop] sumangala-patki opened a new pull request #3440: ABFS: Support for Encryption Context

2021-09-15 Thread GitBox
sumangala-patki opened a new pull request #3440: URL: https://github.com/apache/hadoop/pull/3440 Draft PR -- This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use the URL above to go to the specific comment. To unsubscribe,

[GitHub] [hadoop] hadoop-yetus commented on pull request #3386: HDFS-16213. De-flake TestFsDatasetImpl#testDnRestartWithHardLink

2021-09-15 Thread GitBox
hadoop-yetus commented on pull request #3386: URL: https://github.com/apache/hadoop/pull/3386#issuecomment-920182740 :broken_heart: **-1 overall** | Vote | Subsystem | Runtime | Logfile | Comment | |::|--:|:|::|:---:| | +0

[GitHub] [hadoop] akshatb1 opened a new pull request #3439: YARN-10957. Using invokeConcurrent Overload with Collection in getClusterMetrics

2021-09-15 Thread GitBox
akshatb1 opened a new pull request #3439: URL: https://github.com/apache/hadoop/pull/3439 - In #3135, we added a new overload of invokeConcurrent to avoid ArrayList initialization at multiple places. Using the same in getClusterMetrics. - Verified the unit tests for

[GitHub] [hadoop] JackWangCS opened a new pull request #3438: YARN-10951. Move async scheduling logic to a new AsyncSchedulingManager

2021-09-15 Thread GitBox
JackWangCS opened a new pull request #3438: URL: https://github.com/apache/hadoop/pull/3438 ### Description of PR Move async scheduling logic to a new class ### How was this patch tested? ### For code changes: - [Yes] Does the title or this PR starts with the

[jira] [Work logged] (HADOOP-17195) Intermittent OutOfMemory error while performing hdfs CopyFromLocal to abfs

2021-09-15 Thread ASF GitHub Bot (Jira)
[ https://issues.apache.org/jira/browse/HADOOP-17195?focusedWorklogId=651185=com.atlassian.jira.plugin.system.issuetabpanels:worklog-tabpanel#worklog-651185 ] ASF GitHub Bot logged work on HADOOP-17195: --- Author: ASF GitHub Bot

  1   2   >