[GitHub] [hadoop] tomscut commented on a change in pull request #3664: HDFS-16314. Support to make dfs.namenode.block-placement-policy.exclude-slow-nodes.enabled reconfigurable

2021-11-24 Thread GitBox
tomscut commented on a change in pull request #3664: URL: https://github.com/apache/hadoop/pull/3664#discussion_r756628602 ## File path: hadoop-hdfs-project/hadoop-hdfs/src/main/java/org/apache/hadoop/hdfs/server/blockmanagement/BlockManager.java ## @@ -5360,4 +5360,14 @@

[GitHub] [hadoop] hadoop-yetus commented on pull request #3718: YARN-9063. ATS 1.5 fails to start if RollingLevelDb files are corrupt or missing

2021-11-24 Thread GitBox
hadoop-yetus commented on pull request #3718: URL: https://github.com/apache/hadoop/pull/3718#issuecomment-978897353 :confetti_ball: **+1 overall** | Vote | Subsystem | Runtime | Comment | |::|--:|:|:| | +0 :ok: | reexec | 20m

[GitHub] [hadoop] hadoop-yetus commented on pull request #3716: HDFS-16327. Make DFS_NAMENODE_MAX_SLOWPEER_COLLECT_NODES_KEY reconfig…

2021-11-24 Thread GitBox
hadoop-yetus commented on pull request #3716: URL: https://github.com/apache/hadoop/pull/3716#issuecomment-978896164 :confetti_ball: **+1 overall** | Vote | Subsystem | Runtime | Logfile | Comment | |::|--:|:|::|:---:| | +0

[GitHub] [hadoop] haiyang1987 commented on pull request #3664: HDFS-16314. Support to make dfs.namenode.block-placement-policy.exclude-slow-nodes.enabled reconfigurable

2021-11-24 Thread GitBox
haiyang1987 commented on pull request #3664: URL: https://github.com/apache/hadoop/pull/3664#issuecomment-978891642 @ferhui @tomscut Could you please take a look? Thanks. -- This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and

[jira] [Work logged] (HADOOP-18022) Add restrict-imports-enforcer-rule for Guava Preconditions in hadoop-main pom

2021-11-24 Thread ASF GitHub Bot (Jira)
[ https://issues.apache.org/jira/browse/HADOOP-18022?focusedWorklogId=686247=com.atlassian.jira.plugin.system.issuetabpanels:worklog-tabpanel#worklog-686247 ] ASF GitHub Bot logged work on HADOOP-18022: --- Author: ASF GitHub Bot

[GitHub] [hadoop] virajjasani commented on pull request #3712: HADOOP-18022. Add restrict-imports-enforcer-rule for Guava Preconditions in hadoop-main pom

2021-11-24 Thread GitBox
virajjasani commented on pull request #3712: URL: https://github.com/apache/hadoop/pull/3712#issuecomment-978886529 Removed Preconditions usage from `hadoop-yarn-server-timelineservice-hbase` module because test module `hadoop-yarn-server-timelineservice-hbase-tests` depends on hbase

[jira] [Commented] (HADOOP-18023) Allow cp command to run with multi threads.

2021-11-24 Thread Chengwei Wang (Jira)
[ https://issues.apache.org/jira/browse/HADOOP-18023?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17448964#comment-17448964 ] Chengwei Wang commented on HADOOP-18023: Created PR  https://github.com/apache/hadoop/pull/3721

[jira] [Work logged] (HADOOP-18023) Allow cp command to run with multi threads.

2021-11-24 Thread ASF GitHub Bot (Jira)
[ https://issues.apache.org/jira/browse/HADOOP-18023?focusedWorklogId=686246=com.atlassian.jira.plugin.system.issuetabpanels:worklog-tabpanel#worklog-686246 ] ASF GitHub Bot logged work on HADOOP-18023: --- Author: ASF GitHub Bot

[jira] [Updated] (HADOOP-18023) Allow cp command to run with multi threads.

2021-11-24 Thread ASF GitHub Bot (Jira)
[ https://issues.apache.org/jira/browse/HADOOP-18023?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] ASF GitHub Bot updated HADOOP-18023: Labels: pull-request-available (was: ) > Allow cp command to run with multi threads. >

[GitHub] [hadoop] smarthanwang opened a new pull request #3721: HADOOP-18023. Allow cp command to run with multi threads.

2021-11-24 Thread GitBox
smarthanwang opened a new pull request #3721: URL: https://github.com/apache/hadoop/pull/3721 JIRA: https://issues.apache.org/jira/browse/HADOOP-18023 ### Description of PR Allow hadoop fs -cp command to run with multi-thread to improve copy speed. ### How was

[GitHub] [hadoop] virajjasani opened a new pull request #3720: HDFS-16171. De-flake testDecommissionStatus (#3280)

2021-11-24 Thread GitBox
virajjasani opened a new pull request #3720: URL: https://github.com/apache/hadoop/pull/3720 ### Description of PR testDecommissionStatus keeps failing intermittently. ``` [ERROR]

[jira] [Work logged] (HADOOP-18024) SocketChannel is not closed when IOException happens in Server$Listener.doAccept

2021-11-24 Thread ASF GitHub Bot (Jira)
[ https://issues.apache.org/jira/browse/HADOOP-18024?focusedWorklogId=686238=com.atlassian.jira.plugin.system.issuetabpanels:worklog-tabpanel#worklog-686238 ] ASF GitHub Bot logged work on HADOOP-18024: --- Author: ASF GitHub Bot

[jira] [Work logged] (HADOOP-18024) SocketChannel is not closed when IOException happens in Server$Listener.doAccept

2021-11-24 Thread ASF GitHub Bot (Jira)
[ https://issues.apache.org/jira/browse/HADOOP-18024?focusedWorklogId=686237=com.atlassian.jira.plugin.system.issuetabpanels:worklog-tabpanel#worklog-686237 ] ASF GitHub Bot logged work on HADOOP-18024: --- Author: ASF GitHub Bot

[GitHub] [hadoop] functioner edited a comment on pull request #3719: HADOOP-18024. SocketChannel is not closed when IOException happens in Server$Listener.doAccept

2021-11-24 Thread GitBox
functioner edited a comment on pull request #3719: URL: https://github.com/apache/hadoop/pull/3719#issuecomment-978854702 This is a follow-up for https://github.com/apache/hadoop/pull/2727. @iwasakims @ferhui We previously had some discussion in

[GitHub] [hadoop] functioner commented on pull request #3719: HADOOP-18024. SocketChannel is not closed when IOException happens in Server$Listener.doAccept

2021-11-24 Thread GitBox
functioner commented on pull request #3719: URL: https://github.com/apache/hadoop/pull/3719#issuecomment-978854702 This is a follow-up for https://github.com/apache/hadoop/pull/2727. @iwasakims @ferhui We previously had some discussion in https://github.com/apache/hadoop/pull/2727. So

[jira] [Work logged] (HADOOP-18022) Add restrict-imports-enforcer-rule for Guava Preconditions in hadoop-main pom

2021-11-24 Thread ASF GitHub Bot (Jira)
[ https://issues.apache.org/jira/browse/HADOOP-18022?focusedWorklogId=686235=com.atlassian.jira.plugin.system.issuetabpanels:worklog-tabpanel#worklog-686235 ] ASF GitHub Bot logged work on HADOOP-18022: --- Author: ASF GitHub Bot

[GitHub] [hadoop] virajjasani commented on pull request #3712: HADOOP-18022. Add restrict-imports-enforcer-rule for Guava Preconditions in hadoop-main pom

2021-11-24 Thread GitBox
virajjasani commented on pull request #3712: URL: https://github.com/apache/hadoop/pull/3712#issuecomment-978852808 JFYI @tasanuma, I am working on some test failures. Hopefully QA result tomorrow should be clean. -- This is an automated message from the Apache Git Service. To respond

[jira] [Work logged] (HADOOP-18024) SocketChannel is not closed when IOException happens in Server$Listener.doAccept

2021-11-24 Thread ASF GitHub Bot (Jira)
[ https://issues.apache.org/jira/browse/HADOOP-18024?focusedWorklogId=686234=com.atlassian.jira.plugin.system.issuetabpanels:worklog-tabpanel#worklog-686234 ] ASF GitHub Bot logged work on HADOOP-18024: --- Author: ASF GitHub Bot

[jira] [Updated] (HADOOP-18024) SocketChannel is not closed when IOException happens in Server$Listener.doAccept

2021-11-24 Thread ASF GitHub Bot (Jira)
[ https://issues.apache.org/jira/browse/HADOOP-18024?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] ASF GitHub Bot updated HADOOP-18024: Labels: pull-request-available (was: ) > SocketChannel is not closed when IOException

[GitHub] [hadoop] functioner opened a new pull request #3719: HADOOP-18024. SocketChannel is not closed when IOException happens in Server$Listener.doAccept

2021-11-24 Thread GitBox
functioner opened a new pull request #3719: URL: https://github.com/apache/hadoop/pull/3719 ### Description of PR [HADOOP-18024](https://issues.apache.org/jira/browse/HADOOP-18024) ### How was this patch tested? ### For code changes: - [ ] Does the title or

[jira] [Updated] (HADOOP-18024) SocketChannel is not closed when IOException happens in Server$Listener.doAccept

2021-11-24 Thread Haoze Wu (Jira)
[ https://issues.apache.org/jira/browse/HADOOP-18024?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Haoze Wu updated HADOOP-18024: -- Description: This is a follow-up of HADOOP-17552. When the symptom described in HADOOP-17552

[jira] [Work logged] (HADOOP-18022) Add restrict-imports-enforcer-rule for Guava Preconditions in hadoop-main pom

2021-11-24 Thread ASF GitHub Bot (Jira)
[ https://issues.apache.org/jira/browse/HADOOP-18022?focusedWorklogId=686230=com.atlassian.jira.plugin.system.issuetabpanels:worklog-tabpanel#worklog-686230 ] ASF GitHub Bot logged work on HADOOP-18022: --- Author: ASF GitHub Bot

[GitHub] [hadoop] hadoop-yetus commented on pull request #3712: HADOOP-18022. Add restrict-imports-enforcer-rule for Guava Preconditions in hadoop-main pom

2021-11-24 Thread GitBox
hadoop-yetus commented on pull request #3712: URL: https://github.com/apache/hadoop/pull/3712#issuecomment-978847696 :broken_heart: **-1 overall** | Vote | Subsystem | Runtime | Logfile | Comment | |::|--:|:|::|:---:| | +0

[jira] [Updated] (HADOOP-18024) SocketChannel is not closed when IOException happens in Server$Listener.doAccept

2021-11-24 Thread Haoze Wu (Jira)
[ https://issues.apache.org/jira/browse/HADOOP-18024?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Haoze Wu updated HADOOP-18024: -- Description: This is a follow-up of HADOOP-17552. When the symptom described in HADOOP-17552

[jira] [Created] (HADOOP-18024) SocketChannel is not closed when IOException happens in Server$Listener.doAccept

2021-11-24 Thread Haoze Wu (Jira)
Haoze Wu created HADOOP-18024: - Summary: SocketChannel is not closed when IOException happens in Server$Listener.doAccept Key: HADOOP-18024 URL: https://issues.apache.org/jira/browse/HADOOP-18024

[jira] [Updated] (HADOOP-18024) SocketChannel is not closed when IOException happens in Server$Listener.doAccept

2021-11-24 Thread Haoze Wu (Jira)
[ https://issues.apache.org/jira/browse/HADOOP-18024?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Haoze Wu updated HADOOP-18024: -- Description: This is a follow-up of HADOOP-17552. When the symptom described in

[jira] [Resolved] (HADOOP-18014) CallerContext should not include some characters

2021-11-24 Thread Takanobu Asanuma (Jira)
[ https://issues.apache.org/jira/browse/HADOOP-18014?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Takanobu Asanuma resolved HADOOP-18014. --- Fix Version/s: 3.4.0 Resolution: Fixed > CallerContext should not include

[jira] [Work logged] (HADOOP-18014) CallerContext should not include some characters

2021-11-24 Thread ASF GitHub Bot (Jira)
[ https://issues.apache.org/jira/browse/HADOOP-18014?focusedWorklogId=686222=com.atlassian.jira.plugin.system.issuetabpanels:worklog-tabpanel#worklog-686222 ] ASF GitHub Bot logged work on HADOOP-18014: --- Author: ASF GitHub Bot

[GitHub] [hadoop] tasanuma commented on pull request #3698: HADOOP-18014. CallerContext should not include some characters.

2021-11-24 Thread GitBox
tasanuma commented on pull request #3698: URL: https://github.com/apache/hadoop/pull/3698#issuecomment-978839353 Merged it. Thanks for your reviews, @virajjasani, @liuml07, @ferhui! -- This is an automated message from the Apache Git Service. To respond to the message, please log on to

[jira] [Work logged] (HADOOP-18014) CallerContext should not include some characters

2021-11-24 Thread ASF GitHub Bot (Jira)
[ https://issues.apache.org/jira/browse/HADOOP-18014?focusedWorklogId=686223=com.atlassian.jira.plugin.system.issuetabpanels:worklog-tabpanel#worklog-686223 ] ASF GitHub Bot logged work on HADOOP-18014: --- Author: ASF GitHub Bot

[GitHub] [hadoop] tasanuma merged pull request #3698: HADOOP-18014. CallerContext should not include some characters.

2021-11-24 Thread GitBox
tasanuma merged pull request #3698: URL: https://github.com/apache/hadoop/pull/3698 -- This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use the URL above to go to the specific comment. To unsubscribe, e-mail:

[jira] [Commented] (HADOOP-18023) Allow cp command to run with multi threads.

2021-11-24 Thread Yi-Sheng Lien (Jira)
[ https://issues.apache.org/jira/browse/HADOOP-18023?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17448936#comment-17448936 ] Yi-Sheng Lien commented on HADOOP-18023: Oh, it seems interesting. > Allow cp command to run

[GitHub] [hadoop] tomscut commented on a change in pull request #3684: HDFS-16338. Correct fsimage error configuration message

2021-11-24 Thread GitBox
tomscut commented on a change in pull request #3684: URL: https://github.com/apache/hadoop/pull/3684#discussion_r756573192 ## File path: hadoop-hdfs-project/hadoop-hdfs/src/test/java/org/apache/hadoop/hdfs/server/namenode/TestFSImage.java ## @@ -275,6 +276,31 @@ public void

[jira] [Commented] (HADOOP-18023) Allow cp command to run with multi threads.

2021-11-24 Thread Chengwei Wang (Jira)
[ https://issues.apache.org/jira/browse/HADOOP-18023?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17448922#comment-17448922 ] Chengwei Wang commented on HADOOP-18023: It's useful to allow  _*-cp*_ command to  run with

[jira] [Updated] (HADOOP-18023) Allow cp command to run with multi threads.

2021-11-24 Thread Chengwei Wang (Jira)
[ https://issues.apache.org/jira/browse/HADOOP-18023?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Chengwei Wang updated HADOOP-18023: --- Description: Allow _*hadoop fs -cp*_ command to  run with multi-thread to improve copy

[jira] [Created] (HADOOP-18023) Allow cp command to run with multi threads.

2021-11-24 Thread Chengwei Wang (Jira)
Chengwei Wang created HADOOP-18023: -- Summary: Allow cp command to run with multi threads. Key: HADOOP-18023 URL: https://issues.apache.org/jira/browse/HADOOP-18023 Project: Hadoop Common

[GitHub] [hadoop] tomscut commented on pull request #3695: HDFS-16344. Improve DirectoryScanner.Stats#toString

2021-11-24 Thread GitBox
tomscut commented on pull request #3695: URL: https://github.com/apache/hadoop/pull/3695#issuecomment-978777820 > Hi @ferhui , please also take a look. Thanks a lot. Thanks @ferhui for your review. -- This is an automated message from the Apache Git Service. To respond to the

[GitHub] [hadoop] tomscut commented on pull request #3695: HDFS-16344. Improve DirectoryScanner.Stats#toString

2021-11-24 Thread GitBox
tomscut commented on pull request #3695: URL: https://github.com/apache/hadoop/pull/3695#issuecomment-978756310 Hi @ferhui , please also take a look. Thanks a lot. -- This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use the

[GitHub] [hadoop] ferhui commented on pull request #3711: HDFS-16350. Datanode start time should be set after RPC server starts successfully

2021-11-24 Thread GitBox
ferhui commented on pull request #3711: URL: https://github.com/apache/hadoop/pull/3711#issuecomment-978750666 @virajjasani Thanks for contribution. @tomscut Thanks for review! -- This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub

[GitHub] [hadoop] ferhui merged pull request #3711: HDFS-16350. Datanode start time should be set after RPC server starts successfully

2021-11-24 Thread GitBox
ferhui merged pull request #3711: URL: https://github.com/apache/hadoop/pull/3711 -- This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use the URL above to go to the specific comment. To unsubscribe, e-mail:

[jira] [Resolved] (HADOOP-17995) Stale record should be remove when DataNodePeerMetrics#dumpSendPacketDownstreamAvgInfoAsJson

2021-11-24 Thread Hui Fei (Jira)
[ https://issues.apache.org/jira/browse/HADOOP-17995?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Hui Fei resolved HADOOP-17995. -- Resolution: Fixed > Stale record should be remove when >

[jira] [Work logged] (HADOOP-17995) Stale record should be remove when DataNodePeerMetrics#dumpSendPacketDownstreamAvgInfoAsJson

2021-11-24 Thread ASF GitHub Bot (Jira)
[ https://issues.apache.org/jira/browse/HADOOP-17995?focusedWorklogId=686183=com.atlassian.jira.plugin.system.issuetabpanels:worklog-tabpanel#worklog-686183 ] ASF GitHub Bot logged work on HADOOP-17995: --- Author: ASF GitHub Bot

[GitHub] [hadoop] ferhui commented on pull request #3708: HADOOP-17995. Stale record should be remove when DataNodePeerMetrics#dumpSendPacketDownstreamAvgInfoAsJson

2021-11-24 Thread GitBox
ferhui commented on pull request #3708: URL: https://github.com/apache/hadoop/pull/3708#issuecomment-978748011 @haiyang1987 Thanks for fixing. @sodonnel Thanks for review! -- This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and

[jira] [Work logged] (HADOOP-17995) Stale record should be remove when DataNodePeerMetrics#dumpSendPacketDownstreamAvgInfoAsJson

2021-11-24 Thread ASF GitHub Bot (Jira)
[ https://issues.apache.org/jira/browse/HADOOP-17995?focusedWorklogId=686182=com.atlassian.jira.plugin.system.issuetabpanels:worklog-tabpanel#worklog-686182 ] ASF GitHub Bot logged work on HADOOP-17995: --- Author: ASF GitHub Bot

[GitHub] [hadoop] ferhui merged pull request #3708: HADOOP-17995. Stale record should be remove when DataNodePeerMetrics#dumpSendPacketDownstreamAvgInfoAsJson

2021-11-24 Thread GitBox
ferhui merged pull request #3708: URL: https://github.com/apache/hadoop/pull/3708 -- This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use the URL above to go to the specific comment. To unsubscribe, e-mail:

[jira] [Work logged] (HADOOP-18014) CallerContext should not include some characters

2021-11-24 Thread ASF GitHub Bot (Jira)
[ https://issues.apache.org/jira/browse/HADOOP-18014?focusedWorklogId=686179=com.atlassian.jira.plugin.system.issuetabpanels:worklog-tabpanel#worklog-686179 ] ASF GitHub Bot logged work on HADOOP-18014: --- Author: ASF GitHub Bot

[jira] [Work logged] (HADOOP-18014) CallerContext should not include some characters

2021-11-24 Thread ASF GitHub Bot (Jira)
[ https://issues.apache.org/jira/browse/HADOOP-18014?focusedWorklogId=686180=com.atlassian.jira.plugin.system.issuetabpanels:worklog-tabpanel#worklog-686180 ] ASF GitHub Bot logged work on HADOOP-18014: --- Author: ASF GitHub Bot

[GitHub] [hadoop] tasanuma commented on pull request #3683: HADOOP-18014. CallerContext should not include some characters.

2021-11-24 Thread GitBox
tasanuma commented on pull request #3683: URL: https://github.com/apache/hadoop/pull/3683#issuecomment-978730121 I'm closing this PR since #3698 supersede it. @ferhui @goiri If you have any concerns, please comment on #3698. Thanks. -- This is an automated message from the Apache Git

[GitHub] [hadoop] tasanuma closed pull request #3683: HADOOP-18014. CallerContext should not include some characters.

2021-11-24 Thread GitBox
tasanuma closed pull request #3683: URL: https://github.com/apache/hadoop/pull/3683 -- This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use the URL above to go to the specific comment. To unsubscribe, e-mail:

[GitHub] [hadoop] hadoop-yetus commented on pull request #3716: HDFS-16327. Make DFS_NAMENODE_MAX_SLOWPEER_COLLECT_NODES_KEY reconfig…

2021-11-24 Thread GitBox
hadoop-yetus commented on pull request #3716: URL: https://github.com/apache/hadoop/pull/3716#issuecomment-978728015 :broken_heart: **-1 overall** | Vote | Subsystem | Runtime | Logfile | Comment | |::|--:|:|::|:---:| | +0

[jira] [Work logged] (HADOOP-18022) Add restrict-imports-enforcer-rule for Guava Preconditions in hadoop-main pom

2021-11-24 Thread ASF GitHub Bot (Jira)
[ https://issues.apache.org/jira/browse/HADOOP-18022?focusedWorklogId=686125=com.atlassian.jira.plugin.system.issuetabpanels:worklog-tabpanel#worklog-686125 ] ASF GitHub Bot logged work on HADOOP-18022: --- Author: ASF GitHub Bot

[GitHub] [hadoop] hadoop-yetus commented on pull request #3712: HADOOP-18022. Add restrict-imports-enforcer-rule for Guava Preconditions in hadoop-main pom

2021-11-24 Thread GitBox
hadoop-yetus commented on pull request #3712: URL: https://github.com/apache/hadoop/pull/3712#issuecomment-978423492 :broken_heart: **-1 overall** | Vote | Subsystem | Runtime | Logfile | Comment | |::|--:|:|::|:---:| | +0

[jira] [Commented] (HADOOP-18019) S3AFileSystem.s3GetFileStatus() doesn't find dir markers on minio

2021-11-24 Thread Ruslan Dautkhanov (Jira)
[ https://issues.apache.org/jira/browse/HADOOP-18019?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17448863#comment-17448863 ] Ruslan Dautkhanov commented on HADOOP-18019: [~y4m4] does this mean that other deployment

[jira] [Work logged] (HADOOP-16202) Stabilize openFile() and adopt internally

2021-11-24 Thread ASF GitHub Bot (Jira)
[ https://issues.apache.org/jira/browse/HADOOP-16202?focusedWorklogId=686121=com.atlassian.jira.plugin.system.issuetabpanels:worklog-tabpanel#worklog-686121 ] ASF GitHub Bot logged work on HADOOP-16202: --- Author: ASF GitHub Bot

[GitHub] [hadoop] hadoop-yetus commented on pull request #2584: HADOOP-16202. Enhance openFile()

2021-11-24 Thread GitBox
hadoop-yetus commented on pull request #2584: URL: https://github.com/apache/hadoop/pull/2584#issuecomment-978376044 :broken_heart: **-1 overall** | Vote | Subsystem | Runtime | Logfile | Comment | |::|--:|:|::|:---:| | +0

[GitHub] [hadoop] hadoop-yetus commented on pull request #3717: YARN-11005. Implement the core QUEUE_LENGTH_THEN_RESOURCES OContainer allocation policy

2021-11-24 Thread GitBox
hadoop-yetus commented on pull request #3717: URL: https://github.com/apache/hadoop/pull/3717#issuecomment-978340289 :broken_heart: **-1 overall** | Vote | Subsystem | Runtime | Logfile | Comment | |::|--:|:|::|:---:| | +0

[GitHub] [hadoop] hadoop-yetus commented on pull request #3713: HDFS-16351. add path exception information in FSNamesystem

2021-11-24 Thread GitBox
hadoop-yetus commented on pull request #3713: URL: https://github.com/apache/hadoop/pull/3713#issuecomment-978260914 :broken_heart: **-1 overall** | Vote | Subsystem | Runtime | Logfile | Comment | |::|--:|:|::|:---:| | +0

[jira] [Work logged] (HADOOP-18001) Update to Jetty 9.4.44

2021-11-24 Thread ASF GitHub Bot (Jira)
[ https://issues.apache.org/jira/browse/HADOOP-18001?focusedWorklogId=686087=com.atlassian.jira.plugin.system.issuetabpanels:worklog-tabpanel#worklog-686087 ] ASF GitHub Bot logged work on HADOOP-18001: --- Author: ASF GitHub Bot

[GitHub] [hadoop] hadoop-yetus commented on pull request #3700: HADOOP-18001. Upgrade jetty version to 9.4.44

2021-11-24 Thread GitBox
hadoop-yetus commented on pull request #3700: URL: https://github.com/apache/hadoop/pull/3700#issuecomment-978208963 :broken_heart: **-1 overall** | Vote | Subsystem | Runtime | Logfile | Comment | |::|--:|:|::|:---:| | +0

[GitHub] [hadoop] hadoop-yetus commented on pull request #3716: HDFS-16327. Make DFS_NAMENODE_MAX_SLOWPEER_COLLECT_NODES_KEY reconfig…

2021-11-24 Thread GitBox
hadoop-yetus commented on pull request #3716: URL: https://github.com/apache/hadoop/pull/3716#issuecomment-978207280 :broken_heart: **-1 overall** | Vote | Subsystem | Runtime | Logfile | Comment | |::|--:|:|::|:---:| | +0

[GitHub] [hadoop] ashutoshcipher opened a new pull request #3718: YARN-9063. ATS 1.5 fails to start if RollingLevelDb files are corrupt or missing

2021-11-24 Thread GitBox
ashutoshcipher opened a new pull request #3718: URL: https://github.com/apache/hadoop/pull/3718 ### Description of PR Jira: https://issues.apache.org/jira/browse/YARN-9063 ATS 1.5 fails to start if RollingLevelDb files are corrupt or missing ### How was this patch tested?

[jira] [Commented] (HADOOP-18019) S3AFileSystem.s3GetFileStatus() doesn't find dir markers on minio

2021-11-24 Thread Harshavardhana (Jira)
[ https://issues.apache.org/jira/browse/HADOOP-18019?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17448767#comment-17448767 ] Harshavardhana commented on HADOOP-18019: - [~ste...@apache.org] yes it is confirmed we closed

[GitHub] [hadoop] afchung opened a new pull request #3717: YARN-11005. Implement the core QUEUE_LENGTH_THEN_RESOURCES OContainer allocation policy

2021-11-24 Thread GitBox
afchung opened a new pull request #3717: URL: https://github.com/apache/hadoop/pull/3717 ### Description of PR * Implement the `QUEUE_LENGTH_THEN_RESOURCES` `LoadComparator` * Add `Resource` requested to select node methods when allocating `OPPORTUNISTIC` containers * Add node

[jira] [Work logged] (HADOOP-17979) Interface EtagSource to allow FileStatus subclasses to provide etags

2021-11-24 Thread ASF GitHub Bot (Jira)
[ https://issues.apache.org/jira/browse/HADOOP-17979?focusedWorklogId=686014=com.atlassian.jira.plugin.system.issuetabpanels:worklog-tabpanel#worklog-686014 ] ASF GitHub Bot logged work on HADOOP-17979: --- Author: ASF GitHub Bot

[GitHub] [hadoop] steveloughran merged pull request #3633: HADOOP-17979. Add Interface EtagSource to allow FileStatus subclasses to provide etags

2021-11-24 Thread GitBox
steveloughran merged pull request #3633: URL: https://github.com/apache/hadoop/pull/3633 -- This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use the URL above to go to the specific comment. To unsubscribe, e-mail:

[jira] [Work logged] (HADOOP-17979) Interface EtagSource to allow FileStatus subclasses to provide etags

2021-11-24 Thread ASF GitHub Bot (Jira)
[ https://issues.apache.org/jira/browse/HADOOP-17979?focusedWorklogId=685994=com.atlassian.jira.plugin.system.issuetabpanels:worklog-tabpanel#worklog-685994 ] ASF GitHub Bot logged work on HADOOP-17979: --- Author: ASF GitHub Bot

[GitHub] [hadoop] hadoop-yetus removed a comment on pull request #3633: HADOOP-17979. Add Interface EtagSource to allow FileStatus subclasses to provide etags

2021-11-24 Thread GitBox
hadoop-yetus removed a comment on pull request #3633: URL: https://github.com/apache/hadoop/pull/3633#issuecomment-973321373 :broken_heart: **-1 overall** | Vote | Subsystem | Runtime | Logfile | Comment | |::|--:|:|::|:---:|

[GitHub] [hadoop] hadoop-yetus commented on pull request #3715: YARN-11014. YARN incorrectly validates maximum capacity resources on …

2021-11-24 Thread GitBox
hadoop-yetus commented on pull request #3715: URL: https://github.com/apache/hadoop/pull/3715#issuecomment-978045418 :confetti_ball: **+1 overall** | Vote | Subsystem | Runtime | Logfile | Comment | |::|--:|:|::|:---:| | +0

[jira] [Work logged] (HADOOP-18021) Provide a public wrapper of Configuration#substituteVars

2021-11-24 Thread ASF GitHub Bot (Jira)
[ https://issues.apache.org/jira/browse/HADOOP-18021?focusedWorklogId=685953=com.atlassian.jira.plugin.system.issuetabpanels:worklog-tabpanel#worklog-685953 ] ASF GitHub Bot logged work on HADOOP-18021: --- Author: ASF GitHub Bot

[GitHub] [hadoop] steveloughran commented on pull request #3710: HADOOP-18021. Provide a public wrapper of Configuration#substituteVars

2021-11-24 Thread GitBox
steveloughran commented on pull request #3710: URL: https://github.com/apache/hadoop/pull/3710#issuecomment-978012968 just make sure the new public method does some substitution -simply to make sure the wire up never breaks -- This is an automated message from the Apache Git

[GitHub] [hadoop] GuoPhilipse commented on pull request #3713: HDFS-16351. add path exception information in FSNamesystem

2021-11-24 Thread GitBox
GuoPhilipse commented on pull request #3713: URL: https://github.com/apache/hadoop/pull/3713#issuecomment-978005246 > Thanks for writing the test @GuoPhilipse. Could you also add one additional test in `TestDFSPermission` because that way we can also test creating some file and then test

[GitHub] [hadoop] aajisaka merged pull request #3686: HDFS-16336. De-flake TestRollingUpgrade#testRollback

2021-11-24 Thread GitBox
aajisaka merged pull request #3686: URL: https://github.com/apache/hadoop/pull/3686 -- This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use the URL above to go to the specific comment. To unsubscribe, e-mail:

[GitHub] [hadoop] hadoop-yetus commented on pull request #3713: HDFS-16351. add path exception information in FSNamesystem

2021-11-24 Thread GitBox
hadoop-yetus commented on pull request #3713: URL: https://github.com/apache/hadoop/pull/3713#issuecomment-977882525 :confetti_ball: **+1 overall** | Vote | Subsystem | Runtime | Logfile | Comment | |::|--:|:|::|:---:| | +0

[jira] [Work logged] (HADOOP-15566) Support OpenTelemetry

2021-11-24 Thread ASF GitHub Bot (Jira)
[ https://issues.apache.org/jira/browse/HADOOP-15566?focusedWorklogId=685828=com.atlassian.jira.plugin.system.issuetabpanels:worklog-tabpanel#worklog-685828 ] ASF GitHub Bot logged work on HADOOP-15566: --- Author: ASF GitHub Bot

[GitHub] [hadoop] hadoop-yetus commented on pull request #3445: HADOOP-15566 Opentelemetry changes using java agent

2021-11-24 Thread GitBox
hadoop-yetus commented on pull request #3445: URL: https://github.com/apache/hadoop/pull/3445#issuecomment-977877431 :broken_heart: **-1 overall** | Vote | Subsystem | Runtime | Logfile | Comment | |::|--:|:|::|:---:| | +0

[jira] [Commented] (HADOOP-18019) S3AFileSystem.s3GetFileStatus() doesn't find dir markers on minio

2021-11-24 Thread Steve Loughran (Jira)
[ https://issues.apache.org/jira/browse/HADOOP-18019?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17448573#comment-17448573 ] Steve Loughran commented on HADOOP-18019: - ok, so this is an aspect of minio single mode

[GitHub] [hadoop] tomscut opened a new pull request #3716: HDFS-16327. Make DFS_NAMENODE_MAX_SLOWPEER_COLLECT_NODES_KEY reconfig…

2021-11-24 Thread GitBox
tomscut opened a new pull request #3716: URL: https://github.com/apache/hadoop/pull/3716 JIRA: [HDFS-16327](https://issues.apache.org/jira/browse/HDFS-16327). As the HDFS cluster expands or shrinks, the number of slow nodes to be filtered must be dynamically adjusted. So we should

[jira] [Resolved] (HADOOP-17975) Fallback to simple auth does not work for a secondary DistributedFileSystem instance

2021-11-24 Thread Stephen O'Donnell (Jira)
[ https://issues.apache.org/jira/browse/HADOOP-17975?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Stephen O'Donnell resolved HADOOP-17975. Resolution: Fixed > Fallback to simple auth does not work for a secondary

[jira] [Updated] (HADOOP-17975) Fallback to simple auth does not work for a secondary DistributedFileSystem instance

2021-11-24 Thread Stephen O'Donnell (Jira)
[ https://issues.apache.org/jira/browse/HADOOP-17975?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Stephen O'Donnell updated HADOOP-17975: --- Fix Version/s: 3.2.4 > Fallback to simple auth does not work for a secondary

[jira] [Work logged] (HADOOP-15566) Support OpenTelemetry

2021-11-24 Thread ASF GitHub Bot (Jira)
[ https://issues.apache.org/jira/browse/HADOOP-15566?focusedWorklogId=685784=com.atlassian.jira.plugin.system.issuetabpanels:worklog-tabpanel#worklog-685784 ] ASF GitHub Bot logged work on HADOOP-15566: --- Author: ASF GitHub Bot

[GitHub] [hadoop] hadoop-yetus commented on pull request #3445: HADOOP-15566 Opentelemetry changes using java agent

2021-11-24 Thread GitBox
hadoop-yetus commented on pull request #3445: URL: https://github.com/apache/hadoop/pull/3445#issuecomment-977765468 :broken_heart: **-1 overall** | Vote | Subsystem | Runtime | Logfile | Comment | |::|--:|:|::|:---:| | +0

[jira] [Updated] (HADOOP-17975) Fallback to simple auth does not work for a secondary DistributedFileSystem instance

2021-11-24 Thread Stephen O'Donnell (Jira)
[ https://issues.apache.org/jira/browse/HADOOP-17975?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Stephen O'Donnell updated HADOOP-17975: --- Fix Version/s: 3.4.0 3.3.3 > Fallback to simple auth does not

[jira] [Work logged] (HADOOP-17995) Stale record should be remove when DataNodePeerMetrics#dumpSendPacketDownstreamAvgInfoAsJson

2021-11-24 Thread ASF GitHub Bot (Jira)
[ https://issues.apache.org/jira/browse/HADOOP-17995?focusedWorklogId=685778=com.atlassian.jira.plugin.system.issuetabpanels:worklog-tabpanel#worklog-685778 ] ASF GitHub Bot logged work on HADOOP-17995: --- Author: ASF GitHub Bot

[GitHub] [hadoop] sodonnel commented on pull request #3708: HADOOP-17995. Stale record should be remove when DataNodePeerMetrics#dumpSendPacketDownstreamAvgInfoAsJson

2021-11-24 Thread GitBox
sodonnel commented on pull request #3708: URL: https://github.com/apache/hadoop/pull/3708#issuecomment-977755386 +1 from me. The CI report is green too, so all good there. -- This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and

[jira] [Work logged] (HADOOP-17975) Fallback to simple auth does not work for a secondary DistributedFileSystem instance

2021-11-24 Thread ASF GitHub Bot (Jira)
[ https://issues.apache.org/jira/browse/HADOOP-17975?focusedWorklogId=685777=com.atlassian.jira.plugin.system.issuetabpanels:worklog-tabpanel#worklog-685777 ] ASF GitHub Bot logged work on HADOOP-17975: --- Author: ASF GitHub Bot

[GitHub] [hadoop] sodonnel merged pull request #3579: HADOOP-17975 Fallback to simple auth does not work for a secondary DistributedFileSystem instance.

2021-11-24 Thread GitBox
sodonnel merged pull request #3579: URL: https://github.com/apache/hadoop/pull/3579 -- This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use the URL above to go to the specific comment. To unsubscribe, e-mail:

[jira] [Work logged] (HADOOP-17409) Remove S3Guard - no longer needed

2021-11-24 Thread ASF GitHub Bot (Jira)
[ https://issues.apache.org/jira/browse/HADOOP-17409?focusedWorklogId=685766=com.atlassian.jira.plugin.system.issuetabpanels:worklog-tabpanel#worklog-685766 ] ASF GitHub Bot logged work on HADOOP-17409: --- Author: ASF GitHub Bot

[GitHub] [hadoop] mukund-thakur commented on a change in pull request #3534: HADOOP-17409. Remove s3guard from S3A module

2021-11-24 Thread GitBox
mukund-thakur commented on a change in pull request #3534: URL: https://github.com/apache/hadoop/pull/3534#discussion_r754893451 ## File path: hadoop-common-project/hadoop-common/src/site/markdown/filesystem/introduction.md ## @@ -343,7 +343,7 @@ stores pretend that they are

[jira] [Work logged] (HADOOP-17409) Remove S3Guard - no longer needed

2021-11-24 Thread ASF GitHub Bot (Jira)
[ https://issues.apache.org/jira/browse/HADOOP-17409?focusedWorklogId=685756=com.atlassian.jira.plugin.system.issuetabpanels:worklog-tabpanel#worklog-685756 ] ASF GitHub Bot logged work on HADOOP-17409: --- Author: ASF GitHub Bot

[GitHub] [hadoop] harshavardhana commented on a change in pull request #3534: HADOOP-17409. Remove s3guard from S3A module

2021-11-24 Thread GitBox
harshavardhana commented on a change in pull request #3534: URL: https://github.com/apache/hadoop/pull/3534#discussion_r755876603 ## File path: hadoop-common-project/hadoop-common/src/site/markdown/filesystem/introduction.md ## @@ -343,7 +343,7 @@ stores pretend that they are

[jira] [Work logged] (HADOOP-18022) Add restrict-imports-enforcer-rule for Guava Preconditions in hadoop-main pom

2021-11-24 Thread ASF GitHub Bot (Jira)
[ https://issues.apache.org/jira/browse/HADOOP-18022?focusedWorklogId=685753=com.atlassian.jira.plugin.system.issuetabpanels:worklog-tabpanel#worklog-685753 ] ASF GitHub Bot logged work on HADOOP-18022: --- Author: ASF GitHub Bot

[GitHub] [hadoop] hadoop-yetus commented on pull request #3712: HADOOP-18022. Add restrict-imports-enforcer-rule for Guava Preconditions in hadoop-main pom

2021-11-24 Thread GitBox
hadoop-yetus commented on pull request #3712: URL: https://github.com/apache/hadoop/pull/3712#issuecomment-977707995 :broken_heart: **-1 overall** | Vote | Subsystem | Runtime | Logfile | Comment | |::|--:|:|::|:---:| | +0

[GitHub] [hadoop] aajisaka commented on pull request #3592: YARN-10991. Fix to ignore the grouping "[]" for resourcesStr in parse…

2021-11-24 Thread GitBox
aajisaka commented on pull request #3592: URL: https://github.com/apache/hadoop/pull/3592#issuecomment-977704471 Merged. Thank you @ashutoshcipher and @tomscut -- This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use the URL

[GitHub] [hadoop] aajisaka merged pull request #3592: YARN-10991. Fix to ignore the grouping "[]" for resourcesStr in parse…

2021-11-24 Thread GitBox
aajisaka merged pull request #3592: URL: https://github.com/apache/hadoop/pull/3592 -- This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use the URL above to go to the specific comment. To unsubscribe, e-mail:

[jira] [Work logged] (HADOOP-18022) Add restrict-imports-enforcer-rule for Guava Preconditions in hadoop-main pom

2021-11-24 Thread ASF GitHub Bot (Jira)
[ https://issues.apache.org/jira/browse/HADOOP-18022?focusedWorklogId=685743=com.atlassian.jira.plugin.system.issuetabpanels:worklog-tabpanel#worklog-685743 ] ASF GitHub Bot logged work on HADOOP-18022: --- Author: ASF GitHub Bot

[GitHub] [hadoop] hadoop-yetus commented on pull request #3712: HADOOP-18022. Add restrict-imports-enforcer-rule for Guava Preconditions in hadoop-main pom

2021-11-24 Thread GitBox
hadoop-yetus commented on pull request #3712: URL: https://github.com/apache/hadoop/pull/3712#issuecomment-977686334 :broken_heart: **-1 overall** | Vote | Subsystem | Runtime | Logfile | Comment | |::|--:|:|::|:---:| | +0

[GitHub] [hadoop] hadoop-yetus commented on pull request #3676: HDFS-16331. Make dfs.blockreport.intervalMsec reconfigurable

2021-11-24 Thread GitBox
hadoop-yetus commented on pull request #3676: URL: https://github.com/apache/hadoop/pull/3676#issuecomment-977651738 :broken_heart: **-1 overall** | Vote | Subsystem | Runtime | Logfile | Comment | |::|--:|:|::|:---:| | +0

[jira] [Work logged] (HADOOP-18022) Add restrict-imports-enforcer-rule for Guava Preconditions in hadoop-main pom

2021-11-24 Thread ASF GitHub Bot (Jira)
[ https://issues.apache.org/jira/browse/HADOOP-18022?focusedWorklogId=685692=com.atlassian.jira.plugin.system.issuetabpanels:worklog-tabpanel#worklog-685692 ] ASF GitHub Bot logged work on HADOOP-18022: --- Author: ASF GitHub Bot

[GitHub] [hadoop] hadoop-yetus commented on pull request #3712: HADOOP-18022. Add restrict-imports-enforcer-rule for Guava Preconditions in hadoop-main pom

2021-11-24 Thread GitBox
hadoop-yetus commented on pull request #3712: URL: https://github.com/apache/hadoop/pull/3712#issuecomment-977627009 :broken_heart: **-1 overall** | Vote | Subsystem | Runtime | Logfile | Comment | |::|--:|:|::|:---:| | +0

[GitHub] [hadoop] GuoPhilipse edited a comment on pull request #3696: HDFS-16345. Fix test case fail in TestBlockStoragePolicy

2021-11-24 Thread GitBox
GuoPhilipse edited a comment on pull request #3696: URL: https://github.com/apache/hadoop/pull/3696#issuecomment-976220112 cc @aajisaka @ayushtkn here are several PR tests fail for BindException of `TestBlockStoragePolicy` class.

  1   2   >