[jira] [Comment Edited] (HADOOP-13500) Concurrency issues when using Configuration iterator

2021-11-09 Thread Dhananjay Badaya (Jira)
[ https://issues.apache.org/jira/browse/HADOOP-13500?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17441534#comment-17441534 ] Dhananjay Badaya edited comment on HADOOP-13500 at 11/10/21, 7:19 AM:

[GitHub] [hadoop] hadoop-yetus commented on pull request #3638: HDFS-16313. Add metrics for each subcluster

2021-11-09 Thread GitBox
hadoop-yetus commented on pull request #3638: URL: https://github.com/apache/hadoop/pull/3638#issuecomment-964849099 :broken_heart: **-1 overall** | Vote | Subsystem | Runtime | Logfile | Comment | |::|--:|:|::|:---:| | +0

[jira] [Comment Edited] (HADOOP-13500) Concurrency issues when using Configuration iterator

2021-11-09 Thread Dhananjay Badaya (Jira)
[ https://issues.apache.org/jira/browse/HADOOP-13500?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17441534#comment-17441534 ] Dhananjay Badaya edited comment on HADOOP-13500 at 11/10/21, 7:16 AM:

[jira] [Commented] (HADOOP-17998) Enable get command run with multi-thread

2021-11-09 Thread Chengwei Wang (Jira)
[ https://issues.apache.org/jira/browse/HADOOP-17998?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17441537#comment-17441537 ] Chengwei Wang commented on HADOOP-17998: Submit [^HADOOP-17998.002.patch] to fix checkstyle and

[jira] [Commented] (HADOOP-13500) Concurrency issues when using Configuration iterator

2021-11-09 Thread Dhananjay Badaya (Jira)
[ https://issues.apache.org/jira/browse/HADOOP-13500?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17441534#comment-17441534 ] Dhananjay Badaya commented on HADOOP-13500: --- Encountered this with Hive {code:java}

[jira] [Updated] (HADOOP-17998) Enable get command run with multi-thread

2021-11-09 Thread Chengwei Wang (Jira)
[ https://issues.apache.org/jira/browse/HADOOP-17998?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Chengwei Wang updated HADOOP-17998: --- Attachment: HADOOP-17998.002.patch > Enable get command run with multi-thread >

[jira] [Work logged] (HADOOP-17995) Stale record should be remove when DataNodePeerMetrics#dumpSendPacketDownstreamAvgInfoAsJson

2021-11-09 Thread ASF GitHub Bot (Jira)
[ https://issues.apache.org/jira/browse/HADOOP-17995?focusedWorklogId=679490=com.atlassian.jira.plugin.system.issuetabpanels:worklog-tabpanel#worklog-679490 ] ASF GitHub Bot logged work on HADOOP-17995: --- Author: ASF GitHub Bot

[GitHub] [hadoop] tomscut commented on a change in pull request #3630: HADOOP-17995. Stale record should be remove when DataNodePeerMetrics#dumpSendPacketDownstreamAvgInfoAsJson

2021-11-09 Thread GitBox
tomscut commented on a change in pull request #3630: URL: https://github.com/apache/hadoop/pull/3630#discussion_r746299394 ## File path: hadoop-common-project/hadoop-common/src/main/java/org/apache/hadoop/metrics2/lib/MutableRollingAverages.java ## @@ -167,7 +167,7 @@

[GitHub] [hadoop] tomscut commented on a change in pull request #3615: HDFS-16298. Improve error msg for BlockMissingException

2021-11-09 Thread GitBox
tomscut commented on a change in pull request #3615: URL: https://github.com/apache/hadoop/pull/3615#discussion_r746296475 ## File path: hadoop-hdfs-project/hadoop-hdfs-client/src/main/java/org/apache/hadoop/hdfs/DFSInputStream.java ## @@ -1003,7 +1003,7 @@ private

[GitHub] [hadoop] ferhui commented on a change in pull request #3615: HDFS-16298. Improve error msg for BlockMissingException

2021-11-09 Thread GitBox
ferhui commented on a change in pull request #3615: URL: https://github.com/apache/hadoop/pull/3615#discussion_r746295538 ## File path: hadoop-hdfs-project/hadoop-hdfs-client/src/main/java/org/apache/hadoop/hdfs/DFSInputStream.java ## @@ -1003,7 +1003,7 @@ private

[jira] [Work logged] (HADOOP-15327) Upgrade MR ShuffleHandler to use Netty4

2021-11-09 Thread ASF GitHub Bot (Jira)
[ https://issues.apache.org/jira/browse/HADOOP-15327?focusedWorklogId=679486=com.atlassian.jira.plugin.system.issuetabpanels:worklog-tabpanel#worklog-679486 ] ASF GitHub Bot logged work on HADOOP-15327: --- Author: ASF GitHub Bot

[GitHub] [hadoop] hadoop-yetus commented on pull request #3259: HADOOP-15327. Upgrade MR ShuffleHandler to use Netty4

2021-11-09 Thread GitBox
hadoop-yetus commented on pull request #3259: URL: https://github.com/apache/hadoop/pull/3259#issuecomment-964838016 :broken_heart: **-1 overall** | Vote | Subsystem | Runtime | Logfile | Comment | |::|--:|:|::|:---:| | +0

[GitHub] [hadoop] tomscut commented on a change in pull request #3615: HDFS-16298. Improve error msg for BlockMissingException

2021-11-09 Thread GitBox
tomscut commented on a change in pull request #3615: URL: https://github.com/apache/hadoop/pull/3615#discussion_r746290325 ## File path: hadoop-hdfs-project/hadoop-hdfs-client/src/main/java/org/apache/hadoop/hdfs/DFSInputStream.java ## @@ -1003,7 +1003,7 @@ private

[jira] [Work logged] (HADOOP-17995) Stale record should be remove when DataNodePeerMetrics#dumpSendPacketDownstreamAvgInfoAsJson

2021-11-09 Thread ASF GitHub Bot (Jira)
[ https://issues.apache.org/jira/browse/HADOOP-17995?focusedWorklogId=679482=com.atlassian.jira.plugin.system.issuetabpanels:worklog-tabpanel#worklog-679482 ] ASF GitHub Bot logged work on HADOOP-17995: --- Author: ASF GitHub Bot

[GitHub] [hadoop] ferhui commented on a change in pull request #3630: HADOOP-17995. Stale record should be remove when DataNodePeerMetrics#dumpSendPacketDownstreamAvgInfoAsJson

2021-11-09 Thread GitBox
ferhui commented on a change in pull request #3630: URL: https://github.com/apache/hadoop/pull/3630#discussion_r746287734 ## File path: hadoop-common-project/hadoop-common/src/main/java/org/apache/hadoop/metrics2/lib/MutableRollingAverages.java ## @@ -167,7 +167,7 @@

[GitHub] [hadoop] ferhui commented on pull request #3638: HDFS-16313. Add metrics for each subcluster

2021-11-09 Thread GitBox
ferhui commented on pull request #3638: URL: https://github.com/apache/hadoop/pull/3638#issuecomment-964827426 @symious Thanks for your contribution, it's a good idea. Overall LGTM, except what @goiri said. -- This is an automated message from the Apache Git Service. To respond to the

[GitHub] [hadoop] ferhui commented on a change in pull request #3615: HDFS-16298. Improve error msg for BlockMissingException

2021-11-09 Thread GitBox
ferhui commented on a change in pull request #3615: URL: https://github.com/apache/hadoop/pull/3615#discussion_r746278835 ## File path: hadoop-hdfs-project/hadoop-hdfs-client/src/main/java/org/apache/hadoop/hdfs/DFSInputStream.java ## @@ -1003,7 +1003,7 @@ private

[jira] [Commented] (HADOOP-17998) Enable get command run with multi-thread

2021-11-09 Thread Hadoop QA (Jira)
[ https://issues.apache.org/jira/browse/HADOOP-17998?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17441510#comment-17441510 ] Hadoop QA commented on HADOOP-17998: | (x) *{color:red}-1 overall{color}* | \\ \\ || Vote ||

[GitHub] [hadoop] jojochuang commented on pull request #3640: HDFS-16187. SnapshotDiff behaviour with Xattrs and Acls is not consistent across NN restarts with checkpointing (#3340)

2021-11-09 Thread GitBox
jojochuang commented on pull request #3640: URL: https://github.com/apache/hadoop/pull/3640#issuecomment-964798104 Only a few trivial conflicts in import list in the test code. -- This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub

[GitHub] [hadoop] jojochuang opened a new pull request #3640: HDFS-16187. SnapshotDiff behaviour with Xattrs and Acls is not consistent across NN restarts with checkpointing (#3340)

2021-11-09 Thread GitBox
jojochuang opened a new pull request #3640: URL: https://github.com/apache/hadoop/pull/3640 (cherry picked from commit 356ebbbe80aef991d564a6140e341ddd76176416) Conflicts: hadoop-hdfs-project/hadoop-hdfs/src/test/java/org/apache/hadoop/hdfs/TestEncryptionZones.java

[GitHub] [hadoop] symious commented on a change in pull request #3638: HDFS-16313. Add metrics for each subcluster

2021-11-09 Thread GitBox
symious commented on a change in pull request #3638: URL: https://github.com/apache/hadoop/pull/3638#discussion_r746253724 ## File path: hadoop-hdfs-project/hadoop-hdfs-rbf/src/main/java/org/apache/hadoop/hdfs/server/federation/metrics/SubClusterRPCMBean.java ## @@ -0,0 +1,41

[jira] [Work logged] (HADOOP-17995) Stale record should be remove when DataNodePeerMetrics#dumpSendPacketDownstreamAvgInfoAsJson

2021-11-09 Thread ASF GitHub Bot (Jira)
[ https://issues.apache.org/jira/browse/HADOOP-17995?focusedWorklogId=679467=com.atlassian.jira.plugin.system.issuetabpanels:worklog-tabpanel#worklog-679467 ] ASF GitHub Bot logged work on HADOOP-17995: --- Author: ASF GitHub Bot

[GitHub] [hadoop] haiyang1987 commented on pull request #3630: HADOOP-17995. Stale record should be remove when DataNodePeerMetrics#dumpSendPacketDownstreamAvgInfoAsJson

2021-11-09 Thread GitBox
haiyang1987 commented on pull request #3630: URL: https://github.com/apache/hadoop/pull/3630#issuecomment-964756797 @ferhui @tomscut @AlphaGouGe I submitted some code. Can you help review. thank you very much. -- This is an automated message from the Apache Git Service. To respond

[GitHub] [hadoop] sumangala-patki commented on a change in pull request #3440: ABFS: Support for Encryption Context

2021-11-09 Thread GitBox
sumangala-patki commented on a change in pull request #3440: URL: https://github.com/apache/hadoop/pull/3440#discussion_r746215898 ## File path: hadoop-tools/hadoop-azure/src/main/java/org/apache/hadoop/fs/azurebfs/AbfsConfiguration.java ## @@ -906,6 +907,36 @@ public

[GitHub] [hadoop] sumangala-patki commented on a change in pull request #3440: ABFS: Support for Encryption Context

2021-11-09 Thread GitBox
sumangala-patki commented on a change in pull request #3440: URL: https://github.com/apache/hadoop/pull/3440#discussion_r746215652 ## File path: hadoop-tools/hadoop-azure/src/main/java/org/apache/hadoop/fs/azurebfs/services/AbfsClient.java ## @@ -221,16 +223,50 @@

[GitHub] [hadoop] sumangala-patki commented on a change in pull request #3440: ABFS: Support for Encryption Context

2021-11-09 Thread GitBox
sumangala-patki commented on a change in pull request #3440: URL: https://github.com/apache/hadoop/pull/3440#discussion_r746214855 ## File path: hadoop-tools/hadoop-azure/src/main/java/org/apache/hadoop/fs/azurebfs/services/AbfsClient.java ## @@ -221,16 +223,50 @@

[GitHub] [hadoop] sumangala-patki commented on a change in pull request #3440: ABFS: Support for Encryption Context

2021-11-09 Thread GitBox
sumangala-patki commented on a change in pull request #3440: URL: https://github.com/apache/hadoop/pull/3440#discussion_r746214551 ## File path: hadoop-tools/hadoop-azure/src/main/java/org/apache/hadoop/fs/azurebfs/services/AbfsClient.java ## @@ -113,13 +119,14 @@ private

[GitHub] [hadoop] hadoop-yetus commented on pull request #3639: HADOOP-17999: Do not initialize all target FileSystems for setWriteChecksum and setVerifyChecksum

2021-11-09 Thread GitBox
hadoop-yetus commented on pull request #3639: URL: https://github.com/apache/hadoop/pull/3639#issuecomment-964741321 :confetti_ball: **+1 overall** | Vote | Subsystem | Runtime | Logfile | Comment | |::|--:|:|::|:---:| | +0

[jira] [Work logged] (HADOOP-17999) ViewFileSystem.setVerifyChecksum should not initialize all target filesystems

2021-11-09 Thread ASF GitHub Bot (Jira)
[ https://issues.apache.org/jira/browse/HADOOP-17999?focusedWorklogId=679463=com.atlassian.jira.plugin.system.issuetabpanels:worklog-tabpanel#worklog-679463 ] ASF GitHub Bot logged work on HADOOP-17999: --- Author: ASF GitHub Bot

[jira] [Work logged] (HADOOP-17975) Fallback to simple auth does not work for a secondary DistributedFileSystem instance

2021-11-09 Thread ASF GitHub Bot (Jira)
[ https://issues.apache.org/jira/browse/HADOOP-17975?focusedWorklogId=679461=com.atlassian.jira.plugin.system.issuetabpanels:worklog-tabpanel#worklog-679461 ] ASF GitHub Bot logged work on HADOOP-17975: --- Author: ASF GitHub Bot

[GitHub] [hadoop] symious commented on pull request #3579: HADOOP-17975 Fallback to simple auth does not work for a secondary DistributedFileSystem instance.

2021-11-09 Thread GitBox
symious commented on pull request #3579: URL: https://github.com/apache/hadoop/pull/3579#issuecomment-964737683 @fapifta Sorry for late reply. I think it's not adding a new field like ClientID. I created a commit for example, could you help to

[GitHub] [hadoop] tasanuma commented on pull request #3622: HDFS-16301.Improve BenchmarkThroughput#SIZE naming standardization.

2021-11-09 Thread GitBox
tasanuma commented on pull request #3622: URL: https://github.com/apache/hadoop/pull/3622#issuecomment-964726064 Merged. Thanks for your contribution, @jianghuazhu! -- This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use the

[GitHub] [hadoop] tasanuma merged pull request #3622: HDFS-16301.Improve BenchmarkThroughput#SIZE naming standardization.

2021-11-09 Thread GitBox
tasanuma merged pull request #3622: URL: https://github.com/apache/hadoop/pull/3622 -- This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use the URL above to go to the specific comment. To unsubscribe, e-mail:

[jira] [Updated] (HADOOP-17998) Enable get command run with multi-thread

2021-11-09 Thread Chengwei Wang (Jira)
[ https://issues.apache.org/jira/browse/HADOOP-17998?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Chengwei Wang updated HADOOP-17998: --- Attachment: HADOOP-17998.001-1.patch Status: Patch Available (was: Open) > Enable

[jira] [Updated] (HADOOP-17998) Enable get command run with multi-thread

2021-11-09 Thread Chengwei Wang (Jira)
[ https://issues.apache.org/jira/browse/HADOOP-17998?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Chengwei Wang updated HADOOP-17998: --- Attachment: (was: HADOOP-17998.001-1.patch) > Enable get command run with multi-thread

[jira] [Work logged] (HADOOP-17997) RBF: Namespace usage of mount table with multi subclusters can exceed quota

2021-11-09 Thread ASF GitHub Bot (Jira)
[ https://issues.apache.org/jira/browse/HADOOP-17997?focusedWorklogId=679442=com.atlassian.jira.plugin.system.issuetabpanels:worklog-tabpanel#worklog-679442 ] ASF GitHub Bot logged work on HADOOP-17997: --- Author: ASF GitHub Bot

[jira] [Work logged] (HADOOP-17997) RBF: Namespace usage of mount table with multi subclusters can exceed quota

2021-11-09 Thread ASF GitHub Bot (Jira)
[ https://issues.apache.org/jira/browse/HADOOP-17997?focusedWorklogId=679444=com.atlassian.jira.plugin.system.issuetabpanels:worklog-tabpanel#worklog-679444 ] ASF GitHub Bot logged work on HADOOP-17997: --- Author: ASF GitHub Bot

[GitHub] [hadoop] xicm commented on a change in pull request #3634: HADOOP-17997. RBF: Namespace usage of mount table with multi subclust…

2021-11-09 Thread GitBox
xicm commented on a change in pull request #3634: URL: https://github.com/apache/hadoop/pull/3634#discussion_r746192153 ## File path: hadoop-hdfs-project/hadoop-hdfs/src/main/java/org/apache/hadoop/hdfs/server/namenode/Quota.java ## @@ -50,7 +50,7 @@ public static Counts

[GitHub] [hadoop] xicm commented on a change in pull request #3634: HADOOP-17997. RBF: Namespace usage of mount table with multi subclust…

2021-11-09 Thread GitBox
xicm commented on a change in pull request #3634: URL: https://github.com/apache/hadoop/pull/3634#discussion_r746192153 ## File path: hadoop-hdfs-project/hadoop-hdfs/src/main/java/org/apache/hadoop/hdfs/server/namenode/Quota.java ## @@ -50,7 +50,7 @@ public static Counts

[GitHub] [hadoop] jianghuazhu commented on pull request #3622: HDFS-16301.Improve BenchmarkThroughput#SIZE naming standardization.

2021-11-09 Thread GitBox
jianghuazhu commented on pull request #3622: URL: https://github.com/apache/hadoop/pull/3622#issuecomment-964711282 Can you help review this pr again, @tasanuma. Thank you very much. -- This is an automated message from the Apache Git Service. To respond to the message, please log

[GitHub] [hadoop] jianghuazhu commented on a change in pull request #3629: HDFS-16305.Record the remote NameNode address when the rolling log is triggered.

2021-11-09 Thread GitBox
jianghuazhu commented on a change in pull request #3629: URL: https://github.com/apache/hadoop/pull/3629#discussion_r746188481 ## File path: hadoop-hdfs-project/hadoop-hdfs/src/main/java/org/apache/hadoop/hdfs/server/namenode/ha/EditLogTailer.java ## @@ -413,6 +413,8 @@

[GitHub] [hadoop] tomscut commented on pull request #3637: HDFS-16312. Fix typo for DataNodeVolumeMetrics and ProfilingFileIoEvents

2021-11-09 Thread GitBox
tomscut commented on pull request #3637: URL: https://github.com/apache/hadoop/pull/3637#issuecomment-964692177 Hi @tasanuma @ferhui , please take a look at this. Thanks a lot. -- This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub

[GitHub] [hadoop] tomscut commented on pull request #3636: HDFS-16311. Metric metadataOperationRate calculation error in DataNod…

2021-11-09 Thread GitBox
tomscut commented on pull request #3636: URL: https://github.com/apache/hadoop/pull/3636#issuecomment-964691288 Hi @tasanuma @jojochuang @goiri @ayushtkn , could you please help review the code? Thank you very much. -- This is an automated message from the Apache Git Service. To respond

[GitHub] [hadoop] tomscut commented on pull request #3615: HDFS-16298. Improve error msg for BlockMissingException

2021-11-09 Thread GitBox
tomscut commented on pull request #3615: URL: https://github.com/apache/hadoop/pull/3615#issuecomment-964690618 Hi @tasanuma @ferhui , could you please take a look at this. Thanks a lot. -- This is an automated message from the Apache Git Service. To respond to the message, please log on

[GitHub] [hadoop] tomscut removed a comment on pull request #3615: HDFS-16298. Improve error msg for BlockMissingException

2021-11-09 Thread GitBox
tomscut removed a comment on pull request #3615: URL: https://github.com/apache/hadoop/pull/3615#issuecomment-960559501 Hi @tasanuma @ferhui , please take a look at this. Thanks a lot. -- This is an automated message from the Apache Git Service. To respond to the message, please log on

[jira] [Commented] (HADOOP-17880) Build Hadoop on Centos 7

2021-11-09 Thread baizhendong (Jira)
[ https://issues.apache.org/jira/browse/HADOOP-17880?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17441450#comment-17441450 ] baizhendong commented on HADOOP-17880: -- [~gaurava] thank you. > Build Hadoop on Centos 7 >

[GitHub] [hadoop] tomscut commented on a change in pull request #3629: HDFS-16305.Record the remote NameNode address when the rolling log is triggered.

2021-11-09 Thread GitBox
tomscut commented on a change in pull request #3629: URL: https://github.com/apache/hadoop/pull/3629#discussion_r746167436 ## File path: hadoop-hdfs-project/hadoop-hdfs/src/main/java/org/apache/hadoop/hdfs/server/namenode/ha/EditLogTailer.java ## @@ -413,6 +413,8 @@ private

[GitHub] [hadoop] tomscut commented on a change in pull request #3635: HDFS-16310. RBF: Add client port to CallerContext for Router

2021-11-09 Thread GitBox
tomscut commented on a change in pull request #3635: URL: https://github.com/apache/hadoop/pull/3635#discussion_r746156233 ## File path: hadoop-common-project/hadoop-common/src/main/java/org/apache/hadoop/ipc/CallerContext.java ## @@ -228,6 +228,26 @@ public Builder

[jira] [Work logged] (HADOOP-17981) Support etag-assisted renames in FileOutputCommitter

2021-11-09 Thread ASF GitHub Bot (Jira)
[ https://issues.apache.org/jira/browse/HADOOP-17981?focusedWorklogId=679380=com.atlassian.jira.plugin.system.issuetabpanels:worklog-tabpanel#worklog-679380 ] ASF GitHub Bot logged work on HADOOP-17981: --- Author: ASF GitHub Bot

[GitHub] [hadoop] hadoop-yetus commented on pull request #3611: HADOOP-17981. resilient commit through etag validation

2021-11-09 Thread GitBox
hadoop-yetus commented on pull request #3611: URL: https://github.com/apache/hadoop/pull/3611#issuecomment-964659809 :confetti_ball: **+1 overall** | Vote | Subsystem | Runtime | Logfile | Comment | |::|--:|:|::|:---:| | +0

[jira] [Updated] (HADOOP-17999) ViewFileSystem.setVerifyChecksum should not initialize all target filesystems

2021-11-09 Thread ASF GitHub Bot (Jira)
[ https://issues.apache.org/jira/browse/HADOOP-17999?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] ASF GitHub Bot updated HADOOP-17999: Labels: pull-request-available (was: ) > ViewFileSystem.setVerifyChecksum should not

[jira] [Work logged] (HADOOP-17999) ViewFileSystem.setVerifyChecksum should not initialize all target filesystems

2021-11-09 Thread ASF GitHub Bot (Jira)
[ https://issues.apache.org/jira/browse/HADOOP-17999?focusedWorklogId=679371=com.atlassian.jira.plugin.system.issuetabpanels:worklog-tabpanel#worklog-679371 ] ASF GitHub Bot logged work on HADOOP-17999: --- Author: ASF GitHub Bot

[GitHub] [hadoop] abhishekdas99 opened a new pull request #3639: HADOOP-17999: Do not initialize all target FileSystems for setWriteChecksum and setVerifyChecksum

2021-11-09 Thread GitBox
abhishekdas99 opened a new pull request #3639: URL: https://github.com/apache/hadoop/pull/3639 JIRA: https://issues.apache.org/jira/browse/HADOOP-17999 ### Description of PR All the target filesystems corresponding to mount points are initialized in setWriteChecksum and

[GitHub] [hadoop] hadoop-yetus commented on pull request #3637: HDFS-16312. Fix typo for DataNodeVolumeMetrics and ProfilingFileIoEvents

2021-11-09 Thread GitBox
hadoop-yetus commented on pull request #3637: URL: https://github.com/apache/hadoop/pull/3637#issuecomment-964582278 :broken_heart: **-1 overall** | Vote | Subsystem | Runtime | Logfile | Comment | |::|--:|:|::|:---:| | +0

[GitHub] [hadoop] hadoop-yetus commented on pull request #3635: HDFS-16310. RBF: Add client port to CallerContext for Router

2021-11-09 Thread GitBox
hadoop-yetus commented on pull request #3635: URL: https://github.com/apache/hadoop/pull/3635#issuecomment-964565804 :broken_heart: **-1 overall** | Vote | Subsystem | Runtime | Logfile | Comment | |::|--:|:|::|:---:| | +0

[GitHub] [hadoop] hadoop-yetus commented on pull request #3618: YARN-11000. Replace queue resource calculation logic in updateClusterResource

2021-11-09 Thread GitBox
hadoop-yetus commented on pull request #3618: URL: https://github.com/apache/hadoop/pull/3618#issuecomment-964513455 :broken_heart: **-1 overall** | Vote | Subsystem | Runtime | Logfile | Comment | |::|--:|:|::|:---:| | +0

[GitHub] [hadoop] hadoop-yetus commented on pull request #3636: HDFS-16311. Metric metadataOperationRate calculation error in DataNod…

2021-11-09 Thread GitBox
hadoop-yetus commented on pull request #3636: URL: https://github.com/apache/hadoop/pull/3636#issuecomment-964493861 :broken_heart: **-1 overall** | Vote | Subsystem | Runtime | Logfile | Comment | |::|--:|:|::|:---:| | +0

[jira] [Moved] (HADOOP-17999) ViewFileSystem.setVerifyChecksum should not initialize all target filesystems

2021-11-09 Thread Abhishek Das (Jira)
[ https://issues.apache.org/jira/browse/HADOOP-17999?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Abhishek Das moved HDFS-16309 to HADOOP-17999: -- Key: HADOOP-17999 (was: HDFS-16309) Project: Hadoop Common

[jira] [Commented] (HADOOP-17996) UserGroupInformation#unprotectedRelogin sets the last login time before logging in

2021-11-09 Thread Ravuri Sushma sree (Jira)
[ https://issues.apache.org/jira/browse/HADOOP-17996?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17441316#comment-17441316 ] Ravuri Sushma sree commented on HADOOP-17996: - Thanks for filing this JIRA [~prabhujoseph] 

[jira] [Work logged] (HADOOP-15566) Support OpenTelemetry

2021-11-09 Thread ASF GitHub Bot (Jira)
[ https://issues.apache.org/jira/browse/HADOOP-15566?focusedWorklogId=679229=com.atlassian.jira.plugin.system.issuetabpanels:worklog-tabpanel#worklog-679229 ] ASF GitHub Bot logged work on HADOOP-15566: --- Author: ASF GitHub Bot

[GitHub] [hadoop] ndimiduk commented on pull request #3445: HADOOP-15566 Opentelemetry changes using java agent

2021-11-09 Thread GitBox
ndimiduk commented on pull request #3445: URL: https://github.com/apache/hadoop/pull/3445#issuecomment-964407226 That's great progress, @ArkenKiran ! You got there before I could. On the read path, any block cache miss will go to the hdfs client for a read (can still be local via

[GitHub] [hadoop] hadoop-yetus commented on pull request #3638: HDFS-16313. Add metrics for each subcluster

2021-11-09 Thread GitBox
hadoop-yetus commented on pull request #3638: URL: https://github.com/apache/hadoop/pull/3638#issuecomment-964376598 :broken_heart: **-1 overall** | Vote | Subsystem | Runtime | Logfile | Comment | |::|--:|:|::|:---:| | +0

[jira] [Work logged] (HADOOP-17997) RBF: Namespace usage of mount table with multi subclusters can exceed quota

2021-11-09 Thread ASF GitHub Bot (Jira)
[ https://issues.apache.org/jira/browse/HADOOP-17997?focusedWorklogId=679201=com.atlassian.jira.plugin.system.issuetabpanels:worklog-tabpanel#worklog-679201 ] ASF GitHub Bot logged work on HADOOP-17997: --- Author: ASF GitHub Bot

[GitHub] [hadoop] goiri commented on a change in pull request #3634: HADOOP-17997. RBF: Namespace usage of mount table with multi subclust…

2021-11-09 Thread GitBox
goiri commented on a change in pull request #3634: URL: https://github.com/apache/hadoop/pull/3634#discussion_r745849964 ## File path: hadoop-hdfs-project/hadoop-hdfs/src/main/java/org/apache/hadoop/hdfs/server/namenode/Quota.java ## @@ -50,7 +50,7 @@ public static Counts

[GitHub] [hadoop] goiri commented on a change in pull request #3638: HDFS-16313. Add metrics for each subcluster

2021-11-09 Thread GitBox
goiri commented on a change in pull request #3638: URL: https://github.com/apache/hadoop/pull/3638#discussion_r745848273 ## File path: hadoop-hdfs-project/hadoop-hdfs-rbf/src/main/java/org/apache/hadoop/hdfs/server/federation/metrics/SubClusterRPCMBean.java ## @@ -0,0 +1,41

[jira] [Work logged] (HADOOP-17981) Support etag-assisted renames in FileOutputCommitter

2021-11-09 Thread ASF GitHub Bot (Jira)
[ https://issues.apache.org/jira/browse/HADOOP-17981?focusedWorklogId=679192=com.atlassian.jira.plugin.system.issuetabpanels:worklog-tabpanel#worklog-679192 ] ASF GitHub Bot logged work on HADOOP-17981: --- Author: ASF GitHub Bot

[jira] [Work logged] (HADOOP-17981) Support etag-assisted renames in FileOutputCommitter

2021-11-09 Thread ASF GitHub Bot (Jira)
[ https://issues.apache.org/jira/browse/HADOOP-17981?focusedWorklogId=679193=com.atlassian.jira.plugin.system.issuetabpanels:worklog-tabpanel#worklog-679193 ] ASF GitHub Bot logged work on HADOOP-17981: --- Author: ASF GitHub Bot

[GitHub] [hadoop] hadoop-yetus removed a comment on pull request #3611: HADOOP-17981. resilient commit through etag validation

2021-11-09 Thread GitBox
hadoop-yetus removed a comment on pull request #3611: URL: https://github.com/apache/hadoop/pull/3611#issuecomment-963267230 :broken_heart: **-1 overall** | Vote | Subsystem | Runtime | Logfile | Comment | |::|--:|:|::|:---:|

[GitHub] [hadoop] hadoop-yetus removed a comment on pull request #3611: HADOOP-17981. resilient commit through etag validation

2021-11-09 Thread GitBox
hadoop-yetus removed a comment on pull request #3611: URL: https://github.com/apache/hadoop/pull/3611#issuecomment-962068979 :broken_heart: **-1 overall** | Vote | Subsystem | Runtime | Logfile | Comment | |::|--:|:|::|:---:|

[GitHub] [hadoop] goiri commented on a change in pull request #3635: HDFS-16310. RBF: Add client port to CallerContext for Router

2021-11-09 Thread GitBox
goiri commented on a change in pull request #3635: URL: https://github.com/apache/hadoop/pull/3635#discussion_r745844503 ## File path: hadoop-common-project/hadoop-common/src/main/java/org/apache/hadoop/ipc/CallerContext.java ## @@ -228,6 +228,26 @@ public Builder

[GitHub] [hadoop] virajjasani commented on a change in pull request #3629: HDFS-16305.Record the remote NameNode address when the rolling log is triggered.

2021-11-09 Thread GitBox
virajjasani commented on a change in pull request #3629: URL: https://github.com/apache/hadoop/pull/3629#discussion_r745829054 ## File path: hadoop-hdfs-project/hadoop-hdfs/src/main/java/org/apache/hadoop/hdfs/server/namenode/ha/EditLogTailer.java ## @@ -413,6 +413,8 @@

[GitHub] [hadoop] hadoop-yetus commented on pull request #3622: HDFS-16301.Improve BenchmarkThroughput#SIZE naming standardization.

2021-11-09 Thread GitBox
hadoop-yetus commented on pull request #3622: URL: https://github.com/apache/hadoop/pull/3622#issuecomment-964345383 :broken_heart: **-1 overall** | Vote | Subsystem | Runtime | Logfile | Comment | |::|--:|:|::|:---:| | +0

[jira] [Resolved] (HADOOP-17988) Disable JIRA plugin for YETUS on Hadoop

2021-11-09 Thread Gautham Banasandra (Jira)
[ https://issues.apache.org/jira/browse/HADOOP-17988?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Gautham Banasandra resolved HADOOP-17988. - Fix Version/s: 3.3.3 Resolution: Fixed > Disable JIRA plugin for YETUS

[jira] [Work logged] (HADOOP-17988) Disable JIRA plugin for YETUS on Hadoop

2021-11-09 Thread ASF GitHub Bot (Jira)
[ https://issues.apache.org/jira/browse/HADOOP-17988?focusedWorklogId=679153=com.atlassian.jira.plugin.system.issuetabpanels:worklog-tabpanel#worklog-679153 ] ASF GitHub Bot logged work on HADOOP-17988: --- Author: ASF GitHub Bot

[jira] [Updated] (HADOOP-17988) Disable JIRA plugin for YETUS on Hadoop

2021-11-09 Thread Gautham Banasandra (Jira)
[ https://issues.apache.org/jira/browse/HADOOP-17988?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Gautham Banasandra updated HADOOP-17988: Affects Version/s: 3.3.3 (was: 3.3.0) > Disable JIRA

[GitHub] [hadoop] GauthamBanasandra merged pull request #3610: HADOOP-17988. Disable JIRA plugin for YETUS on Hadoop

2021-11-09 Thread GitBox
GauthamBanasandra merged pull request #3610: URL: https://github.com/apache/hadoop/pull/3610 -- This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use the URL above to go to the specific comment. To unsubscribe, e-mail:

[GitHub] [hadoop] hadoop-yetus commented on pull request #3604: YARN-10996. Fix race condition of User object acquisitions

2021-11-09 Thread GitBox
hadoop-yetus commented on pull request #3604: URL: https://github.com/apache/hadoop/pull/3604#issuecomment-964315178 :confetti_ball: **+1 overall** | Vote | Subsystem | Runtime | Logfile | Comment | |::|--:|:|::|:---:| | +0

[jira] [Work logged] (HADOOP-17979) Interface EtagSource to allow FileStatus subclasses to provide etags

2021-11-09 Thread ASF GitHub Bot (Jira)
[ https://issues.apache.org/jira/browse/HADOOP-17979?focusedWorklogId=679121=com.atlassian.jira.plugin.system.issuetabpanels:worklog-tabpanel#worklog-679121 ] ASF GitHub Bot logged work on HADOOP-17979: --- Author: ASF GitHub Bot

[GitHub] [hadoop] hadoop-yetus commented on pull request #3633: HADOOP-17979. Add Interface EtagSource to allow FileStatus subclasses to provide etags

2021-11-09 Thread GitBox
hadoop-yetus commented on pull request #3633: URL: https://github.com/apache/hadoop/pull/3633#issuecomment-964274996 :broken_heart: **-1 overall** | Vote | Subsystem | Runtime | Logfile | Comment | |::|--:|:|::|:---:| | +0

[GitHub] [hadoop] symious commented on pull request #3638: HDFS-16313. Add metrics for each subcluster

2021-11-09 Thread GitBox
symious commented on pull request #3638: URL: https://github.com/apache/hadoop/pull/3638#issuecomment-964274235 @goiri @ferhui Could you help to review the PR? -- This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use the URL

[GitHub] [hadoop] symious opened a new pull request #3638: HDFS-16313. Add metrics for each subcluster

2021-11-09 Thread GitBox
symious opened a new pull request #3638: URL: https://github.com/apache/hadoop/pull/3638 ### Description of PR Currently we have metrics to track the operations for Router to all nameservices, like "FederationRPCMetrics", but we don't have metrics for Router to each

[jira] [Work logged] (HADOOP-17979) Interface EtagSource to allow FileStatus subclasses to provide etags

2021-11-09 Thread ASF GitHub Bot (Jira)
[ https://issues.apache.org/jira/browse/HADOOP-17979?focusedWorklogId=679083=com.atlassian.jira.plugin.system.issuetabpanels:worklog-tabpanel#worklog-679083 ] ASF GitHub Bot logged work on HADOOP-17979: --- Author: ASF GitHub Bot

[GitHub] [hadoop] hadoop-yetus commented on pull request #3633: HADOOP-17979. Add Interface EtagSource to allow FileStatus subclasses to provide etags

2021-11-09 Thread GitBox
hadoop-yetus commented on pull request #3633: URL: https://github.com/apache/hadoop/pull/3633#issuecomment-964212085 :broken_heart: **-1 overall** | Vote | Subsystem | Runtime | Logfile | Comment | |::|--:|:|::|:---:| | +0

[jira] [Updated] (HADOOP-17657) SequenceFile.Writer should implement StreamCapabilities

2021-11-09 Thread Steve Loughran (Jira)
[ https://issues.apache.org/jira/browse/HADOOP-17657?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Steve Loughran updated HADOOP-17657: Summary: SequenceFile.Writer should implement StreamCapabilities (was:

[jira] [Resolved] (HADOOP-17928) s3a: set fs.s3a.downgrade.syncable.exceptions = true by default

2021-11-09 Thread Steve Loughran (Jira)
[ https://issues.apache.org/jira/browse/HADOOP-17928?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Steve Loughran resolved HADOOP-17928. - Fix Version/s: 3.3.2 Resolution: Fixed > s3a: set

[jira] [Work logged] (HADOOP-15327) Upgrade MR ShuffleHandler to use Netty4

2021-11-09 Thread ASF GitHub Bot (Jira)
[ https://issues.apache.org/jira/browse/HADOOP-15327?focusedWorklogId=679042=com.atlassian.jira.plugin.system.issuetabpanels:worklog-tabpanel#worklog-679042 ] ASF GitHub Bot logged work on HADOOP-15327: --- Author: ASF GitHub Bot

[GitHub] [hadoop] ayushpal24 commented on pull request #3259: HADOOP-15327. Upgrade MR ShuffleHandler to use Netty4

2021-11-09 Thread GitBox
ayushpal24 commented on pull request #3259: URL: https://github.com/apache/hadoop/pull/3259#issuecomment-964157455 Hi @szilard-nemeth , some imports got auto reformatted in previous commit , so i amended the changes in that commit. I have verified the changes are not significant .I will

[jira] [Work logged] (HADOOP-17409) Remove S3Guard - no longer needed

2021-11-09 Thread ASF GitHub Bot (Jira)
[ https://issues.apache.org/jira/browse/HADOOP-17409?focusedWorklogId=679019=com.atlassian.jira.plugin.system.issuetabpanels:worklog-tabpanel#worklog-679019 ] ASF GitHub Bot logged work on HADOOP-17409: --- Author: ASF GitHub Bot

[GitHub] [hadoop] hadoop-yetus commented on pull request #3534: HADOOP-17409. Remove s3guard from S3A module

2021-11-09 Thread GitBox
hadoop-yetus commented on pull request #3534: URL: https://github.com/apache/hadoop/pull/3534#issuecomment-964130727 :broken_heart: **-1 overall** | Vote | Subsystem | Runtime | Logfile | Comment | |::|--:|:|::|:---:| | +0

[jira] [Work logged] (HADOOP-15327) Upgrade MR ShuffleHandler to use Netty4

2021-11-09 Thread ASF GitHub Bot (Jira)
[ https://issues.apache.org/jira/browse/HADOOP-15327?focusedWorklogId=679016=com.atlassian.jira.plugin.system.issuetabpanels:worklog-tabpanel#worklog-679016 ] ASF GitHub Bot logged work on HADOOP-15327: --- Author: ASF GitHub Bot

[GitHub] [hadoop] szilard-nemeth commented on pull request #3259: HADOOP-15327. Upgrade MR ShuffleHandler to use Netty4

2021-11-09 Thread GitBox
szilard-nemeth commented on pull request #3259: URL: https://github.com/apache/hadoop/pull/3259#issuecomment-96412 Hi @ayushpal24, Thanks for your commits to fix the Maven shading issue. I can still see a shadedclient failure up there. Can you clarify why the force push to my

[GitHub] [hadoop] tomscut commented on pull request #3616: HDFS-16299. Fix bug for TestDataNodeVolumeMetrics#verifyDataNodeVolum…

2021-11-09 Thread GitBox
tomscut commented on pull request #3616: URL: https://github.com/apache/hadoop/pull/3616#issuecomment-964118840 Thanks @ayushtkn @tasanuma for your review and merge. -- This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use

[GitHub] [hadoop] tomscut opened a new pull request #3637: HDFS-16312. Fix typo for DataNodeVolumeMetrics and ProfilingFileIoEvents

2021-11-09 Thread GitBox
tomscut opened a new pull request #3637: URL: https://github.com/apache/hadoop/pull/3637 JIRA: [HDFS-16312](https://issues.apache.org/jira/browse/HDFS-16312). Fix typo for DataNodeVolumeMetrics and ProfilingFileIoEvents. -- This is an automated message from the Apache Git Service.

[GitHub] [hadoop] tomscut opened a new pull request #3636: HDFS-16311. Metric metadataOperationRate calculation error in DataNod…

2021-11-09 Thread GitBox
tomscut opened a new pull request #3636: URL: https://github.com/apache/hadoop/pull/3636 JIRA: [HDFS-16311](https://issues.apache.org/jira/browse/HDFS-16311). Metric metadataOperationRate calculation error in DataNodeVolumeMetrics#addFileIoError, causing MetadataOperationRateAvgTime

[GitHub] [hadoop] tomscut opened a new pull request #3635: HDFS-16310. RBF: Add client port to CallerContext for Router

2021-11-09 Thread GitBox
tomscut opened a new pull request #3635: URL: https://github.com/apache/hadoop/pull/3635 JIRA: [HDFS-16310](https://issues.apache.org/jira/browse/HDFS-16310). We mentioned in [#3538](https://github.com/apache/hadoop/pull/3538#issuecomment-955108462) that adding the client port to

[jira] [Commented] (HADOOP-17415) Use S3 content-range header to update length of an object during reads

2021-11-09 Thread Steve Loughran (Jira)
[ https://issues.apache.org/jira/browse/HADOOP-17415?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17441104#comment-17441104 ] Steve Loughran commented on HADOOP-17415: - we only do that HEAD on open to (a) meet

[jira] [Work logged] (HADOOP-17995) Stale record should be remove when DataNodePeerMetrics#dumpSendPacketDownstreamAvgInfoAsJson

2021-11-09 Thread ASF GitHub Bot (Jira)
[ https://issues.apache.org/jira/browse/HADOOP-17995?focusedWorklogId=678976=com.atlassian.jira.plugin.system.issuetabpanels:worklog-tabpanel#worklog-678976 ] ASF GitHub Bot logged work on HADOOP-17995: --- Author: ASF GitHub Bot

[GitHub] [hadoop] hadoop-yetus commented on pull request #3630: HADOOP-17995. Stale record should be remove when DataNodePeerMetrics#dumpSendPacketDownstreamAvgInfoAsJson

2021-11-09 Thread GitBox
hadoop-yetus commented on pull request #3630: URL: https://github.com/apache/hadoop/pull/3630#issuecomment-964044115 :confetti_ball: **+1 overall** | Vote | Subsystem | Runtime | Logfile | Comment | |::|--:|:|::|:---:| | +0

[GitHub] [hadoop] fapifta commented on pull request #3579: HADOOP-17975 Fallback to simple auth does not work for a secondary DistributedFileSystem instance.

2021-11-09 Thread GitBox
fapifta commented on pull request #3579: URL: https://github.com/apache/hadoop/pull/3579#issuecomment-964018510 @symious thank you for the discussion so far, as CI got green, may I ask if you are ok with the solution based on the reasoning I provided? -- This is an automated message

[jira] [Work logged] (HADOOP-17975) Fallback to simple auth does not work for a secondary DistributedFileSystem instance

2021-11-09 Thread ASF GitHub Bot (Jira)
[ https://issues.apache.org/jira/browse/HADOOP-17975?focusedWorklogId=678972=com.atlassian.jira.plugin.system.issuetabpanels:worklog-tabpanel#worklog-678972 ] ASF GitHub Bot logged work on HADOOP-17975: --- Author: ASF GitHub Bot

  1   2   >