[jira] [Updated] (HADOOP-17996) UserGroupInformation#unprotectedRelogin sets the last login time before logging in

2021-11-11 Thread Prabhu Joseph (Jira)
[ https://issues.apache.org/jira/browse/HADOOP-17996?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Prabhu Joseph updated HADOOP-17996: --- Status: Patch Available (was: Open) > UserGroupInformation#unprotectedRelogin sets the

[GitHub] [hadoop] hadoop-yetus commented on pull request #3607: YARN-8859. Add audit logs for router service

2021-11-11 Thread GitBox
hadoop-yetus commented on pull request #3607: URL: https://github.com/apache/hadoop/pull/3607#issuecomment-966890814 :confetti_ball: **+1 overall** | Vote | Subsystem | Runtime | Logfile | Comment | |::|--:|:|::|:---:| | +0

[jira] [Work logged] (HADOOP-17995) Stale record should be remove when DataNodePeerMetrics#dumpSendPacketDownstreamAvgInfoAsJson

2021-11-11 Thread ASF GitHub Bot (Jira)
[ https://issues.apache.org/jira/browse/HADOOP-17995?focusedWorklogId=680695=com.atlassian.jira.plugin.system.issuetabpanels:worklog-tabpanel#worklog-680695 ] ASF GitHub Bot logged work on HADOOP-17995: --- Author: ASF GitHub Bot

[GitHub] [hadoop] haiyang1987 commented on a change in pull request #3630: HADOOP-17995. Stale record should be remove when DataNodePeerMetrics#dumpSendPacketDownstreamAvgInfoAsJson

2021-11-11 Thread GitBox
haiyang1987 commented on a change in pull request #3630: URL: https://github.com/apache/hadoop/pull/3630#discussion_r748030915 ## File path: hadoop-common-project/hadoop-common/src/main/java/org/apache/hadoop/metrics2/lib/MutableRollingAverages.java ## @@ -167,7 +167,7 @@

[GitHub] [hadoop] jojochuang merged pull request #3640: HDFS-16187. SnapshotDiff behaviour with Xattrs and Acls is not consistent across NN restarts with checkpointing (#3340)

2021-11-11 Thread GitBox
jojochuang merged pull request #3640: URL: https://github.com/apache/hadoop/pull/3640 -- This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use the URL above to go to the specific comment. To unsubscribe, e-mail:

[GitHub] [hadoop] minni31 commented on a change in pull request #3607: YARN-8859. Add audit logs for router service

2021-11-11 Thread GitBox
minni31 commented on a change in pull request #3607: URL: https://github.com/apache/hadoop/pull/3607#discussion_r748005013 ## File path:

[GitHub] [hadoop] minni31 commented on a change in pull request #3607: YARN-8859. Add audit logs for router service

2021-11-11 Thread GitBox
minni31 commented on a change in pull request #3607: URL: https://github.com/apache/hadoop/pull/3607#discussion_r748004184 ## File path:

[GitHub] [hadoop] hadoop-yetus commented on pull request #3638: HDFS-16313. Add metrics for each subcluster

2021-11-11 Thread GitBox
hadoop-yetus commented on pull request #3638: URL: https://github.com/apache/hadoop/pull/3638#issuecomment-966854952 :broken_heart: **-1 overall** | Vote | Subsystem | Runtime | Logfile | Comment | |::|--:|:|::|:---:| | +0

[jira] [Work logged] (HADOOP-18003) Add a method appendIfAbsent for CallerContext

2021-11-11 Thread ASF GitHub Bot (Jira)
[ https://issues.apache.org/jira/browse/HADOOP-18003?focusedWorklogId=680666=com.atlassian.jira.plugin.system.issuetabpanels:worklog-tabpanel#worklog-680666 ] ASF GitHub Bot logged work on HADOOP-18003: --- Author: ASF GitHub Bot

[GitHub] [hadoop] hadoop-yetus commented on pull request #3644: HADOOP-18003. Add a method appendIfAbsent for CallerContext

2021-11-11 Thread GitBox
hadoop-yetus commented on pull request #3644: URL: https://github.com/apache/hadoop/pull/3644#issuecomment-966854817 :confetti_ball: **+1 overall** | Vote | Subsystem | Runtime | Logfile | Comment | |::|--:|:|::|:---:| | +0

[GitHub] [hadoop] minni31 commented on a change in pull request #3607: YARN-8859. Add audit logs for router service

2021-11-11 Thread GitBox
minni31 commented on a change in pull request #3607: URL: https://github.com/apache/hadoop/pull/3607#discussion_r748003994 ## File path:

[jira] [Work logged] (HADOOP-18003) Add a method appendIfAbsent for CallerContext

2021-11-11 Thread ASF GitHub Bot (Jira)
[ https://issues.apache.org/jira/browse/HADOOP-18003?focusedWorklogId=680664=com.atlassian.jira.plugin.system.issuetabpanels:worklog-tabpanel#worklog-680664 ] ASF GitHub Bot logged work on HADOOP-18003: --- Author: ASF GitHub Bot

[GitHub] [hadoop] hadoop-yetus commented on pull request #3644: HADOOP-18003. Add a method appendIfAbsent for CallerContext

2021-11-11 Thread GitBox
hadoop-yetus commented on pull request #3644: URL: https://github.com/apache/hadoop/pull/3644#issuecomment-966852198 :confetti_ball: **+1 overall** | Vote | Subsystem | Runtime | Logfile | Comment | |::|--:|:|::|:---:| | +0

[jira] [Updated] (HADOOP-18006) maven-enforcer-plugin's execution of banned-illegal-imports gets overridden in child poms

2021-11-11 Thread ASF GitHub Bot (Jira)
[ https://issues.apache.org/jira/browse/HADOOP-18006?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] ASF GitHub Bot updated HADOOP-18006: Labels: pull-request-available (was: ) > maven-enforcer-plugin's execution of

[jira] [Work logged] (HADOOP-18006) maven-enforcer-plugin's execution of banned-illegal-imports gets overridden in child poms

2021-11-11 Thread ASF GitHub Bot (Jira)
[ https://issues.apache.org/jira/browse/HADOOP-18006?focusedWorklogId=680654=com.atlassian.jira.plugin.system.issuetabpanels:worklog-tabpanel#worklog-680654 ] ASF GitHub Bot logged work on HADOOP-18006: --- Author: ASF GitHub Bot

[GitHub] [hadoop] virajjasani opened a new pull request #3648: HADOOP-18006. maven-enforcer-plugin's execution of banned-illegal-imports gets overridden in child poms

2021-11-11 Thread GitBox
virajjasani opened a new pull request #3648: URL: https://github.com/apache/hadoop/pull/3648 ### Description of PR When we specify any maven plugin with execution tag in the parent as well as child modules, child module plugin overrides parent plugin. For instance, when

[jira] [Created] (HADOOP-18006) maven-enforcer-plugin's execution of banned-illegal-imports gets overridden in child poms

2021-11-11 Thread Viraj Jasani (Jira)
Viraj Jasani created HADOOP-18006: - Summary: maven-enforcer-plugin's execution of banned-illegal-imports gets overridden in child poms Key: HADOOP-18006 URL: https://issues.apache.org/jira/browse/HADOOP-18006

[GitHub] [hadoop] hadoop-yetus commented on pull request #3643: HDFS-16315. Add metrics related to Transfer and NativeCopy for DataNode

2021-11-11 Thread GitBox
hadoop-yetus commented on pull request #3643: URL: https://github.com/apache/hadoop/pull/3643#issuecomment-966828124 :broken_heart: **-1 overall** | Vote | Subsystem | Runtime | Logfile | Comment | |::|--:|:|::|:---:| | +0

[jira] [Work logged] (HADOOP-18005) Correct log format for LdapGroupsMapping

2021-11-11 Thread ASF GitHub Bot (Jira)
[ https://issues.apache.org/jira/browse/HADOOP-18005?focusedWorklogId=680647=com.atlassian.jira.plugin.system.issuetabpanels:worklog-tabpanel#worklog-680647 ] ASF GitHub Bot logged work on HADOOP-18005: --- Author: ASF GitHub Bot

[GitHub] [hadoop] hadoop-yetus commented on pull request #3647: HADOOP-18005. Correct log format for LdapGroupsMapping

2021-11-11 Thread GitBox
hadoop-yetus commented on pull request #3647: URL: https://github.com/apache/hadoop/pull/3647#issuecomment-966821109 :broken_heart: **-1 overall** | Vote | Subsystem | Runtime | Logfile | Comment | |::|--:|:|::|:---:| | +0

[GitHub] [hadoop] hadoop-yetus commented on pull request #3646: YARN-11003. Make RMNode aware of all (OContainer inclusive) allocated resources

2021-11-11 Thread GitBox
hadoop-yetus commented on pull request #3646: URL: https://github.com/apache/hadoop/pull/3646#issuecomment-966789708 :confetti_ball: **+1 overall** | Vote | Subsystem | Runtime | Logfile | Comment | |::|--:|:|::|:---:| | +0

[GitHub] [hadoop] haiyang1987 commented on pull request #3596: HDFS-16287. Support to make dfs.namenode.avoid.read.slow.datanode reconfigurable

2021-11-11 Thread GitBox
haiyang1987 commented on pull request #3596: URL: https://github.com/apache/hadoop/pull/3596#issuecomment-966779378 @ferhui @tomscut Thanks your review and merge. -- This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and

[GitHub] [hadoop] tomscut commented on pull request #3643: HDFS-16315. Add metrics related to Transfer and NativeCopy for DataNode

2021-11-11 Thread GitBox
tomscut commented on pull request #3643: URL: https://github.com/apache/hadoop/pull/3643#issuecomment-966772069 > Could you also update `hadoop-common-project/hadoop-common/src/site/markdown/Metrics.md`? Thanks @tasanuma for your suggestion. I will update the document ASAP. --

[jira] [Work logged] (HADOOP-18003) Add a method appendIfAbsent for CallerContext

2021-11-11 Thread ASF GitHub Bot (Jira)
[ https://issues.apache.org/jira/browse/HADOOP-18003?focusedWorklogId=680602=com.atlassian.jira.plugin.system.issuetabpanels:worklog-tabpanel#worklog-680602 ] ASF GitHub Bot logged work on HADOOP-18003: --- Author: ASF GitHub Bot

[GitHub] [hadoop] tomscut commented on a change in pull request #3644: HADOOP-18003. Add a method appendIfAbsent for CallerContext

2021-11-11 Thread GitBox
tomscut commented on a change in pull request #3644: URL: https://github.com/apache/hadoop/pull/3644#discussion_r747938836 ## File path: hadoop-common-project/hadoop-common/src/test/java/org/apache/hadoop/ipc/TestCallerContext.java ## @@ -42,6 +42,37 @@ public void

[jira] [Work logged] (HADOOP-18003) Add a method appendIfAbsent for CallerContext

2021-11-11 Thread ASF GitHub Bot (Jira)
[ https://issues.apache.org/jira/browse/HADOOP-18003?focusedWorklogId=680600=com.atlassian.jira.plugin.system.issuetabpanels:worklog-tabpanel#worklog-680600 ] ASF GitHub Bot logged work on HADOOP-18003: --- Author: ASF GitHub Bot

[GitHub] [hadoop] tasanuma commented on a change in pull request #3644: HADOOP-18003. Add a method appendIfAbsent for CallerContext

2021-11-11 Thread GitBox
tasanuma commented on a change in pull request #3644: URL: https://github.com/apache/hadoop/pull/3644#discussion_r747937158 ## File path: hadoop-common-project/hadoop-common/src/test/java/org/apache/hadoop/ipc/TestCallerContext.java ## @@ -42,6 +42,37 @@ public void

[jira] [Work logged] (HADOOP-18003) Add a method appendIfAbsent for CallerContext

2021-11-11 Thread ASF GitHub Bot (Jira)
[ https://issues.apache.org/jira/browse/HADOOP-18003?focusedWorklogId=680597=com.atlassian.jira.plugin.system.issuetabpanels:worklog-tabpanel#worklog-680597 ] ASF GitHub Bot logged work on HADOOP-18003: --- Author: ASF GitHub Bot

[GitHub] [hadoop] tasanuma commented on a change in pull request #3644: HADOOP-18003. Add a method appendIfAbsent for CallerContext

2021-11-11 Thread GitBox
tasanuma commented on a change in pull request #3644: URL: https://github.com/apache/hadoop/pull/3644#discussion_r747937158 ## File path: hadoop-common-project/hadoop-common/src/test/java/org/apache/hadoop/ipc/TestCallerContext.java ## @@ -42,6 +42,37 @@ public void

[GitHub] [hadoop] tasanuma commented on pull request #3643: HDFS-16315. Add metrics related to Transfer and NativeCopy for DataNode

2021-11-11 Thread GitBox
tasanuma commented on pull request #3643: URL: https://github.com/apache/hadoop/pull/3643#issuecomment-966767111 Could you also update `hadoop-common-project/hadoop-common/src/site/markdown/Metrics.md`? -- This is an automated message from the Apache Git Service. To respond to the

[jira] [Work logged] (HADOOP-18003) Add a method appendIfAbsent for CallerContext

2021-11-11 Thread ASF GitHub Bot (Jira)
[ https://issues.apache.org/jira/browse/HADOOP-18003?focusedWorklogId=680595=com.atlassian.jira.plugin.system.issuetabpanels:worklog-tabpanel#worklog-680595 ] ASF GitHub Bot logged work on HADOOP-18003: --- Author: ASF GitHub Bot

[GitHub] [hadoop] tomscut commented on a change in pull request #3644: HADOOP-18003. Add a method appendIfAbsent for CallerContext

2021-11-11 Thread GitBox
tomscut commented on a change in pull request #3644: URL: https://github.com/apache/hadoop/pull/3644#discussion_r747935844 ## File path: hadoop-common-project/hadoop-common/src/test/java/org/apache/hadoop/ipc/TestCallerContext.java ## @@ -42,6 +42,37 @@ public void

[jira] [Work logged] (HADOOP-18003) Add a method appendIfAbsent for CallerContext

2021-11-11 Thread ASF GitHub Bot (Jira)
[ https://issues.apache.org/jira/browse/HADOOP-18003?focusedWorklogId=680590=com.atlassian.jira.plugin.system.issuetabpanels:worklog-tabpanel#worklog-680590 ] ASF GitHub Bot logged work on HADOOP-18003: --- Author: ASF GitHub Bot

[GitHub] [hadoop] tasanuma commented on a change in pull request #3644: HADOOP-18003. Add a method appendIfAbsent for CallerContext

2021-11-11 Thread GitBox
tasanuma commented on a change in pull request #3644: URL: https://github.com/apache/hadoop/pull/3644#discussion_r747932879 ## File path: hadoop-common-project/hadoop-common/src/test/java/org/apache/hadoop/ipc/TestCallerContext.java ## @@ -42,6 +42,37 @@ public void

[GitHub] [hadoop] ferhui commented on pull request #3596: HDFS-16287. Support to make dfs.namenode.avoid.read.slow.datanode reconfigurable

2021-11-11 Thread GitBox
ferhui commented on pull request #3596: URL: https://github.com/apache/hadoop/pull/3596#issuecomment-966759997 @haiyang1987 Thanks for contribution. @tomscut Thanks for review! -- This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub

[GitHub] [hadoop] ferhui merged pull request #3596: HDFS-16287. Support to make dfs.namenode.avoid.read.slow.datanode reconfigurable

2021-11-11 Thread GitBox
ferhui merged pull request #3596: URL: https://github.com/apache/hadoop/pull/3596 -- This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use the URL above to go to the specific comment. To unsubscribe, e-mail:

[GitHub] [hadoop] tomscut commented on pull request #3643: HDFS-16315. Add metrics related to Transfer and NativeCopy for DataNode

2021-11-11 Thread GitBox
tomscut commented on pull request #3643: URL: https://github.com/apache/hadoop/pull/3643#issuecomment-966758876 Thanks @ferhui for your review. -- This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use the URL above to go to

[GitHub] [hadoop] ferhui commented on pull request #3629: HDFS-16305.Record the remote NameNode address when the rolling log is triggered.

2021-11-11 Thread GitBox
ferhui commented on pull request #3629: URL: https://github.com/apache/hadoop/pull/3629#issuecomment-966754276 @jianghuazhu Thanks for contribution. @ayushtkn @virajjasani @tomscut Thanks for review! -- This is an automated message from the Apache Git Service. To respond to the message,

[GitHub] [hadoop] ferhui merged pull request #3629: HDFS-16305.Record the remote NameNode address when the rolling log is triggered.

2021-11-11 Thread GitBox
ferhui merged pull request #3629: URL: https://github.com/apache/hadoop/pull/3629 -- This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use the URL above to go to the specific comment. To unsubscribe, e-mail:

[GitHub] [hadoop] tomscut commented on pull request #3636: HDFS-16311. Metric metadataOperationRate calculation error in DataNod…

2021-11-11 Thread GitBox
tomscut commented on pull request #3636: URL: https://github.com/apache/hadoop/pull/3636#issuecomment-966746626 Thanks @tasanuma for the merge. -- This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use the URL above to go to

[jira] [Work logged] (HADOOP-18003) Add a method appendIfAbsent for CallerContext

2021-11-11 Thread ASF GitHub Bot (Jira)
[ https://issues.apache.org/jira/browse/HADOOP-18003?focusedWorklogId=680570=com.atlassian.jira.plugin.system.issuetabpanels:worklog-tabpanel#worklog-680570 ] ASF GitHub Bot logged work on HADOOP-18003: --- Author: ASF GitHub Bot

[GitHub] [hadoop] tomscut commented on pull request #3644: HADOOP-18003. Add a method appendIfAbsent for CallerContext

2021-11-11 Thread GitBox
tomscut commented on pull request #3644: URL: https://github.com/apache/hadoop/pull/3644#issuecomment-966746304 We discussed here [#3635](https://github.com/apache/hadoop/pull/3635#discussion_r746873078) earlier. -- This is an automated message from the Apache Git Service. To

[jira] [Updated] (HADOOP-18005) Correct log format for LdapGroupsMapping

2021-11-11 Thread ASF GitHub Bot (Jira)
[ https://issues.apache.org/jira/browse/HADOOP-18005?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] ASF GitHub Bot updated HADOOP-18005: Labels: pull-request-available (was: ) > Correct log format for LdapGroupsMapping >

[jira] [Work logged] (HADOOP-18005) Correct log format for LdapGroupsMapping

2021-11-11 Thread ASF GitHub Bot (Jira)
[ https://issues.apache.org/jira/browse/HADOOP-18005?focusedWorklogId=680569=com.atlassian.jira.plugin.system.issuetabpanels:worklog-tabpanel#worklog-680569 ] ASF GitHub Bot logged work on HADOOP-18005: --- Author: ASF GitHub Bot

[GitHub] [hadoop] tomscut opened a new pull request #3647: HADOOP-18005. Correct log format for LdapGroupsMapping

2021-11-11 Thread GitBox
tomscut opened a new pull request #3647: URL: https://github.com/apache/hadoop/pull/3647 JIRA: [HADOOP-18005](https://issues.apache.org/jira/browse/HADOOP-18005). -- This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use the

[GitHub] [hadoop] tasanuma commented on pull request #3636: HDFS-16311. Metric metadataOperationRate calculation error in DataNod…

2021-11-11 Thread GitBox
tasanuma commented on pull request #3636: URL: https://github.com/apache/hadoop/pull/3636#issuecomment-966743376 Merged it. Thanks for your contribution, @tomscut. Thanks for reviewing it, @ayushtkn. -- This is an automated message from the Apache Git Service. To respond to the message,

[GitHub] [hadoop] tasanuma merged pull request #3636: HDFS-16311. Metric metadataOperationRate calculation error in DataNod…

2021-11-11 Thread GitBox
tasanuma merged pull request #3636: URL: https://github.com/apache/hadoop/pull/3636 -- This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use the URL above to go to the specific comment. To unsubscribe, e-mail:

[jira] [Created] (HADOOP-18005) Correct log format for LdapGroupsMapping

2021-11-11 Thread tomscut (Jira)
tomscut created HADOOP-18005: Summary: Correct log format for LdapGroupsMapping Key: HADOOP-18005 URL: https://issues.apache.org/jira/browse/HADOOP-18005 Project: Hadoop Common Issue Type: Wish

[GitHub] [hadoop] tomscut commented on pull request #3636: HDFS-16311. Metric metadataOperationRate calculation error in DataNod…

2021-11-11 Thread GitBox
tomscut commented on pull request #3636: URL: https://github.com/apache/hadoop/pull/3636#issuecomment-966729633 Thanks @ayushtkn for your review. -- This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use the URL above to

[GitHub] [hadoop] hadoop-yetus commented on pull request #3646: YARN-11003. Make RMNode aware of all (OContainer inclusive) allocated resources

2021-11-11 Thread GitBox
hadoop-yetus commented on pull request #3646: URL: https://github.com/apache/hadoop/pull/3646#issuecomment-966724419 :confetti_ball: **+1 overall** | Vote | Subsystem | Runtime | Logfile | Comment | |::|--:|:|::|:---:| | +0

[GitHub] [hadoop] afchung commented on pull request #3646: YARN-11003. Make RMNode aware of all (OContainer inclusive) allocated resources

2021-11-11 Thread GitBox
afchung commented on pull request #3646: URL: https://github.com/apache/hadoop/pull/3646#issuecomment-966657911 @goiri thanks for the review! Have pushed a new commit to address your comments. -- This is an automated message from the Apache Git Service. To respond to the message, please

[GitHub] [hadoop] goiri commented on a change in pull request #3646: YARN-11003. Make RMNode aware of all (OContainer inclusive) allocated resources

2021-11-11 Thread GitBox
goiri commented on a change in pull request #3646: URL: https://github.com/apache/hadoop/pull/3646#discussion_r747780345 ## File path:

[GitHub] [hadoop] afchung opened a new pull request #3646: YARN-11003. Make RMNode aware of all (OContainer inclusive) allocated resources

2021-11-11 Thread GitBox
afchung opened a new pull request #3646: URL: https://github.com/apache/hadoop/pull/3646 ### Description of PR * Adds a new method in RMNode: getAllocatedContainerResource, which records how much resource is allocated to containers on a node * Adds up RUNNING and NEW container

[jira] [Work logged] (HADOOP-15566) Support OpenTelemetry

2021-11-11 Thread ASF GitHub Bot (Jira)
[ https://issues.apache.org/jira/browse/HADOOP-15566?focusedWorklogId=680434=com.atlassian.jira.plugin.system.issuetabpanels:worklog-tabpanel#worklog-680434 ] ASF GitHub Bot logged work on HADOOP-15566: --- Author: ASF GitHub Bot

[GitHub] [hadoop] ndimiduk commented on pull request #3445: HADOOP-15566 Opentelemetry changes using java agent

2021-11-11 Thread GitBox
ndimiduk commented on pull request #3445: URL: https://github.com/apache/hadoop/pull/3445#issuecomment-966557663 Okay, this patch to your branch, ``` diff --git a/hadoop-client-modules/hadoop-client/pom.xml b/hadoop-client-modules/hadoop-client/pom.xml index

[jira] [Work logged] (HADOOP-15566) Support OpenTelemetry

2021-11-11 Thread ASF GitHub Bot (Jira)
[ https://issues.apache.org/jira/browse/HADOOP-15566?focusedWorklogId=680416=com.atlassian.jira.plugin.system.issuetabpanels:worklog-tabpanel#worklog-680416 ] ASF GitHub Bot logged work on HADOOP-15566: --- Author: ASF GitHub Bot

[GitHub] [hadoop] ndimiduk commented on pull request #3445: HADOOP-15566 Opentelemetry changes using java agent

2021-11-11 Thread GitBox
ndimiduk commented on pull request #3445: URL: https://github.com/apache/hadoop/pull/3445#issuecomment-966536367 Oh I see, you already have the dependency in the `hadoop-project/pom.xml`. I guess it doesn't get picked up from there during packaging. So my patch is not quite right either.

[jira] [Commented] (HADOOP-17999) ViewFileSystem.setVerifyChecksum should not initialize all target filesystems

2021-11-11 Thread Konstantin Shvachko (Jira)
[ https://issues.apache.org/jira/browse/HADOOP-17999?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17442389#comment-17442389 ] Konstantin Shvachko commented on HADOOP-17999: -- Was looking at the patch. Why do we need

[GitHub] [hadoop] ndimiduk commented on pull request #3445: HADOOP-15566 Opentelemetry changes using java agent

2021-11-11 Thread GitBox
ndimiduk commented on pull request #3445: URL: https://github.com/apache/hadoop/pull/3445#issuecomment-966523434 This isn't right, but it's along the path, ``` diff --git a/hadoop-client-modules/hadoop-client/pom.xml b/hadoop-client-modules/hadoop-client/pom.xml index

[jira] [Work logged] (HADOOP-15566) Support OpenTelemetry

2021-11-11 Thread ASF GitHub Bot (Jira)
[ https://issues.apache.org/jira/browse/HADOOP-15566?focusedWorklogId=680404=com.atlassian.jira.plugin.system.issuetabpanels:worklog-tabpanel#worklog-680404 ] ASF GitHub Bot logged work on HADOOP-15566: --- Author: ASF GitHub Bot

[jira] [Work logged] (HADOOP-15566) Support OpenTelemetry

2021-11-11 Thread ASF GitHub Bot (Jira)
[ https://issues.apache.org/jira/browse/HADOOP-15566?focusedWorklogId=680400=com.atlassian.jira.plugin.system.issuetabpanels:worklog-tabpanel#worklog-680400 ] ASF GitHub Bot logged work on HADOOP-15566: --- Author: ASF GitHub Bot

[GitHub] [hadoop] ndimiduk commented on pull request #3445: HADOOP-15566 Opentelemetry changes using java agent

2021-11-11 Thread GitBox
ndimiduk commented on pull request #3445: URL: https://github.com/apache/hadoop/pull/3445#issuecomment-966519014 I think you need to add the otel-agent jar as a dependency to hadoop-common and exclude it as a dependency from hadoop-client. then it'll show up in `share/hadoop/common/lib`.

[GitHub] [hadoop] goiri commented on a change in pull request #3632: YARN-10822. Containers going from New to Scheduled transition for kil…

2021-11-11 Thread GitBox
goiri commented on a change in pull request #3632: URL: https://github.com/apache/hadoop/pull/3632#discussion_r747713762 ## File path:

[GitHub] [hadoop] goiri commented on a change in pull request #3607: YARN-8859. Add audit logs for router service

2021-11-11 Thread GitBox
goiri commented on a change in pull request #3607: URL: https://github.com/apache/hadoop/pull/3607#discussion_r747710116 ## File path:

[GitHub] [hadoop] goiri merged pull request #3603: [YARN-10998] Add YARN_ROUTER_HEAPSIZE to yarn-env for routers

2021-11-11 Thread GitBox
goiri merged pull request #3603: URL: https://github.com/apache/hadoop/pull/3603 -- This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use the URL above to go to the specific comment. To unsubscribe, e-mail:

[GitHub] [hadoop] ayushtkn commented on a change in pull request #3469: HDFS-16234.Improve DataNodeMetrics to initialize IBR more reasonable.

2021-11-11 Thread GitBox
ayushtkn commented on a change in pull request #3469: URL: https://github.com/apache/hadoop/pull/3469#discussion_r747693806 ## File path: hadoop-hdfs-project/hadoop-hdfs/src/main/java/org/apache/hadoop/hdfs/server/datanode/IncrementalBlockReportManager.java ## @@ -212,6

[jira] [Work logged] (HADOOP-17997) RBF: Namespace usage of mount table with multi subclusters can exceed quota

2021-11-11 Thread ASF GitHub Bot (Jira)
[ https://issues.apache.org/jira/browse/HADOOP-17997?focusedWorklogId=680356=com.atlassian.jira.plugin.system.issuetabpanels:worklog-tabpanel#worklog-680356 ] ASF GitHub Bot logged work on HADOOP-17997: --- Author: ASF GitHub Bot

[GitHub] [hadoop] ayushtkn commented on a change in pull request #3634: HADOOP-17997. RBF: Namespace usage of mount table with multi subclust…

2021-11-11 Thread GitBox
ayushtkn commented on a change in pull request #3634: URL: https://github.com/apache/hadoop/pull/3634#discussion_r747676443 ## File path: hadoop-hdfs-project/hadoop-hdfs/src/main/java/org/apache/hadoop/hdfs/server/namenode/Quota.java ## @@ -50,7 +50,7 @@ public static Counts

[GitHub] [hadoop] hadoop-yetus commented on pull request #3618: YARN-11000. Replace queue resource calculation logic in updateClusterResource

2021-11-11 Thread GitBox
hadoop-yetus commented on pull request #3618: URL: https://github.com/apache/hadoop/pull/3618#issuecomment-966442234 :broken_heart: **-1 overall** | Vote | Subsystem | Runtime | Logfile | Comment | |::|--:|:|::|:---:| | +0

[GitHub] [hadoop] hadoop-yetus commented on pull request #3643: HDFS-16315. Add metrics related to Transfer and NativeCopy for DataNode

2021-11-11 Thread GitBox
hadoop-yetus commented on pull request #3643: URL: https://github.com/apache/hadoop/pull/3643#issuecomment-966435311 :confetti_ball: **+1 overall** | Vote | Subsystem | Runtime | Logfile | Comment | |::|--:|:|::|:---:| | +0

[GitHub] [hadoop] jianghuazhu commented on pull request #3629: HDFS-16305.Record the remote NameNode address when the rolling log is triggered.

2021-11-11 Thread GitBox
jianghuazhu commented on pull request #3629: URL: https://github.com/apache/hadoop/pull/3629#issuecomment-966419908 Can you help review this pr again, @ayushtkn @ferhui Thank you very much. -- This is an automated message from the Apache Git Service. To respond to the message,

[GitHub] [hadoop] jianghuazhu commented on pull request #3629: HDFS-16305.Record the remote NameNode address when the rolling log is triggered.

2021-11-11 Thread GitBox
jianghuazhu commented on pull request #3629: URL: https://github.com/apache/hadoop/pull/3629#issuecomment-966418929 Thank you very much. @virajjasani @tomscut -- This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use the URL

[jira] [Work logged] (HADOOP-17979) Interface EtagSource to allow FileStatus subclasses to provide etags

2021-11-11 Thread ASF GitHub Bot (Jira)
[ https://issues.apache.org/jira/browse/HADOOP-17979?focusedWorklogId=680310=com.atlassian.jira.plugin.system.issuetabpanels:worklog-tabpanel#worklog-680310 ] ASF GitHub Bot logged work on HADOOP-17979: --- Author: ASF GitHub Bot

[GitHub] [hadoop] hadoop-yetus commented on pull request #3633: HADOOP-17979. Add Interface EtagSource to allow FileStatus subclasses to provide etags

2021-11-11 Thread GitBox
hadoop-yetus commented on pull request #3633: URL: https://github.com/apache/hadoop/pull/3633#issuecomment-966377314 :broken_heart: **-1 overall** | Vote | Subsystem | Runtime | Logfile | Comment | |::|--:|:|::|:---:| | +0

[jira] [Work logged] (HADOOP-17995) Stale record should be remove when DataNodePeerMetrics#dumpSendPacketDownstreamAvgInfoAsJson

2021-11-11 Thread ASF GitHub Bot (Jira)
[ https://issues.apache.org/jira/browse/HADOOP-17995?focusedWorklogId=680287=com.atlassian.jira.plugin.system.issuetabpanels:worklog-tabpanel#worklog-680287 ] ASF GitHub Bot logged work on HADOOP-17995: --- Author: ASF GitHub Bot

[GitHub] [hadoop] AlphaGouGe commented on a change in pull request #3630: HADOOP-17995. Stale record should be remove when DataNodePeerMetrics#dumpSendPacketDownstreamAvgInfoAsJson

2021-11-11 Thread GitBox
AlphaGouGe commented on a change in pull request #3630: URL: https://github.com/apache/hadoop/pull/3630#discussion_r747520206 ## File path: hadoop-common-project/hadoop-common/src/main/java/org/apache/hadoop/metrics2/lib/MutableRollingAverages.java ## @@ -167,7 +167,7 @@

[jira] [Created] (HADOOP-18004) abfs and s3a disk buffer factories to use UUIDs for file prefixes

2021-11-11 Thread Steve Loughran (Jira)
Steve Loughran created HADOOP-18004: --- Summary: abfs and s3a disk buffer factories to use UUIDs for file prefixes Key: HADOOP-18004 URL: https://issues.apache.org/jira/browse/HADOOP-18004 Project:

[GitHub] [hadoop] hadoop-yetus commented on pull request #3635: HDFS-16310. RBF: Add client port to CallerContext for Router

2021-11-11 Thread GitBox
hadoop-yetus commented on pull request #3635: URL: https://github.com/apache/hadoop/pull/3635#issuecomment-966269499 :broken_heart: **-1 overall** | Vote | Subsystem | Runtime | Logfile | Comment | |::|--:|:|::|:---:| | +0

[jira] [Work logged] (HADOOP-18002) abfs rename idempotency broken -remove recovery

2021-11-11 Thread ASF GitHub Bot (Jira)
[ https://issues.apache.org/jira/browse/HADOOP-18002?focusedWorklogId=680251=com.atlassian.jira.plugin.system.issuetabpanels:worklog-tabpanel#worklog-680251 ] ASF GitHub Bot logged work on HADOOP-18002: --- Author: ASF GitHub Bot

[GitHub] [hadoop] mukund-thakur commented on pull request #3641: HADOOP-18002. abfs rename idempotency broken -remove recovery

2021-11-11 Thread GitBox
mukund-thakur commented on pull request #3641: URL: https://github.com/apache/hadoop/pull/3641#issuecomment-966254315 Why can't we just revert the commit rather than deleting it? Also there is delete idempotency checks as well not sure if they also use same LMT check. -- This is an

[GitHub] [hadoop] sumangala-patki commented on a change in pull request #3440: ABFS: Support for Encryption Context

2021-11-11 Thread GitBox
sumangala-patki commented on a change in pull request #3440: URL: https://github.com/apache/hadoop/pull/3440#discussion_r747361460 ## File path: hadoop-tools/hadoop-azure/src/main/java/org/apache/hadoop/fs/azurebfs/services/AbfsClient.java ## @@ -113,13 +119,14 @@ private

[GitHub] [hadoop] tomscut commented on pull request #3643: HDFS-16315. Add metrics related to Transfer and NativeCopy for DataNode

2021-11-11 Thread GitBox
tomscut commented on pull request #3643: URL: https://github.com/apache/hadoop/pull/3643#issuecomment-966082070 Hi @aajisaka @tasanuma @goiri @jojochuang @ferhui , could you please review the code. Thanks a lot. -- This is an automated message from the Apache Git Service. To respond to

[GitHub] [hadoop] hadoop-yetus commented on pull request #3643: HDFS-16315. Add metrics related to Transfer and NativeCopy for DataNode

2021-11-11 Thread GitBox
hadoop-yetus commented on pull request #3643: URL: https://github.com/apache/hadoop/pull/3643#issuecomment-966077866 :confetti_ball: **+1 overall** | Vote | Subsystem | Runtime | Logfile | Comment | |::|--:|:|::|:---:| | +0