[GitHub] [hadoop] virajjasani commented on pull request #3659: HDFS-16323. DatanodeHttpServer doesn't require handler state map while retrieving filter handlers

2021-11-15 Thread GitBox
virajjasani commented on pull request #3659: URL: https://github.com/apache/hadoop/pull/3659#issuecomment-969965471 @anuengineer @aajisaka @tasanuma Could you please take a look? Thanks -- This is an automated message from the Apache Git Service. To respond to the message, please log on

[GitHub] [hadoop] tasanuma commented on pull request #3666: Backport HDFS-16315 for branch-3.3

2021-11-15 Thread GitBox
tasanuma commented on pull request #3666: URL: https://github.com/apache/hadoop/pull/3666#issuecomment-969957949 @tomscut Thanks for creating the PR. +1, pending Jenkins. -- This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and

[GitHub] [hadoop] hadoop-yetus commented on pull request #3665: pull-request-creator 1

2021-11-15 Thread GitBox
hadoop-yetus commented on pull request #3665: URL: https://github.com/apache/hadoop/pull/3665#issuecomment-969933268 :broken_heart: **-1 overall** | Vote | Subsystem | Runtime | Logfile | Comment | |::|--:|:|::|:---:| | +0

[GitHub] [hadoop] tomscut commented on pull request #3643: HDFS-16315. Add metrics related to Transfer and NativeCopy for DataNode

2021-11-15 Thread GitBox
tomscut commented on pull request #3643: URL: https://github.com/apache/hadoop/pull/3643#issuecomment-969915079 > @tomscut I'd like to cherry-pick it to lower branches, but there are small conflicts. Could you create another PR for branch-3.3? The variable of `name` in `TestFsDatasetImpl`

[GitHub] [hadoop] tomscut opened a new pull request #3666: Backport HDFS-16315 for branch-3.3

2021-11-15 Thread GitBox
tomscut opened a new pull request #3666: URL: https://github.com/apache/hadoop/pull/3666 Backport [HDFS-16315](https://issues.apache.org/jira/browse/HDFS-16315) for branch-3.3. -- This is an automated message from the Apache Git Service. To respond to the message, please log on to

[jira] [Work logged] (HADOOP-11867) FS API: Add a high-performance vectored Read to FSDataInputStream API

2021-11-15 Thread ASF GitHub Bot (Jira)
[ https://issues.apache.org/jira/browse/HADOOP-11867?focusedWorklogId=681836=com.atlassian.jira.plugin.system.issuetabpanels:worklog-tabpanel#worklog-681836 ] ASF GitHub Bot logged work on HADOOP-11867: --- Author: ASF GitHub Bot

[GitHub] [hadoop] mukund-thakur commented on a change in pull request #3499: HADOOP-11867. Add a high performance vectored read API to file system.

2021-11-15 Thread GitBox
mukund-thakur commented on a change in pull request #3499: URL: https://github.com/apache/hadoop/pull/3499#discussion_r749944182 ## File path: hadoop-common-project/hadoop-common/src/main/java/org/apache/hadoop/fs/impl/CombinedFileRange.java ## @@ -0,0 +1,71 @@ +/* + *

[GitHub] [hadoop] ardier opened a new pull request #3665: pull-request-creator 1

2021-11-15 Thread GitBox
ardier opened a new pull request #3665: URL: https://github.com/apache/hadoop/pull/3665 ### Description of PR ### How was this patch tested? ### For code changes: - [ ] Does the title or this PR starts with the corresponding JIRA issue id (e.g.

[GitHub] [hadoop] haiyang1987 commented on pull request #3664: HDFS-16314. Support to make dfs.namenode.block-placement-policy.exclude-slow-nodes.enabled reconfigurable

2021-11-15 Thread GitBox
haiyang1987 commented on pull request #3664: URL: https://github.com/apache/hadoop/pull/3664#issuecomment-969834330 @tomscut Thank you for your reply. sorry, the previous PR exception was closed and created a new PR. As you suggested fixed and updated PR. -- This is an automated

[GitHub] [hadoop] haiyang1987 edited a comment on pull request #3651: HDFS-16314. Support to make dfs.namenode.block-placement-policy.exclude-slow-nodes.enabled reconfigurable

2021-11-15 Thread GitBox
haiyang1987 edited a comment on pull request #3651: URL: https://github.com/apache/hadoop/pull/3651#issuecomment-969825808 Sorry, code branch HDFS-16314 was deleted by mistake, resubmit a PR https://github.com/apache/hadoop/pull/3664 -- This is an automated message from the Apache Git

[GitHub] [hadoop] haiyang1987 commented on pull request #3651: HDFS-16314. Support to make dfs.namenode.block-placement-policy.exclude-slow-nodes.enabled reconfigurable

2021-11-15 Thread GitBox
haiyang1987 commented on pull request #3651: URL: https://github.com/apache/hadoop/pull/3651#issuecomment-969825808 Sorry, code branch HDFS-16314 was deleted by mistake, resubmit a PR -- This is an automated message from the Apache Git Service. To respond to the message, please log on to

[GitHub] [hadoop] haiyang1987 closed pull request #3664: HDFS-16314. Support to make dfs.namenode.block-placement-policy.exclude-slow-nodes.enabled reconfigurable

2021-11-15 Thread GitBox
haiyang1987 closed pull request #3664: URL: https://github.com/apache/hadoop/pull/3664 -- This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use the URL above to go to the specific comment. To unsubscribe, e-mail:

[GitHub] [hadoop] haiyang1987 opened a new pull request #3664: HDFS-16314. Support to make dfs.namenode.block-placement-policy.exclude-slow-nodes.enabled reconfigurable

2021-11-15 Thread GitBox
haiyang1987 opened a new pull request #3664: URL: https://github.com/apache/hadoop/pull/3664 ### Description of PR Consider that make dfs.namenode.block-placement-policy.exclude-slow-nodes.enabled reconfigurable and rapid rollback in case this feature HDFS-16076 unexpected things

[GitHub] [hadoop] tomscut commented on pull request #3643: HDFS-16315. Add metrics related to Transfer and NativeCopy for DataNode

2021-11-15 Thread GitBox
tomscut commented on pull request #3643: URL: https://github.com/apache/hadoop/pull/3643#issuecomment-969787153 > @tomscut I'd like to cherry-pick it to lower branches, but there are small conflicts. Could you create another PR for branch-3.3? The variable of `name` in `TestFsDatasetImpl`

[GitHub] [hadoop] tasanuma commented on pull request #3643: HDFS-16315. Add metrics related to Transfer and NativeCopy for DataNode

2021-11-15 Thread GitBox
tasanuma commented on pull request #3643: URL: https://github.com/apache/hadoop/pull/3643#issuecomment-969782246 @tomscut I'd like to cherry-pick it to lower branches, but there are small conflicts. Could you create another PR for branch-3.3? The variable of `name` in `TestFsDatasetImpl`

[GitHub] [hadoop] haiyang1987 closed pull request #3651: HDFS-16314. Support to make dfs.namenode.block-placement-policy.exclude-slow-nodes.enabled reconfigurable

2021-11-15 Thread GitBox
haiyang1987 closed pull request #3651: URL: https://github.com/apache/hadoop/pull/3651 -- This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use the URL above to go to the specific comment. To unsubscribe, e-mail:

[GitHub] [hadoop] haiyang1987 commented on a change in pull request #3651: HDFS-16314. Support to make dfs.namenode.block-placement-policy.exclude-slow-nodes.enabled reconfigurable

2021-11-15 Thread GitBox
haiyang1987 commented on a change in pull request #3651: URL: https://github.com/apache/hadoop/pull/3651#discussion_r749867573 ## File path: hadoop-hdfs-project/hadoop-hdfs/src/main/java/org/apache/hadoop/hdfs/server/namenode/NameNode.java ## @@ -2390,15 +2394,24 @@ String

[GitHub] [hadoop] tomscut commented on pull request #3643: HDFS-16315. Add metrics related to Transfer and NativeCopy for DataNode

2021-11-15 Thread GitBox
tomscut commented on pull request #3643: URL: https://github.com/apache/hadoop/pull/3643#issuecomment-969716964 Thanks @tasanuma for the merge. -- This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use the URL above to go to

[GitHub] [hadoop] GuoPhilipse commented on pull request #3661: HDFS-16324. fix error log in BlockManagerSafeMode

2021-11-15 Thread GitBox
GuoPhilipse commented on pull request #3661: URL: https://github.com/apache/hadoop/pull/3661#issuecomment-969695706 > > @tomscut Could you kindly help verify, the test error seems not related with the patch. `[ERROR]

[GitHub] [hadoop] tasanuma commented on pull request #3643: HDFS-16315. Add metrics related to Transfer and NativeCopy for DataNode

2021-11-15 Thread GitBox
tasanuma commented on pull request #3643: URL: https://github.com/apache/hadoop/pull/3643#issuecomment-969691839 Merged. Thanks for your contribution, @tomscut, and thanks for reviewing it, @ferhui and @ayushtkn. -- This is an automated message from the Apache Git Service. To respond to

[GitHub] [hadoop] tasanuma merged pull request #3643: HDFS-16315. Add metrics related to Transfer and NativeCopy for DataNode

2021-11-15 Thread GitBox
tasanuma merged pull request #3643: URL: https://github.com/apache/hadoop/pull/3643 -- This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use the URL above to go to the specific comment. To unsubscribe, e-mail:

[GitHub] [hadoop] tomscut commented on pull request #3661: HDFS-16324. fix error log in BlockManagerSafeMode

2021-11-15 Thread GitBox
tomscut commented on pull request #3661: URL: https://github.com/apache/hadoop/pull/3661#issuecomment-969677031 > @tomscut Could you kindly help verify, the test error seems not related with the patch. `[ERROR]

[GitHub] [hadoop] ferhui commented on pull request #3654: HDFS-16320. Datanode retrieve slownode information from NameNode

2021-11-15 Thread GitBox
ferhui commented on pull request #3654: URL: https://github.com/apache/hadoop/pull/3654#issuecomment-969675032 @tasanuma @ayushtkn Would you also take a look? Thanks. -- This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use

[GitHub] [hadoop] GuoPhilipse commented on pull request #3661: HDFS-16324. fix error log in BlockManagerSafeMode

2021-11-15 Thread GitBox
GuoPhilipse commented on pull request #3661: URL: https://github.com/apache/hadoop/pull/3661#issuecomment-969671740 @tomscut Could you kindly help verify, the test error seems not related with the patch. `[ERROR]

[GitHub] [hadoop] GuoPhilipse commented on pull request #3657: YARN-11007.Improve doc

2021-11-15 Thread GitBox
GuoPhilipse commented on pull request #3657: URL: https://github.com/apache/hadoop/pull/3657#issuecomment-969667746 @BilwaST @tangzhankun ,Could you kindly help review ? Thanx -- This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub

[GitHub] [hadoop] ferhui commented on pull request #3638: HDFS-16313. Add metrics for each subcluster

2021-11-15 Thread GitBox
ferhui commented on pull request #3638: URL: https://github.com/apache/hadoop/pull/3638#issuecomment-969653176 @symious Thanks for contribution. @goiri Thanks for review! Merged to trunk. -- This is an automated message from the Apache Git Service. To respond to the message, please log

[GitHub] [hadoop] ferhui merged pull request #3638: HDFS-16313. Add metrics for each subcluster

2021-11-15 Thread GitBox
ferhui merged pull request #3638: URL: https://github.com/apache/hadoop/pull/3638 -- This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use the URL above to go to the specific comment. To unsubscribe, e-mail:

[GitHub] [hadoop] tomscut commented on a change in pull request #3651: HDFS-16314. Support to make dfs.namenode.block-placement-policy.exclude-slow-nodes.enabled reconfigurable

2021-11-15 Thread GitBox
tomscut commented on a change in pull request #3651: URL: https://github.com/apache/hadoop/pull/3651#discussion_r749833779 ## File path: hadoop-hdfs-project/hadoop-hdfs/src/main/java/org/apache/hadoop/hdfs/server/namenode/NameNode.java ## @@ -2390,15 +2394,24 @@ String

[GitHub] [hadoop] tomscut opened a new pull request #3663: HDFS-16326. Simplify the code for DiskBalancer

2021-11-15 Thread GitBox
tomscut opened a new pull request #3663: URL: https://github.com/apache/hadoop/pull/3663 JIRA: [HDFS-16326](https://issues.apache.org/jira/browse/HDFS-16326). Simplify the code for DiskBalancer. -- This is an automated message from the Apache Git Service. To respond to the

[GitHub] [hadoop] hadoop-yetus commented on pull request #3646: YARN-11003. Make RMNode aware of all (OContainer inclusive) allocated resources

2021-11-15 Thread GitBox
hadoop-yetus commented on pull request #3646: URL: https://github.com/apache/hadoop/pull/3646#issuecomment-969502883 :confetti_ball: **+1 overall** | Vote | Subsystem | Runtime | Logfile | Comment | |::|--:|:|::|:---:| | +0

[jira] [Work logged] (HADOOP-17999) ViewFileSystem.setVerifyChecksum should not initialize all target filesystems

2021-11-15 Thread ASF GitHub Bot (Jira)
[ https://issues.apache.org/jira/browse/HADOOP-17999?focusedWorklogId=681690=com.atlassian.jira.plugin.system.issuetabpanels:worklog-tabpanel#worklog-681690 ] ASF GitHub Bot logged work on HADOOP-17999: --- Author: ASF GitHub Bot

[GitHub] [hadoop] shvachko commented on a change in pull request #3639: HADOOP-17999: Do not initialize all target FileSystems for setWriteChecksum and setVerifyChecksum

2021-11-15 Thread GitBox
shvachko commented on a change in pull request #3639: URL: https://github.com/apache/hadoop/pull/3639#discussion_r749658488 ## File path: hadoop-common-project/hadoop-common/src/main/java/org/apache/hadoop/fs/viewfs/ViewFileSystem.java ## @@ -917,13 +917,9 @@ public void

[jira] [Work logged] (HADOOP-18011) ABFS: Enable config control for default connection timeout

2021-11-15 Thread ASF GitHub Bot (Jira)
[ https://issues.apache.org/jira/browse/HADOOP-18011?focusedWorklogId=681681=com.atlassian.jira.plugin.system.issuetabpanels:worklog-tabpanel#worklog-681681 ] ASF GitHub Bot logged work on HADOOP-18011: --- Author: ASF GitHub Bot

[GitHub] [hadoop] hadoop-yetus commented on pull request #3662: HADOOP-18011. ABFS: Configurable HTTP connection and read timeouts

2021-11-15 Thread GitBox
hadoop-yetus commented on pull request #3662: URL: https://github.com/apache/hadoop/pull/3662#issuecomment-969255405 :broken_heart: **-1 overall** | Vote | Subsystem | Runtime | Logfile | Comment | |::|--:|:|::|:---:| | +0

[GitHub] [hadoop] goiri commented on a change in pull request #3646: YARN-11003. Make RMNode aware of all (OContainer inclusive) allocated resources

2021-11-15 Thread GitBox
goiri commented on a change in pull request #3646: URL: https://github.com/apache/hadoop/pull/3646#discussion_r749613001 ## File path:

[jira] [Work logged] (HADOOP-17409) Remove S3Guard - no longer needed

2021-11-15 Thread ASF GitHub Bot (Jira)
[ https://issues.apache.org/jira/browse/HADOOP-17409?focusedWorklogId=681669=com.atlassian.jira.plugin.system.issuetabpanels:worklog-tabpanel#worklog-681669 ] ASF GitHub Bot logged work on HADOOP-17409: --- Author: ASF GitHub Bot

[GitHub] [hadoop] hadoop-yetus commented on pull request #3534: HADOOP-17409. Remove s3guard from S3A module

2021-11-15 Thread GitBox
hadoop-yetus commented on pull request #3534: URL: https://github.com/apache/hadoop/pull/3534#issuecomment-969227284 :broken_heart: **-1 overall** | Vote | Subsystem | Runtime | Logfile | Comment | |::|--:|:|::|:---:| | +0

[GitHub] [hadoop] hadoop-yetus commented on pull request #3661: HDFS-16324. fix error log in BlockManagerSafeMode

2021-11-15 Thread GitBox
hadoop-yetus commented on pull request #3661: URL: https://github.com/apache/hadoop/pull/3661#issuecomment-969219671 :broken_heart: **-1 overall** | Vote | Subsystem | Runtime | Logfile | Comment | |::|--:|:|::|:---:| | +0

[jira] [Work logged] (HADOOP-17999) ViewFileSystem.setVerifyChecksum should not initialize all target filesystems

2021-11-15 Thread ASF GitHub Bot (Jira)
[ https://issues.apache.org/jira/browse/HADOOP-17999?focusedWorklogId=681666=com.atlassian.jira.plugin.system.issuetabpanels:worklog-tabpanel#worklog-681666 ] ASF GitHub Bot logged work on HADOOP-17999: --- Author: ASF GitHub Bot

[GitHub] [hadoop] hadoop-yetus commented on pull request #3639: HADOOP-17999: Do not initialize all target FileSystems for setWriteChecksum and setVerifyChecksum

2021-11-15 Thread GitBox
hadoop-yetus commented on pull request #3639: URL: https://github.com/apache/hadoop/pull/3639#issuecomment-969216656 :broken_heart: **-1 overall** | Vote | Subsystem | Runtime | Logfile | Comment | |::|--:|:|::|:---:| | +0

[jira] [Commented] (HADOOP-18012) ABFS: Modify Rename idempotency code

2021-11-15 Thread Sneha Vijayarajan (Jira)
[ https://issues.apache.org/jira/browse/HADOOP-18012?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17444030#comment-17444030 ] Sneha Vijayarajan commented on HADOOP-18012: Need to fix test failures seen along with this

[jira] [Work logged] (HADOOP-18011) ABFS: Enable config control for default connection timeout

2021-11-15 Thread ASF GitHub Bot (Jira)
[ https://issues.apache.org/jira/browse/HADOOP-18011?focusedWorklogId=681659=com.atlassian.jira.plugin.system.issuetabpanels:worklog-tabpanel#worklog-681659 ] ASF GitHub Bot logged work on HADOOP-18011: --- Author: ASF GitHub Bot

[GitHub] [hadoop] snvijaya commented on pull request #3662: HADOOP-18011. ABFS: Configurable HTTP connection and read timeouts

2021-11-15 Thread GitBox
snvijaya commented on pull request #3662: URL: https://github.com/apache/hadoop/pull/3662#issuecomment-969201299 ::: AGGREGATED TEST RESULT HNS-OAuth [INFO] Results: [INFO] [WARNING] Tests run: 106, Failures: 0, Errors: 0, Skipped: 1

[jira] [Comment Edited] (HADOOP-17996) UserGroupInformation#unprotectedRelogin sets the last login time before logging in

2021-11-15 Thread Prabhu Joseph (Jira)
[ https://issues.apache.org/jira/browse/HADOOP-17996?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17444021#comment-17444021 ] Prabhu Joseph edited comment on HADOOP-17996 at 11/15/21, 6:18 PM: ---

[jira] [Commented] (HADOOP-17996) UserGroupInformation#unprotectedRelogin sets the last login time before logging in

2021-11-15 Thread Prabhu Joseph (Jira)
[ https://issues.apache.org/jira/browse/HADOOP-17996?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17444021#comment-17444021 ] Prabhu Joseph commented on HADOOP-17996: Thanks [~brahmareddy] for reviewing the patch.

[jira] [Comment Edited] (HADOOP-17996) UserGroupInformation#unprotectedRelogin sets the last login time before logging in

2021-11-15 Thread Prabhu Joseph (Jira)
[ https://issues.apache.org/jira/browse/HADOOP-17996?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17444021#comment-17444021 ] Prabhu Joseph edited comment on HADOOP-17996 at 11/15/21, 6:17 PM: ---

[jira] [Updated] (HADOOP-18011) ABFS: Enable config control for default connection timeout

2021-11-15 Thread ASF GitHub Bot (Jira)
[ https://issues.apache.org/jira/browse/HADOOP-18011?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] ASF GitHub Bot updated HADOOP-18011: Labels: pull-request-available (was: ) > ABFS: Enable config control for default

[jira] [Work logged] (HADOOP-18011) ABFS: Enable config control for default connection timeout

2021-11-15 Thread ASF GitHub Bot (Jira)
[ https://issues.apache.org/jira/browse/HADOOP-18011?focusedWorklogId=681648=com.atlassian.jira.plugin.system.issuetabpanels:worklog-tabpanel#worklog-681648 ] ASF GitHub Bot logged work on HADOOP-18011: --- Author: ASF GitHub Bot

[GitHub] [hadoop] snvijaya opened a new pull request #3662: HADOOP-18011. ABFS: Configurable HTTP connection and read timeouts

2021-11-15 Thread GitBox
snvijaya opened a new pull request #3662: URL: https://github.com/apache/hadoop/pull/3662 ABFS driver has a default connection timeout and read timeout value of 30 secs. For jobs that are time sensitive, preference would be quick failure and have shorter HTTP connection and read timeout.

[jira] [Created] (HADOOP-18012) ABFS: Modify Rename idempotency code

2021-11-15 Thread Sneha Vijayarajan (Jira)
Sneha Vijayarajan created HADOOP-18012: -- Summary: ABFS: Modify Rename idempotency code Key: HADOOP-18012 URL: https://issues.apache.org/jira/browse/HADOOP-18012 Project: Hadoop Common

[jira] [Work logged] (HADOOP-17409) Remove S3Guard - no longer needed

2021-11-15 Thread ASF GitHub Bot (Jira)
[ https://issues.apache.org/jira/browse/HADOOP-17409?focusedWorklogId=681625=com.atlassian.jira.plugin.system.issuetabpanels:worklog-tabpanel#worklog-681625 ] ASF GitHub Bot logged work on HADOOP-17409: --- Author: ASF GitHub Bot

[GitHub] [hadoop] steveloughran commented on pull request #3534: HADOOP-17409. Remove s3guard from S3A module

2021-11-15 Thread GitBox
steveloughran commented on pull request #3534: URL: https://github.com/apache/hadoop/pull/3534#issuecomment-969126236 testing s3 london, all good. removed ITestPartialRenamesDeletes test which was failing as the output of the processing of the multi object delete exception didn't

[jira] [Work logged] (HADOOP-17409) Remove S3Guard - no longer needed

2021-11-15 Thread ASF GitHub Bot (Jira)
[ https://issues.apache.org/jira/browse/HADOOP-17409?focusedWorklogId=681623=com.atlassian.jira.plugin.system.issuetabpanels:worklog-tabpanel#worklog-681623 ] ASF GitHub Bot logged work on HADOOP-17409: --- Author: ASF GitHub Bot

[GitHub] [hadoop] hadoop-yetus removed a comment on pull request #3534: HADOOP-17409. Remove s3guard from S3A module

2021-11-15 Thread GitBox
hadoop-yetus removed a comment on pull request #3534: URL: https://github.com/apache/hadoop/pull/3534#issuecomment-962095446 -- This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use the URL above to go to the specific comment.

[jira] [Updated] (HADOOP-18011) ABFS: Enable config control for default connection timeout

2021-11-15 Thread Sneha Vijayarajan (Jira)
[ https://issues.apache.org/jira/browse/HADOOP-18011?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Sneha Vijayarajan updated HADOOP-18011: --- Description: ABFS driver has a default connection timeout and read timeout value

[jira] [Work logged] (HADOOP-18003) Add a method appendIfAbsent for CallerContext

2021-11-15 Thread ASF GitHub Bot (Jira)
[ https://issues.apache.org/jira/browse/HADOOP-18003?focusedWorklogId=681583=com.atlassian.jira.plugin.system.issuetabpanels:worklog-tabpanel#worklog-681583 ] ASF GitHub Bot logged work on HADOOP-18003: --- Author: ASF GitHub Bot

[GitHub] [hadoop] tomscut commented on pull request #3644: HADOOP-18003. Add a method appendIfAbsent for CallerContext

2021-11-15 Thread GitBox
tomscut commented on pull request #3644: URL: https://github.com/apache/hadoop/pull/3644#issuecomment-969052288 > Merged. Thanks for your contribution, @tomscut! Thanks @tasanuma for the merge. -- This is an automated message from the Apache Git Service. To respond to the message,

[GitHub] [hadoop] szilard-nemeth closed pull request #3628: YARN-11001. Add docs on removing node-to-labels mapping

2021-11-15 Thread GitBox
szilard-nemeth closed pull request #3628: URL: https://github.com/apache/hadoop/pull/3628 -- This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use the URL above to go to the specific comment. To unsubscribe, e-mail:

[GitHub] [hadoop] szilard-nemeth commented on pull request #3628: YARN-11001. Add docs on removing node-to-labels mapping

2021-11-15 Thread GitBox
szilard-nemeth commented on pull request #3628: URL: https://github.com/apache/hadoop/pull/3628#issuecomment-968998397 Hi @manuzhang , Thanks for your contribution. Patch lookgs good to me, committed to trunk. -- This is an automated message from the Apache Git Service. To respond

[jira] [Resolved] (HADOOP-18010) some time delay (0.3s) for swebhdfs + kerberos + observer setting.

2021-11-15 Thread Chuan-Heng Hsiao (Jira)
[ https://issues.apache.org/jira/browse/HADOOP-18010?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Chuan-Heng Hsiao resolved HADOOP-18010. --- Resolution: Duplicate More suitable to be in HDFS issues. > some time delay

[jira] [Commented] (HADOOP-18010) some time delay (0.3s) for swebhdfs + kerberos + observer setting.

2021-11-15 Thread Chuan-Heng Hsiao (Jira)
[ https://issues.apache.org/jira/browse/HADOOP-18010?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17443846#comment-17443846 ] Chuan-Heng Hsiao commented on HADOOP-18010: --- Looks like that this issue is more suitable in

[jira] [Updated] (HADOOP-18006) maven-enforcer-plugin's execution of banned-illegal-imports gets overridden in child poms

2021-11-15 Thread Takanobu Asanuma (Jira)
[ https://issues.apache.org/jira/browse/HADOOP-18006?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Takanobu Asanuma updated HADOOP-18006: -- Fix Version/s: 3.4.0 Resolution: Fixed Status: Resolved (was:

[jira] [Work logged] (HADOOP-18006) maven-enforcer-plugin's execution of banned-illegal-imports gets overridden in child poms

2021-11-15 Thread ASF GitHub Bot (Jira)
[ https://issues.apache.org/jira/browse/HADOOP-18006?focusedWorklogId=681514=com.atlassian.jira.plugin.system.issuetabpanels:worklog-tabpanel#worklog-681514 ] ASF GitHub Bot logged work on HADOOP-18006: --- Author: ASF GitHub Bot

[jira] [Work logged] (HADOOP-18006) maven-enforcer-plugin's execution of banned-illegal-imports gets overridden in child poms

2021-11-15 Thread ASF GitHub Bot (Jira)
[ https://issues.apache.org/jira/browse/HADOOP-18006?focusedWorklogId=681513=com.atlassian.jira.plugin.system.issuetabpanels:worklog-tabpanel#worklog-681513 ] ASF GitHub Bot logged work on HADOOP-18006: --- Author: ASF GitHub Bot

[GitHub] [hadoop] tasanuma commented on pull request #3648: HADOOP-18006. maven-enforcer-plugin's execution of banned-illegal-imports gets overridden in child poms

2021-11-15 Thread GitBox
tasanuma commented on pull request #3648: URL: https://github.com/apache/hadoop/pull/3648#issuecomment-968935647 Merged it. Thanks for your contribution, @virajjasani. Thanks for your review, @amahussein. -- This is an automated message from the Apache Git Service. To respond to the

[GitHub] [hadoop] tasanuma merged pull request #3648: HADOOP-18006. maven-enforcer-plugin's execution of banned-illegal-imports gets overridden in child poms

2021-11-15 Thread GitBox
tasanuma merged pull request #3648: URL: https://github.com/apache/hadoop/pull/3648 -- This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use the URL above to go to the specific comment. To unsubscribe, e-mail:

[jira] [Resolved] (HADOOP-18003) Add a method appendIfAbsent for CallerContext

2021-11-15 Thread Takanobu Asanuma (Jira)
[ https://issues.apache.org/jira/browse/HADOOP-18003?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Takanobu Asanuma resolved HADOOP-18003. --- Fix Version/s: 3.4.0 Resolution: Fixed > Add a method appendIfAbsent for

[GitHub] [hadoop] hadoop-yetus commented on pull request #3659: HDFS-16323. DatanodeHttpServer doesn't require handler state map while retrieving filter handlers

2021-11-15 Thread GitBox
hadoop-yetus commented on pull request #3659: URL: https://github.com/apache/hadoop/pull/3659#issuecomment-968926593 :broken_heart: **-1 overall** | Vote | Subsystem | Runtime | Logfile | Comment | |::|--:|:|::|:---:| | +0

[jira] [Work logged] (HADOOP-18003) Add a method appendIfAbsent for CallerContext

2021-11-15 Thread ASF GitHub Bot (Jira)
[ https://issues.apache.org/jira/browse/HADOOP-18003?focusedWorklogId=681499=com.atlassian.jira.plugin.system.issuetabpanels:worklog-tabpanel#worklog-681499 ] ASF GitHub Bot logged work on HADOOP-18003: --- Author: ASF GitHub Bot

[jira] [Work logged] (HADOOP-18003) Add a method appendIfAbsent for CallerContext

2021-11-15 Thread ASF GitHub Bot (Jira)
[ https://issues.apache.org/jira/browse/HADOOP-18003?focusedWorklogId=681500=com.atlassian.jira.plugin.system.issuetabpanels:worklog-tabpanel#worklog-681500 ] ASF GitHub Bot logged work on HADOOP-18003: --- Author: ASF GitHub Bot

[GitHub] [hadoop] tasanuma commented on pull request #3644: HADOOP-18003. Add a method appendIfAbsent for CallerContext

2021-11-15 Thread GitBox
tasanuma commented on pull request #3644: URL: https://github.com/apache/hadoop/pull/3644#issuecomment-968924601 Merged. Thanks for your contribution, @tomscut! -- This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use the URL

[GitHub] [hadoop] tasanuma merged pull request #3644: HADOOP-18003. Add a method appendIfAbsent for CallerContext

2021-11-15 Thread GitBox
tasanuma merged pull request #3644: URL: https://github.com/apache/hadoop/pull/3644 -- This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use the URL above to go to the specific comment. To unsubscribe, e-mail:

[GitHub] [hadoop] GuoPhilipse opened a new pull request #3661: HDFS-16324. fix error log in BlockManagerSafeMode

2021-11-15 Thread GitBox
GuoPhilipse opened a new pull request #3661: URL: https://github.com/apache/hadoop/pull/3661 ### Description of PR if `recheckInterval` was set as invalid value, there will be warning log output, but the message seems not that proper ,we can improve it. ### How was this patch

[jira] [Commented] (HADOOP-17996) UserGroupInformation#unprotectedRelogin sets the last login time before logging in

2021-11-15 Thread Brahma Reddy Battula (Jira)
[ https://issues.apache.org/jira/browse/HADOOP-17996?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17443809#comment-17443809 ] Brahma Reddy Battula commented on HADOOP-17996: --- [~prabhujoseph]  and [~Sushma_28] 

[jira] [Work logged] (HADOOP-17975) Fallback to simple auth does not work for a secondary DistributedFileSystem instance

2021-11-15 Thread ASF GitHub Bot (Jira)
[ https://issues.apache.org/jira/browse/HADOOP-17975?focusedWorklogId=681447=com.atlassian.jira.plugin.system.issuetabpanels:worklog-tabpanel#worklog-681447 ] ASF GitHub Bot logged work on HADOOP-17975: --- Author: ASF GitHub Bot

[GitHub] [hadoop] fapifta commented on a change in pull request #3658: HADOOP-17975 Fallback to simple auth does not work for a secondary DistributedFileSystem instance

2021-11-15 Thread GitBox
fapifta commented on a change in pull request #3658: URL: https://github.com/apache/hadoop/pull/3658#discussion_r749290889 ## File path: hadoop-common-project/hadoop-common/src/main/java/org/apache/hadoop/ipc/Client.java ## @@ -1679,11 +1679,13 @@ private Connection

[jira] [Updated] (HADOOP-18011) ABFS: Enable config control for default connection timeout

2021-11-15 Thread Sneha Vijayarajan (Jira)
[ https://issues.apache.org/jira/browse/HADOOP-18011?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Sneha Vijayarajan updated HADOOP-18011: --- Description: ABFS driver has a default connection timeout value of 30 secs. For

[jira] [Work logged] (HADOOP-18002) abfs rename idempotency broken -remove recovery

2021-11-15 Thread ASF GitHub Bot (Jira)
[ https://issues.apache.org/jira/browse/HADOOP-18002?focusedWorklogId=681441=com.atlassian.jira.plugin.system.issuetabpanels:worklog-tabpanel#worklog-681441 ] ASF GitHub Bot logged work on HADOOP-18002: --- Author: ASF GitHub Bot

[GitHub] [hadoop] steveloughran commented on pull request #3641: HADOOP-18002. abfs rename idempotency broken -remove recovery

2021-11-15 Thread GitBox
steveloughran commented on pull request #3641: URL: https://github.com/apache/hadoop/pull/3641#issuecomment-968849106 @mukund-thakur way too many changes since the original change went in -and that did rename and delete -- This is an automated message from the Apache Git Service. To

[jira] [Work logged] (HADOOP-18002) abfs rename idempotency broken -remove recovery

2021-11-15 Thread ASF GitHub Bot (Jira)
[ https://issues.apache.org/jira/browse/HADOOP-18002?focusedWorklogId=681436=com.atlassian.jira.plugin.system.issuetabpanels:worklog-tabpanel#worklog-681436 ] ASF GitHub Bot logged work on HADOOP-18002: --- Author: ASF GitHub Bot

[GitHub] [hadoop] steveloughran commented on pull request #3641: HADOOP-18002. abfs rename idempotency broken -remove recovery

2021-11-15 Thread GitBox
steveloughran commented on pull request #3641: URL: https://github.com/apache/hadoop/pull/3641#issuecomment-968841090 good idea..let me see. delete idempotency is easier...if the file isn't there, delete worked -- This is an automated message from the Apache Git Service. To respond to

[GitHub] [hadoop] ferhui commented on pull request #3638: HDFS-16313. Add metrics for each subcluster

2021-11-15 Thread GitBox
ferhui commented on pull request #3638: URL: https://github.com/apache/hadoop/pull/3638#issuecomment-968774697 @goiri Do you have any other comments? -- This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use the URL above to

[GitHub] [hadoop] ferhui commented on pull request #3654: HDFS-16320. Datanode retrieve slownode information from NameNode

2021-11-15 Thread GitBox
ferhui commented on pull request #3654: URL: https://github.com/apache/hadoop/pull/3654#issuecomment-968767997 @aajisaka @Hexiaoqiao @jojochuang Would you give any advices? -- This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and

[GitHub] [hadoop] ferhui commented on pull request #3654: HDFS-16320. Datanode retrieve slownode information from NameNode

2021-11-15 Thread GitBox
ferhui commented on pull request #3654: URL: https://github.com/apache/hadoop/pull/3654#issuecomment-968766994 @symious Thanks. Right now only namenode knows that which datanode is slow, and it will avoid to choose this node for the following requirement. But we have no ways to handle

[GitHub] [hadoop] TiborKovacsCloudera opened a new pull request #3660: YARN-10982

2021-11-15 Thread GitBox
TiborKovacsCloudera opened a new pull request #3660: URL: https://github.com/apache/hadoop/pull/3660 Use QueuePath class where it's reasonable. -- This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use the URL above to go to

[GitHub] [hadoop] haiyang1987 commented on pull request #3651: HDFS-16314. Support to make dfs.namenode.block-placement-policy.exclude-slow-nodes.enabled reconfigurable

2021-11-15 Thread GitBox
haiyang1987 commented on pull request #3651: URL: https://github.com/apache/hadoop/pull/3651#issuecomment-968674241 @ferhui @tomscut I submitted some code. Can you help review. thank you very much. -- This is an automated message from the Apache Git Service. To respond to the

[jira] [Commented] (HADOOP-17996) UserGroupInformation#unprotectedRelogin sets the last login time before logging in

2021-11-15 Thread Prabhu Joseph (Jira)
[ https://issues.apache.org/jira/browse/HADOOP-17996?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17443619#comment-17443619 ] Prabhu Joseph commented on HADOOP-17996: Thanks [~Sushma_28] for the patch. The patch looks