[GitHub] [hadoop] symious commented on pull request #3654: HDFS-16320. Datanode retrieve slownode information from NameNode

2021-11-18 Thread GitBox
symious commented on pull request #3654: URL: https://github.com/apache/hadoop/pull/3654#issuecomment-973827350 @ferhui Sure. Updated the patch. Please have a check. -- This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use

[GitHub] [hadoop] ferhui commented on pull request #3654: HDFS-16320. Datanode retrieve slownode information from NameNode

2021-11-18 Thread GitBox
ferhui commented on pull request #3654: URL: https://github.com/apache/hadoop/pull/3654#issuecomment-973821950 @symious You can fix the checkstyle issues. If no objection, you can continue to do the next work mentioned in your document. -- This is an automated message from the Apache

[jira] [Updated] (HADOOP-18016) Make certain methods LimitedPrivate in S3AUtils.java to provide proxy support

2021-11-18 Thread Mehakmeet Singh (Jira)
[ https://issues.apache.org/jira/browse/HADOOP-18016?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Mehakmeet Singh updated HADOOP-18016: - Summary: Make certain methods LimitedPrivate in S3AUtils.java to provide proxy support

[jira] [Updated] (HADOOP-18016) Make certain methods LimitedPrivate in S3AUtils.java to provide proxy support

2021-11-18 Thread Mehakmeet Singh (Jira)
[ https://issues.apache.org/jira/browse/HADOOP-18016?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Mehakmeet Singh updated HADOOP-18016: - Description: S3AUtils(Private) have certain methods which can be used in external

[GitHub] [hadoop] hadoop-yetus commented on pull request #3679: HDFS-16333. fix balancer bug when transfer an EC block

2021-11-18 Thread GitBox
hadoop-yetus commented on pull request #3679: URL: https://github.com/apache/hadoop/pull/3679#issuecomment-973809782 :broken_heart: **-1 overall** | Vote | Subsystem | Runtime | Logfile | Comment | |::|--:|:|::|:---:| | +0

[jira] [Created] (HADOOP-18016) Make certain methods PrivateLimited in S3AUtils.java to provide proxy support

2021-11-18 Thread Mehakmeet Singh (Jira)
Mehakmeet Singh created HADOOP-18016: Summary: Make certain methods PrivateLimited in S3AUtils.java to provide proxy support Key: HADOOP-18016 URL: https://issues.apache.org/jira/browse/HADOOP-18016

[jira] [Created] (HADOOP-18015) Public Interface to use S3AUtils.java methods in external projects

2021-11-18 Thread Mehakmeet Singh (Jira)
Mehakmeet Singh created HADOOP-18015: Summary: Public Interface to use S3AUtils.java methods in external projects Key: HADOOP-18015 URL: https://issues.apache.org/jira/browse/HADOOP-18015

[jira] [Work logged] (HADOOP-17975) Fallback to simple auth does not work for a secondary DistributedFileSystem instance

2021-11-18 Thread ASF GitHub Bot (Jira)
[ https://issues.apache.org/jira/browse/HADOOP-17975?focusedWorklogId=683793=com.atlassian.jira.plugin.system.issuetabpanels:worklog-tabpanel#worklog-683793 ] ASF GitHub Bot logged work on HADOOP-17975: --- Author: ASF GitHub Bot

[GitHub] [hadoop] symious commented on a change in pull request #3658: HADOOP-17975 Fallback to simple auth does not work for a secondary DistributedFileSystem instance

2021-11-18 Thread GitBox
symious commented on a change in pull request #3658: URL: https://github.com/apache/hadoop/pull/3658#discussion_r752898939 ## File path: hadoop-common-project/hadoop-common/src/main/java/org/apache/hadoop/ipc/Client.java ## @@ -1679,11 +1679,13 @@ private Connection

[jira] [Commented] (HADOOP-15685) Build fails (hadoop pipes) on newer Linux envs (like Fedora 28)

2021-11-18 Thread Masatake Iwasaki (Jira)
[ https://issues.apache.org/jira/browse/HADOOP-15685?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17446304#comment-17446304 ] Masatake Iwasaki commented on HADOOP-15685: --- [~brahmareddy] HADOOP-16739 should cover RHEL 8

[GitHub] [hadoop] hadoop-yetus commented on pull request #3440: ABFS: Support for Encryption Context

2021-11-18 Thread GitBox
hadoop-yetus commented on pull request #3440: URL: https://github.com/apache/hadoop/pull/3440#issuecomment-973784985 :broken_heart: **-1 overall** | Vote | Subsystem | Runtime | Logfile | Comment | |::|--:|:|::|:---:| | +0

[jira] [Work logged] (HADOOP-18014) CallerContext should not include some characters

2021-11-18 Thread ASF GitHub Bot (Jira)
[ https://issues.apache.org/jira/browse/HADOOP-18014?focusedWorklogId=683778=com.atlassian.jira.plugin.system.issuetabpanels:worklog-tabpanel#worklog-683778 ] ASF GitHub Bot logged work on HADOOP-18014: --- Author: ASF GitHub Bot

[jira] [Work started] (HADOOP-18014) CallerContext should not include some characters

2021-11-18 Thread Takanobu Asanuma (Jira)
[ https://issues.apache.org/jira/browse/HADOOP-18014?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Work on HADOOP-18014 started by Takanobu Asanuma. - > CallerContext should not include some characters >

[GitHub] [hadoop] tasanuma commented on pull request #3683: HADOOP-18014. CallerContext should not include some characters.

2021-11-18 Thread GitBox
tasanuma commented on pull request #3683: URL: https://github.com/apache/hadoop/pull/3683#issuecomment-973773396 @ferhui @liuml07 Could you review this PR? -- This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use the URL

[jira] [Updated] (HADOOP-18014) CallerContext should not include some characters

2021-11-18 Thread ASF GitHub Bot (Jira)
[ https://issues.apache.org/jira/browse/HADOOP-18014?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] ASF GitHub Bot updated HADOOP-18014: Labels: pull-request-available (was: ) > CallerContext should not include some

[jira] [Work logged] (HADOOP-18014) CallerContext should not include some characters

2021-11-18 Thread ASF GitHub Bot (Jira)
[ https://issues.apache.org/jira/browse/HADOOP-18014?focusedWorklogId=683776=com.atlassian.jira.plugin.system.issuetabpanels:worklog-tabpanel#worklog-683776 ] ASF GitHub Bot logged work on HADOOP-18014: --- Author: ASF GitHub Bot

[GitHub] [hadoop] tasanuma opened a new pull request #3683: HADOOP-18014. CallerContext should not include some characters.

2021-11-18 Thread GitBox
tasanuma opened a new pull request #3683: URL: https://github.com/apache/hadoop/pull/3683 ### Description of PR CallerContext should not include '\t', '\n', '=' because it could be written to audit log. ### How was this patch tested? I created a unit test and confirmed

[jira] [Created] (HADOOP-18014) CallerContext should not include some characters

2021-11-18 Thread Takanobu Asanuma (Jira)
Takanobu Asanuma created HADOOP-18014: - Summary: CallerContext should not include some characters Key: HADOOP-18014 URL: https://issues.apache.org/jira/browse/HADOOP-18014 Project: Hadoop Common

[jira] [Commented] (HADOOP-15518) Authentication filter calling handler after request already authenticated

2021-11-18 Thread Prabhu Joseph (Jira)
[ https://issues.apache.org/jira/browse/HADOOP-15518?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17446290#comment-17446290 ] Prabhu Joseph commented on HADOOP-15518: Have found Spark Running jobs - Executors Page is

[jira] [Commented] (HADOOP-15685) Build fails (hadoop pipes) on newer Linux envs (like Fedora 28)

2021-11-18 Thread Hadoop QA (Jira)
[ https://issues.apache.org/jira/browse/HADOOP-15685?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17446268#comment-17446268 ] Hadoop QA commented on HADOOP-15685: | (x) *{color:red}-1 overall{color}* | \\ \\ || Vote ||

[jira] [Commented] (HADOOP-15685) Build fails (hadoop pipes) on newer Linux envs (like Fedora 28)

2021-11-18 Thread Brahma Reddy Battula (Jira)
[ https://issues.apache.org/jira/browse/HADOOP-15685?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17446267#comment-17446267 ] Brahma Reddy Battula commented on HADOOP-15685: --- [~iwasakims]  did you get chance run on

[jira] [Work logged] (HADOOP-17998) Enable get command run with multi-thread

2021-11-18 Thread ASF GitHub Bot (Jira)
[ https://issues.apache.org/jira/browse/HADOOP-17998?focusedWorklogId=683754=com.atlassian.jira.plugin.system.issuetabpanels:worklog-tabpanel#worklog-683754 ] ASF GitHub Bot logged work on HADOOP-17998: --- Author: ASF GitHub Bot

[GitHub] [hadoop] smarthanwang commented on a change in pull request #3645: HADOOP-17998. Enable get command run with multi-thread.

2021-11-18 Thread GitBox
smarthanwang commented on a change in pull request #3645: URL: https://github.com/apache/hadoop/pull/3645#discussion_r752825112 ## File path: hadoop-common-project/hadoop-common/src/main/java/org/apache/hadoop/fs/shell/CopyCommandWithMultiThread.java ## @@ -0,0 +1,157 @@ +/**

[jira] [Work logged] (HADOOP-17998) Enable get command run with multi-thread

2021-11-18 Thread ASF GitHub Bot (Jira)
[ https://issues.apache.org/jira/browse/HADOOP-17998?focusedWorklogId=683753=com.atlassian.jira.plugin.system.issuetabpanels:worklog-tabpanel#worklog-683753 ] ASF GitHub Bot logged work on HADOOP-17998: --- Author: ASF GitHub Bot

[GitHub] [hadoop] smarthanwang commented on a change in pull request #3645: HADOOP-17998. Enable get command run with multi-thread.

2021-11-18 Thread GitBox
smarthanwang commented on a change in pull request #3645: URL: https://github.com/apache/hadoop/pull/3645#discussion_r752825112 ## File path: hadoop-common-project/hadoop-common/src/main/java/org/apache/hadoop/fs/shell/CopyCommandWithMultiThread.java ## @@ -0,0 +1,157 @@ +/**

[GitHub] [hadoop] tasanuma commented on pull request #3663: HDFS-16326. Simplify the code for DiskBalancer

2021-11-18 Thread GitBox
tasanuma commented on pull request #3663: URL: https://github.com/apache/hadoop/pull/3663#issuecomment-973673989 Thanks for your contribution, @tomscut. Thanks for your review, @virajjasani. -- This is an automated message from the Apache Git Service. To respond to the message, please

[GitHub] [hadoop] tasanuma merged pull request #3663: HDFS-16326. Simplify the code for DiskBalancer

2021-11-18 Thread GitBox
tasanuma merged pull request #3663: URL: https://github.com/apache/hadoop/pull/3663 -- This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use the URL above to go to the specific comment. To unsubscribe, e-mail:

[GitHub] [hadoop] tomscut commented on pull request #3681: HDFS-16335. Fix HDFSCommands.md

2021-11-18 Thread GitBox
tomscut commented on pull request #3681: URL: https://github.com/apache/hadoop/pull/3681#issuecomment-973665925 @aajisaka @tasanuma Please take a look at this. Thanks a lot. -- This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub

[GitHub] [hadoop] tomscut commented on pull request #3663: HDFS-16326. Simplify the code for DiskBalancer

2021-11-18 Thread GitBox
tomscut commented on pull request #3663: URL: https://github.com/apache/hadoop/pull/3663#issuecomment-973665327 Hi @aajisaka @tasanuma , please take a look at this. Thank you very much. -- This is an automated message from the Apache Git Service. To respond to the message, please log on

[GitHub] [hadoop] GuoPhilipse commented on pull request #3669: HDFS-16328. Correct disk balancer desc

2021-11-18 Thread GitBox
GuoPhilipse commented on pull request #3669: URL: https://github.com/apache/hadoop/pull/3669#issuecomment-973657277 @aajisaka Thanks for your review and merging :) -- This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use the

[GitHub] [hadoop] GuoPhilipse commented on pull request #3680: YARN-11007.improve doc quality

2021-11-18 Thread GitBox
GuoPhilipse commented on pull request #3680: URL: https://github.com/apache/hadoop/pull/3680#issuecomment-973650601 @szilard-nemeth need i add something else? -- This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use the URL

[GitHub] [hadoop] tomscut opened a new pull request #3682: HDFS-16337. Show start time of Datanode on Web

2021-11-18 Thread GitBox
tomscut opened a new pull request #3682: URL: https://github.com/apache/hadoop/pull/3682 JIRA: [HDFS-16337](https://issues.apache.org/jira/browse/HDFS-16337). Show start time of Datanode on Web.

[GitHub] [hadoop] tomscut commented on pull request #3670: HDFS-16329. Fix log format for BlockManager

2021-11-18 Thread GitBox
tomscut commented on pull request #3670: URL: https://github.com/apache/hadoop/pull/3670#issuecomment-973604279 Thanks @aajisaka for the merge. -- This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use the URL above to go to

[jira] [Work logged] (HADOOP-17124) Support LZO using aircompressor

2021-11-18 Thread ASF GitHub Bot (Jira)
[ https://issues.apache.org/jira/browse/HADOOP-17124?focusedWorklogId=683688=com.atlassian.jira.plugin.system.issuetabpanels:worklog-tabpanel#worklog-683688 ] ASF GitHub Bot logged work on HADOOP-17124: --- Author: ASF GitHub Bot

[GitHub] [hadoop] viirya commented on pull request #3612: WIP. HADOOP-17124. Support LZO Codec using aircompressor

2021-11-18 Thread GitBox
viirya commented on pull request #3612: URL: https://github.com/apache/hadoop/pull/3612#issuecomment-973344043 Thanks @sunchao ! I think the mostly famous usage of `aircompressor` is [trino](https://trino.io/). Trino uses the library for its Lz4Codec, LzoCodec, SnappyCodec, etc.

[jira] [Work logged] (HADOOP-17979) Interface EtagSource to allow FileStatus subclasses to provide etags

2021-11-18 Thread ASF GitHub Bot (Jira)
[ https://issues.apache.org/jira/browse/HADOOP-17979?focusedWorklogId=683667=com.atlassian.jira.plugin.system.issuetabpanels:worklog-tabpanel#worklog-683667 ] ASF GitHub Bot logged work on HADOOP-17979: --- Author: ASF GitHub Bot

[GitHub] [hadoop] hadoop-yetus commented on pull request #3633: HADOOP-17979. Add Interface EtagSource to allow FileStatus subclasses to provide etags

2021-11-18 Thread GitBox
hadoop-yetus commented on pull request #3633: URL: https://github.com/apache/hadoop/pull/3633#issuecomment-973321373 :broken_heart: **-1 overall** | Vote | Subsystem | Runtime | Logfile | Comment | |::|--:|:|::|:---:| | +0

[GitHub] [hadoop] hadoop-yetus commented on pull request #3680: YARN-11007.improve doc quality

2021-11-18 Thread GitBox
hadoop-yetus commented on pull request #3680: URL: https://github.com/apache/hadoop/pull/3680#issuecomment-973234244 :broken_heart: **-1 overall** | Vote | Subsystem | Runtime | Logfile | Comment | |::|--:|:|::|:---:| | +0

[GitHub] [hadoop] hadoop-yetus commented on pull request #3680: YARN-11007.improve doc quality

2021-11-18 Thread GitBox
hadoop-yetus commented on pull request #3680: URL: https://github.com/apache/hadoop/pull/3680#issuecomment-973186875 :broken_heart: **-1 overall** | Vote | Subsystem | Runtime | Logfile | Comment | |::|--:|:|::|:---:| | +0

[jira] [Work logged] (HADOOP-17981) Support etag-assisted renames in FileOutputCommitter

2021-11-18 Thread ASF GitHub Bot (Jira)
[ https://issues.apache.org/jira/browse/HADOOP-17981?focusedWorklogId=683559=com.atlassian.jira.plugin.system.issuetabpanels:worklog-tabpanel#worklog-683559 ] ASF GitHub Bot logged work on HADOOP-17981: --- Author: ASF GitHub Bot

[GitHub] [hadoop] steveloughran commented on pull request #3611: HADOOP-17981. resilient commit through etag validation

2021-11-18 Thread GitBox
steveloughran commented on pull request #3611: URL: https://github.com/apache/hadoop/pull/3611#issuecomment-973144586 note, setting "fs.azure.rename.raises.exceptions" to "true" highlights that the default trash policy can't handle exceptions raised there -- This is an automated

[GitHub] [hadoop] hadoop-yetus commented on pull request #3470: YARN-10965. Centralize queue resource calculation based on CapacityVectors

2021-11-18 Thread GitBox
hadoop-yetus commented on pull request #3470: URL: https://github.com/apache/hadoop/pull/3470#issuecomment-973121141 :broken_heart: **-1 overall** | Vote | Subsystem | Runtime | Logfile | Comment | |::|--:|:|::|:---:| | +0

[GitHub] [hadoop] hadoop-yetus commented on pull request #3677: HDFS-16332 Handle invalid token exception in sasl handshake

2021-11-18 Thread GitBox
hadoop-yetus commented on pull request #3677: URL: https://github.com/apache/hadoop/pull/3677#issuecomment-973090769 :confetti_ball: **+1 overall** | Vote | Subsystem | Runtime | Logfile | Comment | |::|--:|:|::|:---:| | +0

[GitHub] [hadoop] mariosmeim-db commented on a change in pull request #3440: ABFS: Support for Encryption Context

2021-11-18 Thread GitBox
mariosmeim-db commented on a change in pull request #3440: URL: https://github.com/apache/hadoop/pull/3440#discussion_r752461416 ## File path: hadoop-tools/hadoop-azure/src/main/java/org/apache/hadoop/fs/azurebfs/security/EncryptionAdapter.java ## @@ -0,0 +1,147 @@ +/** + *

[GitHub] [hadoop] mariosmeim-db commented on a change in pull request #3440: ABFS: Support for Encryption Context

2021-11-18 Thread GitBox
mariosmeim-db commented on a change in pull request #3440: URL: https://github.com/apache/hadoop/pull/3440#discussion_r752450837 ## File path: hadoop-tools/hadoop-azure/src/main/java/org/apache/hadoop/fs/azurebfs/security/EncryptionAdapter.java ## @@ -0,0 +1,147 @@ +/** + *

[GitHub] [hadoop] hadoop-yetus commented on pull request #3672: HDFS-16330. Fix incorrect placeholder for Exception logs in DiskBalancer

2021-11-18 Thread GitBox
hadoop-yetus commented on pull request #3672: URL: https://github.com/apache/hadoop/pull/3672#issuecomment-973062880 :broken_heart: **-1 overall** | Vote | Subsystem | Runtime | Logfile | Comment | |::|--:|:|::|:---:| | +0

[GitHub] [hadoop] hadoop-yetus commented on pull request #3676: HDFS-16331. Make dfs.blockreport.intervalMsec reconfigurable

2021-11-18 Thread GitBox
hadoop-yetus commented on pull request #3676: URL: https://github.com/apache/hadoop/pull/3676#issuecomment-973049276 :broken_heart: **-1 overall** | Vote | Subsystem | Runtime | Logfile | Comment | |::|--:|:|::|:---:| | +0

[GitHub] [hadoop] hadoop-yetus commented on pull request #3679: HDFS-16333. fix balancer bug when transfer an EC block

2021-11-18 Thread GitBox
hadoop-yetus commented on pull request #3679: URL: https://github.com/apache/hadoop/pull/3679#issuecomment-973036747 :broken_heart: **-1 overall** | Vote | Subsystem | Runtime | Logfile | Comment | |::|--:|:|::|:---:| | +0

[GitHub] [hadoop] hemanthboyina commented on pull request #3679: HDFS-16333. fix balancer bug when transfer an EC block

2021-11-18 Thread GitBox
hemanthboyina commented on pull request #3679: URL: https://github.com/apache/hadoop/pull/3679#issuecomment-973028808 @liubingxing can you extend an UT for your scenario -- This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and

[GitHub] [hadoop] aajisaka commented on pull request #3669: HDFS-16328. Correct disk balancer desc

2021-11-18 Thread GitBox
aajisaka commented on pull request #3669: URL: https://github.com/apache/hadoop/pull/3669#issuecomment-973004871 Merged. Thank you @GuoPhilipse -- This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use the URL above to go to

[GitHub] [hadoop] aajisaka merged pull request #3669: HDFS-16328. Correct disk balancer desc

2021-11-18 Thread GitBox
aajisaka merged pull request #3669: URL: https://github.com/apache/hadoop/pull/3669 -- This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use the URL above to go to the specific comment. To unsubscribe, e-mail:

[GitHub] [hadoop] aajisaka commented on pull request #3672: HDFS-16330. Fix incorrect placeholder for Exception logs in DiskBalancer

2021-11-18 Thread GitBox
aajisaka commented on pull request #3672: URL: https://github.com/apache/hadoop/pull/3672#issuecomment-972999165 Thank you @virajjasani for your contribution and thank you @tomscut for your review. -- This is an automated message from the Apache Git Service. To respond to the message,

[GitHub] [hadoop] aajisaka merged pull request #3672: HDFS-16330. Fix incorrect placeholder for Exception logs in DiskBalancer

2021-11-18 Thread GitBox
aajisaka merged pull request #3672: URL: https://github.com/apache/hadoop/pull/3672 -- This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use the URL above to go to the specific comment. To unsubscribe, e-mail:

[GitHub] [hadoop] aajisaka commented on pull request #3672: HDFS-16330. Fix incorrect placeholder for Exception logs in DiskBalancer

2021-11-18 Thread GitBox
aajisaka commented on pull request #3672: URL: https://github.com/apache/hadoop/pull/3672#issuecomment-972997244 The test failure is not related to the patch. Committing. -- This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and

[jira] [Commented] (HADOOP-17996) UserGroupInformation#unprotectedRelogin sets the last login time before logging in

2021-11-18 Thread Prabhu Joseph (Jira)
[ https://issues.apache.org/jira/browse/HADOOP-17996?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17446001#comment-17446001 ] Prabhu Joseph commented on HADOOP-17996: [~brahmareddy]  If you are fine, we will go and commit

[GitHub] [hadoop] aajisaka commented on pull request #3670: HDFS-16329. Fix log format for BlockManager

2021-11-18 Thread GitBox
aajisaka commented on pull request #3670: URL: https://github.com/apache/hadoop/pull/3670#issuecomment-972985329 Thank you @tomscut and @virajjasani ! -- This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use the URL above to

[GitHub] [hadoop] aajisaka merged pull request #3670: HDFS-16329. Fix log format for BlockManager

2021-11-18 Thread GitBox
aajisaka merged pull request #3670: URL: https://github.com/apache/hadoop/pull/3670 -- This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use the URL above to go to the specific comment. To unsubscribe, e-mail:

[jira] [Updated] (HADOOP-15808) Harden Token service loader use

2021-11-18 Thread Akira Ajisaka (Jira)
[ https://issues.apache.org/jira/browse/HADOOP-15808?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Akira Ajisaka updated HADOOP-15808: --- Fix Version/s: 3.3.0 > Harden Token service loader use > --- >

[GitHub] [hadoop] hadoop-yetus commented on pull request #3681: HDFS-16335. Fix HDFSCommands.md

2021-11-18 Thread GitBox
hadoop-yetus commented on pull request #3681: URL: https://github.com/apache/hadoop/pull/3681#issuecomment-972959787 :confetti_ball: **+1 overall** | Vote | Subsystem | Runtime | Logfile | Comment | |::|--:|:|::|:---:| | +0

[GitHub] [hadoop] KevinWikant edited a comment on pull request #3675: HDFS-16303. Improve handling of datanode lost while decommissioning

2021-11-18 Thread GitBox
KevinWikant edited a comment on pull request #3675: URL: https://github.com/apache/hadoop/pull/3675#issuecomment-972499317 Seems the unit tests failed on an unrelated error: ` [ERROR] Failures: [ERROR]

[GitHub] [hadoop] hadoop-yetus commented on pull request #3672: HDFS-16330. Fix incorrect placeholder for Exception logs in DiskBalancer

2021-11-18 Thread GitBox
hadoop-yetus commented on pull request #3672: URL: https://github.com/apache/hadoop/pull/3672#issuecomment-972951535 :broken_heart: **-1 overall** | Vote | Subsystem | Runtime | Logfile | Comment | |::|--:|:|::|:---:| | +0

[jira] [Work logged] (HADOOP-17409) Remove S3Guard - no longer needed

2021-11-18 Thread ASF GitHub Bot (Jira)
[ https://issues.apache.org/jira/browse/HADOOP-17409?focusedWorklogId=683354=com.atlassian.jira.plugin.system.issuetabpanels:worklog-tabpanel#worklog-683354 ] ASF GitHub Bot logged work on HADOOP-17409: --- Author: ASF GitHub Bot

[GitHub] [hadoop] mehakmeet commented on a change in pull request #3534: HADOOP-17409. Remove s3guard from S3A module

2021-11-18 Thread GitBox
mehakmeet commented on a change in pull request #3534: URL: https://github.com/apache/hadoop/pull/3534#discussion_r752291332 ## File path: hadoop-tools/hadoop-aws/src/main/java/org/apache/hadoop/fs/s3a/InconsistentAmazonS3Client.java ## @@ -60,12 +55,13 @@ import

[jira] [Work logged] (HADOOP-17979) Interface EtagSource to allow FileStatus subclasses to provide etags

2021-11-18 Thread ASF GitHub Bot (Jira)
[ https://issues.apache.org/jira/browse/HADOOP-17979?focusedWorklogId=683353=com.atlassian.jira.plugin.system.issuetabpanels:worklog-tabpanel#worklog-683353 ] ASF GitHub Bot logged work on HADOOP-17979: --- Author: ASF GitHub Bot

[GitHub] [hadoop] hadoop-yetus removed a comment on pull request #3633: HADOOP-17979. Add Interface EtagSource to allow FileStatus subclasses to provide etags

2021-11-18 Thread GitBox
hadoop-yetus removed a comment on pull request #3633: URL: https://github.com/apache/hadoop/pull/3633#issuecomment-966377314 :broken_heart: **-1 overall** | Vote | Subsystem | Runtime | Logfile | Comment | |::|--:|:|::|:---:|

[jira] [Created] (HADOOP-18013) ABFS: add resilient trash policy

2021-11-18 Thread Steve Loughran (Jira)
Steve Loughran created HADOOP-18013: --- Summary: ABFS: add resilient trash policy Key: HADOOP-18013 URL: https://issues.apache.org/jira/browse/HADOOP-18013 Project: Hadoop Common Issue Type:

[jira] [Updated] (HADOOP-17566) Über-jira: S3A Hadoop 3.3.2 features

2021-11-18 Thread Steve Loughran (Jira)
[ https://issues.apache.org/jira/browse/HADOOP-17566?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Steve Loughran updated HADOOP-17566: Summary: Über-jira: S3A Hadoop 3.3.2 features (was: Über-jira: S3A Hadoop 3.4 features)

[jira] [Updated] (HADOOP-17566) Über-jira: S3A Hadoop 3.3.2 features

2021-11-18 Thread Steve Loughran (Jira)
[ https://issues.apache.org/jira/browse/HADOOP-17566?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Steve Loughran updated HADOOP-17566: Target Version/s: 3.3.2 (was: 3.4.0) > Über-jira: S3A Hadoop 3.3.2 features >

[GitHub] [hadoop] hadoop-yetus commented on pull request #3677: HDFS-16332 Handle invalid token exception in sasl handshake

2021-11-18 Thread GitBox
hadoop-yetus commented on pull request #3677: URL: https://github.com/apache/hadoop/pull/3677#issuecomment-972892897 :broken_heart: **-1 overall** | Vote | Subsystem | Runtime | Logfile | Comment | |::|--:|:|::|:---:| | +0

[GitHub] [hadoop] tomscut opened a new pull request #3681: HDFS-16335. Fix HDFSCommands.md

2021-11-18 Thread GitBox
tomscut opened a new pull request #3681: URL: https://github.com/apache/hadoop/pull/3681 JIRA: [HDFS-16335](https://issues.apache.org/jira/browse/HDFS-16335). Fix HDFSCommands.md. -- This is an automated message from the Apache Git Service. To respond to the message, please log on

[GitHub] [hadoop] hadoop-yetus commented on pull request #3649: HDFS-16318. Add exception blockinfo

2021-11-18 Thread GitBox
hadoop-yetus commented on pull request #3649: URL: https://github.com/apache/hadoop/pull/3649#issuecomment-972875513 :broken_heart: **-1 overall** | Vote | Subsystem | Runtime | Logfile | Comment | |::|--:|:|::|:---:| | +0

[jira] [Work logged] (HADOOP-17998) Enable get command run with multi-thread

2021-11-18 Thread ASF GitHub Bot (Jira)
[ https://issues.apache.org/jira/browse/HADOOP-17998?focusedWorklogId=683288=com.atlassian.jira.plugin.system.issuetabpanels:worklog-tabpanel#worklog-683288 ] ASF GitHub Bot logged work on HADOOP-17998: --- Author: ASF GitHub Bot

[GitHub] [hadoop] sodonnel commented on pull request #3645: HADOOP-17998. Enable get command run with multi-thread.

2021-11-18 Thread GitBox
sodonnel commented on pull request #3645: URL: https://github.com/apache/hadoop/pull/3645#issuecomment-972850753 Thanks for working on this @smarthanwang. The change looks mostly good to me. I have just a few minor comments. There is also a failing test in `hadoop.cli.TestCLI`. I

[jira] [Work logged] (HADOOP-17998) Enable get command run with multi-thread

2021-11-18 Thread ASF GitHub Bot (Jira)
[ https://issues.apache.org/jira/browse/HADOOP-17998?focusedWorklogId=683284=com.atlassian.jira.plugin.system.issuetabpanels:worklog-tabpanel#worklog-683284 ] ASF GitHub Bot logged work on HADOOP-17998: --- Author: ASF GitHub Bot

[GitHub] [hadoop] sodonnel commented on a change in pull request #3645: HADOOP-17998. Enable get command run with multi-thread.

2021-11-18 Thread GitBox
sodonnel commented on a change in pull request #3645: URL: https://github.com/apache/hadoop/pull/3645#discussion_r752221314 ## File path: hadoop-common-project/hadoop-common/src/main/java/org/apache/hadoop/fs/shell/CopyCommandWithMultiThread.java ## @@ -0,0 +1,157 @@ +/** + *

[jira] [Work logged] (HADOOP-17998) Enable get command run with multi-thread

2021-11-18 Thread ASF GitHub Bot (Jira)
[ https://issues.apache.org/jira/browse/HADOOP-17998?focusedWorklogId=683281=com.atlassian.jira.plugin.system.issuetabpanels:worklog-tabpanel#worklog-683281 ] ASF GitHub Bot logged work on HADOOP-17998: --- Author: ASF GitHub Bot

[GitHub] [hadoop] sodonnel commented on a change in pull request #3645: HADOOP-17998. Enable get command run with multi-thread.

2021-11-18 Thread GitBox
sodonnel commented on a change in pull request #3645: URL: https://github.com/apache/hadoop/pull/3645#discussion_r752220174 ## File path: hadoop-common-project/hadoop-common/src/main/java/org/apache/hadoop/fs/shell/CopyCommandWithMultiThread.java ## @@ -0,0 +1,157 @@ +/** + *

[jira] [Work logged] (HADOOP-17998) Enable get command run with multi-thread

2021-11-18 Thread ASF GitHub Bot (Jira)
[ https://issues.apache.org/jira/browse/HADOOP-17998?focusedWorklogId=683274=com.atlassian.jira.plugin.system.issuetabpanels:worklog-tabpanel#worklog-683274 ] ASF GitHub Bot logged work on HADOOP-17998: --- Author: ASF GitHub Bot

[GitHub] [hadoop] sodonnel commented on a change in pull request #3645: HADOOP-17998. Enable get command run with multi-thread.

2021-11-18 Thread GitBox
sodonnel commented on a change in pull request #3645: URL: https://github.com/apache/hadoop/pull/3645#discussion_r752215572 ## File path: hadoop-common-project/hadoop-common/src/test/java/org/apache/hadoop/fs/shell/TestCopyToLocal.java ## @@ -0,0 +1,230 @@ +/** + * Licensed

[GitHub] [hadoop] hadoop-yetus commented on pull request #3470: YARN-10965. Centralize queue resource calculation based on CapacityVectors

2021-11-18 Thread GitBox
hadoop-yetus commented on pull request #3470: URL: https://github.com/apache/hadoop/pull/3470#issuecomment-972840961 :broken_heart: **-1 overall** | Vote | Subsystem | Runtime | Logfile | Comment | |::|--:|:|::|:---:| | +0

[jira] [Work logged] (HADOOP-17998) Enable get command run with multi-thread

2021-11-18 Thread ASF GitHub Bot (Jira)
[ https://issues.apache.org/jira/browse/HADOOP-17998?focusedWorklogId=683272=com.atlassian.jira.plugin.system.issuetabpanels:worklog-tabpanel#worklog-683272 ] ASF GitHub Bot logged work on HADOOP-17998: --- Author: ASF GitHub Bot

[GitHub] [hadoop] sodonnel commented on a change in pull request #3645: HADOOP-17998. Enable get command run with multi-thread.

2021-11-18 Thread GitBox
sodonnel commented on a change in pull request #3645: URL: https://github.com/apache/hadoop/pull/3645#discussion_r752213829 ## File path: hadoop-common-project/hadoop-common/src/test/java/org/apache/hadoop/fs/shell/TestCopyToLocal.java ## @@ -0,0 +1,230 @@ +/** + * Licensed

[GitHub] [hadoop] GuoPhilipse commented on pull request #3680: YARN-11007.improve doc quality

2021-11-18 Thread GitBox
GuoPhilipse commented on pull request #3680: URL: https://github.com/apache/hadoop/pull/3680#issuecomment-972836532 cc @szilard-nemeth -- This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use the URL above to go to the

[GitHub] [hadoop] GuoPhilipse commented on pull request #3657: YARN-11007.Improve doc

2021-11-18 Thread GitBox
GuoPhilipse commented on pull request #3657: URL: https://github.com/apache/hadoop/pull/3657#issuecomment-972835841 > Hi @GuoPhilipse , Did you close the PR on purpose? sorry, i deleted this branch by mistake, i have updated in another pr:

[GitHub] [hadoop] szilard-nemeth commented on pull request #3657: YARN-11007.Improve doc

2021-11-18 Thread GitBox
szilard-nemeth commented on pull request #3657: URL: https://github.com/apache/hadoop/pull/3657#issuecomment-972833409 Hi @GuoPhilipse , Did you close the PR on purpose? -- This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and

[GitHub] [hadoop] GuoPhilipse opened a new pull request #3680: YARN-11007.improve doc quality

2021-11-18 Thread GitBox
GuoPhilipse opened a new pull request #3680: URL: https://github.com/apache/hadoop/pull/3680 correct words to improve doc quality -- This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use the URL above to go to the specific

[GitHub] [hadoop] GuoPhilipse closed pull request #3657: YARN-11007.Improve doc

2021-11-18 Thread GitBox
GuoPhilipse closed pull request #3657: URL: https://github.com/apache/hadoop/pull/3657 -- This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use the URL above to go to the specific comment. To unsubscribe, e-mail:

[GitHub] [hadoop] tasanuma commented on pull request #3654: HDFS-16320. Datanode retrieve slownode information from NameNode

2021-11-18 Thread GitBox
tasanuma commented on pull request #3654: URL: https://github.com/apache/hadoop/pull/3654#issuecomment-972801673 @symious Thank you for your reply. That definitely should be fixed. And getting such information from the datanodes makes sense to me. -- This is an automated message from

[GitHub] [hadoop] haiyang1987 commented on pull request #3664: HDFS-16314. Support to make dfs.namenode.block-placement-policy.exclude-slow-nodes.enabled reconfigurable

2021-11-18 Thread GitBox
haiyang1987 commented on pull request #3664: URL: https://github.com/apache/hadoop/pull/3664#issuecomment-972789348 Hi @tomscut Is there anything else that needs to be improved in the current code? Thanks. -- This is an automated message from the Apache Git Service. To respond to the

[GitHub] [hadoop] hadoop-yetus commented on pull request #3677: HDFS-16332 Handle invalid token exception in sasl handshake

2021-11-18 Thread GitBox
hadoop-yetus commented on pull request #3677: URL: https://github.com/apache/hadoop/pull/3677#issuecomment-972787126 :broken_heart: **-1 overall** | Vote | Subsystem | Runtime | Logfile | Comment | |::|--:|:|::|:---:| | +0

[GitHub] [hadoop] hadoop-yetus commented on pull request #3678: HDFS-16334.Correct Namenode ACL desc

2021-11-18 Thread GitBox
hadoop-yetus commented on pull request #3678: URL: https://github.com/apache/hadoop/pull/3678#issuecomment-972781738 :confetti_ball: **+1 overall** | Vote | Subsystem | Runtime | Logfile | Comment | |::|--:|:|::|:---:| | +0

[GitHub] [hadoop] symious commented on pull request #3654: HDFS-16320. Datanode retrieve slownode information from NameNode

2021-11-18 Thread GitBox
symious commented on pull request #3654: URL: https://github.com/apache/hadoop/pull/3654#issuecomment-972776741 @tasanuma Thanks for the review. >I want to clarify about "the clients already using the slownode". Does it mean the case that the DataNode is not a slownode when the

[GitHub] [hadoop] hadoop-yetus commented on pull request #3677: HDFS-16332 Handle invalid token exception in sasl handshake

2021-11-18 Thread GitBox
hadoop-yetus commented on pull request #3677: URL: https://github.com/apache/hadoop/pull/3677#issuecomment-972744683 :broken_heart: **-1 overall** | Vote | Subsystem | Runtime | Logfile | Comment | |::|--:|:|::|:---:| | +0

[GitHub] [hadoop] hadoop-yetus commented on pull request #3679: HDFS-16333. fix balancer bug when transfer an EC block

2021-11-18 Thread GitBox
hadoop-yetus commented on pull request #3679: URL: https://github.com/apache/hadoop/pull/3679#issuecomment-972735018 :broken_heart: **-1 overall** | Vote | Subsystem | Runtime | Logfile | Comment | |::|--:|:|::|:---:| | +0

[GitHub] [hadoop] liubingxing opened a new pull request #3679: HDFS-16333. fix balancer bug when transfer an EC block

2021-11-18 Thread GitBox
liubingxing opened a new pull request #3679: URL: https://github.com/apache/hadoop/pull/3679 JIRA: [HDFS-16333](https://issues.apache.org/jira/browse/HDFS-16333) -- This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use the

[GitHub] [hadoop] tasanuma commented on pull request #3654: HDFS-16320. Datanode retrieve slownode information from NameNode

2021-11-18 Thread GitBox
tasanuma commented on pull request #3654: URL: https://github.com/apache/hadoop/pull/3654#issuecomment-972729867 @symious Thanks for submitting the PR and sharing your document. I think it's a good solution too. > The configuration for this solution is

[GitHub] [hadoop] GuoPhilipse opened a new pull request #3678: HDFS-16334.Correct Namenode ACL desc

2021-11-18 Thread GitBox
GuoPhilipse opened a new pull request #3678: URL: https://github.com/apache/hadoop/pull/3678 `dfs.namenode.acls.enabled` is set to be `true` after HDFS-13505 ,we can improve the desc -- This is an automated message from the Apache Git Service. To respond to the message, please log on to

[jira] [Work logged] (HADOOP-17975) Fallback to simple auth does not work for a secondary DistributedFileSystem instance

2021-11-18 Thread ASF GitHub Bot (Jira)
[ https://issues.apache.org/jira/browse/HADOOP-17975?focusedWorklogId=683159=com.atlassian.jira.plugin.system.issuetabpanels:worklog-tabpanel#worklog-683159 ] ASF GitHub Bot logged work on HADOOP-17975: --- Author: ASF GitHub Bot

[GitHub] [hadoop] fapifta commented on a change in pull request #3658: HADOOP-17975 Fallback to simple auth does not work for a secondary DistributedFileSystem instance

2021-11-18 Thread GitBox
fapifta commented on a change in pull request #3658: URL: https://github.com/apache/hadoop/pull/3658#discussion_r752011835 ## File path: hadoop-common-project/hadoop-common/src/main/java/org/apache/hadoop/ipc/Client.java ## @@ -1679,11 +1679,13 @@ private Connection