[GitHub] [hadoop] hadoop-yetus commented on pull request #3141: HDFS-16087. Fix stuck issue in rbfbalance tool.

hadoop-yetus commented on pull request #3141: URL: https://github.com/apache/hadoop/pull/3141#issuecomment-876143175 :confetti_ball: **+1 overall** | Vote | Subsystem | Runtime | Logfile | Comment | |::|--:|:|::|:---:| | +0

[GitHub] [hadoop] jianghuazhu commented on pull request #3186: HDFS-16118.Improve the number of handlers that initialize NameNodeRpcServer#clientRpcServer.

jianghuazhu commented on pull request #3186: URL: https://github.com/apache/hadoop/pull/3186#issuecomment-876061665 Some unit tests failed and have nothing to do with this function. -- This is an automated message from the Apache Git Service. To respond to the message, please log on to

[GitHub] [hadoop] lipppppp commented on a change in pull request #3141: HDFS-16087. Fix stuck issue in rbfbalance tool.

lipp commented on a change in pull request #3141: URL: https://github.com/apache/hadoop/pull/3141#discussion_r665811829 ## File path: hadoop-hdfs-project/hadoop-hdfs-rbf/src/test/java/org/apache/hadoop/hdfs/rbfbalance/TestRouterDistCpProcedure.java ## @@ -0,0 +1,120 @@

[GitHub] [hadoop] lipppppp commented on pull request #3141: HDFS-16087. Fix stuck issue in rbfbalance tool.

lipp commented on pull request #3141: URL: https://github.com/apache/hadoop/pull/3141#issuecomment-876049463 Thanks @wojiaodoubao for your review and suggestions. I will fix them soon. -- This is an automated message from the Apache Git Service. To respond to the message, please log

[GitHub] [hadoop] tomscut commented on pull request #3140: HDFS-16088. Standby NameNode process getLiveDatanodeStorageReport req…

tomscut commented on pull request #3140: URL: https://github.com/apache/hadoop/pull/3140#issuecomment-876047593 Hi @tasanuma @jojochuang @aajisaka @ayushtkn , could you please review the code? Thanks a lot. -- This is an automated message from the Apache Git Service. To respond to the

[GitHub] [hadoop] hadoop-yetus commented on pull request #2971: MAPREDUCE-7341. Intermediate Manifest Committer

hadoop-yetus commented on pull request #2971: URL: https://github.com/apache/hadoop/pull/2971#issuecomment-875959943 :broken_heart: **-1 overall** | Vote | Subsystem | Runtime | Logfile | Comment | |::|--:|:|::|:---:| | +0

[jira] [Work logged] (HADOOP-17402) Add GCS FS impl reference to core-default.xml

[ https://issues.apache.org/jira/browse/HADOOP-17402?focusedWorklogId=620237=com.atlassian.jira.plugin.system.issuetabpanels:worklog-tabpanel#worklog-620237 ] ASF GitHub Bot logged work on HADOOP-17402: --- Author: ASF GitHub Bot

[GitHub] [hadoop] steveloughran commented on pull request #3180: HADOOP-17402. Add GCS config to the core-site (#2638)

steveloughran commented on pull request #3180: URL: https://github.com/apache/hadoop/pull/3180#issuecomment-875956180 thanks, all merged in, JIRA closed, you get the credit there too. Now, as you are looking at GCS, fancy looking at #2971 which is going to be a high performance yet

[jira] [Assigned] (HADOOP-17402) Add GCS FS impl reference to core-default.xml

[ https://issues.apache.org/jira/browse/HADOOP-17402?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Steve Loughran reassigned HADOOP-17402: --- Assignee: Rafal Wojdyla > Add GCS FS impl reference to core-default.xml >

[jira] [Work logged] (HADOOP-17402) Add GCS FS impl reference to core-default.xml

[ https://issues.apache.org/jira/browse/HADOOP-17402?focusedWorklogId=620236=com.atlassian.jira.plugin.system.issuetabpanels:worklog-tabpanel#worklog-620236 ] ASF GitHub Bot logged work on HADOOP-17402: --- Author: ASF GitHub Bot

[jira] [Resolved] (HADOOP-17402) Add GCS FS impl reference to core-default.xml

[ https://issues.apache.org/jira/browse/HADOOP-17402?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Steve Loughran resolved HADOOP-17402. - Fix Version/s: 3.3.2 Resolution: Fixed > Add GCS FS impl reference to

[GitHub] [hadoop] steveloughran merged pull request #3180: HADOOP-17402. Add GCS config to the core-site (#2638)

steveloughran merged pull request #3180: URL: https://github.com/apache/hadoop/pull/3180 -- This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use the URL above to go to the specific comment. To unsubscribe, e-mail:

[jira] [Work logged] (HADOOP-17788) Replace IOUtils#closeQuietly usages

[ https://issues.apache.org/jira/browse/HADOOP-17788?focusedWorklogId=620235=com.atlassian.jira.plugin.system.issuetabpanels:worklog-tabpanel#worklog-620235 ] ASF GitHub Bot logged work on HADOOP-17788: --- Author: ASF GitHub Bot

[GitHub] [hadoop] steveloughran commented on pull request #3171: HADOOP-17788. Replace IOUtils#closeQuietly usages by Hadoop's own utility

steveloughran commented on pull request #3171: URL: https://github.com/apache/hadoop/pull/3171#issuecomment-875954548 > thanks for the example of how JDK can produce IllegalArgumentException, learnt something new today. yeah, stupid thing for them to do. wasb was being clever about

[GitHub] [hadoop] hadoop-yetus removed a comment on pull request #2971: MAPREDUCE-7341. Intermediate Manifest Committer

hadoop-yetus removed a comment on pull request #2971: URL: https://github.com/apache/hadoop/pull/2971#issuecomment-875132867 :broken_heart: **-1 overall** | Vote | Subsystem | Runtime | Logfile | Comment | |::|--:|:|::|:---:|

[GitHub] [hadoop] hadoop-yetus removed a comment on pull request #2971: MAPREDUCE-7341. Intermediate Manifest Committer

hadoop-yetus removed a comment on pull request #2971: URL: https://github.com/apache/hadoop/pull/2971#issuecomment-874362787 :broken_heart: **-1 overall** | Vote | Subsystem | Runtime | Logfile | Comment | |::|--:|:|::|:---:|

[jira] [Commented] (HADOOP-17789) S3 read performance with Spark with Hadoop 3.3.1 is slower than older Hadoop

[ https://issues.apache.org/jira/browse/HADOOP-17789?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17376846#comment-17376846 ] Steve Loughran commented on HADOOP-17789: - [~arghya18] & ([~gchurch] I need that cloudstore

[jira] [Commented] (HADOOP-17755) EOF reached error reading ORC file on S3A

[ https://issues.apache.org/jira/browse/HADOOP-17755?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17376844#comment-17376844 ] Steve Loughran commented on HADOOP-17755: - [~gchurch] please comment on new JIRA. I'm not

[jira] [Assigned] (HADOOP-17789) S3 read performance with Spark with Hadoop 3.3.1 is slower than older Hadoop

[ https://issues.apache.org/jira/browse/HADOOP-17789?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Steve Loughran reassigned HADOOP-17789: --- Assignee: Steve Loughran > S3 read performance with Spark with Hadoop 3.3.1 is

[GitHub] [hadoop] hadoop-yetus commented on pull request #3186: HDFS-16118.Improve the number of handlers that initialize NameNodeRpcServer#clientRpcServer.

hadoop-yetus commented on pull request #3186: URL: https://github.com/apache/hadoop/pull/3186#issuecomment-875926006 :broken_heart: **-1 overall** | Vote | Subsystem | Runtime | Logfile | Comment | |::|--:|:|::|:---:| | +0

[GitHub] [hadoop] hadoop-yetus commented on pull request #3164: Fix NPE in Find.java

hadoop-yetus commented on pull request #3164: URL: https://github.com/apache/hadoop/pull/3164#issuecomment-875872871 :broken_heart: **-1 overall** | Vote | Subsystem | Runtime | Logfile | Comment | |::|--:|:|::|:---:| | +0

[GitHub] [hadoop] hadoop-yetus commented on pull request #3135: YARN-10829. Support getApplications API in FederationClientInterceptor

hadoop-yetus commented on pull request #3135: URL: https://github.com/apache/hadoop/pull/3135#issuecomment-875865972 :confetti_ball: **+1 overall** | Vote | Subsystem | Runtime | Logfile | Comment | |::|--:|:|::|:---:| | +0

[jira] [Work logged] (HADOOP-13887) Encrypt S3A data client-side with AWS SDK (S3-CSE)

[ https://issues.apache.org/jira/browse/HADOOP-13887?focusedWorklogId=620101=com.atlassian.jira.plugin.system.issuetabpanels:worklog-tabpanel#worklog-620101 ] ASF GitHub Bot logged work on HADOOP-13887: --- Author: ASF GitHub Bot

[GitHub] [hadoop] mukund-thakur commented on a change in pull request #2706: HADOOP-13887. Support S3 client side encryption (S3-CSE) using AWS-SDK

mukund-thakur commented on a change in pull request #2706: URL: https://github.com/apache/hadoop/pull/2706#discussion_r665189654 ## File path: hadoop-tools/hadoop-aws/src/main/java/org/apache/hadoop/fs/s3a/S3ABlockOutputStream.java ## @@ -307,29 +311,31 @@ public synchronized

[jira] [Work logged] (HADOOP-13887) Encrypt S3A data client-side with AWS SDK (S3-CSE)

[ https://issues.apache.org/jira/browse/HADOOP-13887?focusedWorklogId=620094=com.atlassian.jira.plugin.system.issuetabpanels:worklog-tabpanel#worklog-620094 ] ASF GitHub Bot logged work on HADOOP-13887: --- Author: ASF GitHub Bot

[GitHub] [hadoop] mehakmeet commented on a change in pull request #2706: HADOOP-13887. Support S3 client side encryption (S3-CSE) using AWS-SDK

mehakmeet commented on a change in pull request #2706: URL: https://github.com/apache/hadoop/pull/2706#discussion_r665558709 ## File path: hadoop-tools/hadoop-aws/src/main/java/org/apache/hadoop/fs/s3a/S3AUtils.java ## @@ -524,10 +525,15 @@ public static S3AFileStatus

[jira] [Work logged] (HADOOP-13887) Encrypt S3A data client-side with AWS SDK (S3-CSE)

[ https://issues.apache.org/jira/browse/HADOOP-13887?focusedWorklogId=620088=com.atlassian.jira.plugin.system.issuetabpanels:worklog-tabpanel#worklog-620088 ] ASF GitHub Bot logged work on HADOOP-13887: --- Author: ASF GitHub Bot

[GitHub] [hadoop] mehakmeet commented on a change in pull request #2706: HADOOP-13887. Support S3 client side encryption (S3-CSE) using AWS-SDK

mehakmeet commented on a change in pull request #2706: URL: https://github.com/apache/hadoop/pull/2706#discussion_r665556483 ## File path: hadoop-tools/hadoop-aws/src/main/java/org/apache/hadoop/fs/s3a/S3AFileSystem.java ## @@ -3655,7 +3676,14 @@ S3AFileStatus

[GitHub] [hadoop] containerAnalyzer edited a comment on pull request #3164: Fix NPE in Find.java

containerAnalyzer edited a comment on pull request #3164: URL: https://github.com/apache/hadoop/pull/3164#issuecomment-875728419 This is another NPE occurring in DumpS3GuardDynamoTable.java. The patch has been submitted. 1. Return **null** to caller

[GitHub] [hadoop] containerAnalyzer commented on pull request #3164: Fix NPE in Find.java

containerAnalyzer commented on pull request #3164: URL: https://github.com/apache/hadoop/pull/3164#issuecomment-875728419 This is another NPE occurring in DumpS3GuardDynamoTable.java. The patch has been submitted. 1. Return **null** to caller

[GitHub] [hadoop] hadoop-yetus commented on pull request #3185: HDFS-16119. start balancer with parameters -hotBlockTimeInterval xxx is invalid.

hadoop-yetus commented on pull request #3185: URL: https://github.com/apache/hadoop/pull/3185#issuecomment-875705835 :broken_heart: **-1 overall** | Vote | Subsystem | Runtime | Logfile | Comment | |::|--:|:|::|:---:| | +0

[jira] [Resolved] (HADOOP-17274) MR FileInput/Output formats to aggregate IOStatistics

[ https://issues.apache.org/jira/browse/HADOOP-17274?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Steve Loughran resolved HADOOP-17274. - Resolution: Won't Fix MAPREDUCE-7341 does this in its new committer > MR

[GitHub] [hadoop] wojiaodoubao commented on pull request #3141: HDFS-16087. Fix stuck issue in rbfbalance tool.

wojiaodoubao commented on pull request #3141: URL: https://github.com/apache/hadoop/pull/3141#issuecomment-87847 There is also some check-style complaint from yetus, fix them please. -- This is an automated message from the Apache Git Service. To respond to the message, please log on

[GitHub] [hadoop] wojiaodoubao commented on a change in pull request #3141: HDFS-16087. Fix stuck issue in rbfbalance tool.

wojiaodoubao commented on a change in pull request #3141: URL: https://github.com/apache/hadoop/pull/3141#discussion_r661299048 ## File path: hadoop-hdfs-project/hadoop-hdfs-rbf/src/main/java/org/apache/hadoop/hdfs/rbfbalance/RouterDistCpProcedure.java ## @@ -44,6 +44,7 @@

[GitHub] [hadoop] wojiaodoubao commented on a change in pull request #3141: HDFS-16087. Fix stuck issue in rbfbalance tool.

wojiaodoubao commented on a change in pull request #3141: URL: https://github.com/apache/hadoop/pull/3141#discussion_r665311980 ## File path: hadoop-hdfs-project/hadoop-hdfs-rbf/src/test/java/org/apache/hadoop/hdfs/rbfbalance/TestRouterDistCpProcedure.java ## @@ -0,0 +1,120

[jira] [Created] (HADOOP-17792) "hadoop.security.token.service.use_ip" should be documented

Akira Ajisaka created HADOOP-17792: -- Summary: "hadoop.security.token.service.use_ip" should be documented Key: HADOOP-17792 URL: https://issues.apache.org/jira/browse/HADOOP-17792 Project: Hadoop

[GitHub] [hadoop] jianghuazhu opened a new pull request #3186: HDFS-16118.Improve the number of handlers that initialize NameNodeRpcServer#clientRpcServer.

jianghuazhu opened a new pull request #3186: URL: https://github.com/apache/hadoop/pull/3186 …Server#clientRpcServer. ## NOTICE Please create an issue in ASF JIRA before opening a pull request, and you need to set the title of the pull request which starts with the

[GitHub] [hadoop] JiaguodongF opened a new pull request #3185: HDFS-16119. start balancer with parameters -hotBlockTimeInterval xxx is valid.

JiaguodongF opened a new pull request #3185: URL: https://github.com/apache/hadoop/pull/3185 when start balancer with parameters -hotBlockTimeInterval xxx,  it is not valid. but set hdfs-site.xml is valid. dfs.balancer.getBlocks.hot-time-interval 1000 -- This is an

[jira] [Updated] (HADOOP-17788) Replace IOUtils#closeQuietly usages

[ https://issues.apache.org/jira/browse/HADOOP-17788?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Viraj Jasani updated HADOOP-17788: -- Target Version/s: 3.4.0 > Replace IOUtils#closeQuietly usages >

[jira] [Updated] (HADOOP-17735) Upgrade aws-java-sdk to 1.11.1026 or later

[ https://issues.apache.org/jira/browse/HADOOP-17735?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Steve Loughran updated HADOOP-17735: Summary: Upgrade aws-java-sdk to 1.11.1026 or later (was: Upgrade aws-java-sdk to

[jira] [Updated] (HADOOP-17735) Upgrade aws-java-sdk to 1.11.1026

[ https://issues.apache.org/jira/browse/HADOOP-17735?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Steve Loughran updated HADOOP-17735: Summary: Upgrade aws-java-sdk to 1.11.1026 (was: Upgrade aws-java-sdk to 1.11.1026 or

[jira] [Updated] (HADOOP-17775) Remove JavaScript package from Docker environment

[ https://issues.apache.org/jira/browse/HADOOP-17775?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Akira Ajisaka updated HADOOP-17775: --- Fix Version/s: 3.3.2 3.2.3 2.10.2 Hadoop Flags:

[jira] [Work logged] (HADOOP-17775) Remove JavaScript package from Docker environment

[ https://issues.apache.org/jira/browse/HADOOP-17775?focusedWorklogId=619852=com.atlassian.jira.plugin.system.issuetabpanels:worklog-tabpanel#worklog-619852 ] ASF GitHub Bot logged work on HADOOP-17775: --- Author: ASF GitHub Bot

[GitHub] [hadoop] aajisaka merged pull request #3184: HADOOP-17775. Remove JavaScript package from Docker environment.

aajisaka merged pull request #3184: URL: https://github.com/apache/hadoop/pull/3184 -- This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use the URL above to go to the specific comment. To unsubscribe, e-mail:

[jira] [Work logged] (HADOOP-17775) Remove JavaScript package from Docker environment

[ https://issues.apache.org/jira/browse/HADOOP-17775?focusedWorklogId=619850=com.atlassian.jira.plugin.system.issuetabpanels:worklog-tabpanel#worklog-619850 ] ASF GitHub Bot logged work on HADOOP-17775: --- Author: ASF GitHub Bot

[jira] [Work logged] (HADOOP-17775) Remove JavaScript package from Docker environment

[ https://issues.apache.org/jira/browse/HADOOP-17775?focusedWorklogId=619851=com.atlassian.jira.plugin.system.issuetabpanels:worklog-tabpanel#worklog-619851 ] ASF GitHub Bot logged work on HADOOP-17775: --- Author: ASF GitHub Bot

[GitHub] [hadoop] aajisaka merged pull request #3183: HADOOP-17775. Remove JavaScript package from Docker environment.

aajisaka merged pull request #3183: URL: https://github.com/apache/hadoop/pull/3183 -- This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use the URL above to go to the specific comment. To unsubscribe, e-mail:

[GitHub] [hadoop] aajisaka merged pull request #3182: HADOOP-17775. Remove JavaScript package from Docker environment.

aajisaka merged pull request #3182: URL: https://github.com/apache/hadoop/pull/3182 -- This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use the URL above to go to the specific comment. To unsubscribe, e-mail:

[GitHub] [hadoop] hemanthboyina commented on pull request #3179: HDFS-16114. the balancer parameters print error

hemanthboyina commented on pull request #3179: URL: https://github.com/apache/hadoop/pull/3179#issuecomment-875413672 thanks @JiaguodongF for the contribution , thanks @tomscut for the review -- This is an automated message from the Apache Git Service. To respond to the message, please

[GitHub] [hadoop] hemanthboyina merged pull request #3179: HDFS-16114. the balancer parameters print error

hemanthboyina merged pull request #3179: URL: https://github.com/apache/hadoop/pull/3179 -- This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use the URL above to go to the specific comment. To unsubscribe, e-mail:

[GitHub] [hadoop] hadoop-yetus commented on pull request #3181: HDFS-16116. Fix Hadoop FedBalance shell and federationBanance markdow…

hadoop-yetus commented on pull request #3181: URL: https://github.com/apache/hadoop/pull/3181#issuecomment-875377099 :broken_heart: **-1 overall** | Vote | Subsystem | Runtime | Logfile | Comment | |::|--:|:|::|:---:| | +0

[jira] [Work logged] (HADOOP-17775) Remove JavaScript package from Docker environment

[ https://issues.apache.org/jira/browse/HADOOP-17775?focusedWorklogId=619773=com.atlassian.jira.plugin.system.issuetabpanels:worklog-tabpanel#worklog-619773 ] ASF GitHub Bot logged work on HADOOP-17775: --- Author: ASF GitHub Bot

[GitHub] [hadoop] hadoop-yetus commented on pull request #3183: HADOOP-17775. Remove JavaScript package from Docker environment.

hadoop-yetus commented on pull request #3183: URL: https://github.com/apache/hadoop/pull/3183#issuecomment-875308658 :confetti_ball: **+1 overall** | Vote | Subsystem | Runtime | Logfile | Comment | |::|--:|:|::|:---:| | +0