[GitHub] [hadoop] xinglin commented on a change in pull request #3201: Fgl saveloadfs

xinglin commented on a change in pull request #3201: URL: https://github.com/apache/hadoop/pull/3201#discussion_r674517832 ## File path: hadoop-hdfs-project/hadoop-hdfs/src/main/java/org/apache/hadoop/hdfs/server/namenode/FSDirectory.java ## @@ -160,6 +164,8 @@ private static

[jira] [Work logged] (HADOOP-17770) WASB : Support disabling buffered reads in positional reads

[ https://issues.apache.org/jira/browse/HADOOP-17770?focusedWorklogId=626440&page=com.atlassian.jira.plugin.system.issuetabpanels:worklog-tabpanel#worklog-626440 ] ASF GitHub Bot logged work on HADOOP-17770: --- Author: ASF GitHub B

[GitHub] [hadoop] hadoop-yetus commented on pull request #3223: Addendum HADOOP-17770 WASB : Support disabling buffered reads in positional reads - Added the invalid SpotBugs warning to findbugs-exclu

hadoop-yetus commented on pull request #3223: URL: https://github.com/apache/hadoop/pull/3223#issuecomment-884669031 :confetti_ball: **+1 overall** | Vote | Subsystem | Runtime | Logfile | Comment | |::|--:|:|::|:---:| | +0 :o

[jira] [Commented] (HADOOP-17042) Hadoop distcp throws "ERROR: Tools helper ///usr/lib/hadoop/libexec/tools/hadoop-distcp.sh was not found"

[ https://issues.apache.org/jira/browse/HADOOP-17042?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=17385256#comment-17385256 ] Vijay Singh commented on HADOOP-17042: -- Hi *[~tanakahda]* Getting the same error

[jira] [Work logged] (HADOOP-17770) WASB : Support disabling buffered reads in positional reads

[ https://issues.apache.org/jira/browse/HADOOP-17770?focusedWorklogId=626428&page=com.atlassian.jira.plugin.system.issuetabpanels:worklog-tabpanel#worklog-626428 ] ASF GitHub Bot logged work on HADOOP-17770: --- Author: ASF GitHub B

[GitHub] [hadoop] hadoop-yetus commented on pull request #3223: Addendum HADOOP-17770 WASB : Support disabling buffered reads in positional reads - Added the invalid SpotBugs warning to findbugs-exclu

hadoop-yetus commented on pull request #3223: URL: https://github.com/apache/hadoop/pull/3223#issuecomment-884653201 :broken_heart: **-1 overall** | Vote | Subsystem | Runtime | Logfile | Comment | |::|--:|:|::|:---:| | +0 :ok

[jira] [Work logged] (HADOOP-17770) WASB : Support disabling buffered reads in positional reads

[ https://issues.apache.org/jira/browse/HADOOP-17770?focusedWorklogId=626420&page=com.atlassian.jira.plugin.system.issuetabpanels:worklog-tabpanel#worklog-626420 ] ASF GitHub Bot logged work on HADOOP-17770: --- Author: ASF GitHub B

[GitHub] [hadoop] anoopsjohn commented on pull request #3149: HADOOP-17770 WASB : Support disabling buffered reads in positional reads

anoopsjohn commented on pull request #3149: URL: https://github.com/apache/hadoop/pull/3149#issuecomment-884642833 @aajisaka , raised a PR for this. -- This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use the URL above to go

[jira] [Work logged] (HADOOP-17770) WASB : Support disabling buffered reads in positional reads

[ https://issues.apache.org/jira/browse/HADOOP-17770?focusedWorklogId=626419&page=com.atlassian.jira.plugin.system.issuetabpanels:worklog-tabpanel#worklog-626419 ] ASF GitHub Bot logged work on HADOOP-17770: --- Author: ASF GitHub B

[GitHub] [hadoop] anoopsjohn opened a new pull request #3223: Addendum HADOOP-17770 WASB : Support disabling buffered reads in positional reads - Added the invalid SpotBugs warning to findbugs-exclude

anoopsjohn opened a new pull request #3223: URL: https://github.com/apache/hadoop/pull/3223 ## NOTICE Please create an issue in ASF JIRA before opening a pull request, and you need to set the title of the pull request which starts with the corresponding JIRA issue number. (e.g.

[jira] [Work logged] (HADOOP-17770) WASB : Support disabling buffered reads in positional reads

[ https://issues.apache.org/jira/browse/HADOOP-17770?focusedWorklogId=626415&page=com.atlassian.jira.plugin.system.issuetabpanels:worklog-tabpanel#worklog-626415 ] ASF GitHub Bot logged work on HADOOP-17770: --- Author: ASF GitHub B

[jira] [Work logged] (HADOOP-17770) WASB : Support disabling buffered reads in positional reads

[ https://issues.apache.org/jira/browse/HADOOP-17770?focusedWorklogId=626416&page=com.atlassian.jira.plugin.system.issuetabpanels:worklog-tabpanel#worklog-626416 ] ASF GitHub Bot logged work on HADOOP-17770: --- Author: ASF GitHub B

[GitHub] [hadoop] anoopsjohn edited a comment on pull request #3149: HADOOP-17770 WASB : Support disabling buffered reads in positional reads

anoopsjohn edited a comment on pull request #3149: URL: https://github.com/apache/hadoop/pull/3149#issuecomment-884638462 -- This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use the URL above to go to the specific comment. To

[GitHub] [hadoop] anoopsjohn commented on pull request #3149: HADOOP-17770 WASB : Support disabling buffered reads in positional reads

anoopsjohn commented on pull request #3149: URL: https://github.com/apache/hadoop/pull/3149#issuecomment-884638462 bq. Would you update findbugs-exclude.xml to ignore the warning? sure -- This is an automated message from the Apache Git Service. To respond to the message, please log on

[jira] [Commented] (HADOOP-17809) WARN security.LdapGroupsMapping: Failed to get groups for user

[ https://issues.apache.org/jira/browse/HADOOP-17809?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=17385217#comment-17385217 ] ighack commented on HADOOP-17809: - my openldap can anonymous access if I remove  hado

[jira] [Work logged] (HADOOP-17770) WASB : Support disabling buffered reads in positional reads

[ https://issues.apache.org/jira/browse/HADOOP-17770?focusedWorklogId=626405&page=com.atlassian.jira.plugin.system.issuetabpanels:worklog-tabpanel#worklog-626405 ] ASF GitHub Bot logged work on HADOOP-17770: --- Author: ASF GitHub B

[GitHub] [hadoop] aajisaka commented on pull request #3149: HADOOP-17770 WASB : Support disabling buffered reads in positional reads

aajisaka commented on pull request #3149: URL: https://github.com/apache/hadoop/pull/3149#issuecomment-884623018 > spotbugs : Internally synchronization for "in" is taken care. @anoopsjohn @surendralilhore Would you update findbugs-exclude.xml to ignore the warning? -- This is an

[jira] [Work logged] (HADOOP-17812) NPE when reading s3a

[ https://issues.apache.org/jira/browse/HADOOP-17812?focusedWorklogId=626404&page=com.atlassian.jira.plugin.system.issuetabpanels:worklog-tabpanel#worklog-626404 ] ASF GitHub Bot logged work on HADOOP-17812: --- Author: ASF GitHub B

[GitHub] [hadoop] hadoop-yetus commented on pull request #3222: HADOOP-17812. Fix s3a NPE when reading

hadoop-yetus commented on pull request #3222: URL: https://github.com/apache/hadoop/pull/3222#issuecomment-884621797 :broken_heart: **-1 overall** | Vote | Subsystem | Runtime | Logfile | Comment | |::|--:|:|::|:---:| | +0 :ok

[jira] [Updated] (HADOOP-17813) Allow line length more than 80 characters

[ https://issues.apache.org/jira/browse/HADOOP-17813?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Akira Ajisaka updated HADOOP-17813: --- Description: Update the checkstyle rule to allow for 100 or 120 characters. Discussion thr

[jira] [Created] (HADOOP-17813) Allow line length more than 80 characters

Akira Ajisaka created HADOOP-17813: -- Summary: Allow line length more than 80 characters Key: HADOOP-17813 URL: https://issues.apache.org/jira/browse/HADOOP-17813 Project: Hadoop Common Issue

[jira] [Work logged] (HADOOP-17812) NPE when reading s3a

[ https://issues.apache.org/jira/browse/HADOOP-17812?focusedWorklogId=626402&page=com.atlassian.jira.plugin.system.issuetabpanels:worklog-tabpanel#worklog-626402 ] ASF GitHub Bot logged work on HADOOP-17812: --- Author: ASF GitHub B

[GitHub] [hadoop] hadoop-yetus commented on pull request #3222: HADOOP-17812. Fix s3a NPE when reading

hadoop-yetus commented on pull request #3222: URL: https://github.com/apache/hadoop/pull/3222#issuecomment-884615254 :broken_heart: **-1 overall** | Vote | Subsystem | Runtime | Logfile | Comment | |::|--:|:|::|:---:| | +0 :ok

[GitHub] [hadoop] hadoop-yetus commented on pull request #3205: HDFS-16130. Implement CREATE File with FGL

hadoop-yetus commented on pull request #3205: URL: https://github.com/apache/hadoop/pull/3205#issuecomment-884613636 :broken_heart: **-1 overall** | Vote | Subsystem | Runtime | Logfile | Comment | |::|--:|:|::|:---:| | +0 :ok

[GitHub] [hadoop] hadoop-yetus commented on pull request #3201: Fgl saveloadfs

hadoop-yetus commented on pull request #3201: URL: https://github.com/apache/hadoop/pull/3201#issuecomment-884602958 :broken_heart: **-1 overall** | Vote | Subsystem | Runtime | Logfile | Comment | |::|--:|:|::|:---:| | +0 :ok

[jira] [Updated] (HADOOP-17812) NPE when reading s3a

[ https://issues.apache.org/jira/browse/HADOOP-17812?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Bobby Wang updated HADOOP-17812: Priority: Major (was: Critical) > NPE when reading s3a > > >

[jira] [Work logged] (HADOOP-17812) NPE when reading s3a

[ https://issues.apache.org/jira/browse/HADOOP-17812?focusedWorklogId=626391&page=com.atlassian.jira.plugin.system.issuetabpanels:worklog-tabpanel#worklog-626391 ] ASF GitHub Bot logged work on HADOOP-17812: --- Author: ASF GitHub B

[jira] [Work logged] (HADOOP-17812) NPE when reading s3a

[ https://issues.apache.org/jira/browse/HADOOP-17812?focusedWorklogId=626392&page=com.atlassian.jira.plugin.system.issuetabpanels:worklog-tabpanel#worklog-626392 ] ASF GitHub Bot logged work on HADOOP-17812: --- Author: ASF GitHub B

[GitHub] [hadoop] wbo4958 edited a comment on pull request #3222: HADOOP-17812. Fix s3a NPE when reading

wbo4958 edited a comment on pull request #3222: URL: https://github.com/apache/hadoop/pull/3222#issuecomment-884597015 @steveloughran Could you help to take a look at this PR? Thx a lot -- This is an automated message from the Apache Git Service. To respond to the message, please log on

[GitHub] [hadoop] wbo4958 commented on pull request #3222: HADOOP-17812. Fix s3a NPE when reading

wbo4958 commented on pull request #3222: URL: https://github.com/apache/hadoop/pull/3222#issuecomment-884597015 @steveloughran Could you help to take a look at this PR? -- This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use

[jira] [Updated] (HADOOP-17812) NPE when reading s3a

[ https://issues.apache.org/jira/browse/HADOOP-17812?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Bobby Wang updated HADOOP-17812: Priority: Critical (was: Major) > NPE when reading s3a > > >

[jira] [Updated] (HADOOP-17812) NPE when reading s3a

[ https://issues.apache.org/jira/browse/HADOOP-17812?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Bobby Wang updated HADOOP-17812: Component/s: (was: tools) fs/s3 > NPE when reading s3a > ---

[jira] [Updated] (HADOOP-17812) NPE when reading s3a

[ https://issues.apache.org/jira/browse/HADOOP-17812?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Bobby Wang updated HADOOP-17812: Description: when [reading from S3a storage|https://github.com/apache/hadoop/blob/rel/release-3.

[jira] [Work logged] (HADOOP-17812) NPE when reading s3a

[ https://issues.apache.org/jira/browse/HADOOP-17812?focusedWorklogId=626390&page=com.atlassian.jira.plugin.system.issuetabpanels:worklog-tabpanel#worklog-626390 ] ASF GitHub Bot logged work on HADOOP-17812: --- Author: ASF GitHub B

[jira] [Updated] (HADOOP-17812) NPE when reading s3a

[ https://issues.apache.org/jira/browse/HADOOP-17812?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Bobby Wang updated HADOOP-17812: Description: when [reading from S3a storage|https://github.com/apache/hadoop/blob/rel/release-3.

[jira] [Updated] (HADOOP-17812) NPE when reading s3a

[ https://issues.apache.org/jira/browse/HADOOP-17812?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] ASF GitHub Bot updated HADOOP-17812: Labels: pull-request-available (was: ) > NPE when reading s3a > > >

[GitHub] [hadoop] wbo4958 opened a new pull request #3222: HADOOP-17812. Fix s3a NPE when reading

wbo4958 opened a new pull request #3222: URL: https://github.com/apache/hadoop/pull/3222 When IOException happens during "wrappedStream.read", onReadFailure->reopen will be called and reopen will try to re-open "wrappedStream", but what if exception happens during getting S3Object, the

[jira] [Created] (HADOOP-17812) NPE when reading s3a

Bobby Wang created HADOOP-17812: --- Summary: NPE when reading s3a Key: HADOOP-17812 URL: https://issues.apache.org/jira/browse/HADOOP-17812 Project: Hadoop Common Issue Type: Bug Compon

[GitHub] [hadoop] hadoop-yetus commented on pull request #2971: MAPREDUCE-7341. Intermediate Manifest Committer

hadoop-yetus commented on pull request #2971: URL: https://github.com/apache/hadoop/pull/2971#issuecomment-884572548 :broken_heart: **-1 overall** | Vote | Subsystem | Runtime | Logfile | Comment | |::|--:|:|::|:---:| | +0 :ok

[GitHub] [hadoop] shvachko commented on a change in pull request #3201: Fgl saveloadfs

shvachko commented on a change in pull request #3201: URL: https://github.com/apache/hadoop/pull/3201#discussion_r674407665 ## File path: hadoop-hdfs-project/hadoop-hdfs/src/main/java/org/apache/hadoop/hdfs/server/namenode/FSDirectory.java ## @@ -1543,6 +1574,43 @@ public fina

[GitHub] [hadoop] shvachko commented on a change in pull request #3205: HDFS-16130. Implement CREATE File with FGL

shvachko commented on a change in pull request #3205: URL: https://github.com/apache/hadoop/pull/3205#discussion_r674373236 ## File path: hadoop-hdfs-project/hadoop-hdfs/src/main/java/org/apache/hadoop/hdfs/server/namenode/FSDirWriteFileOp.java ## @@ -393,7 +400,7 @@ static Hd

[jira] [Work logged] (HADOOP-17811) ABFS: Allow all ExponentialRetryPolicy properties to be configured

[ https://issues.apache.org/jira/browse/HADOOP-17811?focusedWorklogId=626349&page=com.atlassian.jira.plugin.system.issuetabpanels:worklog-tabpanel#worklog-626349 ] ASF GitHub Bot logged work on HADOOP-17811: --- Author: ASF GitHub B

[GitHub] [hadoop] shvachko commented on a change in pull request #3205: HDFS-16130. Implement CREATE File with FGL

shvachko commented on a change in pull request #3205: URL: https://github.com/apache/hadoop/pull/3205#discussion_r674367980 ## File path: hadoop-hdfs-project/hadoop-hdfs/src/main/java/org/apache/hadoop/hdfs/server/namenode/FSDirMkdirOp.java ## @@ -69,25 +69,34 @@ static FileSt

[GitHub] [hadoop] hadoop-yetus commented on pull request #3221: HADOOP-17811: Configure ExponentialRetryPolicy

hadoop-yetus commented on pull request #3221: URL: https://github.com/apache/hadoop/pull/3221#issuecomment-884529375 :broken_heart: **-1 overall** | Vote | Subsystem | Runtime | Logfile | Comment | |::|--:|:|::|:---:| | +0 :ok

[jira] [Commented] (HADOOP-17811) ABFS: Allow all ExponentialRetryPolicy properties to be configured

[ https://issues.apache.org/jira/browse/HADOOP-17811?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=17385122#comment-17385122 ] Hadoop QA commented on HADOOP-17811: | (x) *{color:red}-1 overall{color}* | \\ \\ |

[jira] [Updated] (HADOOP-17811) ABFS: Allow all ExponentialRetryPolicy properties to be configured

[ https://issues.apache.org/jira/browse/HADOOP-17811?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] ASF GitHub Bot updated HADOOP-17811: Labels: pull-request-available (was: ) > ABFS: Allow all ExponentialRetryPolicy properti

[jira] [Work logged] (HADOOP-17811) ABFS: Allow all ExponentialRetryPolicy properties to be configured

[ https://issues.apache.org/jira/browse/HADOOP-17811?focusedWorklogId=626320&page=com.atlassian.jira.plugin.system.issuetabpanels:worklog-tabpanel#worklog-626320 ] ASF GitHub Bot logged work on HADOOP-17811: --- Author: ASF GitHub B

[GitHub] [hadoop] brianloss opened a new pull request #3221: HADOOP-17811: Configure ExponentialRetryPolicy

brianloss opened a new pull request #3221: URL: https://github.com/apache/hadoop/pull/3221 Allow ExponentialRetryPolicy to be fully configured from the hadoop configuration. Properties are already defined for this, so ensure that they are passed along when the retry policy is construct

[jira] [Created] (HADOOP-17811) ABFS: Allow all ExponentialRetryPolicy properties to be configured

Brian Frank Loss created HADOOP-17811: - Summary: ABFS: Allow all ExponentialRetryPolicy properties to be configured Key: HADOOP-17811 URL: https://issues.apache.org/jira/browse/HADOOP-17811 Projec

[GitHub] [hadoop] hadoop-yetus commented on pull request #3203: YARN-10833. Set the X-FRAME-OPTIONS header for the default contexts.

hadoop-yetus commented on pull request #3203: URL: https://github.com/apache/hadoop/pull/3203#issuecomment-884455056 :confetti_ball: **+1 overall** | Vote | Subsystem | Runtime | Logfile | Comment | |::|--:|:|::|:---:| | +0 :o

[jira] [Work logged] (HADOOP-17787) Refactor fetching of credentials in Jenkins

[ https://issues.apache.org/jira/browse/HADOOP-17787?focusedWorklogId=626299&page=com.atlassian.jira.plugin.system.issuetabpanels:worklog-tabpanel#worklog-626299 ] ASF GitHub Bot logged work on HADOOP-17787: --- Author: ASF GitHub B

[GitHub] [hadoop] hadoop-yetus commented on pull request #3167: HADOOP-17787. Refactor fetching of credentials in Jenkins

hadoop-yetus commented on pull request #3167: URL: https://github.com/apache/hadoop/pull/3167#issuecomment-884447137 :confetti_ball: **+1 overall** | Vote | Subsystem | Runtime | Logfile | Comment | |::|--:|:|::|:---:| | +0 :o

[jira] [Work logged] (HADOOP-17139) Re-enable optimized copyFromLocal implementation in S3AFileSystem

[ https://issues.apache.org/jira/browse/HADOOP-17139?focusedWorklogId=626282&page=com.atlassian.jira.plugin.system.issuetabpanels:worklog-tabpanel#worklog-626282 ] ASF GitHub Bot logged work on HADOOP-17139: --- Author: ASF GitHub B

[GitHub] [hadoop] hadoop-yetus commented on pull request #3101: HADOOP-17139 Re-enable optimized copyFromLocal implementation in S3AFileSystem

hadoop-yetus commented on pull request #3101: URL: https://github.com/apache/hadoop/pull/3101#issuecomment-884414854 :broken_heart: **-1 overall** | Vote | Subsystem | Runtime | Logfile | Comment | |::|--:|:|::|:---:| | +0 :ok

[GitHub] [hadoop] xinglin commented on a change in pull request #3201: Fgl saveloadfs

xinglin commented on a change in pull request #3201: URL: https://github.com/apache/hadoop/pull/3201#discussion_r674174955 ## File path: hadoop-hdfs-project/hadoop-hdfs/src/main/java/org/apache/hadoop/hdfs/server/namenode/FSDirectory.java ## @@ -1860,6 +1928,55 @@ FSPermission

[GitHub] [hadoop] xinglin commented on a change in pull request #3201: Fgl saveloadfs

xinglin commented on a change in pull request #3201: URL: https://github.com/apache/hadoop/pull/3201#discussion_r674170856 ## File path: hadoop-hdfs-project/hadoop-hdfs/src/main/java/org/apache/hadoop/hdfs/server/namenode/FSDirectory.java ## @@ -1860,6 +1928,55 @@ FSPermission

[GitHub] [hadoop] hadoop-yetus commented on pull request #3206: YARN-10814. Fallback to RandomSecretProvider if the secret file is em…

hadoop-yetus commented on pull request #3206: URL: https://github.com/apache/hadoop/pull/3206#issuecomment-884290932 :confetti_ball: **+1 overall** | Vote | Subsystem | Runtime | Logfile | Comment | |::|--:|:|::|:---:| | +0 :o

[GitHub] [hadoop] hadoop-yetus commented on pull request #3220: YARN-10355. Refactor NM ContainerLaunch.java#orderEnvByDependencies

hadoop-yetus commented on pull request #3220: URL: https://github.com/apache/hadoop/pull/3220#issuecomment-884225782 :broken_heart: **-1 overall** | Vote | Subsystem | Runtime | Logfile | Comment | |::|--:|:|::|:---:| | +0 :ok

[GitHub] [hadoop] brumi1024 commented on a change in pull request #3220: YARN-10355. Refactor NM ContainerLaunch.java#orderEnvByDependencies

brumi1024 commented on a change in pull request #3220: URL: https://github.com/apache/hadoop/pull/3220#discussion_r674000662 ## File path: hadoop-yarn-project/hadoop-yarn/hadoop-yarn-server/hadoop-yarn-server-nodemanager/src/test/java/org/apache/hadoop/yarn/server/nodemanager/containe

[GitHub] [hadoop] brumi1024 commented on a change in pull request #3220: YARN-10355. Refactor NM ContainerLaunch.java#orderEnvByDependencies

brumi1024 commented on a change in pull request #3220: URL: https://github.com/apache/hadoop/pull/3220#discussion_r673999244 ## File path: hadoop-yarn-project/hadoop-yarn/hadoop-yarn-server/hadoop-yarn-server-nodemanager/src/main/java/org/apache/hadoop/yarn/server/nodemanager/containe

[GitHub] [hadoop] brumi1024 commented on a change in pull request #3220: YARN-10355. Refactor NM ContainerLaunch.java#orderEnvByDependencies

brumi1024 commented on a change in pull request #3220: URL: https://github.com/apache/hadoop/pull/3220#discussion_r673992746 ## File path: hadoop-yarn-project/hadoop-yarn/hadoop-yarn-server/hadoop-yarn-server-nodemanager/src/main/java/org/apache/hadoop/yarn/server/nodemanager/containe

[GitHub] [hadoop] hadoop-yetus commented on pull request #3220: YARN-10355. Refactor NM ContainerLaunch.java#orderEnvByDependencies

hadoop-yetus commented on pull request #3220: URL: https://github.com/apache/hadoop/pull/3220#issuecomment-884190700 :confetti_ball: **+1 overall** | Vote | Subsystem | Runtime | Logfile | Comment | |::|--:|:|::|:---:| | +0 :o

[jira] [Comment Edited] (HADOOP-17789) S3 read performance with Spark with Hadoop 3.3.1 is slower than older Hadoop

[ https://issues.apache.org/jira/browse/HADOOP-17789?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=17383743#comment-17383743 ] Arghya Saha edited comment on HADOOP-17789 at 7/21/21, 12:49 PM:

[GitHub] [hadoop] tomicooler commented on a change in pull request #3220: YARN-10355. Refactor NM ContainerLaunch.java#orderEnvByDependencies

tomicooler commented on a change in pull request #3220: URL: https://github.com/apache/hadoop/pull/3220#discussion_r673926349 ## File path: hadoop-yarn-project/hadoop-yarn/hadoop-yarn-server/hadoop-yarn-server-nodemanager/src/test/java/org/apache/hadoop/yarn/server/nodemanager/contain

[GitHub] [hadoop] tomicooler commented on a change in pull request #3220: YARN-10355. Refactor NM ContainerLaunch.java#orderEnvByDependencies

tomicooler commented on a change in pull request #3220: URL: https://github.com/apache/hadoop/pull/3220#discussion_r673917304 ## File path: hadoop-yarn-project/hadoop-yarn/hadoop-yarn-server/hadoop-yarn-server-nodemanager/src/test/java/org/apache/hadoop/yarn/server/nodemanager/contain

[GitHub] [hadoop] tomicooler commented on a change in pull request #3220: YARN-10355. Refactor NM ContainerLaunch.java#orderEnvByDependencies

tomicooler commented on a change in pull request #3220: URL: https://github.com/apache/hadoop/pull/3220#discussion_r673917188 ## File path: hadoop-yarn-project/hadoop-yarn/hadoop-yarn-server/hadoop-yarn-server-nodemanager/src/main/java/org/apache/hadoop/yarn/server/nodemanager/contain

[GitHub] [hadoop] tomicooler commented on a change in pull request #3220: YARN-10355. Refactor NM ContainerLaunch.java#orderEnvByDependencies

tomicooler commented on a change in pull request #3220: URL: https://github.com/apache/hadoop/pull/3220#discussion_r673912573 ## File path: hadoop-yarn-project/hadoop-yarn/hadoop-yarn-server/hadoop-yarn-server-nodemanager/src/main/java/org/apache/hadoop/yarn/server/nodemanager/contain

[GitHub] [hadoop] tomicooler commented on a change in pull request #3220: YARN-10355. Refactor NM ContainerLaunch.java#orderEnvByDependencies

tomicooler commented on a change in pull request #3220: URL: https://github.com/apache/hadoop/pull/3220#discussion_r673912213 ## File path: hadoop-yarn-project/hadoop-yarn/hadoop-yarn-server/hadoop-yarn-server-nodemanager/src/main/java/org/apache/hadoop/yarn/server/nodemanager/contain

[GitHub] [hadoop] tomicooler commented on a change in pull request #3220: YARN-10355. Refactor NM ContainerLaunch.java#orderEnvByDependencies

tomicooler commented on a change in pull request #3220: URL: https://github.com/apache/hadoop/pull/3220#discussion_r673911895 ## File path: hadoop-yarn-project/hadoop-yarn/hadoop-yarn-server/hadoop-yarn-server-nodemanager/src/main/java/org/apache/hadoop/yarn/server/nodemanager/contain

[jira] [Work logged] (HADOOP-17139) Re-enable optimized copyFromLocal implementation in S3AFileSystem

[ https://issues.apache.org/jira/browse/HADOOP-17139?focusedWorklogId=626067&page=com.atlassian.jira.plugin.system.issuetabpanels:worklog-tabpanel#worklog-626067 ] ASF GitHub Bot logged work on HADOOP-17139: --- Author: ASF GitHub B

[GitHub] [hadoop] hadoop-yetus removed a comment on pull request #3101: HADOOP-17139 Re-enable optimized copyFromLocal implementation in S3AFileSystem

hadoop-yetus removed a comment on pull request #3101: URL: https://github.com/apache/hadoop/pull/3101#issuecomment-874873725 -- This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use the URL above to go to the specific comment.

[jira] [Work logged] (HADOOP-13887) Encrypt S3A data client-side with AWS SDK (S3-CSE)

[ https://issues.apache.org/jira/browse/HADOOP-13887?focusedWorklogId=626066&page=com.atlassian.jira.plugin.system.issuetabpanels:worklog-tabpanel#worklog-626066 ] ASF GitHub Bot logged work on HADOOP-13887: --- Author: ASF GitHub B

[GitHub] [hadoop] steveloughran commented on a change in pull request #2706: HADOOP-13887. Support S3 client side encryption (S3-CSE) using AWS-SDK

steveloughran commented on a change in pull request #2706: URL: https://github.com/apache/hadoop/pull/2706#discussion_r673873663 ## File path: hadoop-tools/hadoop-aws/src/main/java/org/apache/hadoop/fs/s3a/Constants.java ## @@ -437,14 +442,14 @@ private Constants() { /**

[jira] [Work logged] (HADOOP-13887) Encrypt S3A data client-side with AWS SDK (S3-CSE)

[ https://issues.apache.org/jira/browse/HADOOP-13887?focusedWorklogId=626065&page=com.atlassian.jira.plugin.system.issuetabpanels:worklog-tabpanel#worklog-626065 ] ASF GitHub Bot logged work on HADOOP-13887: --- Author: ASF GitHub B

[GitHub] [hadoop] steveloughran commented on a change in pull request #2706: HADOOP-13887. Support S3 client side encryption (S3-CSE) using AWS-SDK

steveloughran commented on a change in pull request #2706: URL: https://github.com/apache/hadoop/pull/2706#discussion_r673869794 ## File path: hadoop-tools/hadoop-aws/src/site/markdown/tools/hadoop-aws/encryption.md ## @@ -619,6 +620,19 @@ clients where S3-CSE has not been ena

[GitHub] [hadoop] prasad-acit commented on a change in pull request #3201: Fgl saveloadfs

prasad-acit commented on a change in pull request #3201: URL: https://github.com/apache/hadoop/pull/3201#discussion_r671996972 ## File path: hadoop-hdfs-project/hadoop-hdfs/src/main/java/org/apache/hadoop/hdfs/server/namenode/FSDirectory.java ## @@ -1860,6 +1928,55 @@ FSPermis

[GitHub] [hadoop] hadoop-yetus commented on pull request #3206: YARN-10814. Fallback to RandomSecretProvider if the secret file is em…

hadoop-yetus commented on pull request #3206: URL: https://github.com/apache/hadoop/pull/3206#issuecomment-884072256 :broken_heart: **-1 overall** | Vote | Subsystem | Runtime | Logfile | Comment | |::|--:|:|::|:---:| | +0 :ok

[GitHub] [hadoop] bogthe commented on a change in pull request #3101: HADOOP-17139 Re-enable optimized copyFromLocal implementation in S3AFileSystem

bogthe commented on a change in pull request #3101: URL: https://github.com/apache/hadoop/pull/3101#discussion_r673835551 ## File path: hadoop-tools/hadoop-aws/src/main/java/org/apache/hadoop/fs/s3a/impl/CopyFromLocalOperation.java ## @@ -144,10 +144,13 @@ public Void execute(

[jira] [Work logged] (HADOOP-17139) Re-enable optimized copyFromLocal implementation in S3AFileSystem

[ https://issues.apache.org/jira/browse/HADOOP-17139?focusedWorklogId=626030&page=com.atlassian.jira.plugin.system.issuetabpanels:worklog-tabpanel#worklog-626030 ] ASF GitHub Bot logged work on HADOOP-17139: --- Author: ASF GitHub B

[jira] [Work logged] (HADOOP-17139) Re-enable optimized copyFromLocal implementation in S3AFileSystem

[ https://issues.apache.org/jira/browse/HADOOP-17139?focusedWorklogId=626020&page=com.atlassian.jira.plugin.system.issuetabpanels:worklog-tabpanel#worklog-626020 ] ASF GitHub Bot logged work on HADOOP-17139: --- Author: ASF GitHub B

[GitHub] [hadoop] bogthe commented on a change in pull request #3101: HADOOP-17139 Re-enable optimized copyFromLocal implementation in S3AFileSystem

bogthe commented on a change in pull request #3101: URL: https://github.com/apache/hadoop/pull/3101#discussion_r673828461 ## File path: hadoop-tools/hadoop-aws/src/main/java/org/apache/hadoop/fs/s3a/impl/CopyFromLocalOperation.java ## @@ -0,0 +1,536 @@ +/* + * Licensed to the

[jira] [Work logged] (HADOOP-17139) Re-enable optimized copyFromLocal implementation in S3AFileSystem

[ https://issues.apache.org/jira/browse/HADOOP-17139?focusedWorklogId=626008&page=com.atlassian.jira.plugin.system.issuetabpanels:worklog-tabpanel#worklog-626008 ] ASF GitHub Bot logged work on HADOOP-17139: --- Author: ASF GitHub B

[GitHub] [hadoop] bogthe commented on a change in pull request #3101: HADOOP-17139 Re-enable optimized copyFromLocal implementation in S3AFileSystem

bogthe commented on a change in pull request #3101: URL: https://github.com/apache/hadoop/pull/3101#discussion_r673818683 ## File path: hadoop-tools/hadoop-aws/src/main/java/org/apache/hadoop/fs/s3a/impl/CopyFromLocalOperation.java ## @@ -161,6 +164,21 @@ public Void execute()

[jira] [Comment Edited] (HADOOP-17809) WARN security.LdapGroupsMapping: Failed to get groups for user

[ https://issues.apache.org/jira/browse/HADOOP-17809?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=17384776#comment-17384776 ] ighack edited comment on HADOOP-17809 at 7/21/21, 9:32 AM: --- i

[jira] [Commented] (HADOOP-17809) WARN security.LdapGroupsMapping: Failed to get groups for user

[ https://issues.apache.org/jira/browse/HADOOP-17809?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=17384776#comment-17384776 ] ighack commented on HADOOP-17809: - {code:java} ./hadoop-cmf-hdfs-NAMENODE-bigdser5.log.

[GitHub] [hadoop] hadoop-yetus commented on pull request #3220: YARN-10355. Refactor NM ContainerLaunch.java#orderEnvByDependencies

hadoop-yetus commented on pull request #3220: URL: https://github.com/apache/hadoop/pull/3220#issuecomment-884040951 :confetti_ball: **+1 overall** | Vote | Subsystem | Runtime | Logfile | Comment | |::|--:|:|::|:---:| | +0 :o

[GitHub] [hadoop] 9uapaw commented on a change in pull request #3220: YARN-10355. Refactor NM ContainerLaunch.java#orderEnvByDependencies

9uapaw commented on a change in pull request #3220: URL: https://github.com/apache/hadoop/pull/3220#discussion_r673800026 ## File path: hadoop-yarn-project/hadoop-yarn/hadoop-yarn-server/hadoop-yarn-server-nodemanager/src/main/java/org/apache/hadoop/yarn/server/nodemanager/containerma

[GitHub] [hadoop] tomicooler commented on a change in pull request #3206: YARN-10814. Fallback to RandomSecretProvider if the secret file is em…

tomicooler commented on a change in pull request #3206: URL: https://github.com/apache/hadoop/pull/3206#discussion_r673734487 ## File path: hadoop-common-project/hadoop-auth/src/test/java/org/apache/hadoop/security/authentication/util/TestFileSignerSecretProvider.java ## @@ -4

[GitHub] [hadoop] tomicooler commented on a change in pull request #3206: YARN-10814. Fallback to RandomSecretProvider if the secret file is em…

tomicooler commented on a change in pull request #3206: URL: https://github.com/apache/hadoop/pull/3206#discussion_r673733905 ## File path: hadoop-common-project/hadoop-auth/src/main/java/org/apache/hadoop/security/authentication/server/AuthenticationFilter.java ## @@ -237,6 +

[jira] [Created] (HADOOP-17810) [KMS] LoadBalancingKMSClientProvider should implement toString()

Wei-Chiu Chuang created HADOOP-17810: Summary: [KMS] LoadBalancingKMSClientProvider should implement toString() Key: HADOOP-17810 URL: https://issues.apache.org/jira/browse/HADOOP-17810 Project: H

[jira] [Updated] (HADOOP-17809) WARN security.LdapGroupsMapping: Failed to get groups for user

[ https://issues.apache.org/jira/browse/HADOOP-17809?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] ighack updated HADOOP-17809: Component/s: common > WARN security.LdapGroupsMapping: Failed to get groups for user > --

[GitHub] [hadoop] hadoop-yetus commented on pull request #3211: HDFS-16131. Show storage type for failed volumes on namenode web

hadoop-yetus commented on pull request #3211: URL: https://github.com/apache/hadoop/pull/3211#issuecomment-883952991 :confetti_ball: **+1 overall** | Vote | Subsystem | Runtime | Logfile | Comment | |::|--:|:|::|:---:| | +0 :o

[jira] [Created] (HADOOP-17809) WARN security.LdapGroupsMapping: Failed to get groups for user

ighack created HADOOP-17809: --- Summary: WARN security.LdapGroupsMapping: Failed to get groups for user Key: HADOOP-17809 URL: https://issues.apache.org/jira/browse/HADOOP-17809 Project: Hadoop Common

[GitHub] [hadoop] 9uapaw commented on a change in pull request #3206: YARN-10814. Fallback to RandomSecretProvider if the secret file is em…

9uapaw commented on a change in pull request #3206: URL: https://github.com/apache/hadoop/pull/3206#discussion_r673708836 ## File path: hadoop-common-project/hadoop-auth/src/main/java/org/apache/hadoop/security/authentication/server/AuthenticationFilter.java ## @@ -237,6 +237,