[jira] [Updated] (HADOOP-17775) Remove JavaScript package from Docker environment

[ https://issues.apache.org/jira/browse/HADOOP-17775?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] ASF GitHub Bot updated HADOOP-17775: Labels: pull-request-available (was: ) > Remove JavaScript package from Docker

[jira] [Work logged] (HADOOP-17775) Remove JavaScript package from Docker environment

[ https://issues.apache.org/jira/browse/HADOOP-17775?focusedWorklogId=614337=com.atlassian.jira.plugin.system.issuetabpanels:worklog-tabpanel#worklog-614337 ] ASF GitHub Bot logged work on HADOOP-17775: --- Author: ASF GitHub Bot

[GitHub] [hadoop] iwasakims opened a new pull request #3137: HADOOP-17775. Remove JavaScript package from Docker environment.

iwasakims opened a new pull request #3137: URL: https://github.com/apache/hadoop/pull/3137 https://issues.apache.org/jira/browse/HADOOP-17775 As described in the [README of

[jira] [Updated] (HADOOP-17775) Remove JavaScript package from Docker environment

[ https://issues.apache.org/jira/browse/HADOOP-17775?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Masatake Iwasaki updated HADOOP-17775: -- Description: As described in the [README of

[jira] [Created] (HADOOP-17775) Remove JavaScript package from Docker environment

Masatake Iwasaki created HADOOP-17775: - Summary: Remove JavaScript package from Docker environment Key: HADOOP-17775 URL: https://issues.apache.org/jira/browse/HADOOP-17775 Project: Hadoop Common

[jira] [Work logged] (HADOOP-17290) ABFS: Add Identifiers to Client Request Header

[ https://issues.apache.org/jira/browse/HADOOP-17290?focusedWorklogId=614331=com.atlassian.jira.plugin.system.issuetabpanels:worklog-tabpanel#worklog-614331 ] ASF GitHub Bot logged work on HADOOP-17290: --- Author: ASF GitHub Bot

[GitHub] [hadoop] anoopsjohn commented on a change in pull request #2520: HADOOP-17290. ABFS: Add Identifiers to Client Request Header

anoopsjohn commented on a change in pull request #2520: URL: https://github.com/apache/hadoop/pull/2520#discussion_r657346332 ## File path: hadoop-tools/hadoop-azure/src/main/java/org/apache/hadoop/fs/azurebfs/AzureBlobFileSystem.java ## @@ -1071,7 +1155,10 @@ private boolean

[GitHub] [hadoop] akshatb1 commented on pull request #3135: YARN-10829. Support getApplications API in FederationClientInterceptor

akshatb1 commented on pull request #3135: URL: https://github.com/apache/hadoop/pull/3135#issuecomment-867331271 @goiri @bibinchundatt Could you kindly help in reviewing this PR? Thanks. -- This is an automated message from the Apache Git Service. To respond to the message, please log on

[GitHub] [hadoop] tomscut commented on pull request #3117: HDFS-16076. Avoid using slow DataNodes for reading by sorting locations

tomscut commented on pull request #3117: URL: https://github.com/apache/hadoop/pull/3117#issuecomment-867285100 > Merged it. Thanks for your contribution, @tomscut. Thanks @tasanuma . -- This is an automated message from the Apache Git Service. To respond to the message, please

[GitHub] [hadoop] tasanuma commented on pull request #3117: HDFS-16076. Avoid using slow DataNodes for reading by sorting locations

tasanuma commented on pull request #3117: URL: https://github.com/apache/hadoop/pull/3117#issuecomment-867284477 Merged it. Thanks for your contribution, @tomscut. -- This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use the

[GitHub] [hadoop] tasanuma merged pull request #3117: HDFS-16076. Avoid using slow DataNodes for reading by sorting locations

tasanuma merged pull request #3117: URL: https://github.com/apache/hadoop/pull/3117 -- This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use the URL above to go to the specific comment. For queries about this service,

[GitHub] [hadoop] tomscut opened a new pull request #3136: HDFS-16086. Add volume information to datanode log for tracing

tomscut opened a new pull request #3136: URL: https://github.com/apache/hadoop/pull/3136 JIRA: [HDFS-16086](https://issues.apache.org/jira/browse/HDFS-16086) To keep track of the block in volume, we can add the volume information to the datanode log. -- This is an automated

[GitHub] [hadoop] hadoop-yetus commented on pull request #3133: S3AFS creation fails "Unable to find a region via the region provider chain."

hadoop-yetus commented on pull request #3133: URL: https://github.com/apache/hadoop/pull/3133#issuecomment-867160860 :confetti_ball: **+1 overall** | Vote | Subsystem | Runtime | Logfile | Comment | |::|--:|:|::|:---:| | +0

[GitHub] [hadoop] hadoop-yetus commented on pull request #3135: YARN-10829. Support getApplications API in FederationClientInterceptor

hadoop-yetus commented on pull request #3135: URL: https://github.com/apache/hadoop/pull/3135#issuecomment-867156221 :confetti_ball: **+1 overall** | Vote | Subsystem | Runtime | Logfile | Comment | |::|--:|:|::|:---:| | +0

[jira] [Work logged] (HADOOP-17745) ADLS client can throw an IOException when it should throw an InterruptedIOException

[ https://issues.apache.org/jira/browse/HADOOP-17745?focusedWorklogId=614214=com.atlassian.jira.plugin.system.issuetabpanels:worklog-tabpanel#worklog-614214 ] ASF GitHub Bot logged work on HADOOP-17745: --- Author: ASF GitHub Bot

[GitHub] [hadoop] steveloughran commented on pull request #3076: HADOOP-17745. Wrap IOException with InterruptedException cause properly

steveloughran commented on pull request #3076: URL: https://github.com/apache/hadoop/pull/3076#issuecomment-867139175 > Hi @steveloughran, what tests should I run in order to make this change? all the abfs tests in hadoop-azure. Ideally with as many auth options as you can.

[jira] [Work logged] (HADOOP-17745) ADLS client can throw an IOException when it should throw an InterruptedIOException

[ https://issues.apache.org/jira/browse/HADOOP-17745?focusedWorklogId=614213=com.atlassian.jira.plugin.system.issuetabpanels:worklog-tabpanel#worklog-614213 ] ASF GitHub Bot logged work on HADOOP-17745: --- Author: ASF GitHub Bot

[GitHub] [hadoop] steveloughran commented on a change in pull request #3076: HADOOP-17745. Wrap IOException with InterruptedException cause properly

steveloughran commented on a change in pull request #3076: URL: https://github.com/apache/hadoop/pull/3076#discussion_r657439098 ## File path: hadoop-common-project/hadoop-common/src/test/java/org/apache/hadoop/io/TestIOUtilsWrapExceptionSuite.java ## @@ -0,0 +1,60 @@ +/** +

[GitHub] [hadoop] hadoop-yetus removed a comment on pull request #2971: MAPREDUCE-7341. Intermediate Manifest Committer

hadoop-yetus removed a comment on pull request #2971: URL: https://github.com/apache/hadoop/pull/2971#issuecomment-861003926 :broken_heart: **-1 overall** | Vote | Subsystem | Runtime | Logfile | Comment | |::|--:|:|::|:---:|

[GitHub] [hadoop] steveloughran commented on pull request #3133: S3AFS creation fails "Unable to find a region via the region provider chain."

steveloughran commented on pull request #3133: URL: https://github.com/apache/hadoop/pull/3133#issuecomment-867117923 Tests in progress, s3 london, endpoint and region unset, `-Dparallel-tests -DtestsThreadCount=7 -Dmarkers=keep` -- This is an automated message from the Apache Git

[GitHub] [hadoop] steveloughran commented on pull request #3133: S3AFS creation fails "Unable to find a region via the region provider chain."

steveloughran commented on pull request #3133: URL: https://github.com/apache/hadoop/pull/3133#issuecomment-867117275 Latest patch warns user on fallback, with the LogExactlyOnce class to stop it being over-noisy if someone really, really wants to use this "feature". Also the latest

[GitHub] [hadoop] hadoop-yetus removed a comment on pull request #3133: S3AFS creation fails "Unable to find a region via the region provider chain."

hadoop-yetus removed a comment on pull request #3133: URL: https://github.com/apache/hadoop/pull/3133#issuecomment-867078722 :broken_heart: **-1 overall** | Vote | Subsystem | Runtime | Logfile | Comment | |::|--:|:|::|:---:|

[jira] [Work logged] (HADOOP-17764) S3AInputStream read does not re-open the input stream on the second read retry attempt

[ https://issues.apache.org/jira/browse/HADOOP-17764?focusedWorklogId=614191=com.atlassian.jira.plugin.system.issuetabpanels:worklog-tabpanel#worklog-614191 ] ASF GitHub Bot logged work on HADOOP-17764: --- Author: ASF GitHub Bot

[GitHub] [hadoop] steveloughran commented on a change in pull request #3109: HADOOP-17764. S3AInputStream read does not re-open the input stream on the second read retry attempt

steveloughran commented on a change in pull request #3109: URL: https://github.com/apache/hadoop/pull/3109#discussion_r657412668 ## File path: hadoop-tools/hadoop-aws/src/test/java/org/apache/hadoop/fs/s3a/TestS3AInputStreamRetry.java ## @@ -0,0 +1,167 @@ +/* + * Licensed to

[jira] [Work logged] (HADOOP-17764) S3AInputStream read does not re-open the input stream on the second read retry attempt

[ https://issues.apache.org/jira/browse/HADOOP-17764?focusedWorklogId=614187=com.atlassian.jira.plugin.system.issuetabpanels:worklog-tabpanel#worklog-614187 ] ASF GitHub Bot logged work on HADOOP-17764: --- Author: ASF GitHub Bot

[GitHub] [hadoop] steveloughran commented on pull request #3109: HADOOP-17764. S3AInputStream read does not re-open the input stream on the second read retry attempt

steveloughran commented on pull request #3109: URL: https://github.com/apache/hadoop/pull/3109#issuecomment-867108247 Thanks for the detials. I agree, these are all unrelated. Some of them we've seen before and I'd say "you are distant from your S3 bucket/slow network/overloaded

[jira] [Work logged] (HADOOP-17767) ABFS: Improve test scripts

[ https://issues.apache.org/jira/browse/HADOOP-17767?focusedWorklogId=614183=com.atlassian.jira.plugin.system.issuetabpanels:worklog-tabpanel#worklog-614183 ] ASF GitHub Bot logged work on HADOOP-17767: --- Author: ASF GitHub Bot

[GitHub] [hadoop] hadoop-yetus commented on pull request #3124: HADOOP-17767. ABFS: Updates test scripts

hadoop-yetus commented on pull request #3124: URL: https://github.com/apache/hadoop/pull/3124#issuecomment-867094739 :confetti_ball: **+1 overall** | Vote | Subsystem | Runtime | Logfile | Comment | |::|--:|:|::|:---:| | +0

[GitHub] [hadoop] hadoop-yetus commented on pull request #3133: S3AFS creation fails "Unable to find a region via the region provider chain."

hadoop-yetus commented on pull request #3133: URL: https://github.com/apache/hadoop/pull/3133#issuecomment-867078722 :broken_heart: **-1 overall** | Vote | Subsystem | Runtime | Logfile | Comment | |::|--:|:|::|:---:| | +0

[GitHub] [hadoop] hadoop-yetus commented on pull request #3135: YARN-10829. Support getApplications API in FederationClientInterceptor

hadoop-yetus commented on pull request #3135: URL: https://github.com/apache/hadoop/pull/3135#issuecomment-867077320 :broken_heart: **-1 overall** | Vote | Subsystem | Runtime | Logfile | Comment | |::|--:|:|::|:---:| | +0

[GitHub] [hadoop] steveloughran commented on pull request #3133: S3AFS creation fails "Unable to find a region via the region provider chain."

steveloughran commented on pull request #3133: URL: https://github.com/apache/hadoop/pull/3133#issuecomment-867056184 Latest version does let you switch to the region resolution process if you really want to; this actually lets me do a test by setting sysprops to verify that the region is

[GitHub] [hadoop] hadoop-yetus removed a comment on pull request #3133: S3AFS creation fails "Unable to find a region via the region provider chain."

hadoop-yetus removed a comment on pull request #3133: URL: https://github.com/apache/hadoop/pull/3133#issuecomment-866939056 :broken_heart: **-1 overall** | Vote | Subsystem | Runtime | Logfile | Comment | |::|--:|:|::|:---:|

[GitHub] [hadoop] hadoop-yetus removed a comment on pull request #3133: S3AFS creation fails "Unable to find a region via the region provider chain."

hadoop-yetus removed a comment on pull request #3133: URL: https://github.com/apache/hadoop/pull/3133#issuecomment-865993418 :broken_heart: **-1 overall** | Vote | Subsystem | Runtime | Logfile | Comment | |::|--:|:|::|:---:|

[jira] [Updated] (HADOOP-17771) S3AFS creation fails "Unable to find a region via the region provider chain."

[ https://issues.apache.org/jira/browse/HADOOP-17771?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Steve Loughran updated HADOOP-17771: Description: If you don't have {{fs.s3a.endpoint}} set and lack a region set in env var

[jira] [Updated] (HADOOP-17771) S3AFS creation fails "Unable to find a region via the region provider chain."

[ https://issues.apache.org/jira/browse/HADOOP-17771?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Steve Loughran updated HADOOP-17771: Description: If you don't have {{fs.s3a.endpoint}} set and lack a region set in env var

[jira] [Commented] (HADOOP-17766) CI for Debian 10

[ https://issues.apache.org/jira/browse/HADOOP-17766?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17368349#comment-17368349 ] Íñigo Goiri commented on HADOOP-17766: -- [~gautham] thanks for the patch. Merged PR 3129 to trunk.

[jira] [Resolved] (HADOOP-17766) CI for Debian 10

[ https://issues.apache.org/jira/browse/HADOOP-17766?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Íñigo Goiri resolved HADOOP-17766. -- Fix Version/s: 3.4.0 Hadoop Flags: Reviewed Resolution: Fixed > CI for Debian 10

[jira] [Work logged] (HADOOP-17766) CI for Debian 10

[ https://issues.apache.org/jira/browse/HADOOP-17766?focusedWorklogId=614133=com.atlassian.jira.plugin.system.issuetabpanels:worklog-tabpanel#worklog-614133 ] ASF GitHub Bot logged work on HADOOP-17766: --- Author: ASF GitHub Bot

[GitHub] [hadoop] goiri merged pull request #3129: HADOOP-17766. CI for Debian 10

goiri merged pull request #3129: URL: https://github.com/apache/hadoop/pull/3129 -- This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use the URL above to go to the specific comment. For queries about this service, please

[GitHub] [hadoop] akshatb1 opened a new pull request #3135: YARN-10829. Support getApplications API in FederationClientInterceptor

akshatb1 opened a new pull request #3135: URL: https://github.com/apache/hadoop/pull/3135 Implementing getApplications API in FederationClientInterceptors -- This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use the

[jira] [Work logged] (HADOOP-17764) S3AInputStream read does not re-open the input stream on the second read retry attempt

[ https://issues.apache.org/jira/browse/HADOOP-17764?focusedWorklogId=614106=com.atlassian.jira.plugin.system.issuetabpanels:worklog-tabpanel#worklog-614106 ] ASF GitHub Bot logged work on HADOOP-17764: --- Author: ASF GitHub Bot

[GitHub] [hadoop] majdyz edited a comment on pull request #3109: HADOOP-17764. S3AInputStream read does not re-open the input stream on the second read retry attempt

majdyz edited a comment on pull request #3109: URL: https://github.com/apache/hadoop/pull/3109#issuecomment-866982708 Here are the failing tests: - org.apache.hadoop.tools.contract.AbstractContractDistCpTest#testDistCpWithIterator `org.junit.runners.model.TestTimedOutException:

[jira] [Work logged] (HADOOP-17764) S3AInputStream read does not re-open the input stream on the second read retry attempt

[ https://issues.apache.org/jira/browse/HADOOP-17764?focusedWorklogId=614105=com.atlassian.jira.plugin.system.issuetabpanels:worklog-tabpanel#worklog-614105 ] ASF GitHub Bot logged work on HADOOP-17764: --- Author: ASF GitHub Bot

[GitHub] [hadoop] majdyz commented on pull request #3109: HADOOP-17764. S3AInputStream read does not re-open the input stream on the second read retry attempt

majdyz commented on pull request #3109: URL: https://github.com/apache/hadoop/pull/3109#issuecomment-866982708 Here are the failing tests: - org.apache.hadoop.tools.contract.AbstractContractDistCpTest#testDistCpWithIterator `org.junit.runners.model.TestTimedOutException: test

[jira] [Commented] (HADOOP-17772) ABFS: delete() should have timeout option

[ https://issues.apache.org/jira/browse/HADOOP-17772?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17368301#comment-17368301 ] Zhuangyu Han commented on HADOOP-17772: --- We are using wasbs:// URL > ABFS: delete() should have

[jira] [Work logged] (HADOOP-17771) S3AFS creation fails "Unable to find a region via the region provider chain."

[ https://issues.apache.org/jira/browse/HADOOP-17771?focusedWorklogId=614071=com.atlassian.jira.plugin.system.issuetabpanels:worklog-tabpanel#worklog-614071 ] ASF GitHub Bot logged work on HADOOP-17771: --- Author: ASF GitHub Bot

[GitHub] [hadoop] hadoop-yetus commented on pull request #3133: HADOOP-17771. S3AFS creation fails without region set in ~/.aws/config.

hadoop-yetus commented on pull request #3133: URL: https://github.com/apache/hadoop/pull/3133#issuecomment-866939056 :broken_heart: **-1 overall** | Vote | Subsystem | Runtime | Logfile | Comment | |::|--:|:|::|:---:| | +0

[jira] [Commented] (HADOOP-16128) Some S3A tests leak filesystem instances

[ https://issues.apache.org/jira/browse/HADOOP-16128?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17368277#comment-17368277 ] Amit Chavan commented on HADOOP-16128: --- [~ste...@apache.org]  [~bogthe]  If no one is working on

[GitHub] [hadoop] goiri commented on a change in pull request #3086: HDFS-16039. RBF: Some indicators of RBFMetrics count inaccurately

goiri commented on a change in pull request #3086: URL: https://github.com/apache/hadoop/pull/3086#discussion_r657203156 ## File path: hadoop-hdfs-project/hadoop-hdfs-rbf/src/test/java/org/apache/hadoop/hdfs/server/federation/metrics/TestRBFMetrics.java ## @@ -382,4 +366,56

[GitHub] [hadoop] tomscut commented on pull request #3134: HDFS-16085. Move the getPermissionChecker out of the read lock

tomscut commented on pull request #3134: URL: https://github.com/apache/hadoop/pull/3134#issuecomment-866913600 > +1 Thanks @ayushtkn for your review. -- This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use the URL

[jira] [Work logged] (HADOOP-17769) Upgrade JUnit to 4.13.2

[ https://issues.apache.org/jira/browse/HADOOP-17769?focusedWorklogId=614047=com.atlassian.jira.plugin.system.issuetabpanels:worklog-tabpanel#worklog-614047 ] ASF GitHub Bot logged work on HADOOP-17769: --- Author: ASF GitHub Bot

[GitHub] [hadoop] ayushtkn commented on pull request #3130: HADOOP-17769. Upgrade JUnit to 4.13.2. fixes TestBlockRecovery

ayushtkn commented on pull request #3130: URL: https://github.com/apache/hadoop/pull/3130#issuecomment-866895116 Thanx for the update. Will push once the build completes. -- This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and

[jira] [Work logged] (HADOOP-17769) Upgrade JUnit to 4.13.2

[ https://issues.apache.org/jira/browse/HADOOP-17769?focusedWorklogId=614045=com.atlassian.jira.plugin.system.issuetabpanels:worklog-tabpanel#worklog-614045 ] ASF GitHub Bot logged work on HADOOP-17769: --- Author: ASF GitHub Bot

[jira] [Work logged] (HADOOP-17769) Upgrade JUnit to 4.13.2

[ https://issues.apache.org/jira/browse/HADOOP-17769?focusedWorklogId=614044=com.atlassian.jira.plugin.system.issuetabpanels:worklog-tabpanel#worklog-614044 ] ASF GitHub Bot logged work on HADOOP-17769: --- Author: ASF GitHub Bot

[GitHub] [hadoop] ayushtkn commented on pull request #3131: HADOOP-17769. Upgrade JUnit to 4.13.2. fixes TestBlockRecovery

ayushtkn commented on pull request #3131: URL: https://github.com/apache/hadoop/pull/3131#issuecomment-866893518 Merged. Thanx Everyone!!! -- This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use the URL above to go to the

[GitHub] [hadoop] ayushtkn merged pull request #3131: HADOOP-17769. Upgrade JUnit to 4.13.2. fixes TestBlockRecovery

ayushtkn merged pull request #3131: URL: https://github.com/apache/hadoop/pull/3131 -- This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use the URL above to go to the specific comment. For queries about this service,

[jira] [Work logged] (HADOOP-17769) Upgrade JUnit to 4.13.2

[ https://issues.apache.org/jira/browse/HADOOP-17769?focusedWorklogId=614041=com.atlassian.jira.plugin.system.issuetabpanels:worklog-tabpanel#worklog-614041 ] ASF GitHub Bot logged work on HADOOP-17769: --- Author: ASF GitHub Bot

[GitHub] [hadoop] amahussein commented on pull request #3131: HADOOP-17769. Upgrade JUnit to 4.13.2. fixes TestBlockRecovery

amahussein commented on pull request #3131: URL: https://github.com/apache/hadoop/pull/3131#issuecomment-866871531 Thanks @jojochuang , @aajisaka , @ayushtkn and @ferhui for the reviews and feedback. This PR is ready to be merged. -- This is an automated message from the Apache Git

[jira] [Work logged] (HADOOP-17769) Upgrade JUnit to 4.13.2

[ https://issues.apache.org/jira/browse/HADOOP-17769?focusedWorklogId=614040=com.atlassian.jira.plugin.system.issuetabpanels:worklog-tabpanel#worklog-614040 ] ASF GitHub Bot logged work on HADOOP-17769: --- Author: ASF GitHub Bot

[GitHub] [hadoop] amahussein commented on pull request #3130: HADOOP-17769. Upgrade JUnit to 4.13.2. fixes TestBlockRecovery

amahussein commented on pull request #3130: URL: https://github.com/apache/hadoop/pull/3130#issuecomment-866864214 > @amahussein can you update this file, as suggested on 2.10 PR > https://github.com/apache/hadoop/blob/10b79a26fe0677b266acf237e8458e93743424a6/LICENSE-binary#L505

[jira] [Issue Comment Deleted] (HADOOP-16963) HADOOP-16582 changed mkdirs() behavior

[ https://issues.apache.org/jira/browse/HADOOP-16963?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] David Mollitor updated HADOOP-16963: Comment: was deleted (was: Can you please provide (and link) the corresponding Hive

[jira] [Commented] (HADOOP-16963) HADOOP-16582 changed mkdirs() behavior

[ https://issues.apache.org/jira/browse/HADOOP-16963?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17368118#comment-17368118 ] David Mollitor commented on HADOOP-16963: - Can you please provide (and link) the corresponding

[jira] [Updated] (HADOOP-17771) S3AFS creation fails

[ https://issues.apache.org/jira/browse/HADOOP-17771?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Steve Loughran updated HADOOP-17771: Summary: S3AFS creation fails (was: S3AFS creation fails without region set in

[jira] [Updated] (HADOOP-17771) S3AFS creation fails "Unable to find a region via the region provider chain."

[ https://issues.apache.org/jira/browse/HADOOP-17771?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Steve Loughran updated HADOOP-17771: Summary: S3AFS creation fails "Unable to find a region via the region provider chain."

[jira] [Updated] (HADOOP-17771) S3AFS creation fails without region set in ~/.aws/config

[ https://issues.apache.org/jira/browse/HADOOP-17771?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Steve Loughran updated HADOOP-17771: Environment: * fs.s3a.endpoint is unset * Host outside EC2 * without the file

[jira] [Updated] (HADOOP-17771) S3AFS creation fails without region set in ~/.aws/config

[ https://issues.apache.org/jira/browse/HADOOP-17771?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Steve Loughran updated HADOOP-17771: Environment: * Host outside EC2 * without the file ~/.aws/config or without a region set

[GitHub] [hadoop] iwasakims edited a comment on pull request #3128: YARN-10826. [UI2] Upgrade Node.js to v12.22.1.

iwasakims edited a comment on pull request #3128: URL: https://github.com/apache/hadoop/pull/3128#issuecomment-866790669 I will cherry-pick this to branch-3.3 and branch-3.2 after testing. -- This is an automated message from the Apache Git Service. To respond to the message, please log

[GitHub] [hadoop] iwasakims commented on pull request #3128: YARN-10826. [UI2] Upgrade Node.js to v12.22.1.

iwasakims commented on pull request #3128: URL: https://github.com/apache/hadoop/pull/3128#issuecomment-866790669 I will backport this to branch-3.3 and branch-3.2 after testing. -- This is an automated message from the Apache Git Service. To respond to the message, please log on to

[jira] [Commented] (HADOOP-17772) ABFS: delete() should have timeout option

[ https://issues.apache.org/jira/browse/HADOOP-17772?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17368078#comment-17368078 ] Steve Loughran commented on HADOOP-17772: - abfs is timing out for a deep tree delete in

[jira] [Updated] (HADOOP-17772) ABFS: delete() should have timeout option

[ https://issues.apache.org/jira/browse/HADOOP-17772?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Steve Loughran updated HADOOP-17772: Parent: HADOOP-17736 Issue Type: Sub-task (was: Improvement) > ABFS: delete()

[jira] [Resolved] (HADOOP-15763) Über-JIRA: abfs phase II: Hadoop 3.3 features & fixes

[ https://issues.apache.org/jira/browse/HADOOP-15763?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Steve Loughran resolved HADOOP-15763. - Fix Version/s: 3.3.1 Resolution: Fixed > Über-JIRA: abfs phase II: Hadoop 3.3

[jira] [Commented] (HADOOP-16458) LocatedFileStatusFetcher scans failing intermittently against S3 store

[ https://issues.apache.org/jira/browse/HADOOP-16458?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17368077#comment-17368077 ] Steve Loughran commented on HADOOP-16458: - hmm. Given the purpose of that change was to make

[jira] [Updated] (HADOOP-17774) bytesRead FS statistic showing twice the correct value in S3A

[ https://issues.apache.org/jira/browse/HADOOP-17774?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Steve Loughran updated HADOOP-17774: Parent: HADOOP-17566 Issue Type: Sub-task (was: Bug) > bytesRead FS statistic

[jira] [Work logged] (HADOOP-17290) ABFS: Add Identifiers to Client Request Header

[ https://issues.apache.org/jira/browse/HADOOP-17290?focusedWorklogId=613963=com.atlassian.jira.plugin.system.issuetabpanels:worklog-tabpanel#worklog-613963 ] ASF GitHub Bot logged work on HADOOP-17290: --- Author: ASF GitHub Bot

[GitHub] [hadoop] hadoop-yetus commented on pull request #2520: HADOOP-17290. ABFS: Add Identifiers to Client Request Header

hadoop-yetus commented on pull request #2520: URL: https://github.com/apache/hadoop/pull/2520#issuecomment-866736669 :confetti_ball: **+1 overall** | Vote | Subsystem | Runtime | Logfile | Comment | |::|--:|:|::|:---:| | +0

[jira] [Work logged] (HADOOP-17749) Remove lock contention in SelectorPool of SocketIOWithTimeout

[ https://issues.apache.org/jira/browse/HADOOP-17749?focusedWorklogId=613951=com.atlassian.jira.plugin.system.issuetabpanels:worklog-tabpanel#worklog-613951 ] ASF GitHub Bot logged work on HADOOP-17749: --- Author: ASF GitHub Bot

[GitHub] [hadoop] hadoop-yetus commented on pull request #3080: HADOOP-17749. Remove lock contention in SelectorPool of SocketIOWithTimeout

hadoop-yetus commented on pull request #3080: URL: https://github.com/apache/hadoop/pull/3080#issuecomment-866728745 :broken_heart: **-1 overall** | Vote | Subsystem | Runtime | Logfile | Comment | |::|--:|:|::|:---:| | +0

[GitHub] [hadoop] iwasakims commented on pull request #3128: YARN-10826. [UI2] Upgrade Node.js to v12.22.1.

iwasakims commented on pull request #3128: URL: https://github.com/apache/hadoop/pull/3128#issuecomment-866725556 Thanks, @aajisaka. I updated the commit message and issue title. -- This is an automated message from the Apache Git Service. To respond to the message, please log on to

[GitHub] [hadoop] iwasakims merged pull request #3128: YARN-10826. [UI2] Upgrade Node.js to at least 12.x.

iwasakims merged pull request #3128: URL: https://github.com/apache/hadoop/pull/3128 -- This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use the URL above to go to the specific comment. For queries about this service,

[jira] [Created] (HADOOP-17774) bytesRead FS statistic showing twice the correct value in S3A

Mehakmeet Singh created HADOOP-17774: Summary: bytesRead FS statistic showing twice the correct value in S3A Key: HADOOP-17774 URL: https://issues.apache.org/jira/browse/HADOOP-17774 Project:

[jira] [Work logged] (HADOOP-17771) S3AFS creation fails without region set in ~/.aws/config

[ https://issues.apache.org/jira/browse/HADOOP-17771?focusedWorklogId=613930=com.atlassian.jira.plugin.system.issuetabpanels:worklog-tabpanel#worklog-613930 ] ASF GitHub Bot logged work on HADOOP-17771: --- Author: ASF GitHub Bot

[GitHub] [hadoop] steveloughran commented on a change in pull request #3133: HADOOP-17771. S3AFS creation fails without region set in ~/.aws/config.

steveloughran commented on a change in pull request #3133: URL: https://github.com/apache/hadoop/pull/3133#discussion_r656942766 ## File path: hadoop-tools/hadoop-aws/src/main/java/org/apache/hadoop/fs/s3a/DefaultS3ClientFactory.java ## @@ -141,6 +142,10 @@ protected AmazonS3

[jira] [Work logged] (HADOOP-17771) S3AFS creation fails without region set in ~/.aws/config

[ https://issues.apache.org/jira/browse/HADOOP-17771?focusedWorklogId=613923=com.atlassian.jira.plugin.system.issuetabpanels:worklog-tabpanel#worklog-613923 ] ASF GitHub Bot logged work on HADOOP-17771: --- Author: ASF GitHub Bot

[GitHub] [hadoop] steveloughran commented on pull request #3133: HADOOP-17771. S3AFS creation fails without region set in ~/.aws/config.

steveloughran commented on pull request #3133: URL: https://github.com/apache/hadoop/pull/3133#issuecomment-866696567 + maybe I could test this by setting the sysprop `aws.region` to something invalid. If the region resolution is going through the chain then this would get picked up ahead

[jira] [Work logged] (HADOOP-17771) S3AFS creation fails without region set in ~/.aws/config

[ https://issues.apache.org/jira/browse/HADOOP-17771?focusedWorklogId=613921=com.atlassian.jira.plugin.system.issuetabpanels:worklog-tabpanel#worklog-613921 ] ASF GitHub Bot logged work on HADOOP-17771: --- Author: ASF GitHub Bot

[GitHub] [hadoop] steveloughran commented on pull request #3133: HADOOP-17771. S3AFS creation fails without region set in ~/.aws/config.

steveloughran commented on pull request #3133: URL: https://github.com/apache/hadoop/pull/3133#issuecomment-866694906 One thought here: would you ever want the s3a connector to fall back to that bundled region lookup sequence? I'm wondering in particular if it makes a difference in

[GitHub] [hadoop] tomscut commented on pull request #3117: HDFS-16076. Avoid using slow DataNodes for reading by sorting locations

tomscut commented on pull request #3117: URL: https://github.com/apache/hadoop/pull/3117#issuecomment-866681953 Thanks @tasanuma for your second review. These failed UTs work fine locally. -- This is an automated message from the Apache Git Service. To respond to the message, please log

[GitHub] [hadoop] aajisaka commented on pull request #3128: YARN-10826. [UI2] Upgrade Node.js to at least 12.x.

aajisaka commented on pull request #3128: URL: https://github.com/apache/hadoop/pull/3128#issuecomment-866659346 Thank you @iwasakims When committing, it's better to include the exact version in the commit message instead of "at least 12.x". -- This is an automated message from the

[GitHub] [hadoop] hadoop-yetus commented on pull request #3117: HDFS-16076. Avoid using slow DataNodes for reading by sorting locations

hadoop-yetus commented on pull request #3117: URL: https://github.com/apache/hadoop/pull/3117#issuecomment-866649231 :broken_heart: **-1 overall** | Vote | Subsystem | Runtime | Logfile | Comment | |::|--:|:|::|:---:| | +0

[jira] [Work logged] (HADOOP-17749) Remove lock contention in SelectorPool of SocketIOWithTimeout

[ https://issues.apache.org/jira/browse/HADOOP-17749?focusedWorklogId=613844=com.atlassian.jira.plugin.system.issuetabpanels:worklog-tabpanel#worklog-613844 ] ASF GitHub Bot logged work on HADOOP-17749: --- Author: ASF GitHub Bot

[GitHub] [hadoop] liangxs commented on a change in pull request #3080: HADOOP-17749. Remove lock contention in SelectorPool of SocketIOWithTimeout

liangxs commented on a change in pull request #3080: URL: https://github.com/apache/hadoop/pull/3080#discussion_r656829433 ## File path: hadoop-common-project/hadoop-common/src/main/java/org/apache/hadoop/net/SocketIOWithTimeout.java ## @@ -426,34 +407,44 @@ private

[GitHub] [hadoop] tomscut commented on pull request #3134: HDFS-16085. Move the getPermissionChecker out of the read lock

tomscut commented on pull request #3134: URL: https://github.com/apache/hadoop/pull/3134#issuecomment-866596347 Hi @tasanuma @jojochuang @Hexiaoqiao , could you please take a look. Thanks. -- This is an automated message from the Apache Git Service. To respond to the message, please log

[GitHub] [hadoop] hadoop-yetus commented on pull request #3134: HDFS-16085. Move the getPermissionChecker out of the read lock

hadoop-yetus commented on pull request #3134: URL: https://github.com/apache/hadoop/pull/3134#issuecomment-866592953 :broken_heart: **-1 overall** | Vote | Subsystem | Runtime | Logfile | Comment | |::|--:|:|::|:---:| | +0

[jira] [Work logged] (HADOOP-17714) ABFS: testBlobBackCompatibility, testRandomRead & WasbAbfsCompatibility tests fail when triggered with default configs

[ https://issues.apache.org/jira/browse/HADOOP-17714?focusedWorklogId=613834=com.atlassian.jira.plugin.system.issuetabpanels:worklog-tabpanel#worklog-613834 ] ASF GitHub Bot logged work on HADOOP-17714: --- Author: ASF GitHub Bot

[GitHub] [hadoop] snehavarma edited a comment on pull request #3126: HADOOP-17714 ABFS: testBlobBackCompatibility, testRandomRead & WasbAb…

snehavarma edited a comment on pull request #3126: URL: https://github.com/apache/hadoop/pull/3126#issuecomment-866589147 Test Results: Regions: FNS account - Eastus & HNS account-Eastus2euap HNS-OAuth Results: Tests run: 98, Failures: 0,

[jira] [Work logged] (HADOOP-17714) ABFS: testBlobBackCompatibility, testRandomRead & WasbAbfsCompatibility tests fail when triggered with default configs

[ https://issues.apache.org/jira/browse/HADOOP-17714?focusedWorklogId=613833=com.atlassian.jira.plugin.system.issuetabpanels:worklog-tabpanel#worklog-613833 ] ASF GitHub Bot logged work on HADOOP-17714: --- Author: ASF GitHub Bot

[GitHub] [hadoop] snehavarma commented on pull request #3126: HADOOP-17714 ABFS: testBlobBackCompatibility, testRandomRead & WasbAb…

snehavarma commented on pull request #3126: URL: https://github.com/apache/hadoop/pull/3126#issuecomment-866589147 HNS-OAuth Results: Tests run: 98, Failures: 0, Errors: 0, Skipped: 0 Results: Errors:

[jira] [Comment Edited] (HADOOP-15327) Upgrade MR ShuffleHandler to use Netty4

[ https://issues.apache.org/jira/browse/HADOOP-15327?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17367912#comment-17367912 ] Szilard Nemeth edited comment on HADOOP-15327 at 6/23/21, 7:00 AM: ---

[jira] [Commented] (HADOOP-15327) Upgrade MR ShuffleHandler to use Netty4

[ https://issues.apache.org/jira/browse/HADOOP-15327?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17367912#comment-17367912 ] Szilard Nemeth commented on HADOOP-15327: - Hey [~weichiu], Thanks for putting the exceprt here.

[jira] [Assigned] (HADOOP-17139) Re-enable optimized copyFromLocal implementation in S3AFileSystem

[ https://issues.apache.org/jira/browse/HADOOP-17139?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Bogdan Stolojan reassigned HADOOP-17139: Assignee: Bogdan Stolojan > Re-enable optimized copyFromLocal implementation in

  1   2   >