[jira] [Updated] (HADOOP-18865) ABFS: Adding 100 continue in userAgent String and dynamically removing it if retry is without the header enabled.

[ https://issues.apache.org/jira/browse/HADOOP-18865?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Steve Loughran updated HADOOP-18865: Fix Version/s: 3.4.0 (was: 3.3.6) > ABFS: Adding 100 continue in

[jira] [Resolved] (HADOOP-18328) S3A supports S3 on Outposts

[ https://issues.apache.org/jira/browse/HADOOP-18328?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Steve Loughran resolved HADOOP-18328. - Fix Version/s: 3.3.9 Resolution: Fixed > S3A supports S3 on Outposts >

[jira] [Commented] (HADOOP-18073) Upgrade AWS SDK to v2

[ https://issues.apache.org/jira/browse/HADOOP-18073?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17760880#comment-17760880 ] Steve Loughran commented on HADOOP-18073: - HBASE-28056 is needed to fix hboss fs test code

[jira] [Updated] (HADOOP-18752) Change fs.s3a.directory.marker.retention to "keep"

[ https://issues.apache.org/jira/browse/HADOOP-18752?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Steve Loughran updated HADOOP-18752: Release Note: The s3a connector no longer deletes directory markers by default, which

[jira] [Commented] (HADOOP-18856) Spark insertInto with location GCS bucket root not supported

[ https://issues.apache.org/jira/browse/HADOOP-18856?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17760551#comment-17760551 ] Steve Loughran commented on HADOOP-18856: - i'm declaring the hadoop part of this done. raising

[jira] [Updated] (HADOOP-18856) Spark insertInto with location GCS bucket root not supported

[ https://issues.apache.org/jira/browse/HADOOP-18856?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Steve Loughran updated HADOOP-18856: Priority: Minor (was: Critical) > Spark insertInto with location GCS bucket root not

[jira] [Commented] (HADOOP-18873) ABFS: AbfsOutputStream doesnt close DataBlocks object.

[ https://issues.apache.org/jira/browse/HADOOP-18873?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17760540#comment-17760540 ] Steve Loughran commented on HADOOP-18873: - yeah, this seems serious +[~mehakmeet] > ABFS:

[jira] [Commented] (HADOOP-18871) S3ARetryPolicy to use sdk exception retryable() if it is valid

[ https://issues.apache.org/jira/browse/HADOOP-18871?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17760019#comment-17760019 ] Steve Loughran commented on HADOOP-18871: - +review S3AUtils.isMessageTranslatableToEOF() to see

[jira] [Created] (HADOOP-18871) S3ARetryPolicy to use sdk exception retryable() if it is valid

Steve Loughran created HADOOP-18871: --- Summary: S3ARetryPolicy to use sdk exception retryable() if it is valid Key: HADOOP-18871 URL: https://issues.apache.org/jira/browse/HADOOP-18871 Project:

[jira] [Updated] (HADOOP-18862) [JDK17] MiniYarnClusters don't launch in hadoop-aws integration tests

[ https://issues.apache.org/jira/browse/HADOOP-18862?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Steve Loughran updated HADOOP-18862: Parent Issue: HADOOP-17177 (was: HADOOP-16795) > [JDK17] MiniYarnClusters don't launch

[jira] [Commented] (HADOOP-18747) AWS SDK V2 - sigv2 support

[ https://issues.apache.org/jira/browse/HADOOP-18747?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17760008#comment-17760008 ] Steve Loughran commented on HADOOP-18747: - pending/without this, HADOOP-18857 proposes failing

[jira] [Commented] (HADOOP-18749) AWS SDK V2 - ITestS3AHugeFilesNoMultipart failure

[ https://issues.apache.org/jira/browse/HADOOP-18749?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17760006#comment-17760006 ] Steve Loughran commented on HADOOP-18749: - this is from HADOOP-18863; fix that and this test

[jira] [Resolved] (HADOOP-18749) AWS SDK V2 - ITestS3AHugeFilesNoMultipart failure

[ https://issues.apache.org/jira/browse/HADOOP-18749?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Steve Loughran resolved HADOOP-18749. - Fix Version/s: 3.4.0 Resolution: Duplicate > AWS SDK V2 -

[jira] [Assigned] (HADOOP-18749) AWS SDK V2 - ITestS3AHugeFilesNoMultipart failure

[ https://issues.apache.org/jira/browse/HADOOP-18749?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Steve Loughran reassigned HADOOP-18749: --- Assignee: Steve Loughran > AWS SDK V2 - ITestS3AHugeFilesNoMultipart failure >

[jira] [Commented] (HADOOP-18860) Upgrade mockito to 4.11.0

[ https://issues.apache.org/jira/browse/HADOOP-18860?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17759919#comment-17759919 ] Steve Loughran commented on HADOOP-18860: - merged to trunk, will backport. apologies to

[jira] [Updated] (HADOOP-18860) Upgrade mockito to 4.11.0

[ https://issues.apache.org/jira/browse/HADOOP-18860?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Steve Loughran updated HADOOP-18860: Component/s: test > Upgrade mockito to 4.11.0 > - > >

[jira] [Updated] (HADOOP-18860) Upgrade mockito to 4.11.0

[ https://issues.apache.org/jira/browse/HADOOP-18860?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Steve Loughran updated HADOOP-18860: Fix Version/s: 3.4.0 > Upgrade mockito to 4.11.0 > - > >

[jira] [Commented] (HADOOP-18797) S3A committer fix lost data on concurrent jobs

[ https://issues.apache.org/jira/browse/HADOOP-18797?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17759904#comment-17759904 ] Steve Loughran commented on HADOOP-18797: - oh, except one complication. currently the "__magic"

[jira] [Commented] (HADOOP-18797) S3A committer fix lost data on concurrent jobs

[ https://issues.apache.org/jira/browse/HADOOP-18797?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17759656#comment-17759656 ] Steve Loughran commented on HADOOP-18797: - #3 looks good. this would be good simple change for

[jira] [Assigned] (HADOOP-18863) AWS SDK V2 - AuditFailureExceptions aren't being translated properly

[ https://issues.apache.org/jira/browse/HADOOP-18863?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Steve Loughran reassigned HADOOP-18863: --- Assignee: Steve Loughran > AWS SDK V2 - AuditFailureExceptions aren't being

[jira] [Updated] (HADOOP-18863) AWS SDK V2 - AuditFailureExceptions aren't being translated properly

[ https://issues.apache.org/jira/browse/HADOOP-18863?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Steve Loughran updated HADOOP-18863: Description: {{ITestS3AHugeFilesNoMultipart}} is failing because the

[jira] [Updated] (HADOOP-18867) Upgrade ZooKeeper to 3.6.4

[ https://issues.apache.org/jira/browse/HADOOP-18867?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Steve Loughran updated HADOOP-18867: Affects Version/s: 3.3.6 > Upgrade ZooKeeper to 3.6.4 > -- > >

[jira] [Updated] (HADOOP-18867) Upgrade ZooKeeper to 3.6.4

[ https://issues.apache.org/jira/browse/HADOOP-18867?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Steve Loughran updated HADOOP-18867: Component/s: build > Upgrade ZooKeeper to 3.6.4 > -- > >

[jira] [Commented] (HADOOP-18842) Support Overwrite Directory On Commit For S3A Committers

[ https://issues.apache.org/jira/browse/HADOOP-18842?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17759383#comment-17759383 ] Steve Loughran commented on HADOOP-18842: - Update: no, trying to be dynamic is just over

[jira] [Commented] (HADOOP-18797) S3A committer fix lost data on concurrent jobs

[ https://issues.apache.org/jira/browse/HADOOP-18797?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17759382#comment-17759382 ] Steve Loughran commented on HADOOP-18797: - +[~srahman] -thoughts? > S3A committer fix lost

[jira] [Commented] (HADOOP-18679) Add API for bulk/paged object deletion

[ https://issues.apache.org/jira/browse/HADOOP-18679?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17759269#comment-17759269 ] Steve Loughran commented on HADOOP-18679: - Done a first pass at an API in a PR: no actual time

[jira] [Commented] (HADOOP-18842) Support Overwrite Directory On Commit For S3A Committers

[ https://issues.apache.org/jira/browse/HADOOP-18842?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17759123#comment-17759123 ] Steve Loughran commented on HADOOP-18842: - ok, so you are proposing we split the output files

[jira] [Updated] (HADOOP-18797) S3A committer fix lost data on concurrent jobs

[ https://issues.apache.org/jira/browse/HADOOP-18797?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Steve Loughran updated HADOOP-18797: Affects Version/s: 3.3.6 > S3A committer fix lost data on concurrent jobs >

[jira] [Commented] (HADOOP-18797) S3A committer fix lost data on concurrent jobs

[ https://issues.apache.org/jira/browse/HADOOP-18797?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17759118#comment-17759118 ] Steve Loughran commented on HADOOP-18797: - bq. unning multiple jobs writing into the same dir

[jira] [Commented] (HADOOP-18866) Refactor @Test(expected) with assertThrows

[ https://issues.apache.org/jira/browse/HADOOP-18866?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17759117#comment-17759117 ] Steve Loughran commented on HADOOP-18866: - because they are existing tests, they find

[jira] [Assigned] (HADOOP-18842) Support Overwrite Directory On Commit For S3A Committers

[ https://issues.apache.org/jira/browse/HADOOP-18842?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Steve Loughran reassigned HADOOP-18842: --- Assignee: Syed Shameerur Rahman > Support Overwrite Directory On Commit For S3A

[jira] [Updated] (HADOOP-18842) Support Overwrite Directory On Commit For S3A Committers

[ https://issues.apache.org/jira/browse/HADOOP-18842?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Steve Loughran updated HADOOP-18842: Parent: HADOOP-18477 Issue Type: Sub-task (was: New Feature) > Support

[jira] [Assigned] (HADOOP-18818) Merge aws v2 upgrade feature branch into trunk

[ https://issues.apache.org/jira/browse/HADOOP-18818?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Steve Loughran reassigned HADOOP-18818: --- Assignee: Steve Loughran > Merge aws v2 upgrade feature branch into trunk >

[jira] [Resolved] (HADOOP-18742) AWS v2 SDK: stabilise dependencies with rest of hadoop libraries

[ https://issues.apache.org/jira/browse/HADOOP-18742?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Steve Loughran resolved HADOOP-18742. - Resolution: Not A Problem > AWS v2 SDK: stabilise dependencies with rest of hadoop

[jira] [Commented] (HADOOP-16842) abfs can't access storage account if soft delete is enabled

[ https://issues.apache.org/jira/browse/HADOOP-16842?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17758456#comment-17758456 ] Steve Loughran commented on HADOOP-16842: - you are asking questions about azure storage itself;

[jira] [Commented] (HADOOP-18860) Upgrade mockito to 4.11.0

[ https://issues.apache.org/jira/browse/HADOOP-18860?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17758168#comment-17758168 ] Steve Loughran commented on HADOOP-18860: - this is needed for HADOOP-17377; the initial PR

[jira] [Updated] (HADOOP-18860) Upgrade mockito to 4.11.0

[ https://issues.apache.org/jira/browse/HADOOP-18860?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Steve Loughran updated HADOOP-18860: Issue Type: Improvement (was: Task) > Upgrade mockito to 4.11.0 >

[jira] [Updated] (HADOOP-18860) Upgrade mockito to 4.11.0

[ https://issues.apache.org/jira/browse/HADOOP-18860?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Steve Loughran updated HADOOP-18860: Affects Version/s: 3.3.6 > Upgrade mockito to 4.11.0 > - > >

[jira] [Updated] (HADOOP-18860) Upgrade mockito to 4.11.0

[ https://issues.apache.org/jira/browse/HADOOP-18860?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Steve Loughran updated HADOOP-18860: Component/s: build > Upgrade mockito to 4.11.0 > - > >

[jira] [Updated] (HADOOP-18860) Upgrade mockito to 4.11.0

[ https://issues.apache.org/jira/browse/HADOOP-18860?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Steve Loughran updated HADOOP-18860: Priority: Major (was: Minor) > Upgrade mockito to 4.11.0 > - >

[jira] [Commented] (HADOOP-18863) AWS SDK V2 - AuditFailureExceptions aren't being translated properly

[ https://issues.apache.org/jira/browse/HADOOP-18863?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17758094#comment-17758094 ] Steve Loughran commented on HADOOP-18863: - run with args -Dtest=moo -Dprefetch -Dscale

[jira] [Resolved] (HADOOP-18853) AWS SDK V2 - Upgrade SDK to 2.20.28 and restores multipart copy

[ https://issues.apache.org/jira/browse/HADOOP-18853?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Steve Loughran resolved HADOOP-18853. - Fix Version/s: 3.4.0 Resolution: Fixed > AWS SDK V2 - Upgrade SDK to 2.20.28

[jira] [Resolved] (HADOOP-18859) AWS SDK v2 typo in aws.evenstream.version

[ https://issues.apache.org/jira/browse/HADOOP-18859?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Steve Loughran resolved HADOOP-18859. - Fix Version/s: 3.4.0 Assignee: Ahmar Suhail Resolution: Duplicate >

[jira] [Commented] (HADOOP-18853) AWS SDK V2 - Upgrade SDK to 2.20.28 and restores multipart copy

[ https://issues.apache.org/jira/browse/HADOOP-18853?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17758093#comment-17758093 ] Steve Loughran commented on HADOOP-18853: - scale tests show that the multipart copy exception

[jira] [Created] (HADOOP-18863) AWS SDK V2 - AuditFailureExceptions aren't being translated properly

Steve Loughran created HADOOP-18863: --- Summary: AWS SDK V2 - AuditFailureExceptions aren't being translated properly Key: HADOOP-18863 URL: https://issues.apache.org/jira/browse/HADOOP-18863

[jira] [Commented] (HADOOP-18328) S3A supports S3 on Outposts

[ https://issues.apache.org/jira/browse/HADOOP-18328?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17757964#comment-17757964 ] Steve Loughran commented on HADOOP-18328: - code fix is in trunk; once the doc pr is in i will

[jira] [Updated] (HADOOP-18328) S3A supports S3 on Outposts

[ https://issues.apache.org/jira/browse/HADOOP-18328?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Steve Loughran updated HADOOP-18328: Fix Version/s: 3.4.0 > S3A supports S3 on Outposts > --- > >

[jira] [Assigned] (HADOOP-18328) S3A supports S3 on Outposts

[ https://issues.apache.org/jira/browse/HADOOP-18328?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Steve Loughran reassigned HADOOP-18328: --- Assignee: Sotetsu Suzugamine > S3A supports S3 on Outposts >

[jira] [Commented] (HADOOP-14269) [JDK11] Create module-info.java for each module

[ https://issues.apache.org/jira/browse/HADOOP-14269?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17757959#comment-17757959 ] Steve Loughran commented on HADOOP-14269: - going to add that multiversion jars are inevitably a

[jira] [Updated] (HADOOP-14269) [JDK11] Create module-info.java for each module

[ https://issues.apache.org/jira/browse/HADOOP-14269?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Steve Loughran updated HADOOP-14269: Summary: [JDK11] Create module-info.java for each module (was: Create module-info.java

[jira] [Created] (HADOOP-18862) [JDK17] MiniYarnClusters don't launch in hadoop-aws integration tests

Steve Loughran created HADOOP-18862: --- Summary: [JDK17] MiniYarnClusters don't launch in hadoop-aws integration tests Key: HADOOP-18862 URL: https://issues.apache.org/jira/browse/HADOOP-18862

[jira] [Resolved] (HADOOP-18741) AWS SDK v2 code tuning

[ https://issues.apache.org/jira/browse/HADOOP-18741?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Steve Loughran resolved HADOOP-18741. - Assignee: Steve Loughran Resolution: Duplicate > AWS SDK v2 code tuning >

[jira] [Resolved] (HADOOP-18819) AWS SDK v2 build complaints

[ https://issues.apache.org/jira/browse/HADOOP-18819?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Steve Loughran resolved HADOOP-18819. - Assignee: Steve Loughran Resolution: Duplicate > AWS SDK v2 build complaints >

[jira] [Resolved] (HADOOP-18812) list AWS SDK v2 libraries in LICENSE-binary

[ https://issues.apache.org/jira/browse/HADOOP-18812?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Steve Loughran resolved HADOOP-18812. - Fix Version/s: 3.4.0 Resolution: Duplicate > list AWS SDK v2 libraries in

[jira] [Updated] (HADOOP-18820) AWS SDK v2: make the v1 bridging support optional

[ https://issues.apache.org/jira/browse/HADOOP-18820?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Steve Loughran updated HADOOP-18820: Hadoop Flags: Incompatible change > AWS SDK v2: make the v1 bridging support optional >

[jira] [Resolved] (HADOOP-18820) AWS SDK v2: make the v1 bridging support optional

[ https://issues.apache.org/jira/browse/HADOOP-18820?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Steve Loughran resolved HADOOP-18820. - Fix Version/s: 3.4.0 Resolution: Fixed merged to both feature branches > AWS

[jira] [Created] (HADOOP-18859) AWS SDK v2 typo in aws.evenstream.version

Steve Loughran created HADOOP-18859: --- Summary: AWS SDK v2 typo in aws.evenstream.version Key: HADOOP-18859 URL: https://issues.apache.org/jira/browse/HADOOP-18859 Project: Hadoop Common

[jira] [Commented] (HADOOP-18852) S3ACachingInputStream.ensureCurrentBuffer(): lazy seek means all reads look like random IO

[ https://issues.apache.org/jira/browse/HADOOP-18852?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17757319#comment-17757319 ] Steve Loughran commented on HADOOP-18852: - my unbuffer pr will pass down some of this, and the

[jira] [Resolved] (HADOOP-18858) Upgrade guava due to CVE

[ https://issues.apache.org/jira/browse/HADOOP-18858?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Steve Loughran resolved HADOOP-18858. - Resolution: Duplicate duplicate of HADOOP-18843. [~andrewkstory] anything you can do

[jira] [Commented] (HADOOP-18839) s3a client SSLException is raised after very long timeout "Unsupported or unrecognized SSL message"

[ https://issues.apache.org/jira/browse/HADOOP-18839?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17757302#comment-17757302 ] Steve Loughran commented on HADOOP-18839: - also seen with a different third party store.

[jira] [Updated] (HADOOP-18839) s3a client SSLException is raised after very long timeout "Unsupported or unrecognized SSL message"

[ https://issues.apache.org/jira/browse/HADOOP-18839?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Steve Loughran updated HADOOP-18839: Parent: HADOOP-18477 Issue Type: Sub-task (was: Bug) > s3a client SSLException

[jira] [Updated] (HADOOP-18856) Spark insertInto with location GCS bucket root not supported

[ https://issues.apache.org/jira/browse/HADOOP-18856?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Steve Loughran updated HADOOP-18856: Summary: Spark insertInto with location GCS bucket root not supported (was: Spark

[jira] [Updated] (HADOOP-18857) AWS v2 SDK: fail meaningfully if legacy v2 signing requested

[ https://issues.apache.org/jira/browse/HADOOP-18857?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Steve Loughran updated HADOOP-18857: Description: if the v2 signer is requested on an AWS SDKv2 build, you get an NPE.

[jira] [Created] (HADOOP-18857) AWS v2 SDK: fail meaningfully if legacy v2 signing requested

Steve Loughran created HADOOP-18857: --- Summary: AWS v2 SDK: fail meaningfully if legacy v2 signing requested Key: HADOOP-18857 URL: https://issues.apache.org/jira/browse/HADOOP-18857 Project: Hadoop

[jira] [Comment Edited] (HADOOP-18856) Spark insertInto with location GCS bucket root causes NPE

[ https://issues.apache.org/jira/browse/HADOOP-18856?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17756834#comment-17756834 ] Steve Loughran edited comment on HADOOP-18856 at 8/21/23 11:09 AM: ---

[jira] [Commented] (HADOOP-18856) Spark insertInto with location GCS bucket root causes NPE

[ https://issues.apache.org/jira/browse/HADOOP-18856?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17756834#comment-17756834 ] Steve Loughran commented on HADOOP-18856: - bq. Dataproc's latest 2.1 uses Hadoop 3.3.3 and this

[jira] [Commented] (HADOOP-18850) Enable dual-layer server-side encryption with AWS KMS keys (DSSE-KMS)

[ https://issues.apache.org/jira/browse/HADOOP-18850?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17756032#comment-17756032 ] Steve Loughran commented on HADOOP-18850: - aws sdk update goes in next week. nothing which

[jira] [Updated] (HADOOP-18837) Upgrade Okio to 3.4.0 due to CVE-2023-3635

[ https://issues.apache.org/jira/browse/HADOOP-18837?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Steve Loughran updated HADOOP-18837: Fix Version/s: 3.3.9 > Upgrade Okio to 3.4.0 due to CVE-2023-3635 >

[jira] [Updated] (HADOOP-18854) add options to disable range merging of vectored io

[ https://issues.apache.org/jira/browse/HADOOP-18854?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Steve Loughran updated HADOOP-18854: Parent: HADOOP-18855 Issue Type: Sub-task (was: Improvement) > add options to

[jira] [Created] (HADOOP-18855) VectorIO API tuning

Steve Loughran created HADOOP-18855: --- Summary: VectorIO API tuning Key: HADOOP-18855 URL: https://issues.apache.org/jira/browse/HADOOP-18855 Project: Hadoop Common Issue Type: Improvement

[jira] [Created] (HADOOP-18854) add options to disable range merging of vectored io

Steve Loughran created HADOOP-18854: --- Summary: add options to disable range merging of vectored io Key: HADOOP-18854 URL: https://issues.apache.org/jira/browse/HADOOP-18854 Project: Hadoop Common

[jira] [Commented] (HADOOP-18531) assertion failure in ITestS3APrefetchingInputStream

[ https://issues.apache.org/jira/browse/HADOOP-18531?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17755627#comment-17755627 ] Steve Loughran commented on HADOOP-18531: - aaha, seen this again nearby {code}

[jira] [Created] (HADOOP-18852) S3ACachingInputStream.ensureCurrentBuffer(): lazy seek means all reads look like random IO

Steve Loughran created HADOOP-18852: --- Summary: S3ACachingInputStream.ensureCurrentBuffer(): lazy seek means all reads look like random IO Key: HADOOP-18852 URL:

[jira] [Commented] (HADOOP-18832) Upgrade aws-java-sdk to 1.12.499+

[ https://issues.apache.org/jira/browse/HADOOP-18832?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17755065#comment-17755065 ] Steve Loughran commented on HADOOP-18832: - merged to trunk. fwiw, i want to make this the last

[jira] [Resolved] (HADOOP-18832) Upgrade aws-java-sdk to 1.12.499+

[ https://issues.apache.org/jira/browse/HADOOP-18832?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Steve Loughran resolved HADOOP-18832. - Fix Version/s: 3.4.0 3.3.9 Resolution: Fixed > Upgrade

[jira] [Created] (HADOOP-18849) remove head bucket request from calls which can be made without audit header

Steve Loughran created HADOOP-18849: --- Summary: remove head bucket request from calls which can be made without audit header Key: HADOOP-18849 URL: https://issues.apache.org/jira/browse/HADOOP-18849

[jira] [Commented] (HADOOP-18393) Hadoop 3.3.2 has CVEs coming from dependencies

[ https://issues.apache.org/jira/browse/HADOOP-18393?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17754036#comment-17754036 ] Steve Loughran commented on HADOOP-18393: - don't recall, sorry. > Hadoop 3.3.2 has CVEs

[jira] [Commented] (HADOOP-18848) Upgrade protobuf to 3.15.0 or newer

[ https://issues.apache.org/jira/browse/HADOOP-18848?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17753569#comment-17753569 ] Steve Loughran commented on HADOOP-18848: - going to say this is the ongoing "protobuf is a

[jira] [Commented] (HADOOP-18838) Some fs.s3a.* config values are different in sources and documentation

[ https://issues.apache.org/jira/browse/HADOOP-18838?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17752760#comment-17752760 ] Steve Loughran commented on HADOOP-18838: - hadoop-common.jar, which is pulled into

[jira] [Commented] (HADOOP-18826) abfs getFileStatus(/) fails with "Value for one of the query parameters specified in the request URI is invalid.", 400

[ https://issues.apache.org/jira/browse/HADOOP-18826?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17752449#comment-17752449 ] Steve Loughran commented on HADOOP-18826: - [~sergey.shabalov]: this bug has been fixed and the

[jira] [Resolved] (HADOOP-18826) abfs getFileStatus(/) fails with "Value for one of the query parameters specified in the request URI is invalid.", 400

[ https://issues.apache.org/jira/browse/HADOOP-18826?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Steve Loughran resolved HADOOP-18826. - Fix Version/s: 3.4.0 3.3.9 Resolution: Fixed > abfs

[jira] [Updated] (HADOOP-18838) Some fs.s3a.* config values are different in sources and documentation

[ https://issues.apache.org/jira/browse/HADOOP-18838?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Steve Loughran updated HADOOP-18838: Priority: Minor (was: Major) > Some fs.s3a.* config values are different in sources and

[jira] [Commented] (HADOOP-18838) Some fs.s3a.* config values are different in sources and documentation

[ https://issues.apache.org/jira/browse/HADOOP-18838?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17752145#comment-17752145 ] Steve Loughran commented on HADOOP-18838: - you can actually get a dump of the live cluster

[jira] [Updated] (HADOOP-18838) Some fs.s3a.* config values are different in sources and documentation

[ https://issues.apache.org/jira/browse/HADOOP-18838?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Steve Loughran updated HADOOP-18838: Component/s: documentation > Some fs.s3a.* config values are different in sources and

[jira] [Updated] (HADOOP-18839) s3a client SSLException is raised after very long timeout "Unsupported or unrecognized SSL message"

[ https://issues.apache.org/jira/browse/HADOOP-18839?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Steve Loughran updated HADOOP-18839: Summary: s3a client SSLException is raised after very long timeout "Unsupported or

[jira] [Commented] (HADOOP-18839) SSLException is raised after very long timeout

[ https://issues.apache.org/jira/browse/HADOOP-18839?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17752144#comment-17752144 ] Steve Loughran commented on HADOOP-18839: - bq. The point of this issue is to provide better

[jira] [Updated] (HADOOP-18839) SSLException is raised after very long timeout "Unsupported or unrecognized SSL message"

[ https://issues.apache.org/jira/browse/HADOOP-18839?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Steve Loughran updated HADOOP-18839: Summary: SSLException is raised after very long timeout "Unsupported or unrecognized SSL

[jira] [Created] (HADOOP-18844) Add a way to get the IOStatistics of active filesystems in long-lived processes

Steve Loughran created HADOOP-18844: --- Summary: Add a way to get the IOStatistics of active filesystems in long-lived processes Key: HADOOP-18844 URL: https://issues.apache.org/jira/browse/HADOOP-18844

[jira] [Updated] (HADOOP-18842) Support Overwrite Directory On Commit For S3A Committers

[ https://issues.apache.org/jira/browse/HADOOP-18842?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Steve Loughran updated HADOOP-18842: Affects Version/s: 3.4.0 > Support Overwrite Directory On Commit For S3A Committers >

[jira] [Updated] (HADOOP-18842) Support Overwrite Directory On Commit For S3A Committers

[ https://issues.apache.org/jira/browse/HADOOP-18842?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Steve Loughran updated HADOOP-18842: Component/s: fs/s3 > Support Overwrite Directory On Commit For S3A Committers >

[jira] [Updated] (HADOOP-18233) Initialization race condition with TemporaryAWSCredentialsProvider

[ https://issues.apache.org/jira/browse/HADOOP-18233?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Steve Loughran updated HADOOP-18233: Summary: Initialization race condition with TemporaryAWSCredentialsProvider (was:

[jira] [Resolved] (HADOOP-18837) Upgrade Okio to 3.4.0 due to CVE-2023-3635

[ https://issues.apache.org/jira/browse/HADOOP-18837?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Steve Loughran resolved HADOOP-18837. - Fix Version/s: 3.4.0 Assignee: Rohit Kumar Resolution: Fixed merged to

[jira] [Commented] (HADOOP-18838) Some fs.s3a.* config values are different in sources and documentation

[ https://issues.apache.org/jira/browse/HADOOP-18838?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17751069#comment-17751069 ] Steve Loughran commented on HADOOP-18838: - # whatever is in core default takes priority, so

[jira] [Commented] (HADOOP-18839) SSLException is raised after very long timeout

[ https://issues.apache.org/jira/browse/HADOOP-18839?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17750859#comment-17750859 ] Steve Loughran commented on HADOOP-18839: - does this exception ever recover? if not, it looks

[jira] [Updated] (HADOOP-18839) SSLException is raised after very long timeout

[ https://issues.apache.org/jira/browse/HADOOP-18839?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Steve Loughran updated HADOOP-18839: Priority: Minor (was: Major) > SSLException is raised after very long timeout >

[jira] [Commented] (HADOOP-18829) s3a prefetch LRU cache eviction metric

[ https://issues.apache.org/jira/browse/HADOOP-18829?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17749996#comment-17749996 ] Steve Loughran commented on HADOOP-18829: - can i get my /HADOOP-18184 unbuffer patch in before

[jira] [Updated] (HADOOP-18836) Some properties are missing from hadoop-policy.xml.

[ https://issues.apache.org/jira/browse/HADOOP-18836?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Steve Loughran updated HADOOP-18836: Component/s: security > Some properties are missing from hadoop-policy.xml. >

[jira] [Updated] (HADOOP-18190) Collect IOStatistics during S3A prefetching

[ https://issues.apache.org/jira/browse/HADOOP-18190?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Steve Loughran updated HADOOP-18190: Fix Version/s: 3.4.0 3.3.6 > Collect IOStatistics during S3A

[jira] [Resolved] (HADOOP-18183) s3a audit logs to publish range start/end of GET requests in audit header

[ https://issues.apache.org/jira/browse/HADOOP-18183?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Steve Loughran resolved HADOOP-18183. - Fix Version/s: 3.3.9 3.4.0 Resolution: Fixed > s3a audit

[jira] [Assigned] (HADOOP-18179) Boost S3A Stream Read Performance

[ https://issues.apache.org/jira/browse/HADOOP-18179?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Steve Loughran reassigned HADOOP-18179: --- Assignee: Ahmar Suhail > Boost S3A Stream Read Performance >

<    2   3   4   5   6   7   8   9   10   11   >