[jira] [Resolved] (HADOOP-15460) S3A FS to add "fs.s3a.create.performance" to the builder file creation option set

2022-10-04 Thread Steve Loughran (Jira)
[ https://issues.apache.org/jira/browse/HADOOP-15460?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Steve Loughran resolved HADOOP-15460. - Fix Version/s: 3.3.5 Resolution: Fixed > S3A FS to add

[jira] [Resolved] (HADOOP-13695) S3A to use a thread pool for async path operations

2022-10-04 Thread Steve Loughran (Jira)
[ https://issues.apache.org/jira/browse/HADOOP-13695?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Steve Loughran resolved HADOOP-13695. - Fix Version/s: 3.3.5 Resolution: Done we have a thread pool > S3A to use a

[jira] [Resolved] (HADOOP-16921) NPE in s3a byte buffer block upload

2022-10-04 Thread Steve Loughran (Jira)
[ https://issues.apache.org/jira/browse/HADOOP-16921?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Steve Loughran resolved HADOOP-16921. - Resolution: Cannot Reproduce > NPE in s3a byte buffer block upload >

[jira] [Resolved] (HADOOP-17077) S3A delegation token binding to support secondary binding list

2022-10-04 Thread Steve Loughran (Jira)
[ https://issues.apache.org/jira/browse/HADOOP-17077?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Steve Loughran resolved HADOOP-17077. - Resolution: Won't Fix > S3A delegation token binding to support secondary binding list

[jira] [Resolved] (HADOOP-16741) Document `dynamodb:TagResource` an explicit client-side permission for S3Guard

2022-10-04 Thread Steve Loughran (Jira)
[ https://issues.apache.org/jira/browse/HADOOP-16741?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Steve Loughran resolved HADOOP-16741. - Resolution: Won't Fix > Document `dynamodb:TagResource` an explicit client-side

[jira] [Created] (HADOOP-18477) Über-jira: S3A Hadoop 3.3.9 features

2022-10-04 Thread Steve Loughran (Jira)
Steve Loughran created HADOOP-18477: --- Summary: Über-jira: S3A Hadoop 3.3.9 features Key: HADOOP-18477 URL: https://issues.apache.org/jira/browse/HADOOP-18477 Project: Hadoop Common Issue

[jira] [Created] (HADOOP-18476) Abfs and S3A FileContext bindings to close wrapped filesystems in finalizer

2022-10-04 Thread Steve Loughran (Jira)
Steve Loughran created HADOOP-18476: --- Summary: Abfs and S3A FileContext bindings to close wrapped filesystems in finalizer Key: HADOOP-18476 URL: https://issues.apache.org/jira/browse/HADOOP-18476

[jira] [Resolved] (HADOOP-18466) Limit the findbugs suppression IS2_INCONSISTENT_SYNC to S3AFileSystem field

2022-09-26 Thread Steve Loughran (Jira)
[ https://issues.apache.org/jira/browse/HADOOP-18466?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Steve Loughran resolved HADOOP-18466. - Fix Version/s: 3.4.0 Resolution: Fixed > Limit the findbugs suppression

[jira] [Resolved] (HADOOP-18456) NullPointerException in ObjectListingIterator's constructor

2022-09-23 Thread Steve Loughran (Jira)
[ https://issues.apache.org/jira/browse/HADOOP-18456?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Steve Loughran resolved HADOOP-18456. - Fix Version/s: 3.3.9 Resolution: Fixed > NullPointerException in

[jira] [Resolved] (HADOOP-18242) ABFS Rename Failure when tracking metadata is in incomplete state

2022-09-21 Thread Steve Loughran (Jira)
[ https://issues.apache.org/jira/browse/HADOOP-18242?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Steve Loughran resolved HADOOP-18242. - Fix Version/s: 3.3.9 Resolution: Fixed > ABFS Rename Failure when tracking

[jira] [Created] (HADOOP-18460) ITestS3AContractVectoredRead.jtestStopVectoredIoOperationsUnbuffer failing

2022-09-20 Thread Steve Loughran (Jira)
Steve Loughran created HADOOP-18460: --- Summary: ITestS3AContractVectoredRead.jtestStopVectoredIoOperationsUnbuffer failing Key: HADOOP-18460 URL: https://issues.apache.org/jira/browse/HADOOP-18460

[jira] [Resolved] (HADOOP-18377) hadoop-aws maven build to add a prefetch profile to run all tests with prefetching

2022-09-20 Thread Steve Loughran (Jira)
[ https://issues.apache.org/jira/browse/HADOOP-18377?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Steve Loughran resolved HADOOP-18377. - Fix Version/s: 3.4.0 Resolution: Fixed > hadoop-aws maven build to add a

[jira] [Resolved] (HADOOP-18448) s3a endpoint per bucket configuration in pyspark is ignored

2022-09-19 Thread Steve Loughran (Jira)
[ https://issues.apache.org/jira/browse/HADOOP-18448?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Steve Loughran resolved HADOOP-18448. - Resolution: Invalid > s3a endpoint per bucket configuration in pyspark is ignored >

[jira] [Resolved] (HADOOP-18186) s3a prefetching to use SemaphoredDelegatingExecutor for submitting work

2022-09-09 Thread Steve Loughran (Jira)
[ https://issues.apache.org/jira/browse/HADOOP-18186?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Steve Loughran resolved HADOOP-18186. - Fix Version/s: 3.4.0 Resolution: Fixed > s3a prefetching to use

[jira] [Created] (HADOOP-18442) Remove the hadoop-openstack module

2022-09-05 Thread Steve Loughran (Jira)
Steve Loughran created HADOOP-18442: --- Summary: Remove the hadoop-openstack module Key: HADOOP-18442 URL: https://issues.apache.org/jira/browse/HADOOP-18442 Project: Hadoop Common Issue

[jira] [Resolved] (HADOOP-18423) TestArnResource.parseAccessPointFromArn failing intermittently

2022-09-05 Thread Steve Loughran (Jira)
[ https://issues.apache.org/jira/browse/HADOOP-18423?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Steve Loughran resolved HADOOP-18423. - Resolution: Duplicate > TestArnResource.parseAccessPointFromArn failing intermittently

[jira] [Resolved] (HADOOP-18410) S3AInputStream.unbuffer() async drain not releasing http connections

2022-09-05 Thread Steve Loughran (Jira)
[ https://issues.apache.org/jira/browse/HADOOP-18410?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Steve Loughran resolved HADOOP-18410. - Fix Version/s: 3.4.0 3.3.9 Resolution: Fixed >

[jira] [Resolved] (HADOOP-16259) Distcp to set S3 Storage Class

2022-09-01 Thread Steve Loughran (Jira)
[ https://issues.apache.org/jira/browse/HADOOP-16259?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Steve Loughran resolved HADOOP-16259. - Fix Version/s: 3.4.0 3.3.9 Resolution: Duplicate > Distcp to

[jira] [Resolved] (HADOOP-18339) S3A storage class option only picked up when buffering writes to disk

2022-09-01 Thread Steve Loughran (Jira)
[ https://issues.apache.org/jira/browse/HADOOP-18339?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Steve Loughran resolved HADOOP-18339. - Fix Version/s: 3.4.0 3.3.9 Resolution: Fixed > S3A storage

[jira] [Resolved] (HADOOP-18432) hadoop 3.3.4 doesn't have a binary-aarch64 download link

2022-08-31 Thread Steve Loughran (Jira)
[ https://issues.apache.org/jira/browse/HADOOP-18432?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Steve Loughran resolved HADOOP-18432. - Resolution: Duplicate > hadoop 3.3.4 doesn't have a binary-aarch64 download link >

[jira] [Resolved] (HADOOP-18417) Upgrade Maven Surefire plugin

2022-08-24 Thread Steve Loughran (Jira)
[ https://issues.apache.org/jira/browse/HADOOP-18417?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Steve Loughran resolved HADOOP-18417. - Fix Version/s: 3.4.0 3.3.9 Resolution: Fixed > Upgrade Maven

[jira] [Created] (HADOOP-18416) ITestS3AIOStatisticsContext failure

2022-08-23 Thread Steve Loughran (Jira)
Steve Loughran created HADOOP-18416: --- Summary: ITestS3AIOStatisticsContext failure Key: HADOOP-18416 URL: https://issues.apache.org/jira/browse/HADOOP-18416 Project: Hadoop Common Issue

[jira] [Resolved] (HADOOP-18380) fs.s3a.prefetch.block.size to be read through longBytesOption

2022-08-23 Thread Steve Loughran (Jira)
[ https://issues.apache.org/jira/browse/HADOOP-18380?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Steve Loughran resolved HADOOP-18380. - Fix Version/s: 3.4.0 Resolution: Fixed > fs.s3a.prefetch.block.size to be read

[jira] [Created] (HADOOP-18410) S3AInputStream async drain not releasing http connections

2022-08-19 Thread Steve Loughran (Jira)
Steve Loughran created HADOOP-18410: --- Summary: S3AInputStream async drain not releasing http connections Key: HADOOP-18410 URL: https://issues.apache.org/jira/browse/HADOOP-18410 Project: Hadoop

[jira] [Resolved] (HADOOP-17882) distcp to use openFile() with sequential IO; ranges of reads

2022-08-19 Thread Steve Loughran (Jira)
[ https://issues.apache.org/jira/browse/HADOOP-17882?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Steve Loughran resolved HADOOP-17882. - Fix Version/s: 3.3.9 Resolution: Fixed > distcp to use openFile() with

[jira] [Resolved] (HADOOP-18385) ITestS3ACannedACLs failure; not in a span

2022-08-18 Thread Steve Loughran (Jira)
[ https://issues.apache.org/jira/browse/HADOOP-18385?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Steve Loughran resolved HADOOP-18385. - Fix Version/s: 3.3.9 Resolution: Fixed > ITestS3ACannedACLs failure; not in a

[jira] [Resolved] (HADOOP-18181) move org.apache.hadoop.fs.common package into hadoop-common module

2022-08-17 Thread Steve Loughran (Jira)
[ https://issues.apache.org/jira/browse/HADOOP-18181?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Steve Loughran resolved HADOOP-18181. - Resolution: Fixed > move org.apache.hadoop.fs.common package into hadoop-common

[jira] [Resolved] (HADOOP-18187) Convert s3a prefetching to use JavaDoc for fields and enums

2022-08-17 Thread Steve Loughran (Jira)
[ https://issues.apache.org/jira/browse/HADOOP-18187?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Steve Loughran resolved HADOOP-18187. - Resolution: Fixed fixed in the big HADOOP-18181 patch > Convert s3a prefetching to

[jira] [Resolved] (HADOOP-18318) Update class names to be clear they belong to S3A prefetching

2022-08-17 Thread Steve Loughran (Jira)
[ https://issues.apache.org/jira/browse/HADOOP-18318?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Steve Loughran resolved HADOOP-18318. - Resolution: Fixed fixed in the big HADOOP-18181 patch > Update class names to be

[jira] [Created] (HADOOP-18405) abfs testReadAndWriteWithDifferentBufferSizesAndSeek failure

2022-08-15 Thread Steve Loughran (Jira)
Steve Loughran created HADOOP-18405: --- Summary: abfs testReadAndWriteWithDifferentBufferSizesAndSeek failure Key: HADOOP-18405 URL: https://issues.apache.org/jira/browse/HADOOP-18405 Project: Hadoop

[jira] [Resolved] (HADOOP-18397) Shutdown AWSSecurityTokenService when its resources are no longer in use

2022-08-12 Thread Steve Loughran (Jira)
[ https://issues.apache.org/jira/browse/HADOOP-18397?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Steve Loughran resolved HADOOP-18397. - Fix Version/s: 3.4.0 3.3.9 Resolution: Fixed > Shutdown

[jira] [Resolved] (HADOOP-18340) deleteOnExit does not work with S3AFileSystem

2022-08-11 Thread Steve Loughran (Jira)
[ https://issues.apache.org/jira/browse/HADOOP-18340?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Steve Loughran resolved HADOOP-18340. - Fix Version/s: 3.3.9 Resolution: Fixed > deleteOnExit does not work with

[jira] [Created] (HADOOP-18402) S3A committer NPE in spark job abort

2022-08-11 Thread Steve Loughran (Jira)
Steve Loughran created HADOOP-18402: --- Summary: S3A committer NPE in spark job abort Key: HADOOP-18402 URL: https://issues.apache.org/jira/browse/HADOOP-18402 Project: Hadoop Common Issue

[jira] [Created] (HADOOP-18399) SingleFilePerBlockCache to use LocalDirAllocator for file allocatoin

2022-08-10 Thread Steve Loughran (Jira)
Steve Loughran created HADOOP-18399: --- Summary: SingleFilePerBlockCache to use LocalDirAllocator for file allocatoin Key: HADOOP-18399 URL: https://issues.apache.org/jira/browse/HADOOP-18399

[jira] [Resolved] (HADOOP-18305) Release Hadoop 3.3.4: minor update of hadoop-3.3.3

2022-08-10 Thread Steve Loughran (Jira)
[ https://issues.apache.org/jira/browse/HADOOP-18305?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Steve Loughran resolved HADOOP-18305. - Fix Version/s: 3.3.4 Resolution: Fixed > Release Hadoop 3.3.4: minor update of

[jira] [Resolved] (HADOOP-18393) Hadoop 3.3.2 have CVE coming from dependencies

2022-08-09 Thread Steve Loughran (Jira)
[ https://issues.apache.org/jira/browse/HADOOP-18393?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Steve Loughran resolved HADOOP-18393. - Fix Version/s: 3.3.4 Resolution: Duplicate > Hadoop 3.3.2 have CVE coming from

[jira] [Resolved] (HADOOP-18373) IOStatisticsContext tuning

2022-08-08 Thread Steve Loughran (Jira)
[ https://issues.apache.org/jira/browse/HADOOP-18373?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Steve Loughran resolved HADOOP-18373. - Fix Version/s: 3.3.9 Resolution: Fixed > IOStatisticsContext tuning >

[jira] [Resolved] (HADOOP-17380) ITestS3AContractSeek.teardown closes FS before superclass does its cleanup

2022-08-08 Thread Steve Loughran (Jira)
[ https://issues.apache.org/jira/browse/HADOOP-17380?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Steve Loughran resolved HADOOP-17380. - Resolution: Duplicate > ITestS3AContractSeek.teardown closes FS before superclass does

[jira] [Resolved] (HADOOP-18323) Bump javax.ws.rs-api To Version 3.1.0

2022-08-05 Thread Steve Loughran (Jira)
[ https://issues.apache.org/jira/browse/HADOOP-18323?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Steve Loughran resolved HADOOP-18323. - Resolution: Not A Problem HADOOP-18332 makes this unneeded. closing > Bump

[jira] [Resolved] (HADOOP-18386) ITestS3SelectLandsat timeout after 10 minutes

2022-08-05 Thread Steve Loughran (Jira)
[ https://issues.apache.org/jira/browse/HADOOP-18386?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Steve Loughran resolved HADOOP-18386. - Resolution: Duplicate > ITestS3SelectLandsat timeout after 10 minutes >

[jira] [Created] (HADOOP-18391) harden VectoredReadUtils

2022-08-04 Thread Steve Loughran (Jira)
Steve Loughran created HADOOP-18391: --- Summary: harden VectoredReadUtils Key: HADOOP-18391 URL: https://issues.apache.org/jira/browse/HADOOP-18391 Project: Hadoop Common Issue Type:

[jira] [Resolved] (HADOOP-15964) Add S3A support for Async Scatter/Gather IO

2022-08-04 Thread Steve Loughran (Jira)
[ https://issues.apache.org/jira/browse/HADOOP-15964?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Steve Loughran resolved HADOOP-15964. - Fix Version/s: 3.3.9 Resolution: Fixed > Add S3A support for Async

[jira] [Resolved] (HADOOP-18379) rebase feature/HADOOP-18028-s3a-prefetch to trunk

2022-08-03 Thread Steve Loughran (Jira)
[ https://issues.apache.org/jira/browse/HADOOP-18379?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Steve Loughran resolved HADOOP-18379. - Resolution: Done > rebase feature/HADOOP-18028-s3a-prefetch to trunk >

[jira] [Created] (HADOOP-18386) ITestS3SelectLandsat timeout after 10 minutes

2022-08-02 Thread Steve Loughran (Jira)
Steve Loughran created HADOOP-18386: --- Summary: ITestS3SelectLandsat timeout after 10 minutes Key: HADOOP-18386 URL: https://issues.apache.org/jira/browse/HADOOP-18386 Project: Hadoop Common

[jira] [Created] (HADOOP-18385) ITestS3ACannedACLs failure; not in a span

2022-08-02 Thread Steve Loughran (Jira)
Steve Loughran created HADOOP-18385: --- Summary: ITestS3ACannedACLs failure; not in a span Key: HADOOP-18385 URL: https://issues.apache.org/jira/browse/HADOOP-18385 Project: Hadoop Common

[jira] [Created] (HADOOP-18384) ITestS3AFileSystemStatistic failure in prefetch feature branch

2022-08-02 Thread Steve Loughran (Jira)
Steve Loughran created HADOOP-18384: --- Summary: ITestS3AFileSystemStatistic failure in prefetch feature branch Key: HADOOP-18384 URL: https://issues.apache.org/jira/browse/HADOOP-18384 Project:

[jira] [Created] (HADOOP-18380) fs.s3a.prefetch.block.size to be read through longBytesOption

2022-07-28 Thread Steve Loughran (Jira)
Steve Loughran created HADOOP-18380: --- Summary: fs.s3a.prefetch.block.size to be read through longBytesOption Key: HADOOP-18380 URL: https://issues.apache.org/jira/browse/HADOOP-18380 Project:

[jira] [Created] (HADOOP-18379) rebase feature/HADOOP-18028-s3a-prefetch to trunk

2022-07-28 Thread Steve Loughran (Jira)
Steve Loughran created HADOOP-18379: --- Summary: rebase feature/HADOOP-18028-s3a-prefetch to trunk Key: HADOOP-18379 URL: https://issues.apache.org/jira/browse/HADOOP-18379 Project: Hadoop Common

[jira] [Created] (HADOOP-18377) hadoop-aws maven build to add a prefetch profile to run all tests with prefetching

2022-07-28 Thread Steve Loughran (Jira)
Steve Loughran created HADOOP-18377: --- Summary: hadoop-aws maven build to add a prefetch profile to run all tests with prefetching Key: HADOOP-18377 URL: https://issues.apache.org/jira/browse/HADOOP-18377

[jira] [Resolved] (HADOOP-18182) S3File to store reference to active S3Object in a field.

2022-07-28 Thread Steve Loughran (Jira)
[ https://issues.apache.org/jira/browse/HADOOP-18182?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Steve Loughran resolved HADOOP-18182. - Resolution: Not A Problem > S3File to store reference to active S3Object in a field. >

[jira] [Resolved] (HADOOP-18344) AWS SDK update to 1.12.262 to address jackson CVE-2018-7489

2022-07-28 Thread Steve Loughran (Jira)
[ https://issues.apache.org/jira/browse/HADOOP-18344?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Steve Loughran resolved HADOOP-18344. - Fix Version/s: 3.4.0 3.3.4 Resolution: Fixed > AWS SDK

[jira] [Resolved] (HADOOP-18372) ILoadTestS3ABulkDeleteThrottling failing

2022-07-27 Thread Steve Loughran (Jira)
[ https://issues.apache.org/jira/browse/HADOOP-18372?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Steve Loughran resolved HADOOP-18372. - Fix Version/s: 3.3.9 Resolution: Fixed > ILoadTestS3ABulkDeleteThrottling

[jira] [Created] (HADOOP-18374) DistCP: Aggregate IOStatistics Counters in MapReduce Counters

2022-07-27 Thread Steve Loughran (Jira)
Steve Loughran created HADOOP-18374: --- Summary: DistCP: Aggregate IOStatistics Counters in MapReduce Counters Key: HADOOP-18374 URL: https://issues.apache.org/jira/browse/HADOOP-18374 Project:

[jira] [Resolved] (HADOOP-17806) Add ListWithIOStats wrapper to return IOStats from a list.

2022-07-27 Thread Steve Loughran (Jira)
[ https://issues.apache.org/jira/browse/HADOOP-17806?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Steve Loughran resolved HADOOP-17806. - Resolution: Won't Fix lists which update context iostatistics give you this without

[jira] [Resolved] (HADOOP-17553) FileSystem.close() to optionally log IOStats; save to local dir

2022-07-27 Thread Steve Loughran (Jira)
[ https://issues.apache.org/jira/browse/HADOOP-17553?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Steve Loughran resolved HADOOP-17553. - Resolution: Won't Fix > FileSystem.close() to optionally log IOStats; save to local

[jira] [Created] (HADOOP-18373) hadoop-aws tests to enable iOStatisticsContext

2022-07-27 Thread Steve Loughran (Jira)
Steve Loughran created HADOOP-18373: --- Summary: hadoop-aws tests to enable iOStatisticsContext Key: HADOOP-18373 URL: https://issues.apache.org/jira/browse/HADOOP-18373 Project: Hadoop Common

[jira] [Created] (HADOOP-18372) ILoadTestS3ABulkDeleteThrottling failing!+

2022-07-27 Thread Steve Loughran (Jira)
Steve Loughran created HADOOP-18372: --- Summary: ILoadTestS3ABulkDeleteThrottling failing!+ Key: HADOOP-18372 URL: https://issues.apache.org/jira/browse/HADOOP-18372 Project: Hadoop Common

[jira] [Created] (HADOOP-18371) s3a FS init logs at warn if fs.s3a.create.storage.class is unset

2022-07-27 Thread Steve Loughran (Jira)
Steve Loughran created HADOOP-18371: --- Summary: s3a FS init logs at warn if fs.s3a.create.storage.class is unset Key: HADOOP-18371 URL: https://issues.apache.org/jira/browse/HADOOP-18371 Project:

[jira] [Resolved] (HADOOP-18350) Support for hadoop-aws with aws-java-sdk-bundle with version greater than 1.12.220

2022-07-27 Thread Steve Loughran (Jira)
[ https://issues.apache.org/jira/browse/HADOOP-18350?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Steve Loughran resolved HADOOP-18350. - Resolution: Duplicate > Support for hadoop-aws with aws-java-sdk-bundle with version

[jira] [Resolved] (HADOOP-17461) Add thread-level IOStatistics Context

2022-07-27 Thread Steve Loughran (Jira)
[ https://issues.apache.org/jira/browse/HADOOP-17461?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Steve Loughran resolved HADOOP-17461. - Fix Version/s: 3.3.9 Resolution: Fixed > Add thread-level IOStatistics Context

[jira] [Created] (HADOOP-18367) S3A prefetching to update IOStatisticsContext

2022-07-26 Thread Steve Loughran (Jira)
Steve Loughran created HADOOP-18367: --- Summary: S3A prefetching to update IOStatisticsContext Key: HADOOP-18367 URL: https://issues.apache.org/jira/browse/HADOOP-18367 Project: Hadoop Common

[jira] [Resolved] (HADOOP-18190) Collect IOStatistics during S3A prefetching

2022-07-26 Thread Steve Loughran (Jira)
[ https://issues.apache.org/jira/browse/HADOOP-18190?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Steve Loughran resolved HADOOP-18190. - Resolution: Fixed > Collect IOStatistics during S3A prefetching >

[jira] [Created] (HADOOP-18344) AWS SDK update to address

2022-07-18 Thread Steve Loughran (Jira)
Steve Loughran created HADOOP-18344: --- Summary: AWS SDK update to address Key: HADOOP-18344 URL: https://issues.apache.org/jira/browse/HADOOP-18344 Project: Hadoop Common Issue Type:

[jira] [Resolved] (HADOOP-18332) remove rs-api dependency by downgrading jackson to 2.12.7

2022-07-17 Thread Steve Loughran (Jira)
[ https://issues.apache.org/jira/browse/HADOOP-18332?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Steve Loughran resolved HADOOP-18332. - Fix Version/s: 3.3.4 Release Note: Downgrades Jackson from 2.13.2 to 2.12.7 to fix

[jira] [Resolved] (HADOOP-18254) Add in configuration option to enable prefetching

2022-07-15 Thread Steve Loughran (Jira)
[ https://issues.apache.org/jira/browse/HADOOP-18254?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Steve Loughran resolved HADOOP-18254. - Resolution: Fixed > Add in configuration option to enable prefetching >

[jira] [Resolved] (HADOOP-18231) tests in ITestS3AInputStreamPerformance are failing

2022-07-15 Thread Steve Loughran (Jira)
[ https://issues.apache.org/jira/browse/HADOOP-18231?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Steve Loughran resolved HADOOP-18231. - Fix Version/s: 3.4.0 Resolution: Fixed > tests in

[jira] [Created] (HADOOP-18339) S3A storage class option only picked up when buffering writes to disk

2022-07-15 Thread Steve Loughran (Jira)
Steve Loughran created HADOOP-18339: --- Summary: S3A storage class option only picked up when buffering writes to disk Key: HADOOP-18339 URL: https://issues.apache.org/jira/browse/HADOOP-18339

[jira] [Resolved] (HADOOP-18074) Partial/Incomplete groups list can be returned in LDAP groups lookup

2022-07-14 Thread Steve Loughran (Jira)
[ https://issues.apache.org/jira/browse/HADOOP-18074?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Steve Loughran resolved HADOOP-18074. - Fix Version/s: 3.4.0 3.3.5 Resolution: Fixed >

[jira] [Resolved] (HADOOP-18336) tag FSDataInputStream.getWrappedStream() @Public/@Stable

2022-07-13 Thread Steve Loughran (Jira)
[ https://issues.apache.org/jira/browse/HADOOP-18336?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Steve Loughran resolved HADOOP-18336. - Fix Version/s: 3.4.0 3.3.9 Resolution: Fixed merged to 3.3

[jira] [Resolved] (HADOOP-18338) Unable to access data from S3 bucket over a vpc endpoint - 400 bad request

2022-07-13 Thread Steve Loughran (Jira)
[ https://issues.apache.org/jira/browse/HADOOP-18338?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Steve Loughran resolved HADOOP-18338. - Resolution: Not A Problem change the endpoint and s3a doesn't know what region to sign

[jira] [Resolved] (HADOOP-18217) shutdownhookmanager should not be multithreaded (deadlock possible)

2022-07-13 Thread Steve Loughran (Jira)
[ https://issues.apache.org/jira/browse/HADOOP-18217?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Steve Loughran resolved HADOOP-18217. - Fix Version/s: 3.4.0 3.3.9 Resolution: Fixed committed to

[jira] [Resolved] (HADOOP-17273) FSDataInput/Output Streams to automatically collect IOStatistics

2022-07-12 Thread Steve Loughran (Jira)
[ https://issues.apache.org/jira/browse/HADOOP-17273?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Steve Loughran resolved HADOOP-17273. - Resolution: Won't Fix just use thread level stats from HADOOP-17461 >

[jira] [Resolved] (HADOOP-17856) JsonSerDeser to collect IOStatistics

2022-07-12 Thread Steve Loughran (Jira)
[ https://issues.apache.org/jira/browse/HADOOP-17856?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Steve Loughran resolved HADOOP-17856. - Resolution: Won't Fix no. use the thread stats instead > JsonSerDeser to collect

[jira] [Created] (HADOOP-18336) tag FSDataInputStream.getWrappedStream() @Public/@Stable

2022-07-12 Thread Steve Loughran (Jira)
Steve Loughran created HADOOP-18336: --- Summary: tag FSDataInputStream.getWrappedStream() @Public/@Stable Key: HADOOP-18336 URL: https://issues.apache.org/jira/browse/HADOOP-18336 Project: Hadoop

[jira] [Resolved] (HADOOP-18307) remove hadoop-cos as a dependency of hadoop-cloud-storage

2022-06-24 Thread Steve Loughran (Jira)
[ https://issues.apache.org/jira/browse/HADOOP-18307?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Steve Loughran resolved HADOOP-18307. - Fix Version/s: 3.3.4 Resolution: Fixed > remove hadoop-cos as a dependency of

[jira] [Resolved] (HADOOP-18237) Upgrade Apache Xerces Java to 2.12.2

2022-06-22 Thread Steve Loughran (Jira)
[ https://issues.apache.org/jira/browse/HADOOP-18237?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Steve Loughran resolved HADOOP-18237. - Fix Version/s: 3.4.0 3.3.4 Resolution: Fixed > Upgrade

[jira] [Resolved] (HADOOP-18293) Release Hadoop 3.3.4 critical fix update

2022-06-22 Thread Steve Loughran (Jira)
[ https://issues.apache.org/jira/browse/HADOOP-18293?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Steve Loughran resolved HADOOP-18293. - Resolution: Duplicate forgot about this when i created HADOOP-18305; closing >

[jira] [Resolved] (HADOOP-18159) Certificate doesn't match any of the subject alternative names: [*.s3.amazonaws.com, s3.amazonaws.com]

2022-06-21 Thread Steve Loughran (Jira)
[ https://issues.apache.org/jira/browse/HADOOP-18159?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Steve Loughran resolved HADOOP-18159. - Fix Version/s: 3.3.9 Resolution: Fixed > Certificate doesn't match any of the

[jira] [Resolved] (HADOOP-17833) Improve Magic Committer Performance

2022-06-21 Thread Steve Loughran (Jira)
[ https://issues.apache.org/jira/browse/HADOOP-17833?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Steve Loughran resolved HADOOP-17833. - Fix Version/s: 3.3.4 Release Note: S3A filesytem's createFile() operation supports

[jira] [Created] (HADOOP-18307) remove hadoop-cos as a dependency of hadoop-cloud-storage

2022-06-20 Thread Steve Loughran (Jira)
Steve Loughran created HADOOP-18307: --- Summary: remove hadoop-cos as a dependency of hadoop-cloud-storage Key: HADOOP-18307 URL: https://issues.apache.org/jira/browse/HADOOP-18307 Project: Hadoop

[jira] [Created] (HADOOP-18305) Release Hadoop 3.3.4: minor update of hadoop-3.3.3

2022-06-20 Thread Steve Loughran (Jira)
Steve Loughran created HADOOP-18305: --- Summary: Release Hadoop 3.3.4: minor update of hadoop-3.3.3 Key: HADOOP-18305 URL: https://issues.apache.org/jira/browse/HADOOP-18305 Project: Hadoop Common

[jira] [Resolved] (HADOOP-18019) S3AFileSystem.s3GetFileStatus() doesn't find dir markers on minio

2022-06-20 Thread Steve Loughran (Jira)
[ https://issues.apache.org/jira/browse/HADOOP-18019?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Steve Loughran resolved HADOOP-18019. - Resolution: Won't Fix > S3AFileSystem.s3GetFileStatus() doesn't find dir markers on

[jira] [Resolved] (HADOOP-18298) Hadoop AWS | Staging committer Multipartupload not completing on minio

2022-06-17 Thread Steve Loughran (Jira)
[ https://issues.apache.org/jira/browse/HADOOP-18298?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Steve Loughran resolved HADOOP-18298. - Resolution: Invalid > Hadoop AWS | Staging committer Multipartupload not completing on

[jira] [Created] (HADOOP-18293) Release Hadoop 3.3.4 critical fix update

2022-06-16 Thread Steve Loughran (Jira)
Steve Loughran created HADOOP-18293: --- Summary: Release Hadoop 3.3.4 critical fix update Key: HADOOP-18293 URL: https://issues.apache.org/jira/browse/HADOOP-18293 Project: Hadoop Common

[jira] [Created] (HADOOP-18292) s3a storage class reduced redundancy breaks s3 select tests

2022-06-15 Thread Steve Loughran (Jira)
Steve Loughran created HADOOP-18292: --- Summary: s3a storage class reduced redundancy breaks s3 select tests Key: HADOOP-18292 URL: https://issues.apache.org/jira/browse/HADOOP-18292 Project: Hadoop

[jira] [Created] (HADOOP-18287) Provide a shim library for modern FS APIs

2022-06-10 Thread Steve Loughran (Jira)
Steve Loughran created HADOOP-18287: --- Summary: Provide a shim library for modern FS APIs Key: HADOOP-18287 URL: https://issues.apache.org/jira/browse/HADOOP-18287 Project: Hadoop Common

[jira] [Created] (HADOOP-18283) Review s3a prefetching input stream retry code

2022-06-09 Thread Steve Loughran (Jira)
Steve Loughran created HADOOP-18283: --- Summary: Review s3a prefetching input stream retry code Key: HADOOP-18283 URL: https://issues.apache.org/jira/browse/HADOOP-18283 Project: Hadoop Common

[jira] [Created] (HADOOP-18281) Tune S3A storage class support

2022-06-08 Thread Steve Loughran (Jira)
Steve Loughran created HADOOP-18281: --- Summary: Tune S3A storage class support Key: HADOOP-18281 URL: https://issues.apache.org/jira/browse/HADOOP-18281 Project: Hadoop Common Issue Type:

[jira] [Resolved] (HADOOP-12020) Support AWS S3 reduced redundancy storage class

2022-06-08 Thread Steve Loughran (Jira)
[ https://issues.apache.org/jira/browse/HADOOP-12020?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Steve Loughran resolved HADOOP-12020. - Fix Version/s: 3.3.4 Resolution: Fixed merged to trunk and 3.3.4. thanks! >

[jira] [Resolved] (HADOOP-18278) Do not perform a LIST call when creating a file

2022-06-08 Thread Steve Loughran (Jira)
[ https://issues.apache.org/jira/browse/HADOOP-18278?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Steve Loughran resolved HADOOP-18278. - Target Version/s: 3.4.0 Resolution: Duplicate We do the check to make sure

[jira] [Resolved] (HADOOP-18275) update os-maven-plugin to 1.7.0

2022-06-06 Thread Steve Loughran (Jira)
[ https://issues.apache.org/jira/browse/HADOOP-18275?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Steve Loughran resolved HADOOP-18275. - Fix Version/s: 3.3.4 Resolution: Fixed > update os-maven-plugin to 1.7.0 >

[jira] [Resolved] (HADOOP-17935) Spark job stuck in S3A StagingCommitter::setupJob

2022-06-03 Thread Steve Loughran (Jira)
[ https://issues.apache.org/jira/browse/HADOOP-17935?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Steve Loughran resolved HADOOP-17935. - Resolution: Cannot Reproduce > Spark job stuck in S3A StagingCommitter::setupJob >

[jira] [Resolved] (HADOOP-16407) Improve isolation of FS instances in S3A committer tests

2022-06-03 Thread Steve Loughran (Jira)
[ https://issues.apache.org/jira/browse/HADOOP-16407?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Steve Loughran resolved HADOOP-16407. - Resolution: Won't Fix > Improve isolation of FS instances in S3A committer tests >

[jira] [Created] (HADOOP-18275) update os-maven-plugin to 1.7.0

2022-06-02 Thread Steve Loughran (Jira)
Steve Loughran created HADOOP-18275: --- Summary: update os-maven-plugin to 1.7.0 Key: HADOOP-18275 URL: https://issues.apache.org/jira/browse/HADOOP-18275 Project: Hadoop Common Issue Type:

[jira] [Resolved] (HADOOP-18243) Rebase s3a prefetching feature branch on top of trunk

2022-05-30 Thread Steve Loughran (Jira)
[ https://issues.apache.org/jira/browse/HADOOP-18243?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Steve Loughran resolved HADOOP-18243. - Resolution: Fixed > Rebase s3a prefetching feature branch on top of trunk >

[jira] [Resolved] (HADOOP-18238) Hadoop 3.3.1 SFTPFileSystem.close() method have problem

2022-05-30 Thread Steve Loughran (Jira)
[ https://issues.apache.org/jira/browse/HADOOP-18238?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Steve Loughran resolved HADOOP-18238. - Fix Version/s: 3.3.4 Resolution: Fixed > Hadoop 3.3.1 SFTPFileSystem.close()

[jira] [Resolved] (HADOOP-18269) Misleading method name in DistCpOptions

2022-05-30 Thread Steve Loughran (Jira)
[ https://issues.apache.org/jira/browse/HADOOP-18269?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Steve Loughran resolved HADOOP-18269. - Resolution: Fixed > Misleading method name in DistCpOptions >

[jira] [Created] (HADOOP-18255) fsdatainputstreambuilder.md refers to hadoop 3.3.3, when it shouldn't

2022-05-24 Thread Steve Loughran (Jira)
Steve Loughran created HADOOP-18255: --- Summary: fsdatainputstreambuilder.md refers to hadoop 3.3.3, when it shouldn't Key: HADOOP-18255 URL: https://issues.apache.org/jira/browse/HADOOP-18255

[jira] [Resolved] (HADOOP-18233) Possible race condition with TemporaryAWSCredentialsProvider

2022-05-23 Thread Steve Loughran (Jira)
[ https://issues.apache.org/jira/browse/HADOOP-18233?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Steve Loughran resolved HADOOP-18233. - Resolution: Cannot Reproduce > Possible race condition with

[jira] [Resolved] (HADOOP-18198) Release Hadoop 3.3.3: hadoop-3.3.2 with some fixes

2022-05-18 Thread Steve Loughran (Jira)
[ https://issues.apache.org/jira/browse/HADOOP-18198?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Steve Loughran resolved HADOOP-18198. - Fix Version/s: 3.3.3 Resolution: Fixed done! > Release Hadoop 3.3.3:

<    1   2   3   4   5   6   7   8   9   10   >