[jira] [Resolved] (HADOOP-18705) ABFS should exclude incompatible credential providers

2023-04-24 Thread Steve Loughran (Jira)
[ https://issues.apache.org/jira/browse/HADOOP-18705?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Steve Loughran resolved HADOOP-18705. - Fix Version/s: 3.4.0 3.3.9 Resolution: Fixed merged to

[jira] [Updated] (HADOOP-18705) ABFS should exclude incompatible credential providers

2023-04-24 Thread Steve Loughran (Jira)
[ https://issues.apache.org/jira/browse/HADOOP-18705?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Steve Loughran updated HADOOP-18705: Summary: ABFS should exclude incompatible credential providers (was: hadoop-azure:

[jira] [Commented] (HADOOP-18697) transient failure of ITestS3APrefetchingInputStream.testRandomReadLargeFile

2023-04-21 Thread Steve Loughran (Jira)
[ https://issues.apache.org/jira/browse/HADOOP-18697?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17714932#comment-17714932 ] Steve Loughran commented on HADOOP-18697: - proposed changes * log iostats before the asserts *

[jira] [Commented] (HADOOP-18697) transient failure of ITestS3APrefetchingInputStream.testRandomReadLargeFile

2023-04-21 Thread Steve Loughran (Jira)
[ https://issues.apache.org/jira/browse/HADOOP-18697?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17714931#comment-17714931 ] Steve Loughran commented on HADOOP-18697: - spotted again. {code} [ERROR]

[jira] [Updated] (HADOOP-18179) Boost S3A Stream Read Performance

2023-04-21 Thread Steve Loughran (Jira)
[ https://issues.apache.org/jira/browse/HADOOP-18179?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Steve Loughran updated HADOOP-18179: Summary: Boost S3A Stream Read Performance (was: Boost S3A Stream Read Performance with

[jira] [Updated] (HADOOP-18179) Boost S3A Stream Read Performance with prefetching and caching

2023-04-21 Thread Steve Loughran (Jira)
[ https://issues.apache.org/jira/browse/HADOOP-18179?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Steve Loughran updated HADOOP-18179: Summary: Boost S3A Stream Read Performance with prefetching and caching (was: Boost S3A

[jira] [Commented] (HADOOP-18679) Add API for bulk/paged object deletion

2023-04-19 Thread Steve Loughran (Jira)
[ https://issues.apache.org/jira/browse/HADOOP-18679?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17714240#comment-17714240 ] Steve Loughran commented on HADOOP-18679: - no: the outcome for the caller would be some lists

[jira] [Updated] (HADOOP-18154) S3A Authentication to support WebIdentity

2023-04-19 Thread Steve Loughran (Jira)
[ https://issues.apache.org/jira/browse/HADOOP-18154?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Steve Loughran updated HADOOP-18154: Parent: HADOOP-18477 Issue Type: Sub-task (was: Improvement) > S3A

[jira] [Resolved] (HADOOP-18349) Support EKS for IAM service account

2023-04-19 Thread Steve Loughran (Jira)
[ https://issues.apache.org/jira/browse/HADOOP-18349?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Steve Loughran resolved HADOOP-18349. - Resolution: Duplicate > Support EKS for IAM service account >

[jira] [Commented] (HADOOP-18701) Generic Build Improvements

2023-04-18 Thread Steve Loughran (Jira)
[ https://issues.apache.org/jira/browse/HADOOP-18701?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17713765#comment-17713765 ] Steve Loughran commented on HADOOP-18701: - not sure if that surefire jira is the one, as our

[jira] [Updated] (HADOOP-18704) Support a "permissive" mode for secure clusters to allow "simple" auth clients

2023-04-18 Thread Steve Loughran (Jira)
[ https://issues.apache.org/jira/browse/HADOOP-18704?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Steve Loughran updated HADOOP-18704: Component/s: security > Support a "permissive" mode for secure clusters to allow

[jira] [Updated] (HADOOP-18704) Support a "permissive" mode for secure clusters to allow "simple" auth clients

2023-04-18 Thread Steve Loughran (Jira)
[ https://issues.apache.org/jira/browse/HADOOP-18704?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Steve Loughran updated HADOOP-18704: Issue Type: New Feature (was: Improvement) > Support a "permissive" mode for secure

[jira] [Updated] (HADOOP-18704) Support a "permissive" mode for secure clusters to allow "simple" auth clients

2023-04-18 Thread Steve Loughran (Jira)
[ https://issues.apache.org/jira/browse/HADOOP-18704?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Steve Loughran updated HADOOP-18704: Priority: Major (was: Minor) > Support a "permissive" mode for secure clusters to allow

[jira] [Commented] (HADOOP-18704) Support a "permissive" mode for secure clusters to allow "simple" auth clients

2023-04-18 Thread Steve Loughran (Jira)
[ https://issues.apache.org/jira/browse/HADOOP-18704?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17713757#comment-17713757 ] Steve Loughran commented on HADOOP-18704: - this is going to be up to the yarn/hdfs team to

[jira] [Commented] (HADOOP-18149) The FSDownload verifyAndCopy method doesn't support S3

2023-04-18 Thread Steve Loughran (Jira)
[ https://issues.apache.org/jira/browse/HADOOP-18149?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17713756#comment-17713756 ] Steve Loughran commented on HADOOP-18149: - why closing as invalid? > The FSDownload

[jira] [Updated] (HADOOP-18399) S3A Prefetch - SingleFilePerBlockCache to use LocalDirAllocator

2023-04-18 Thread Steve Loughran (Jira)
[ https://issues.apache.org/jira/browse/HADOOP-18399?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Steve Loughran updated HADOOP-18399: Fix Version/s: 3.4.0 Resolution: Fixed Status: Resolved (was: Patch

[jira] [Updated] (HADOOP-18399) S3A Prefetch - SingleFilePerBlockCache to use LocalDirAllocator

2023-04-18 Thread Steve Loughran (Jira)
[ https://issues.apache.org/jira/browse/HADOOP-18399?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Steve Loughran updated HADOOP-18399: Summary: S3A Prefetch - SingleFilePerBlockCache to use LocalDirAllocator (was:

[jira] [Updated] (HADOOP-18705) hadoop-azure: AzureBlobFileSystem should exclude incompatible credential providers when binding DelegationTokenManagers

2023-04-18 Thread Steve Loughran (Jira)
[ https://issues.apache.org/jira/browse/HADOOP-18705?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Steve Loughran updated HADOOP-18705: Affects Version/s: 3.3.5 > hadoop-azure: AzureBlobFileSystem should exclude incompatible

[jira] [Updated] (HADOOP-18705) hadoop-azure: AzureBlobFileSystem should exclude incompatible credential providers when binding DelegationTokenManagers

2023-04-18 Thread Steve Loughran (Jira)
[ https://issues.apache.org/jira/browse/HADOOP-18705?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Steve Loughran updated HADOOP-18705: Component/s: fs/azure (was: tools) > hadoop-azure:

[jira] [Updated] (HADOOP-18696) S3A ITestS3ABucketExistence access point test failure

2023-04-17 Thread Steve Loughran (Jira)
[ https://issues.apache.org/jira/browse/HADOOP-18696?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Steve Loughran updated HADOOP-18696: Affects Version/s: 3.3.9 > S3A ITestS3ABucketExistence access point test failure >

[jira] [Resolved] (HADOOP-18696) S3A ITestS3ABucketExistence access point test failure

2023-04-17 Thread Steve Loughran (Jira)
[ https://issues.apache.org/jira/browse/HADOOP-18696?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Steve Loughran resolved HADOOP-18696. - Fix Version/s: 3.3.9 Resolution: Fixed > S3A ITestS3ABucketExistence access

[jira] [Assigned] (HADOOP-18696) S3A ITestS3ABucketExistence access point test failure

2023-04-17 Thread Steve Loughran (Jira)
[ https://issues.apache.org/jira/browse/HADOOP-18696?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Steve Loughran reassigned HADOOP-18696: --- Assignee: Steve Loughran > S3A ITestS3ABucketExistence access point test failure

[jira] [Updated] (HADOOP-18696) S3A ITestS3ABucketExistence access point test failure

2023-04-17 Thread Steve Loughran (Jira)
[ https://issues.apache.org/jira/browse/HADOOP-18696?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Steve Loughran updated HADOOP-18696: Component/s: test > S3A ITestS3ABucketExistence access point test failure >

[jira] [Assigned] (HADOOP-18703) Backport S3A prefetching stream to branch-3.3

2023-04-15 Thread Steve Loughran (Jira)
[ https://issues.apache.org/jira/browse/HADOOP-18703?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Steve Loughran reassigned HADOOP-18703: --- Assignee: Steve Loughran > Backport S3A prefetching stream to branch-3.3 >

[jira] [Commented] (HADOOP-18703) Backport S3A prefetching stream to branch-3.3

2023-04-14 Thread Steve Loughran (Jira)
[ https://issues.apache.org/jira/browse/HADOOP-18703?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17712474#comment-17712474 ] Steve Loughran commented on HADOOP-18703: - started with the work as a github pr and patch 1

[jira] [Created] (HADOOP-18703) Backport S3A prefetching stream to branch-3.3

2023-04-14 Thread Steve Loughran (Jira)
Issue Type: Sub-task Components: fs/s3 Affects Versions: 3.3.9 Reporter: Steve Loughran Jira to cover work for backporting the prefetching into branch-3.3 I'm thinking of the best way to do do this. Proposed # new feature branch # cherrypick from trunk all current

[jira] [Commented] (HADOOP-18690) Fix for Javac Error of Unchecked Cast

2023-04-14 Thread Steve Loughran (Jira)
[ https://issues.apache.org/jira/browse/HADOOP-18690?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17712338#comment-17712338 ] Steve Loughran commented on HADOOP-18690: - those branches aren't going to get any commits;

[jira] [Commented] (HADOOP-18697) transient failure of ITestS3APrefetchingInputStream.testRandomReadLargeFile

2023-04-14 Thread Steve Loughran (Jira)
[ https://issues.apache.org/jira/browse/HADOOP-18697?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17712336#comment-17712336 ] Steve Loughran commented on HADOOP-18697: - i think my mbp m1 is too fast :) > transient

[jira] [Updated] (HADOOP-18693) Upgrade Apache Derby from 10.10.2.0 to 10.14.2.0 due to CVEs

2023-04-14 Thread Steve Loughran (Jira)
[ https://issues.apache.org/jira/browse/HADOOP-18693?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Steve Loughran updated HADOOP-18693: Affects Version/s: 3.4.0 > Upgrade Apache Derby from 10.10.2.0 to 10.14.2.0 due to CVEs

[jira] [Updated] (HADOOP-18693) Upgrade Apache Derby from 10.10.2.0 to 10.14.2.0 due to CVEs

2023-04-14 Thread Steve Loughran (Jira)
[ https://issues.apache.org/jira/browse/HADOOP-18693?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Steve Loughran updated HADOOP-18693: Component/s: build test > Upgrade Apache Derby from 10.10.2.0 to

[jira] [Updated] (HADOOP-18695) S3A: reject multipart copy requests when disabled

2023-04-13 Thread Steve Loughran (Jira)
[ https://issues.apache.org/jira/browse/HADOOP-18695?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Steve Loughran updated HADOOP-18695: Summary: S3A: reject multipart copy requests when disabled (was: S3A: reject multipart

[jira] [Commented] (HADOOP-18422) TestServiceInterruptHandling.testRegisterAndRaise failing intermittently

2023-04-13 Thread Steve Loughran (Jira)
[ https://issues.apache.org/jira/browse/HADOOP-18422?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17711889#comment-17711889 ] Steve Loughran commented on HADOOP-18422: - seen this. probably a race condition, those sleep

[jira] [Commented] (HADOOP-18701) Generic Build Improvements

2023-04-13 Thread Steve Loughran (Jira)
[ https://issues.apache.org/jira/browse/HADOOP-18701?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17711884#comment-17711884 ] Steve Loughran commented on HADOOP-18701: - also make sure that surefire prints the full stack

[jira] [Updated] (HADOOP-18695) S3A: reject multipart copy requests initiated by transfer manager when disabled

2023-04-12 Thread Steve Loughran (Jira)
[ https://issues.apache.org/jira/browse/HADOOP-18695?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Steve Loughran updated HADOOP-18695: Summary: S3A: reject multipart copy requests initiated by transfer manager when disabled

[jira] [Created] (HADOOP-18698) S3ABlockOutputStream doesn't collect stats on multipart block uploads

2023-04-12 Thread Steve Loughran (Jira)
Steve Loughran created HADOOP-18698: --- Summary: S3ABlockOutputStream doesn't collect stats on multipart block uploads Key: HADOOP-18698 URL: https://issues.apache.org/jira/browse/HADOOP-18698

[jira] [Commented] (HADOOP-18696) S3A ITestS3ABucketExistence access point test failure

2023-04-12 Thread Steve Loughran (Jira)
[ https://issues.apache.org/jira/browse/HADOOP-18696?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17711523#comment-17711523 ] Steve Loughran commented on HADOOP-18696: - oh, i understand this. the test config is created

[jira] [Created] (HADOOP-18697) transient failure of ITestS3APrefetchingInputStream.testRandomReadLargeFile

2023-04-12 Thread Steve Loughran (Jira)
Steve Loughran created HADOOP-18697: --- Summary: transient failure of ITestS3APrefetchingInputStream.testRandomReadLargeFile Key: HADOOP-18697 URL: https://issues.apache.org/jira/browse/HADOOP-18697

[jira] [Commented] (HADOOP-18696) S3A ITestS3ABucketExistence access point test failure

2023-04-12 Thread Steve Loughran (Jira)
[ https://issues.apache.org/jira/browse/HADOOP-18696?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17711521#comment-17711521 ] Steve Loughran commented on HADOOP-18696: - and storediag list of properties with eu-west in

[jira] [Created] (HADOOP-18696) S3A ITestS3ABucketExistence access point test failure

2023-04-12 Thread Steve Loughran (Jira)
Steve Loughran created HADOOP-18696: --- Summary: S3A ITestS3ABucketExistence access point test failure Key: HADOOP-18696 URL: https://issues.apache.org/jira/browse/HADOOP-18696 Project: Hadoop Common

[jira] [Commented] (HADOOP-18696) S3A ITestS3ABucketExistence access point test failure

2023-04-12 Thread Steve Loughran (Jira)
[ https://issues.apache.org/jira/browse/HADOOP-18696?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17711520#comment-17711520 ] Steve Loughran commented on HADOOP-18696: - full stack {code} [ERROR] Tests run: 6, Failures:

[jira] [Updated] (HADOOP-18695) S3A: reject multipart copy requests initiated by transfer manager when multipart api disabled

2023-04-12 Thread Steve Loughran (Jira)
[ https://issues.apache.org/jira/browse/HADOOP-18695?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Steve Loughran updated HADOOP-18695: Summary: S3A: reject multipart copy requests initiated by transfer manager when

[jira] [Commented] (HADOOP-18695) s3a fs to reject multipart copy-in-rename when multipart api disabled

2023-04-12 Thread Steve Loughran (Jira)
[ https://issues.apache.org/jira/browse/HADOOP-18695?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17711424#comment-17711424 ] Steve Loughran commented on HADOOP-18695: - auditor will raise access denied exception, ```

[jira] [Updated] (HADOOP-18695) s3a fs to reject multipart copy-in-rename when multipart api disabled

2023-04-12 Thread Steve Loughran (Jira)
[ https://issues.apache.org/jira/browse/HADOOP-18695?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Steve Loughran updated HADOOP-18695: Priority: Minor (was: Major) > s3a fs to reject multipart copy-in-rename when multipart

[jira] [Created] (HADOOP-18695) s3a fs to reject multipart copy-in-rename when multipart api disabled

2023-04-12 Thread Steve Loughran (Jira)
Steve Loughran created HADOOP-18695: --- Summary: s3a fs to reject multipart copy-in-rename when multipart api disabled Key: HADOOP-18695 URL: https://issues.apache.org/jira/browse/HADOOP-18695

[jira] [Commented] (HADOOP-18637) S3A to support upload of files greater than 2 GB using DiskBlocks

2023-04-12 Thread Steve Loughran (Jira)
[ https://issues.apache.org/jira/browse/HADOOP-18637?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17711390#comment-17711390 ] Steve Loughran commented on HADOOP-18637: - [~harshit.gupta] can you do a PR of the trunk commit

[jira] [Resolved] (HADOOP-18687) Remove unnecessary dependency on json-smart

2023-04-06 Thread Steve Loughran (Jira)
[ https://issues.apache.org/jira/browse/HADOOP-18687?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Steve Loughran resolved HADOOP-18687. - Fix Version/s: 3.4.0 Resolution: Fixed > Remove unnecessary dependency on

[jira] [Assigned] (HADOOP-18687) Remove unnecessary dependency on json-smart

2023-04-06 Thread Steve Loughran (Jira)
[ https://issues.apache.org/jira/browse/HADOOP-18687?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Steve Loughran reassigned HADOOP-18687: --- Assignee: Michiel de Jong > Remove unnecessary dependency on json-smart >

[jira] [Resolved] (HADOOP-18012) ABFS: Enable config controlled ETag check for Rename idempotency

2023-04-06 Thread Steve Loughran (Jira)
[ https://issues.apache.org/jira/browse/HADOOP-18012?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Steve Loughran resolved HADOOP-18012. - Resolution: Fixed > ABFS: Enable config controlled ETag check for Rename idempotency >

[jira] [Updated] (HADOOP-18012) ABFS: Enable config controlled ETag check for Rename idempotency

2023-04-06 Thread Steve Loughran (Jira)
[ https://issues.apache.org/jira/browse/HADOOP-18012?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Steve Loughran updated HADOOP-18012: Fix Version/s: 3.4.0 > ABFS: Enable config controlled ETag check for Rename idempotency

[jira] [Commented] (HADOOP-18689) Bump jettison from 1.5.3 to 1.5.4 in /hadoop-project

2023-04-06 Thread Steve Loughran (Jira)
[ https://issues.apache.org/jira/browse/HADOOP-18689?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17709418#comment-17709418 ] Steve Loughran commented on HADOOP-18689: - build versions, component ... etc > Bump jettison

[jira] [Resolved] (HADOOP-18684) S3A filesystem to support binding to other URI schemes

2023-04-05 Thread Steve Loughran (Jira)
[ https://issues.apache.org/jira/browse/HADOOP-18684?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Steve Loughran resolved HADOOP-18684. - Fix Version/s: 3.4.0 3.3.9 Assignee: Harshit Gupta

[jira] [Updated] (HADOOP-18684) S3A filesystem to support binding to other URI schemes

2023-04-05 Thread Steve Loughran (Jira)
[ https://issues.apache.org/jira/browse/HADOOP-18684?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Steve Loughran updated HADOOP-18684: Summary: S3A filesystem to support binding to other URI schemes (was: S3A filesystem to

[jira] [Commented] (HADOOP-18684) S3A filesystem to support binding to other URI schemes

2023-04-05 Thread Steve Loughran (Jira)
[ https://issues.apache.org/jira/browse/HADOOP-18684?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17708924#comment-17708924 ] Steve Loughran commented on HADOOP-18684: - aah, i committed this with a typo in the title "to

[jira] [Updated] (HADOOP-18012) ABFS: Enable config controlled ETag check for Rename idempotency

2023-04-05 Thread Steve Loughran (Jira)
[ https://issues.apache.org/jira/browse/HADOOP-18012?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Steve Loughran updated HADOOP-18012: Fix Version/s: 3.3.9 > ABFS: Enable config controlled ETag check for Rename idempotency

[jira] [Resolved] (HADOOP-18647) x-ms-client-request-id to have some way that identifies retry of an API.

2023-04-05 Thread Steve Loughran (Jira)
[ https://issues.apache.org/jira/browse/HADOOP-18647?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Steve Loughran resolved HADOOP-18647. - Resolution: Fixed > x-ms-client-request-id to have some way that identifies retry of

[jira] [Updated] (HADOOP-18684) S3A filesystem to support binding to to other URI schemes

2023-04-05 Thread Steve Loughran (Jira)
[ https://issues.apache.org/jira/browse/HADOOP-18684?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Steve Loughran updated HADOOP-18684: Description: Allow s3a filesystem to be bindable to other filesystem schemas, especially

[jira] [Updated] (HADOOP-18684) S3A filesystem to support binding to to other URI schemes

2023-04-05 Thread Steve Loughran (Jira)
[ https://issues.apache.org/jira/browse/HADOOP-18684?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Steve Loughran updated HADOOP-18684: Summary: S3A filesystem to support binding to to other URI schemes (was: Fix S3A

[jira] [Created] (HADOOP-18688) s3a audit info to include #of items in a DeleteObjects request

2023-03-31 Thread Steve Loughran (Jira)
Steve Loughran created HADOOP-18688: --- Summary: s3a audit info to include #of items in a DeleteObjects request Key: HADOOP-18688 URL: https://issues.apache.org/jira/browse/HADOOP-18688 Project:

[jira] [Updated] (HADOOP-18012) ABFS: Enable config controlled ETag check for Rename idempotency

2023-03-31 Thread Steve Loughran (Jira)
[ https://issues.apache.org/jira/browse/HADOOP-18012?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Steve Loughran updated HADOOP-18012: Description: To support recovery of comms failure during rename, the abfs client fetches

[jira] [Resolved] (HADOOP-18425) [ABFS]: RenameFilePath Source File Not Found (404) error in retry loop

2023-03-31 Thread Steve Loughran (Jira)
[ https://issues.apache.org/jira/browse/HADOOP-18425?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Steve Loughran resolved HADOOP-18425. - Resolution: Duplicate > [ABFS]: RenameFilePath Source File Not Found (404) error in

[jira] [Commented] (HADOOP-18685) Amazon S3 disabling ACLs on all new buckets

2023-03-31 Thread Steve Loughran (Jira)
[ https://issues.apache.org/jira/browse/HADOOP-18685?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17707280#comment-17707280 ] Steve Loughran commented on HADOOP-18685: - 1. what happens if the tests fail? 2. is there a

[jira] [Updated] (HADOOP-18647) x-ms-client-request-id to have some way that identifies retry of an API.

2023-03-30 Thread Steve Loughran (Jira)
[ https://issues.apache.org/jira/browse/HADOOP-18647?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Steve Loughran updated HADOOP-18647: Fix Version/s: 3.3.9 > x-ms-client-request-id to have some way that identifies retry of

[jira] [Commented] (HADOOP-18676) Include jettison as direct dependency of hadoop-common

2023-03-29 Thread Steve Loughran (Jira)
[ https://issues.apache.org/jira/browse/HADOOP-18676?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17706507#comment-17706507 ] Steve Loughran commented on HADOOP-18676: - should this go into branch-3.3? > Include jettison

[jira] [Resolved] (HADOOP-18146) ABFS: Add changes for expect hundred continue header with append requests

2023-03-28 Thread Steve Loughran (Jira)
[ https://issues.apache.org/jira/browse/HADOOP-18146?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Steve Loughran resolved HADOOP-18146. - Fix Version/s: 3.3.9 Resolution: Fixed > ABFS: Add changes for expect hundred

[jira] [Resolved] (HADOOP-18606) Add reason in in x-ms-client-request-id on a retry API call.

2023-03-28 Thread Steve Loughran (Jira)
[ https://issues.apache.org/jira/browse/HADOOP-18606?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Steve Loughran resolved HADOOP-18606. - Resolution: Fixed > Add reason in in x-ms-client-request-id on a retry API call. >

[jira] [Updated] (HADOOP-18606) Add reason in in x-ms-client-request-id on a retry API call.

2023-03-28 Thread Steve Loughran (Jira)
[ https://issues.apache.org/jira/browse/HADOOP-18606?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Steve Loughran updated HADOOP-18606: Fix Version/s: 3.3.9 > Add reason in in x-ms-client-request-id on a retry API call. >

[jira] [Resolved] (HADOOP-18672) ask: abfs connector to support checksum

2023-03-27 Thread Steve Loughran (Jira)
[ https://issues.apache.org/jira/browse/HADOOP-18672?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Steve Loughran resolved HADOOP-18672. - Resolution: Information Provided > ask: abfs connector to support checksum >

[jira] [Commented] (HADOOP-18679) Add API for bulk/paged object deletion

2023-03-27 Thread Steve Loughran (Jira)
[ https://issues.apache.org/jira/browse/HADOOP-18679?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17705326#comment-17705326 ] Steve Loughran commented on HADOOP-18679: - actually, i'd have the builder have a completion

[jira] [Updated] (HADOOP-18678) Broken links for arm build of hadoop 3.3.5

2023-03-27 Thread Steve Loughran (Jira)
[ https://issues.apache.org/jira/browse/HADOOP-18678?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Steve Loughran updated HADOOP-18678: Fix Version/s: 3.3.5 > Broken links for arm build of hadoop 3.3.5 >

[jira] [Updated] (HADOOP-18146) ABFS: Add changes for expect hundred continue header with append requests

2023-03-27 Thread Steve Loughran (Jira)
[ https://issues.apache.org/jira/browse/HADOOP-18146?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Steve Loughran updated HADOOP-18146: Affects Version/s: 3.3.5 (was: 3.3.1) > ABFS: Add changes for

[jira] [Updated] (HADOOP-18146) ABFS: Add changes for expect hundred continue header with append requests

2023-03-27 Thread Steve Loughran (Jira)
[ https://issues.apache.org/jira/browse/HADOOP-18146?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Steve Loughran updated HADOOP-18146: Target Version/s: 3.3.9 > ABFS: Add changes for expect hundred continue header with

[jira] [Updated] (HADOOP-18146) ABFS: Add changes for expect hundred continue header with append requests

2023-03-27 Thread Steve Loughran (Jira)
[ https://issues.apache.org/jira/browse/HADOOP-18146?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Steve Loughran updated HADOOP-18146: Component/s: fs/azure > ABFS: Add changes for expect hundred continue header with append

[jira] [Updated] (HADOOP-18146) ABFS: Add changes for expect hundred continue header with append requests

2023-03-27 Thread Steve Loughran (Jira)
[ https://issues.apache.org/jira/browse/HADOOP-18146?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Steve Loughran updated HADOOP-18146: Fix Version/s: 3.4.0 > ABFS: Add changes for expect hundred continue header with append

[jira] [Commented] (HADOOP-18679) Add API for bulk/paged object deletion

2023-03-24 Thread Steve Loughran (Jira)
[ https://issues.apache.org/jira/browse/HADOOP-18679?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17704653#comment-17704653 ] Steve Loughran commented on HADOOP-18679: - need to think about throttling here, maybe have a

[jira] [Commented] (HADOOP-18679) Add API for bulk/paged object deletion

2023-03-24 Thread Steve Loughran (Jira)
[ https://issues.apache.org/jira/browse/HADOOP-18679?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17704648#comment-17704648 ] Steve Loughran commented on HADOOP-18679: - h2. Possible API: delete queue app creates a

[jira] [Created] (HADOOP-18679) Add API for bulk/paged object deletion

2023-03-24 Thread Steve Loughran (Jira)
Steve Loughran created HADOOP-18679: --- Summary: Add API for bulk/paged object deletion Key: HADOOP-18679 URL: https://issues.apache.org/jira/browse/HADOOP-18679 Project: Hadoop Common Issue

[jira] [Resolved] (HADOOP-16800) ITestDynamoDBMetadataStore.testTableVersioning failure -DDB deleteItem consistency?

2023-03-24 Thread Steve Loughran (Jira)
[ https://issues.apache.org/jira/browse/HADOOP-16800?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Steve Loughran resolved HADOOP-16800. - Resolution: Won't Fix > ITestDynamoDBMetadataStore.testTableVersioning failure -DDB

[jira] [Commented] (HADOOP-18678) Broken links for arm build of hadoop 3.3.5

2023-03-24 Thread Steve Loughran (Jira)
[ https://issues.apache.org/jira/browse/HADOOP-18678?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17704569#comment-17704569 ] Steve Loughran commented on HADOOP-18678: - files have changed though it'll probably take a few

[jira] [Commented] (HADOOP-18676) Include jettison as direct dependency of hadoop-common

2023-03-24 Thread Steve Loughran (Jira)
[ https://issues.apache.org/jira/browse/HADOOP-18676?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17704562#comment-17704562 ] Steve Loughran commented on HADOOP-18676: - what versions does this affect? > Include jettison

[jira] [Assigned] (HADOOP-18678) Broken links for arm build of hadoop 3.3.5

2023-03-24 Thread Steve Loughran (Jira)
[ https://issues.apache.org/jira/browse/HADOOP-18678?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Steve Loughran reassigned HADOOP-18678: --- Assignee: Steve Loughran > Broken links for arm build of hadoop 3.3.5 >

[jira] [Commented] (HADOOP-18678) Broken links for arm build of hadoop 3.3.5

2023-03-24 Thread Steve Loughran (Jira)
[ https://issues.apache.org/jira/browse/HADOOP-18678?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17704545#comment-17704545 ] Steve Loughran commented on HADOOP-18678: - let me rename the files > Broken links for arm

[jira] [Commented] (HADOOP-18677) Hadoop "current" documentation link broken after release 3.3.5.

2023-03-23 Thread Steve Loughran (Jira)
[ https://issues.apache.org/jira/browse/HADOOP-18677?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17704350#comment-17704350 ] Steve Loughran commented on HADOOP-18677: - thanks, and sorry for breaking it. i had checked the

[jira] [Resolved] (HADOOP-18677) Hadoop "current" documentation link broken after release 3.3.5.

2023-03-23 Thread Steve Loughran (Jira)
[ https://issues.apache.org/jira/browse/HADOOP-18677?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Steve Loughran resolved HADOOP-18677. - Resolution: Fixed > Hadoop "current" documentation link broken after release 3.3.5. >

[jira] [Updated] (HADOOP-18159) Certificate doesn't match any of the subject alternative names: [*.s3.amazonaws.com, s3.amazonaws.com]

2023-03-23 Thread Steve Loughran (Jira)
[ https://issues.apache.org/jira/browse/HADOOP-18159?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Steve Loughran updated HADOOP-18159: Fix Version/s: 3.3.5 > Certificate doesn't match any of the subject alternative names:

[jira] [Resolved] (HADOOP-18470) Release hadoop 3.3.5

2023-03-23 Thread Steve Loughran (Jira)
[ https://issues.apache.org/jira/browse/HADOOP-18470?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Steve Loughran resolved HADOOP-18470. - Fix Version/s: 3.3.5 Assignee: Steve Loughran (was: Mukund Thakur)

[jira] [Commented] (HADOOP-18672) ask: abfs connector to support checksum

2023-03-23 Thread Steve Loughran (Jira)
[ https://issues.apache.org/jira/browse/HADOOP-18672?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17704088#comment-17704088 ] Steve Loughran commented on HADOOP-18672: - been a long time since I read that paper; I should

[jira] [Resolved] (HADOOP-18329) Add support for IBM Semeru OE JRE 11.0.15.0 and greater

2023-03-22 Thread Steve Loughran (Jira)
[ https://issues.apache.org/jira/browse/HADOOP-18329?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Steve Loughran resolved HADOOP-18329. - Resolution: Fixed closing as done. if it doesn't work, then create a follow on jira

[jira] [Updated] (HADOOP-18590) Publish SBOM artifacts

2023-03-22 Thread Steve Loughran (Jira)
[ https://issues.apache.org/jira/browse/HADOOP-18590?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Steve Loughran updated HADOOP-18590: Fix Version/s: (was: 3.4.0) (was: 3.3.5) > Publish SBOM

[jira] [Commented] (HADOOP-18671) Add recoverLease(), setSafeMode(), isFileClosed() APIs to FileSystem

2023-03-21 Thread Steve Loughran (Jira)
[ https://issues.apache.org/jira/browse/HADOOP-18671?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17703171#comment-17703171 ] Steve Loughran commented on HADOOP-18671: - i do think the api could be pulled up, but it MUST

[jira] [Resolved] (HADOOP-18672) ask: abfs connector to support checksum

2023-03-21 Thread Steve Loughran (Jira)
[ https://issues.apache.org/jira/browse/HADOOP-18672?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Steve Loughran resolved HADOOP-18672. - Resolution: Information Provided > ask: abfs connector to support checksum >

[jira] [Commented] (HADOOP-18672) ask: abfs connector to support checksum

2023-03-21 Thread Steve Loughran (Jira)
[ https://issues.apache.org/jira/browse/HADOOP-18672?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17703164#comment-17703164 ] Steve Loughran commented on HADOOP-18672: - azure storage doesn't have checksums it does have

[jira] [Resolved] (HADOOP-18670) Spark application's dependency conflicts with Hadoop's dependency

2023-03-20 Thread Steve Loughran (Jira)
[ https://issues.apache.org/jira/browse/HADOOP-18670?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Steve Loughran resolved HADOOP-18670. - Resolution: Invalid hadoop guava on 3.3.0+ is 27+. therefore this is unlikely to be a

[jira] [Resolved] (HADOOP-18578) Bump netty to the latest 4.1.86

2023-03-17 Thread Steve Loughran (Jira)
[ https://issues.apache.org/jira/browse/HADOOP-18578?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Steve Loughran resolved HADOOP-18578. - Fix Version/s: 3.4.0 Resolution: Duplicate > Bump netty to the latest 4.1.86 >

[jira] [Commented] (HADOOP-18668) Path capability probe for truncate is only honored by RawLocalFileSystem

2023-03-17 Thread Steve Loughran (Jira)
[ https://issues.apache.org/jira/browse/HADOOP-18668?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17701677#comment-17701677 ] Steve Loughran commented on HADOOP-18668: - can you mark versions; component as "fs" + all

[jira] [Updated] (HADOOP-18647) x-ms-client-request-id to have some way that identifies retry of an API.

2023-03-15 Thread Steve Loughran (Jira)
[ https://issues.apache.org/jira/browse/HADOOP-18647?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Steve Loughran updated HADOOP-18647: Affects Version/s: 3.3.5 > x-ms-client-request-id to have some way that identifies retry

[jira] [Assigned] (HADOOP-18012) ABFS: Enable config controlled ETag check for Rename idempotency

2023-03-15 Thread Steve Loughran (Jira)
[ https://issues.apache.org/jira/browse/HADOOP-18012?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Steve Loughran reassigned HADOOP-18012: --- Assignee: Sree Bhattacharyya (was: Sneha Vijayarajan) > ABFS: Enable config

[jira] [Commented] (HADOOP-18012) ABFS: Enable config controlled ETag check for Rename idempotency

2023-03-15 Thread Steve Loughran (Jira)
[ https://issues.apache.org/jira/browse/HADOOP-18012?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17700837#comment-17700837 ] Steve Loughran commented on HADOOP-18012: - Things I'd like * the option set by default. If

[jira] [Resolved] (HADOOP-18667) ABFS: eTag Check to mitigate Rename Failures

2023-03-15 Thread Steve Loughran (Jira)
[ https://issues.apache.org/jira/browse/HADOOP-18667?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Steve Loughran resolved HADOOP-18667. - Resolution: Duplicate > ABFS: eTag Check to mitigate Rename Failures >

[jira] [Commented] (HADOOP-18667) ABFS: eTag Check to mitigate Rename Failures

2023-03-15 Thread Steve Loughran (Jira)
[ https://issues.apache.org/jira/browse/HADOOP-18667?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17700835#comment-17700835 ] Steve Loughran commented on HADOOP-18667: - Sneha created HADOOP-18012 for this a while back;

[jira] [Updated] (HADOOP-17746) compatibility table in directory_markers.md doesn't render right

2023-03-15 Thread Steve Loughran (Jira)
[ https://issues.apache.org/jira/browse/HADOOP-17746?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Steve Loughran updated HADOOP-17746: Fix Version/s: 3.3.9 Assignee: Masatake Iwasaki (was: Steve Loughran)

<    6   7   8   9   10   11   12   13   14   15   >