[jira] [Updated] (HADOOP-18981) Move oncrpc/portmap from hadoop-nfs to hadoop-common

2024-01-11 Thread Steve Loughran (Jira)
[ https://issues.apache.org/jira/browse/HADOOP-18981?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Steve Loughran updated HADOOP-18981: Fix Version/s: 3.5.0 (was: 3.4.0) > Move oncrpc/portmap from

[jira] [Updated] (HADOOP-19004) S3A: Support Authentication through HttpSigner API

2024-01-11 Thread Steve Loughran (Jira)
[ https://issues.apache.org/jira/browse/HADOOP-19004?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Steve Loughran updated HADOOP-19004: Fix Version/s: 3.5.0 > S3A: Support Authentication through HttpSigner API >

[jira] [Updated] (HADOOP-19004) S3A: Support Authentication through HttpSigner API

2024-01-11 Thread Steve Loughran (Jira)
[ https://issues.apache.org/jira/browse/HADOOP-19004?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Steve Loughran updated HADOOP-19004: Fix Version/s: (was: 3.4.0) > S3A: Support Authentication through HttpSigner API >

[jira] [Resolved] (HADOOP-19004) S3A: Support Authentication through HttpSigner API

2024-01-11 Thread Steve Loughran (Jira)
[ https://issues.apache.org/jira/browse/HADOOP-19004?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Steve Loughran resolved HADOOP-19004. - Fix Version/s: 3.4.0 Resolution: Fixed > S3A: Support Authentication through

[jira] [Updated] (HADOOP-18981) Move oncrpc/portmap from hadoop-nfs to hadoop-common

2024-01-11 Thread Steve Loughran (Jira)
[ https://issues.apache.org/jira/browse/HADOOP-18981?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Steve Loughran updated HADOOP-18981: Component/s: net > Move oncrpc/portmap from hadoop-nfs to hadoop-common >

[jira] [Resolved] (HADOOP-18981) Move oncrpc/portmap from hadoop-nfs to hadoop-common

2024-01-11 Thread Steve Loughran (Jira)
[ https://issues.apache.org/jira/browse/HADOOP-18981?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Steve Loughran resolved HADOOP-18981. - Fix Version/s: 3.4.0 Resolution: Fixed > Move oncrpc/portmap from hadoop-nfs to

[jira] [Created] (HADOOP-19033) S3A: disable checksum validation

2024-01-10 Thread Steve Loughran (Jira)
Steve Loughran created HADOOP-19033: --- Summary: S3A: disable checksum validation Key: HADOOP-19033 URL: https://issues.apache.org/jira/browse/HADOOP-19033 Project: Hadoop Common Issue Type:

[jira] [Updated] (HADOOP-19032) S3A: ITestS3AFileContextURI: MultiObjectDeleteException bulk delete of odd filenames

2024-01-10 Thread Steve Loughran (Jira)
[ https://issues.apache.org/jira/browse/HADOOP-19032?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Steve Loughran updated HADOOP-19032: Summary: S3A: ITestS3AFileContextURI: MultiObjectDeleteException bulk delete of odd

[jira] [Updated] (HADOOP-19032) S3A: ITestS3AFileContextURI: MultiObjectDeleteException bulk delete of odd filenames in

2024-01-10 Thread Steve Loughran (Jira)
[ https://issues.apache.org/jira/browse/HADOOP-19032?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Steve Loughran updated HADOOP-19032: Summary: S3A: ITestS3AFileContextURI: MultiObjectDeleteException bulk delete of odd

[jira] [Commented] (HADOOP-19032) MultiObjectDeleteException bulk delete of odd filenames

2024-01-10 Thread Steve Loughran (Jira)
[ https://issues.apache.org/jira/browse/HADOOP-19032?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17805169#comment-17805169 ] Steve Loughran commented on HADOOP-19032: - {code} [ERROR] Tests run: 17, Failures: 0, Errors:

[jira] [Created] (HADOOP-19032) MultiObjectDeleteException bulk delete of odd filenames

2024-01-10 Thread Steve Loughran (Jira)
Steve Loughran created HADOOP-19032: --- Summary: MultiObjectDeleteException bulk delete of odd filenames Key: HADOOP-19032 URL: https://issues.apache.org/jira/browse/HADOOP-19032 Project: Hadoop

[jira] [Commented] (HADOOP-19027) S3A: S3AInputStream doesn't recover from HTTP/channel exceptions

2024-01-09 Thread Steve Loughran (Jira)
[ https://issues.apache.org/jira/browse/HADOOP-19027?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17804710#comment-17804710 ] Steve Loughran commented on HADOOP-19027: - doing the mocking tests to simulate all the

[jira] [Updated] (HADOOP-19027) S3A: S3AInputStream doesn't recover from HTTP/channel exceptions

2024-01-08 Thread Steve Loughran (Jira)
[ https://issues.apache.org/jira/browse/HADOOP-19027?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Steve Loughran updated HADOOP-19027: Summary: S3A: S3AInputStream doesn't recover from HTTP/channel exceptions (was: S3A:

[jira] [Commented] (HADOOP-19027) S3A: S3AInputStream doesn't recover from HTTP exceptions

2024-01-05 Thread Steve Loughran (Jira)
[ https://issues.apache.org/jira/browse/HADOOP-19027?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17803659#comment-17803659 ] Steve Loughran commented on HADOOP-19027: - The retry logic in S3AInputStream only seems to

[jira] [Commented] (HADOOP-19027) S3A: S3AInputStream doesn't recover from HTTP exceptions

2024-01-05 Thread Steve Loughran (Jira)
[ https://issues.apache.org/jira/browse/HADOOP-19027?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17803654#comment-17803654 ] Steve Loughran commented on HADOOP-19027: - full stack trace {code}

[jira] [Commented] (HADOOP-19027) S3A: S3AInputStream doesn't recover from HTTP exceptions

2024-01-05 Thread Steve Loughran (Jira)
[ https://issues.apache.org/jira/browse/HADOOP-19027?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17803649#comment-17803649 ] Steve Loughran commented on HADOOP-19027: - openssl, "stream is closed" {code} Error while

[jira] [Created] (HADOOP-19027) S3A: S3AInputStream doesn't recover from HTTP exceptions

2024-01-05 Thread Steve Loughran (Jira)
Steve Loughran created HADOOP-19027: --- Summary: S3A: S3AInputStream doesn't recover from HTTP exceptions Key: HADOOP-19027 URL: https://issues.apache.org/jira/browse/HADOOP-19027 Project: Hadoop

[jira] [Updated] (HADOOP-18886) S3A: AWS SDK V2 Migration: stabilization and S3Express

2024-01-05 Thread Steve Loughran (Jira)
[ https://issues.apache.org/jira/browse/HADOOP-18886?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Steve Loughran updated HADOOP-18886: Description: The final stabilisation changes to the V2 SDK MIgration; those moved off

[jira] [Commented] (HADOOP-19023) ITestS3AConcurrentOps#testParallelRename intermittent timeout failure

2024-01-05 Thread Steve Loughran (Jira)
[ https://issues.apache.org/jira/browse/HADOOP-19023?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17803521#comment-17803521 ] Steve Loughran commented on HADOOP-19023: - * make sure you've not got a site config with an

[jira] [Updated] (HADOOP-19023) ITestS3AConcurrentOps#testParallelRename intermittent timeout failure

2024-01-05 Thread Steve Loughran (Jira)
[ https://issues.apache.org/jira/browse/HADOOP-19023?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Steve Loughran updated HADOOP-19023: Component/s: fs/s3 > ITestS3AConcurrentOps#testParallelRename intermittent timeout

[jira] [Updated] (HADOOP-19023) ITestS3AConcurrentOps#testParallelRename intermittent timeout failure

2024-01-05 Thread Steve Loughran (Jira)
[ https://issues.apache.org/jira/browse/HADOOP-19023?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Steve Loughran updated HADOOP-19023: Affects Version/s: 3.4.0 > ITestS3AConcurrentOps#testParallelRename intermittent timeout

[jira] [Updated] (HADOOP-19022) ITestS3AConfiguration#testRequestTimeout failure

2024-01-05 Thread Steve Loughran (Jira)
[ https://issues.apache.org/jira/browse/HADOOP-19022?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Steve Loughran updated HADOOP-19022: Component/s: fs/s3 test > ITestS3AConfiguration#testRequestTimeout

[jira] [Comment Edited] (HADOOP-19022) ITestS3AConfiguration#testRequestTimeout failure

2024-01-05 Thread Steve Loughran (Jira)
[ https://issues.apache.org/jira/browse/HADOOP-19022?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17803520#comment-17803520 ] Steve Loughran edited comment on HADOOP-19022 at 1/5/24 11:51 AM: --

[jira] [Updated] (HADOOP-19022) ITestS3AConfiguration#testRequestTimeout failure

2024-01-05 Thread Steve Loughran (Jira)
[ https://issues.apache.org/jira/browse/HADOOP-19022?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Steve Loughran updated HADOOP-19022: Affects Version/s: 3.4.0 > ITestS3AConfiguration#testRequestTimeout failure >

[jira] [Commented] (HADOOP-19022) ITestS3AConfiguration#testRequestTimeout failure

2024-01-05 Thread Steve Loughran (Jira)
[ https://issues.apache.org/jira/browse/HADOOP-19022?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17803520#comment-17803520 ] Steve Loughran commented on HADOOP-19022: - should be a string now, e.g "20s" >

[jira] [Commented] (HADOOP-19025) Migrate ContractTestUtils to AssertJ

2024-01-05 Thread Steve Loughran (Jira)
[ https://issues.apache.org/jira/browse/HADOOP-19025?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17803519#comment-17803519 ] Steve Loughran commented on HADOOP-19025: - looking forward to this! > Migrate

[jira] [Commented] (HADOOP-19026) S3A: TestIAMInstanceCredentialsProvider.testIAMInstanceCredentialsInstantiate failure

2024-01-05 Thread Steve Loughran (Jira)
[ https://issues.apache.org/jira/browse/HADOOP-19026?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17803518#comment-17803518 ] Steve Loughran commented on HADOOP-19026: - {code} java.lang.AssertionError: Cause not a

[jira] [Created] (HADOOP-19026) S3A: TestIAMInstanceCredentialsProvider.testIAMInstanceCredentialsInstantiate failure

2024-01-05 Thread Steve Loughran (Jira)
Steve Loughran created HADOOP-19026: --- Summary: S3A: TestIAMInstanceCredentialsProvider.testIAMInstanceCredentialsInstantiate failure Key: HADOOP-19026 URL: https://issues.apache.org/jira/browse/HADOOP-19026

[jira] [Updated] (HADOOP-17912) ABFS: Support for Encryption Context

2024-01-03 Thread Steve Loughran (Jira)
[ https://issues.apache.org/jira/browse/HADOOP-17912?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Steve Loughran updated HADOOP-17912: Fix Version/s: 3.3.9 > ABFS: Support for Encryption Context >

[jira] [Updated] (HADOOP-19021) [ABFS] move to jdk11 HttpClient for http2 and connection keep alive

2024-01-02 Thread Steve Loughran (Jira)
[ https://issues.apache.org/jira/browse/HADOOP-19021?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Steve Loughran updated HADOOP-19021: Summary: [ABFS] move to jdk11 HttpClient for http2 and connection keep alive (was: in

[jira] [Commented] (HADOOP-18991) Remove commons-beanutils dependency from Hadoop 3

2024-01-02 Thread Steve Loughran (Jira)
[ https://issues.apache.org/jira/browse/HADOOP-18991?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17801756#comment-17801756 ] Steve Loughran commented on HADOOP-18991: - so leave in branch-3.3 and noted as optional; cut

[jira] [Resolved] (HADOOP-19017) Setup pre-commit CI for Windows 10

2024-01-02 Thread Steve Loughran (Jira)
[ https://issues.apache.org/jira/browse/HADOOP-19017?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Steve Loughran resolved HADOOP-19017. - Fix Version/s: 3.4.0 Resolution: Fixed > Setup pre-commit CI for Windows 10 >

[jira] [Commented] (HADOOP-18991) Remove commons-beanutils dependency from Hadoop 3

2024-01-01 Thread Steve Loughran (Jira)
[ https://issues.apache.org/jira/browse/HADOOP-18991?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17801599#comment-17801599 ] Steve Loughran commented on HADOOP-18991: - hive should add explicit dependencies here > Remove

[jira] [Updated] (HADOOP-17347) ABFS: read/cache footer with fs.azure.footer.read.request.size

2024-01-01 Thread Steve Loughran (Jira)
[ https://issues.apache.org/jira/browse/HADOOP-17347?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Steve Loughran updated HADOOP-17347: Summary: ABFS: read/cache footer with fs.azure.footer.read.request.size (was: ABFS:

[jira] [Resolved] (HADOOP-17912) ABFS: Support for Encryption Context

2024-01-01 Thread Steve Loughran (Jira)
[ https://issues.apache.org/jira/browse/HADOOP-17912?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Steve Loughran resolved HADOOP-17912. - Fix Version/s: 3.4.0 Resolution: Fixed > ABFS: Support for Encryption Context >

[jira] [Resolved] (HADOOP-18540) Upgrade Bouncy Castle to 1.70

2024-01-01 Thread Steve Loughran (Jira)
[ https://issues.apache.org/jira/browse/HADOOP-18540?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Steve Loughran resolved HADOOP-18540. - Fix Version/s: 3.4.0 Resolution: Fixed > Upgrade Bouncy Castle to 1.70 >

[jira] [Commented] (HADOOP-19013) fs.getXattrs(path) for S3FS doesn't have x-amz-server-side-encryption-aws-kms-key-id header.

2024-01-01 Thread Steve Loughran (Jira)
[ https://issues.apache.org/jira/browse/HADOOP-19013?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17801542#comment-17801542 ] Steve Loughran commented on HADOOP-19013: - this a standard header? or do you just think it'd be

[jira] [Resolved] (HADOOP-19008) S3A: Upgrade AWS SDK to 2.21.41

2023-12-12 Thread Steve Loughran (Jira)
[ https://issues.apache.org/jira/browse/HADOOP-19008?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Steve Loughran resolved HADOOP-19008. - Fix Version/s: 3.4.0 Resolution: Fixed > S3A: Upgrade AWS SDK to 2.21.41 >

[jira] [Created] (HADOOP-19008) S3A: Upgrade AWS SDK to 2.21.41

2023-12-08 Thread Steve Loughran (Jira)
Steve Loughran created HADOOP-19008: --- Summary: S3A: Upgrade AWS SDK to 2.21.41 Key: HADOOP-19008 URL: https://issues.apache.org/jira/browse/HADOOP-19008 Project: Hadoop Common Issue Type:

[jira] [Resolved] (HADOOP-18999) S3A: debug logging for http traffic to S3 stores

2023-12-08 Thread Steve Loughran (Jira)
[ https://issues.apache.org/jira/browse/HADOOP-18999?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Steve Loughran resolved HADOOP-18999. - Resolution: Not A Problem no longer needed as 2.21.41 logs properly! > S3A: debug

[jira] [Commented] (HADOOP-19007) S3A: transfer manager not wired up to s3a executor pool

2023-12-08 Thread Steve Loughran (Jira)
[ https://issues.apache.org/jira/browse/HADOOP-19007?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17794656#comment-17794656 ] Steve Loughran commented on HADOOP-19007: - [~ahmar] any specific reason why this isn't done?

[jira] [Created] (HADOOP-19007) S3A: transfer manager not wired up to s3a executor pool

2023-12-08 Thread Steve Loughran (Jira)
Steve Loughran created HADOOP-19007: --- Summary: S3A: transfer manager not wired up to s3a executor pool Key: HADOOP-19007 URL: https://issues.apache.org/jira/browse/HADOOP-19007 Project: Hadoop

[jira] [Commented] (HADOOP-18915) Tune/extend S3A http connection and thread pool settings

2023-12-07 Thread Steve Loughran (Jira)
[ https://issues.apache.org/jira/browse/HADOOP-18915?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17794302#comment-17794302 ] Steve Loughran commented on HADOOP-18915: - looking at the AWS SDK source, it looks like the

[jira] [Commented] (HADOOP-18540) Upgrade Bouncy Castle to 1.70

2023-12-07 Thread Steve Loughran (Jira)
[ https://issues.apache.org/jira/browse/HADOOP-18540?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17794283#comment-17794283 ] Steve Loughran commented on HADOOP-18540: - [~BilwaST] ok, lets get that PR rebased for a retest

[jira] [Resolved] (HADOOP-18925) S3A: add option "fs.s3a.copy.from.local.enabled" to enable/disable CopyFromLocalOperation

2023-12-07 Thread Steve Loughran (Jira)
[ https://issues.apache.org/jira/browse/HADOOP-18925?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Steve Loughran resolved HADOOP-18925. - Fix Version/s: 3.4.0 3.3.9 Resolution: Fixed > S3A: add

[jira] [Resolved] (HADOOP-18997) S3A: Add option fs.s3a.s3express.create.session to enable/disable CreateSession

2023-12-07 Thread Steve Loughran (Jira)
[ https://issues.apache.org/jira/browse/HADOOP-18997?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Steve Loughran resolved HADOOP-18997. - Fix Version/s: 3.4.0 Resolution: Fixed > S3A: Add option

[jira] [Updated] (HADOOP-19004) S3A: Support Authentication through HttpSigner API

2023-12-06 Thread Steve Loughran (Jira)
[ https://issues.apache.org/jira/browse/HADOOP-19004?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Steve Loughran updated HADOOP-19004: Summary: S3A: Support Authentication through HttpSigner API (was: S3A: Move to a new

[jira] [Created] (HADOOP-19004) S3A: Move to a new HttpSigner for S3Express

2023-12-05 Thread Steve Loughran (Jira)
Steve Loughran created HADOOP-19004: --- Summary: S3A: Move to a new HttpSigner for S3Express Key: HADOOP-19004 URL: https://issues.apache.org/jira/browse/HADOOP-19004 Project: Hadoop Common

[jira] [Resolved] (HADOOP-18955) AWS SDK v2: add path capability probe "fs.s3a.capability.aws.v2"

2023-12-05 Thread Steve Loughran (Jira)
[ https://issues.apache.org/jira/browse/HADOOP-18955?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Steve Loughran resolved HADOOP-18955. - Fix Version/s: 3.4.0 Resolution: Fixed Fixed in HADOOP-18996 > AWS SDK v2: add

[jira] [Resolved] (HADOOP-18961) S3A: add s3guard command "bucket" to create buckets

2023-12-05 Thread Steve Loughran (Jira)
[ https://issues.apache.org/jira/browse/HADOOP-18961?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Steve Loughran resolved HADOOP-18961. - Fix Version/s: 3.4.0 Resolution: Fixed Fixed in HADOOP-18996 > S3A: add

[jira] [Updated] (HADOOP-18997) S3A: Add option fs.s3a.s3express.create.session to enable/disable CreateSession

2023-12-05 Thread Steve Loughran (Jira)
[ https://issues.apache.org/jira/browse/HADOOP-18997?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Steve Loughran updated HADOOP-18997: Summary: S3A: Add option fs.s3a.s3express.create.session to enable/disable CreateSession

[jira] [Assigned] (HADOOP-18708) AWS SDK V2 - Implement CSE

2023-12-05 Thread Steve Loughran (Jira)
[ https://issues.apache.org/jira/browse/HADOOP-18708?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Steve Loughran reassigned HADOOP-18708: --- Assignee: Ahmar Suhail > AWS SDK V2 - Implement CSE > --

[jira] [Commented] (HADOOP-19003) S3A Assume role tests failing against S3Express stores

2023-12-05 Thread Steve Loughran (Jira)
[ https://issues.apache.org/jira/browse/HADOOP-19003?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17793310#comment-17793310 ] Steve Loughran commented on HADOOP-19003: - {code} [ERROR]

[jira] [Created] (HADOOP-19003) S3A Assume role tests failing against S3Express stores

2023-12-05 Thread Steve Loughran (Jira)
Steve Loughran created HADOOP-19003: --- Summary: S3A Assume role tests failing against S3Express stores Key: HADOOP-19003 URL: https://issues.apache.org/jira/browse/HADOOP-19003 Project: Hadoop Common

[jira] [Updated] (HADOOP-18997) S3A: add way to turn off CreateSession API

2023-12-05 Thread Steve Loughran (Jira)
[ https://issues.apache.org/jira/browse/HADOOP-18997?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Steve Loughran updated HADOOP-18997: Description: add a way to disable the need to use the createsession call, so as to allow

[jira] [Updated] (HADOOP-18968) S3A FileSystem does not correctly list empty directories after HADOOP-17199

2023-12-05 Thread Steve Loughran (Jira)
[ https://issues.apache.org/jira/browse/HADOOP-18968?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Steve Loughran updated HADOOP-18968: Component/s: fs/s3 > S3A FileSystem does not correctly list empty directories after

[jira] [Commented] (HADOOP-19000) Unknown S3Express bucket raises UnknownHostException rather than NoSuchBucketException; will block for retries

2023-12-04 Thread Steve Loughran (Jira)
[ https://issues.apache.org/jira/browse/HADOOP-19000?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17792835#comment-17792835 ] Steve Loughran commented on HADOOP-19000: - no, not related to HADOOP-18915, though if

[jira] [Commented] (HADOOP-19001) LD_LIBRARY_PATH is missing HADOOP_COMMON_LIB_NATIVE_DIR

2023-12-02 Thread Steve Loughran (Jira)
[ https://issues.apache.org/jira/browse/HADOOP-19001?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17792400#comment-17792400 ] Steve Loughran commented on HADOOP-19001: - we've tried to lock this down for security, if you

[jira] [Updated] (HADOOP-19000) Unknown S3Express bucket raises UnknownHostException rather than NoSuchBucketException; will block for retries

2023-12-01 Thread Steve Loughran (Jira)
[ https://issues.apache.org/jira/browse/HADOOP-19000?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Steve Loughran updated HADOOP-19000: Summary: Unknown S3Express bucket raises UnknownHostException rather than

[jira] [Comment Edited] (HADOOP-19000) Unknown S3Express bucket raises UnknownHostException rather than NoSuckBucketException

2023-12-01 Thread Steve Loughran (Jira)
[ https://issues.apache.org/jira/browse/HADOOP-19000?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17792110#comment-17792110 ] Steve Loughran edited comment on HADOOP-19000 at 12/1/23 3:34 PM: --

[jira] [Commented] (HADOOP-19000) Unknown S3Express bucket raises UnknownHostException rather than NoSuckBucketException

2023-12-01 Thread Steve Loughran (Jira)
[ https://issues.apache.org/jira/browse/HADOOP-19000?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17792112#comment-17792112 ] Steve Loughran commented on HADOOP-19000: - now, set the retries to 10 and instead of any UHE

[jira] [Commented] (HADOOP-19000) Unknown S3Express bucket raises UnknownHostException rather than NoSuckBucketException

2023-12-01 Thread Steve Loughran (Jira)
[ https://issues.apache.org/jira/browse/HADOOP-19000?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17792110#comment-17792110 ] Steve Loughran commented on HADOOP-19000: - replicate by trying to list a bucket which isn't

[jira] [Created] (HADOOP-19000) Unknown S3Express bucket raises UnknownHostException rather than NoSuckBucketException

2023-12-01 Thread Steve Loughran (Jira)
Steve Loughran created HADOOP-19000: --- Summary: Unknown S3Express bucket raises UnknownHostException rather than NoSuckBucketException Key: HADOOP-19000 URL: https://issues.apache.org/jira/browse/HADOOP-19000

[jira] [Updated] (HADOOP-18996) S3A to provide full support for S3 Express One Zone

2023-12-01 Thread Steve Loughran (Jira)
[ https://issues.apache.org/jira/browse/HADOOP-18996?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Steve Loughran updated HADOOP-18996: Parent Issue: HADOOP-18886 (was: HADOOP-18477) > S3A to provide full support for S3

[jira] [Updated] (HADOOP-18996) S3A to provide full support for S3 Express One Zone

2023-12-01 Thread Steve Loughran (Jira)
[ https://issues.apache.org/jira/browse/HADOOP-18996?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Steve Loughran updated HADOOP-18996: Release Note: Hadoop S3A connector has explicit awareness of and support for S3Express

[jira] [Created] (HADOOP-18999) S3A: debug logging for http traffic to S3 stores

2023-12-01 Thread Steve Loughran (Jira)
Steve Loughran created HADOOP-18999: --- Summary: S3A: debug logging for http traffic to S3 stores Key: HADOOP-18999 URL: https://issues.apache.org/jira/browse/HADOOP-18999 Project: Hadoop Common

[jira] [Updated] (HADOOP-18886) S3A: AWS SDK V2 Migration: stabilization and S3Express

2023-12-01 Thread Steve Loughran (Jira)
[ https://issues.apache.org/jira/browse/HADOOP-18886?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Steve Loughran updated HADOOP-18886: Summary: S3A: AWS SDK V2 Migration: stabilization and S3Express (was: S3A: AWS SDK V2

[jira] [Assigned] (HADOOP-18997) S3A: add way to turn off CreateSession API

2023-12-01 Thread Steve Loughran (Jira)
[ https://issues.apache.org/jira/browse/HADOOP-18997?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Steve Loughran reassigned HADOOP-18997: --- Assignee: Steve Loughran > S3A: add way to turn off CreateSession API >

[jira] [Resolved] (HADOOP-18996) S3A to provide full support for S3 Express One Zone

2023-12-01 Thread Steve Loughran (Jira)
[ https://issues.apache.org/jira/browse/HADOOP-18996?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Steve Loughran resolved HADOOP-18996. - Fix Version/s: 3.4.0 Resolution: Fixed > S3A to provide full support for S3

[jira] [Created] (HADOOP-18997) S3A: add way to turn off CreateSession API

2023-11-30 Thread Steve Loughran (Jira)
Steve Loughran created HADOOP-18997: --- Summary: S3A: add way to turn off CreateSession API Key: HADOOP-18997 URL: https://issues.apache.org/jira/browse/HADOOP-18997 Project: Hadoop Common

[jira] [Commented] (HADOOP-18996) S3A to provide full support for S3 Express One Zone

2023-11-29 Thread Steve Loughran (Jira)
[ https://issues.apache.org/jira/browse/HADOOP-18996?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17791267#comment-17791267 ] Steve Loughran commented on HADOOP-18996: - PR is up; as I say in the PR, if people review it

[jira] [Updated] (HADOOP-18996) S3A to provide full support for S3 Express One Zone

2023-11-29 Thread Steve Loughran (Jira)
[ https://issues.apache.org/jira/browse/HADOOP-18996?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Steve Loughran updated HADOOP-18996: Description: HADOOP-18995 upgrades the SDK version which allows connecting to a s3

[jira] [Updated] (HADOOP-18996) S3A to provide full support for S3 Express One Zone

2023-11-29 Thread Steve Loughran (Jira)
[ https://issues.apache.org/jira/browse/HADOOP-18996?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Steve Loughran updated HADOOP-18996: Summary: S3A to provide full support for S3 Express One Zone (was: Add necessary

[jira] [Resolved] (HADOOP-18915) Tune/extend S3A http connection and thread pool settings

2023-11-29 Thread Steve Loughran (Jira)
[ https://issues.apache.org/jira/browse/HADOOP-18915?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Steve Loughran resolved HADOOP-18915. - Fix Version/s: 3.4.0 Resolution: Fixed > Tune/extend S3A http connection and

[jira] [Updated] (HADOOP-18915) Tune/extend S3A http connection and thread pool settings

2023-11-29 Thread Steve Loughran (Jira)
[ https://issues.apache.org/jira/browse/HADOOP-18915?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Steve Loughran updated HADOOP-18915: Summary: Tune/extend S3A http connection and thread pool settings (was: Extend S3A http

[jira] [Updated] (HADOOP-18915) Extend S3A http client connection timeouts

2023-11-29 Thread Steve Loughran (Jira)
[ https://issues.apache.org/jira/browse/HADOOP-18915?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Steve Loughran updated HADOOP-18915: Description: Increases existing pool sizes, as with server scale and vector IO, larger

[jira] [Resolved] (HADOOP-18995) S3A: Upgrade AWS SDK version to 2.21.33 for Amazon S3 Express One Zone support

2023-11-29 Thread Steve Loughran (Jira)
[ https://issues.apache.org/jira/browse/HADOOP-18995?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Steve Loughran resolved HADOOP-18995. - Fix Version/s: 3.4.0 Resolution: Fixed > S3A: Upgrade AWS SDK version to

[jira] [Updated] (HADOOP-18995) S3A: Upgrade AWS SDK version to 2.21.33 for Amazon S3 Express One Zone support

2023-11-29 Thread Steve Loughran (Jira)
[ https://issues.apache.org/jira/browse/HADOOP-18995?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Steve Loughran updated HADOOP-18995: Summary: S3A: Upgrade AWS SDK version to 2.21.33 for Amazon S3 Express One Zone support

[jira] [Commented] (HADOOP-18996) Add necessary software support for S3 Express One Zone

2023-11-29 Thread Steve Loughran (Jira)
[ https://issues.apache.org/jira/browse/HADOOP-18996?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17791037#comment-17791037 ] Steve Loughran commented on HADOOP-18996: - i can probably help here > Add necessary software

[jira] [Assigned] (HADOOP-18996) Add necessary software support for S3 Express One Zone

2023-11-29 Thread Steve Loughran (Jira)
[ https://issues.apache.org/jira/browse/HADOOP-18996?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Steve Loughran reassigned HADOOP-18996: --- Assignee: Steve Loughran > Add necessary software support for S3 Express One Zone

[jira] [Updated] (HADOOP-18994) Support OpenSSL 3

2023-11-28 Thread Steve Loughran (Jira)
[ https://issues.apache.org/jira/browse/HADOOP-18994?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Steve Loughran updated HADOOP-18994: Summary: Support OpenSSL 3 (was: Support OpneSSL 3) > Support OpenSSL 3 >

[jira] [Updated] (HADOOP-18991) Remove commons-benautils dependency from Hadoop 3

2023-11-28 Thread Steve Loughran (Jira)
[ https://issues.apache.org/jira/browse/HADOOP-18991?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Steve Loughran updated HADOOP-18991: Issue Type: Improvement (was: Bug) > Remove commons-benautils dependency from Hadoop 3

[jira] [Created] (HADOOP-18990) S3A: retry on credential expiry

2023-11-25 Thread Steve Loughran (Jira)
Steve Loughran created HADOOP-18990: --- Summary: S3A: retry on credential expiry Key: HADOOP-18990 URL: https://issues.apache.org/jira/browse/HADOOP-18990 Project: Hadoop Common Issue Type:

[jira] [Updated] (HADOOP-18915) Extend S3A http client connection timeouts

2023-11-25 Thread Steve Loughran (Jira)
[ https://issues.apache.org/jira/browse/HADOOP-18915?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Steve Loughran updated HADOOP-18915: Description: * Add ability to configure *all* timeouts, especially acquisition time *

[jira] [Updated] (HADOOP-18915) Extend S3A http client connection timeouts

2023-11-25 Thread Steve Loughran (Jira)
[ https://issues.apache.org/jira/browse/HADOOP-18915?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Steve Loughran updated HADOOP-18915: Summary: Extend S3A http client connection timeouts (was: S3A client builder to use

[jira] [Comment Edited] (HADOOP-17372) S3A AWS Credential provider loading gets confused with isolated classloaders

2023-11-25 Thread Steve Loughran (Jira)
[ https://issues.apache.org/jira/browse/HADOOP-17372?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17789547#comment-17789547 ] Steve Loughran edited comment on HADOOP-17372 at 11/25/23 12:25 PM:

[jira] [Commented] (HADOOP-17372) S3A AWS Credential provider loading gets confused with isolated classloaders

2023-11-24 Thread Steve Loughran (Jira)
[ https://issues.apache.org/jira/browse/HADOOP-17372?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17789547#comment-17789547 ] Steve Loughran commented on HADOOP-17372: - well, an option to disable isolated classloader is

[jira] [Reopened] (HADOOP-18930) S3A: make fs.s3a.create.performance an option you can set for the entire bucket

2023-11-24 Thread Steve Loughran (Jira)
[ https://issues.apache.org/jira/browse/HADOOP-18930?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Steve Loughran reopened HADOOP-18930: - going to do a quick followup; noticed I'd set the default to true, which is a bit unsafe.

[jira] [Commented] (HADOOP-18915) S3A client builder to use getTImeDuration() for HTTP timeouts

2023-11-24 Thread Steve Loughran (Jira)
[ https://issues.apache.org/jira/browse/HADOOP-18915?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17789472#comment-17789472 ] Steve Loughran commented on HADOOP-18915: - Here are the default timeouts in the synchronous

[jira] [Assigned] (HADOOP-18987) Corrections to Hadoop FileSystem API Definition

2023-11-23 Thread Steve Loughran (Jira)
[ https://issues.apache.org/jira/browse/HADOOP-18987?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Steve Loughran reassigned HADOOP-18987: --- Assignee: Dieter De Paepe > Corrections to Hadoop FileSystem API Definition >

[jira] [Updated] (HADOOP-18987) Corrections to Hadoop FileSystem API Definition

2023-11-23 Thread Steve Loughran (Jira)
[ https://issues.apache.org/jira/browse/HADOOP-18987?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Steve Loughran updated HADOOP-18987: Affects Version/s: 3.3.6 > Corrections to Hadoop FileSystem API Definition >

[jira] [Resolved] (HADOOP-18969) S3A: AbstractS3ACostTest to clear bucket fs.s3a.create.performance flag

2023-11-21 Thread Steve Loughran (Jira)
[ https://issues.apache.org/jira/browse/HADOOP-18969?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Steve Loughran resolved HADOOP-18969. - Fix Version/s: 3.4.0 Resolution: Fixed > S3A: AbstractS3ACostTest to clear

[jira] [Commented] (HADOOP-18984) S3A: Support dynamic region resolution

2023-11-21 Thread Steve Loughran (Jira)
[ https://issues.apache.org/jira/browse/HADOOP-18984?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17788407#comment-17788407 ] Steve Loughran commented on HADOOP-18984: - fyi, cloudstore now has a regions2 command to work

[jira] [Created] (HADOOP-18984) S3A: Support dynamic region resolution

2023-11-20 Thread Steve Loughran (Jira)
Steve Loughran created HADOOP-18984: --- Summary: S3A: Support dynamic region resolution Key: HADOOP-18984 URL: https://issues.apache.org/jira/browse/HADOOP-18984 Project: Hadoop Common Issue

[jira] [Created] (HADOOP-18983) S3A: remove @deprecated tags where no longer needed

2023-11-20 Thread Steve Loughran (Jira)
Steve Loughran created HADOOP-18983: --- Summary: S3A: remove @deprecated tags where no longer needed Key: HADOOP-18983 URL: https://issues.apache.org/jira/browse/HADOOP-18983 Project: Hadoop Common

[jira] [Commented] (HADOOP-18980) S3A credential provider remapping: make extensible

2023-11-20 Thread Steve Loughran (Jira)
[ https://issues.apache.org/jira/browse/HADOOP-18980?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17787914#comment-17787914 ] Steve Loughran commented on HADOOP-18980: - exactly; though i'd expect the remapping to be from

[jira] [Created] (HADOOP-18980) S3A credential provider remapping: make extensible

2023-11-17 Thread Steve Loughran (Jira)
Steve Loughran created HADOOP-18980: --- Summary: S3A credential provider remapping: make extensible Key: HADOOP-18980 URL: https://issues.apache.org/jira/browse/HADOOP-18980 Project: Hadoop Common

[jira] [Updated] (HADOOP-18830) S3A: Cut S3 Select

2023-11-17 Thread Steve Loughran (Jira)
[ https://issues.apache.org/jira/browse/HADOOP-18830?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Steve Loughran updated HADOOP-18830: Summary: S3A: Cut S3 Select (was: Cut S3 Select) > S3A: Cut S3 Select >

[jira] [Updated] (HADOOP-18975) AWS SDK v2: extend support for FIPS endpoints

2023-11-16 Thread Steve Loughran (Jira)
[ https://issues.apache.org/jira/browse/HADOOP-18975?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Steve Loughran updated HADOOP-18975: Summary: AWS SDK v2: extend support for FIPS endpoints (was: AWS SDK v2: support FIPS

[jira] [Assigned] (HADOOP-18975) AWS SDK v2: extend support for FIPS endpoints

2023-11-16 Thread Steve Loughran (Jira)
[ https://issues.apache.org/jira/browse/HADOOP-18975?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Steve Loughran reassigned HADOOP-18975: --- Assignee: Steve Loughran > AWS SDK v2: extend support for FIPS endpoints >

<    1   2   3   4   5   6   7   8   9   10   >