[
https://issues.apache.org/jira/browse/HADOOP-18330?focusedWorklogId=791669&page=com.atlassian.jira.plugin.system.issuetabpanels:worklog-tabpanel#worklog-791669
]
ASF GitHub Bot logged work on HADOOP-18330:
-------------------------------------------
Author: ASF GitHub Bot
Created on: 16/Jul/22 16:56
Start Date: 16/Jul/22 16:56
Worklog Time Spent: 10m
Work Description: steveloughran commented on PR #4557:
URL: https://github.com/apache/hadoop/pull/4557#issuecomment-1186239135
aah, I'd merged this and only then noticed this was against 3.3.3. reverted.
Can you create a PR with the final patch applied to trunk? and test it (just
tell us the endpoint, no need for the other details). then we can merge there
and back in to branch-3.3
the 3.3.3 branch is frozen; a fork was made earlier for a critical
integration/cve release, which this doesn't qualify for...target the next
release after that
Issue Time Tracking
-------------------
Worklog Id: (was: 791669)
Time Spent: 2h 10m (was: 2h)
> S3AFileSystem removes Path when calling createS3Client
> ------------------------------------------------------
>
> Key: HADOOP-18330
> URL: https://issues.apache.org/jira/browse/HADOOP-18330
> Project: Hadoop Common
> Issue Type: Bug
> Components: fs/s3
> Affects Versions: 3.3.0, 3.3.1, 3.3.2, 3.3.3
> Reporter: Ashutosh Pant
> Assignee: Ashutosh Pant
> Priority: Minor
> Labels: pull-request-available
> Time Spent: 2h 10m
> Remaining Estimate: 0h
>
> when using hadoop and spark to read/write data from an s3 bucket like ->
> s3a://bucket/path and using a custom Credentials Provider, the path is
> removed from the s3a URI and the credentials provider fails because the full
> path is gone.
> In Spark 3.2,
> It was invoked as -> s3 = ReflectionUtils.newInstance(s3ClientFactoryClass,
> conf)
> .createS3Client(name, bucket, credentials);
> But In spark 3.3.3
> It is invoked as s3 = ReflectionUtils.newInstance(s3ClientFactoryClass,
> conf).createS3Client(getUri(), parameters);
> the getUri() removes the path from the s3a URI
--
This message was sent by Atlassian Jira
(v8.20.10#820010)
---------------------------------------------------------------------
To unsubscribe, e-mail: [email protected]
For additional commands, e-mail: [email protected]
