[
https://issues.apache.org/jira/browse/HADOOP-18281?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
]
Steve Loughran updated HADOOP-18281:
------------------------------------
Description:
Followup to HADOOP-12020, with work/review from rebasing HADOOP-17833 atop it.
* Can we merge ITestS3AHugeFilesStorageClass into one of the existing test
cases? just because it is slow...ideally we want as few of those as possible,
even if by testing multiple things at the same we break the rules of testing.
* move setting the storage class into
setOptionalMultipartUploadRequestParameters and setOptionalPutRequestParameters
* both newPutObjectRequest() calls to set storage class
* docs to list the valid option strings. I had to delve into the AWS SDK to
work them out
Once HADOOP-17833 is in, make this a new option something which can be
explicitly used in createFile().
I've updated PutObjectOptions to pass a value around, and made sure it gets
down to to the request factory. that leaves
* setting the storage class from the options {{CreateFileBuilder}}
* testing!
* doc update
> Tune S3A storage class support
> ------------------------------
>
> Key: HADOOP-18281
> URL: https://issues.apache.org/jira/browse/HADOOP-18281
> Project: Hadoop Common
> Issue Type: Improvement
> Components: fs/s3
> Affects Versions: 3.3.4
> Reporter: Steve Loughran
> Priority: Minor
>
> Followup to HADOOP-12020, with work/review from rebasing HADOOP-17833 atop it.
> * Can we merge ITestS3AHugeFilesStorageClass into one of the existing test
> cases? just because it is slow...ideally we want as few of those as possible,
> even if by testing multiple things at the same we break the rules of testing.
> * move setting the storage class into
> setOptionalMultipartUploadRequestParameters and
> setOptionalPutRequestParameters
> * both newPutObjectRequest() calls to set storage class
> * docs to list the valid option strings. I had to delve into the AWS SDK to
> work them out
> Once HADOOP-17833 is in, make this a new option something which can be
> explicitly used in createFile().
> I've updated PutObjectOptions to pass a value around, and made sure it gets
> down to to the request factory. that leaves
> * setting the storage class from the options {{CreateFileBuilder}}
> * testing!
> * doc update
--
This message was sent by Atlassian Jira
(v8.20.7#820007)
---------------------------------------------------------------------
To unsubscribe, e-mail: [email protected]
For additional commands, e-mail: [email protected]
