[
https://issues.apache.org/jira/browse/HADOOP-17851?focusedWorklogId=649397&page=com.atlassian.jira.plugin.system.issuetabpanels:worklog-tabpanel#worklog-649397
]
ASF GitHub Bot logged work on HADOOP-17851:
-------------------------------------------
Author: ASF GitHub Bot
Created on: 10/Sep/21 18:56
Start Date: 10/Sep/21 18:56
Worklog Time Spent: 10m
Work Description: holdenk commented on a change in pull request #3312:
URL: https://github.com/apache/hadoop/pull/3312#discussion_r706403252
##########
File path:
hadoop-tools/hadoop-aws/src/main/java/org/apache/hadoop/fs/s3a/Constants.java
##########
@@ -410,6 +410,10 @@ private Constants() {
public static final String CANNED_ACL = "fs.s3a.acl.default";
public static final String DEFAULT_CANNED_ACL = "";
+ // gzip, deflate, compress, br, etc.
+ public static final String CONTENT_ENCODING = "fs.s3a.content.encoding";
+ public static final String DEFAULT_CONTENT_ENCODING = null;
Review comment:
A user can set this to pretty much anything they want. gzip,deflate, and
compress are the ones that I believe have special handling inside of the AWS
ecosystem, but I could see more encoding types being supported in the future.
--
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.
To unsubscribe, e-mail: [email protected]
For queries about this service, please contact Infrastructure at:
[email protected]
Issue Time Tracking
-------------------
Worklog Id: (was: 649397)
Time Spent: 2h 50m (was: 2h 40m)
> Support user specified content encoding for S3A
> -----------------------------------------------
>
> Key: HADOOP-17851
> URL: https://issues.apache.org/jira/browse/HADOOP-17851
> Project: Hadoop Common
> Issue Type: Sub-task
> Components: fs/s3
> Affects Versions: 3.3.1
> Reporter: Holden Karau
> Assignee: Holden Karau
> Priority: Minor
> Labels: pull-request-available
> Time Spent: 2h 50m
> Remaining Estimate: 0h
>
> User-specified object content-encoding (part of the object metadata) is
> important for allowing compressed files to be processed in the AWS ecosystem.
> We should allow the user to specify the content encoding of the files being
> written.
> metadata can not be changed after a file is written without a rewrite.
--
This message was sent by Atlassian Jira
(v8.3.4#803005)
---------------------------------------------------------------------
To unsubscribe, e-mail: [email protected]
For additional commands, e-mail: [email protected]
