Steve Loughran created HADOOP-19161:
---------------------------------------
Summary: S3A: support a comma separated list of performance flags
Key: HADOOP-19161
URL: https://issues.apache.org/jira/browse/HADOOP-19161
Project: Hadoop Common
Issue Type: Improvement
Components: fs/s3
Affects Versions: 3.4.1
Reporter: Steve Loughran
Assignee: Steve Loughran
HADOOP-19072 shows we want to add more optimisations than that of HADOOP-18930.
* Extending the new optimisations to the existing option is brittle
* Adding explicit options for each feature gets complext fast.
Proposed
* A new class S3APerformanceFlags keeps all the flags
* it build this from a string[] of values, which can be extracted from
getConf(),
* and it can also support a "*" option to mean "everything"
* this class can also be handed off to hasPathCapability() and do the right
thing.
Proposed optimisations
* create file (we will hook up HADOOP-18930)
* mkdir (HADOOP-19072)
* delete (probe for parent path)
* rename (probe for source path)
We could think of more, with different names, later.
The goal is make it possible to strip out every HTTP request we do for
safety/posix compliance, so applications have the option of turning off what
they don't need.
--
This message was sent by Atlassian Jira
(v8.20.10#820010)
---------------------------------------------------------------------
To unsubscribe, e-mail: [email protected]
For additional commands, e-mail: [email protected]
