[
https://issues.apache.org/jira/browse/HDDS-434?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=16631788#comment-16631788
]
Elek, Marton commented on HDDS-434:
-----------------------------------
Thank you [[email protected]] the comments. Very useful.
I think the first-level goal was just to do something which can be used by
awscli or other simple aws tool.
But I definitely agree that the s3a should be one of the main supported
use-case and all of the tests should be passed from there (and your list of the
required features is a very big help).
Currently we have unit tests (without using miniozone cluster) and I would like
to add acceptance tests (docker based higher level scripts, starting real
cluster and executing shell commands) to test the aws cli / s3cmd.
S3A Filesystem tests could fill the gap between these and provide
integration-like unit tests (with more coverage what we can do) We should
integrate them as soon as we can.
> Provide an s3 compatible REST api for ozone objects
> ---------------------------------------------------
>
> Key: HDDS-434
> URL: https://issues.apache.org/jira/browse/HDDS-434
> Project: Hadoop Distributed Data Store
> Issue Type: New Feature
> Reporter: Elek, Marton
> Assignee: Elek, Marton
> Priority: Major
> Attachments: S3Gateway.pdf
>
>
> S3 REST api is the de facto standard for object stores. Many external tools
> already support it.
> This issue is about creating a new s3gateway component which implements (most
> part of) the s3 API using the internal RPC calls.
> Some part of the implementation is very straightforward: we need a new
> service with usual REST stack and we need to implement the most commont
> GET/POST/PUT calls. Some other (Authorization, multi-part upload) are more
> tricky.
> Here I suggest to create an evaluation: first we can implement a skeleton
> service which could support read only requests without authorization and we
> can define proper specification for the upload part / authorization during
> the work.
> As of now the gatway service could be a new standalone application (eg. ozone
> s3g start) later we can modify it to work as s DatanodePlugin similar to the
> existing object store plugin.
--
This message was sent by Atlassian JIRA
(v7.6.3#76005)
---------------------------------------------------------------------
To unsubscribe, e-mail: [email protected]
For additional commands, e-mail: [email protected]
