[
https://issues.apache.org/jira/browse/HDFS-7240?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14564618#comment-14564618
]
kanaka kumar avvaru commented on HDFS-7240:
-------------------------------------------
Very interesting to follow [~jnp], we also have some requirements to support
Trillion level small objects/files.
We will be intrested to contibute for OZone development. Can you please invite
me also to the webex meeting?
For now I have few comments on the this Project
Practically partitioning may be difficult to be controlled by Storage Layer
alone, as distribution depends on key construction applications.
So, bucket partitioner classes can be a input while creating a bucket so that
applications can handle the partitions well.
Object level Metadata would be required such as tags/labels which can be used
by computing jobs as additional info(similar to xaatributes on file)
What is the plan for leveldbjni content file persistence & has any concept like
WAL for reliability is planned?
When & how does the leveldbjni content will be replicated?
As millions are buckets are expected, is Partitioning for buckets is also
required based on volume name?
Swift & AWS S3 support supports Object versions and replace. Does OZone also
plan for the same?
Missing feature like multi part loading,heavy object/storage space splits etc,,
also can be pooled in the coming phases( may be phase 2 or later)
We can also add readable snap shots of a bucket in the features queue? (may be
at later stage of project)
As part of Transparency encryption, encryption zone at bucket level could be an
expectation from applications.
> Object store in HDFS
> --------------------
>
> Key: HDFS-7240
> URL: https://issues.apache.org/jira/browse/HDFS-7240
> Project: Hadoop HDFS
> Issue Type: New Feature
> Reporter: Jitendra Nath Pandey
> Assignee: Jitendra Nath Pandey
> Attachments: Ozone-architecture-v1.pdf
>
>
> This jira proposes to add object store capabilities into HDFS.
> As part of the federation work (HDFS-1052) we separated block storage as a
> generic storage layer. Using the Block Pool abstraction, new kinds of
> namespaces can be built on top of the storage layer i.e. datanodes.
> In this jira I will explore building an object store using the datanode
> storage, but independent of namespace metadata.
> I will soon update with a detailed design document.
--
This message was sent by Atlassian JIRA
(v6.3.4#6332)
