[ 
https://issues.apache.org/jira/browse/HDFS-12464?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=16181540#comment-16181540
 ] 

Elek, Marton commented on HDFS-12464:
-------------------------------------

Yes, that's Architectural overview was also a missing point. I think we need to 
provide both information

* One high level overview, with diagram, and explain the basic concepts. 
Typically for end-users: for the existing users of the HDFS to understand 
what's new, and why it's important
* I created this more in-depth documentation for the developers/sys-admin who 
would like to use the system after they understood what is ozone and how it 
works.
   * It could help to understand the Ozone during the HDFS-7240 merge vote.
   * It could help to understand the consequences of turning on ozone. For 
example it's a tipical question where will be any data written. I also missed 
the definition of the network commiunication for the existing HDFS/YARN. It 
could help a lot to debug the network issues.

But I agree:
 * Your high(er) level overview is more important.
 * Maybe the class level introduction is too low level (I think it would be 
useful for the other hadoop contributors/developers/commiters to understand 
what kind of additional services added to the system. Even if I didn't mention 
all, just the important ones)
 * I think, it's important to mention what kind of data is stored on the disk, 
and where. For example what kind of data could be lost in case of a disk 
failure. But maybe mentioning the file names itself are unnecessery.

I have no problems if this patch will be refactored to something else or will 
be droped. It is more like a POC. Maybe it could be used to ask some potential 
user (hadoop contributors/commiters) if they are interested about this kind of 
information or the source code is enough.

> Ozone: More detailed documentation about the ozone components
> -------------------------------------------------------------
>
>                 Key: HDFS-12464
>                 URL: https://issues.apache.org/jira/browse/HDFS-12464
>             Project: Hadoop HDFS
>          Issue Type: Sub-task
>          Components: HDFS-7240
>    Affects Versions: HDFS-7240
>            Reporter: Elek, Marton
>            Assignee: Elek, Marton
>              Labels: ozoneDoc
>         Attachments: HDFS-12464-HDFS-7240.001.patch, 
> HDFS-7240-HDFS-12464.001.patch
>
>
> I started to write a more detailed introduction about the Ozone components. 
> The goal is to explain the basic responsibility of the components and the 
> basic network topology (which components sends messages and to where?). 
>  



--
This message was sent by Atlassian JIRA
(v6.4.14#64029)

---------------------------------------------------------------------
To unsubscribe, e-mail: [email protected]
For additional commands, e-mail: [email protected]

Reply via email to