Vrushali C updated YARN-3411:
    Attachment: YARN-3411.poc.1

Attaching a patch for this schema option. I am still working on refining this 
patch and there is some also more work to be done on this patch after the 
following clarifications are done.

- need to clarify how to store metrics, perhaps add another api to timeline 
- need to add some more functions to the TimelineMetric class to facilitate 
writing of metrics
- need to have way to know which part of the TimelineEntity has been recently 
updated so that only that much information can be stored.

> [Storage implementation] explore the native HBase write schema for storage
> --------------------------------------------------------------------------
>                 Key: YARN-3411
>                 URL: https://issues.apache.org/jira/browse/YARN-3411
>             Project: Hadoop YARN
>          Issue Type: Sub-task
>          Components: timelineserver
>            Reporter: Sangjin Lee
>            Assignee: Vrushali C
>            Priority: Critical
>         Attachments: ATSv2BackendHBaseSchemaproposal.pdf, YARN-3411.poc.txt
> There is work that's in progress to implement the storage based on a Phoenix 
> schema (YARN-3134).
> In parallel, we would like to explore an implementation based on a native 
> HBase schema for the write path. Such a schema does not exclude using 
> Phoenix, especially for reads and offline queries.
> Once we have basic implementations of both options, we could evaluate them in 
> terms of performance, scalability, usability, etc. and make a call.

This message was sent by Atlassian JIRA

Reply via email to