[ 
https://issues.apache.org/jira/browse/YARN-3264?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
 ]

Vrushali C updated YARN-3264:
-----------------------------
    Attachment: YARN-3264.001.patch


Uploading a patch that contains a FileSystem based backend storage 
implementation for PoC.  The FileSystemTimelineServiceWriterImpl  will create 
files under 

/tmp/org.apache.hadoop.yarn.server.timelineservice.storage.FileSystemTimelineServiceWriterImpl/{entity_type}/{entity_id}.thist.

The patch adds to the Distributed Shell test case the check for entities 
written out by the TimelineAggregator and the TimelineServiceWriter.

This is what I see under /tmp/ if I comment out the deletion in the 
TestDistributedShell unit test at line 375.

{code}
$ cat  
/tmp/org.apache.hadoop.yarn.server.timelineservice.storage.FileSystemTimelineServiceWriterImpl/*/*
{"metrics":[],"events":[{"id":"DS_APP_ATTEMPT_START","timestamp":1425432577909,"info":{}}],"id":"appattempt_1425432568784_0001_000001","type":"DS_APP_ATTEMPT","createdtime":0,"modifiedtime":0,"info":{"user":"vrushalic"},"configs":{},"isrelatedto":{},"relatesto":{}}

{"metrics":[],"events":[{"id":"DS_APP_ATTEMPT_START","timestamp":1425432578900,"info":{}}],"id":"appattempt_1425432568784_0001_000001","type":"DS_APP_ATTEMPT","createdtime":0,"modifiedtime":0,"info":{"user":"vrushalic"},"configs":{},"isrelatedto":{},"relatesto":{}}

{"metrics":[],"events":[{"id":"DS_CONTAINER_START","timestamp":1425432581007,"info":{"Node":"localhost:57638","Resources":"<memory:128,
 
vCores:1>"}}],"id":"container_1425432568784_0001_01_000002","type":"DS_CONTAINER","createdtime":0,"modifiedtime":0,"info":{"user":"vrushalic"},"configs":{},"isrelatedto":{},"relatesto":{}}

{"metrics":[],"events":[{"id":"DS_CONTAINER_END","timestamp":1425432581954,"info":{"State":"COMPLETE","Exit
 
Status":0}}],"id":"container_1425432568784_0001_01_000002","type":"DS_CONTAINER","createdtime":0,"modifiedtime":0,"info":{"user":"vrushalic"},"configs":{},"isrelatedto":{},"relatesto":{}}

{"metrics":[],"events":[{"id":"DS_CONTAINER_START","timestamp":1425432581988,"info":{"Node":"localhost:57638","Resources":"<memory:128,
 
vCores:1>"}}],"id":"container_1425432568784_0001_01_000003","type":"DS_CONTAINER","createdtime":0,"modifiedtime":0,"info":{"user":"vrushalic"},"configs":{},"isrelatedto":{},"relatesto":{}}

{"metrics":[],"events":[{"id":"DS_CONTAINER_END","timestamp":1425432582958,"info":{"State":"COMPLETE","Exit
 
Status":0}}],"id":"container_1425432568784_0001_01_000003","type":"DS_CONTAINER","createdtime":0,"modifiedtime":0,"info":{"user":"vrushalic"},"configs":{},"isrelatedto":{},"relatesto":{}}

$

{code}

> [Storage implementation] Create a POC only file based storage implementation 
> for ATS writes
> -------------------------------------------------------------------------------------------
>
>                 Key: YARN-3264
>                 URL: https://issues.apache.org/jira/browse/YARN-3264
>             Project: Hadoop YARN
>          Issue Type: Sub-task
>          Components: timelineserver
>            Reporter: Vrushali C
>            Assignee: Vrushali C
>         Attachments: YARN-3264.001.patch
>
>
> For the PoC, need to create a backend impl for file based storage of entities 



--
This message was sent by Atlassian JIRA
(v6.3.4#6332)

Reply via email to