[ 
https://issues.apache.org/jira/browse/YARN-5525?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=15613469#comment-15613469
 ] 

Botong Huang commented on YARN-5525:
------------------------------------

Hi Xuan, ContainerLogAggregationPolicy only provides interface to decide on 
which containers to upload logs for. There's more that might be needed here 
(for a customized AppLogAggregator), for instance: 1. upload the logs to a 
different RemoteRootLogDir per application; 2. customized the directory 
structures within the RemoteRootLogDir folder (which is hard coded to 
remoteRootDir/<user>/suffix/<appId>/<nodeId> now); 3. a different log 
aggregation format (e.g. just copy the log files without aggregation). 

> Make log aggregation service class configurable
> -----------------------------------------------
>
>                 Key: YARN-5525
>                 URL: https://issues.apache.org/jira/browse/YARN-5525
>             Project: Hadoop YARN
>          Issue Type: Improvement
>          Components: log-aggregation
>            Reporter: Giovanni Matteo Fumarola
>            Assignee: Botong Huang
>            Priority: Minor
>              Labels: oct16-medium
>         Attachments: YARN-5525.v1.patch, YARN-5525.v2.patch, 
> YARN-5525.v3.patch
>
>
> Make the log aggregation class configurable and extensible, so that 
> alternative log aggregation behaviors like app specific log aggregation 
> directory, log aggregation format can be implemented and plugged in.



--
This message was sent by Atlassian JIRA
(v6.3.4#6332)

---------------------------------------------------------------------
To unsubscribe, e-mail: [email protected]
For additional commands, e-mail: [email protected]

Reply via email to