[
https://issues.apache.org/jira/browse/YARN-7500?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=16254905#comment-16254905
]
Prabhu Joseph commented on YARN-7500:
-------------------------------------
[~jlowe] Oh yes, missed it.
The issue is our customer has a long running custom Yarn Application which has
started before yarn.log-aggregation.retain-seconds and was running yesterday as
per the RM UI, and today we din see any logs under app-logs. Logs where there
for running job. Looks only possibility is the custom app has not updated the
logs for many days.
Will check RM logs and hdfs-audit logs to validate and give more information.
> LogAggregation DeletionService should consider completedTime for long running
> jobs
> ----------------------------------------------------------------------------------
>
> Key: YARN-7500
> URL: https://issues.apache.org/jira/browse/YARN-7500
> Project: Hadoop YARN
> Issue Type: Bug
> Components: log-aggregation
> Affects Versions: 2.7.3
> Reporter: Prabhu Joseph
> Assignee: Prabhu Joseph
>
> Currently LogAggregation deletes the application logs based on start time of
> the job. For long running jobs (started before
> yarn.log-aggregation.retain-seconds), say it is failed yesterday for some
> reason and we won't have the job logs today for debugging.
> Better to consider the completedTime of the job as part of the deletion
> condition.
--
This message was sent by Atlassian JIRA
(v6.4.14#64029)
---------------------------------------------------------------------
To unsubscribe, e-mail: [email protected]
For additional commands, e-mail: [email protected]
