[ https://issues.apache.org/jira/browse/YARN-1005?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ]
Rohith Sharma K S resolved YARN-1005. ------------------------------------- Resolution: Cannot Reproduce > Log aggregators should check for FSDataOutputStream close before renaming to > aggregated file. > --------------------------------------------------------------------------------------------- > > Key: YARN-1005 > URL: https://issues.apache.org/jira/browse/YARN-1005 > Project: Hadoop YARN > Issue Type: Bug > Components: nodemanager > Affects Versions: 2.1.0-beta, 2.0.5-alpha > Reporter: Rohith Sharma K S > > If AggregatedLogFormat.LogWriter.closeWriter() is interuppted, then > "remoteNodeTmpLogFileForApp" is renamed to "remoteNodeLogFileForApp" file. > This renamed file does not contain valid aggregated logs. There can be > situation renamed file can be not in BCFile format. > This cause issue while viewing from JobHistoryServer web page. > {noformat} > 2013-07-27 18:51:14,787 ERROR org.apache.hadoop.yarn.webapp.View: Error > getting logs for job_1374918614757_0002 > java.io.IOException: Not a valid BCFile. > at > org.apache.hadoop.io.file.tfile.BCFile$Magic.readAndVerify(BCFile.java:927) > at org.apache.hadoop.io.file.tfile.BCFile$Reader.<init>(BCFile.java:628) > at org.apache.hadoop.io.file.tfile.TFile$Reader.<init>(TFile.java:804) > at > org.apache.hadoop.yarn.logaggregation.AggregatedLogFormat$LogReader.<init>(AggregatedLogFormat.java:337) > at > org.apache.hadoop.yarn.webapp.log.AggregatedLogsBlock.render(AggregatedLogsBlock.java:89) > at > org.apache.hadoop.yarn.webapp.view.HtmlBlock.render(HtmlBlock.java:64) > at > org.apache.hadoop.yarn.webapp.view.HtmlBlock.renderPartial(HtmlBlock.java:74) > {noformat} > -- This message was sent by Atlassian JIRA (v6.3.4#6332) --------------------------------------------------------------------- To unsubscribe, e-mail: yarn-dev-unsubscr...@hadoop.apache.org For additional commands, e-mail: yarn-dev-h...@hadoop.apache.org