Hi all, We've encounterd an "ERROR ...EagerTaskInitializationListener: Job initialization failed" on our hadoop 0.19.2 cluster. Reading the job tracker log, it seems that the job tracker tries to get a history file name from local file system on job tracker. Why does it try to get this old file? The file ".jt_1283752186987_job_201009061449_0801_user_sss.crc" in the log below had been generated more than 30 days ago and possibly been deleted by HistoryCleaner.
2010-10-11 07:10:06,517 ERROR org.apache.hadoop.mapred.EagerTaskInitializationListener: Job initialization failed: java.io.FileNotFoundException: File file:/xxx/history/.jt_1283752186987_job_201009061449_0801_user_sss.crc does not exist. at org.apache.hadoop.fs.RawLocalFileSystem.getFileStatus(RawLocalFileSystem.java:420) at org.apache.hadoop.fs.RawLocalFileSystem.listStatus(RawLocalFileSystem.java:297) at org.apache.hadoop.fs.FileSystem.listStatus(FileSystem.java:723) at org.apache.hadoop.fs.FileSystem.listStatus(FileSystem.java:748) at org.apache.hadoop.fs.ChecksumFileSystem.listStatus(ChecksumFileSystem.java:457) at org.apache.hadoop.fs.FileSystem.listStatus(FileSystem.java:723) at org.apache.hadoop.fs.FileSystem.listStatus(FileSystem.java:748) at org.apache.hadoop.mapred.JobHistory$JobInfo.getJobHistoryFileName(JobHistory.java:662) at org.apache.hadoop.mapred.JobHistory$JobInfo.logSubmitted(JobHistory.java:805) at org.apache.hadoop.mapred.JobInProgress.initTasks(JobInProgress.java:360) at org.apache.hadoop.mapred.EagerTaskInitializationListener$JobInitThread.run(EagerTaskInitializationListener.java:55) at java.lang.Thread.run(Thread.java:619) Plus, is HistoryCleaner only way to delete old history files? I just want to know when an by what the file ".jt_1283752186987_job_201009061449_0801_user_sss.crc" has been deleted. Thanks, Manhee
