To Whom It May Concern: I am running:
haddop version 0.20.203.0 (downloaded from http://hadoop.apache.org/common/ ) Java version 1.7.0_02 Cygwin and ssh on a Windows XP OS. Overall the problems I have seen in the log files involve unexpected directory permission settings of: rwxrwxrwxt when rwxr-xr-x was expected. In all but the TaskTracker, I was able to solve this problem manually simply by executing chmod -R 755. In the case of the TaskTracker, although I manually changed the permissions, when I run start-mapred.sh, it apparently is recreating this part of the directory tree with the rwxrwxrwxt perms, then programatically attempting to change the permissions to 755. An exception is thrown (please see the log file contents below) when this attempt is made. I'm at a loss currently on how to rectify this. Note, I'm just beginning with hadoop and do not have really any background. I'm working my way through Tom White's, "Hadoop The Definitve Guide". Thanks, Mike Freeman P.S. I should mention that my other log files are now error-free (after my manually changing permissions) and I am able to run hadoop commands from the cygwin command line. 2012-01-07 14:42:15,046 INFO org.apache.hadoop.metrics2.impl.MetricsConfig: loaded properties from hadoop-metrics2.properties 2012-01-07 14:42:15,203 INFO org.apache.hadoop.metrics2.impl.MetricsSourceAdapter: MBean for source MetricsSystem,sub=Stats registered. 2012-01-07 14:42:15,218 INFO org.apache.hadoop.metrics2.impl.MetricsSystemImpl: Scheduled snapshot period at 10 second(s). 2012-01-07 14:42:15,218 INFO org.apache.hadoop.metrics2.impl.MetricsSystemImpl: TaskTracker metrics system started 2012-01-07 14:42:15,656 INFO org.apache.hadoop.metrics2.impl.MetricsSourceAdapter: MBean for source ugi registered. 2012-01-07 14:42:15,656 WARN org.apache.hadoop.metrics2.impl.MetricsSystemImpl: Source name ugi already exists! 2012-01-07 14:42:15,859 INFO org.mortbay.log: Logging to org.slf4j.impl.Log4jLoggerAdapter(org.mortbay.log) via org.mortbay.log.Slf4jLog 2012-01-07 14:42:15,984 INFO org.apache.hadoop.http.HttpServer: Added global filtersafety (class=org.apache.hadoop.http.HttpServer$QuotingInputFilter) 2012-01-07 14:42:16,031 INFO org.apache.hadoop.mapred.TaskLogsTruncater: Initializing logs' truncater with mapRetainSize=-1 and reduceRetainSize=-1 2012-01-07 14:42:16,031 INFO org.apache.hadoop.mapred.TaskTracker: Starting tasktracker with owner as SYSTEM 2012-01-07 14:42:16,046 ERROR org.apache.hadoop.mapred.TaskTracker: Can not start task tracker because java.io.IOException: Failed to set permissions of path: /tmp/hadoop-SYSTEM/mapred/local/taskTracker to 0755 at org.apache.hadoop.fs.RawLocalFileSystem.checkReturnValue(RawLocalFileSystem.java:525) at org.apache.hadoop.fs.RawLocalFileSystem.setPermission(RawLocalFileSystem.java:507) at org.apache.hadoop.fs.RawLocalFileSystem.mkdirs(RawLocalFileSystem.java:318) at org.apache.hadoop.fs.FilterFileSystem.mkdirs(FilterFileSystem.java:183) at org.apache.hadoop.mapred.TaskTracker.initialize(TaskTracker.java:630) at org.apache.hadoop.mapred.TaskTracker.<init>(TaskTracker.java:1328) at org.apache.hadoop.mapred.TaskTracker.main(TaskTracker.java:3430) 2012-01-07 14:42:16,046 INFO org.apache.hadoop.mapred.TaskTracker: SHUTDOWN_MSG: /************************************************************ SHUTDOWN_MSG: Shutting down TaskTracker ************************************************************/
