The error in the logs is something you can ignore. The process is polling /proc and there is a race between it reading one file in /proc and trying to read another one. If a process exits in between then you get this error, but it is not a fatal error which is why your map task completed successfully.
--Bobby On 5/8/13 12:42 AM, "牛兆捷" <[email protected]> wrote: >I find a warning from my container log like this below, >Anyone meet the problem? > >2013-05-08 13:23:59,622 WARN [main] >org.apache.hadoop.util.NativeCodeLoader: Unable to load native-hadoop >library for your platform... using builtin-java classes where applicable >2013-05-08 13:23:59,732 INFO [main] org.apache.hadoop.util.Shell: setsid >exited with exit code 0 >2013-05-08 13:23:59,824 INFO [main] >org.apache.hadoop.metrics2.impl.MetricsConfig: loaded properties from >hadoop-metrics2.properties >2013-05-08 13:23:59,909 INFO [main] >org.apache.hadoop.metrics2.impl.MetricsSystemImpl: Scheduled snapshot >period at 10 second(s). >2013-05-08 13:23:59,909 INFO [main] >org.apache.hadoop.metrics2.impl.MetricsSystemImpl: MapTask metrics system >started >2013-05-08 13:23:59,933 INFO [main] org.apache.hadoop.mapred.YarnChild: >Executing with tokens: >2013-05-08 13:23:59,933 INFO [main] org.apache.hadoop.mapred.YarnChild: >Kind: mapreduce.job, Service: job_1367985414547_0009, Ident: >(org.apache.hadoop.mapreduce.security.token.JobTokenIdentifier@7ca522a6) >2013-05-08 13:24:00,009 INFO [main] org.apache.hadoop.mapred.YarnChild: >Sleeping for 0ms before retrying again. Got null now. >2013-05-08 13:24:01,263 INFO [main] org.apache.hadoop.mapred.YarnChild: >mapreduce.cluster.local.dir for child: >/data/hustnn/local/usercache/hustnn/appcache/application_1367985414547_000 >9 >2013-05-08 13:24:01,480 WARN [main] org.apache.hadoop.conf.Configuration: >mapred.task.id is deprecated. Instead, use mapreduce.task.attempt.id >2013-05-08 13:24:01,576 WARN [main] org.apache.hadoop.conf.Configuration: >mapred.task.is.map is deprecated. Instead, use mapreduce.task.ismap >2013-05-08 13:24:01,612 WARN [main] org.apache.hadoop.conf.Configuration: >mapred.tip.id is deprecated. Instead, use mapreduce.task.id >2013-05-08 13:24:01,613 WARN [main] org.apache.hadoop.conf.Configuration: >mapred.task.partition is deprecated. Instead, use mapreduce.task.partition >2013-05-08 13:24:01,613 WARN [main] org.apache.hadoop.conf.Configuration: >mapred.local.dir is deprecated. Instead, use mapreduce.cluster.local.dir >2013-05-08 13:24:01,694 WARN [main] org.apache.hadoop.conf.Configuration: >job.local.dir is deprecated. Instead, use mapreduce.job.local.dir >2013-05-08 13:24:01,694 WARN [main] org.apache.hadoop.conf.Configuration: >mapred.job.id is deprecated. Instead, use mapreduce.job.id >2013-05-08 13:24:02,329 WARN [main] org.apache.hadoop.conf.Configuration: >session.id is deprecated. Instead, use dfs.metrics.session-id >2013-05-08 13:24:03,184 INFO [main] org.apache.hadoop.mapred.Task: Using >ResourceCalculatorProcessTree : [ ] >2013-05-08 13:24:03,913 INFO [main] org.apache.hadoop.mapred.MapTask: >Processing split: hdfs://155.69.148.21:18000/terasort-23/part-m-00001 from >0 length 256000000 >2013-05-08 13:24:03,928 INFO [main] org.apache.hadoop.mapred.MapTask: Map >output collector class = org.apache.hadoop.mapred.MapTask$MapOutputBuffer >2013-05-08 13:24:04,196 INFO [main] org.apache.hadoop.mapred.MapTask: >(EQUATOR) 0 kvi 134217724(536870896) >2013-05-08 13:24:04,196 INFO [main] org.apache.hadoop.mapred.MapTask: >mapreduce.task.io.sort.mb: 512 >2013-05-08 13:24:04,196 INFO [main] org.apache.hadoop.mapred.MapTask: soft >limit at 429496736 >2013-05-08 13:24:04,196 INFO [main] org.apache.hadoop.mapred.MapTask: >bufstart = 0; bufvoid = 536870912 >2013-05-08 13:24:04,196 INFO [main] org.apache.hadoop.mapred.MapTask: >kvstart = 134217724; length = 33554432 >2013-05-08 13:25:10,643 INFO [main] org.apache.hadoop.mapred.MapTask: >Starting flush of map output >2013-05-08 13:25:10,821 INFO [main] org.apache.hadoop.mapred.MapTask: >Spilling map output >2013-05-08 13:25:10,821 INFO [main] org.apache.hadoop.mapred.MapTask: >bufstart = 0; bufend = 261120000; bufvoid = 536870912 >2013-05-08 13:25:10,821 INFO [main] org.apache.hadoop.mapred.MapTask: >kvstart = 134217724(536870896); kvend = 123977728(495910912); length = >10239997/33554432 >2013-05-08 13:25:42,934 INFO [main] org.apache.hadoop.mapred.MapTask: >Finished spill 0 >2013-05-08 13:25:43,219 INFO [main] org.apache.hadoop.mapred.Task: >Task:attempt_1367985414547_0009_m_000001_0 is done. And is in the process >of committing >2013-05-08 13:26:35,311 WARN [main] >org.apache.hadoop.yarn.util.ProcfsBasedProcessTree: Error reading the >stream java.io.IOException: No such process >2013-05-08 13:26:35,319 INFO [main] org.apache.hadoop.mapred.Task: Task >'attempt_1367985414547_0009_m_000001_0' done. >2013-05-08 13:26:35,422 INFO [main] >org.apache.hadoop.metrics2.impl.MetricsSystemImpl: Stopping MapTask >metrics >system... > >-- >*Sincerely,* >*Zhaojie* >* >*
