Thanks
2013/5/8 Robert Evans <[email protected]> > The error in the logs is something you can ignore. The process is polling > /proc and there is a race between it reading one file in /proc and trying > to read another one. If a process exits in between then you get this > error, but it is not a fatal error which is why your map task completed > successfully. > > --Bobby > > On 5/8/13 12:42 AM, "牛兆捷" <[email protected]> wrote: > > >I find a warning from my container log like this below, > >Anyone meet the problem? > > > >2013-05-08 13:23:59,622 WARN [main] > >org.apache.hadoop.util.NativeCodeLoader: Unable to load native-hadoop > >library for your platform... using builtin-java classes where applicable > >2013-05-08 13:23:59,732 INFO [main] org.apache.hadoop.util.Shell: setsid > >exited with exit code 0 > >2013-05-08 13:23:59,824 INFO [main] > >org.apache.hadoop.metrics2.impl.MetricsConfig: loaded properties from > >hadoop-metrics2.properties > >2013-05-08 13:23:59,909 INFO [main] > >org.apache.hadoop.metrics2.impl.MetricsSystemImpl: Scheduled snapshot > >period at 10 second(s). > >2013-05-08 13:23:59,909 INFO [main] > >org.apache.hadoop.metrics2.impl.MetricsSystemImpl: MapTask metrics system > >started > >2013-05-08 13:23:59,933 INFO [main] org.apache.hadoop.mapred.YarnChild: > >Executing with tokens: > >2013-05-08 13:23:59,933 INFO [main] org.apache.hadoop.mapred.YarnChild: > >Kind: mapreduce.job, Service: job_1367985414547_0009, Ident: > >(org.apache.hadoop.mapreduce.security.token.JobTokenIdentifier@7ca522a6) > >2013-05-08 13:24:00,009 INFO [main] org.apache.hadoop.mapred.YarnChild: > >Sleeping for 0ms before retrying again. Got null now. > >2013-05-08 13:24:01,263 INFO [main] org.apache.hadoop.mapred.YarnChild: > >mapreduce.cluster.local.dir for child: > >/data/hustnn/local/usercache/hustnn/appcache/application_1367985414547_000 > >9 > >2013-05-08 13:24:01,480 WARN [main] org.apache.hadoop.conf.Configuration: > >mapred.task.id is deprecated. Instead, use mapreduce.task.attempt.id > >2013-05-08 13:24:01,576 WARN [main] org.apache.hadoop.conf.Configuration: > >mapred.task.is.map is deprecated. Instead, use mapreduce.task.ismap > >2013-05-08 13:24:01,612 WARN [main] org.apache.hadoop.conf.Configuration: > >mapred.tip.id is deprecated. Instead, use mapreduce.task.id > >2013-05-08 13:24:01,613 WARN [main] org.apache.hadoop.conf.Configuration: > >mapred.task.partition is deprecated. Instead, use mapreduce.task.partition > >2013-05-08 13:24:01,613 WARN [main] org.apache.hadoop.conf.Configuration: > >mapred.local.dir is deprecated. Instead, use mapreduce.cluster.local.dir > >2013-05-08 13:24:01,694 WARN [main] org.apache.hadoop.conf.Configuration: > >job.local.dir is deprecated. Instead, use mapreduce.job.local.dir > >2013-05-08 13:24:01,694 WARN [main] org.apache.hadoop.conf.Configuration: > >mapred.job.id is deprecated. Instead, use mapreduce.job.id > >2013-05-08 13:24:02,329 WARN [main] org.apache.hadoop.conf.Configuration: > >session.id is deprecated. Instead, use dfs.metrics.session-id > >2013-05-08 13:24:03,184 INFO [main] org.apache.hadoop.mapred.Task: Using > >ResourceCalculatorProcessTree : [ ] > >2013-05-08 13:24:03,913 INFO [main] org.apache.hadoop.mapred.MapTask: > >Processing split: hdfs://155.69.148.21:18000/terasort-23/part-m-00001from > >0 length 256000000 > >2013-05-08 13:24:03,928 INFO [main] org.apache.hadoop.mapred.MapTask: Map > >output collector class = org.apache.hadoop.mapred.MapTask$MapOutputBuffer > >2013-05-08 13:24:04,196 INFO [main] org.apache.hadoop.mapred.MapTask: > >(EQUATOR) 0 kvi 134217724(536870896) > >2013-05-08 13:24:04,196 INFO [main] org.apache.hadoop.mapred.MapTask: > >mapreduce.task.io.sort.mb: 512 > >2013-05-08 13:24:04,196 INFO [main] org.apache.hadoop.mapred.MapTask: soft > >limit at 429496736 > >2013-05-08 13:24:04,196 INFO [main] org.apache.hadoop.mapred.MapTask: > >bufstart = 0; bufvoid = 536870912 > >2013-05-08 13:24:04,196 INFO [main] org.apache.hadoop.mapred.MapTask: > >kvstart = 134217724; length = 33554432 > >2013-05-08 13:25:10,643 INFO [main] org.apache.hadoop.mapred.MapTask: > >Starting flush of map output > >2013-05-08 13:25:10,821 INFO [main] org.apache.hadoop.mapred.MapTask: > >Spilling map output > >2013-05-08 13:25:10,821 INFO [main] org.apache.hadoop.mapred.MapTask: > >bufstart = 0; bufend = 261120000; bufvoid = 536870912 > >2013-05-08 13:25:10,821 INFO [main] org.apache.hadoop.mapred.MapTask: > >kvstart = 134217724(536870896); kvend = 123977728(495910912); length = > >10239997/33554432 > >2013-05-08 13:25:42,934 INFO [main] org.apache.hadoop.mapred.MapTask: > >Finished spill 0 > >2013-05-08 13:25:43,219 INFO [main] org.apache.hadoop.mapred.Task: > >Task:attempt_1367985414547_0009_m_000001_0 is done. And is in the process > >of committing > >2013-05-08 13:26:35,311 WARN [main] > >org.apache.hadoop.yarn.util.ProcfsBasedProcessTree: Error reading the > >stream java.io.IOException: No such process > >2013-05-08 13:26:35,319 INFO [main] org.apache.hadoop.mapred.Task: Task > >'attempt_1367985414547_0009_m_000001_0' done. > >2013-05-08 13:26:35,422 INFO [main] > >org.apache.hadoop.metrics2.impl.MetricsSystemImpl: Stopping MapTask > >metrics > >system... > > > >-- > >*Sincerely,* > >*Zhaojie* > >* > >* > > -- *Sincerely,* *Zhaojie* * *
