To unsubscribe from this list send an email to [email protected]<mailto:[email protected]>.
https://hadoop.apache.org/mailing_lists.html On Sep 24, 2015, at 9:40 AM, sukesh kumar <[email protected]<mailto:[email protected]>> wrote: unsubscribe On Thu, Sep 24, 2015 at 8:49 PM, xeonmailinglist <[email protected]<mailto:[email protected]>> wrote: Hi, 1. I have this example of MapReduce [1], and I want to print info in the stdout and in a log file. It seems that the logs isn’t print anything. How can I make my class print these words? 2. I also have set in the yarn-site.xml to retain log. Although the logs are retained in the /app-logs dir, the userlogs dir is deleted at the end of the job execution. How can I make MapReduce to not delete files in the userlogs dir? I am using Yarn. Thanks, [1] Wordcount exampla with just the map part. public class MyWordCount { public static class MyMap extends Mapper { Log log = LogFactory.getLog(MyWordCount.class); private final static IntWritable one = new IntWritable(1); private Text word = new Text(); public void map(LongWritable key, Text value, OutputCollector<Text, IntWritable> output, Reporter reporter) throws IOException { StringTokenizer itr = new StringTokenizer(value.toString()); System.out.println("HERRE"); log.info<http://log.info/>("HERRRRRE"); while (itr.hasMoreTokens()) { word.set(itr.nextToken()); output.collect(word, one); } } public void run(Context context) throws IOException, InterruptedException { setup(context); try { while (context.nextKeyValue()) { System.out.println("Key: " + context.getCurrentKey() + " Value: " + context.getCurrentValue()); map(context.getCurrentKey(), context.getCurrentValue(), context); } } finally { cleanup(context); } } public void cleanup(Mapper.Context context) {} } [2] yarn-site.xml <!-- job history --> <property> <name>yarn.log-aggregation-enable</name> <value>true</value> </property> <property> <name>yarn.nodemanager.log.retain-seconds</name> <value>900000</value> </property> <property> <name>yarn.nodemanager.remote-app-log-dir</name> <value>/app-logs</value> </property> -- Thanks & Best Regards Sukesh Kumar
