Hi Maria! You have to be careful which log4j.properties file is on the classpath of the task which was launched. Often times there are multiple log4j.properties file, perhaps in the classpaths or in one of the jars on the classpath. Are you sure the log4j.properties file you edited is the only one loaded by the classloader?
Ravi On Fri, Nov 4, 2016 at 5:06 AM, Maria <[email protected]> wrote: > Sorry,(clerical errors) . > I just modified “log4j.appender.RFA.layout.ConversionPattern=%d{ISO8601} > %p %c: %m%n” > to "log4j.appender.RFA.layout.ConversionPattern=%d{ISO8601} %p %c: [ID: > %X{ID}] %m%n", > and use "MDC.put("ID",ID)" in mapper class, It does not work. > > > At 2016-11-04 17:01:16, "Maria" <[email protected]> wrote: > > > >I know that, A simple way is to write "<custom ID> " to every > >LOG.info()/LOG.warn()....like this: > > > >logger.info(ID + " start map logic"); > >BUT,every LOG info has to add "ID" is not wise. > >Or else, can someone know how to modify the mapreduce task ConversionPattern > >configuration? > >I tried to modify "RFA" Appender to this: > >------------------- > >log4j.appender.RFA=org.apache.log4j.RollingFileAppender > >log4j.appender.RFA.File=${hadoop.log.dir}/${hadoop.log.file} > >log4j.appender.RFA.MaxFileSize=${hadoop.log.maxfilesize} > >log4j.appender.RFA.MaxBackupIndex=${hadoop.log.maxbackupindex} > >log4j.appender.RFA.layout=org.apache.log4j.PatternLayout > ># Pattern format: Date LogLevel LoggerName LogMessage > >log4j.appender.RFA.layout.ConversionPattern=%d{ISO8601} %p %c: %m%n > ># Debugging Pattern format > >#log4j.appender.RFA.layout.ConversionPattern=%d{ISO8601} %-5p %l - [ID: > >%X{ID}] %m%n > >----------------- > >It does not work. > > > >At 2016-11-04 11:26:57, "Maria" <[email protected]> wrote: > >> > >>Hi, dear developers, > >> > >>I'm trying to reconfig $HADOOP/etc.hadoop/log4j.properties, > >>I want to add an <custom ID> to mapreduce log before LOGmessage. Like this: > >>"ID:234521 start map logic" > >> > >>My steps as follow: > >>(1)In my Mapper Class: > >> > >>static Logger logger = LoggerFactory.getLogger(Mapper.class); > >>.... > >> > >>public void map(Object key, Text value, Context context) throws > >>IOException, InterruptedException { > >> > >> MDC.put("ID", "operatorID"); > >> logger.info("start map logic"); > >> > >> StringTokenizer itr = new StringTokenizer(value.toString()); > >> while (itr.hasMoreTokens()) { > >> word.set(itr.nextToken()); > >> context.write(word, one); > >> } > >> } > >> } > >>(2)config $HADOOP/etc.hadoop/log4j.properties > >> > >>log4j.appender.TLA=org.apache.hadoop.mapred.TaskLogAppender > >>log4j.appender.TLA.taskId=${hadoop.tasklog.taskid} > >>log4j.appender.TLA.isCleanup=${hadoop.tasklog.iscleanup} > >>log4j.appender.TLA.totalLogFileSize=${hadoop.tasklog.totalLogFileSize} > >> > >>log4j.appender.TLA.layout=org.apache.log4j.PatternLayout > >>log4j.appender.TLA.layout.ConversionPattern=%l %p %c: ID:[%X{ID}] %m%n > >> > >> > >>BUT it does not work. and because use slf4j API, so I don't know how to get > >>Appenders. > >> > >>I am desperately in need。。 > >>Any help would be highly appreciated > >>--------------------------------------------------------------------- > >>To unsubscribe, e-mail: [email protected] > >>For additional commands, e-mail: [email protected] > > > > > >【网易自营|30天无忧退货】日本匠心设计秋冬宠物用品，限时9.9元起，还可叠加双11折扣>> > > > >--------------------------------------------------------------------- > >To unsubscribe, e-mail: [email protected] > >For additional commands, e-mail: [email protected] > > > > >
