I hope, this property will fix your issue. set mapred.reduce.child.java.opts=-Xmx4096m;
On Mon, Mar 24, 2014 at 3:59 PM, Clay McDonald < stuart.mcdon...@bateswhite.com> wrote: > I believe I found my issue. > > 2014-03-24 15:49:38,775 FATAL [main] org.apache.hadoop.mapred.YarnChild: > Error running child : java.lang.OutOfMemoryError: Java heap space > > > Clay > > > > From: Clay McDonald [mailto:stuart.mcdon...@bateswhite.com] > Sent: Monday, March 24, 2014 2:07 PM > To: 'user@hive.apache.org' > Subject: Joins Failing > > My join query is failing. Any suggestions on how I should troubleshoot > this? > > 92651139753_0036_1_conf.xml to hdfs:// > dc-bigdata5.bateswhite.com:8020/mr-history/tmp/root/job_1392651139753_0036_conf.xml_tmp > 2014-03-24 13:48:58,244 INFO [Thread-65] > org.apache.hadoop.mapreduce.jobhistory.JobHistoryEventHandler: Copied to > done location: hdfs:// > dc-bigdata5.bateswhite.com:8020/mr-history/tmp/root/job_1392651139753_0036_conf.xml_tmp > 2014-03-24 13:48:58,248 INFO [Thread-65] > org.apache.hadoop.mapreduce.jobhistory.JobHistoryEventHandler: Moved tmp to > done: hdfs:// > dc-bigdata5.bateswhite.com:8020/mr-history/tmp/root/job_1392651139753_0036.summary_tmpto > hdfs:// > dc-bigdata5.bateswhite.com:8020/mr-history/tmp/root/job_1392651139753_0036.summary > 2014-03-24 13:48:58,249 INFO [Thread-65] > org.apache.hadoop.mapreduce.jobhistory.JobHistoryEventHandler: Moved tmp to > done: hdfs:// > dc-bigdata5.bateswhite.com:8020/mr-history/tmp/root/job_1392651139753_0036_conf.xml_tmpto > hdfs:// > dc-bigdata5.bateswhite.com:8020/mr-history/tmp/root/job_1392651139753_0036_conf.xml > 2014-03-24 13:48:58,251 INFO [Thread-65] > org.apache.hadoop.mapreduce.jobhistory.JobHistoryEventHandler: Moved tmp to > done: hdfs:// > dc-bigdata5.bateswhite.com:8020/mr-history/tmp/root/job_1392651139753_0036-1395683232406-root-SELECT+COUNT%28A.UPC_ID%29+AS+CNT%0D%0AFR...B.UPC_ID%28Stage-1395683335043-0-0-FAILED-default.jhist_tmpto > hdfs:// > dc-bigdata5.bateswhite.com:8020/mr-history/tmp/root/job_1392651139753_0036-1395683232406-root-SELECT+COUNT%28A.UPC_ID%29+AS+CNT%0D%0AFR...B.UPC_ID%28Stage-1395683335043-0-0-FAILED-default.jhist > 2014-03-24 13:48:58,251 INFO [Thread-65] > org.apache.hadoop.mapreduce.jobhistory.JobHistoryEventHandler: Stopped > JobHistoryEventHandler. super.stop() > 2014-03-24 13:48:58,252 INFO [Thread-65] > org.apache.hadoop.mapreduce.v2.app.rm.RMContainerAllocator: Setting job > diagnostics to Task failed task_1392651139753_0036_m_000011 > Job failed as tasks failed. failedMaps:1 failedReduces:0 > > > Thanks Clay >
