we are using hbase hadoop version 0.20.3 maybe I can do it using the jobconf (separate jvm opts for map/reduce) ?
On Thu, Mar 17, 2011 at 7:23 PM, Harsh J <qwertyman...@gmail.com> wrote: > What version of Hadoop are you using? > > 1 is a new property in 0.21, and is the right one if you're using that. > 2 is the property to use in 0.20, and applies to both Maps and > Reduces. In 0.20 there is no distinction available for setting JVM > opts to types of tasks. > > On Thu, Mar 17, 2011 at 10:37 PM, Lior Schachter <li...@infolinks.com> > wrote: > > sure. my mistake. thanks. > > > > I'm also trying to increase the reducer heap size (keeping the map with > the > > default 200m). I found 2 related properties: > > 1. mapreduce.reduce.java.opts > > 2. mapred.child.java.opts > > > > Which should be configured and whats the purpose of the second property. > > > > thanks, > > Lior > > > > On Thu, Mar 17, 2011 at 6:41 PM, Harsh J <qwertyman...@gmail.com> wrote: > >> > >> Hello, > >> > >> Remove the "=" from "-Xmx=2048m". > >> > >> P.s. If you're looking to change the JobTracker opts, it is > >> HADOOP_JOBTRACKER_OPTS, not TASKTRACKER :) > >> > >> On Thu, Mar 17, 2011 at 10:08 PM, Lior Schachter <li...@infolinks.com> > >> wrote: > >> > Hi, > >> > I'm trying to increase the job-tracker heap by adding Xmx definition > to > >> > hadoop-env.sh (adding it to HADOOP_TASKTRACKER_OPTS). > >> > I keep getting this error while starting hadoop: > >> > Invalid maximum heap size: -Xmx=2048m > >> > Could not create the Java virtual machine. > >> > > >> > Any idea what am I doing wrong ? > >> > > >> > >> > >> > >> -- > >> Harsh J > >> http://harshj.com > > > > > > > > -- > Harsh J > http://harshj.com >
