Creating Indexes again

2012-11-23 Thread Peter Marron
Hi, I'm trying to create indexes in Hive, and I've switched to using CDH-4. The creation of the index is failing and it's pretty obvious that the reducers are running out of heap space. When I use the web interface for the Hadoop reduce task list I can find this entry: Error: Java heap space

Re: Creating Indexes again

2012-11-23 Thread Nitin Pawar
try increasing ulimit on your hadoop cluster as well increase the memory for map and reducer both by setting them up on hive set mapred.job.map.memory.mb=6000; set mapred.job.reduce.memory.mb=4000; you can change the values based on the hadoop cluster you have setup On Fri, Nov 23, 2012 at

RE: Creating Indexes again

2012-11-23 Thread Peter Marron
...@trilliumsoftware.commailto:roy.willi...@trilliumsoftware.com From: Nitin Pawar [mailto:nitinpawar...@gmail.com] Sent: 23 November 2012 08:55 To: user@hive.apache.org Subject: Re: Creating Indexes again try increasing ulimit on your hadoop cluster as well increase the memory for map and reducer both by setting them up