Thanks, I've incremented number map tasks and number of reduce tasks, Although worksI think that it's not a solution so I will try both proposals
Joan 2011/1/4 Hari Sreekumar <[email protected]> > Arvind, > > Where can I find DataDrivenInputFormat? Is it available in v0.20.2 and is > it stable? > > Thanks, > Hari > > > On Tue, Jan 4, 2011 at 12:02 AM, [email protected] > <[email protected]>wrote: > >> Joan, >> >> The DataDrivenInputFormat is a better fit for moving large volumes of data >> as it generates WHERE clauses that help partition the data better. >> >> You could also use Sqoop <https://github.com/cloudera/sqoop> that makes >> such large volume data migration between relational sources and HDFS a >> breeze. >> >> Arvind >> >> >> On Mon, Jan 3, 2011 at 8:56 AM, Joan <[email protected]> wrote: >> >>> Hi, >>> >>> I'm trying load data from big table in Database. I'm using DBInputFormat >>> but when my Job try to get all records, It throws an execption: >>> >>> *Exception in thread "Thread for syncLogs" java.lang.OutOfMemoryError: >>> Java heap space* >>> >>> I'm trying to get millions of records and I would like using DBInputSplit >>> but I don't know how I used it and how many split I need? >>> >>> Thanks >>> >>> Joan >>> >> >> >
