) reducer that combines all data together. Have you tried external
(dynamic) partitions for combining data?
-amit
- Original Message -
From: hadoopman hadoop...@gmail.com
To: common-user@hadoop.apache.org
Cc:
Sent: Tuesday, 10 May 2011 11:26 PM
Subject: hadoop/hive data loading
When
@hadoop.apache.org
Cc:
Sent: Tuesday, 10 May 2011 11:26 PM
Subject: hadoop/hive data loading
When we load data into hive sometimes we've run into situations where the load
fails and the logs show a heap out of memory error. If I load just a few days
(or months) of data then no problem. But then if I try
When we load data into hive sometimes we've run into situations where
the load fails and the logs show a heap out of memory error. If I load
just a few days (or months) of data then no problem. But then if I try
to load two years (for example) of data then I've seen it fail. Not
with every
