On 1/27/10 10:59 PM, Fu Ecy wrote: > I want to load some files on HDFS to a hive table, but there is > an execption as follow: > hive> load data inpath > '/group/taobao/taobao/dw/stb/20100125/collect_info/*' into table > collect_info; > Loading data to table collect_info > Failed with exception addFiles: error while moving files!!! > FAILED: Execution Error, return code 1 from > org.apache.hadoop.hive.ql.exec.MoveTask > > But, when I download the files from HDFS to local machine, then load > them into the table, it works. > Data in '/group/taobao/taobao/dw/stb/20100125/collect_info/*' is a > little more than 200GB. > > I need to use the Hive to make some statistics. > much thanks :-)
The size of the files shouldn't really matter (move operations affect metadata only - the blocks aren't rewritten or anything like that). Check in your Hive log files (by default in /tmp/<user>/hive.log on the local machine you run Hive on, I believe) and you should see a stack trace with additional information. Regards. -- Eric Sammer [email protected] http://esammer.blogspot.com
