HIVEMERGEMAPFILES("hive.merge.mapfiles", true),
HIVEMERGEMAPREDFILES("hive.merge.mapredfiles", false),
Set the above parameters to true before your query.
________________________________________
From: lei liu [[email protected]]
Sent: Thursday, August 05, 2010 8:47 PM
To: [email protected]
Subject: How to merge small files
When I run below sql: INSERT OVERWRITE TABLE tablename1 select_statement1 FROM
from_statement, there are many files which size is zero are stored to hadoop,
How can I merge these small files?
Thanks,
LiuLei