Re: Potential bug around hive merging of small files

This does look like a bug. Shrijeet, mind opening a jira and attaching your patch there. Thanks, Ashutosh On Mon, Mar 12, 2012 at 16:29, Shrijeet Paliwal shrij...@rocketfuel.comwrote: I had a type in last email. Settings are as follows hive set mapred.min.split.size.per.node=10; hive

Re: Potential bug around hive merging of small files

I have opened https://issues.apache.org/jira/browse/HIVE-2869 On Tue, Mar 13, 2012 at 8:37 AM, Ashutosh Chauhan hashut...@apache.orgwrote: This does look like a bug. Shrijeet, mind opening a jira and attaching your patch there. Thanks, Ashutosh On Mon, Mar 12, 2012 at 16:29, Shrijeet

Potential bug around hive merging of small files

Hive Version: Hive 0.8 (last commit SHA b581a6192b8d4c544092679d05f45b2e50d42b45 ) Hadoop version : chd3u0 I am trying to use the hive merge small file feature by setting all the necessary params. I am disabling use of CombineHiveInputFormat since my input is compressed text. hive set

Re: Potential bug around hive merging of small files

I had a type in last email. Settings are as follows hive set mapred.min.split.size.per.node=10; hive set mapred.min.split.size.per.rack=10; hive set mapred.max.split.size=10; hive set hive.merge.size.per.task=10; hive set hive.merge.smallfiles.avgsize=10;