I believe this JIRA could be related: https://issues.apache.org/jira/browse/PIG-2693
On Sun, May 13, 2012 at 8:41 PM, Travis Crawford <[email protected]>wrote: > Hey Aniket - > > I allegedly fixed this in: > > Automagically setting parallelism based on input file size does not > work with HCatalog > https://issues.apache.org/jira/browse/PIG-2573 > > HCatLoader should report its input size so pig can estimate the number > of reducers > https://issues.apache.org/jira/browse/HCATALOG-328 > > If its not working we should fix it. Can you provide more details? > > --travis > > > On Sun, May 13, 2012 at 7:24 PM, Aniket Mokashi <[email protected]> > wrote: > > Hi, > > > > I have observed that pig's reducer estimator does not work with > HCatalog. I > > am wondering if there is a way to make it work? If not, should we have a > > jira with pig to track this? > > > > Thanks, > > Aniket > -- *Note that I'm no longer using my Yahoo! email address. Please email me at [email protected] going forward.*
