To close the loop on this... we identified an issue with a recent pig patch and are fixing. Will be fixed shortly.
--travis On Sun, May 13, 2012 at 11:22 PM, Bill Graham <[email protected]> wrote: > I believe this JIRA could be related: > > https://issues.apache.org/jira/browse/PIG-2693 > > > On Sun, May 13, 2012 at 8:41 PM, Travis Crawford > <[email protected]>wrote: > >> Hey Aniket - >> >> I allegedly fixed this in: >> >> Automagically setting parallelism based on input file size does not >> work with HCatalog >> https://issues.apache.org/jira/browse/PIG-2573 >> >> HCatLoader should report its input size so pig can estimate the number >> of reducers >> https://issues.apache.org/jira/browse/HCATALOG-328 >> >> If its not working we should fix it. Can you provide more details? >> >> --travis >> >> >> On Sun, May 13, 2012 at 7:24 PM, Aniket Mokashi <[email protected]> >> wrote: >> > Hi, >> > >> > I have observed that pig's reducer estimator does not work with >> HCatalog. I >> > am wondering if there is a way to make it work? If not, should we have a >> > jira with pig to track this? >> > >> > Thanks, >> > Aniket >> > > > > -- > *Note that I'm no longer using my Yahoo! email address. Please email me at > [email protected] going forward.*
