Pig will filter file start with ".", and this is also the default behavior of hadoop's InputFormat. If you use the next release Pig 0.7 which integrate Hadoop's InputFormat, you can override the InputFormat to include files start with "."
On Sun, May 9, 2010 at 12:03 AM, hc busy <[email protected]> wrote: > This might be well known already, but I just got kicked in the behind by a > temporary file that I generate and load that starts it's file name with a > period. Apparently PigStorage will not load any files starting with a > period... Sigh, probly a feature, but took a while to figure out. > > > It's actually kinda funny that I initially thought cogroup was broken before > checking out the Storage as the culprit... > > > > -- busy > -- Best Regards Jeff Zhang
