Hi Praveen, Thanks for the reply. In fact after a minor debugging, I could make it work and it could read in using the glob pattern.
Best, Hanif On Friday, October 3, 2014 3:08 AM, Praveen R <prav...@sigmoidanalytics.com> wrote: Looks like Pig load doesn't support glob patterns. I guess you would need to write a custom loader to achieve this. On Fri, Oct 3, 2014 at 3:25 AM, hanif mahboobi < hanifmahbo...@yahoo.com.invalid> wrote: > Hi There, > > Here is my problem. > I have a folder with thousands of files in it. I just want to load certain > subset of them which have a specific string in their names (in this example > "site"). > > Knowing that something like this does not work: > table = LOAD 'folder/*site*' USING ... > > Can anybody help with that? > > Thanks, > Hanif