Re: Custom load function?

[Alan Gates]

PigStorage (the default load function) takes Hadoop regular  
expressions.  So as long as you can express these files in a valid  
Hadoop regular expression it should work fine.

Alan.

On Mar 9, 2010, at 7:56 PM, jiang licht wrote:

Before I read the example, here's a simple thing that I want to know  
how to implement but not sure: I have a list of files which are  
scattered in different folders in a hadoop cluster, instead of  
firing multiple "load" to read each file, I want to put the full  
path names of these files on a list and then have a load function  
that can take the file name of the list as an argument and then load  
these files ...

Thanks,

Michael