Those would be passed as parameters either through -param option or through a parameter file with -param_file option and the pig's preprocessor just substitutes the values in your script. Since its just a blind parameter substitution, in my shingling script I even had the schema definition passed to it. I suppose passing input field name shouldn't be an issue as long as it is valid In the context of script execution plan.
-...@nkur 10 11:32 PM, "Ted Dunning" <ted.dunn...@gmail.com> wrote: As an interesting test case, can you write a pig program that counts words. BUT, it takes an input file name AND an input field name. On Mon, Feb 22, 2010 at 9:56 AM, Ted Dunning <ted.dunn...@gmail.com> wrote: > > That isn't an issue here. It is the invocation of pig programs and passing > useful information to them that is the problem. > > > On Mon, Feb 22, 2010 at 9:20 AM, Ankur C. Goel <gan...@yahoo-inc.com>wrote: > >> Scripting ability while still limited has better streaming support so you >> can have relations streamed >> Into a custom script executing in either map or reduce phase depending >> upon where it is placed. >> > > > > -- > Ted Dunning, CTO > DeepDyve > > -- Ted Dunning, CTO DeepDyve
