Re: Custom load function?

[jiang licht]

Thanks Dmitriy. I will read the example and see if I still have questions.

Thanks,

Michael

--- On Tue, 3/9/10, Dmitriy Ryaboy <dvrya...@gmail.com> wrote:

From: Dmitriy Ryaboy <dvrya...@gmail.com>
Subject: Re: Custom load function?
To: pig-user@hadoop.apache.org
Date: Tuesday, March 9, 2010, 7:51 PM

I am not sure what your question is.

Your function can work in any way that you want. You don't even have to read
files, you can connect to databases or make up your own data.  See the Hbase
LoadFunc for example. What exactly are you having trouble with?

-D

On Tue, Mar 9, 2010 at 5:43 PM, jiang licht <licht_ji...@yahoo.com> wrote:

> Not just processing different formats or performing pre-processing stuff as
> discussed in pig udf manual. What I want is that a function that can decide
> where to find what files to load and then load those files and generate
> desired tuples (embedded pig is a solution to this in a different way).
>
> Thanks,
>
> Michael
>
>
>