Hi,
I am trying to write a loader which can append the input path as a
field, something like this:

hadoop fs -ls a/
1.txt
2.txt
3.txt

a = load 'a/*' using MyLoader() as (id, path);
dump a;

(x,a/1.txt)
(y,a/2.txt)
(z,a/3.txt)

I tried to subclass PigStorage, and append location to the end of the
returned tuple, but what I got is:

(x,a/*)
(y,a/*)
(z,a/*)

Where can I find the absolute path of the input file? Thanks!

Shawn

Reply via email to