Madhavi Nadig created PIG-3548:
----------------------------------
Summary: Allow pig to load multiple paths specified in a
filenames.txt
Key: PIG-3548
URL: https://issues.apache.org/jira/browse/PIG-3548
Project: Pig
Issue Type: Improvement
Reporter: Madhavi Nadig
I have a list of paths stored in a filenames.txt. I would like to load them all
using a single LOAD command. The paths don't conform to one or more regexes, so
they have to specified individually.
So far I've used the -param option with pig to specify them. But it results in
an extremely long commandline and I'm afraid I wont be able to scale my script.
shell : pig -param read_paths=<my-long-list-of-paths> something.pig
something.pig : requests = LOAD '$read_paths' USING PigStorage(',');
--
This message was sent by Atlassian JIRA
(v6.1#6144)
