This feature is supported since 0.6 (PIG-1071). But the correct form is
raw = LOAD '/input_data/dir1,/input_data/dir2,/input_data/dir3' USING
PigStorage ('\t') AS (.....);
Thanks,
-Richard
-----Original Message-----
From: Katukuri, Jay [mailto:[email protected]]
Sent: Friday, May 07, 2010 3:53 PM
To: [email protected]
Subject: List of directories in Load
Hi all,
Is it possible to specify multiple HDFS directories in 'Load' function.
Ex: raw = LOAD '/input_data/dir1', '/input_data/dir2',
'/input_data/dir3' USING PigStorage ('\t') AS (.....);
Thanks,
Jay