People use this feature when they want to load many files with the same schema. It's hard to see how this feature can be used to manage tables with different schema (as in the AS clause).
Thanks, -Richard -----Original Message----- From: Syed Wasti [mailto:[email protected]] Sent: Monday, May 10, 2010 10:58 AM To: [email protected] Subject: Re: List of directories in Load This is interesting... When can we use this option ? Can the different directories be two different tables ? On 5/7/10 4:14 PM, "Richard Ding" <[email protected]> wrote: > This feature is supported since 0.6 (PIG-1071). But the correct form is > > raw = LOAD '/input_data/dir1,/input_data/dir2,/input_data/dir3' USING > PigStorage ('\t') AS (.....); > > Thanks, > -Richard > -----Original Message----- > From: Katukuri, Jay [mailto:[email protected]] > Sent: Friday, May 07, 2010 3:53 PM > To: [email protected] > Subject: List of directories in Load > > Hi all, > Is it possible to specify multiple HDFS directories in 'Load' function. > Ex: raw = LOAD '/input_data/dir1', '/input_data/dir2', > '/input_data/dir3' USING PigStorage ('\t') AS (.....); > > Thanks, > Jay >
