Pig in general do not deal with output directory, instead, it is handled by individual storer. Take PigStorage for example, in PigStorage.setStoreLocation, it invokes FileOutputFormat.setOutputPath, which then invoke set "mapreduce.output.fileoutputformat.outputdir".
Thanks, Daniel On Mon, Aug 4, 2014 at 11:02 AM, Ji Mahn Ok <[email protected]> wrote: > Hi, > > I would like to ask a question on pig property to set the output directory > of MapReduce Job produced by pig. As we know, > "mapreduce.output.fileoutputformat.outputdir" or "mapred.output.dir" is the > property we use to set the output directory. > It seems that pig sets "pig.reduce.output.dirs" property in addition to the > property mentioned above. > They usually have the same value but I find that sometimes they don't (e.g > PigMix L12 - a case of multi stores), they are different. In this case, > hadoop follows "pig.reduce.output.dirs" property. > > Could anyone explain how pig make hadoop use "pig.reduce.output.dirs" > property, instead of the usual property > ("mapreduce.output.fileoutputformat.outputdir" or "mapred.output.dir"), to > set the output directory? > Please feel free to correct me if there is any false point in my question. > > Thank you in advance. > > > Best Regards, > JI MAHN -- CONFIDENTIALITY NOTICE NOTICE: This message is intended for the use of the individual or entity to which it is addressed and may contain information that is confidential, privileged and exempt from disclosure under applicable law. If the reader of this message is not the intended recipient, you are hereby notified that any printing, copying, dissemination, distribution, disclosure or forwarding of this communication is strictly prohibited. If you have received this communication in error, please contact the sender immediately and delete it from your system. Thank You.
