Pig Latin programs get translated into a set of physical operators
which are placed in MapReduce jobs. Whether a particular operator
ends up in a map or a reduce depends on a number of factors. We
presented a paper at VLDB a few years ago that goes into this in
detail, http://www.vldb.org/pvldb/2/vldb09-1074.pdf
Alan.
On May 20, 2011, at 5:16 AM, George Kousiouris wrote:
Hi all,
Sorry if this is a trivial question, but i wanted to clarify it before
starting to use pig.
How exactly does pig exploit the mapreduce framework? Is it through
the
standard pig commands? and do they all have a mapreduce
implementation?
or just some commands only (for example filter seems to be a mapper)?
Thanks,
George
--
---------------------------
George Kousiouris
Electrical and Computer Engineer
Division of Communications,
Electronics and Information Engineering
School of Electrical and Computer Engineering
Tel: +30 210 772 2546
Mobile: +30 6939354121
Fax: +30 210 772 2569
Email: [email protected]
National Technical University of Athens
9 Heroon Polytechniou str., 157 73 Zografou, Athens, Greece
