There is no concept of costing in pig at this point. Currently we let
the script writer decide when to choose an FR Join over a symmetric
hash join.
We certainly welcome any work on an optimizer in pig. Be sure and
take a look at https://issues.apache.org/jira/browse/PIG-360 where
some work on an optimizer has already started.
Alan.
On Jan 16, 2009, at 10:51 AM, nitesh bhatia wrote:
Hi
I am working on addition of adaptive behavior in Pig Execution
Model. Is
there any pre-defined method to estimate execution time for Pig
Simple join?
I think for FRJoin some method will be required to estimate it. My
idea is
to design an Adaptive query optimizer similar to that for Glue-Nail
Deductive database system (http://portal.acm.org/citation.cfm?id=615194
).
--nitesh
--
Nitesh Bhatia
Dhirubhai Ambani Institute of Information & Communication Technology
Gandhinagar
Gujarat
"Life is never perfect. It just depends where you draw the line."
visit:
http://www.awaaaz.com - connecting through music
http://www.volstreet.com - lets volunteer for better tomorrow
http://www.instibuzz.com - Voice opinions, Transact easily, Have fun
