There is no concept of costing in pig at this point. Currently we let the script writer decide when to choose an FR Join over a symmetric hash join.

We certainly welcome any work on an optimizer in pig. Be sure and take a look at https://issues.apache.org/jira/browse/PIG-360 where some work on an optimizer has already started.


Alan.

On Jan 16, 2009, at 10:51 AM, nitesh bhatia wrote:

Hi
I am working on addition of adaptive behavior in Pig Execution Model. Is there any pre-defined method to estimate execution time for Pig Simple join? I think for FRJoin some method will be required to estimate it. My idea is
to design an Adaptive query optimizer similar to that for Glue-Nail
Deductive database system (http://portal.acm.org/citation.cfm?id=615194 ).

--nitesh

--
Nitesh Bhatia
Dhirubhai Ambani Institute of Information & Communication Technology
Gandhinagar
Gujarat

"Life is never perfect. It just depends where you draw the line."

visit:
http://www.awaaaz.com - connecting through music
http://www.volstreet.com - lets volunteer for better tomorrow
http://www.instibuzz.com - Voice opinions, Transact easily, Have fun

Reply via email to