There is no concept of costing in pig at this point. Currently we let the script writer decide when to choose an FR Join over a symmetric hash join.

We certainly welcome any work on an optimizer in pig. Be sure and take a look at where some work on an optimizer has already started.


On Jan 16, 2009, at 10:51 AM, nitesh bhatia wrote:

I am working on addition of adaptive behavior in Pig Execution Model. Is there any pre-defined method to estimate execution time for Pig Simple join? I think for FRJoin some method will be required to estimate it. My idea is
to design an Adaptive query optimizer similar to that for Glue-Nail
Deductive database system ( ).


Nitesh Bhatia
Dhirubhai Ambani Institute of Information & Communication Technology

"Life is never perfect. It just depends where you draw the line."

visit: - connecting through music - lets volunteer for better tomorrow - Voice opinions, Transact easily, Have fun

Reply via email to