Dear Wiki user, You have subscribed to a wiki page or wiki category on "Pig Wiki" for change notification.
The following page has been changed by AshutoshChauhan: http://wiki.apache.org/pig/PigMergeJoin ------------------------------------------------------------------------------ inputs to a merge join. If users wish to do three plus way joins with this algorithm they can decompose their joins into a series of two ways joins. ---- + == Performance Benchmark == + ||# of rows || # of rows || Sym-Hash Join || Merge-Join || Skew-Join || Remarks || + ||100K|| 100K|| 1m30.588s|| 0m41.764s|| |||| + ||5M|| 5M|| 1m5.579s|| 0m51.535s|| |||| + |15M|| 15M|| 2m55.812s|| 2m16.906s|| |||| + ||15M|| 15M|| 5m21.030s|| 4m12.125s|| |||| + ||20M|| 20M|| 10m30.819s|| 5m42.302s|| |||| + ||20M ||20M ||12m25.878s ||5m42.302s|| |||| + ||20M|| 20M || 15m56.533s|| 7m57.646s|| |||| + ||20M|| 20M|| . || 17m16.542s ||112m20.478s|||| + ||100M ||20M|| 30mins|| 15mins|| |||| + ||50M ||100M ||42mins ||28mins |||| + ||50M|| 100M|| 41mins, 56sec|| 28mins|| |||| + ||50M ||100M|| 42mins|| 28mins |||| + ||100M ||100M ||74mins|| 44mins|| |||| + + ---- == Phase 2 == Phase 1 which got committed in r804310 has few limitations. Those limitations are enumerated below with possible solutions:
