Dear Wiki user,

You have subscribed to a wiki page or wiki category on "Pig Wiki" for change 
notification.

The following page has been changed by Shravan Narayanamurthy:
http://wiki.apache.org/pig/PigExecutionModel

------------------------------------------------------------------------------
  }}}
  
  Stubs for LocalRearrange and Package
- 
+ No need to provide an implementation for GlobalRearragnge as its taken care 
of by the shuffle phas. However, for performance improvements, we can add an 
identity combiner so that the local rearrange outputs a <groupKey,list of 
tuples>. In this case, we would have to slightly change the part where input is 
provided to POPackage as we need to merge the list of lists into a flattened 
Bag or Bag of Bags. If we have a bag of bags, then there will be a slight 
improvement in performance as all Tuples inside the inner bag will belong to 
the same input and we just need to put this bag into its appropriate place.
  {{{
  package org.apache.pig.optimization;
  

Reply via email to