-----------------------------------------------------------
This is an automatically generated e-mail. To reply, visit:
https://reviews.apache.org/r/45127/
-----------------------------------------------------------

Review request for pig and Daniel Dai.


Bugs: PIG-4840
    https://issues.apache.org/jira/browse/PIG-4840


Repository: pig


Description
-------

We turn of UnionOptimizer for unsupported storefuncs as writing from two 
vertices may overwrite data. But in the case where there is only one unique 
union member we don't create vertex groups and merge the union operators into 
the Split vertex, we can turn it on.

Also fixed TezVertexStats where it was showing twice the number of output 
records when all the union members were merged into the split.


Diffs
-----

  
http://svn.apache.org/repos/asf/pig/trunk/src/org/apache/pig/backend/hadoop/executionengine/tez/plan/optimizer/MultiQueryOptimizerTez.java
 1734835 
  
http://svn.apache.org/repos/asf/pig/trunk/src/org/apache/pig/backend/hadoop/executionengine/tez/plan/optimizer/UnionOptimizer.java
 1734835 
  
http://svn.apache.org/repos/asf/pig/trunk/src/org/apache/pig/tools/pigstats/tez/TezVertexStats.java
 1734835 
  
http://svn.apache.org/repos/asf/pig/trunk/test/org/apache/pig/test/data/GoldenFiles/tez/TEZC-Union-1-SplitStore.gld
 PRE-CREATION 
  
http://svn.apache.org/repos/asf/pig/trunk/test/org/apache/pig/tez/TestTezCompiler.java
 1734835 

Diff: https://reviews.apache.org/r/45127/diff/


Testing
-------


Thanks,

Rohini Palaniswamy

Reply via email to