-----------------------------------------------------------
This is an automatically generated e-mail. To reply, visit:
https://reviews.apache.org/r/45127/
-----------------------------------------------------------
Review request for pig and Daniel Dai.
Bugs: PIG-4840
https://issues.apache.org/jira/browse/PIG-4840
Repository: pig
Description
-------
We turn of UnionOptimizer for unsupported storefuncs as writing from two
vertices may overwrite data. But in the case where there is only one unique
union member we don't create vertex groups and merge the union operators into
the Split vertex, we can turn it on.
Also fixed TezVertexStats where it was showing twice the number of output
records when all the union members were merged into the split.
Diffs
-----
http://svn.apache.org/repos/asf/pig/trunk/src/org/apache/pig/backend/hadoop/executionengine/tez/plan/optimizer/MultiQueryOptimizerTez.java
1734835
http://svn.apache.org/repos/asf/pig/trunk/src/org/apache/pig/backend/hadoop/executionengine/tez/plan/optimizer/UnionOptimizer.java
1734835
http://svn.apache.org/repos/asf/pig/trunk/src/org/apache/pig/tools/pigstats/tez/TezVertexStats.java
1734835
http://svn.apache.org/repos/asf/pig/trunk/test/org/apache/pig/test/data/GoldenFiles/tez/TEZC-Union-1-SplitStore.gld
PRE-CREATION
http://svn.apache.org/repos/asf/pig/trunk/test/org/apache/pig/tez/TestTezCompiler.java
1734835
Diff: https://reviews.apache.org/r/45127/diff/
Testing
-------
Thanks,
Rohini Palaniswamy