Rohini Palaniswamy created PIG-4785:
---------------------------------------
Summary: Optimize multi-query plan for diamond shape edges
Key: PIG-4785
URL: https://issues.apache.org/jira/browse/PIG-4785
Project: Pig
Issue Type: Sub-task
Reporter: Rohini Palaniswamy
Assignee: Rohini Palaniswamy
If diamond shaped edge (two edges going to same vertex), we do not merge into
Split. Lot of data is transferred because of that. It can be optimized to merge
the operator into the Split, but still have a POValueInputTez->POValueOutputTez
vertex which just will be used to redirect the input to avoid the diamond
shaped edge. This will allow filtering and other processing to happen in the
Split operator itself and the data transferred to the routing vertex will be
minimal.
--
This message was sent by Atlassian JIRA
(v6.3.4#6332)
