Xianda Ke created PIG-4876:
------------------------------
Summary: OutputConsumeIterator can't handle the last buffered
tuples for some Operators
Key: PIG-4876
URL: https://issues.apache.org/jira/browse/PIG-4876
Project: Pig
Issue Type: Sub-task
Reporter: Xianda Ke
Assignee: Xianda Ke
Some Operators, such as MergeCogroup, Stream, CollectedGroup etc buffer some
input records to constitute the result tuples. The last result tuples are
buffered in the operator. These Operators need a flag to indicate the end of
input, so that they can flush and constitute their last tuples.
Currently, the flag 'parentPlan.endOfAllInput' is targeted for flushing the
buffered tuples in MR mode. But it does not work with OutputConsumeIterator in
Spark mode.
--
This message was sent by Atlassian JIRA
(v6.3.4#6332)
