Andrew Crites created BEAM-9624:
-----------------------------------
Summary: Combine operation should support only converting to
accumulators
Key: BEAM-9624
URL: https://issues.apache.org/jira/browse/BEAM-9624
Project: Beam
Issue Type: Improvement
Components: runner-core
Reporter: Andrew Crites
Assignee: Andrew Crites
For streaming pipelines, we want to be able to lift the combiner into the
MergeBuckets without having to also do a PartialGroupByKey before the shuffle.
We don't want to do the PGBK since it could cause non-deterministic results
when used with some triggers.
We propose adding a new URN for doing just the convert to accumulators step and
adding support for it in Java/Python/Go.
--
This message was sent by Atlassian Jira
(v8.3.4#803005)
