[
https://issues.apache.org/jira/browse/BEAM-4604?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=16519518#comment-16519518
]
Kenneth Knowles commented on BEAM-4604:
---------------------------------------
[~bushkovsky] I see your case. I think you can use triggers with GroupByKey and
trigger after 10 elements or 1 second of processing time. Then if you want to
be sure that you have bunches of 10 or less, you can split them. Does that work?
[~echauchot] I don't think you should change GroupIntoBatches. We might want to
document how users can decide whether they want GroupIntoBatches or GroupByKey
with triggers.
> Support Triggers for "GroupIntoBatches" Transform
> -------------------------------------------------
>
> Key: BEAM-4604
> URL: https://issues.apache.org/jira/browse/BEAM-4604
> Project: Beam
> Issue Type: Improvement
> Components: sdk-java-core
> Reporter: Oleksandr Bushkovskyi
> Priority: Major
>
> I think it makes sense to implement triggering support for "GroupIntoBatches"
> transform.
> I've spent quite a long time trying to understand why my triggering behavior
> doesn't work with "GroupIntoBatches".
> This transform has an exactly same signature and similar naming as
> "GroupByKey" transform. It's confusing that this two similar from outer view
> transforms works differently with triggers.
> At least it should be clearly documented with "GroupIntoBatches" that it
> doesn't support triggers.
--
This message was sent by Atlassian JIRA
(v7.6.3#76005)