[
https://issues.apache.org/jira/browse/BEAM-11443?focusedWorklogId=524892&page=com.atlassian.jira.plugin.system.issuetabpanels:worklog-tabpanel#worklog-524892
]
ASF GitHub Bot logged work on BEAM-11443:
-----------------------------------------
Author: ASF GitHub Bot
Created on: 16/Dec/20 08:58
Start Date: 16/Dec/20 08:58
Worklog Time Spent: 10m
Work Description: dmvk commented on pull request #13538:
URL: https://github.com/apache/beam/pull/13538#issuecomment-745945570
The performance gain highly depends on the workload. We've seen some nice
results while processing backlog with fairly long windows and EOW triggers,
while in the "realtime" mode, with "speculative processing time triggers" this
doesn't make much of a difference. Also it higly depends on the message type
itself, whether its deeply nested protobuf or primitive time.
So it's super hard to give any precise number, but there is a lot of
potential in some cases.
----------------------------------------------------------------
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.
For queries about this service, please contact Infrastructure at:
[email protected]
Issue Time Tracking
-------------------
Worklog Id: (was: 524892)
Time Spent: 1h (was: 50m)
> Byte-based GroupByKey in Flink Streaming
> ----------------------------------------
>
> Key: BEAM-11443
> URL: https://issues.apache.org/jira/browse/BEAM-11443
> Project: Beam
> Issue Type: Improvement
> Components: runner-flink
> Reporter: David Morávek
> Assignee: David Morávek
> Priority: P3
> Time Spent: 1h
> Remaining Estimate: 0h
>
> Currently Flink Streaming GBK is implemented using
> `SystemReduceFn#buffering`, that works on de-serialized values (we need to
> de-serialize value after shuffle and then serialize again when appending to
> bag state).
> We can remove this unnecessary serde cycle by using binary representation
> instead of de-serialized payload.
--
This message was sent by Atlassian Jira
(v8.3.4#803005)
