[
https://issues.apache.org/jira/browse/BEAM-12333?focusedWorklogId=595705&page=com.atlassian.jira.plugin.system.issuetabpanels:worklog-tabpanel#worklog-595705
]
ASF GitHub Bot logged work on BEAM-12333:
-----------------------------------------
Author: ASF GitHub Bot
Created on: 12/May/21 23:30
Start Date: 12/May/21 23:30
Worklog Time Spent: 10m
Work Description: kw2542 commented on a change in pull request #14802:
URL: https://github.com/apache/beam/pull/14802#discussion_r631467742
##########
File path:
runners/samza/src/main/java/org/apache/beam/runners/samza/runtime/SamzaTimerInternalsFactory.java
##########
@@ -682,16 +653,26 @@ public void encode(TimerKey<K> value, OutputStream
outStream)
throws CoderException, IOException {
// encode the timestamp first
- STRING_CODER.encode(value.timerId, outStream);
- STRING_CODER.encode(value.stateNamespace.stringKey(), outStream);
+ STRING_CODER.encode(value.getTimerId(), outStream);
+ STRING_CODER.encode(value.getStateNamespace().stringKey(), outStream);
if (keyCoder != null) {
- keyCoder.encode(value.key, outStream);
+ keyCoder.encode(value.getKey(), outStream);
+ }
+
+ // encode a byte (1/0) to indicate the presence/absence of timerFamilyId
+ // We can use this approach to add additional fields in the future
+ if (!Strings.isNullOrEmpty(value.getTimerFamilyId())) {
+ BOOLEAN_CODER.encode(true, outStream);
Review comment:
Got you, actually we do not need that because when timer family id is
not present, we will still encode `null` in the bytes to actually indicate that
timer family id is null.
--
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.
For queries about this service, please contact Infrastructure at:
[email protected]
Issue Time Tracking
-------------------
Worklog Id: (was: 595705)
Time Spent: 0.5h (was: 20m)
> TimerFamilyId is not present in TimerKey in SamzaTimerInternalsFactory and
> therefore doesn't get persisted for Processing Time timers
> -------------------------------------------------------------------------------------------------------------------------------------
>
> Key: BEAM-12333
> URL: https://issues.apache.org/jira/browse/BEAM-12333
> Project: Beam
> Issue Type: Improvement
> Components: runner-samza
> Reporter: Ajo Thomas
> Assignee: Ajo Thomas
> Priority: P3
> Time Spent: 0.5h
> Remaining Estimate: 0h
>
> `SamzaTimerInternalsFactory` stores timer state, event time and processing
> time timers alike, in the form of a MapState<TimerKey<K>, Long>. TimerKey,
> however, doesn't include the `TimerFamilyId` and is therefore not persisted.
> On the other hand, event time timers uses an additional time sorted set to
> persist the TimerData(which contains TimerFamilyId). We need to include timer
> family id in the TimerKey to ensure that it is persisted.
--
This message was sent by Atlassian Jira
(v8.3.4#803005)
