[
https://issues.apache.org/jira/browse/BEAM-7126?focusedWorklogId=260201&page=com.atlassian.jira.plugin.system.issuetabpanels:worklog-tabpanel#worklog-260201
]
ASF GitHub Bot logged work on BEAM-7126:
----------------------------------------
Author: ASF GitHub Bot
Created on: 14/Jun/19 07:40
Start Date: 14/Jun/19 07:40
Worklog Time Spent: 10m
Work Description: tweise commented on pull request #8697: [BEAM-7126] Fix
StateRequestHandler type variables to allow for proper key parameterization
URL: https://github.com/apache/beam/pull/8697#discussion_r293692424
##########
File path:
runners/flink/src/main/java/org/apache/beam/runners/flink/translation/wrappers/streaming/ExecutableStageDoFnOperator.java
##########
@@ -339,7 +339,8 @@ private void prepareStateBackend(K key) {
// Key for state request is shipped already encoded as ByteString,
// this is mostly a wrapping with ByteBuffer. We still follow the
// usual key encoding procedure.
- final ByteBuffer encodedKey = FlinkKeyUtils.encodeKey(key, keyCoder);
Review comment:
It seems to be cast into the portability support classes and there is a
comment here as well:
https://github.com/apache/beam/blob/247e93ef7fbe87dbb1cd82a0ce6b2e6aa5254f7c/runners/java-fn-execution/src/main/java/org/apache/beam/runners/fnexecution/state/StateRequestHandlers.java#L54
----------------------------------------------------------------
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.
For queries about this service, please contact Infrastructure at:
us...@infra.apache.org
Issue Time Tracking
-------------------
Worklog Id: (was: 260201)
Time Spent: 3h 50m (was: 3h 40m)
> Double encoding of state keys in portable Flink runner
> ------------------------------------------------------
>
> Key: BEAM-7126
> URL: https://issues.apache.org/jira/browse/BEAM-7126
> Project: Beam
> Issue Type: Bug
> Components: runner-flink
> Affects Versions: 2.11.0
> Reporter: Thomas Weise
> Assignee: Maximilian Michels
> Priority: Major
> Labels: portability-flink
> Fix For: 2.13.0
>
> Time Spent: 3h 50m
> Remaining Estimate: 0h
>
> State keys currently need to be encoded as NESTED. My attempt to use the
> ByteString directly in BEAM-7112 caused checkpointing to fail. We should look
> into eliminating the redundant key encoding and adjusting
> StateRequestHandlers.
--
This message was sent by Atlassian JIRA
(v7.6.3#76005)
