[
https://issues.apache.org/jira/browse/FLINK-23908?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
]
Till Rohrmann closed FLINK-23908.
---------------------------------
Resolution: Fixed
Fixed via
1.14.0: b09978ba065da9a6525a02e19c25514032330f31
1.13.3: 85114ebeac590df576a05612b86e257a37c9ff7c
1.12.6: 70a56575d467945cc2893a03dc7a59c92509b56f
> Hint user about possibly non-deterministic key
> ----------------------------------------------
>
> Key: FLINK-23908
> URL: https://issues.apache.org/jira/browse/FLINK-23908
> Project: Flink
> Issue Type: Sub-task
> Components: Runtime / State Backends
> Affects Versions: 1.14.0, 1.12.5, 1.13.2
> Reporter: David Morávek
> Assignee: David Morávek
> Priority: Major
> Labels: pull-request-available
> Fix For: 1.14.0, 1.12.6, 1.13.3
>
>
> If user has non-deterministic hashCode and equals implementation, he ends up
> with "confusing" (if you don't now details about Flink internals) exception.
> RocksDBStateBackend:
> {code}
> Caused by: java.lang.IllegalArgumentException: Key group 0 is not in
> KeyGroupRange{startKeyGroup=32, endKeyGroup=63}.
> at
> org.apache.flink.runtime.state.KeyGroupRangeOffsets.computeKeyGroupIndex(KeyGroupRangeOffsets.java:142)
> at
> org.apache.flink.runtime.state.KeyGroupRangeOffsets.setKeyGroupOffset(KeyGroupRangeOffsets.java:104)
> at
> org.apache.flink.contrib.streaming.state.snapshot.RocksFullSnapshotStrategy$SnapshotAsynchronousPartCallable.writeKVStateData(RocksFullSnapshotStrategy.java:319)
> at
> org.apache.flink.contrib.streaming.state.snapshot.RocksFullSnapshotStrategy$SnapshotAsynchronousPartCallable.writeSnapshotToOutputStream(RocksFullSnapshotStrategy.java:261)
> {code}
> HeapStateBackend:
> {code}
> 2021-08-16 16:28:54 java.lang.NullPointerException: null
> 2021-08-16 16:28:54 at
> org.apache.flink.runtime.state.heap.StateTable.put(StateTable.java:351)
> ~[flink-dist_2.11-1.12.3.jar:1.12.3]
> 2021-08-16 16:28:54 at
> org.apache.flink.runtime.state.heap.StateTable.put(StateTable.java:159)
> ~[flink-dist_2.11-1.12.3.jar:1.12.3]
> 2021-08-16 16:28:54 at
> org.apache.flink.runtime.state.heap.HeapListState.add(HeapListState.java:98)
> ~[flink-dist_2.11-1.12.3.jar:1.12.3]
> 2021-08-16 16:28:54 at
> org.apache.flink.streaming.runtime.operators.windowing.WindowOperator.processElement(WindowOperator.java:422)
> ~[flink-dist_2.11-1.12.3.jar:1.12.3]
> 2021-08-16 16:28:54 at
> org.apache.flink.streaming.runtime.tasks.OneInputStreamTask$StreamTaskNetworkOutput.emitRecord(OneInputStreamTask.java:191)
> ~[flink-dist_2.11-1.12.3.jar:1.12.3]
> 2021-08-16 16:28:54 at
> org.apache.flink.streaming.runtime.io.StreamTaskNetworkInput.processElement(StreamTaskNetworkInput.java:204)
> ~[flink-dist_2.11-1.12.3.jar:1.12.3]
> 2021-08-16 16:28:54 at
> org.apache.flink.streaming.runtime.io.StreamTaskNetworkInput.emitNext(StreamTaskNetworkInput.java:174)
> ~[flink-dist_2.11-1.12.3.jar:1.12.3]
> 2021-08-16 16:28:54 at
> org.apache.flink.streaming.runtime.io.StreamOneInputProcessor.processInput(StreamOneInputProcessor.java:65)
> ~[flink-dist_2.11-1.12.3.jar:1.12.3]
> 2021-08-16 16:28:54 at
> org.apache.flink.streaming.runtime.tasks.StreamTask.processInput(StreamTask.java:396)
> ~[flink-dist_2.11-1.12.3.jar:1.12.3]
> 2021-08-16 16:28:54 at
> org.apache.flink.streaming.runtime.tasks.mailbox.MailboxProcessor.runMailboxLoop(MailboxProcessor.java:191)
> ~[flink-dist_2.11-1.12.3.jar:1.12.3]
> 2021-08-16 16:28:54 at
> org.apache.flink.streaming.runtime.tasks.StreamTask.runMailboxLoop(StreamTask.java:617)
> ~[flink-dist_2.11-1.12.3.jar:1.12.3]
> 2021-08-16 16:28:54 at
> org.apache.flink.streaming.runtime.tasks.StreamTask.invoke(StreamTask.java:581)
> ~[flink-dist_2.11-1.12.3.jar:1.12.3]
> 2021-08-16 16:28:54 at
> org.apache.flink.runtime.taskmanager.Task.doRun(Task.java:755)
> ~[flink-dist_2.11-1.12.3.jar:1.12.3]
> 2021-08-16 16:28:54 at
> org.apache.flink.runtime.taskmanager.Task.run(Task.java:570)
> ~[flink-dist_2.11-1.12.3.jar:1.12.3]
> 2021-08-16 16:28:54 at java.lang.Thread.run(Unknown Source) ~[?:?]
> {code}
--
This message was sent by Atlassian Jira
(v8.3.4#803005)
