Tzu-Li (Gordon) Tai created FLINK-11287:
-------------------------------------------
Summary: RocksDBListState creation should use actual registered
state serializer instead of serializer provided by descriptor
Key: FLINK-11287
URL: https://issues.apache.org/jira/browse/FLINK-11287
Project: Flink
Issue Type: Bug
Components: State Backends, Checkpointing
Reporter: Tzu-Li (Gordon) Tai
Assignee: Tzu-Li (Gordon) Tai
Fix For: 1.8.0
Currently, when creating a {{RocksDBListState}}, the element serializer wrapped
by the {{RocksDBListState}} is retrieved from the state descriptor:
{code}
static <E, K, N, SV, S extends State, IS extends S> IS create(
StateDescriptor<S, SV> stateDesc,
Tuple2<ColumnFamilyHandle, RegisteredKeyValueStateBackendMetaInfo<N, SV>>
registerResult,
RocksDBKeyedStateBackend<K> backend) {
return (IS) new RocksDBListState<>(
registerResult.f0,
registerResult.f1.getNamespaceSerializer(),
(TypeSerializer<List<E>>) registerResult.f1.getStateSerializer(),
(List<E>) stateDesc.getDefaultValue(),
backend);
}
{code}
This is incorrect, since new serializers retrieved from state descriptors have
not been checked for compatibility with restored state.
Instead, the element serializer should be retrieved from the register result,
which contains the actual state serializer registered in the state backend for
state access (and has already been checked for compatibility / reconfigured
appropriately).
--
This message was sent by Atlassian JIRA
(v7.6.3#76005)
