This is an automated email from the ASF dual-hosted git repository.
tzulitai pushed a change to branch master
in repository https://gitbox.apache.org/repos/asf/flink.git.
from 8e39851 [FLINK-11449][table-common] Introduce a new expression stack
and visitor interface
new 0e99a23 [FLINK-11740] [core] Clarify CompositeTypeSerializerSnapshot
class signature
new 38f7a9c [hotfix] [core] Fix
TypeSerializerUtils#snapshotBackwardsCompatible method signature
new 3f9d9cf [FLINK-11772] [DataStream] Remove "config" from all
serializer snapshot field / method names in InternalTimersSnapshot
new 14aae59 [FLINK-11772] [DataStream] Let InternalTimerServiceImpl use
new serialization compatibility APIs for key / namespace serializer checks
new 8b8dd80 [FLINK-11772] [DataStream]
InternalTimerServiceSerializationProxy should not be serializing timers' key /
namespace serializers anymore
new d954b25 [FLINK-11741] [core] Add getNestedSerializerSnapshots utility
method in CompositeTypeSerializerConfigSnapshot
new 154bb6e [FLINK-11741] [runtime] Replace ArrayListSerializer's
ensureCompatibility method with SelfResolvingTypeSerializer implementation
new cc22268 [FLINK-11741] [core] Remove CompositeSerializer's
ensureCompatibility method using SelfResolvingTypeSerializer interface
new 02d877a [FLINK-11741] [core] Remove Scala EitherSerializer's
ensureCompatibility method using LegacySerializerSnapshotTransformer interface
new 750e4c7 [FLINK-11741] [table] Remove table dataview serializers'
ensureCompatibility method using LegacySerializerSnapshotTransformer interface
new 852f876 [FLINK-11741] [runtime] WritableSerializer's
ensureCompatibility method should have been removed
new fab31b2 [FLINK-11741] Remove ensureCompatibility implementation from
dummy serializers
new 65dedef [FLINK-11741] [tests] Remove ensureCompatibility
implementation in all test-related serializers
new b2ac45b [FLINK-11755] [tests] Remove
TypeSerializerSnapshotTest#testBridgeCompatibilityCheck test
new 108a90a [FLINK-11741] [core] Remove TypeSerializerSingleton's
ensureCompatibility implementation
new 17c07ac [FLINK-11741] [cep] Migrate legacy NFA serializers to use new
serialization compatibility abstractions
new cb91548 [FLINK-11755] [core] Remove no longer used CompatibilityUtil
class
new 2e924a1 [FLINK-11755] [core] Drop ensureCompatibility from
TypeSerializer
new 937c0db [FLINK-11755] [core] Drop no longer used class
CompatibilityResult
new 572b9d6 [FLINK-11755] [core] Removed no longer used class
TypeDeserializer
new 0ab52e9 [FLINK-11406] [core] Return INCOMPATIBLE when nested
serializers arity don't match in CompositeTypeSerializerSnapshot
new 4c6be5a [FLINK-11753] [tests] Add hamcrest matchers for
TypeSerializerSchemaCompatibility
new 1c36d22 [FLINK-11753] [tests] Refactor
SchemaCompatibilityTestingSerializer
new 7c95643 [FLINK-11773] [core] Add LinkedOptionalMapSerializer
new d579cc9 [FLINK-11773] [core] Use LinkedOptionalMapSerializer in
Kryo-/PojoSerializerSnapshotData
new 2a60cd7 [FLINK-11773] [tests] Add unit tests for
KryoSerializerSnapshot
new 541eb5e [FLINK-10342] [kafka] Filter restored partitions in
FlinkKafkaConsumer with topics descriptor
new 6a4f012 [FLINK-10342] [kafka] Improve Javadoc of new
disableFilterRestoredPartitionsWithSubscribedTopics method in
FlinkKafkaConsumerBase
new 276807e [hotfix] [tests]Fix typo in RollingSinkSecuredITCase.java
new e9ec5d6 [FLINK-11771] [core] Fix
TypeSerializerSnapshot#readVersionedSnapshot for TypeSerializerSnapshots
directly upgraded from TypeSerializerConfigSnapshot
new 651ebf4 [FLINK-10777] [tests] Update
TypeSerializerSnapshotMigrationITCase to cover restoring from 1.7.x
new 459fd92 [FLINK-10785] [tests] Upgrade
FlinkKinesisConsumerMigrationTest to test restoring from 1.7.x
The 32 revisions listed above as "new" are entirely new to this
repository and will be described in separate emails. The revisions
listed as "add" were already present in the repository and have only
been added to this reference.
Summary of changes:
.../connectors/fs/RollingSinkSecuredITCase.java | 2 +-
.../connectors/kafka/FlinkKafkaConsumerBase.java | 34 +++
.../internals/AbstractPartitionDiscoverer.java | 2 +-
.../kafka/internals/KafkaTopicsDescriptor.java | 17 +-
.../kafka/FlinkKafkaConsumerBaseMigrationTest.java | 23 +-
.../kafka/FlinkKafkaConsumerBaseTest.java | 170 ++++++++++-
.../kafka/internals/KafkaTopicsDescriptorTest.java | 64 ++++
.../kinesis/FlinkKinesisConsumerMigrationTest.java | 2 +-
...consumer-migration-test-flink1.7-empty-snapshot | Bin 0 -> 18539 bytes
...nesis-consumer-migration-test-flink1.7-snapshot | Bin 0 -> 18607 bytes
.../java/typeutils/runtime/WritableSerializer.java | 16 +-
.../api/common/typeutils/CompatibilityResult.java | 116 --------
.../api/common/typeutils/CompatibilityUtil.java | 109 -------
.../api/common/typeutils/CompositeSerializer.java | 49 ---
.../CompositeTypeSerializerConfigSnapshot.java | 7 +
.../typeutils/CompositeTypeSerializerSnapshot.java | 17 +-
.../ParameterlessTypeSerializerConfig.java | 23 ++
.../api/common/typeutils/TypeDeserializer.java | 80 -----
.../common/typeutils/TypeDeserializerAdapter.java | 139 ---------
.../flink/api/common/typeutils/TypeSerializer.java | 51 +---
.../typeutils/TypeSerializerConfigSnapshot.java | 25 +-
.../common/typeutils/TypeSerializerSnapshot.java | 13 +-
.../api/common/typeutils/TypeSerializerUtils.java | 2 +-
.../typeutils/UnloadableDummyTypeSerializer.java | 7 +-
.../base/GenericArraySerializerSnapshot.java | 9 +-
.../typeutils/base/ListSerializerSnapshot.java | 7 +-
.../typeutils/base/MapSerializerSnapshot.java | 6 +-
.../typeutils/base/TypeSerializerSingleton.java | 36 +--
.../runtime/EitherSerializerConfigSnapshot.java | 1 -
.../runtime/JavaEitherSerializerSnapshot.java | 14 +-
.../java/typeutils/runtime/NullableSerializer.java | 8 +-
.../runtime/PojoSerializerSnapshotData.java | 65 +---
.../typeutils/runtime/TupleSerializerSnapshot.java | 9 +-
.../runtime/kryo/KryoSerializerSnapshotData.java | 208 +++++++------
.../flink/util/LinkedOptionalMapSerializer.java | 129 ++++++++
.../CompositeTypeSerializerSnapshotTest.java | 37 ++-
.../typeutils/CompositeTypeSerializerUtilTest.java | 56 ++--
.../common/typeutils/TypeSerializerMatchers.java | 199 +++++++++++++
.../TypeSerializerSerializationUtilTest.java | 31 +-
.../TypeSerializerSnapshotMigrationTestBase.java | 33 +--
.../typeutils/TypeSerializerSnapshotTest.java | 19 --
.../base/EnumSerializerSnapshotMigrationTest.java | 39 +--
.../PojoSerializerSnapshotMigrationTest.java | 3 +-
.../runtime/PojoSerializerSnapshotTest.java | 21 +-
.../runtime/kryo/KryoSerializerSnapshotTest.java | 167 +++++++++++
.../SchemaCompatibilityTestingSerializer.java | 327 +++++++++------------
.../avro/typeutils/AvroSerializerSnapshotTest.java | 44 +--
.../api/java/io/CollectionInputFormatTest.java | 6 -
.../main/java/org/apache/flink/cep/nfa/NFA.java | 97 +++---
.../org/apache/flink/cep/nfa/SharedBuffer.java | 107 ++++---
.../LockableTypeSerializerSnapshot.java | 6 +-
.../flink/runtime/state/ArrayListSerializer.java | 49 ++-
.../runtime/state/ArrayListSerializerSnapshot.java | 6 +-
.../flink/runtime/state/ttl/TtlStateFactory.java | 30 +-
.../testutils/types/IntListSerializer.java | 6 -
.../testutils/types/IntPairSerializer.java | 6 -
.../testutils/types/StringPairSerializer.java | 10 +-
.../flink/runtime/query/KvStateRegistryTest.java | 6 -
.../state/InternalPriorityQueueTestBase.java | 39 ++-
.../runtime/state/OperatorStateBackendTest.java | 13 +-
.../state/heap/TestDuplicateSerializer.java | 10 +-
.../testutils/recordutils/RecordSerializer.java | 10 +-
.../ScalaCaseClassSerializerSnapshot.java | 9 +-
.../typeutils/ScalaEitherSerializerSnapshot.java | 6 +-
.../typeutils/ScalaOptionSerializerSnapshot.java | 7 +-
.../typeutils/ScalaTrySerializerSnapshot.java | 7 +-
.../typeutils/TraversableSerializerSnapshot.java | 9 +-
.../Tuple2CaseClassSerializerSnapshot.java | 5 +-
.../api/scala/typeutils/EitherSerializer.scala | 57 ++--
.../api/scala/typeutils/NothingSerializer.scala | 6 +-
.../streaming/api/datastream/CoGroupedStreams.java | 7 +-
.../functions/sink/TwoPhaseCommitSinkFunction.java | 7 +-
.../api/operators/InternalTimerServiceImpl.java | 71 +++--
.../InternalTimerServiceSerializationProxy.java | 18 +-
.../api/operators/InternalTimersSnapshot.java | 50 +---
.../InternalTimersSnapshotReaderWriters.java | 115 ++++++--
.../api/operators/TimerSerializerSnapshot.java | 9 +-
.../api/operators/co/IntervalJoinOperator.java | 7 +-
.../streamrecord/StreamElementSerializer.java | 8 +-
.../operators/InternalTimerServiceImplTest.java | 16 +-
.../table/dataview/ListViewSerializerSnapshot.java | 6 +-
.../table/dataview/MapViewSerializerSnapshot.java | 6 +-
.../flink/table/dataview/ListViewSerializer.scala | 60 ++--
.../flink/table/dataview/MapViewSerializer.scala | 72 ++---
.../TypeSerializerSnapshotMigrationITCase.java | 14 +-
.../_metadata | Bin 0 -> 3302 bytes
.../_metadata | Bin 0 -> 3201 bytes
87 files changed, 1737 insertions(+), 1672 deletions(-)
create mode 100644
flink-connectors/flink-connector-kafka-base/src/test/java/org/apache/flink/streaming/connectors/kafka/internals/KafkaTopicsDescriptorTest.java
create mode 100644
flink-connectors/flink-connector-kinesis/src/test/resources/kinesis-consumer-migration-test-flink1.7-empty-snapshot
create mode 100644
flink-connectors/flink-connector-kinesis/src/test/resources/kinesis-consumer-migration-test-flink1.7-snapshot
delete mode 100644
flink-core/src/main/java/org/apache/flink/api/common/typeutils/CompatibilityResult.java
delete mode 100644
flink-core/src/main/java/org/apache/flink/api/common/typeutils/CompatibilityUtil.java
delete mode 100644
flink-core/src/main/java/org/apache/flink/api/common/typeutils/TypeDeserializer.java
delete mode 100644
flink-core/src/main/java/org/apache/flink/api/common/typeutils/TypeDeserializerAdapter.java
create mode 100644
flink-core/src/main/java/org/apache/flink/util/LinkedOptionalMapSerializer.java
create mode 100644
flink-core/src/test/java/org/apache/flink/api/common/typeutils/TypeSerializerMatchers.java
create mode 100644
flink-core/src/test/java/org/apache/flink/api/java/typeutils/runtime/kryo/KryoSerializerSnapshotTest.java
create mode 100644
flink-tests/src/test/resources/type-serializer-snapshot-migration-itcase-flink1.7-rocksdb-savepoint/_metadata
create mode 100644
flink-tests/src/test/resources/type-serializer-snapshot-migration-itcase-flink1.7-savepoint/_metadata
