This is an automated email from the ASF dual-hosted git repository.
tzulitai pushed a change to branch release-1.8
in repository https://gitbox.apache.org/repos/asf/flink.git.
from dd032c5 [FLINK-11777][docs] Remove and update useless html anchor in
hadoop_compatibility.md.
new 19a32a1 [FLINK-11740] [core] Clarify CompositeTypeSerializerSnapshot
class signature
new 829b267 [hotfix] [core] Fix
TypeSerializerUtils#snapshotBackwardsCompatible method signature
new 943c934 [FLINK-11772] [DataStream] Remove "config" from all
serializer snapshot field / method names in InternalTimersSnapshot
new d451b73 [FLINK-11772] [DataStream] Let InternalTimerServiceImpl use
new serialization compatibility APIs for key / namespace serializer checks
new a22069f [FLINK-11772] [DataStream]
InternalTimerServiceSerializationProxy should not be serializing timers' key /
namespace serializers anymore
new 6b85529 [FLINK-11741] [core] Add getNestedSerializerSnapshots utility
method in CompositeTypeSerializerConfigSnapshot
new 2724c84 [FLINK-11741] [runtime] Replace ArrayListSerializer's
ensureCompatibility method with SelfResolvingTypeSerializer implementation
new 7b3b7cb [FLINK-11741] [core] Remove CompositeSerializer's
ensureCompatibility method using SelfResolvingTypeSerializer interface
new 5dcc28a [FLINK-11741] [core] Remove Scala EitherSerializer's
ensureCompatibility method using LegacySerializerSnapshotTransformer interface
new efd9cf3 [FLINK-11741] [table] Remove table dataview serializers'
ensureCompatibility method using LegacySerializerSnapshotTransformer interface
new 75afa9c [FLINK-11741] [runtime] WritableSerializer's
ensureCompatibility method should have been removed
new 13cc1ca [FLINK-11741] Remove ensureCompatibility implementation from
dummy serializers
new edeeda3 [FLINK-11741] [tests] Remove ensureCompatibility
implementation in all test-related serializers
new b192ce5 [FLINK-11755] [tests] Remove
TypeSerializerSnapshotTest#testBridgeCompatibilityCheck test
new 3369083 [FLINK-11741] [core] Remove TypeSerializerSingleton's
ensureCompatibility implementation
new 6841790 [FLINK-11741] [cep] Migrate legacy NFA serializers to use new
serialization compatibility abstractions
new 9075e46 [FLINK-11755] [core] Remove no longer used CompatibilityUtil
class
new 07c763d [FLINK-11755] [core] Drop ensureCompatibility from
TypeSerializer
new ecd2389 [FLINK-11755] [core] Drop no longer used class
CompatibilityResult
new ae62497 [FLINK-11755] [core] Removed no longer used class
TypeDeserializer
new 7aa802a [FLINK-11406] [core] Return INCOMPATIBLE when nested
serializers arity don't match in CompositeTypeSerializerSnapshot
new 6a68b31 [FLINK-11753] [tests] Add hamcrest matchers for
TypeSerializerSchemaCompatibility
new 6ac771a [FLINK-11753] [tests] Refactor
SchemaCompatibilityTestingSerializer
new f1bbb63 [FLINK-11773] [core] Add LinkedOptionalMapSerializer
new ff00541 [FLINK-11773] [core] Use LinkedOptionalMapSerializer in
Kryo-/PojoSerializerSnapshotData
new 151cd8c [FLINK-11773] [tests] Add unit tests for
KryoSerializerSnapshot
new 879507d [FLINK-10342] [kafka] Filter restored partitions in
FlinkKafkaConsumer with topics descriptor
new 572a57c [FLINK-10342] [kafka] Improve Javadoc of new
disableFilterRestoredPartitionsWithSubscribedTopics method in
FlinkKafkaConsumerBase
new f4722e5 [hotfix] [tests]Fix typo in RollingSinkSecuredITCase.java
new 93c1515 [FLINK-11771] [core] Fix
TypeSerializerSnapshot#readVersionedSnapshot for TypeSerializerSnapshots
directly upgraded from TypeSerializerConfigSnapshot
new f2c92a2 [FLINK-10777] [tests] Update
TypeSerializerSnapshotMigrationITCase to cover restoring from 1.7.x
new 4fea6b8 [FLINK-10785] [tests] Upgrade
FlinkKinesisConsumerMigrationTest to test restoring from 1.7.x
The 32 revisions listed above as "new" are entirely new to this
repository and will be described in separate emails. The revisions
listed as "add" were already present in the repository and have only
been added to this reference.
Summary of changes:
.../connectors/fs/RollingSinkSecuredITCase.java | 2 +-
.../connectors/kafka/FlinkKafkaConsumerBase.java | 34 +++
.../internals/AbstractPartitionDiscoverer.java | 2 +-
.../kafka/internals/KafkaTopicsDescriptor.java | 17 +-
.../kafka/FlinkKafkaConsumerBaseMigrationTest.java | 23 +-
.../kafka/FlinkKafkaConsumerBaseTest.java | 170 ++++++++++-
.../kafka/internals/KafkaTopicsDescriptorTest.java | 64 ++++
.../kinesis/FlinkKinesisConsumerMigrationTest.java | 2 +-
...consumer-migration-test-flink1.7-empty-snapshot | Bin 0 -> 18539 bytes
...nesis-consumer-migration-test-flink1.7-snapshot | Bin 0 -> 18607 bytes
.../java/typeutils/runtime/WritableSerializer.java | 16 +-
.../api/common/typeutils/CompatibilityResult.java | 116 --------
.../api/common/typeutils/CompatibilityUtil.java | 109 -------
.../api/common/typeutils/CompositeSerializer.java | 49 ---
.../CompositeTypeSerializerConfigSnapshot.java | 7 +
.../typeutils/CompositeTypeSerializerSnapshot.java | 17 +-
.../ParameterlessTypeSerializerConfig.java | 23 ++
.../api/common/typeutils/TypeDeserializer.java | 80 -----
.../common/typeutils/TypeDeserializerAdapter.java | 139 ---------
.../flink/api/common/typeutils/TypeSerializer.java | 51 +---
.../typeutils/TypeSerializerConfigSnapshot.java | 25 +-
.../common/typeutils/TypeSerializerSnapshot.java | 13 +-
.../api/common/typeutils/TypeSerializerUtils.java | 2 +-
.../typeutils/UnloadableDummyTypeSerializer.java | 7 +-
.../base/GenericArraySerializerSnapshot.java | 9 +-
.../typeutils/base/ListSerializerSnapshot.java | 7 +-
.../typeutils/base/MapSerializerSnapshot.java | 6 +-
.../typeutils/base/TypeSerializerSingleton.java | 36 +--
.../runtime/EitherSerializerConfigSnapshot.java | 1 -
.../runtime/JavaEitherSerializerSnapshot.java | 14 +-
.../java/typeutils/runtime/NullableSerializer.java | 8 +-
.../runtime/PojoSerializerSnapshotData.java | 65 +---
.../typeutils/runtime/TupleSerializerSnapshot.java | 9 +-
.../runtime/kryo/KryoSerializerSnapshotData.java | 208 +++++++------
.../flink/util/LinkedOptionalMapSerializer.java | 129 ++++++++
.../CompositeTypeSerializerSnapshotTest.java | 37 ++-
.../typeutils/CompositeTypeSerializerUtilTest.java | 56 ++--
.../common/typeutils/TypeSerializerMatchers.java | 199 +++++++++++++
.../TypeSerializerSerializationUtilTest.java | 31 +-
.../TypeSerializerSnapshotMigrationTestBase.java | 33 +--
.../typeutils/TypeSerializerSnapshotTest.java | 19 --
.../base/EnumSerializerSnapshotMigrationTest.java | 39 +--
.../PojoSerializerSnapshotMigrationTest.java | 3 +-
.../runtime/PojoSerializerSnapshotTest.java | 21 +-
.../runtime/kryo/KryoSerializerSnapshotTest.java | 167 +++++++++++
.../SchemaCompatibilityTestingSerializer.java | 327 +++++++++------------
.../avro/typeutils/AvroSerializerSnapshotTest.java | 44 +--
.../api/java/io/CollectionInputFormatTest.java | 6 -
.../main/java/org/apache/flink/cep/nfa/NFA.java | 97 +++---
.../org/apache/flink/cep/nfa/SharedBuffer.java | 107 ++++---
.../LockableTypeSerializerSnapshot.java | 6 +-
.../flink/runtime/state/ArrayListSerializer.java | 49 ++-
.../runtime/state/ArrayListSerializerSnapshot.java | 6 +-
.../flink/runtime/state/ttl/TtlStateFactory.java | 30 +-
.../testutils/types/IntListSerializer.java | 6 -
.../testutils/types/IntPairSerializer.java | 6 -
.../testutils/types/StringPairSerializer.java | 10 +-
.../flink/runtime/query/KvStateRegistryTest.java | 6 -
.../state/InternalPriorityQueueTestBase.java | 39 ++-
.../runtime/state/OperatorStateBackendTest.java | 13 +-
.../state/heap/TestDuplicateSerializer.java | 10 +-
.../testutils/recordutils/RecordSerializer.java | 10 +-
.../ScalaCaseClassSerializerSnapshot.java | 9 +-
.../typeutils/ScalaEitherSerializerSnapshot.java | 6 +-
.../typeutils/ScalaOptionSerializerSnapshot.java | 7 +-
.../typeutils/ScalaTrySerializerSnapshot.java | 7 +-
.../typeutils/TraversableSerializerSnapshot.java | 9 +-
.../Tuple2CaseClassSerializerSnapshot.java | 5 +-
.../api/scala/typeutils/EitherSerializer.scala | 57 ++--
.../api/scala/typeutils/NothingSerializer.scala | 6 +-
.../streaming/api/datastream/CoGroupedStreams.java | 7 +-
.../functions/sink/TwoPhaseCommitSinkFunction.java | 7 +-
.../api/operators/InternalTimerServiceImpl.java | 71 +++--
.../InternalTimerServiceSerializationProxy.java | 18 +-
.../api/operators/InternalTimersSnapshot.java | 50 +---
.../InternalTimersSnapshotReaderWriters.java | 115 ++++++--
.../api/operators/TimerSerializerSnapshot.java | 9 +-
.../api/operators/co/IntervalJoinOperator.java | 7 +-
.../streamrecord/StreamElementSerializer.java | 8 +-
.../operators/InternalTimerServiceImplTest.java | 16 +-
.../table/dataview/ListViewSerializerSnapshot.java | 6 +-
.../table/dataview/MapViewSerializerSnapshot.java | 6 +-
.../flink/table/dataview/ListViewSerializer.scala | 60 ++--
.../flink/table/dataview/MapViewSerializer.scala | 72 ++---
.../TypeSerializerSnapshotMigrationITCase.java | 14 +-
.../_metadata | Bin 0 -> 3302 bytes
.../_metadata | Bin 0 -> 3201 bytes
87 files changed, 1737 insertions(+), 1672 deletions(-)
create mode 100644
flink-connectors/flink-connector-kafka-base/src/test/java/org/apache/flink/streaming/connectors/kafka/internals/KafkaTopicsDescriptorTest.java
create mode 100644
flink-connectors/flink-connector-kinesis/src/test/resources/kinesis-consumer-migration-test-flink1.7-empty-snapshot
create mode 100644
flink-connectors/flink-connector-kinesis/src/test/resources/kinesis-consumer-migration-test-flink1.7-snapshot
delete mode 100644
flink-core/src/main/java/org/apache/flink/api/common/typeutils/CompatibilityResult.java
delete mode 100644
flink-core/src/main/java/org/apache/flink/api/common/typeutils/CompatibilityUtil.java
delete mode 100644
flink-core/src/main/java/org/apache/flink/api/common/typeutils/TypeDeserializer.java
delete mode 100644
flink-core/src/main/java/org/apache/flink/api/common/typeutils/TypeDeserializerAdapter.java
create mode 100644
flink-core/src/main/java/org/apache/flink/util/LinkedOptionalMapSerializer.java
create mode 100644
flink-core/src/test/java/org/apache/flink/api/common/typeutils/TypeSerializerMatchers.java
create mode 100644
flink-core/src/test/java/org/apache/flink/api/java/typeutils/runtime/kryo/KryoSerializerSnapshotTest.java
create mode 100644
flink-tests/src/test/resources/type-serializer-snapshot-migration-itcase-flink1.7-rocksdb-savepoint/_metadata
create mode 100644
flink-tests/src/test/resources/type-serializer-snapshot-migration-itcase-flink1.7-savepoint/_metadata
