hhktseng opened a new pull request, #26397:
URL: https://github.com/apache/flink/pull/26397
## What is the purpose of the change
Fix the problem wherer AvroDeserializationSchema class will produce corrupt
record after a parsing error was thrown.
This is to reopen the PR that was closed.
## Brief change log
- refactored the Decoder initialization portion to `setupDecoder()` method
- capture the datumreader read error and reinitialize decoder when
captured, to avoid future corruption
- added Coordinate as second Avro schema class to test mix schema usage
(scenario that encounters unexpected schema record)
- added `generateRandomCoordinate()` method in TestDataGenerator to support
unit test
- added `testMixSchemaUsage()` method in AvroDeserializationSchemaTest
class as an unit test case for the change
## Verifying this change
This change added `testMixSchemaUsage()` unit test case in
AvroDeserializationSchemaTest.java for flink-avro test verification.
## Does this pull request potentially affect one of the following parts:
- Dependencies (does it add or upgrade a dependency): no
- The public API, i.e., is any changed class annotated with
`@Public(Evolving)`: no
- The serializers: yes
- The runtime per-record code paths (performance sensitive): no
- Anything that affects deployment or recovery: JobManager (and its
components), Checkpointing, Kubernetes/Yarn, ZooKeeper: no
- The S3 file system connector: no
## Documentation
- Does this pull request introduce a new feature? no
- If yes, how is the feature documented? not applicable
--
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.
To unsubscribe, e-mail: [email protected]
For queries about this service, please contact Infrastructure at:
[email protected]
