taoran92 opened a new pull request, #10935:
URL: https://github.com/apache/paimon/pull/10935
### Purpose
Fixes #10931.
Preserve Debezium Avro binary values through CDC parsing and sink
conversion. For example, `00 FF 80 41` currently becomes `00 EF BF BD EF BF BD
41` under UTF-8. Reading the backing array also includes bytes outside the
buffer's valid range and fails for direct or read-only buffers.
Encode plain binary fields as Base64 with the existing CDC field markers,
reading only the duplicated buffer's remaining bytes. Decode Avro decimal
logical types separately for both bytes and fixed representations.
### Tests
38 targeted tests passed, including regression coverage for all byte values,
NULL and empty values, buffer ranges, direct/read-only buffers, computed
columns, UPDATE/DELETE, table write/read round trips, and decimal logical
types. Checkstyle and Spotless checks passed.
```shell
mvn -pl paimon-flink/paimon-flink-cdc -Pflink1 -DwildcardSuites=none \
-Dtest=DebeziumAvroBinaryRecordTest,DebeziumAvroRecordParserTestSimple,DebeziumBinaryRecordTest,CdcRecordUtilsTest
test
mvn -pl paimon-flink/paimon-flink-cdc -Pflink1 -DwildcardSuites=none \
-Dtest=DebeziumSchemaUtilsTest,DebeziumJsonRecordParserTest test
```
--
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.
To unsubscribe, e-mail: [email protected]
For queries about this service, please contact Infrastructure at:
[email protected]
