[
https://issues.apache.org/jira/browse/FLINK-38520?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
]
ASF GitHub Bot updated FLINK-38520:
-----------------------------------
Labels: pull-request-available (was: )
> Postgres YAML CDC support array with null element
> -------------------------------------------------
>
> Key: FLINK-38520
> URL: https://issues.apache.org/jira/browse/FLINK-38520
> Project: Flink
> Issue Type: Improvement
> Components: Flink CDC
> Affects Versions: cdc-3.4.0
> Reporter: Hongshun Wang
> Priority: Major
> Labels: pull-request-available
> Fix For: cdc-3.6.0
>
>
> Currently, if a null value in array, exception will occur:
> {code:java}
> java.lang.IllegalArgumentException: Unable convert multidimensional array
> value '[null]' to a flat array. at
> org.apache.flink.cdc.debezium.event.DebeziumEventDeserializationSchema.convertToArray(DebeziumEventDeserializationSchema.java:519)
> at
> org.apache.flink.cdc.debezium.event.DebeziumEventDeserializationSchema$4.convert(DebeziumEventDeserializationSchema.java:248)
> at
> org.apache.flink.cdc.debezium.event.DebeziumEventDeserializationSchema$5.convert(DebeziumEventDeserializationSchema.java:563)
> at
> org.apache.flink.cdc.debezium.event.DebeziumEventDeserializationSchema.convertField(DebeziumEventDeserializationSchema.java:462)
> at
> org.apache.flink.cdc.debezium.event.DebeziumEventDeserializationSchema.convertToRecord(DebeziumEventDeserializationSchema.java:449)
> at
> org.apache.flink.cdc.debezium.event.DebeziumEventDeserializationSchema$2.convert(DebeziumEventDeserializationSchema.java:228)
> at
> org.apache.flink.cdc.debezium.event.DebeziumEventDeserializationSchema$5.convert(DebeziumEventDeserializationSchema.java:563)
> at
> org.apache.flink.cdc.debezium.event.DebeziumEventDeserializationSchema.extractDataRecord(DebeziumEventDeserializationSchema.java:157)
> at
> org.apache.flink.cdc.debezium.event.DebeziumEventDeserializationSchema.extractAfterDataRecord(DebeziumEventDeserializationSchema.java:152)
> at
> org.apache.flink.cdc.debezium.event.DebeziumEventDeserializationSchema.deserializeDataChangeRecord(DebeziumEventDeserializationSchema.java:118)
> at
> org.apache.flink.cdc.debezium.event.SourceRecordEventDeserializer.deserialize(SourceRecordEventDeserializer.java:49)
> at
> org.apache.flink.cdc.debezium.event.DebeziumEventDeserializationSchema.deserialize(DebeziumEventDeserializationSchema.java:105)
> at
> org.apache.flink.cdc.connectors.base.source.reader.IncrementalSourceRecordEmitter.emitElement(IncrementalSourceRecordEmitter.java:160)
> at
> org.apache.flink.cdc.connectors.base.source.reader.IncrementalSourceRecordEmitter.processElement(IncrementalSourceRecordEmitter.java:118)
> at
> org.apache.flink.cdc.connectors.postgres.source.reader.PostgresPipelineRecordEmitter.processElement(PostgresPipelineRecordEmitter.java:114)
> at
> org.apache.flink.cdc.connectors.base.source.reader.IncrementalSourceRecordEmitter.emitRecord(IncrementalSourceRecordEmitter.java:88)
> at
> org.apache.flink.cdc.connectors.base.source.reader.IncrementalSourceRecordEmitter.emitRecord(IncrementalSourceRecordEmitter.java:57)
> at
> org.apache.flink.connector.base.source.reader.SourceReaderBase.pollNext(SourceReaderBase.java:229)
> at
> org.apache.flink.streaming.api.operators.SourceOperator.pollNext(SourceOperator.java:806)
> at
> org.apache.flink.streaming.api.operators.SourceOperator.emitNext(SourceOperator.java:484)
> at
> org.apache.flink.streaming.runtime.io.StreamTaskSourceInput.emitNext(StreamTaskSourceInput.java:70)
> at
> org.apache.flink.streaming.runtime.io.StreamOneInputProcessor.processInput(StreamOneInputProcessor.java:68)
> at
> org.apache.flink.streaming.runtime.tasks.StreamTask.processInput(StreamTask.java:706)
> {code}
--
This message was sent by Atlassian Jira
(v8.20.10#820010)
