hbgstc123 opened a new issue, #7260:
URL: https://github.com/apache/hudi/issues/7260

   **Describe the problem you faced**
   
   In flink job, when stream reading from hudi table with array type column, 
see this error
   java.lang.ClassCastException: 
org.apache.hudi.table.format.cow.data.ColumnarArrayData cannot be cast to 
org.apache.flink.table.data.ColumnarArrayData
   
   
   **To Reproduce**
   
   Steps to reproduce the behavior:
   
   1.use flink to stream read from a hudi table that contains an array type 
column
   
   **Expected behavior**
   
   no error
   
   **Environment Description**
   
   * Hudi version : 0.12.1
   * Flink version : 1.13
   
   * Running on Docker? (yes/no) :no
   
   
   **Stacktrace**
   
   ```java.lang.ClassCastException: 
org.apache.hudi.table.data.ColumnarArrayData cannot be cast to 
org.apache.flink.table.data.ColumnarArrayData
        at 
org.apache.flink.table.runtime.typeutils.ArrayDataSerializer.copy(ArrayDataSerializer.java:90)
        at 
org.apache.flink.table.runtime.typeutils.ArrayDataSerializer.copy(ArrayDataSerializer.java:47)
        at 
org.apache.flink.table.runtime.typeutils.RowDataSerializer.copyRowData(RowDataSerializer.java:170)
        at 
org.apache.flink.table.runtime.typeutils.RowDataSerializer.copy(RowDataSerializer.java:131)
        at 
org.apache.flink.table.runtime.typeutils.RowDataSerializer.copy(RowDataSerializer.java:48)
        at 
org.apache.flink.streaming.runtime.tasks.CopyingChainingOutput.pushToOperator(CopyingChainingOutput.java:69)
        at 
org.apache.flink.streaming.runtime.tasks.CopyingChainingOutput.collect(CopyingChainingOutput.java:46)
        at 
org.apache.flink.streaming.runtime.tasks.CopyingChainingOutput.collect(CopyingChainingOutput.java:26)
        at 
org.apache.flink.streaming.api.operators.CountingOutput.collect(CountingOutput.java:50)
        at 
org.apache.flink.streaming.api.operators.CountingOutput.collect(CountingOutput.java:28)
        at 
org.apache.flink.streaming.api.operators.StreamSourceContexts$ManualWatermarkContext.processAndCollect(StreamSourceContexts.java:380)
        at 
org.apache.flink.streaming.api.operators.StreamSourceContexts$WatermarkContext.collect(StreamSourceContexts.java:477)
        at 
org.apache.hudi.source.StreamReadOperator.consumeAsMiniBatch(StreamReadOperator.java:187)
        at 
org.apache.hudi.source.StreamReadOperator.processSplits(StreamReadOperator.java:166)
        at 
org.apache.flink.streaming.runtime.tasks.StreamTaskActionExecutor$1.runThrowing(StreamTaskActionExecutor.java:50)
        at 
org.apache.flink.streaming.runtime.tasks.mailbox.Mail.run(Mail.java:90)
        at 
org.apache.flink.streaming.runtime.tasks.mailbox.MailboxProcessor.processMailsNonBlocking(MailboxProcessor.java:359)
        at 
org.apache.flink.streaming.runtime.tasks.mailbox.MailboxProcessor.processMail(MailboxProcessor.java:323)
        at 
org.apache.flink.streaming.runtime.tasks.mailbox.MailboxProcessor.runMailboxLoop(MailboxProcessor.java:202)
        at 
org.apache.flink.streaming.runtime.tasks.StreamTask.runMailboxLoop(StreamTask.java:689)
        at 
org.apache.flink.streaming.runtime.tasks.StreamTask.executeInvoke(StreamTask.java:644)
        at 
org.apache.flink.streaming.runtime.tasks.StreamTask.runWithCleanUpOnFail(StreamTask.java:655)
        at 
org.apache.flink.streaming.runtime.tasks.StreamTask.invoke(StreamTask.java:628)
        at org.apache.flink.runtime.taskmanager.Task.doRun(Task.java:782)
        at org.apache.flink.runtime.taskmanager.Task.run(Task.java:566)
        at java.lang.Thread.run(Thread.java:748)
   ```
   
   


-- 
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.

To unsubscribe, e-mail: [email protected]

For queries about this service, please contact Infrastructure at:
[email protected]

Reply via email to