MengYao created HUDI-1683:
-----------------------------
Summary: When using hudi on flink write data to the HDFS
ClassCastException: scala. Tuple2 always be cast to org.apache.hudi.com mon.
Util. Collection. The Pair
Key: HUDI-1683
URL: https://issues.apache.org/jira/browse/HUDI-1683
Project: Apache Hudi
Issue Type: Bug
Components: Flink Integration
Affects Versions: 0.7.0
Environment: CentOS7:
hadoop-3.1.0
flink-1.12.2
Reporter: MengYao
Fix For: 0.8.0
Attachments: Hudi-Flink-CaseClassException_20210312102417.png
Caused by: java.lang{color:red}.ClassCastException: scala.Tuple2 cannot be cast
to org.apache.hudi.common.util.collection.Pair{color}
at
org.apache.hudi.table.action.commit.UpsertPartitioner.getPartition(UpsertPartitioner.java:266)
at
org.apache.hudi.table.action.commit.BaseFlinkCommitActionExecutor.lambda$partition$2(BaseFlinkCommitActionExecutor.java:155)
at java.util.stream.Collectors.lambda$groupingBy$45(Collectors.java:907)
at java.util.stream.ReduceOps$3ReducingSink.accept(ReduceOps.java:169)
at
java.util.stream.ReferencePipeline$3$1.accept(ReferencePipeline.java:193)
at
java.util.ArrayList$ArrayListSpliterator.forEachRemaining(ArrayList.java:1384)
at java.util.stream.AbstractPipeline.copyInto(AbstractPipeline.java:482)
at
java.util.stream.AbstractPipeline.wrapAndCopyInto(AbstractPipeline.java:472)
at
java.util.stream.ReduceOps$ReduceOp.evaluateSequential(ReduceOps.java:708)
at java.util.stream.AbstractPipeline.evaluate(AbstractPipeline.java:234)
at
java.util.stream.ReferencePipeline.collect(ReferencePipeline.java:499)
at
org.apache.hudi.table.action.commit.BaseFlinkCommitActionExecutor.partition(BaseFlinkCommitActionExecutor.java:155)
at
org.apache.hudi.table.action.commit.BaseFlinkCommitActionExecutor.execute(BaseFlinkCommitActionExecutor.java:115)
at
org.apache.hudi.table.action.commit.BaseFlinkCommitActionExecutor.execute(BaseFlinkCommitActionExecutor.java:68)
at
org.apache.hudi.table.action.commit.AbstractWriteHelper.write(AbstractWriteHelper.java:55)
... 33 more
--
This message was sent by Atlassian Jira
(v8.3.4#803005)
