jing created HUDI-1792:
--------------------------
Summary: Fix flink-client query error when processing files
larger than 128mb
Key: HUDI-1792
URL: https://issues.apache.org/jira/browse/HUDI-1792
Project: Apache Hudi
Issue Type: Bug
Components: Flink Integration
Reporter: jing
Assignee: jing
Use the flink client to query the cow table and report an error. The error
message is as follows:
{code:java}
//代码占位符
Caused by: org.apache.flink.runtime.JobException: Creating the input splits
caused an error: org.apache.hadoop.fs.HdfsBlockLocation cannot be cast to
java.lang.ComparableCaused by: org.apache.flink.runtime.JobException: Creating
the input splits caused an error: org.apache.hadoop.fs.HdfsBlockLocation cannot
be cast to java.lang.Comparable at
org.apache.flink.runtime.executiongraph.ExecutionJobVertex.<init>(ExecutionJobVertex.java:260)
at
org.apache.flink.runtime.executiongraph.ExecutionGraph.attachJobGraph(ExecutionGraph.java:866)
at
org.apache.flink.runtime.executiongraph.ExecutionGraphBuilder.buildGraph(ExecutionGraphBuilder.java:257)
at
org.apache.flink.runtime.scheduler.SchedulerBase.createExecutionGraph(SchedulerBase.java:322)
at
org.apache.flink.runtime.scheduler.SchedulerBase.createAndRestoreExecutionGraph(SchedulerBase.java:276)
at
org.apache.flink.runtime.scheduler.SchedulerBase.<init>(SchedulerBase.java:249)
at
org.apache.flink.runtime.scheduler.DefaultScheduler.<init>(DefaultScheduler.java:133)
at
org.apache.flink.runtime.scheduler.DefaultSchedulerFactory.createInstance(DefaultSchedulerFactory.java:111)
at
org.apache.flink.runtime.jobmaster.JobMaster.createScheduler(JobMaster.java:345)
at org.apache.flink.runtime.jobmaster.JobMaster.<init>(JobMaster.java:330) at
org.apache.flink.runtime.jobmaster.factories.DefaultJobMasterServiceFactory.createJobMasterService(DefaultJobMasterServiceFactory.java:95)
at
org.apache.flink.runtime.jobmaster.factories.DefaultJobMasterServiceFactory.createJobMasterService(DefaultJobMasterServiceFactory.java:39)
at
org.apache.flink.runtime.jobmaster.JobManagerRunnerImpl.<init>(JobManagerRunnerImpl.java:162)
at
org.apache.flink.runtime.dispatcher.DefaultJobManagerRunnerFactory.createJobManagerRunner(DefaultJobManagerRunnerFactory.java:86)
at
org.apache.flink.runtime.dispatcher.Dispatcher.lambda$createJobManagerRunner$5(Dispatcher.java:478)
... 4 more
{code}
--
This message was sent by Atlassian Jira
(v8.3.4#803005)
