huyuanfeng2018 opened a new issue, #8265:
URL: https://github.com/apache/hudi/issues/8265
**Describe the problem you faced**
版本信息
hudi-0.13.0
flink1.16
flink sql( HUDI CREATE DDL):
```
CREATE TABLE `ods_action_log_huya_hudi_nopro_test` (
`stime` VARCHAR PRIMARY KEY,
`product` VARCHAR,
`eid` VARCHAR,
`curpage` VARCHAR,
`curlocation` VARCHAR,
`mid` VARCHAR ,
`yyuid` BIGINT,
`prop` VARCHAR,
`dt` VARCHAR,
`hour` VARCHAR
) PARTITIONED BY (`dt`, `hour`)
WITH (
'connector' = 'hudi',
'write.tasks' = '64',
'write.operation' = 'insert', -- The write operation, that this write
should do (insert or upsert is supported)
'path' =
'hdfs://huyaopclusternew/user/hive/warehouse/dw_rt_ods.db/ods_action_log_huya_hudi_nopro_test',
'table.type' = 'COPY_ON_WRITE', -- If MERGE_ON_READ, hive query will not
have output until the parquet file is generated
'hoodie.bucket.index.num.buckets' = '1',
'hoodie.bucket.index.hash.field' = 'stime',
'hoodie.clean.async' = 'true',
'hoodie.cleaner.commits.retained' = '5',
'hoodie.datasource.write.hive_style_partitioning' = 'true',
'clustering.async.enabled' = 'true'
);
```
When I turn on 'clustering.async.enabled' = 'true'
Start error:
```
Caused by: java.lang.ClassNotFoundException:
org.apache.flink.table.planner.codegen.sort.SortCodeGenerator
```
## Reasons and suggestions
Flink does not have Flink-table-planner in the jvm operating environment by
default after 1.15. The related planner is loaded and used through
flink-table-planner-loader through subclasspath. SortCodeGenerator is used in
hudi to do part of the logic of the cluster, so This exception occurs.
Specific link:
https://nightlies.apache.org/flink/flink-docs-master/docs/dev/configuration/advanced/
So I think that hudi needs to improve the code adaptation after flink1.15,
or give a reminder that the user should move the flink-table-planner jar
package in the opt directory to the lib directory in the flink release version
To adapt to the operating environment of hudi
--
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.
To unsubscribe, e-mail: [email protected]
For queries about this service, please contact Infrastructure at:
[email protected]
