Kong Wei created HUDI-6239:
------------------------------
Summary: cluster-scheduling-weight and cluster-scheduling-minShare
not take effect in deltastreamer
Key: HUDI-6239
URL: https://issues.apache.org/jira/browse/HUDI-6239
Project: Apache Hudi
Issue Type: Bug
Components: deltastreamer
Reporter: Kong Wei
Attachments: image-2023-05-19-11-04-45-541.png,
image-2023-05-19-11-05-41-056.png
In the method
org.apache.hudi.utilities.deltastreamer.SchedulerConfGenerator#generateConfig,
it will generate the spark scheduler conf for deltasync, compaction and
clustering.
But the clustering scheduler conf will not take effect.
The SPARK_SCHEDULING_PATTERN only contain 2 scheduler pool
!image-2023-05-19-11-04-45-541.png!
While the generateConfig take 3 pool as parameter.
!image-2023-05-19-11-05-41-056.png!
--
This message was sent by Atlassian Jira
(v8.20.10#820010)
