[
https://issues.apache.org/jira/browse/HUDI-6239?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
]
Kong Wei updated HUDI-6239:
---------------------------
Priority: Minor (was: Major)
> cluster-scheduling-weight and cluster-scheduling-minShare not take effect in
> deltastreamer
> ------------------------------------------------------------------------------------------
>
> Key: HUDI-6239
> URL: https://issues.apache.org/jira/browse/HUDI-6239
> Project: Apache Hudi
> Issue Type: Bug
> Components: deltastreamer
> Reporter: Kong Wei
> Assignee: Kong Wei
> Priority: Minor
> Attachments: image-2023-05-19-11-04-45-541.png,
> image-2023-05-19-11-05-41-056.png
>
>
> In the method
> org.apache.hudi.utilities.deltastreamer.SchedulerConfGenerator#generateConfig,
> it will generate the spark scheduler conf for deltasync, compaction and
> clustering.
> But the clustering scheduler conf will not take effect.
> The SPARK_SCHEDULING_PATTERN only contain 2 scheduler pool
> !image-2023-05-19-11-04-45-541.png!
> While the generateConfig take 3 pool as parameter.
> !image-2023-05-19-11-05-41-056.png!
>
--
This message was sent by Atlassian Jira
(v8.20.10#820010)