Hi devs: We would like to start a discussion about AIP-1: Optimizing Allocation and Schedule Priority of Optimizer resources for Tables[1].
An optimizer group comprises a collection of optimizers, where each optimizer instance typically contains multiple threads, with each optimizer thread responsible for executing a single optimizing task. When multiple self-optimizing tasks are pending and optimizer resources are limited, tasks originating from the same table may monopolize all available resources in the absence of proper constraints. So, we propose to optimize allocation and schedule priority of optimizer resources for tables. Looking forward to hearing from you. [1] https://cwiki.apache.org/confluence/x/bQ5JFg Best XixiChen