zhangshenghang commented on code in PR #10102:
URL: https://github.com/apache/seatunnel/pull/10102#discussion_r2558330778
##########
seatunnel-api/src/main/java/org/apache/seatunnel/api/options/EnvCommonOptions.java:
##########
@@ -115,4 +115,23 @@ public class EnvCommonOptions {
.mapType()
.noDefaultValue()
.withDescription("Define the worker where the job runs by
tag");
+
+ // ==================== Parallelism Inference Options ====================
+
+ public static Option<Boolean> PARALLELISM_INFERENCE_ENABLED =
+ Options.key("parallelism.inference.enabled")
+ .booleanType()
+ .defaultValue(false)
+ .withDescription(
+ "Enable automatic parallelism inference based on
data volume. "
+ + "When enabled, operators with
parallelism=-1 will have their parallelism "
+ + "automatically determined based on the
size of consumed data.");
+
+ public static Option<Integer> PARALLELISM_INFERENCE_MAX_PARALLELISM =
+ Options.key("parallelism.inference.max-parallelism")
+ .intType()
+ .defaultValue(128)
+ .withDescription(
+ "The maximum parallelism for operators when using
automatic inference. "
+ + "Must be a power of 2 to ensure even
distribution of subpartitions.");
Review Comment:
ditto
--
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.
To unsubscribe, e-mail: [email protected]
For queries about this service, please contact Infrastructure at:
[email protected]
