junaiddshaukat commented on code in PR #39546:
URL: https://github.com/apache/beam/pull/39546#discussion_r3689347561
##########
runners/kafka-streams/src/main/java/org/apache/beam/runners/kafka/streams/KafkaStreamsPipelineOptions.java:
##########
@@ -55,6 +55,21 @@ public interface KafkaStreamsPipelineOptions extends
PortablePipelineOptions {
void setMaxBundleTimeMs(int maxBundleTimeMs);
+ @Description(
+ "Number of partitions for the topics the runner creates for a pipeline
(the bootstrap topic"
+ + " of each Impulse and Read, and the repartition topic of each
GroupByKey). This is the"
+ + " parallelism the shuffled parts of the pipeline can reach.")
+ @Default.Integer(1)
+ int getTopicPartitions();
Review Comment:
Renamed, and I rewrote the description to say where it applies — a
GroupByKey runs one task per partition of its repartition topic, so it's the
number of instances its state and downstream stages spread over.
--
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.
To unsubscribe, e-mail: [email protected]
For queries about this service, please contact Infrastructure at:
[email protected]
