[jira] [Updated] (KAFKA-10721) Rewrite topology to allow for overlapping unequal topic subscriptions

2021-04-06 Thread Salavat Zainullin (Jira)


 [ 
https://issues.apache.org/jira/browse/KAFKA-10721?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
 ]

Salavat Zainullin updated KAFKA-10721:
--
Description: 
Minor followup improvement to KAFKA-6687 in which we rewrite the topology to 
make it possible for a user to subscribe multiple KStream/KTables to the same 
topic or identical set of topics. We could further extend this to make it 
possible for multiple KStream/KTables to be subscribed to overlapping but not 
identical sets of topics, ie
{code:java}
KStream streamA = builder.stream("topic");
KStream streamB = builder.stream("topic", "other-topic"); {code}
One way to do this would be to break up multiple-topic source nodes into 
multiple single-topic sources that get merged together in the child node.

See 
https://github.com/apache/kafka/pull/9582/files#diff-ac1bf2b23b80784dec20b00fdc42f2df7e5a5133d6c68978fa44aea11e950c3aR347-R349

  was:
Minor followup improvement to KAFKA-6687 in which we rewrite the topology to 
make it possible for a user to subscribe multiple KStream/KTables to the same 
topic or identical set of topics. We could further extend this to make it 
possible for multiple KStream/KTables to be subscribed to overlapping but not 
identical sets of topics, ie
{code:java}
KStream streamA = builder.stream("topic");
KStream streamB = builder.stream("topic, "other-topic"); {code}
One way to do this would be to break up multiple-topic source nodes into 
multiple single-topic sources that get merged together in the child node.

See 
https://github.com/apache/kafka/pull/9582/files#diff-ac1bf2b23b80784dec20b00fdc42f2df7e5a5133d6c68978fa44aea11e950c3aR347-R349


> Rewrite topology to allow for overlapping unequal topic subscriptions
> -
>
> Key: KAFKA-10721
> URL: https://issues.apache.org/jira/browse/KAFKA-10721
> Project: Kafka
>  Issue Type: Improvement
>  Components: streams
>Reporter: A. Sophie Blee-Goldman
>Assignee: Salavat Zainullin
>Priority: Minor
>  Labels: newbie++
>
> Minor followup improvement to KAFKA-6687 in which we rewrite the topology to 
> make it possible for a user to subscribe multiple KStream/KTables to the same 
> topic or identical set of topics. We could further extend this to make it 
> possible for multiple KStream/KTables to be subscribed to overlapping but not 
> identical sets of topics, ie
> {code:java}
> KStream streamA = builder.stream("topic");
> KStream streamB = builder.stream("topic", "other-topic"); {code}
> One way to do this would be to break up multiple-topic source nodes into 
> multiple single-topic sources that get merged together in the child node.
> See 
> https://github.com/apache/kafka/pull/9582/files#diff-ac1bf2b23b80784dec20b00fdc42f2df7e5a5133d6c68978fa44aea11e950c3aR347-R349



--
This message was sent by Atlassian Jira
(v8.3.4#803005)


[jira] [Updated] (KAFKA-10721) Rewrite topology to allow for overlapping unequal topic subscriptions

2020-11-16 Thread Guozhang Wang (Jira)


 [ 
https://issues.apache.org/jira/browse/KAFKA-10721?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
 ]

Guozhang Wang updated KAFKA-10721:
--
Labels: newbie++  (was: )

> Rewrite topology to allow for overlapping unequal topic subscriptions
> -
>
> Key: KAFKA-10721
> URL: https://issues.apache.org/jira/browse/KAFKA-10721
> Project: Kafka
>  Issue Type: Improvement
>  Components: streams
>Reporter: A. Sophie Blee-Goldman
>Priority: Minor
>  Labels: newbie++
>
> Minor followup improvement to KAFKA-6687 in which we rewrite the topology to 
> make it possible for a user to subscribe multiple KStream/KTables to the same 
> topic or identical set of topics. We could further extend this to make it 
> possible for multiple KStream/KTables to be subscribed to overlapping but not 
> identical sets of topics, ie
> {code:java}
> KStream streamA = builder.stream("topic");
> KStream streamB = builder.stream("topic, "other-topic"); {code}
> One way to do this would be to break up multiple-topic source nodes into 
> multiple single-topic sources that get merged together in the child node.
> See 
> https://github.com/apache/kafka/pull/9582/files#diff-ac1bf2b23b80784dec20b00fdc42f2df7e5a5133d6c68978fa44aea11e950c3aR347-R349



--
This message was sent by Atlassian Jira
(v8.3.4#803005)