[
https://issues.apache.org/jira/browse/KAFKA-12453?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=17331366#comment-17331366
]
Patrick O'Keeffe commented on KAFKA-12453:
------------------------------------------
Thanks for the explanation [~mjsax]
Agree it makes sense to create a new page for topology optimisation, I could
have done with similar guidance myself!
A couple of questions:
# There is an FAQ for topology optimisation on the Confluent site, which goes
further than the apache kafka docs, but still not far enough. However, it does
provide a good starting point - do I need to be careful to avoid similarities
with the Confluent text, e.g. writing the page as an FAQ, maybe having
similarly named sections ...?
# Has been a while since I've written any HTML, any advice on testing the that
the page is formatted correctly and will render?
> Guidance on whether a topology is eligible for optimisation
> -----------------------------------------------------------
>
> Key: KAFKA-12453
> URL: https://issues.apache.org/jira/browse/KAFKA-12453
> Project: Kafka
> Issue Type: Improvement
> Components: streams
> Reporter: Patrick O'Keeffe
> Priority: Major
>
> Since the introduction of KStream.toTable() in Kafka 2.6.x, the decision
> about whether a topology is eligible for optimisation is no longer a simple
> one, and is related to whether toTable() operations are preceded by key
> changing operators.
> This decision requires expert level knowledge, and there are serious
> implications associated with getting it wrong in terms of fault tolerance
> Some ideas spring to mind around how to guide developers to make the correct
> decision:
> # Topology.describe() could indicate whether this topology is eligible for
> optimisation
> # Topologies could be automatically optimised - note this may have an impact
> at deployment time, in that an application reset may be required. The
> developer would need to made aware of this and adjust the deployment plan
> accordingly
>
>
--
This message was sent by Atlassian Jira
(v8.3.4#803005)
