Do you know the set of subtypes in advance? I.e, could you use:
KStream branches = stream.branch(predicates);
to split the stream based on the subtypes?
On Tue, 18 Oct 2016 at 00:43 Matthias J. Sax <matth...@confluent.io> wrote:
> -----BEGIN PGP SIGNED MESSAGE-----
> Hash: SHA512
> using DSL you cannot do this. However, if you use Processor API you can.
> There are similar question on the mailing list already. For example:
> As we got this request multiple times already, it might be worth
> adding it IMHO. Not sure what the opinion of other is? We should make
> sure that the feature gets accepted before you put a lot of effort in
> it. :)
> - -Matthias
> On 10/17/16 2:10 PM, Florian Hussonnois wrote:
> > Hi All,
> > Currently, it seems not possible with KStream to produce messages
> > to topics which are not known until runtime.
> > For a new project I am evaluating the Kafka Connect / Kafka
> > Streams architecture but without that feature I cannot retain the
> > KStreams API.
> > Our use case is pretty basic. We have xml messages in input of our
> > topology. Each message is splitted into subtypes and formatted in
> > Avro before being sent to a dedicated topic.
> > So the output topics depend of the subtype of each message.
> > I think it would be nice to add methods into the KStream interface
> > to provide such feature.
> > If you think that feature would be usefull I can create a jira and
> > contribute to it. Also, do I need to create a new KIP as this
> > requires changes on a public API ?
> > Thanks,
> -----BEGIN PGP SIGNATURE-----
> Comment: GPGTools - https://gpgtools.org
> -----END PGP SIGNATURE-----