; To: Haopu Wang
> Cc: user@spark.apache.org
> Subject: Re: expected behavior of Kafka dynamic topic subscription
>
> That's not what I would expect from the underlying kafka consumer, no.
>
> But this particular case (no matching topics, then add a topic after
> SubscribePattern
behavior of Kafka dynamic topic subscription
That's not what I would expect from the underlying kafka consumer, no.
But this particular case (no matching topics, then add a topic after
SubscribePattern stream starts) actually isn't part of unit tests for
either the DStream or the structured stream
That's not what I would expect from the underlying kafka consumer, no.
But this particular case (no matching topics, then add a topic after
SubscribePattern stream starts) actually isn't part of unit tests for
either the DStream or the structured stream.
I'll make a jira ticket.
On Thu, Nov 3,
I'm using Kafka010 integration API to create a DStream using
SubscriberPattern ConsumerStrategy.
The specified topic doesn't exist when I start the application.
Then I create the topic and publish some test messages. I can see them
in the console subscriber.
But the spark application doesn't