Yes, I already set auto commit true(default value is true).
Topology for storm 0.9.6 version is executing already.
In storm 0.9.6, I made spout like below. But spout read data continuously every
restart.
SpoutConfig spoutConf = new SpoutConfig(zkHosts, topicWithUnitServiceCode,
groupWithPrefix, UUID.randomUUID().toString());
But up to 1.0.2, spout consume read same data every restart.
So I changed and fixed id parameter to "test", but occur samely.
Any changed in SpoutConfig and KafkaSpout?
-----Original Message-----
From: <[email protected]>
To: <[email protected]>;
Cc:
Sent: 2016-11-22 (화) 11:23:53
Subject: Re: kafka spout consume same data every restart topology
Hi.
You should commit the message when you finish the process or set the Kafka
auto commit to true.
There is a kafka offset setting which will only read the latest message.
auto.offset.reset = latest.
---------------------------------------------------------------------------
TSMC PROPERTY
This email communication (and any attachments) is proprietary information
for the sole use of its
intended recipient. Any unauthorized review, use or distribution by anyone
other than the intended
recipient is strictly prohibited. If you are not the intended recipient,
please notify the sender by
replying to this email, and then delete this email and any copies of it
immediately. Thank you.
---------------------------------------------------------------------------
