Hi, all I have the task to getting data from KafkaSpout and populate into DB, I am using persistentAggregate to take on this job. My understanding is trident spouts emit tuples in batches. Trident persists the messages from kafka and storm them in tridentState then write into DB in batch (using persistentAggregate to update), then clear the State. This is to be done iteratively.
Is it correct logic? How to manage the batch messages in memory? thanks Alec
