Hi, I wanted to know if it is a good practice to develop a custom offset
management method while consuming from Kafka. I am thinking to develop it as
below.
1. Create a PartitionInfo named tuple as below
PartitionInfo("PartitionInfo",["header","custom writer","offset"]
1. Then populate the tuple with the header, writer and last offset details
2. Write the tuple in a file/database once the consumer commits the message
3. Next time when consumer starts, it checks the last offset and reads from
there
Thanks
Rajib
