While your DB consumer is running you get the access to the partition ${partition} @ offset ${offset} https://github.com/confluentinc/examples/blob/6.1.1-post/clients/cloud/nodejs/consumer.jswhen setting your second consumers for real time just set them tostart from that point
בתאריך יום ו׳, 28 במאי 2021, 01:51, מאת Ronald Fenner < rfen...@gamecircus.com>: > I'm trying to figure out how to pragmatically read a consumer groups > offset for a topic. > What I'm trying to do is read the offsets of our DB consumers that run > once an hour and batch lad all new messages. I then would have another > consumer that monitors the offsets that have been consumed and consume the > message not yet loaded storing them in memory to be able to send them to a > viewer. As messages get consumed they then get pruned from the in memory > cache. > > Basically I'm wanting to create window on the messages that haven't been > loaded into the db. > > I've seen ways of getting it from the command line but I'd like to from > with in code. > > Currently I'm using node-rdkafka. > > I guess as a last resort I could shell the command line for the offsets > then parse it and get it that way. > > > Ronald Fenner > Network Architect > Game Circus LLC. > > rfen...@gamecircus.com > >