Is there any way to find out backlog on kafka topic while using spark structured streaming ? I checked few consumer apis but that requires to enable groupid for streaming, but seems it is not allowed.
Basically i want to know number of records waiting to be processed. Any suggestions ?