Hi. I am in the process of migrating from DStreams to structured steaming. In DStream API job we were using batch size as 1 minute and it was taking 30-45 secs to process it.
With structured streaming I am using a trigger interval of 30 secs but it seems to be taking a large amount of time to process Will setting maxOffsetsPerTrigger help me? How does that map to the previous DStream batch size ? Thanks Girish -- Thanks & Regards, Girish Subramanian
