I'm using Spark Streaming and there maybe some delays between batches. I'd like to know is it possible to merge delayed batches into one batch to do processing?
For example, the interval is set to 5 min but the first batch uses 1 hour, so there are many batches delayed. In the end of processing for each batch, I'll save the data into database. So if all the delayed batches are merged into a big one, it will save many resources. I'd like to know if it is possible. Thanks.
