Hi,
I am doing a few basic operation like map -> reduceByKey -> filter, which is very similar to world count and I'm saving the result where the count > threshold. Currently the batch window is every 10s, but I would like to save the results to redshift at a lower frequency instead of every 10s. Should I be increasing my batch interval and use reduceByKeyAndWindow? Thanks!