je-ik commented on pull request #12551: URL: https://github.com/apache/beam/pull/12551#issuecomment-673351917
Another observation is that this happens when there are many timers that are fired at the same time. The pipeline operates in bootstrap mode - watermark is updated after reading 1 hour of data from batch storage, so it "hops" on 1 hour boundaries, but the pipeline uses 30s windows. So there are many windows that get closed and that's where this happens. It seems no to happen when the pipeline reads realtime data and updates watermark appropriately. I think there might be some sort of race condition somewhere, but so far I didn't figure out where exactly. ---------------------------------------------------------------- This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use the URL above to go to the specific comment. For queries about this service, please contact Infrastructure at: [email protected]
