lostluck commented on issue #31177: URL: https://github.com/apache/beam/issues/31177#issuecomment-2137322583
Basic "test focused" ProcessingTime handling is merged in with #30492. Unfortunately due to other tasks I had to focus on, I didn't manage to get the real time clock handling in yet. But the current set up should be sufficient for "unit test" execution. Processing time timers won't auto fail the pipeline with 2.57.0, but they also won't wait around for the real time to occur. They will be processed in the correct order with the correct restrictions though (only one scheduled per key per timer per window per tag etc...). Unbounded SplittableDoFns (with ProcessContinuations) don't currently schedule into the processing time system just yet, but that's also going to be worked on with adding "real time". Using a TestStream as an input into the pipeline will allow control over the synthetic processing time clock, and will hopefully be sufficient to test things out with some semblance of ordering. Triggers remain unimplemented, so ProcessingTime triggers remain a failure case for such pipelines. -- This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use the URL above to go to the specific comment. To unsubscribe, e-mail: [email protected] For queries about this service, please contact Infrastructure at: [email protected]
