kkdoon commented on issue #28554: URL: https://github.com/apache/beam/issues/28554#issuecomment-1732422840
These events are the buffered events that are emitted from DoFn1. I tried the following steps: 1. Publish 10 elements to Kafka topic and stop the producer job. 2. Verified that the 10 elements were processed by DoFn1 and Stable DoFn did not receive them. 3. Drained the job and it failed to execute the savepoint (and did not emit any of the buffered 10 elements). From my experience, the only instance drain operation works is if the buffered elements are fully processed (via checkpoint trigger) and buffer is empty at time of drain execution. -- This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use the URL above to go to the specific comment. To unsubscribe, e-mail: [email protected] For queries about this service, please contact Infrastructure at: [email protected]
