smrosenberry commented on issue #21746: [SPARK-24699] [SS]Make watermarks work with Trigger.Once by saving updated watermark to commit log URL: https://github.com/apache/spark/pull/21746#issuecomment-526860362 > fully processes the on-hand data when window aggregating when you run the Trigger.Once twice Can someone expound on this comment? Specifically, how do I programmatically "run the Trigger.once twice"? In its simplest form, I tried this without success: ``` Dataset dataset; // input read from a file DataStreamWriter writer = dataset.writeStream().trigger( Trigger.Once() ); StreamingQuery query = writer.start(); query.awaitTermination(); query = writer.start(); query.awaitTermination(); query.stop(); ``` Any hints would be greatly appreciated...
---------------------------------------------------------------- This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use the URL above to go to the specific comment. For queries about this service, please contact Infrastructure at: [email protected] With regards, Apache Git Services --------------------------------------------------------------------- To unsubscribe, e-mail: [email protected] For additional commands, e-mail: [email protected]
