arunmahadevan commented on issue #23576: [SPARK-26655] [SS] Support multiple aggregates in append mode URL: https://github.com/apache/spark/pull/23576#issuecomment-461245832 >Do you have some idea/plan in mind for non-global watermark? Just curious, because that might be one of major change on concept. I am not sure if you mean the way the watermarks are computed or propagate...anyways that seems orthogonal. Here we compute the operator watermark as minimum of input watermarks which should hold irrespective. I don't see another reasonable way to make progress at each operator.
---------------------------------------------------------------- This is an automated message from the Apache Git Service. To respond to the message, please log on GitHub and use the URL above to go to the specific comment. For queries about this service, please contact Infrastructure at: [email protected] With regards, Apache Git Services --------------------------------------------------------------------- To unsubscribe, e-mail: [email protected] For additional commands, e-mail: [email protected]
