Boyang Jerry Peng created SPARK-39586:
-----------------------------------------
Summary: Advanced Windowing
Key: SPARK-39586
URL: https://issues.apache.org/jira/browse/SPARK-39586
Project: Spark
Issue Type: New Feature
Components: Structured Streaming
Affects Versions: 3.3.0
Reporter: Boyang Jerry Peng
Currently in Structure Streaming there does not exist a user friendly method to
define custom windowing strategies. Users can only choose from an existing set
of built-in window strategies such tumbling, sliding, session windows. To
improve flexibility of the engine and to support more advanced use cases,
Structured Streaming needs to provide an intuitive API that allows users to
define custom window boundaries, to trigger windows when they are complete,
and, if necessary, evict elements from windows.
--
This message was sent by Atlassian Jira
(v8.20.7#820007)
---------------------------------------------------------------------
To unsubscribe, e-mail: [email protected]
For additional commands, e-mail: [email protected]