Jungtaek Lim created SPARK-42933:
------------------------------------
Summary: PySpark: dropDuplicates within watermark
Key: SPARK-42933
URL: https://issues.apache.org/jira/browse/SPARK-42933
Project: Spark
Issue Type: New Feature
Components: PySpark, Structured Streaming
Affects Versions: 3.5.0
Reporter: Jungtaek Lim
This is a follow-up issue for SPARK-42931 to ease of review for SPARK-42931.
Add equivalent public API where we add in SPARK-42931 to PySpark, and also add
a code example for PySpark in the guide doc.
Once we merge SPARK-42931, this ticket should be ideally marked as blocker.
--
This message was sent by Atlassian Jira
(v8.20.10#820010)
---------------------------------------------------------------------
To unsubscribe, e-mail: [email protected]
For additional commands, e-mail: [email protected]
