[
https://issues.apache.org/jira/browse/SPARK-48446?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
]
Hyukjin Kwon reassigned SPARK-48446:
------------------------------------
Assignee: Yuchen Liu
> Update SS Doc of dropDuplicatesWithinWatermark to use the right syntax
> ----------------------------------------------------------------------
>
> Key: SPARK-48446
> URL: https://issues.apache.org/jira/browse/SPARK-48446
> Project: Spark
> Issue Type: Documentation
> Components: Structured Streaming
> Affects Versions: 4.0.0
> Reporter: Yuchen Liu
> Assignee: Yuchen Liu
> Priority: Minor
> Labels: easyfix, pull-request-available
> Original Estimate: 1h
> Remaining Estimate: 1h
>
> For dropDuplicates, the example on
> [https://spark.apache.org/docs/latest/structured-streaming-programming-guide.html#:~:text=)%20%5C%0A%20%20.-,dropDuplicates,-(%22guid%22]
> is out of date compared with
> [https://spark.apache.org/docs/latest/api/python/reference/pyspark.sql/api/pyspark.sql.DataFrame.dropDuplicates.html].
> The argument should be a list.
> The discrepancy is also true for dropDuplicatesWithinWatermark.
--
This message was sent by Atlassian Jira
(v8.20.10#820010)
---------------------------------------------------------------------
To unsubscribe, e-mail: [email protected]
For additional commands, e-mail: [email protected]
