Github user HyukjinKwon commented on a diff in the pull request:
https://github.com/apache/spark/pull/20254#discussion_r161358664
--- Diff: python/pyspark/sql/dataframe.py ---
@@ -1364,7 +1364,9 @@ def subtract(self, other):
""" Return a new :class:`DataFrame` containing rows in this frame
but not in another frame.
- This is equivalent to `EXCEPT` in SQL.
+ This is equivalent to `EXCEPT DISTINCT` in SQL.
+
+ (Note: Before Spark 2.0, the behavior was equivalent to `EXCEPT
ALL` in SQL.)
--- End diff --
In PySpark, we can use `.. note:: `. This makes the doc pretty :).
---
---------------------------------------------------------------------
To unsubscribe, e-mail: [email protected]
For additional commands, e-mail: [email protected]
