Github user MLnick commented on a diff in the pull request:
https://github.com/apache/spark/pull/12135#discussion_r86541754
--- Diff:
sql/core/src/main/scala/org/apache/spark/sql/DataFrameStatFunctions.scala ---
@@ -72,13 +73,38 @@ final class DataFrameStatFunctions private[sql](df:
DataFrame) {
}
/**
+ * Calculates the approximate quantiles of numerical columns of a
DataFrame.
+ *
+ * Note that rows containing any null values will be removed before
calculation.
--- End diff --
Let's actually change both this line and the one for the above
`approxQuantile` method to say `Note that rows containing any null or NaN
values will be removed ...`
---
If your project is set up for it, you can reply to this email and have your
reply appear on GitHub as well. If your project does not have this feature
enabled and wishes so, or if the feature is enabled but not working, please
contact infrastructure at [email protected] or file a JIRA ticket
with INFRA.
---
---------------------------------------------------------------------
To unsubscribe, e-mail: [email protected]
For additional commands, e-mail: [email protected]
