Github user hvanhovell commented on a diff in the pull request:
https://github.com/apache/spark/pull/19828#discussion_r153241835
--- Diff: sql/core/src/main/scala/org/apache/spark/sql/Dataset.scala ---
@@ -2733,6 +2733,12 @@ class Dataset[T] private[sql](
*/
@scala.annotation.varargs
def repartition(numPartitions: Int, partitionExprs: Column*): Dataset[T]
= withTypedPlan {
+ partitionExprs.find(_.expr.isInstanceOf[SortOrder]).foreach {
sortOrder =>
--- End diff --
Use `collect` or `filter`? That way we can show all offending columns.
---
---------------------------------------------------------------------
To unsubscribe, e-mail: [email protected]
For additional commands, e-mail: [email protected]
