aokolnychyi commented on code in PR #37749:
URL: https://github.com/apache/spark/pull/37749#discussion_r962076870
##########
sql/catalyst/src/main/scala/org/apache/spark/sql/catalyst/plans/physical/partitioning.scala:
##########
@@ -361,6 +361,18 @@ object KeyGroupedPartitioning {
partitionValues: Seq[InternalRow]): KeyGroupedPartitioning = {
KeyGroupedPartitioning(expressions, partitionValues.size,
Some(partitionValues))
}
+
+ def supportsExpressions(expressions: Seq[Expression]): Boolean = {
Review Comment:
@sunchao @cloud-fan, I went back and forth on where to add this validation.
I decided to add it here as it is a current limitation of internal Catalyst
`KeyGroupedPartitioning`. It is fine if a data source reports a partitioning
with multi-arg transforms, we just can't benefit from it right now.
Let me know what you think. I also added a test to
`KeyGroupedPartitioningSuite`.
--
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.
To unsubscribe, e-mail: [email protected]
For queries about this service, please contact Infrastructure at:
[email protected]
---------------------------------------------------------------------
To unsubscribe, e-mail: [email protected]
For additional commands, e-mail: [email protected]
