Github user HyukjinKwon commented on a diff in the pull request:
https://github.com/apache/spark/pull/19505#discussion_r145012436
--- Diff:
sql/core/src/main/scala/org/apache/spark/sql/execution/python/ExtractPythonUDFs.scala
---
@@ -137,11 +137,15 @@ object ExtractPythonUDFs extends Rule[SparkPlan] with
PredicateHelper {
udf.references.subsetOf(child.outputSet)
}
if (validUdfs.nonEmpty) {
+ if (validUdfs.find(_.pythonUdfType ==
PythonUdfType.PANDAS_GROUPED_UDF).isDefined) {
--- End diff --
nit: maybe
```scala
validUdfs.exists(_.pythonUdfType == PythonUdfType.PANDAS_GROUPED_UDF)
```
---
---------------------------------------------------------------------
To unsubscribe, e-mail: [email protected]
For additional commands, e-mail: [email protected]
