Github user HyukjinKwon commented on a diff in the pull request:
https://github.com/apache/spark/pull/20892#discussion_r176897639
--- Diff: python/pyspark/sql/functions.py ---
@@ -28,10 +27,10 @@
from pyspark import since, SparkContext
from pyspark.rdd import ignore_unicode_prefix, PythonEvalType
-from pyspark.serializers import PickleSerializer, AutoBatchedSerializer
from pyspark.sql.column import Column, _to_java_column, _to_seq
from pyspark.sql.dataframe import DataFrame
from pyspark.sql.types import StringType, DataType
+# Keep UserDefinedFunction import for backwards compatible import; moved
in SPARK-22409
from pyspark.sql.udf import UserDefinedFunction, _create_udf
--- End diff --
yea, I think we should better keep this import and the comment looks good.
---
---------------------------------------------------------------------
To unsubscribe, e-mail: [email protected]
For additional commands, e-mail: [email protected]
