Github user cloud-fan commented on a diff in the pull request:
https://github.com/apache/spark/pull/19630#discussion_r148806731
--- Diff: python/pyspark/rdd.py ---
@@ -56,6 +56,22 @@
__all__ = ["RDD"]
+class PythonEvalType(object):
+ """
+ Evaluation type of python rdd.
+
+ These values are internal to PySpark.
+ """
+ NON_UDF = 0
+
+ SQL_BATCHED_UDF = 100
+
+ PANDAS_SCALAR_UDF = 200
+ PANDAS_GROUP_MAP_UDF = 201
+ PANDAS_GROUP_AGGREGATE_UDF = 202
+ PANDAS_GROUP_FLATMAP_UDF = 203
--- End diff --
This is new, what's the mean of flatmap here?
---
---------------------------------------------------------------------
To unsubscribe, e-mail: [email protected]
For additional commands, e-mail: [email protected]
