Li Jin created SPARK-25640:
------------------------------
Summary: Clarify/Improve EvalType for grouped aggregate and window
aggregate
Key: SPARK-25640
URL: https://issues.apache.org/jira/browse/SPARK-25640
Project: Spark
Issue Type: Sub-task
Components: PySpark
Affects Versions: 2.4.0
Reporter: Li Jin
Currently, grouped aggregate and window aggregate uses different EvalType,
however, they map to the same user facing type PandasUDFType.GROUPED_MAP.
It makes sense to have one user facing type because it
(PandasUDFType.GROUPED_MAP) can be used in both groupby and window operation.
However, the mismatching between PandasUDFType and EvalType can be confusing to
developers. We should clarify and/or improve this.
--
This message was sent by Atlassian JIRA
(v7.6.3#76005)
---------------------------------------------------------------------
To unsubscribe, e-mail: issues-unsubscr...@spark.apache.org
For additional commands, e-mail: issues-h...@spark.apache.org
