Hyukjin Kwon created SPARK-61096:
------------------------------------
Summary: Represent GroupedData by its grouping expressions, the
types of its DataFrame and its type in the Python client as PySpark does
Key: SPARK-61096
URL: https://issues.apache.org/jira/browse/SPARK-61096
Project: Spark
Issue Type: Bug
Components: Connect
Affects Versions: connect-rust-4.3.0
Reporter: Hyukjin Kwon
In PySpark Connect, the repr of a {{GroupedData}} names its grouping
expressions, the columns and types of its DataFrame, and its type:
{{GroupedData[grouping expressions: [k], value: [k: int, s: string], type:
GroupBy]}}, of {{GroupBy}}, {{RollUp}}, {{Cube}}, {{GroupingSets}} or {{Pivot}}.
The Rust-backed Python client gives the default repr of an object,
{{<pyspark.sql.group.GroupedData object at 0x...>}}. Represent it as PySpark
does.
--
This message was sent by Atlassian Jira
(v10.3.26#10030026)
---------------------------------------------------------------------
To unsubscribe, e-mail: [email protected]
For additional commands, e-mail: [email protected]
