This is an automated email from the ASF dual-hosted git repository.
dongjoon pushed a commit to branch master
in repository https://gitbox.apache.org/repos/asf/spark.git
The following commit(s) were added to refs/heads/master by this push:
new 79357c8ccd22 [SPARK-47933][CONNECT][PYTHON][FOLLOW-UP] Avoid
referencing _to_seq in `pyspark-connect`
79357c8ccd22 is described below
commit 79357c8ccd22729a074c42f700544e7e3f023a8d
Author: Hyukjin Kwon <gurwls...@apache.org>
AuthorDate: Thu Apr 25 14:49:21 2024 -0700
[SPARK-47933][CONNECT][PYTHON][FOLLOW-UP] Avoid referencing _to_seq in
`pyspark-connect`
### What changes were proposed in this pull request?
This PR is a followup of https://github.com/apache/spark/pull/46155 that
removes the reference of `_to_seq` that `pyspark-connect` package does not have.
### Why are the changes needed?
To recover the CI
https://github.com/apache/spark/actions/runs/8821919392/job/24218893631
### Does this PR introduce _any_ user-facing change?
No, the main change has not been released out yet.
### How was this patch tested?
Manually tested.
### Was this patch authored or co-authored using generative AI tooling?
No.
Closes #46229 from HyukjinKwon/SPARK-47933-followuptmp.
Authored-by: Hyukjin Kwon <gurwls...@apache.org>
Signed-off-by: Dongjoon Hyun <dh...@apple.com>
---
python/pyspark/sql/group.py | 4 ++--
1 file changed, 2 insertions(+), 2 deletions(-)
diff --git a/python/pyspark/sql/group.py b/python/pyspark/sql/group.py
index d26e23bc7160..34c3531c8302 100644
--- a/python/pyspark/sql/group.py
+++ b/python/pyspark/sql/group.py
@@ -43,9 +43,9 @@ def dfapi(f: Callable[..., DataFrame]) -> Callable[...,
DataFrame]:
def df_varargs_api(f: Callable[..., DataFrame]) -> Callable[..., DataFrame]:
- from pyspark.sql.classic.column import _to_seq
-
def _api(self: "GroupedData", *cols: str) -> DataFrame:
+ from pyspark.sql.classic.column import _to_seq
+
name = f.__name__
jdf = getattr(self._jgd, name)(_to_seq(self.session._sc, cols))
return DataFrame(jdf, self.session)
---------------------------------------------------------------------
To unsubscribe, e-mail: commits-unsubscr...@spark.apache.org
For additional commands, e-mail: commits-h...@spark.apache.org
