[
https://issues.apache.org/jira/browse/SPARK-41827?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
]
Sandeep Singh updated SPARK-41827:
----------------------------------
Description:
{code:java}
File
"/Users/s.singh/personal/spark-oss/python/pyspark/sql/connect/dataframe.py",
line 302, in pyspark.sql.connect.dataframe.DataFrame.groupBy
Failed example:
df.groupBy(["name", df.age]).count().sort("name", "age").show()
Exception raised:
Traceback (most recent call last):
File
"/usr/local/Cellar/[email protected]/3.10.8/Frameworks/Python.framework/Versions/3.10/lib/python3.10/doctest.py",
line 1350, in __run
exec(compile(example.source, filename, "single",
File "<doctest pyspark.sql.connect.dataframe.DataFrame.groupBy[4]>", line
1, in <module>
df.groupBy(["name", df.age]).count().sort("name", "age").show()
File
"/Users/s.singh/personal/spark-oss/python/pyspark/sql/connect/dataframe.py",
line 251, in groupBy
raise TypeError(
TypeError: groupBy requires all cols be Column or str, but got list
['name', Column<'ColumnReference(age)'>]{code}
was:
{code:java}
File
"/Users/s.singh/personal/spark-oss/python/pyspark/sql/connect/dataframe.py",
line 650, in pyspark.sql.connect.dataframe.DataFrame.fillna
Failed example:
df.na.fill(50).show()
Expected:
+---+------+-----+----+
|age|height| name|bool|
+---+------+-----+----+
| 10| 80.5|Alice|null|
| 5| 50.0| Bob|null|
| 50| 50.0| Tom|null|
| 50| 50.0| null|true|
+---+------+-----+----+
Got:
+----+------+-----+----+
| age|height| name|bool|
+----+------+-----+----+
|10.0| 80.5|Alice|null|
| 5.0| 50.0| Bob|null|
|50.0| 50.0| Tom|null|
|50.0| 50.0| null|true|
+----+------+-----+----+
<BLANKLINE>{code}
> DataFrame.groupBy requires all cols be Column or str
> ----------------------------------------------------
>
> Key: SPARK-41827
> URL: https://issues.apache.org/jira/browse/SPARK-41827
> Project: Spark
> Issue Type: Sub-task
> Components: Connect
> Affects Versions: 3.4.0
> Reporter: Sandeep Singh
> Priority: Major
>
> {code:java}
> File
> "/Users/s.singh/personal/spark-oss/python/pyspark/sql/connect/dataframe.py",
> line 302, in pyspark.sql.connect.dataframe.DataFrame.groupBy
> Failed example:
> df.groupBy(["name", df.age]).count().sort("name", "age").show()
> Exception raised:
> Traceback (most recent call last):
> File
> "/usr/local/Cellar/[email protected]/3.10.8/Frameworks/Python.framework/Versions/3.10/lib/python3.10/doctest.py",
> line 1350, in __run
> exec(compile(example.source, filename, "single",
> File "<doctest pyspark.sql.connect.dataframe.DataFrame.groupBy[4]>",
> line 1, in <module>
> df.groupBy(["name", df.age]).count().sort("name", "age").show()
> File
> "/Users/s.singh/personal/spark-oss/python/pyspark/sql/connect/dataframe.py",
> line 251, in groupBy
> raise TypeError(
> TypeError: groupBy requires all cols be Column or str, but got list
> ['name', Column<'ColumnReference(age)'>]{code}
--
This message was sent by Atlassian Jira
(v8.20.10#820010)
---------------------------------------------------------------------
To unsubscribe, e-mail: [email protected]
For additional commands, e-mail: [email protected]
