[
https://issues.apache.org/jira/browse/SPARK-41825?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
]
Sandeep Singh updated SPARK-41825:
----------------------------------
Description:
{code:java}
File
"/Users/s.singh/personal/spark-oss/python/pyspark/sql/connect/dataframe.py",
line 650, in pyspark.sql.connect.dataframe.DataFrame.fillna
Failed example:
df.na.fill(50).show()
Expected:
+---+------+-----+----+
|age|height| name|bool|
+---+------+-----+----+
| 10| 80.5|Alice|null|
| 5| 50.0| Bob|null|
| 50| 50.0| Tom|null|
| 50| 50.0| null|true|
+---+------+-----+----+
Got:
+----+------+-----+----+
| age|height| name|bool|
+----+------+-----+----+
|10.0| 80.5|Alice|null|
| 5.0| 50.0| Bob|null|
|50.0| 50.0| Tom|null|
|50.0| 50.0| null|true|
+----+------+-----+----+
<BLANKLINE>{code}
was:
{code:java}
File
"/Users/s.singh/personal/spark-oss/python/pyspark/sql/connect/dataframe.py",
line 1296, in pyspark.sql.connect.dataframe.DataFrame.explain
Failed example:
df.explain()
Expected:
== Physical Plan ==
*(1) Scan ExistingRDD[age...,name...]
Got:
== Physical Plan ==
LocalTableScan [age#1148L, name#1149]
<BLANKLINE>
<BLANKLINE>
**********************************************************************
File
"/Users/s.singh/personal/spark-oss/python/pyspark/sql/connect/dataframe.py",
line 1314, in pyspark.sql.connect.dataframe.DataFrame.explain
Failed example:
df.explain(mode="formatted")
Expected:
== Physical Plan ==
* Scan ExistingRDD (...)
(1) Scan ExistingRDD [codegen id : ...]
Output [2]: [age..., name...]
...
Got:
== Physical Plan ==
LocalTableScan (1)
<BLANKLINE>
<BLANKLINE>
(1) LocalTableScan
Output [2]: [age#1170L, name#1171]
Arguments: [age#1170L, name#1171]
<BLANKLINE>
<BLANKLINE>{code}
> DataFrame.show formating int as double
> --------------------------------------
>
> Key: SPARK-41825
> URL: https://issues.apache.org/jira/browse/SPARK-41825
> Project: Spark
> Issue Type: Sub-task
> Components: Connect
> Affects Versions: 3.4.0
> Reporter: Sandeep Singh
> Priority: Major
>
> {code:java}
> File
> "/Users/s.singh/personal/spark-oss/python/pyspark/sql/connect/dataframe.py",
> line 650, in pyspark.sql.connect.dataframe.DataFrame.fillna
> Failed example:
> df.na.fill(50).show()
> Expected:
> +---+------+-----+----+
> |age|height| name|bool|
> +---+------+-----+----+
> | 10| 80.5|Alice|null|
> | 5| 50.0| Bob|null|
> | 50| 50.0| Tom|null|
> | 50| 50.0| null|true|
> +---+------+-----+----+
> Got:
> +----+------+-----+----+
> | age|height| name|bool|
> +----+------+-----+----+
> |10.0| 80.5|Alice|null|
> | 5.0| 50.0| Bob|null|
> |50.0| 50.0| Tom|null|
> |50.0| 50.0| null|true|
> +----+------+-----+----+
> <BLANKLINE>{code}
--
This message was sent by Atlassian Jira
(v8.20.10#820010)
---------------------------------------------------------------------
To unsubscribe, e-mail: [email protected]
For additional commands, e-mail: [email protected]
