Xinrong Meng created SPARK-37251:
------------------------------------
Summary: Failed _joinAsOf doctest
Key: SPARK-37251
URL: https://issues.apache.org/jira/browse/SPARK-37251
Project: Spark
Issue Type: Sub-task
Components: PySpark
Affects Versions: 3.3.0
Reporter: Xinrong Meng
{code:java}
File "/Users/xinrong.meng/spark/python/pyspark/sql/dataframe.py", line 1523, in
pyspark.sql.dataframe.DataFrame._joinAsOf
Failed example:
left._joinAsOf(
right, leftAsOfColumn="a", rightAsOfColumn="a", how="left",
tolerance=F.lit(1)
).select(left.a, 'left_val', 'right_val').sort("a").collect()
Exception raised:
Traceback (most recent call last):
File "/opt/miniconda3/envs/py10/lib/python3.10/doctest.py", line 1348, in
__run
exec(compile(example.source, filename, "single",
File "<doctest pyspark.sql.dataframe.DataFrame._joinAsOf[5]>", line 1, in
<module>
left._joinAsOf(
File "/Users/xinrong.meng/spark/python/pyspark/sql/dataframe.py", line
1578, in _joinAsOf
jdf = self._jdf.joinAsOf(
File
"/Users/xinrong.meng/spark/python/lib/py4j-0.10.9.2-src.zip/py4j/java_gateway.py",
line 1309, in __call__
return_value = get_return_value(
File "/Users/xinrong.meng/spark/python/pyspark/sql/utils.py", line 178,
in deco
return f(*a, **kw)
File
"/Users/xinrong.meng/spark/python/lib/py4j-0.10.9.2-src.zip/py4j/protocol.py",
line 330, in get_return_value
raise Py4JError(
py4j.protocol.Py4JError: An error occurred while calling o283.joinAsOf.
Trace:
py4j.Py4JException: Method joinAsOf([class org.apache.spark.sql.Dataset,
class org.apache.spark.sql.Column, class org.apache.spark.sql.Column, null,
class java.lang.String, class org.apache.spark.sql.Column, class
java.lang.Boolean, class java.lang.String]) does not exist
{code}
--
This message was sent by Atlassian Jira
(v8.20.1#820001)
---------------------------------------------------------------------
To unsubscribe, e-mail: [email protected]
For additional commands, e-mail: [email protected]
