HyukjinKwon commented on PR #41696:
URL: https://github.com/apache/spark/pull/41696#issuecomment-1603455454
The test fails FYI:
```
File "/__w/spark/spark/python/pyspark/pandas/window.py", line 2529, in
pyspark.pandas.window.ExponentialMoving.mean
Failed example:
df.ewm(com=0.1).mean()
Exception raised:
Traceback (most recent call last):
File "/usr/lib/python3.9/doctest.py", line 1336, in __run
exec(compile(example.source, filename, "single",
File "<doctest pyspark.pandas.window.ExponentialMoving.mean[1]>", line
1, in <module>
df.ewm(com=0.1).mean()
File "/__w/spark/spark/python/pyspark/pandas/window.py", line 2549, in
mean
return super().mean()
File "/__w/spark/spark/python/pyspark/pandas/window.py", line 2457, in
mean
return self._apply_as_series_or_frame(mean)
File "/__w/spark/spark/python/pyspark/pandas/window.py", line 210, in
_apply_as_series_or_frame
return self._psdf_or_psser._apply_series_op(
File "/__w/spark/spark/python/pyspark/pandas/frame.py", line 881, in
_apply_series_op
applied.append(op(self._psser_for(label)))
File "/__w/spark/spark/python/pyspark/pandas/window.py", line 211, in
<lambda>
lambda psser: psser._with_new_scol(func(psser.spark.column)), #
TODO: dtype?
File "/__w/spark/spark/python/pyspark/pandas/window.py", line 2450, in
mean
col_ewm = SF.ewm(scol, unified_alpha, self._ignore_na)
File "/__w/spark/spark/python/pyspark/pandas/spark/functions.py", line
159, in ewm
return Column(sc._jvm.PythonSQLUtils.pandasCovar(col._jc, alpha,
ignore_na))
File
"/__w/spark/spark/python/lib/py4j-0.10.9.7-src.zip/py4j/java_gateway.py", line
1322, in __call__
return_value = get_return_value(
File "/__w/spark/spark/python/pyspark/errors/exceptions/captured.py",
line 179, in deco
return f(*a, **kw)
File
"/__w/spark/spark/python/lib/py4j-0.10.9.7-src.zip/py4j/protocol.py", line 330,
in get_return_value
raise Py4JError(
py4j.protocol.Py4JError: An error occurred while calling
z:org.apache.spark.sql.api.python.PythonSQLUtils.pandasCovar. Trace:
py4j.Py4JException: Method pandasCovar([class
org.apache.spark.sql.Column, class java.lang.Double, class java.lang.Boolean])
does not exist
at py4j.reflection.ReflectionEngine.getMethod(ReflectionEngine.java:321)
at py4j.reflection.ReflectionEngine.getMethod(ReflectionEngine.java:342)
at py4j.Gateway.invoke(Gateway.java:276)
at py4j.commands.AbstractCommand.invokeMethod(AbstractCommand.java:132)
at py4j.commands.CallCommand.execute(CallCommand.java:79)
at
py4j.ClientServerConnection.waitForCommands(ClientServerConnection.java:182)
at py4j.ClientServerConnection.run(ClientServerConnection.java:106)
at java.lang.Thread.run(Thread.java:750)
```
--
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.
To unsubscribe, e-mail: [email protected]
For queries about this service, please contact Infrastructure at:
[email protected]
---------------------------------------------------------------------
To unsubscribe, e-mail: [email protected]
For additional commands, e-mail: [email protected]
