This is an automated email from the ASF dual-hosted git repository.
gurwls223 pushed a commit to branch master
in repository https://gitbox.apache.org/repos/asf/spark.git
The following commit(s) were added to refs/heads/master by this push:
new 70eef5df94d [SPARK-43434][CONNECT][PYTHON][TESTS] Disable flaky
doctest `pyspark.sql.connect.dataframe.DataFrame.writeStream`
70eef5df94d is described below
commit 70eef5df94d741eb4aca3a0ce647f180397fd474
Author: Ruifeng Zheng <ruife...@apache.org>
AuthorDate: Wed May 10 21:17:36 2023 +0900
[SPARK-43434][CONNECT][PYTHON][TESTS] Disable flaky doctest
`pyspark.sql.connect.dataframe.DataFrame.writeStream`
### What changes were proposed in this pull request?
Disable flaky doctest `pyspark.sql.connect.dataframe.DataFrame.writeStream`
### Why are the changes needed?
This test is unstable, see
https://github.com/apache/spark/pull/40586#issuecomment-1524690074 and
https://github.com/apache/spark/pull/40586#discussion_r1182411427
### Does this PR introduce _any_ user-facing change?
No, dev-only
### How was this patch tested?
updated UT
Closes #41114 from zhengruifeng/connect_test_write_stream.
Authored-by: Ruifeng Zheng <ruife...@apache.org>
Signed-off-by: Hyukjin Kwon <gurwls...@apache.org>
---
python/pyspark/sql/connect/dataframe.py | 3 +++
1 file changed, 3 insertions(+)
diff --git a/python/pyspark/sql/connect/dataframe.py
b/python/pyspark/sql/connect/dataframe.py
index 87f061f139e..ffd52cf0cec 100644
--- a/python/pyspark/sql/connect/dataframe.py
+++ b/python/pyspark/sql/connect/dataframe.py
@@ -2171,6 +2171,9 @@ def _test() -> None:
# TODO(SPARK-41888): Support StreamingQueryListener for DataFrame.observe
del pyspark.sql.connect.dataframe.DataFrame.observe.__doc__
+ # TODO(SPARK-43435): should reenable this test
+ del pyspark.sql.connect.dataframe.DataFrame.writeStream.__doc__
+
globs["spark"] = (
PySparkSession.builder.appName("sql.connect.dataframe tests")
.remote("local[4]")
---------------------------------------------------------------------
To unsubscribe, e-mail: commits-unsubscr...@spark.apache.org
For additional commands, e-mail: commits-h...@spark.apache.org
