This is an automated email from the ASF dual-hosted git repository.
gurwls223 pushed a commit to branch master
in repository https://gitbox.apache.org/repos/asf/spark.git
The following commit(s) were added to refs/heads/master by this push:
new 33091980ab3 [SPARK-38893][SS][PYTHON][TESTS] Test SourceProgress in
PySpark
33091980ab3 is described below
commit 33091980ab325bcd001fad93129d74f0189c08e9
Author: Hyukjin Kwon <[email protected]>
AuthorDate: Thu Apr 14 17:24:34 2022 +0900
[SPARK-38893][SS][PYTHON][TESTS] Test SourceProgress in PySpark
### What changes were proposed in this pull request?
There was a mistake in https://github.com/apache/spark/pull/36038 that
mistakenly did not test `SourceProgress`. This PR fixes it.
### Why are the changes needed?
For better test coverage.
### Does this PR introduce _any_ user-facing change?
No, test-only.
### How was this patch tested?
Test-only PR, and CI should validate it.
Closes #36190 from HyukjinKwon/SPARK-38893.
Authored-by: Hyukjin Kwon <[email protected]>
Signed-off-by: Hyukjin Kwon <[email protected]>
---
python/pyspark/sql/tests/test_streaming_listener.py | 2 +-
1 file changed, 1 insertion(+), 1 deletion(-)
diff --git a/python/pyspark/sql/tests/test_streaming_listener.py
b/python/pyspark/sql/tests/test_streaming_listener.py
index 263bf864dd6..010b2fbf633 100644
--- a/python/pyspark/sql/tests/test_streaming_listener.py
+++ b/python/pyspark/sql/tests/test_streaming_listener.py
@@ -194,7 +194,7 @@ class StreamingListenerTests(ReusedSQLTestCase):
self.check_state_operator_progress(so)
self.assertTrue(isinstance(progress.sources, list))
- for so in progress.stateOperators:
+ for so in progress.sources:
self.check_source_progress(so)
self.assertTrue(isinstance(progress.sink, SinkProgress))
---------------------------------------------------------------------
To unsubscribe, e-mail: [email protected]
For additional commands, e-mail: [email protected]
