This is an automated email from the ASF dual-hosted git repository.
gurwls223 pushed a commit to branch master
in repository https://gitbox.apache.org/repos/asf/spark.git
The following commit(s) were added to refs/heads/master by this push:
new 42838a94153d [SPARK-50912][PYTHON][TESTS] Skip
FrameTakeAdvParityTests.test_take_adv because of OOM for now
42838a94153d is described below
commit 42838a94153dc831718c31a10dbd63e27bafb100
Author: Hyukjin Kwon <[email protected]>
AuthorDate: Wed Jan 22 10:34:41 2025 +0900
[SPARK-50912][PYTHON][TESTS] Skip FrameTakeAdvParityTests.test_take_adv
because of OOM for now
### What changes were proposed in this pull request?
This PR proposes to skip `test_take_adv` in Spark Connect only build.
Similar with https://github.com/apache/spark/pull/49565
### Why are the changes needed?
This particular test is flaky
(https://github.com/apache/spark/actions/runs/12835248061/job/35794283521 and
fails with OOM, which results in stopping all following tests. We should at
least fix this build, and run other tests.
The build reuses single JVM for running all tests so it consumes more
memory.
### Does this PR introduce _any_ user-facing change?
No, test-only.
### How was this patch tested?
Will monitor the build.
### Was this patch authored or co-authored using generative AI tooling?
No.
Closes #49593 from HyukjinKwon/SPARK-50912.
Authored-by: Hyukjin Kwon <[email protected]>
Signed-off-by: Hyukjin Kwon <[email protected]>
---
python/pyspark/pandas/tests/connect/frame/test_parity_take_adv.py | 2 ++
1 file changed, 2 insertions(+)
diff --git a/python/pyspark/pandas/tests/connect/frame/test_parity_take_adv.py
b/python/pyspark/pandas/tests/connect/frame/test_parity_take_adv.py
index 22b4aea4fd39..2d1958073b29 100644
--- a/python/pyspark/pandas/tests/connect/frame/test_parity_take_adv.py
+++ b/python/pyspark/pandas/tests/connect/frame/test_parity_take_adv.py
@@ -16,11 +16,13 @@
#
import unittest
+from pyspark import is_remote_only
from pyspark.pandas.tests.frame.test_take_adv import FrameTakeAdvMixin
from pyspark.testing.connectutils import ReusedConnectTestCase
from pyspark.testing.pandasutils import PandasOnSparkTestUtils
[email protected](is_remote_only(), "Flaky with OOM")
class FrameTakeAdvParityTests(
FrameTakeAdvMixin,
PandasOnSparkTestUtils,
---------------------------------------------------------------------
To unsubscribe, e-mail: [email protected]
For additional commands, e-mail: [email protected]
