This is an automated email from the ASF dual-hosted git repository.
ruifengz pushed a commit to branch master
in repository https://gitbox.apache.org/repos/asf/spark.git
The following commit(s) were added to refs/heads/master by this push:
new 5a30d68a6520 [SPARK-53451][PYTHON][TESTS] Fix scheduled job for python
3.13 no GIL
5a30d68a6520 is described below
commit 5a30d68a652075497d72985fffb31ee281b18c79
Author: Ruifeng Zheng <ruife...@apache.org>
AuthorDate: Tue Sep 2 16:10:33 2025 +0800
[SPARK-53451][PYTHON][TESTS] Fix scheduled job for python 3.13 no GIL
### What changes were proposed in this pull request?
Fix scheduled job for python 3.13 no GIL
### Why are the changes needed?
to fix
https://github.com/apache/spark/actions/runs/17385400014/job/49350962801
### Does this PR introduce _any_ user-facing change?
no, test-only
### How was this patch tested?
PR builder with
```
default: '{"PYSPARK_IMAGE_TO_TEST": "python-313-nogil", "PYTHON_TO_TEST":
"python3.13t", "PYTHON_GIL": "0"}'
```
https://github.com/zhengruifeng/spark/runs/49371694251
### Was this patch authored or co-authored using generative AI tooling?
no
Closes #52195 from zhengruifeng/fix_py313_no_gil_test.
Authored-by: Ruifeng Zheng <ruife...@apache.org>
Signed-off-by: Ruifeng Zheng <ruife...@apache.org>
---
python/pyspark/sql/tests/arrow/test_arrow.py | 2 +-
1 file changed, 1 insertion(+), 1 deletion(-)
diff --git a/python/pyspark/sql/tests/arrow/test_arrow.py
b/python/pyspark/sql/tests/arrow/test_arrow.py
index c74ca121f26d..d9a5720bc343 100644
--- a/python/pyspark/sql/tests/arrow/test_arrow.py
+++ b/python/pyspark/sql/tests/arrow/test_arrow.py
@@ -477,7 +477,7 @@ class ArrowTestsMixin:
allocation_after = pa.total_allocated_bytes()
difference = allocation_after - allocation_before
# Should be around 1x the data size (table should not hold on to any
memory)
- self.assertGreaterEqual(difference, 0.9 * expected_bytes)
+ self.assertGreaterEqual(difference, 0.8 * expected_bytes)
self.assertLessEqual(difference, 1.1 * expected_bytes)
with
self.sql_conf({"spark.sql.execution.arrow.pyspark.selfDestruct.enabled":
False}):
---------------------------------------------------------------------
To unsubscribe, e-mail: commits-unsubscr...@spark.apache.org
For additional commands, e-mail: commits-h...@spark.apache.org
