This is an automated email from the ASF dual-hosted git repository.
dongjoon pushed a commit to branch master
in repository https://gitbox.apache.org/repos/asf/spark.git
The following commit(s) were added to refs/heads/master by this push:
new 26ab773478b9 [SPARK-53614][PYTHON][TESTS][FOLLOW-UP] Fix the maxBytes
config in tests
26ab773478b9 is described below
commit 26ab773478b940d0531d34b71a21758cc5ae6621
Author: Ruifeng Zheng <[email protected]>
AuthorDate: Thu Nov 27 16:51:07 2025 -0800
[SPARK-53614][PYTHON][TESTS][FOLLOW-UP] Fix the maxBytes config in tests
### What changes were proposed in this pull request?
Fix the maxBytes config in tests
### Why are the changes needed?
the testing configs `(1000, 4096)` were duplicated, IntMax should be tested
instead
### Does this PR introduce _any_ user-facing change?
no
### How was this patch tested?
ci
### Was this patch authored or co-authored using generative AI tooling?
no
Closes #53249 from zhengruifeng/test_grouped_conf.
Authored-by: Ruifeng Zheng <[email protected]>
Signed-off-by: Dongjoon Hyun <[email protected]>
---
python/pyspark/sql/tests/pandas/test_pandas_grouped_map.py | 4 ++--
1 file changed, 2 insertions(+), 2 deletions(-)
diff --git a/python/pyspark/sql/tests/pandas/test_pandas_grouped_map.py
b/python/pyspark/sql/tests/pandas/test_pandas_grouped_map.py
index 45b18e9414eb..fb18c5f062b8 100644
--- a/python/pyspark/sql/tests/pandas/test_pandas_grouped_map.py
+++ b/python/pyspark/sql/tests/pandas/test_pandas_grouped_map.py
@@ -1091,7 +1091,7 @@ class ApplyInPandasTestsMixin:
.sort("key")
).collect()
- for maxRecords, maxBytes in [(1000, 4096), (0, 4096), (1000, 4096)]:
+ for maxRecords, maxBytes in [(1000, 2**31 - 1), (0, 4096), (1000,
4096)]:
with self.subTest(maxRecords=maxRecords, maxBytes=maxBytes):
with self.sql_conf(
{
@@ -1137,7 +1137,7 @@ class ApplyInPandasTestsMixin:
df.groupby("key").agg(sf.min("v").alias("min"),
sf.max("v").alias("max")).sort("key")
).collect()
- for maxRecords, maxBytes in [(1000, 4096), (0, 4096), (1000, 4096)]:
+ for maxRecords, maxBytes in [(1000, 2**31 - 1), (0, 4096), (1000,
4096)]:
with self.subTest(maxRecords=maxRecords, maxBytes=maxBytes):
with self.sql_conf(
{
---------------------------------------------------------------------
To unsubscribe, e-mail: [email protected]
For additional commands, e-mail: [email protected]
