This is an automated email from the ASF dual-hosted git repository.
dongjoon pushed a commit to branch master
in repository https://gitbox.apache.org/repos/asf/spark.git
The following commit(s) were added to refs/heads/master by this push:
new d97acc17dd0b [SPARK-49853][SQL][TESTS] Increase test timeout of
`PythonForeachWriterSuite` to `60s`
d97acc17dd0b is described below
commit d97acc17dd0bce476a1f44e7cce14e8d13d95a51
Author: Dongjoon Hyun <[email protected]>
AuthorDate: Wed Oct 2 14:20:49 2024 -0700
[SPARK-49853][SQL][TESTS] Increase test timeout of
`PythonForeachWriterSuite` to `60s`
### What changes were proposed in this pull request?
This PR aims to increase test timeout of `PythonForeachWriterSuite` to
`60s`.
### Why are the changes needed?
To stablize `PythonForeachWriterSuite` in GitHub Action MacOS 15 Runner.
For the failed cases, the data is still under generation.
- https://github.com/apache/spark/actions/runs/11132652698/job/30936988757
```
- UnsafeRowBuffer: handles more data than memory *** FAILED ***
The code passed to eventually never returned normally. Attempted 237
times over 20.075615666999997 seconds.
Last failure message: ArraySeq(1, ..., 1815) did not equal
Range$Inclusive(1, ..., 2000)
```
GitHub Runners have different spec and macOS has very limited resources
among them.
-
https://docs.github.com/en/actions/using-github-hosted-runners/using-github-hosted-runners/about-github-hosted-runners#standard-github-hosted-runners-for-public-repositories
| Virtual Machine | Processor (CPU) | Memory (RAM) | Storage (SSD) |
Workflow label |
| -- | -- | -- | -- | -- |
| Linux | 4 | 16 GB | 14 GB |
ubuntu-latest,ubuntu-24.04,ubuntu-22.04,ubuntu-20.04 |
| macOS | 3 (M1) | 7 GB | 14 GB | macos-latest,macos-14, macos-15 [Beta] |
### Does this PR introduce _any_ user-facing change?
No, this is a test-only change.
### How was this patch tested?
Pass the CIs.
### Was this patch authored or co-authored using generative AI tooling?
No.
Closes #48319 from dongjoon-hyun/SPARK-49853.
Authored-by: Dongjoon Hyun <[email protected]>
Signed-off-by: Dongjoon Hyun <[email protected]>
---
.../apache/spark/sql/execution/python/PythonForeachWriterSuite.scala | 2 +-
1 file changed, 1 insertion(+), 1 deletion(-)
diff --git
a/sql/core/src/test/scala/org/apache/spark/sql/execution/python/PythonForeachWriterSuite.scala
b/sql/core/src/test/scala/org/apache/spark/sql/execution/python/PythonForeachWriterSuite.scala
index 3a8ce569d1ba..a2d331836183 100644
---
a/sql/core/src/test/scala/org/apache/spark/sql/execution/python/PythonForeachWriterSuite.scala
+++
b/sql/core/src/test/scala/org/apache/spark/sql/execution/python/PythonForeachWriterSuite.scala
@@ -99,7 +99,7 @@ class PythonForeachWriterSuite extends SparkFunSuite with
Eventually with Mockit
}
private val iterator = buffer.iterator
private val outputBuffer = new ArrayBuffer[Int]
- private val testTimeout = timeout(20.seconds)
+ private val testTimeout = timeout(60.seconds)
private val intProj = UnsafeProjection.create(Array[DataType](IntegerType))
private val thread = new Thread() {
override def run(): Unit = {
---------------------------------------------------------------------
To unsubscribe, e-mail: [email protected]
For additional commands, e-mail: [email protected]
