tkaymak opened a new pull request, #40428: URL: https://github.com/apache/beam/pull/40428
Fixes #40427. Since #40324, ValidatesRunner methods run on 8 threads per test JVM. The Spark runners keep metrics in a JVM wide `MetricsAccumulator` and allow one SparkContext per JVM, so every Spark VR and PVR PostCommit is red since 2026-10-01. This sets `beam.validatesRunner.parallelThreads=1` for the Spark runner and Spark job server test tasks, as the Dataflow runner sets its own value. The trigger files run the eight affected suites on this PR. Local check, `:runners:spark:4:validatesStructuredStreamingRunnerBatch` on PAssertTest, FlattenTest and CreateTest: 37 failures on master, 46 tests and 0 failures with this change. R: @Abacn cc @reuvenlax -- This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use the URL above to go to the specific comment. To unsubscribe, e-mail: [email protected] For queries about this service, please contact Infrastructure at: [email protected]
