thswlsqls opened a new pull request, #9971:
URL: https://github.com/apache/paimon/pull/9971

   ### Purpose
   
   fix #9970
   
   - `SparkE2eTest.testFlinkWriteAndSparkRead` fails intermittently in 
`checkQueryResult`: the `spark-sql` shutdown race logs an ERROR after the 
correct rows, with exit code 0.
   - #8907 only cut the `dispatcher-CoarseGrainedScheduler` message; the race 
also logs `ERROR TransportRequestHandler: Error while invoking 
RpcHandler#receive() for one-way message.` with a `Could not find AppClient` 
trace.
   - Replace the message-specific cut with `stripTrailingSparkErrorLogs`, which 
drops everything from the first line with Spark's default log4j2 ERROR prefix 
(`yy/MM/dd HH:mm:ss ERROR `); the timestamp anchor leaves an `ERROR` word 
inside a result row intact.
   - CI runs: https://github.com/apache/paimon/actions/runs/31138366506 (PR 
#9085), https://github.com/apache/paimon/actions/runs/33298854847 (master 
push), https://github.com/apache/paimon/actions/runs/34942967900 (PR #9835).
   
   ### Tests
   
   - Added `SparkE2eOutputTest` (no Docker), 5 cases: no log, 
CoarseGrainedScheduler variant, two TransportRequestHandler blocks, ERROR on 
first line, `ERROR` inside a row.
   - `mvn -Pflink1,spark3 -pl paimon-e2e-tests -Dtest=SparkE2eOutputTest test` 
— 5 passed; `spotless:check`, checkstyle and `test-compile` green.
   - Docker-based `SparkE2eTest` not run locally; covered by CI `e2e-flink1`.
   


-- 
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.

To unsubscribe, e-mail: [email protected]

For queries about this service, please contact Infrastructure at:
[email protected]

Reply via email to