zhangshenghang opened a new pull request, #11366:
URL: https://github.com/apache/seatunnel/pull/11366

   ### Purpose
   
   Fixes #9890.
   
   Spark cluster mode ships the SeaTunnel job config through `spark-submit 
--files`. The runtime previously reduced the submitted config path to only its 
file name and checked the driver working directory directly. In Spark 
Standalone cluster mode the shipped file can live under Spark's files directory 
instead, so SeaTunnel failed before reading the job config.
   
   ### Changes
   
   - Resolve the cluster-mode config file from `SparkFiles` when the local 
basename does not exist.
   - Keep the existing path behavior for client mode and for cluster mode when 
the basename is already available locally.
   - Add unit coverage for both behaviors.
   
   ### Tests
   
   - `./mvnw -pl 
seatunnel-core/seatunnel-spark-starter/seatunnel-spark-starter-common 
-Dtest=SparkTaskExecuteCommandTest test`
   - `./mvnw spotless:apply`
   - `./mvnw -q -DskipTests verify`
   


-- 
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.

To unsubscribe, e-mail: [email protected]

For queries about this service, please contact Infrastructure at:
[email protected]

Reply via email to