vraziel opened a new issue, #5373:
URL: https://github.com/apache/seatunnel/issues/5373

   ### Search before asking
   
   - [X] I had searched in the 
[issues](https://github.com/apache/seatunnel/issues?q=is%3Aissue+label%3A%22bug%22)
 and found no similar issues.
   
   
   ### What happened
   
   Hello,
   
   I was checking SeaTunnel with Spark in cluster mode. Docker runs a spark 
cluster.
   You can create Spark cluster with the following docker compose file.
   
   
[docker-compose.txt](https://github.com/apache/seatunnel/files/12429336/docker-compose.txt)
   
   After cluster was ready,  I tried to run the following command:
   
   bin/start-seatunnel-spark-3-connector-v2.sh -m spark://127.0.0.1:7077 -e 
cluster -c config/v2.batch.config.template
   
   But error was thrown by Spark engine.
   
   
   
   
   
   
   
   
   ### SeaTunnel Version
   
   2.3.3 
   
   ### SeaTunnel Config
   
   ```conf
   env {
     # You can set SeaTunnel environment configuration here
     execution.parallelism = 2
     job.mode = "BATCH"
     checkpoint.interval = 10000
     #execution.checkpoint.interval = 10000
     #execution.checkpoint.data-uri = "hdfs://localhost:9000/checkpoint"
   }
   
   source {
     # This is a example source plugin **only for test and demonstrate the 
feature source plugin**
     FakeSource {
       parallelism = 2
       result_table_name = "fake"
       row.num = 16
       schema = {
         fields {
           name = "string"
           age = "int"
         }
       }
     }
   
     # If you would like to get more information about how to configure 
SeaTunnel and see full list of source plugins,
     # please go to https://seatunnel.apache.org/docs/category/source-v2
   }
   
   sink {
     Console {
     }
   
     # If you would like to get more information about how to configure 
SeaTunnel and see full list of sink plugins,
     # please go to https://seatunnel.apache.org/docs/category/sink-v2
   }
   ```
   
   
   ### Running Command
   
   ```shell
   bin/start-seatunnel-spark-3-connector-v2.sh -m spark://127.0.0.1:7077 -e 
cluster -c config/v2.batch.config.template
   ```
   
   
   ### Error Exception
   
   ```log
   xception from cluster was: java.nio.file.NoSuchFileException: 
/home/uraziel/apache-seatunnel-2.3.3-SNAPSHOT-bin/starter/seatunnel-spark-3-starter.jar
   java.nio.file.NoSuchFileException: 
/home/uraziel/apache-seatunnel-2.3.3-SNAPSHOT-bin/starter/seatunnel-spark-3-starter.jar
        at 
sun.nio.fs.UnixException.translateToIOException(UnixException.java:86)
        at sun.nio.fs.UnixException.rethrowAsIOException(UnixException.java:102)
        at sun.nio.fs.UnixException.rethrowAsIOException(UnixException.java:107)
        at sun.nio.fs.UnixCopyFile.copy(UnixCopyFile.java:526)
        at 
sun.nio.fs.UnixFileSystemProvider.copy(UnixFileSystemProvider.java:253)
        at java.nio.file.Files.copy(Files.java:1274)
        at org.apache.spark.util.Utils$.copyRecursive(Utils.scala:771)
        at org.apache.spark.util.Utils$.copyFile(Utils.scala:742)
        at org.apache.spark.util.Utils$.doFetchFile(Utils.scala:815)
        at org.apache.spark.util.Utils$.fetchFile(Utils.scala:557)
        at 
org.apache.spark.deploy.worker.DriverRunner.downloadUserJar(DriverRunner.scala:162)
        at 
org.apache.spark.deploy.worker.DriverRunner.prepareAndRunDriver(DriverRunner.scala:179)
        at 
org.apache.spark.deploy.worker.DriverRunner$$anon$2.run(DriverRunner.scala:99)
   ```
   
   
   ### Zeta or Flink or Spark Version
   
   Spark 3.3.1
   
   ### Java or Scala Version
   
   _No response_
   
   ### Screenshots
   
   Shell
   
![image](https://github.com/apache/seatunnel/assets/143090484/def42572-cd91-4b3b-8faa-4ba2cadfc74d)
   
   Docker 
   
![image](https://github.com/apache/seatunnel/assets/143090484/79cbaf49-d3de-4ca9-a8e6-3b6f1bfd4e2e)
   
   
   
   ### Are you willing to submit PR?
   
   - [ ] Yes I am willing to submit a PR!
   
   ### Code of Conduct
   
   - [X] I agree to follow this project's [Code of 
Conduct](https://www.apache.org/foundation/policies/conduct)
   


-- 
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.

To unsubscribe, e-mail: [email protected]

For queries about this service, please contact Infrastructure at:
[email protected]

Reply via email to