whb-bigdata opened a new issue, #1743:
URL: https://github.com/apache/incubator-seatunnel/issues/1743

   ### Search before asking
   
   - [X] I had searched in the 
[issues](https://github.com/apache/incubator-seatunnel/issues?q=is%3Aissue+label%3A%22bug%22)
 and found no similar issues.
   
   
   ### What happened
   
   when  use spark-submit   yarn  cluster  deploy-mode ,spark can not  get  
config  file on yarn
   
   ### SeaTunnel Version
   
   2.1.1-prepare
   
   ### SeaTunnel Config
   
   ```conf
   env {
           spark.master = yarn
           spark.app.name = "20220315"
           spark.executor.instances = 1
           spark.executor.cores = 1
           spark.executor.memory = "4g"
           spark.driver.memory = "4g"
           spark.yarn.keytab = "xxxx.keytab"
           spark.yarn.principal = "xxxxxx"
           spark.yarn.queue = "xxxxxx"
   }
   source{
    jdbc {
           driver = "com.mysql.jdbc.Driver"
           url = "xxxxxxxxxx"
           table = "xxxxxxxxxxx"
           result_table_name = "xxxxxxxxxxx"
           user = "root"
           password = "xxxxxxxxxxx"
   }
   
   }
   
   transform{
    sql {
           sql = "select   * from xxxxxx"
           result_table_name = "xxxxx"
   }
   }
   sink{
   jdbc {
           driver = "com.mysql.jdbc.Driver"
           source_table_name = "xxxxx"
           saveMode = "append"
           url = "xxxxx"
           user = "root"
           password = "xxxxx"
           dbTable = "xxxxx"
           }
   }
   ```
   
   
   ### Running Command
   
   ```shell
   bin/start-seatunnel-spark.sh --master yarn --deploy-mode cluster -c 
config/application.conf
   ```
   
   
   ### Error Exception
   
   ```log
   22/04/24 14:27:19 WARN conf.HiveConf: HiveConf of name 
hive.strict.checks.cartesian.product does not exist
   22/04/24 14:27:20 INFO security.AMCredentialRenewer: Scheduling login from 
keytab in 18.0 h.
   22/04/24 14:27:20 INFO yarn.ApplicationMaster: Preparing Local resources
   22/04/24 14:27:20 INFO yarn.ApplicationMaster: ApplicationAttemptId: 
appattempt_1647333129725_263600_000001
   22/04/24 14:27:20 INFO yarn.ApplicationMaster: Starting the user application 
in a separate Thread
   22/04/24 14:27:20 INFO yarn.ApplicationMaster: Waiting for spark context 
initialization...
   22/04/24 14:27:20 INFO config.ConfigBuilder: Loading config file: 
./config/application.conf
   22/04/24 14:27:21 INFO config.ConfigBuilder: parsed config file: {}
   
   22/04/24 14:27:21 ERROR seatunnel.Seatunnel: 
   
   
===============================================================================
   
   
   22/04/24 14:27:21 ERROR seatunnel.Seatunnel: Fatal Error, 
   
   22/04/24 14:27:21 ERROR seatunnel.Seatunnel: Please submit bug report in 
https://github.com/apache/incubator-seatunnel/issues
   
   22/04/24 14:27:21 ERROR seatunnel.Seatunnel: Reason:No configuration setting 
found for key 'env' 
   
   22/04/24 14:27:21 ERROR seatunnel.Seatunnel: Exception 
StackTrace:org.apache.seatunnel.shade.com.typesafe.config.ConfigException$Missing:
 No configuration setting found for key 'env'
        at 
org.apache.seatunnel.shade.com.typesafe.config.impl.SimpleConfig.findKeyOrNull(SimpleConfig.java:156)
        at 
org.apache.seatunnel.shade.com.typesafe.config.impl.SimpleConfig.findOrNull(SimpleConfig.java:174)
        at 
org.apache.seatunnel.shade.com.typesafe.config.impl.SimpleConfig.find(SimpleConfig.java:188)
        at 
org.apache.seatunnel.shade.com.typesafe.config.impl.SimpleConfig.find(SimpleConfig.java:193)
        at 
org.apache.seatunnel.shade.com.typesafe.config.impl.SimpleConfig.getObject(SimpleConfig.java:268)
        at 
org.apache.seatunnel.shade.com.typesafe.config.impl.SimpleConfig.getConfig(SimpleConfig.java:274)
        at 
org.apache.seatunnel.shade.com.typesafe.config.impl.SimpleConfig.getConfig(SimpleConfig.java:41)
        at 
org.apache.seatunnel.config.EnvironmentFactory.getEnvironment(EnvironmentFactory.java:47)
        at 
org.apache.seatunnel.config.ExecutionContext.<init>(ExecutionContext.java:49)
        at 
org.apache.seatunnel.command.spark.SparkTaskExecuteCommand.execute(SparkTaskExecuteCommand.java:44)
        at 
org.apache.seatunnel.command.spark.SparkTaskExecuteCommand.execute(SparkTaskExecuteCommand.java:36)
        at org.apache.seatunnel.Seatunnel.run(Seatunnel.java:48)
        at org.apache.seatunnel.SeatunnelSpark.main(SeatunnelSpark.java:27)
        at sun.reflect.NativeMethodAccessorImpl.invoke0(Native Method)
        at 
sun.reflect.NativeMethodAccessorImpl.invoke(NativeMethodAccessorImpl.java:62)
        at 
sun.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorImpl.java:43)
        at java.lang.reflect.Method.invoke(Method.java:498)
        at 
org.apache.spark.deploy.yarn.ApplicationMaster$$anon$2.run(ApplicationMaster.scala:685)
   ```
   
   
   ### Flink or Spark Version
   
   _No response_
   
   ### Java or Scala Version
   
   _No response_
   
   ### Screenshots
   
   
![image](https://user-images.githubusercontent.com/70148413/165090272-cece166c-61cc-401c-82f3-dd301627c1de.png)
   it can not get file so ERROR seatunnel.Seatunnel: Reason:No configuration 
setting found for key 'env' 
   
   ### Are you willing to submit PR?
   
   - [X] Yes I am willing to submit a PR!
   
   ### Code of Conduct
   
   - [X] I agree to follow this project's [Code of 
Conduct](https://www.apache.org/foundation/policies/conduct)
   


-- 
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.

To unsubscribe, e-mail: [email protected]

For queries about this service, please contact Infrastructure at:
[email protected]

Reply via email to