yihui8776 commented on issue #2493: URL: https://github.com/apache/incubator-seatunnel/issues/2493#issuecomment-1225462128
stderr is Launch Command: "/usr/lib/jvm/java-1.8-openjdk/jre/bin/java" "-cp" "/spark/conf/:/spark/jars/*" "-Xmx1024M" "-Dspark.driver.supervise=false" "-Dspark.submit.deployMode=cluster" "-Dspark.master=spark://spark-master:7077" "-Dspark.executor.extraJavaOptions=" "-Dspark.files=file:///apache-seatunnel-incubating-2.1.0/config/application.conf,file:///seatunnel/plugins.tar.gz" "-Dspark.jars=file:///seatunnel/lib/seatunnel-core-flink.jar,file:///seatunnel/lib/seatunnel-core-spark.jar,file:///seatunnel/lib/seatunnel-core-sql-2.1.0-2.11.8.jar,file:/seatunnel/lib/seatunnel-core-spark.jar" "-Dspark.rpc.askTimeout=10s" "-Dspark.app.name=seatunnel" "-Dspark.driver.extraJavaOptions=" "org.apache.spark.deploy.worker.DriverWrapper" "spark://[email protected]:45811" "/spark/work/driver-20220824090534-0015/seatunnel-core-spark.jar" "org.apache.seatunnel.SeatunnelSpark" "--master" "spark://spark-master:7077" "--deploy-mode" "cluster" "--config" "./config/application.conf" ======================================== log4j:WARN No appenders could be found for logger (org.apache.hadoop.metrics2.lib.MutableMetricsFactory). log4j:WARN Please initialize the log4j system properly. log4j:WARN See http://logging.apache.org/log4j/1.2/faq.html#noconfig for more info. Using Spark's default log4j profile: org/apache/spark/log4j-defaults.properties 22/08/24 09:05:35 INFO SecurityManager: Changing view acls to: root 22/08/24 09:05:35 INFO SecurityManager: Changing modify acls to: root 22/08/24 09:05:35 INFO SecurityManager: Changing view acls groups to: 22/08/24 09:05:35 INFO SecurityManager: Changing modify acls groups to: 22/08/24 09:05:35 INFO SecurityManager: SecurityManager: authentication disabled; ui acls disabled; users with view permissions: Set(root); groups with view permissions: Set(); users with modify permissions: Set(root); groups with modify permissions: Set() 22/08/24 09:05:36 INFO Utils: Successfully started service 'Driver' on port 46367. 22/08/24 09:05:36 INFO DriverWrapper: Driver address: 172.23.0.3:46367 22/08/24 09:05:36 INFO WorkerWatcher: Connecting to worker spark://[email protected]:45811 22/08/24 09:05:36 INFO SecurityManager: Changing view acls to: root 22/08/24 09:05:36 INFO SecurityManager: Changing modify acls to: root 22/08/24 09:05:36 INFO SecurityManager: Changing view acls groups to: 22/08/24 09:05:36 INFO SecurityManager: Changing modify acls groups to: 22/08/24 09:05:36 INFO SecurityManager: SecurityManager: authentication disabled; ui acls disabled; users with view permissions: Set(root); groups with view permissions: Set(); users with modify permissions: Set(root); groups with modify permissions: Set() 22/08/24 09:05:36 INFO TransportClientFactory: Successfully created connection to /172.23.0.3:45811 after 25 ms (0 ms spent in bootstraps) 22/08/24 09:05:36 INFO WorkerWatcher: Successfully connected to spark://[email protected]:45811 22/08/24 09:05:36 INFO ConfigBuilder: Loading config file: application.conf 22/08/24 09:05:36 INFO ConfigBuilder: parsed config file: {} 22/08/24 09:05:36 ERROR Seatunnel: =============================================================================== 22/08/24 09:05:36 ERROR Seatunnel: Fatal Error, 22/08/24 09:05:36 ERROR Seatunnel: Please submit bug report in https://github.com/apache/incubator-seatunnel/issues 22/08/24 09:05:36 ERROR Seatunnel: Reason:No configuration setting found for key 'env' 22/08/24 09:05:36 ERROR Seatunnel: Exception StackTrace:org.apache.seatunnel.shade.com.typesafe.config.ConfigException$Missing: No configuration setting found for key 'env' at org.apache.seatunnel.shade.com.typesafe.config.impl.SimpleConfig.findKeyOrNull(SimpleConfig.java:156) at org.apache.seatunnel.shade.com.typesafe.config.impl.SimpleConfig.findOrNull(SimpleConfig.java:174) at org.apache.seatunnel.shade.com.typesafe.config.impl.SimpleConfig.find(SimpleConfig.java:188) at org.apache.seatunnel.shade.com.typesafe.config.impl.SimpleConfig.find(SimpleConfig.java:193) at org.apache.seatunnel.shade.com.typesafe.config.impl.SimpleConfig.getObject(SimpleConfig.java:268) at org.apache.seatunnel.shade.com.typesafe.config.impl.SimpleConfig.getConfig(SimpleConfig.java:274) at org.apache.seatunnel.shade.com.typesafe.config.impl.SimpleConfig.getConfig(SimpleConfig.java:41) at org.apache.seatunnel.config.ConfigBuilder.createEnv(ConfigBuilder.java:182) at org.apache.seatunnel.config.ConfigBuilder.<init>(ConfigBuilder.java:66) at org.apache.seatunnel.Seatunnel.entryPoint(Seatunnel.java:98) at org.apache.seatunnel.Seatunnel.run(Seatunnel.java:65) at org.apache.seatunnel.SeatunnelSpark.main(SeatunnelSpark.java:29) at sun.reflect.NativeMethodAccessorImpl.invoke0(Native Method) at sun.reflect.NativeMethodAccessorImpl.invoke(NativeMethodAccessorImpl.java:62) at sun.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorImpl.java:43) at java.lang.reflect.Method.invoke(Method.java:498) at org.apache.spark.deploy.worker.DriverWrapper$.main(DriverWrapper.scala:65) at org.apache.spark.deploy.worker.DriverWrapper.main(DriverWrapper.scala) 22/08/24 09:05:36 ERROR Seatunnel: =============================================================================== Exception in thread "main" java.lang.reflect.InvocationTargetException at sun.reflect.NativeMethodAccessorImpl.invoke0(Native Method) at sun.reflect.NativeMethodAccessorImpl.invoke(NativeMethodAccessorImpl.java:62) at sun.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorImpl.java:43) at java.lang.reflect.Method.invoke(Method.java:498) at org.apache.spark.deploy.worker.DriverWrapper$.main(DriverWrapper.scala:65) at org.apache.spark.deploy.worker.DriverWrapper.main(DriverWrapper.scala) Caused by: org.apache.seatunnel.shade.com.typesafe.config.ConfigException$Missing: No configuration setting found for key 'env' at org.apache.seatunnel.shade.com.typesafe.config.impl.SimpleConfig.findKeyOrNull(SimpleConfig.java:156) at org.apache.seatunnel.shade.com.typesafe.config.impl.SimpleConfig.findOrNull(SimpleConfig.java:174) at org.apache.seatunnel.shade.com.typesafe.config.impl.SimpleConfig.find(SimpleConfig.java:188) at org.apache.seatunnel.shade.com.typesafe.config.impl.SimpleConfig.find(SimpleConfig.java:193) at org.apache.seatunnel.shade.com.typesafe.config.impl.SimpleConfig.getObject(SimpleConfig.java:268) at org.apache.seatunnel.shade.com.typesafe.config.impl.SimpleConfig.getConfig(SimpleConfig.java:274) at org.apache.seatunnel.shade.com.typesafe.config.impl.SimpleConfig.getConfig(SimpleConfig.java:41) at org.apache.seatunnel.config.ConfigBuilder.createEnv(ConfigBuilder.java:182) at org.apache.seatunnel.config.ConfigBuilder.<init>(ConfigBuilder.java:66) at org.apache.seatunnel.Seatunnel.entryPoint(Seatunnel.java:98) at org.apache.seatunnel.Seatunnel.run(Seatunnel.java:65) at org.apache.seatunnel.SeatunnelSpark.main(SeatunnelSpark.java:29) ... 6 more 22/08/24 09:05:36 INFO ShutdownHookManager: Shutdown hook called 22/08/24 09:05:36 INFO ShutdownHookManager: Deleting directory /tmp/spark-85e93752-9f36-4704-805d-068f6fceed62 > `22/08/22 07:13:29 INFO ClientEndpoint: State of driver-20220822071324-0004 is FAILED` The driver log didn't display, please check your log config to make sure driver log can be display, then we will know what's problem. stderr is Launch Command: "/usr/lib/jvm/java-1.8-openjdk/jre/bin/java" "-cp" "/spark/conf/:/spark/jars/*" "-Xmx1024M" "-Dspark.driver.supervise=false" "-Dspark.submit.deployMode=cluster" "-Dspark.master=spark://spark-master:7077" "-Dspark.executor.extraJavaOptions=" "-Dspark.files=file:///apache-seatunnel-incubating-2.1.0/config/application.conf,file:///seatunnel/plugins.tar.gz" "-Dspark.jars=file:///seatunnel/lib/seatunnel-core-flink.jar,file:///seatunnel/lib/seatunnel-core-spark.jar,file:///seatunnel/lib/seatunnel-core-sql-2.1.0-2.11.8.jar,file:/seatunnel/lib/seatunnel-core-spark.jar" "-Dspark.rpc.askTimeout=10s" "-Dspark.app.name=seatunnel" "-Dspark.driver.extraJavaOptions=" "org.apache.spark.deploy.worker.DriverWrapper" "spark://[email protected]:45811" "/spark/work/driver-20220824090534-0015/seatunnel-core-spark.jar" "org.apache.seatunnel.SeatunnelSpark" "--master" "spark://spark-master:7077" "--deploy-mode" "cluster" "--config" "./config/application.conf" ======================================== log4j:WARN No appenders could be found for logger (org.apache.hadoop.metrics2.lib.MutableMetricsFactory). log4j:WARN Please initialize the log4j system properly. log4j:WARN See http://logging.apache.org/log4j/1.2/faq.html#noconfig for more info. Using Spark's default log4j profile: org/apache/spark/log4j-defaults.properties 22/08/24 09:05:35 INFO SecurityManager: Changing view acls to: root 22/08/24 09:05:35 INFO SecurityManager: Changing modify acls to: root 22/08/24 09:05:35 INFO SecurityManager: Changing view acls groups to: 22/08/24 09:05:35 INFO SecurityManager: Changing modify acls groups to: 22/08/24 09:05:35 INFO SecurityManager: SecurityManager: authentication disabled; ui acls disabled; users with view permissions: Set(root); groups with view permissions: Set(); users with modify permissions: Set(root); groups with modify permissions: Set() 22/08/24 09:05:36 INFO Utils: Successfully started service 'Driver' on port 46367. 22/08/24 09:05:36 INFO DriverWrapper: Driver address: 172.23.0.3:46367 22/08/24 09:05:36 INFO WorkerWatcher: Connecting to worker spark://[email protected]:45811 22/08/24 09:05:36 INFO SecurityManager: Changing view acls to: root 22/08/24 09:05:36 INFO SecurityManager: Changing modify acls to: root 22/08/24 09:05:36 INFO SecurityManager: Changing view acls groups to: 22/08/24 09:05:36 INFO SecurityManager: Changing modify acls groups to: 22/08/24 09:05:36 INFO SecurityManager: SecurityManager: authentication disabled; ui acls disabled; users with view permissions: Set(root); groups with view permissions: Set(); users with modify permissions: Set(root); groups with modify permissions: Set() 22/08/24 09:05:36 INFO TransportClientFactory: Successfully created connection to /172.23.0.3:45811 after 25 ms (0 ms spent in bootstraps) 22/08/24 09:05:36 INFO WorkerWatcher: Successfully connected to spark://[email protected]:45811 22/08/24 09:05:36 INFO ConfigBuilder: Loading config file: application.conf 22/08/24 09:05:36 INFO ConfigBuilder: parsed config file: {} 22/08/24 09:05:36 ERROR Seatunnel: =============================================================================== 22/08/24 09:05:36 ERROR Seatunnel: Fatal Error, 22/08/24 09:05:36 ERROR Seatunnel: Please submit bug report in https://github.com/apache/incubator-seatunnel/issues 22/08/24 09:05:36 ERROR Seatunnel: Reason:No configuration setting found for key 'env' 22/08/24 09:05:36 ERROR Seatunnel: Exception StackTrace:org.apache.seatunnel.shade.com.typesafe.config.ConfigException$Missing: No configuration setting found for key 'env' at org.apache.seatunnel.shade.com.typesafe.config.impl.SimpleConfig.findKeyOrNull(SimpleConfig.java:156) at org.apache.seatunnel.shade.com.typesafe.config.impl.SimpleConfig.findOrNull(SimpleConfig.java:174) at org.apache.seatunnel.shade.com.typesafe.config.impl.SimpleConfig.find(SimpleConfig.java:188) at org.apache.seatunnel.shade.com.typesafe.config.impl.SimpleConfig.find(SimpleConfig.java:193) at org.apache.seatunnel.shade.com.typesafe.config.impl.SimpleConfig.getObject(SimpleConfig.java:268) at org.apache.seatunnel.shade.com.typesafe.config.impl.SimpleConfig.getConfig(SimpleConfig.java:274) at org.apache.seatunnel.shade.com.typesafe.config.impl.SimpleConfig.getConfig(SimpleConfig.java:41) at org.apache.seatunnel.config.ConfigBuilder.createEnv(ConfigBuilder.java:182) at org.apache.seatunnel.config.ConfigBuilder.<init>(ConfigBuilder.java:66) at org.apache.seatunnel.Seatunnel.entryPoint(Seatunnel.java:98) at org.apache.seatunnel.Seatunnel.run(Seatunnel.java:65) at org.apache.seatunnel.SeatunnelSpark.main(SeatunnelSpark.java:29) at sun.reflect.NativeMethodAccessorImpl.invoke0(Native Method) at sun.reflect.NativeMethodAccessorImpl.invoke(NativeMethodAccessorImpl.java:62) at sun.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorImpl.java:43) at java.lang.reflect.Method.invoke(Method.java:498) at org.apache.spark.deploy.worker.DriverWrapper$.main(DriverWrapper.scala:65) at org.apache.spark.deploy.worker.DriverWrapper.main(DriverWrapper.scala) 22/08/24 09:05:36 ERROR Seatunnel: =============================================================================== Exception in thread "main" java.lang.reflect.InvocationTargetException at sun.reflect.NativeMethodAccessorImpl.invoke0(Native Method) at sun.reflect.NativeMethodAccessorImpl.invoke(NativeMethodAccessorImpl.java:62) at sun.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorImpl.java:43) at java.lang.reflect.Method.invoke(Method.java:498) at org.apache.spark.deploy.worker.DriverWrapper$.main(DriverWrapper.scala:65) at org.apache.spark.deploy.worker.DriverWrapper.main(DriverWrapper.scala) Caused by: org.apache.seatunnel.shade.com.typesafe.config.ConfigException$Missing: No configuration setting found for key 'env' at org.apache.seatunnel.shade.com.typesafe.config.impl.SimpleConfig.findKeyOrNull(SimpleConfig.java:156) at org.apache.seatunnel.shade.com.typesafe.config.impl.SimpleConfig.findOrNull(SimpleConfig.java:174) at org.apache.seatunnel.shade.com.typesafe.config.impl.SimpleConfig.find(SimpleConfig.java:188) at org.apache.seatunnel.shade.com.typesafe.config.impl.SimpleConfig.find(SimpleConfig.java:193) at org.apache.seatunnel.shade.com.typesafe.config.impl.SimpleConfig.getObject(SimpleConfig.java:268) at org.apache.seatunnel.shade.com.typesafe.config.impl.SimpleConfig.getConfig(SimpleConfig.java:274) at org.apache.seatunnel.shade.com.typesafe.config.impl.SimpleConfig.getConfig(SimpleConfig.java:41) at org.apache.seatunnel.config.ConfigBuilder.createEnv(ConfigBuilder.java:182) at org.apache.seatunnel.config.ConfigBuilder.<init>(ConfigBuilder.java:66) at org.apache.seatunnel.Seatunnel.entryPoint(Seatunnel.java:98) at org.apache.seatunnel.Seatunnel.run(Seatunnel.java:65) at org.apache.seatunnel.SeatunnelSpark.main(SeatunnelSpark.java:29) ... 6 more 22/08/24 09:05:36 INFO ShutdownHookManager: Shutdown hook called 22/08/24 09:05:36 INFO ShutdownHookManager: Deleting directory /tmp/spark-85e93752-9f36-4704-805d-068f6fceed62 -- This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use the URL above to go to the specific comment. To unsubscribe, e-mail: [email protected] For queries about this service, please contact Infrastructure at: [email protected]
