hit-lacus commented on issue #1166: Prepare DebugTomcat and Integration Test in Hadoop3 Env URL: https://github.com/apache/kylin/pull/1166#issuecomment-605395132 #### BuildWithSpark Error - Output of Kylin side Code ``` 2020-03-28T12:45:48,280 INFO [pool-15-thread-1] spark.SparkExecutable:41 : 20/03/28 12:45:48 ERROR SparkContext: Error initializing SparkContext. 2020-03-28T12:45:48,281 INFO [pool-15-thread-1] spark.SparkExecutable:41 : org.apache.spark.SparkException: Yarn application has already ended! It might have been killed or unable to launch application master. 2020-03-28T12:45:48,281 INFO [pool-15-thread-1] spark.SparkExecutable:41 : at org.apache.spark.scheduler.cluster.YarnClientSchedulerBackend.waitForApplication(YarnClientSchedulerBackend.scala:89) 2020-03-28T12:45:48,281 INFO [pool-15-thread-1] spark.SparkExecutable:41 : at org.apache.spark.scheduler.cluster.YarnClientSchedulerBackend.start(YarnClientSchedulerBackend.scala:63) 2020-03-28T12:45:48,281 INFO [pool-15-thread-1] spark.SparkExecutable:41 : at org.apache.spark.scheduler.TaskSchedulerImpl.start(TaskSchedulerImpl.scala:164) 2020-03-28T12:45:48,281 INFO [pool-15-thread-1] spark.SparkExecutable:41 : at org.apache.spark.SparkContext.<init>(SparkContext.scala:500) 2020-03-28T12:45:48,281 INFO [pool-15-thread-1] spark.SparkExecutable:41 : at org.apache.spark.api.java.JavaSparkContext.<init>(JavaSparkContext.scala:58) 2020-03-28T12:45:48,281 INFO [pool-15-thread-1] spark.SparkExecutable:41 : at org.apache.kylin.engine.spark.SparkCubingByLayer.execute(SparkCubingByLayer.java:130) 2020-03-28T12:45:48,281 INFO [pool-15-thread-1] spark.SparkExecutable:41 : at org.apache.kylin.common.util.AbstractApplication.execute(AbstractApplication.java:37) 2020-03-28T12:45:48,282 INFO [pool-15-thread-1] spark.SparkExecutable:41 : at org.apache.kylin.common.util.SparkEntry.main(SparkEntry.java:44) 2020-03-28T12:45:48,282 INFO [pool-15-thread-1] spark.SparkExecutable:41 : at sun.reflect.NativeMethodAccessorImpl.invoke0(Native Method) 2020-03-28T12:45:48,282 INFO [pool-15-thread-1] spark.SparkExecutable:41 : at sun.reflect.NativeMethodAccessorImpl.invoke(NativeMethodAccessorImpl.java:62) 2020-03-28T12:45:48,282 INFO [pool-15-thread-1] spark.SparkExecutable:41 : at sun.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorImpl.java:43) 2020-03-28T12:45:48,282 INFO [pool-15-thread-1] spark.SparkExecutable:41 : at java.lang.reflect.Method.invoke(Method.java:498) 2020-03-28T12:45:48,282 INFO [pool-15-thread-1] spark.SparkExecutable:41 : at org.apache.spark.deploy.JavaMainApplication.start(SparkApplication.scala:52) 2020-03-28T12:45:48,282 INFO [pool-15-thread-1] spark.SparkExecutable:41 : at org.apache.spark.deploy.SparkSubmit$.org$apache$spark$deploy$SparkSubmit$$runMain(SparkSubmit.scala:894) 2020-03-28T12:45:48,283 INFO [pool-15-thread-1] spark.SparkExecutable:41 : at org.apache.spark.deploy.SparkSubmit$.doRunMain$1(SparkSubmit.scala:198) 2020-03-28T12:45:48,283 INFO [pool-15-thread-1] spark.SparkExecutable:41 : at org.apache.spark.deploy.SparkSubmit$.submit(SparkSubmit.scala:228) 2020-03-28T12:45:48,283 INFO [pool-15-thread-1] spark.SparkExecutable:41 : at org.apache.spark.deploy.SparkSubmit$.main(SparkSubmit.scala:137) 2020-03-28T12:45:48,283 INFO [pool-15-thread-1] spark.SparkExecutable:41 : at org.apache.spark.deploy.SparkSubmit.main(SparkSubmit.scala) ``` - yarn logs ```sh Application application_1585367998531_0005 failed 2 times due to AM Container for appattempt_1585367998531_0005_000002 exited with exitCode: 13 Failing this attempt.Diagnostics: [2020-03-28 04:45:47.339]Exception from container-launch. Container id: container_e08_1585367998531_0005_02_000001 Exit code: 13 [2020-03-28 04:45:47.342]Container exited with a non-zero exit code 13. Error file: prelaunch.err. Last 4096 bytes of prelaunch.err : Last 4096 bytes of stderr : rying ... 20/03/28 04:45:44 ERROR ApplicationMaster: Failed to connect to driver at mbp-kyligence:57068, retrying ... 20/03/28 04:45:44 ERROR ApplicationMaster: Failed to connect to driver at mbp-kyligence:57068, retrying ... 20/03/28 04:45:44 ERROR ApplicationMaster: Failed to connect to driver at mbp-kyligence:57068, retrying ... 20/03/28 04:45:45 ERROR ApplicationMaster: Failed to connect to driver at mbp-kyligence:57068, retrying ... 20/03/28 04:45:45 ERROR ApplicationMaster: Failed to connect to driver at mbp-kyligence:57068, retrying ... 20/03/28 04:45:45 ERROR ApplicationMaster: Failed to connect to driver at mbp-kyligence:57068, retrying ... 20/03/28 04:45:45 ERROR ApplicationMaster: Failed to connect to driver at mbp-kyligence:57068, retrying ... 20/03/28 04:45:45 ERROR ApplicationMaster: Failed to connect to driver at mbp-kyligence:57068, retrying ... 20/03/28 04:45:45 ERROR ApplicationMaster: Failed to connect to driver at mbp-kyligence:57068, retrying ... 20/03/28 04:45:45 ERROR ApplicationMaster: Failed to connect to driver at mbp-kyligence:57068, retrying ... 20/03/28 04:45:45 ERROR ApplicationMaster: Failed to connect to driver at mbp-kyligence:57068, retrying ... 20/03/28 04:45:45 ERROR ApplicationMaster: Failed to connect to driver at mbp-kyligence:57068, retrying ... 20/03/28 04:45:45 ERROR ApplicationMaster: Failed to connect to driver at mbp-kyligence:57068, retrying ... 20/03/28 04:45:46 ERROR ApplicationMaster: Failed to connect to driver at mbp-kyligence:57068, retrying ... 20/03/28 04:45:46 ERROR ApplicationMaster: Failed to connect to driver at mbp-kyligence:57068, retrying ... 20/03/28 04:45:46 ERROR ApplicationMaster: Failed to connect to driver at mbp-kyligence:57068, retrying ... 20/03/28 04:45:46 ERROR ApplicationMaster: Failed to connect to driver at mbp-kyligence:57068, retrying ... 20/03/28 04:45:46 ERROR ApplicationMaster: Failed to connect to driver at mbp-kyligence:57068, retrying ... 20/03/28 04:45:46 ERROR ApplicationMaster: Failed to connect to driver at mbp-kyligence:57068, retrying ... 20/03/28 04:45:46 ERROR ApplicationMaster: Failed to connect to driver at mbp-kyligence:57068, retrying ... 20/03/28 04:45:46 ERROR ApplicationMaster: Failed to connect to driver at mbp-kyligence:57068, retrying ... 20/03/28 04:45:46 ERROR ApplicationMaster: Failed to connect to driver at mbp-kyligence:57068, retrying ... ```
---------------------------------------------------------------- This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use the URL above to go to the specific comment. For queries about this service, please contact Infrastructure at: us...@infra.apache.org With regards, Apache Git Services
