[GitHub] [kylin] hit-lacus commented on issue #1166: Prepare DebugTomcat and Integration Test in Hadoop3 Env
hit-lacus commented on issue #1166: Prepare DebugTomcat and Integration Test in
Hadoop3 Env
URL: https://github.com/apache/kylin/pull/1166#issuecomment-605395132
BuildWithSpark Error
- Output of Kylin side Code
```
2020-03-28T12:45:48,280 INFO [pool-15-thread-1] spark.SparkExecutable:41 :
20/03/28 12:45:48 ERROR SparkContext: Error initializing SparkContext.
2020-03-28T12:45:48,281 INFO [pool-15-thread-1] spark.SparkExecutable:41 :
org.apache.spark.SparkException: Yarn application has already ended! It might
have been killed or unable to launch application master.
2020-03-28T12:45:48,281 INFO [pool-15-thread-1] spark.SparkExecutable:41 :
at
org.apache.spark.scheduler.cluster.YarnClientSchedulerBackend.waitForApplication(YarnClientSchedulerBackend.scala:89)
2020-03-28T12:45:48,281 INFO [pool-15-thread-1] spark.SparkExecutable:41 :
at
org.apache.spark.scheduler.cluster.YarnClientSchedulerBackend.start(YarnClientSchedulerBackend.scala:63)
2020-03-28T12:45:48,281 INFO [pool-15-thread-1] spark.SparkExecutable:41 :
at
org.apache.spark.scheduler.TaskSchedulerImpl.start(TaskSchedulerImpl.scala:164)
2020-03-28T12:45:48,281 INFO [pool-15-thread-1] spark.SparkExecutable:41 :
at org.apache.spark.SparkContext.(SparkContext.scala:500)
2020-03-28T12:45:48,281 INFO [pool-15-thread-1] spark.SparkExecutable:41 :
at org.apache.spark.api.java.JavaSparkContext.(JavaSparkContext.scala:58)
2020-03-28T12:45:48,281 INFO [pool-15-thread-1] spark.SparkExecutable:41 :
at
org.apache.kylin.engine.spark.SparkCubingByLayer.execute(SparkCubingByLayer.java:130)
2020-03-28T12:45:48,281 INFO [pool-15-thread-1] spark.SparkExecutable:41 :
at
org.apache.kylin.common.util.AbstractApplication.execute(AbstractApplication.java:37)
2020-03-28T12:45:48,282 INFO [pool-15-thread-1] spark.SparkExecutable:41 :
at org.apache.kylin.common.util.SparkEntry.main(SparkEntry.java:44)
2020-03-28T12:45:48,282 INFO [pool-15-thread-1] spark.SparkExecutable:41 :
at sun.reflect.NativeMethodAccessorImpl.invoke0(Native Method)
2020-03-28T12:45:48,282 INFO [pool-15-thread-1] spark.SparkExecutable:41 :
at sun.reflect.NativeMethodAccessorImpl.invoke(NativeMethodAccessorImpl.java:62)
2020-03-28T12:45:48,282 INFO [pool-15-thread-1] spark.SparkExecutable:41 :
at
sun.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorImpl.java:43)
2020-03-28T12:45:48,282 INFO [pool-15-thread-1] spark.SparkExecutable:41 :
at java.lang.reflect.Method.invoke(Method.java:498)
2020-03-28T12:45:48,282 INFO [pool-15-thread-1] spark.SparkExecutable:41 :
at org.apache.spark.deploy.JavaMainApplication.start(SparkApplication.scala:52)
2020-03-28T12:45:48,282 INFO [pool-15-thread-1] spark.SparkExecutable:41 :
at
org.apache.spark.deploy.SparkSubmit$.org$apache$spark$deploy$SparkSubmit$$runMain(SparkSubmit.scala:894)
2020-03-28T12:45:48,283 INFO [pool-15-thread-1] spark.SparkExecutable:41 :
at org.apache.spark.deploy.SparkSubmit$.doRunMain$1(SparkSubmit.scala:198)
2020-03-28T12:45:48,283 INFO [pool-15-thread-1] spark.SparkExecutable:41 :
at org.apache.spark.deploy.SparkSubmit$.submit(SparkSubmit.scala:228)
2020-03-28T12:45:48,283 INFO [pool-15-thread-1] spark.SparkExecutable:41 :
at org.apache.spark.deploy.SparkSubmit$.main(SparkSubmit.scala:137)
2020-03-28T12:45:48,283 INFO [pool-15-thread-1] spark.SparkExecutable:41 :
at org.apache.spark.deploy.SparkSubmit.main(SparkSubmit.scala)
```
- yarn logs
```sh
Application application_1585367998531_0005 failed 2 times due to AM
Container for appattempt_1585367998531_0005_02 exited with exitCode: 13
Failing this attempt.Diagnostics: [2020-03-28 04:45:47.339]Exception from
container-launch.
Container id: container_e08_1585367998531_0005_02_01
Exit code: 13
[2020-03-28 04:45:47.342]Container exited with a non-zero exit code 13.
Error file: prelaunch.err.
Last 4096 bytes of prelaunch.err :
Last 4096 bytes of stderr :
rying ...
20/03/28 04:45:44 ERROR ApplicationMaster: Failed to connect to driver at
mbp-kyligence:57068, retrying ...
20/03/28 04:45:44 ERROR ApplicationMaster: Failed to connect to driver at
mbp-kyligence:57068, retrying ...
20/03/28 04:45:44 ERROR ApplicationMaster: Failed to connect to driver at
mbp-kyligence:57068, retrying ...
20/03/28 04:45:45 ERROR ApplicationMaster: Failed to connect to driver at
mbp-kyligence:57068, retrying ...
20/03/28 04:45:45 ERROR ApplicationMaster: Failed to connect to driver at
mbp-kyligence:57068, retrying ...
20/03/28 04:45:45 ERROR ApplicationMaster: Failed to connect to driver at
mbp-kyligence:57068, retrying ...
20/03/28 04:45:45 ERROR ApplicationMaster: Failed to connect to driver at
mbp-kyligence:57068, retrying ...
20/03/28 04:45:45 ERROR ApplicationMaster: Failed to connect to driver at
mbp-kyligence:57068, retrying ...
20/03/28 04:45:45 ERROR ApplicationMaster: Failed
[GitHub] [kylin] hit-lacus commented on issue #1166: Prepare DebugTomcat and Integration Test in Hadoop3 Env
hit-lacus commented on issue #1166: Prepare DebugTomcat and Integration Test in Hadoop3 Env URL: https://github.com/apache/kylin/pull/1166#issuecomment-604253631 ## Trouble Shotting ```sh ``` This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use the URL above to go to the specific comment. For queries about this service, please contact Infrastructure at: us...@infra.apache.org With regards, Apache Git Services
[GitHub] [kylin] hit-lacus commented on issue #1166: Prepare DebugTomcat and Integration Test in Hadoop3 Env
hit-lacus commented on issue #1166: Prepare DebugTomcat and Integration Test in Hadoop3 Env URL: https://github.com/apache/kylin/pull/1166#issuecomment-604206262 //TODO This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use the URL above to go to the specific comment. For queries about this service, please contact Infrastructure at: us...@infra.apache.org With regards, Apache Git Services
[GitHub] [kylin] hit-lacus commented on issue #1166: Prepare DebugTomcat and Integration Test in Hadoop3 Env
hit-lacus commented on issue #1166: Prepare DebugTomcat and Integration Test in
Hadoop3 Env
URL: https://github.com/apache/kylin/pull/1166#issuecomment-604206291
# Discussion
### Why use docker other than vm?
### Why choosing this HDP3 docker image, why not use a small and custom one?
Following is the pros and cons of why I choose this HDP3 docker image:
Pros
- It is the only all-in-one official(for official, I means **hortonworks**
and **cloudera**) Hadoop3 docker image I could find, I think it should be
well-test by **hortonworks** teams.
- Custom hadoop docker may lack (compared to HDP image):
- Easy service monitor
- Easy configuration modify
- Standard hadoop layout (meet the convention)
- More mature combination
Cons
- The image is really big(27 GB), it not easy to download or
distribute/share it.
- Docker may has some unexpected problems which is annoying, but I will do
my best to document them.
Plan
I will try reduce its size after everything is done.
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.
For queries about this service, please contact Infrastructure at:
us...@infra.apache.org
With regards,
Apache Git Services
[GitHub] [kylin] hit-lacus commented on issue #1166: Prepare DebugTomcat and Integration Test in Hadoop3 Env
hit-lacus commented on issue #1166: Prepare DebugTomcat and Integration Test in Hadoop3 Env URL: https://github.com/apache/kylin/pull/1166#issuecomment-603287165 faq This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use the URL above to go to the specific comment. For queries about this service, please contact Infrastructure at: us...@infra.apache.org With regards, Apache Git Services
[GitHub] [kylin] hit-lacus commented on issue #1166: Prepare DebugTomcat and Integration Test in Hadoop3 Env
hit-lacus commented on issue #1166: Prepare DebugTomcat and Integration Test in Hadoop3 Env URL: https://github.com/apache/kylin/pull/1166#issuecomment-603286983 ## Running Integration Test in Laptop [mvn verify] This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use the URL above to go to the specific comment. For queries about this service, please contact Infrastructure at: us...@infra.apache.org With regards, Apache Git Services
[GitHub] [kylin] hit-lacus commented on issue #1166: Prepare DebugTomcat and Integration Test in Hadoop3 Env
hit-lacus commented on issue #1166: Prepare DebugTomcat and Integration Test in Hadoop3 Env URL: https://github.com/apache/kylin/pull/1166#issuecomment-603287094 todo This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use the URL above to go to the specific comment. For queries about this service, please contact Infrastructure at: us...@infra.apache.org With regards, Apache Git Services
[GitHub] [kylin] hit-lacus commented on issue #1166: Prepare DebugTomcat and Integration Test in Hadoop3 Env
hit-lacus commented on issue #1166: Prepare DebugTomcat and Integration Test in Hadoop3 Env URL: https://github.com/apache/kylin/pull/1166#issuecomment-603282888 ## Running Integration Test in Laptop (Kafka Source) This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use the URL above to go to the specific comment. For queries about this service, please contact Infrastructure at: us...@infra.apache.org With regards, Apache Git Services
[GitHub] [kylin] hit-lacus commented on issue #1166: Prepare DebugTomcat and Integration Test in Hadoop3 Env
hit-lacus commented on issue #1166: Prepare DebugTomcat and Integration Test in Hadoop3 Env URL: https://github.com/apache/kylin/pull/1166#issuecomment-603281107 ## Running Integration Test in Laptop (Hive Source)  This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use the URL above to go to the specific comment. For queries about this service, please contact Infrastructure at: us...@infra.apache.org With regards, Apache Git Services
[GitHub] [kylin] hit-lacus commented on issue #1166: Prepare DebugTomcat and Integration Test in Hadoop3 Env
hit-lacus commented on issue #1166: Prepare DebugTomcat and Integration Test in Hadoop3 Env URL: https://github.com/apache/kylin/pull/1166#issuecomment-603271789 ## DebugTomcat No need for other change, use the old way. https://user-images.githubusercontent.com/14030549/77436440-7806b080-6e1e-11ea-9287-02ba6476c7f7.png;> This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use the URL above to go to the specific comment. For queries about this service, please contact Infrastructure at: us...@infra.apache.org With regards, Apache Git Services
[GitHub] [kylin] hit-lacus commented on issue #1166: Prepare DebugTomcat and Integration Test in Hadoop3 Env
hit-lacus commented on issue #1166: Prepare DebugTomcat and Integration Test in Hadoop3 Env URL: https://github.com/apache/kylin/pull/1166#issuecomment-603251050 ## Prepare Spark > If you not interested in Spark Cubing, you may consider skip this part. Please download spark binary and decompress it into somewhere of your laptop, I think spark2.3 should works, what is choose is **spark-2.3.2-bin-hadoop2.7** . After that, please set some sytem env in `~/.zshrc` or `~/.bashrc`. , depending on which shell you are using. ```sh export SPARK_HOME=/Users/XXX/Lab/laucs-libs/spark-2.3.2-bin-hadoop2.7 export HADOOP_CONF_DIR=/Users/XXX/IntelliJ_IDEA_Project/MyKylinHadoop3/examples/test_case_data/sandbox export HADOOP_USER_NAME=root ``` This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use the URL above to go to the specific comment. For queries about this service, please contact Infrastructure at: us...@infra.apache.org With regards, Apache Git Services
[GitHub] [kylin] hit-lacus commented on issue #1166: Prepare DebugTomcat and Integration Test in Hadoop3 Env
hit-lacus commented on issue #1166: Prepare DebugTomcat and Integration Test in Hadoop3 Env URL: https://github.com/apache/kylin/pull/1166#issuecomment-603229123 ### Check Ambari Web UI Wait about two minutes, you can check sandbox-hdp.hortonworks.com:8080 in your laptap. But wait here, you cannot login via `admin`/`admin`. You have to reset the password too by the following command. ```sh [root@sandbox-hdp /] ambari-admin-password-reset ``` If you cannot visit that page, please login to container and execute `ambari-server status` to find why ambari-server failed to start and listen on port 8080. ### Configure Ambari This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use the URL above to go to the specific comment. For queries about this service, please contact Infrastructure at: us...@infra.apache.org With regards, Apache Git Services
[GitHub] [kylin] hit-lacus commented on issue #1166: Prepare DebugTomcat and Integration Test in Hadoop3 Env
hit-lacus commented on issue #1166: Prepare DebugTomcat and Integration Test in Hadoop3 Env URL: https://github.com/apache/kylin/pull/1166#issuecomment-603216501 # Prepare Env ```sh [root@docker-node ~]# docker version Client: Docker Engine - Community Version: 19.03.8 API version: 1.40 Go version:go1.12.17 Git commit:afacb8b Built: Wed Mar 11 01:27:04 2020 OS/Arch: linux/amd64 Experimental: false Server: Docker Engine - Community Engine: Version: 19.03.8 API version: 1.40 (minimum version 1.12) Go version: go1.12.17 Git commit: afacb8b Built:Wed Mar 11 01:25:42 2020 OS/Arch: linux/amd64 Experimental: false containerd: Version: 1.2.13 GitCommit:7ad184331fa3e55e52b890ea95e65ba581ae3429 runc: Version: 1.0.0-rc10 GitCommit:dc9208a3303feef5b3839f4323d9beb36df0a9dd docker-init: Version: 0.18.0 GitCommit:fec3683 ``` ```sh [root@docker-node ~]# lsb_release -a LSB Version: :core-4.1-amd64:core-4.1-noarch:cxx-4.1-amd64:cxx-4.1-noarch:desktop-4.1-amd64:desktop-4.1-noarch:languages-4.1-amd64:languages-4.1-noarch:printing-4.1-amd64:printing-4.1-noarch Distributor ID: CentOS Description: CentOS Linux release 7.7.1908 (Core) Release: 7.7.1908 Codename:Core ``` Please make sure docker node meet following requirement:  This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use the URL above to go to the specific comment. For queries about this service, please contact Infrastructure at: us...@infra.apache.org With regards, Apache Git Services
[GitHub] [kylin] hit-lacus commented on issue #1166: Prepare DebugTomcat and Integration Test in Hadoop3 Env
hit-lacus commented on issue #1166: Prepare DebugTomcat and Integration Test in Hadoop3 Env URL: https://github.com/apache/kylin/pull/1166#issuecomment-602239479 https://user-images.githubusercontent.com/14030549/77255341-92674f80-6ca1-11ea-8c4a-2278199e0399.png;> This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use the URL above to go to the specific comment. For queries about this service, please contact Infrastructure at: us...@infra.apache.org With regards, Apache Git Services
[GitHub] [kylin] hit-lacus commented on issue #1166: Prepare DebugTomcat and Integration Test in Hadoop3 Env
hit-lacus commented on issue #1166: Prepare DebugTomcat and Integration Test in Hadoop3 Env URL: https://github.com/apache/kylin/pull/1166#issuecomment-602238268 ## Test This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use the URL above to go to the specific comment. For queries about this service, please contact Infrastructure at: us...@infra.apache.org With regards, Apache Git Services
