[
https://issues.apache.org/jira/browse/KYLIN-4446?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=17093352#comment-17093352
]
ASF GitHub Bot commented on KYLIN-4446:
---------------------------------------
hit-lacus edited a comment on pull request #1182:
URL: https://github.com/apache/kylin/pull/1182#issuecomment-619833363
## Prepare Docker Image
- Downloads required binary
```shell
xiaoxiang.yu:~/ $ ll Downloads/apache-kylin-3.0.1-bin-cdh57.tar
[18:39:26]
-rw-r--r--@ 1 xiaoxiang.yu INC\Domain Users 253M 4 15 16:49
Downloads/apache-kylin-3.0.1-bin-cdh57.tar
xiaoxiang.yu:~/ $ ll Downloads/spark-2.3.2-bin-hadoop2.7.tgz
[18:39:52]
-rwxrwxrwx 1 xiaoxiang.yu INC\Domain Users 215M 3 23 01:36
Downloads/spark-2.3.2-bin-hadoop2.7.tgz
```
- Downloads required jars
```shell
xiaoxiang.yu:~/ $ ll Downloads/mem*
[18:40:05]
-rw-r--r--@ 1 xiaoxiang.yu INC\Domain Users 163K 4 27 18:45
Downloads/memcached-session-manager-2.1.1.jar
-rw-r--r--@ 1 xiaoxiang.yu INC\Domain Users 11K 4 27 18:45
Downloads/memcached-session-manager-tc7-2.1.1.jar
```
- Remove old image
```shell
xiaoxiang.yu:CDH57/ (kubernetes*) $ docker rmi hadoop-client:cdh57
[18:46:33]
Untagged: hadoop-client:cdh57
xiaoxiang.yu:CDH57/ (kubernetes*) $ docker images |grep hadoop-client | grep
wc -l [18:47:31]
xiaoxiang.yu:CDH57/ (kubernetes*) $
xiaoxiang.yu:kylin-client/ (kubernetes*) $ docker rmi
kylin-client:3.0.1-cdh57
[18:51:58]
Untagged: kylin-client:3.0.1-cdh57
Deleted:
sha256:eb16424fc7cae2e4ca105e778290feec0ef370da2cc19e7df8b37ddd7166de57
Deleted:
sha256:5c5d43dc5f482ea5e60f58902f577bbfe3bc22b37175d6a5c28b3f66646f9626
Deleted:
sha256:9e509fdbf7d47b4cc28c45060809fecb888fab4c79b94f27f6826e78ed012431
Deleted:
sha256:3c97b6cb2781d7a594f18cccf357ce90214d7e1317fabf28edfccf45896af502
Deleted:
sha256:64b5601d1cb411c481382e6fe022f18dda4c5d070476a922bc4fd7531bad0846
Deleted:
sha256:fe814862cb919a47a9c162506921c0ee93edca19c5d36006f92153487c4429ef
Deleted:
sha256:1badb3b00a3f56ba66627e8c802b0a8f6a394bc2bc0dfa04d15a3085de9e34b9
Deleted:
sha256:afdb1ccabfabd7f375a184c6a8aa3b0aeb54195e92fd67d5a225a9e6fc501469
Deleted:
sha256:515eaf5fcbabf292b0e39d7fffd2d43f6c02d4b13af4f99be79027d120ce792d
Deleted:
sha256:f88e58969b5f908502fbddf2e058a97d31ed31134c8020b0762eea1224a86383
Deleted:
sha256:24b707ed4fe0ac52d4f3b32f9eac13fcd3698071a521f02ba1494d8cd7ec7646
Deleted:
sha256:664b07d4d73e4a1b587983f0b80fd7500d93f1c1eedbf925adf5b94391583389
Deleted:
sha256:75cdc77ae2aa8a0be849cd09961fc80a4d3856964fe91e265da2580b2d7dbd10
Deleted:
sha256:78e1a1873e763dd81d65d0249869d546e39806fc9ae415d508bff7fac3a1c1eb
```
- Build Hadoop-Client image
```shell
xiaoxiang.yu:CDH57/ (kubernetes*) $ pwd
[18:50:57]
/Users/xiaoxiang.yu/IntelliJ_IDEA_Project/MyKylin/kubernetes/docker/hadoop-client/CDH57
xiaoxiang.yu:CDH57/ (kubernetes*) $ cp
~/Downloads/spark-2.3.2-bin-hadoop2.7.tgz provided-binary
[18:48:25]
xiaoxiang.yu:CDH57/ (kubernetes*) $
[18:48:37]
xiaoxiang.yu:CDH57/ (kubernetes*) $
[18:49:02]
xiaoxiang.yu:CDH57/ (kubernetes*) $ sh build-image.sh
[18:49:02]
Sending build context to Docker daemon 225.9MB
Step 1/26 : FROM centos:7.3.1611
---> c5d48e81b986
... ... ...
Step 26/26 : ADD provided-binary/spark-${SPARK_VERSION}-bin-hadoop2.7.tgz .
---> ee576395a7f4
Successfully built ee576395a7f4
Successfully tagged hadoop-client:cdh57
```
- Build kylin-client image
```shell
xiaoxiang.yu:kylin-client/ (kubernetes*) $ cp
/Users/xiaoxiang.yu/Downloads/memcached-session-manager-2.1.1.jar
apache-kylin-3.0.1-bin-cdh57/tomcat/lib
xiaoxiang.yu:kylin-client/ (kubernetes*) $ cp
/Users/xiaoxiang.yu/Downloads/memcached-session-manager-tc7-2.1.1.jar
apache-kylin-3.0.1-bin-cdh57/tomcat/lib
xiaoxiang.yu:kylin-client/ (kubernetes*) $ sh build-image.sh
[19:06:35]
Sending build context to Docker daemon 531.4MB
Step 1/23 : FROM hadoop-client:cdh57
---> ee576395a7f4
Step 2/23 : MAINTAINER Apache Kylin
---> Using cache
---> bd37b4be904f
Step 3/23 : ARG USER=apache_kylin
---> Using cache
---> 7e860f60cd6b
Step 4/23 : ARG USER_HOME=/home/${USER}
---> Using cache
---> 81d3ff20f301
Step 5/23 : ARG KYLIN_VERSION=apache-kylin-3.0.1-bin-cdh57
---> Using cache
---> 9d9622c9fab7
Step 6/23 : ARG HADOOP_CONF_HOME=/etc/hadoop/conf
---> Using cache
---> 7fa3676c6199
Step 7/23 : ARG HIVE_CONF_HOME=/etc/hive/conf
---> Using cache
---> 9e4679f4f582
Step 8/23 : ARG HBASE_CONF_HOME=/etc/hbase/conf
---> Using cache
---> 491b4dbe0cec
Step 9/23 : ARG SPARK_CONF_HOME=$KYLIN_HOME/hadoop-conf
---> Using cache
---> 1c2e39c268f4
Step 10/23 : ENV SPARK_HOME /opt/spark-2.3.2-bin-hadoop2.7
---> Using cache
---> db65c266f986
Step 11/23 : ENV KYLIN_HOME=$USER_HOME/kylin
---> Using cache
---> f8a17081a4a5
Step 12/23 : WORKDIR /tmp
---> Using cache
---> 5af436187fd4
Step 13/23 : RUN set -x && yum install -y openssh-clients cronie
unzip sudo net-tools iftop tcpdump
perf telnet bind-utils && yum clean all
---> Using cache
---> ef53f3155c7e
Step 14/23 : RUN set -x && groupadd -r $USER && useradd -r -m -g
$USER $USER -d $USER_HOME && echo '$USER ALL=(ALL) NOPASSWD:ALL' >>
/etc/sudoers
---> Using cache
---> 1d0ee15484f7
Step 15/23 : COPY --chown=$USER:$USER $KYLIN_VERSION $KYLIN_HOME
---> Using cache
---> debe0d8920d5
Step 16/23 : RUN set -x && unzip -qq
$KYLIN_HOME/tomcat/webapps/kylin.war -d $KYLIN_HOME/tomcat/webapps/kylin &&
chown -R $USER:$USER $KYLIN_HOME/tomcat/webapps/kylin && rm
$KYLIN_HOME/tomcat/webapps/kylin.war && mkdir $SPARK_CONF_HOME && ln -s
$HADOOP_CONF_HOME/core-site.xml $SPARK_CONF_HOME/core-site.xml && ln -s
$HADOOP_CONF_HOME/hdfs-site.xml $SPARK_CONF_HOME/hdfs-site.xml && ln -s
$HADOOP_CONF_HOME/yarn-site.xml $SPARK_CONF_HOME/yarn-site.xml && ln -s
$HADOOP_CONF_HOME/hdfs-variable.xml $SPARK_CONF_HOME/hdfs-variable.xml && ln
-s $HADOOP_CONF_HOME/yarn-variable.xml $SPARK_CONF_HOME/yarn-variable.xml &&
ln -s $HADOOP_CONF_HOME/federation-mapping.xml
$SPARK_CONF_HOME/federation-mapping.xml && ln -s
$HIVE_CONF_HOME/hive-site.xml $SPARK_CONF_HOME/hive-site.xml && ln -s
$HBASE_CONF_HOME/hbase-site.xml $SPARK_CONF_HOME/hbase-site.xml && chown -R
$USER:$USER $SPARK_CONF_HOME
---> Using cache
---> 40913e8eae5c
Step 17/23 : ENV TOOL_HOME=$USER_HOME/bin
---> Using cache
---> 889756023204
Step 18/23 : COPY bin $TOOL_HOME
---> Using cache
---> 01e1041cc7cb
Step 19/23 : COPY crontab.txt /tmp/crontab.txt
---> 9e084a6fd4b5
Step 20/23 : RUN /usr/bin/crontab -u $USER /tmp/crontab.txt && rm -rf
/tmp/* && chmod 755 $TOOL_HOME/*
---> Running in 023036a3dff3
Removing intermediate container 023036a3dff3
---> 2279b966c55b
Step 21/23 : EXPOSE 7070
---> Running in ee0cc6d75bc6
Removing intermediate container ee0cc6d75bc6
---> 13400f20c95b
Step 22/23 : USER root
---> Running in 57b588a270c2
Removing intermediate container 57b588a270c2
---> 6d41c69a36a4
Step 23/23 : CMD ["sh", "-c", "$TOOL_HOME/bootstrap.sh server -d"]
---> Running in c786eea2ce0f
Removing intermediate container c786eea2ce0f
---> 7ea27faa653f
Successfully built 7ea27faa653f
Successfully tagged kylin-client:3.0.1-cdh57
```
----------------------------------------------------------------
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.
For queries about this service, please contact Infrastructure at:
[email protected]
> Kylin on kubernetes in a quickstart env
> ---------------------------------------
>
> Key: KYLIN-4446
> URL: https://issues.apache.org/jira/browse/KYLIN-4446
> Project: Kylin
> Issue Type: Sub-task
> Components: Integration
> Reporter: Xiaoxiang Yu
> Assignee: Xiaoxiang Yu
> Priority: Major
> Labels: kubernetes
> Fix For: v3.1.0
>
> Original Estimate: 48h
> Time Spent: 2h
> Remaining Estimate: 46h
>
> For a quick-start/PoC purpose, please consider use this template, it will
> only deploy one Kylin instance with role {color:#de350b}*ALL* {color}
--
This message was sent by Atlassian Jira
(v8.3.4#803005)
