hit-lacus edited a comment on pull request #1182: URL: https://github.com/apache/kylin/pull/1182#issuecomment-619833363
## Prepare Docker Image - Downloads required binary ```shell xiaoxiang.yu:~/ $ ll Downloads/apache-kylin-3.0.1-bin-cdh57.tar [18:39:26] -rw-r--r--@ 1 xiaoxiang.yu INC\Domain Users 253M 4 15 16:49 Downloads/apache-kylin-3.0.1-bin-cdh57.tar xiaoxiang.yu:~/ $ ll Downloads/spark-2.3.2-bin-hadoop2.7.tgz [18:39:52] -rwxrwxrwx 1 xiaoxiang.yu INC\Domain Users 215M 3 23 01:36 Downloads/spark-2.3.2-bin-hadoop2.7.tgz ``` - Downloads required jars ```shell xiaoxiang.yu:~/ $ ll Downloads/mem* [18:40:05] -rw-r--r--@ 1 xiaoxiang.yu INC\Domain Users 163K 4 27 18:45 Downloads/memcached-session-manager-2.1.1.jar -rw-r--r--@ 1 xiaoxiang.yu INC\Domain Users 11K 4 27 18:45 Downloads/memcached-session-manager-tc7-2.1.1.jar ``` - Remove old image ```shell xiaoxiang.yu:CDH57/ (kubernetes*) $ docker rmi hadoop-client:cdh57 [18:46:33] Untagged: hadoop-client:cdh57 xiaoxiang.yu:CDH57/ (kubernetes*) $ docker images |grep hadoop-client | grep wc -l [18:47:31] xiaoxiang.yu:CDH57/ (kubernetes*) $ xiaoxiang.yu:kylin-client/ (kubernetes*) $ docker rmi kylin-client:3.0.1-cdh57 [18:51:58] Untagged: kylin-client:3.0.1-cdh57 Deleted: sha256:eb16424fc7cae2e4ca105e778290feec0ef370da2cc19e7df8b37ddd7166de57 Deleted: sha256:5c5d43dc5f482ea5e60f58902f577bbfe3bc22b37175d6a5c28b3f66646f9626 Deleted: sha256:9e509fdbf7d47b4cc28c45060809fecb888fab4c79b94f27f6826e78ed012431 Deleted: sha256:3c97b6cb2781d7a594f18cccf357ce90214d7e1317fabf28edfccf45896af502 Deleted: sha256:64b5601d1cb411c481382e6fe022f18dda4c5d070476a922bc4fd7531bad0846 Deleted: sha256:fe814862cb919a47a9c162506921c0ee93edca19c5d36006f92153487c4429ef Deleted: sha256:1badb3b00a3f56ba66627e8c802b0a8f6a394bc2bc0dfa04d15a3085de9e34b9 Deleted: sha256:afdb1ccabfabd7f375a184c6a8aa3b0aeb54195e92fd67d5a225a9e6fc501469 Deleted: sha256:515eaf5fcbabf292b0e39d7fffd2d43f6c02d4b13af4f99be79027d120ce792d Deleted: sha256:f88e58969b5f908502fbddf2e058a97d31ed31134c8020b0762eea1224a86383 Deleted: sha256:24b707ed4fe0ac52d4f3b32f9eac13fcd3698071a521f02ba1494d8cd7ec7646 Deleted: sha256:664b07d4d73e4a1b587983f0b80fd7500d93f1c1eedbf925adf5b94391583389 Deleted: sha256:75cdc77ae2aa8a0be849cd09961fc80a4d3856964fe91e265da2580b2d7dbd10 Deleted: sha256:78e1a1873e763dd81d65d0249869d546e39806fc9ae415d508bff7fac3a1c1eb ``` - Build Hadoop-Client image ```shell xiaoxiang.yu:CDH57/ (kubernetes*) $ pwd [18:50:57] /Users/xiaoxiang.yu/IntelliJ_IDEA_Project/MyKylin/kubernetes/docker/hadoop-client/CDH57 xiaoxiang.yu:CDH57/ (kubernetes*) $ cp ~/Downloads/spark-2.3.2-bin-hadoop2.7.tgz provided-binary [18:48:25] xiaoxiang.yu:CDH57/ (kubernetes*) $ [18:48:37] xiaoxiang.yu:CDH57/ (kubernetes*) $ [18:49:02] xiaoxiang.yu:CDH57/ (kubernetes*) $ sh build-image.sh [18:49:02] Sending build context to Docker daemon 225.9MB Step 1/26 : FROM centos:7.3.1611 ---> c5d48e81b986 ... ... ... Step 26/26 : ADD provided-binary/spark-${SPARK_VERSION}-bin-hadoop2.7.tgz . ---> ee576395a7f4 Successfully built ee576395a7f4 Successfully tagged hadoop-client:cdh57 ``` - Build kylin-client image ```shell xiaoxiang.yu:kylin-client/ (kubernetes*) $ cp /Users/xiaoxiang.yu/Downloads/memcached-session-manager-2.1.1.jar apache-kylin-3.0.1-bin-cdh57/tomcat/lib xiaoxiang.yu:kylin-client/ (kubernetes*) $ cp /Users/xiaoxiang.yu/Downloads/memcached-session-manager-tc7-2.1.1.jar apache-kylin-3.0.1-bin-cdh57/tomcat/lib xiaoxiang.yu:kylin-client/ (kubernetes*) $ sh build-image.sh [19:06:35] Sending build context to Docker daemon 531.4MB Step 1/23 : FROM hadoop-client:cdh57 ---> ee576395a7f4 Step 2/23 : MAINTAINER Apache Kylin ---> Using cache ---> bd37b4be904f Step 3/23 : ARG USER=apache_kylin ---> Using cache ---> 7e860f60cd6b Step 4/23 : ARG USER_HOME=/home/${USER} ---> Using cache ---> 81d3ff20f301 Step 5/23 : ARG KYLIN_VERSION=apache-kylin-3.0.1-bin-cdh57 ---> Using cache ---> 9d9622c9fab7 Step 6/23 : ARG HADOOP_CONF_HOME=/etc/hadoop/conf ---> Using cache ---> 7fa3676c6199 Step 7/23 : ARG HIVE_CONF_HOME=/etc/hive/conf ---> Using cache ---> 9e4679f4f582 Step 8/23 : ARG HBASE_CONF_HOME=/etc/hbase/conf ---> Using cache ---> 491b4dbe0cec Step 9/23 : ARG SPARK_CONF_HOME=$KYLIN_HOME/hadoop-conf ---> Using cache ---> 1c2e39c268f4 Step 10/23 : ENV SPARK_HOME /opt/spark-2.3.2-bin-hadoop2.7 ---> Using cache ---> db65c266f986 Step 11/23 : ENV KYLIN_HOME=$USER_HOME/kylin ---> Using cache ---> f8a17081a4a5 Step 12/23 : WORKDIR /tmp ---> Using cache ---> 5af436187fd4 Step 13/23 : RUN set -x && yum install -y openssh-clients cronie unzip sudo net-tools iftop tcpdump perf telnet bind-utils && yum clean all ---> Using cache ---> ef53f3155c7e Step 14/23 : RUN set -x && groupadd -r $USER && useradd -r -m -g $USER $USER -d $USER_HOME && echo '$USER ALL=(ALL) NOPASSWD:ALL' >> /etc/sudoers ---> Using cache ---> 1d0ee15484f7 Step 15/23 : COPY --chown=$USER:$USER $KYLIN_VERSION $KYLIN_HOME ---> Using cache ---> debe0d8920d5 Step 16/23 : RUN set -x && unzip -qq $KYLIN_HOME/tomcat/webapps/kylin.war -d $KYLIN_HOME/tomcat/webapps/kylin && chown -R $USER:$USER $KYLIN_HOME/tomcat/webapps/kylin && rm $KYLIN_HOME/tomcat/webapps/kylin.war && mkdir $SPARK_CONF_HOME && ln -s $HADOOP_CONF_HOME/core-site.xml $SPARK_CONF_HOME/core-site.xml && ln -s $HADOOP_CONF_HOME/hdfs-site.xml $SPARK_CONF_HOME/hdfs-site.xml && ln -s $HADOOP_CONF_HOME/yarn-site.xml $SPARK_CONF_HOME/yarn-site.xml && ln -s $HADOOP_CONF_HOME/hdfs-variable.xml $SPARK_CONF_HOME/hdfs-variable.xml && ln -s $HADOOP_CONF_HOME/yarn-variable.xml $SPARK_CONF_HOME/yarn-variable.xml && ln -s $HADOOP_CONF_HOME/federation-mapping.xml $SPARK_CONF_HOME/federation-mapping.xml && ln -s $HIVE_CONF_HOME/hive-site.xml $SPARK_CONF_HOME/hive-site.xml && ln -s $HBASE_CONF_HOME/hbase-site.xml $SPARK_CONF_HOME/hbase-site.xml && chown -R $USER:$USER $SPARK_CONF_HOME ---> Using cache ---> 40913e8eae5c Step 17/23 : ENV TOOL_HOME=$USER_HOME/bin ---> Using cache ---> 889756023204 Step 18/23 : COPY bin $TOOL_HOME ---> Using cache ---> 01e1041cc7cb Step 19/23 : COPY crontab.txt /tmp/crontab.txt ---> 9e084a6fd4b5 Step 20/23 : RUN /usr/bin/crontab -u $USER /tmp/crontab.txt && rm -rf /tmp/* && chmod 755 $TOOL_HOME/* ---> Running in 023036a3dff3 Removing intermediate container 023036a3dff3 ---> 2279b966c55b Step 21/23 : EXPOSE 7070 ---> Running in ee0cc6d75bc6 Removing intermediate container ee0cc6d75bc6 ---> 13400f20c95b Step 22/23 : USER root ---> Running in 57b588a270c2 Removing intermediate container 57b588a270c2 ---> 6d41c69a36a4 Step 23/23 : CMD ["sh", "-c", "$TOOL_HOME/bootstrap.sh server -d"] ---> Running in c786eea2ce0f Removing intermediate container c786eea2ce0f ---> 7ea27faa653f Successfully built 7ea27faa653f Successfully tagged kylin-client:3.0.1-cdh57 ``` ---------------------------------------------------------------- This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use the URL above to go to the specific comment. For queries about this service, please contact Infrastructure at: us...@infra.apache.org