[
https://issues.apache.org/jira/browse/KYLIN-4446?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=17093343#comment-17093343
]
ASF GitHub Bot commented on KYLIN-4446:
---------------------------------------
hit-lacus edited a comment on pull request #1182:
URL: https://github.com/apache/kylin/pull/1182#issuecomment-619833363
## Prepare Docker Image
- Downloads required binary
```shell
xiaoxiang.yu:~/ $ ll Downloads/apache-kylin-3.0.1-bin-cdh57.tar
[18:39:26]
-rw-r--r--@ 1 xiaoxiang.yu INC\Domain Users 253M 4 15 16:49
Downloads/apache-kylin-3.0.1-bin-cdh57.tar
xiaoxiang.yu:~/ $ ll Downloads/spark-2.3.2-bin-hadoop2.7.tgz
[18:39:52]
-rwxrwxrwx 1 xiaoxiang.yu INC\Domain Users 215M 3 23 01:36
Downloads/spark-2.3.2-bin-hadoop2.7.tgz
```
- Downloads required jars
```shell
xiaoxiang.yu:~/ $ ll Downloads/mem*
[18:40:05]
-rw-r--r--@ 1 xiaoxiang.yu INC\Domain Users 163K 4 27 18:45
Downloads/memcached-session-manager-2.1.1.jar
-rw-r--r--@ 1 xiaoxiang.yu INC\Domain Users 11K 4 27 18:45
Downloads/memcached-session-manager-tc7-2.1.1.jar
```
- Remove old image
```shell
xiaoxiang.yu:CDH57/ (kubernetes*) $ docker rmi hadoop-client:cdh57
[18:46:33]
Untagged: hadoop-client:cdh57
xiaoxiang.yu:CDH57/ (kubernetes*) $ docker images |grep hadoop-client | grep
wc -l [18:47:31]
xiaoxiang.yu:CDH57/ (kubernetes*) $
xiaoxiang.yu:kylin-client/ (kubernetes*) $ docker rmi
kylin-client:3.0.1-cdh57
[18:51:58]
Untagged: kylin-client:3.0.1-cdh57
Deleted:
sha256:eb16424fc7cae2e4ca105e778290feec0ef370da2cc19e7df8b37ddd7166de57
Deleted:
sha256:5c5d43dc5f482ea5e60f58902f577bbfe3bc22b37175d6a5c28b3f66646f9626
Deleted:
sha256:9e509fdbf7d47b4cc28c45060809fecb888fab4c79b94f27f6826e78ed012431
Deleted:
sha256:3c97b6cb2781d7a594f18cccf357ce90214d7e1317fabf28edfccf45896af502
Deleted:
sha256:64b5601d1cb411c481382e6fe022f18dda4c5d070476a922bc4fd7531bad0846
Deleted:
sha256:fe814862cb919a47a9c162506921c0ee93edca19c5d36006f92153487c4429ef
Deleted:
sha256:1badb3b00a3f56ba66627e8c802b0a8f6a394bc2bc0dfa04d15a3085de9e34b9
Deleted:
sha256:afdb1ccabfabd7f375a184c6a8aa3b0aeb54195e92fd67d5a225a9e6fc501469
Deleted:
sha256:515eaf5fcbabf292b0e39d7fffd2d43f6c02d4b13af4f99be79027d120ce792d
Deleted:
sha256:f88e58969b5f908502fbddf2e058a97d31ed31134c8020b0762eea1224a86383
Deleted:
sha256:24b707ed4fe0ac52d4f3b32f9eac13fcd3698071a521f02ba1494d8cd7ec7646
Deleted:
sha256:664b07d4d73e4a1b587983f0b80fd7500d93f1c1eedbf925adf5b94391583389
Deleted:
sha256:75cdc77ae2aa8a0be849cd09961fc80a4d3856964fe91e265da2580b2d7dbd10
Deleted:
sha256:78e1a1873e763dd81d65d0249869d546e39806fc9ae415d508bff7fac3a1c1eb
```
- Build Hadoop-Client image
```shell
xiaoxiang.yu:CDH57/ (kubernetes*) $ pwd
[18:50:57]
/Users/xiaoxiang.yu/IntelliJ_IDEA_Project/MyKylin/kubernetes/docker/hadoop-client/CDH57
xiaoxiang.yu:CDH57/ (kubernetes*) $ cp
~/Downloads/spark-2.3.2-bin-hadoop2.7.tgz provided-binary
[18:48:25]
xiaoxiang.yu:CDH57/ (kubernetes*) $
[18:48:37]
xiaoxiang.yu:CDH57/ (kubernetes*) $
[18:49:02]
xiaoxiang.yu:CDH57/ (kubernetes*) $ sh build-image.sh
[18:49:02]
Sending build context to Docker daemon 225.9MB
Step 1/26 : FROM centos:7.3.1611
---> c5d48e81b986
Step 2/26 : MAINTAINER Apache Kylin
---> Using cache
---> 7d31909dd19a
Step 3/26 : ENV JAVA_VERSION 1.8.0
---> Using cache
---> 596fd0b28b00
Step 4/26 : ENV SPARK_VERSION 2.3.2
---> Using cache
---> ec0263221e5b
Step 5/26 : ENV JAVA_HOME /usr/lib/jvm/java-${JAVA_VERSION}
---> Using cache
---> fcb50630b39a
Step 6/26 : ENV HADOOP_HOME /usr/lib/hadoop
---> Using cache
---> 729ba7b92158
Step 7/26 : ENV HIVE_HOME /usr/lib/hive
---> Using cache
---> 720cd72e9904
Step 8/26 : ENV HCAT_HOME /usr/lib/hive-hcatalog
---> Using cache
---> 7ef4bfdbc4cd
Step 9/26 : ENV HBASE_HOME /usr/lib/hbase
---> Using cache
---> 818e685192a5
Step 10/26 : ENV SPARK_HOME /opt/spark-${SPARK_VERSION}-bin-hadoop2.7
---> Using cache
---> ec3429565158
Step 11/26 : ENV PATH $PATH:$SPARK_HOME/bin:
---> Using cache
---> f2b052643286
Step 12/26 : ENV HADOOP_CONF_DIR /etc/hadoop/conf
---> Using cache
---> 0d76e82d405c
Step 13/26 : ENV HIVE_CONF_DIR /etc/hive/conf
---> Using cache
---> 1ad66c55a1de
Step 14/26 : ENV HBASE_CONF_DIR /etc/hbase/conf
---> Using cache
---> 91e260f7d120
Step 15/26 : ENV HIVE_CONF ${HIVE_CONF_DIR}
---> Using cache
---> 4321f4fe59f4
Step 16/26 : ENV HIVE_LIB ${HIVE_HOME}/lib
---> Using cache
---> 6b6b4e2a5ff4
Step 17/26 : RUN echo $'[cloudera-cdh5] \nname=Cloudera\'s Distribution for
Hadoop, Version 5
\nbaseurl=https://archive.cloudera.com/cdh5/redhat/6/x86_64/cdh/5.7.6/ \ngpgkey
=https://archive.cloudera.com/cdh5/redhat/6/x86_64/cdh/RPM-GPG-KEY-cloudera
\ngpgcheck = 1' > /etc/yum.repos.d/cloudera-cdh5.repo
---> Using cache
---> ca7957895170
Step 18/26 : WORKDIR /opt
---> Using cache
---> c85839b823ef
Step 19/26 : RUN set -xeu && yum -y install java-1.8.0-openjdk-devel
---> Using cache
---> 70de99c7c287
Step 20/26 : RUN set -xeu && yum -y install krb5-workstation
---> Using cache
---> ee2d6cf2c56c
Step 21/26 : RUN set -xeu && yum -y install hadoop-client
---> Using cache
---> 7c332c100a62
Step 22/26 : RUN set -xeu && yum -y install hive hive-hcatalog
---> Using cache
---> 54d0c23e2781
Step 23/26 : RUN set -xeu && yum -y install hbase
---> Using cache
---> 57aa98165f79
Step 24/26 : RUN set -xeu && curl -o
${HIVE_HOME}/lib/hadoop-lzo-0.4.15.jar
https://clojars.org/repo/hadoop-lzo/hadoop-lzo/0.4.15/hadoop-lzo-0.4.15.jar &&
curl -o ${HIVE_HOME}/lib/mysql-connector-java-5.1.24.jar
https://repo1.maven.org/maven2/mysql/mysql-connector-java/5.1.24/mysql-connector-java-5.1.24.jar
---> Using cache
---> c9494c618436
Step 25/26 : RUN set -xeu && yum -q clean all && rm -rf
/var/cache/yum && rm -rf /tmp/* /var/tmp/*
---> Using cache
---> 4a2d6490c98d
Step 26/26 : ADD provided-binary/spark-${SPARK_VERSION}-bin-hadoop2.7.tgz .
---> ee576395a7f4
Successfully built ee576395a7f4
Successfully tagged hadoop-client:cdh57
```
----------------------------------------------------------------
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.
For queries about this service, please contact Infrastructure at:
[email protected]
> Kylin on kubernetes in a quickstart env
> ---------------------------------------
>
> Key: KYLIN-4446
> URL: https://issues.apache.org/jira/browse/KYLIN-4446
> Project: Kylin
> Issue Type: Sub-task
> Components: Integration
> Reporter: Xiaoxiang Yu
> Assignee: Xiaoxiang Yu
> Priority: Major
> Labels: kubernetes
> Fix For: v3.1.0
>
> Original Estimate: 48h
> Time Spent: 2h
> Remaining Estimate: 46h
>
> For a quick-start/PoC purpose, please consider use this template, it will
> only deploy one Kylin instance with role {color:#de350b}*ALL* {color}
--
This message was sent by Atlassian Jira
(v8.3.4#803005)
