[
https://issues.apache.org/jira/browse/KYLIN-4446?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=17093341#comment-17093341
]
ASF GitHub Bot commented on KYLIN-4446:
---------------------------------------
hit-lacus edited a comment on pull request #1182:
URL: https://github.com/apache/kylin/pull/1182#issuecomment-619833363
## Prepare Docker Image
- Downloads required binary
```shell
xiaoxiang.yu:~/ $ ll Downloads/apache-kylin-3.0.1-bin-cdh57.tar
[18:39:26]
-rw-r--r--@ 1 xiaoxiang.yu INC\Domain Users 253M 4 15 16:49
Downloads/apache-kylin-3.0.1-bin-cdh57.tar
xiaoxiang.yu:~/ $ ll Downloads/spark-2.3.2-bin-hadoop2.7.tgz
[18:39:52]
-rwxrwxrwx 1 xiaoxiang.yu INC\Domain Users 215M 3 23 01:36
Downloads/spark-2.3.2-bin-hadoop2.7.tgz
```
- Downloads required jars
```shell
xiaoxiang.yu:~/ $ ll Downloads/mem*
[18:40:05]
-rw-r--r--@ 1 xiaoxiang.yu INC\Domain Users 163K 4 27 18:45
Downloads/memcached-session-manager-2.1.1.jar
-rw-r--r--@ 1 xiaoxiang.yu INC\Domain Users 11K 4 27 18:45
Downloads/memcached-session-manager-tc7-2.1.1.jar
```
- Remove old image
```shell
xiaoxiang.yu:CDH57/ (kubernetes*) $ docker rmi hadoop-client:cdh57
[18:46:33]
Untagged: hadoop-client:cdh57
xiaoxiang.yu:CDH57/ (kubernetes*) $ docker images |grep hadoop-client | grep
wc -l [18:47:31]
xiaoxiang.yu:CDH57/ (kubernetes*) $
```
- Build Hadoop-Client image
```shell
xiaoxiang.yu:CDH57/ (kubernetes*) $ pwd
[18:50:57]
/Users/xiaoxiang.yu/IntelliJ_IDEA_Project/MyKylin/kubernetes/docker/hadoop-client/CDH57
xiaoxiang.yu:CDH57/ (kubernetes*) $ cp
~/Downloads/spark-2.3.2-bin-hadoop2.7.tgz provided-binary
[18:48:25]
xiaoxiang.yu:CDH57/ (kubernetes*) $
[18:48:37]
xiaoxiang.yu:CDH57/ (kubernetes*) $
[18:49:02]
xiaoxiang.yu:CDH57/ (kubernetes*) $ sh build-image.sh
[18:49:02]
Sending build context to Docker daemon 225.9MB
Step 1/26 : FROM centos:7.3.1611
---> c5d48e81b986
Step 2/26 : MAINTAINER Apache Kylin
---> Using cache
---> 7d31909dd19a
Step 3/26 : ENV JAVA_VERSION 1.8.0
---> Using cache
---> 596fd0b28b00
Step 4/26 : ENV SPARK_VERSION 2.3.2
---> Using cache
---> ec0263221e5b
Step 5/26 : ENV JAVA_HOME /usr/lib/jvm/java-${JAVA_VERSION}
---> Using cache
---> fcb50630b39a
Step 6/26 : ENV HADOOP_HOME /usr/lib/hadoop
---> Using cache
---> 729ba7b92158
Step 7/26 : ENV HIVE_HOME /usr/lib/hive
---> Using cache
---> 720cd72e9904
Step 8/26 : ENV HCAT_HOME /usr/lib/hive-hcatalog
---> Using cache
---> 7ef4bfdbc4cd
Step 9/26 : ENV HBASE_HOME /usr/lib/hbase
---> Using cache
---> 818e685192a5
Step 10/26 : ENV SPARK_HOME /opt/spark-${SPARK_VERSION}-bin-hadoop2.7
---> Using cache
---> ec3429565158
Step 11/26 : ENV PATH $PATH:$SPARK_HOME/bin:
---> Using cache
---> f2b052643286
Step 12/26 : ENV HADOOP_CONF_DIR /etc/hadoop/conf
---> Using cache
---> 0d76e82d405c
Step 13/26 : ENV HIVE_CONF_DIR /etc/hive/conf
---> Using cache
---> 1ad66c55a1de
Step 14/26 : ENV HBASE_CONF_DIR /etc/hbase/conf
---> Using cache
---> 91e260f7d120
Step 15/26 : ENV HIVE_CONF ${HIVE_CONF_DIR}
---> Using cache
---> 4321f4fe59f4
Step 16/26 : ENV HIVE_LIB ${HIVE_HOME}/lib
---> Using cache
---> 6b6b4e2a5ff4
Step 17/26 : RUN echo $'[cloudera-cdh5] \nname=Cloudera\'s Distribution for
Hadoop, Version 5
\nbaseurl=https://archive.cloudera.com/cdh5/redhat/6/x86_64/cdh/5.7.6/ \ngpgkey
=https://archive.cloudera.com/cdh5/redhat/6/x86_64/cdh/RPM-GPG-KEY-cloudera
\ngpgcheck = 1' > /etc/yum.repos.d/cloudera-cdh5.repo
---> Using cache
---> ca7957895170
Step 18/26 : WORKDIR /opt
---> Using cache
---> c85839b823ef
Step 19/26 : RUN set -xeu && yum -y install java-1.8.0-openjdk-devel
---> Using cache
---> 70de99c7c287
Step 20/26 : RUN set -xeu && yum -y install krb5-workstation
---> Using cache
---> ee2d6cf2c56c
Step 21/26 : RUN set -xeu && yum -y install hadoop-client
---> Using cache
---> 7c332c100a62
Step 22/26 : RUN set -xeu && yum -y install hive hive-hcatalog
---> Using cache
---> 54d0c23e2781
Step 23/26 : RUN set -xeu && yum -y install hbase
---> Using cache
---> 57aa98165f79
Step 24/26 : RUN set -xeu && curl -o
${HIVE_HOME}/lib/hadoop-lzo-0.4.15.jar
https://clojars.org/repo/hadoop-lzo/hadoop-lzo/0.4.15/hadoop-lzo-0.4.15.jar &&
curl -o ${HIVE_HOME}/lib/mysql-connector-java-5.1.24.jar
https://repo1.maven.org/maven2/mysql/mysql-connector-java/5.1.24/mysql-connector-java-5.1.24.jar
---> Using cache
---> c9494c618436
Step 25/26 : RUN set -xeu && yum -q clean all && rm -rf
/var/cache/yum && rm -rf /tmp/* /var/tmp/*
---> Using cache
---> 4a2d6490c98d
Step 26/26 : ADD provided-binary/spark-${SPARK_VERSION}-bin-hadoop2.7.tgz .
---> ee576395a7f4
Successfully built ee576395a7f4
Successfully tagged hadoop-client:cdh57
```
----------------------------------------------------------------
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.
For queries about this service, please contact Infrastructure at:
[email protected]
> Kylin on kubernetes in a quickstart env
> ---------------------------------------
>
> Key: KYLIN-4446
> URL: https://issues.apache.org/jira/browse/KYLIN-4446
> Project: Kylin
> Issue Type: Sub-task
> Components: Integration
> Reporter: Xiaoxiang Yu
> Assignee: Xiaoxiang Yu
> Priority: Major
> Labels: kubernetes
> Fix For: v3.1.0
>
> Original Estimate: 48h
> Time Spent: 2h
> Remaining Estimate: 46h
>
> For a quick-start/PoC purpose, please consider use this template, it will
> only deploy one Kylin instance with role {color:#de350b}*ALL* {color}
--
This message was sent by Atlassian Jira
(v8.3.4#803005)
