lshmouse commented on a change in pull request #864: KYLIN-4181 Schedule Kylin using Kubernetes URL: https://github.com/apache/kylin/pull/864#discussion_r342388845
########## File path: kubernetes/README.md ########## @@ -0,0 +1,108 @@ +# Kubernetes QuickStart + +This guide shows how to run Kylin cluster using Kubernetes StatefulSet Controller. The following figure depicts a typical scenario for Kylin cluster mode deployment: + + + +## Build or Pull Docker Image + +You can pull the image from Docker Hub directly if you do not want to build the image locally: + +```bash +docker pull apachekylin/kylin:3.0.0-alpha2-cdh57 +``` + +Otherwise, you can build the image using the following command: + +```bash +./build.sh +``` + +TIPS: If you are woking with air gapped network or slow internet speeds, we suggest you prepare the binary packages under the directory \$\{WORK_DIR\} by yourself and execute this: + +```bash +docker build ${WORK_DIR} -f Dockerfile -t "kylin:${KYLIN_VERSION}-cdh57" +``` + +## Prepare your Hadoop Configuration + +Put all of the configuration files under the "conf" directory. + +```bash +kylin.properties +hbase-site.xml +hive-site.xml +hdfs-site.xml +core-site.xml +mapred-site.xml +yarn-site.xml +``` + +If you worked with Kerberized Hadoop Cluster, do not forget to prepare the following files: + +```bash +krb5.conf +kylin.keytab +``` + +## Create ConfigMaps and Secret + +We recommand you to create separate Kubernetes namespace for Kylin. + +```bash +kubectl create namespace kylin +``` + +Execute the following shell scripts to create the required ConfigMaps: + +```bash +./kylin-configmap.sh +./kylin-secret.sh +``` + +## Create Service and StatefulSet + +Make sure the following resources exist in your namespace: + +```bash +kubectl get configmaps,secret -n kylin + +NAME DATA AGE +configmap/hadoop-config 4 6h42m +configmap/hbase-config 1 6h42m +configmap/hive-config 1 6h42m +configmap/krb5-config 1 6h27m +configmap/kylin-config 1 6h42m + +NAME TYPE DATA AGE +secret/kylin-keytab Opaque 1 6h32m +``` + +Then, you need to create headless service for stable DNS entries(kylin-0.kylin, kylin-1.kylin, kylin-2.kylin...) of StatefulSet members. + +```bash +kubectl apply -f kylin-service.yaml +``` + +Finally, create the StatefulSet and try to use it: + +```bash +kubectl apply -f kylin-statefulset.yaml Review comment: It's better to have an ingress support ---------------------------------------------------------------- This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use the URL above to go to the specific comment. For queries about this service, please contact Infrastructure at: [email protected] With regards, Apache Git Services
