[jira] [Commented] (KYLIN-4320) number of replicas of Cuboid files cannot be configured for Spark engine
[
https://issues.apache.org/jira/browse/KYLIN-4320?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17094174#comment-17094174
]
ASF subversion and git services commented on KYLIN-4320:
Commit 78afb52b57736bf0bfd10a0299ac9b44f1119400 in kylin's branch
refs/heads/master from Shao Feng Shi
[ https://gitbox.apache.org/repos/asf?p=kylin.git;h=78afb52 ]
Revert "KYLIN-4320 number of replicas of Cuboid files cannot be configured for
Spark engine"
This reverts commit 926515bfc217167fe570c0cf21a39f54e5b5d1ff.
> number of replicas of Cuboid files cannot be configured for Spark engine
>
>
> Key: KYLIN-4320
> URL: https://issues.apache.org/jira/browse/KYLIN-4320
> Project: Kylin
> Issue Type: Bug
> Components: Job Engine
>Affects Versions: v3.0.1
>Reporter: Congling Xia
>Assignee: Yaqian Zhang
>Priority: Major
> Fix For: v3.1.0
>
> Attachments: cuboid_replications.png
>
> Original Estimate: 4h
> Remaining Estimate: 4h
>
> Hi, team. I try to change `dfs.replication` to 3 by adding the following
> config override
> {code:java}
> kylin.engine.spark-conf.spark.hadoop.dfs.replication=3
> {code}
> Then, I get a strange result - numbers of replicas of cuboid files varies
> even though they are in the same level.
> !cuboid_replications.png!
> I guess it is due to the conflicting settings in SparkUtil:
> {code:java}
> public static void modifySparkHadoopConfiguration(SparkContext sc) throws
> Exception {
> sc.hadoopConfiguration().set("dfs.replication", "2"); // cuboid
> intermediate files, replication=2
>
> sc.hadoopConfiguration().set("mapreduce.output.fileoutputformat.compress",
> "true");
>
> sc.hadoopConfiguration().set("mapreduce.output.fileoutputformat.compress.type",
> "BLOCK");
>
> sc.hadoopConfiguration().set("mapreduce.output.fileoutputformat.compress.codec",
> "org.apache.hadoop.io.compress.DefaultCodec"); // or
> org.apache.hadoop.io.compress.SnappyCodec
> }
> {code}
> It may be a bug for Spark property precedence. After checking [Spark
> documents|#dynamically-loading-spark-properties]], it seems that some
> programmatically set properties may not take effect and it is not a
> recommended way for Spark job configuration.
>
> Anyway, cuboid files may survive for weeks until expired or been merged, the
> configuration rewrite in
> `org.apache.kylin.engine.spark.SparkUtil#modifySparkHadoopConfiguration`
> makes those files less reliable.
> Is there any way to force cuboid files to remain 3 replicas? or shall we
> remove the code in SparkUtil to make
> kylin.engine.spark-conf.spark.hadoop.dfs.replication work properly?
--
This message was sent by Atlassian Jira
(v8.3.4#803005)
[jira] [Comment Edited] (KYLIN-4442) Kylin System Cube Hive tables not able to update
[ https://issues.apache.org/jira/browse/KYLIN-4442?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17093734#comment-17093734 ] Sonu Singh edited comment on KYLIN-4442 at 4/28/20, 5:32 AM: - Hi [~hit_lacus], I have downgrade Hive to 3.1.0 from 3.1.2 and still facing the same issue. was (Author: sonusingh): Hi [~hit_lacus], I have downgrade Hive to 3.1.0 from 3.1.2 and still facing the same issue. Also when I am trying to execute hive create partition command through hive CLI getting below exception : create partition by ALTER TABLE KYLIN.HIVE_METRICS_JOB_QA ADD IF NOT EXISTS PARTITION (kday_date='2020-04-27') NoViableAltException(224@[917:1: ddlStatement : ( createDatabaseStatement | switchDatabaseStatement | dropDatabaseStatement | createTableStatement | dropTableStatement | truncateTableStatement | alterStatement | descStatement | showStatement | metastoreCheck | createViewStatement | createMaterializedViewStatement | dropViewStatement | dropMaterializedViewStatement | createFunctionStatement | createMacroStatement | dropFunctionStatement | reloadFunctionStatement | dropMacroStatement | analyzeStatement | lockStatement | unlockStatement | lockDatabase | unlockDatabase | createRoleStatement | dropRoleStatement | ( grantPrivileges )=> grantPrivileges | ( revokePrivileges )=> revokePrivileges | showGrants | showRoleGrants | showRolePrincipals | showRoles | grantRole | revokeRole | setRole | showCurrentRole | abortTransactionStatement | killQueryStatement | resourcePlanDdlStatements );]) at org.antlr.runtime.DFA.noViableAlt(DFA.java:158) at org.antlr.runtime.DFA.predict(DFA.java:116) at org.apache.hadoop.hive.ql.parse.HiveParser.ddlStatement(HiveParser.java:4244) at org.apache.hadoop.hive.ql.parse.HiveParser.execStatement(HiveParser.java:2494) > Kylin System Cube Hive tables not able to update > - > > Key: KYLIN-4442 > URL: https://issues.apache.org/jira/browse/KYLIN-4442 > Project: Kylin > Issue Type: Bug >Affects Versions: v3.0.0 >Reporter: Sonu Singh >Priority: Blocker > Attachments: image-2020-04-18-17-26-33-316.png, > kylin-metrics-reporter-hive-3.1.0-SNAPSHOT.jar > > > Kylin System Cube Hive table is not updating. I am using Kylin hadoop3 code > and running on vanilla hadoop3. -- This message was sent by Atlassian Jira (v8.3.4#803005)
[jira] [Created] (KYLIN-4473) Issue while writting HFILES while using apache spark in EMR
Jerry Verghese Cheruvathoor created KYLIN-4473: -- Summary: Issue while writting HFILES while using apache spark in EMR Key: KYLIN-4473 URL: https://issues.apache.org/jira/browse/KYLIN-4473 Project: Kylin Issue Type: Bug Components: Spark Engine, Storage - HBase Affects Versions: v3.0.1 Environment: EMR Reporter: Jerry Verghese Cheruvathoor While trying to create a cube using the spark i am facing issue in creating the hfiles. Spark command executed from kylin : export HADOOP_CONF_DIR=/etc/hadoop/conf && /usr/local/kylin/apache-kylin-3.0.1-bin-hbase1x/spark/bin/spark-submit --class org.apache.kylin.common.util.SparkEntry --name "Convert Cuboid Data to HFile" --conf spark.executor.instances=40 --conf spark.yarn.queue=default --conf spark.history.fs.logDirectory=hdfs:///kylin/spark-history --conf spark.master=yarn --conf spark.hadoop.yarn.timeline-service.enabled=false --conf spark.executor.memory=4G --conf spark.eventLog.enabled=true --conf spark.eventLog.dir=hdfs:///kylin/spark-history --conf spark.yarn.executor.memoryOverhead=1024 --conf spark.driver.memory=2G --conf spark.shuffle.service.enabled=true --jars /usr/lib/hbase/lib/hbase-common-1.4.10.jar,/usr/lib/hbase/lib/hbase-server-1.4.10.jar,/usr/lib/hbase/lib/hbase-client-1.4.10.jar,/usr/lib/hbase/lib/hbase-protocol-1.4.10.jar,/usr/lib/hbase/lib/hbase-hadoop-compat-1.4.10.jar,/usr/lib/hbase/lib/htrace-core-3.1.0-incubating.jar,/usr/lib/hbase/lib/metrics-core-2.2.0.jar,/usr/lib/hbase/lib/hbase-hadoop-compat-1.4.10.jar,/usr/lib/hbase/lib/hbase-hadoop2-compat-1.4.10.jar, /usr/local/kylin/apache-kylin-3.0.1-bin-hbase1x/lib/kylin-job-3.0.1.jar -className org.apache.kylin.storage.hbase.steps.SparkCubeHFile -partitions hdfs://ip-10-234-119-182.w2.ngap2dev.nike.com:8020/kylin/kylin_metadata4/kylin-75dc6473-b974-c5c7-5d9b-bc42142d4ee9/test1/rowkey_stats/part-r-0_hfile -counterOutput hdfs://ip-10-234-119-182.w2.ngap2dev.nike.com:8020/kylin/kylin_metadata4/kylin-75dc6473-b974-c5c7-5d9b-bc42142d4ee9/test1/counter -cubename test1 -output hdfs://ip-10-234-119-182.w2.ngap2dev.nike.com:8020/kylin/kylin_metadata4/kylin-75dc6473-b974-c5c7-5d9b-bc42142d4ee9/test1/hfile -input hdfs://ip-10-234-119-182.w2.ngap2dev.nike.com:8020/kylin/kylin_metadata4/kylin-75dc6473-b974-c5c7-5d9b-bc42142d4ee9/test1/cuboid/ -segmentId af2fe8db-6132-4b53-1680-7f93ac622f25 -metaUrl kylin_metadata4@hdfs,path=hdfs://ip-10-234-119-182.w2.ngap2dev.nike.com:8020/kylin/kylin_metadata4/kylin-75dc6473-b974-c5c7-5d9b-bc42142d4ee9/test1/metadata -hbaseConfPath hdfs://ip-10-234-119-182.w2.ngap2dev.nike.com:8020/kylin/kylin_metadata4/kylin-75dc6473-b974-c5c7-5d9b-bc42142d4ee9/hbase-conf.xml Below is the error log . 34.115.209:3764434.115.209:376442020-04-28 05:21:01 WARN TaskSetManager:66 - Lost task 0.0 in stage 1.0 (TID 2, ip-10-234-115-209.w2.ngap2dev.nike.com, executor 4): org.apache.spark.SparkException: Task failed while writing rows at org.apache.spark.internal.io.SparkHadoopWriter$.org$apache$spark$internal$io$SparkHadoopWriter$$executeTask(SparkHadoopWriter.scala:155) at org.apache.spark.internal.io.SparkHadoopWriter$$anonfun$3.apply(SparkHadoopWriter.scala:83) at org.apache.spark.internal.io.SparkHadoopWriter$$anonfun$3.apply(SparkHadoopWriter.scala:78) at org.apache.spark.scheduler.ResultTask.runTask(ResultTask.scala:87) at org.apache.spark.scheduler.Task.run(Task.scala:109) at org.apache.spark.executor.Executor$TaskRunner.run(Executor.scala:345) at java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1149) at java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) at java.lang.Thread.run(Thread.java:748)Caused by: java.lang.NoClassDefFoundError: Lorg/apache/hadoop/hbase/metrics/MetricRegistry; at java.lang.Class.getDeclaredFields0(Native Method) at java.lang.Class.privateGetDeclaredFields(Class.java:2583) at java.lang.Class.getDeclaredFields(Class.java:1916) at org.apache.hadoop.util.ReflectionUtils.getDeclaredFieldsIncludingInherited(ReflectionUtils.java:323) at org.apache.hadoop.metrics2.lib.MetricsSourceBuilder.initRegistry(MetricsSourceBuilder.java:92) at org.apache.hadoop.metrics2.lib.MetricsSourceBuilder.(MetricsSourceBuilder.java:56) at org.apache.hadoop.metrics2.lib.MetricsAnnotations.newSourceBuilder(MetricsAnnotations.java:43) at org.apache.hadoop.metrics2.impl.MetricsSystemImpl.register(MetricsSystemImpl.java:224) at org.apache.hadoop.hbase.metrics.BaseSourceImpl.(BaseSourceImpl.java:115) at org.apache.hadoop.hbase.io.MetricsIOSourceImpl.(MetricsIOSourceImpl.java:44) at org.apache.hadoop.hbase.io.MetricsIOSourceImpl.(MetricsIOSourceImpl.java:36) at org.apache.hadoop.hbase.regionserver.MetricsRegionServerSourceFactoryImpl.createIO(MetricsRegionServerSourceFactoryImpl.java:73) at
[jira] [Commented] (KYLIN-4446) Kylin on kubernetes in a quickstart env
[
https://issues.apache.org/jira/browse/KYLIN-4446?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17094108#comment-17094108
]
ASF GitHub Bot commented on KYLIN-4446:
---
coveralls edited a comment on pull request #1182:
URL: https://github.com/apache/kylin/pull/1182#issuecomment-617824003
## Pull Request Test Coverage Report for [Build
5860](https://coveralls.io/builds/30388872)
* **0** of **0** changed or added relevant lines in **0** files are
covered.
* **6** unchanged lines in **2** files lost coverage.
* Overall coverage increased (+**0.001%**) to **27.467%**
---
| Files with Coverage Reduction | New Missed Lines | % |
| :-|--|--: |
|
[server-base/src/main/java/org/apache/kylin/rest/util/QueryRequestLimits.java](https://coveralls.io/builds/30388872/source?filename=server-base%2Fsrc%2Fmain%2Fjava%2Forg%2Fapache%2Fkylin%2Frest%2Futil%2FQueryRequestLimits.java#L72)
| 1 | 47.62% |
|
[core-cube/src/main/java/org/apache/kylin/cube/inmemcubing/MemDiskStore.java](https://coveralls.io/builds/30388872/source?filename=core-cube%2Fsrc%2Fmain%2Fjava%2Forg%2Fapache%2Fkylin%2Fcube%2Finmemcubing%2FMemDiskStore.java#L439)
| 5 | 77.81% |
| Totals | [](https://coveralls.io/builds/30388872)
|
| :-- | --: |
| Change from base [Build 5853](https://coveralls.io/builds/30348545): |
0.001% |
| Covered Lines: | 24317 |
| Relevant Lines: | 88532 |
---
# - [Coveralls](https://coveralls.io)
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.
For queries about this service, please contact Infrastructure at:
us...@infra.apache.org
> Kylin on kubernetes in a quickstart env
> ---
>
> Key: KYLIN-4446
> URL: https://issues.apache.org/jira/browse/KYLIN-4446
> Project: Kylin
> Issue Type: Sub-task
> Components: Integration
>Reporter: Xiaoxiang Yu
>Assignee: Xiaoxiang Yu
>Priority: Major
> Labels: kubernetes
> Fix For: v3.1.0
>
> Original Estimate: 48h
> Time Spent: 2h
> Remaining Estimate: 46h
>
> For a quick-start/PoC purpose, please consider use this template, it will
> only deploy one Kylin instance with role {color:#de350b}*ALL* {color}
--
This message was sent by Atlassian Jira
(v8.3.4#803005)
[GitHub] [kylin] coveralls edited a comment on pull request #1182: KYLIN-4446 Kylin on kubernetes in quick-start and production env
coveralls edited a comment on pull request #1182: URL: https://github.com/apache/kylin/pull/1182#issuecomment-617824003 ## Pull Request Test Coverage Report for [Build 5860](https://coveralls.io/builds/30388872) * **0** of **0** changed or added relevant lines in **0** files are covered. * **6** unchanged lines in **2** files lost coverage. * Overall coverage increased (+**0.001%**) to **27.467%** --- | Files with Coverage Reduction | New Missed Lines | % | | :-|--|--: | | [server-base/src/main/java/org/apache/kylin/rest/util/QueryRequestLimits.java](https://coveralls.io/builds/30388872/source?filename=server-base%2Fsrc%2Fmain%2Fjava%2Forg%2Fapache%2Fkylin%2Frest%2Futil%2FQueryRequestLimits.java#L72) | 1 | 47.62% | | [core-cube/src/main/java/org/apache/kylin/cube/inmemcubing/MemDiskStore.java](https://coveralls.io/builds/30388872/source?filename=core-cube%2Fsrc%2Fmain%2Fjava%2Forg%2Fapache%2Fkylin%2Fcube%2Finmemcubing%2FMemDiskStore.java#L439) | 5 | 77.81% | | Totals | [](https://coveralls.io/builds/30388872) | | :-- | --: | | Change from base [Build 5853](https://coveralls.io/builds/30348545): | 0.001% | | Covered Lines: | 24317 | | Relevant Lines: | 88532 | --- # - [Coveralls](https://coveralls.io) This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use the URL above to go to the specific comment. For queries about this service, please contact Infrastructure at: us...@infra.apache.org
[jira] [Reopened] (KYLIN-4467) Support TopN by kylin on Parquet
[ https://issues.apache.org/jira/browse/KYLIN-4467?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Harvey Yue reopened KYLIN-4467: --- Assignee: Harvey Yue (was: wangrupeng) Reopen this issue when querying topn measure sql get ArrayIndexOutOfBoundsException: at org.apache.kylin.engine.spark2.NExecAndComp.sql(NExecAndComp.java:425) at org.apache.kylin.engine.spark2.NExecAndComp.sql(NExecAndComp.java:425) at org.apache.kylin.engine.spark2.NExecAndComp.sql(NExecAndComp.java:408) at org.apache.kylin.engine.spark2.BuildAndQueryEmptySegmentsTest.testEmptySegments(BuildAndQueryEmptySegmentsTest.java:57) at sun.reflect.NativeMethodAccessorImpl.invoke0(Native Method) at sun.reflect.NativeMethodAccessorImpl.invoke(NativeMethodAccessorImpl.java:62) at sun.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorImpl.java:43) at java.lang.reflect.Method.invoke(Method.java:498) at org.junit.runners.model.FrameworkMethod$1.runReflectiveCall(FrameworkMethod.java:50) at org.junit.internal.runners.model.ReflectiveCallable.run(ReflectiveCallable.java:12) at org.junit.runners.model.FrameworkMethod.invokeExplosively(FrameworkMethod.java:47) at org.junit.internal.runners.statements.InvokeMethod.evaluate(InvokeMethod.java:17) at org.junit.internal.runners.statements.RunBefores.evaluate(RunBefores.java:26) at org.junit.internal.runners.statements.RunAfters.evaluate(RunAfters.java:27) at org.junit.runners.ParentRunner.runLeaf(ParentRunner.java:325) at org.junit.runners.BlockJUnit4ClassRunner.runChild(BlockJUnit4ClassRunner.java:78) at org.junit.runners.BlockJUnit4ClassRunner.runChild(BlockJUnit4ClassRunner.java:57) at org.junit.runners.ParentRunner$3.run(ParentRunner.java:290) at org.junit.runners.ParentRunner$1.schedule(ParentRunner.java:71) at org.junit.runners.ParentRunner.runChildren(ParentRunner.java:288) at org.junit.runners.ParentRunner.access$000(ParentRunner.java:58) at org.junit.runners.ParentRunner$2.evaluate(ParentRunner.java:268) at org.junit.internal.runners.statements.RunBefores.evaluate(RunBefores.java:26) at org.junit.runners.ParentRunner.run(ParentRunner.java:363) at org.junit.runner.JUnitCore.run(JUnitCore.java:137) at com.intellij.junit4.JUnit4IdeaTestRunner.startRunnerWithArgs(JUnit4IdeaTestRunner.java:68) at com.intellij.rt.junit.IdeaTestRunner$Repeater.startRunnerWithArgs(IdeaTestRunner.java:33) at com.intellij.rt.junit.JUnitStarter.prepareStreamsAndStart(JUnitStarter.java:230) at com.intellij.rt.junit.JUnitStarter.main(JUnitStarter.java:58)Caused by: java.sql.SQLException: exception while executing query: java.lang.ArrayIndexOutOfBoundsException: 12 at org.apache.calcite.avatica.Helper.createException(Helper.java:56) at org.apache.calcite.avatica.Helper.createException(Helper.java:41) at org.apache.calcite.avatica.AvaticaConnection.executeQueryInternal(AvaticaConnection.java:577) at org.apache.calcite.avatica.AvaticaPreparedStatement.executeQuery(AvaticaPreparedStatement.java:137) at org.apache.kylin.engine.spark2.NExecAndComp.queryCube(NExecAndComp.java:455) at org.apache.kylin.engine.spark2.NExecAndComp.queryCubeAndSkipCompute(NExecAndComp.java:431) at org.apache.kylin.engine.spark2.NExecAndComp.sql(NExecAndComp.java:418) ... 27 moreCaused by: java.lang.RuntimeException: java.lang.ArrayIndexOutOfBoundsException: 12 at org.apache.kylin.query.exec.SparkExec.collectToEnumerable(SparkExec.java:46) at Baz.bind(Unknown Source) at org.apache.calcite.jdbc.CalcitePrepare$CalciteSignature.enumerable(CalcitePrepare.java:365) at org.apache.calcite.jdbc.CalciteConnectionImpl.enumerable(CalciteConnectionImpl.java:301) at org.apache.calcite.jdbc.CalciteMetaImpl._createIterable(CalciteMetaImpl.java:559) at org.apache.calcite.jdbc.CalciteMetaImpl.createIterable(CalciteMetaImpl.java:550) at org.apache.calcite.avatica.AvaticaResultSet.execute(AvaticaResultSet.java:182) at org.apache.calcite.jdbc.CalciteResultSet.execute(CalciteResultSet.java:67) at org.apache.calcite.jdbc.CalciteResultSet.execute(CalciteResultSet.java:44) at org.apache.calcite.avatica.AvaticaConnection.executeQueryInternal(AvaticaConnection.java:573) ... 31 moreCaused by: java.lang.ArrayIndexOutOfBoundsException: 12 at org.apache.kylin.query.runtime.RuntimeHelper$$anonfun$gtSchemaToCalciteSchema$2.apply(RuntimeHelper.scala:118) at org.apache.kylin.query.runtime.RuntimeHelper$$anonfun$gtSchemaToCalciteSchema$2.apply(RuntimeHelper.scala:97) at scala.collection.TraversableLike$$anonfun$map$1.apply(TraversableLike.scala:234) at scala.collection.TraversableLike$$anonfun$map$1.apply(TraversableLike.scala:234) at scala.collection.Iterator$class.foreach(Iterator.scala:893) at scala.collection.AbstractIterator.foreach(Iterator.scala:1336) at scala.collection.IterableLike$class.foreach(IterableLike.scala:72) at scala.collection.AbstractIterable.foreach(Iterable.scala:54) at
[jira] [Reopened] (KYLIN-4320) number of replicas of Cuboid files cannot be configured for Spark engine
[
https://issues.apache.org/jira/browse/KYLIN-4320?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
]
Yaqian Zhang reopened KYLIN-4320:
-
> number of replicas of Cuboid files cannot be configured for Spark engine
>
>
> Key: KYLIN-4320
> URL: https://issues.apache.org/jira/browse/KYLIN-4320
> Project: Kylin
> Issue Type: Bug
> Components: Job Engine
>Affects Versions: v3.0.1
>Reporter: Congling Xia
>Assignee: Yaqian Zhang
>Priority: Major
> Fix For: v3.1.0
>
> Attachments: cuboid_replications.png
>
> Original Estimate: 4h
> Remaining Estimate: 4h
>
> Hi, team. I try to change `dfs.replication` to 3 by adding the following
> config override
> {code:java}
> kylin.engine.spark-conf.spark.hadoop.dfs.replication=3
> {code}
> Then, I get a strange result - numbers of replicas of cuboid files varies
> even though they are in the same level.
> !cuboid_replications.png!
> I guess it is due to the conflicting settings in SparkUtil:
> {code:java}
> public static void modifySparkHadoopConfiguration(SparkContext sc) throws
> Exception {
> sc.hadoopConfiguration().set("dfs.replication", "2"); // cuboid
> intermediate files, replication=2
>
> sc.hadoopConfiguration().set("mapreduce.output.fileoutputformat.compress",
> "true");
>
> sc.hadoopConfiguration().set("mapreduce.output.fileoutputformat.compress.type",
> "BLOCK");
>
> sc.hadoopConfiguration().set("mapreduce.output.fileoutputformat.compress.codec",
> "org.apache.hadoop.io.compress.DefaultCodec"); // or
> org.apache.hadoop.io.compress.SnappyCodec
> }
> {code}
> It may be a bug for Spark property precedence. After checking [Spark
> documents|#dynamically-loading-spark-properties]], it seems that some
> programmatically set properties may not take effect and it is not a
> recommended way for Spark job configuration.
>
> Anyway, cuboid files may survive for weeks until expired or been merged, the
> configuration rewrite in
> `org.apache.kylin.engine.spark.SparkUtil#modifySparkHadoopConfiguration`
> makes those files less reliable.
> Is there any way to force cuboid files to remain 3 replicas? or shall we
> remove the code in SparkUtil to make
> kylin.engine.spark-conf.spark.hadoop.dfs.replication work properly?
--
This message was sent by Atlassian Jira
(v8.3.4#803005)
[jira] [Commented] (KYLIN-4442) Kylin System Cube Hive tables not able to update
[ https://issues.apache.org/jira/browse/KYLIN-4442?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17093734#comment-17093734 ] Sonu Singh commented on KYLIN-4442: --- Hi [~hit_lacus], I have downgrade Hive to 3.1.0 from 3.1.2 and still facing the same issue. Also when I am trying to execute hive create partition command through hive CLI getting below exception : create partition by ALTER TABLE KYLIN.HIVE_METRICS_JOB_QA ADD IF NOT EXISTS PARTITION (kday_date='2020-04-27') NoViableAltException(224@[917:1: ddlStatement : ( createDatabaseStatement | switchDatabaseStatement | dropDatabaseStatement | createTableStatement | dropTableStatement | truncateTableStatement | alterStatement | descStatement | showStatement | metastoreCheck | createViewStatement | createMaterializedViewStatement | dropViewStatement | dropMaterializedViewStatement | createFunctionStatement | createMacroStatement | dropFunctionStatement | reloadFunctionStatement | dropMacroStatement | analyzeStatement | lockStatement | unlockStatement | lockDatabase | unlockDatabase | createRoleStatement | dropRoleStatement | ( grantPrivileges )=> grantPrivileges | ( revokePrivileges )=> revokePrivileges | showGrants | showRoleGrants | showRolePrincipals | showRoles | grantRole | revokeRole | setRole | showCurrentRole | abortTransactionStatement | killQueryStatement | resourcePlanDdlStatements );]) at org.antlr.runtime.DFA.noViableAlt(DFA.java:158) at org.antlr.runtime.DFA.predict(DFA.java:116) at org.apache.hadoop.hive.ql.parse.HiveParser.ddlStatement(HiveParser.java:4244) at org.apache.hadoop.hive.ql.parse.HiveParser.execStatement(HiveParser.java:2494) > Kylin System Cube Hive tables not able to update > - > > Key: KYLIN-4442 > URL: https://issues.apache.org/jira/browse/KYLIN-4442 > Project: Kylin > Issue Type: Bug >Affects Versions: v3.0.0 >Reporter: Sonu Singh >Priority: Blocker > Attachments: image-2020-04-18-17-26-33-316.png, > kylin-metrics-reporter-hive-3.1.0-SNAPSHOT.jar > > > Kylin System Cube Hive table is not updating. I am using Kylin hadoop3 code > and running on vanilla hadoop3. -- This message was sent by Atlassian Jira (v8.3.4#803005)
[jira] [Commented] (KYLIN-4446) Kylin on kubernetes in a quickstart env
[ https://issues.apache.org/jira/browse/KYLIN-4446?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17093580#comment-17093580 ] ASF GitHub Bot commented on KYLIN-4446: --- hit-lacus edited a comment on pull request #1182: URL: https://github.com/apache/kylin/pull/1182#issuecomment-619862739 ## Scale Out/In Job Service - https://kubernetes.io/docs/tasks/run-application/scale-stateful-set/ - Modify replica(from 1 to 3) and scale out job server ```shell root@open-source:/home/ubuntu/kylin-kubernetes/kubernetes/example/deployment# vim kylin-job/kylin-job-statefulset.yaml root@open-source:/home/ubuntu/kylin-kubernetes/kubernetes/example/deployment# kubectl apply -f kylin-job/ ``` - Check state of pods ```shell root@open-source:/home/ubuntu/kylin-kubernetes/kubernetes/example/deployment# kubectl get pod -n kylin-example NAMEREADY STATUSRESTARTS AGE kylin-job-0 2/2 Running 0 27s kylin-job-1 2/2 Running 0 69s kylin-job-2 2/2 Running 0 67s kylin-memcached-0 1/1 Running 0 131m kylin-query-0 2/2 Running 0 66m root@open-source:/home/ubuntu/kylin-kubernetes/kubernetes/example/deployment# kubectl get pod -n kylin-example NAMEREADY STATUSRESTARTS AGE kylin-job-0 2/2 Running 0 34s kylin-job-1 2/2 Running 0 76s kylin-job-2 2/2 Running 0 74s kylin-memcached-0 1/1 Running 0 131m kylin-query-0 2/2 Running 0 66m root@open-source:/home/ubuntu/kylin-kubernetes/kubernetes/example/deployment# kubectl get statefulset -n kylin-example NAME READY AGE kylin-job 3/3 115m kylin-memcached 1/1 131m kylin-query 1/1 66m root@open-source:/home/ubuntu/example/deployment# docker ps | grep kylin-job- da9c0cf239e4a9acac7280fe "/usr/local/bin/dock…" 8 minutes ago Up 8 minutes k8s_filebeat_kylin-job-0_kylin-example_26c08037-0543-4e15-9ac2-54021266a52b_0 06ff2e6a2d3e7ea27faa653f "sh -c 'cp $KYLIN_HO…" 8 minutes ago Up 8 minutes k8s_kylin_kylin-job-0_kylin-example_26c08037-0543-4e15-9ac2-54021266a52b_0 87062bb80c1bk8s.gcr.io/pause:3.2 "/pause" 8 minutes ago Up 8 minutes k8s_POD_kylin-job-0_kylin-example_26c08037-0543-4e15-9ac2-54021266a52b_0 91d96d1bee0fa9acac7280fe "/usr/local/bin/dock…" 8 minutes ago Up 8 minutes k8s_filebeat_kylin-job-2_kylin-example_93cc142c-0dc8-4e5e-886d-4408fac76c5d_0 d5d352acbb8d7ea27faa653f "sh -c 'cp $KYLIN_HO…" 8 minutes ago Up 8 minutes k8s_kylin_kylin-job-2_kylin-example_93cc142c-0dc8-4e5e-886d-4408fac76c5d_0 ad05de976d8ak8s.gcr.io/pause:3.2 "/pause" 8 minutes ago Up 8 minutes k8s_POD_kylin-job-2_kylin-example_93cc142c-0dc8-4e5e-886d-4408fac76c5d_0 41de3f26e592a9acac7280fe "/usr/local/bin/dock…" 8 minutes ago Up 8 minutes k8s_filebeat_kylin-job-1_kylin-example_b83623a1-c8a4-456f-95e3-fce19d78afb1_0 b3666e72bc7b7ea27faa653f "sh -c 'cp $KYLIN_HO…" 8 minutes ago Up 8 minutes k8s_kylin_kylin-job-1_kylin-example_b83623a1-c8a4-456f-95e3-fce19d78afb1_0 1489fd6e04dbk8s.gcr.io/pause:3.2 "/pause" 8 minutes ago Up 8 minutes k8s_POD_kylin-job-1_kylin-example_b83623a1-c8a4-456f-95e3-fce19d78afb1_0 root@open-source:/home/ubuntu/example/deployment# ``` - Instance List https://user-images.githubusercontent.com/14030549/80381674-dcaca380-88d3-11ea-9b43-96ffc452b319.png;> - Test another build https://user-images.githubusercontent.com/14030549/80383050-aa03aa80-88d5-11ea-8424-52825dd0d8cd.png;> - Force kill Active JobServer(Failover Test) ```shell root@open-source:/home/ubuntu/example/deployment# docker kill b3666e72bc7b b3666e72bc7b ``` - Check current active job server https://user-images.githubusercontent.com/14030549/80383200-df0ffd00-88d5-11ea-8474-f21de4d0a6e3.png;> - Test a third build https://user-images.githubusercontent.com/14030549/80384382-6447e180-88d7-11ea-9732-263d13d76115.png;> This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use the URL above to go to the specific comment. For queries
[GitHub] [kylin] hit-lacus edited a comment on pull request #1182: KYLIN-4446 Kylin on kubernetes in quick-start and production env
hit-lacus edited a comment on pull request #1182: URL: https://github.com/apache/kylin/pull/1182#issuecomment-619862739 ## Scale Out/In Job Service - https://kubernetes.io/docs/tasks/run-application/scale-stateful-set/ - Modify replica(from 1 to 3) and scale out job server ```shell root@open-source:/home/ubuntu/kylin-kubernetes/kubernetes/example/deployment# vim kylin-job/kylin-job-statefulset.yaml root@open-source:/home/ubuntu/kylin-kubernetes/kubernetes/example/deployment# kubectl apply -f kylin-job/ ``` - Check state of pods ```shell root@open-source:/home/ubuntu/kylin-kubernetes/kubernetes/example/deployment# kubectl get pod -n kylin-example NAMEREADY STATUSRESTARTS AGE kylin-job-0 2/2 Running 0 27s kylin-job-1 2/2 Running 0 69s kylin-job-2 2/2 Running 0 67s kylin-memcached-0 1/1 Running 0 131m kylin-query-0 2/2 Running 0 66m root@open-source:/home/ubuntu/kylin-kubernetes/kubernetes/example/deployment# kubectl get pod -n kylin-example NAMEREADY STATUSRESTARTS AGE kylin-job-0 2/2 Running 0 34s kylin-job-1 2/2 Running 0 76s kylin-job-2 2/2 Running 0 74s kylin-memcached-0 1/1 Running 0 131m kylin-query-0 2/2 Running 0 66m root@open-source:/home/ubuntu/kylin-kubernetes/kubernetes/example/deployment# kubectl get statefulset -n kylin-example NAME READY AGE kylin-job 3/3 115m kylin-memcached 1/1 131m kylin-query 1/1 66m root@open-source:/home/ubuntu/example/deployment# docker ps | grep kylin-job- da9c0cf239e4a9acac7280fe "/usr/local/bin/dock…" 8 minutes ago Up 8 minutes k8s_filebeat_kylin-job-0_kylin-example_26c08037-0543-4e15-9ac2-54021266a52b_0 06ff2e6a2d3e7ea27faa653f "sh -c 'cp $KYLIN_HO…" 8 minutes ago Up 8 minutes k8s_kylin_kylin-job-0_kylin-example_26c08037-0543-4e15-9ac2-54021266a52b_0 87062bb80c1bk8s.gcr.io/pause:3.2 "/pause" 8 minutes ago Up 8 minutes k8s_POD_kylin-job-0_kylin-example_26c08037-0543-4e15-9ac2-54021266a52b_0 91d96d1bee0fa9acac7280fe "/usr/local/bin/dock…" 8 minutes ago Up 8 minutes k8s_filebeat_kylin-job-2_kylin-example_93cc142c-0dc8-4e5e-886d-4408fac76c5d_0 d5d352acbb8d7ea27faa653f "sh -c 'cp $KYLIN_HO…" 8 minutes ago Up 8 minutes k8s_kylin_kylin-job-2_kylin-example_93cc142c-0dc8-4e5e-886d-4408fac76c5d_0 ad05de976d8ak8s.gcr.io/pause:3.2 "/pause" 8 minutes ago Up 8 minutes k8s_POD_kylin-job-2_kylin-example_93cc142c-0dc8-4e5e-886d-4408fac76c5d_0 41de3f26e592a9acac7280fe "/usr/local/bin/dock…" 8 minutes ago Up 8 minutes k8s_filebeat_kylin-job-1_kylin-example_b83623a1-c8a4-456f-95e3-fce19d78afb1_0 b3666e72bc7b7ea27faa653f "sh -c 'cp $KYLIN_HO…" 8 minutes ago Up 8 minutes k8s_kylin_kylin-job-1_kylin-example_b83623a1-c8a4-456f-95e3-fce19d78afb1_0 1489fd6e04dbk8s.gcr.io/pause:3.2 "/pause" 8 minutes ago Up 8 minutes k8s_POD_kylin-job-1_kylin-example_b83623a1-c8a4-456f-95e3-fce19d78afb1_0 root@open-source:/home/ubuntu/example/deployment# ``` - Instance List https://user-images.githubusercontent.com/14030549/80381674-dcaca380-88d3-11ea-9b43-96ffc452b319.png;> - Test another build https://user-images.githubusercontent.com/14030549/80383050-aa03aa80-88d5-11ea-8424-52825dd0d8cd.png;> - Force kill Active JobServer(Failover Test) ```shell root@open-source:/home/ubuntu/example/deployment# docker kill b3666e72bc7b b3666e72bc7b ``` - Check current active job server https://user-images.githubusercontent.com/14030549/80383200-df0ffd00-88d5-11ea-8474-f21de4d0a6e3.png;> - Test a third build https://user-images.githubusercontent.com/14030549/80384382-6447e180-88d7-11ea-9732-263d13d76115.png;> This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use the URL above to go to the specific comment. For queries about this service, please contact Infrastructure at: us...@infra.apache.org
[jira] [Commented] (KYLIN-4446) Kylin on kubernetes in a quickstart env
[ https://issues.apache.org/jira/browse/KYLIN-4446?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17093574#comment-17093574 ] ASF GitHub Bot commented on KYLIN-4446: --- hit-lacus edited a comment on pull request #1182: URL: https://github.com/apache/kylin/pull/1182#issuecomment-619862739 ## Scale Out/In Job Service - https://kubernetes.io/docs/tasks/run-application/scale-stateful-set/ - Modify replica(from 1 to 3) and scale out job server ```shell root@open-source:/home/ubuntu/kylin-kubernetes/kubernetes/example/deployment# vim kylin-job/kylin-job-statefulset.yaml root@open-source:/home/ubuntu/kylin-kubernetes/kubernetes/example/deployment# kubectl apply -f kylin-job/ ``` - Check state of pods ```shell root@open-source:/home/ubuntu/kylin-kubernetes/kubernetes/example/deployment# kubectl get pod -n kylin-example NAMEREADY STATUSRESTARTS AGE kylin-job-0 2/2 Running 0 27s kylin-job-1 2/2 Running 0 69s kylin-job-2 2/2 Running 0 67s kylin-memcached-0 1/1 Running 0 131m kylin-query-0 2/2 Running 0 66m root@open-source:/home/ubuntu/kylin-kubernetes/kubernetes/example/deployment# kubectl get pod -n kylin-example NAMEREADY STATUSRESTARTS AGE kylin-job-0 2/2 Running 0 34s kylin-job-1 2/2 Running 0 76s kylin-job-2 2/2 Running 0 74s kylin-memcached-0 1/1 Running 0 131m kylin-query-0 2/2 Running 0 66m root@open-source:/home/ubuntu/kylin-kubernetes/kubernetes/example/deployment# kubectl get statefulset -n kylin-example NAME READY AGE kylin-job 3/3 115m kylin-memcached 1/1 131m kylin-query 1/1 66m root@open-source:/home/ubuntu/example/deployment# docker ps | grep kylin-job- da9c0cf239e4a9acac7280fe "/usr/local/bin/dock…" 8 minutes ago Up 8 minutes k8s_filebeat_kylin-job-0_kylin-example_26c08037-0543-4e15-9ac2-54021266a52b_0 06ff2e6a2d3e7ea27faa653f "sh -c 'cp $KYLIN_HO…" 8 minutes ago Up 8 minutes k8s_kylin_kylin-job-0_kylin-example_26c08037-0543-4e15-9ac2-54021266a52b_0 87062bb80c1bk8s.gcr.io/pause:3.2 "/pause" 8 minutes ago Up 8 minutes k8s_POD_kylin-job-0_kylin-example_26c08037-0543-4e15-9ac2-54021266a52b_0 91d96d1bee0fa9acac7280fe "/usr/local/bin/dock…" 8 minutes ago Up 8 minutes k8s_filebeat_kylin-job-2_kylin-example_93cc142c-0dc8-4e5e-886d-4408fac76c5d_0 d5d352acbb8d7ea27faa653f "sh -c 'cp $KYLIN_HO…" 8 minutes ago Up 8 minutes k8s_kylin_kylin-job-2_kylin-example_93cc142c-0dc8-4e5e-886d-4408fac76c5d_0 ad05de976d8ak8s.gcr.io/pause:3.2 "/pause" 8 minutes ago Up 8 minutes k8s_POD_kylin-job-2_kylin-example_93cc142c-0dc8-4e5e-886d-4408fac76c5d_0 41de3f26e592a9acac7280fe "/usr/local/bin/dock…" 8 minutes ago Up 8 minutes k8s_filebeat_kylin-job-1_kylin-example_b83623a1-c8a4-456f-95e3-fce19d78afb1_0 b3666e72bc7b7ea27faa653f "sh -c 'cp $KYLIN_HO…" 8 minutes ago Up 8 minutes k8s_kylin_kylin-job-1_kylin-example_b83623a1-c8a4-456f-95e3-fce19d78afb1_0 1489fd6e04dbk8s.gcr.io/pause:3.2 "/pause" 8 minutes ago Up 8 minutes k8s_POD_kylin-job-1_kylin-example_b83623a1-c8a4-456f-95e3-fce19d78afb1_0 root@open-source:/home/ubuntu/example/deployment# ``` - Instance List https://user-images.githubusercontent.com/14030549/80381674-dcaca380-88d3-11ea-9b43-96ffc452b319.png;> - Test another build https://user-images.githubusercontent.com/14030549/80383050-aa03aa80-88d5-11ea-8424-52825dd0d8cd.png;> - Force kill Active JobServer(Failover Test) ```shell root@open-source:/home/ubuntu/example/deployment# docker kill b3666e72bc7b b3666e72bc7b ``` - Check current active job server https://user-images.githubusercontent.com/14030549/80383200-df0ffd00-88d5-11ea-8474-f21de4d0a6e3.png;> - Test a third build This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use the URL above to go to the specific comment. For queries about this service, please contact Infrastructure at: us...@infra.apache.org > Kylin on kubernetes in a
[GitHub] [kylin] hit-lacus edited a comment on pull request #1182: KYLIN-4446 Kylin on kubernetes in quick-start and production env
hit-lacus edited a comment on pull request #1182: URL: https://github.com/apache/kylin/pull/1182#issuecomment-619862739 ## Scale Out/In Job Service - https://kubernetes.io/docs/tasks/run-application/scale-stateful-set/ - Modify replica(from 1 to 3) and scale out job server ```shell root@open-source:/home/ubuntu/kylin-kubernetes/kubernetes/example/deployment# vim kylin-job/kylin-job-statefulset.yaml root@open-source:/home/ubuntu/kylin-kubernetes/kubernetes/example/deployment# kubectl apply -f kylin-job/ ``` - Check state of pods ```shell root@open-source:/home/ubuntu/kylin-kubernetes/kubernetes/example/deployment# kubectl get pod -n kylin-example NAMEREADY STATUSRESTARTS AGE kylin-job-0 2/2 Running 0 27s kylin-job-1 2/2 Running 0 69s kylin-job-2 2/2 Running 0 67s kylin-memcached-0 1/1 Running 0 131m kylin-query-0 2/2 Running 0 66m root@open-source:/home/ubuntu/kylin-kubernetes/kubernetes/example/deployment# kubectl get pod -n kylin-example NAMEREADY STATUSRESTARTS AGE kylin-job-0 2/2 Running 0 34s kylin-job-1 2/2 Running 0 76s kylin-job-2 2/2 Running 0 74s kylin-memcached-0 1/1 Running 0 131m kylin-query-0 2/2 Running 0 66m root@open-source:/home/ubuntu/kylin-kubernetes/kubernetes/example/deployment# kubectl get statefulset -n kylin-example NAME READY AGE kylin-job 3/3 115m kylin-memcached 1/1 131m kylin-query 1/1 66m root@open-source:/home/ubuntu/example/deployment# docker ps | grep kylin-job- da9c0cf239e4a9acac7280fe "/usr/local/bin/dock…" 8 minutes ago Up 8 minutes k8s_filebeat_kylin-job-0_kylin-example_26c08037-0543-4e15-9ac2-54021266a52b_0 06ff2e6a2d3e7ea27faa653f "sh -c 'cp $KYLIN_HO…" 8 minutes ago Up 8 minutes k8s_kylin_kylin-job-0_kylin-example_26c08037-0543-4e15-9ac2-54021266a52b_0 87062bb80c1bk8s.gcr.io/pause:3.2 "/pause" 8 minutes ago Up 8 minutes k8s_POD_kylin-job-0_kylin-example_26c08037-0543-4e15-9ac2-54021266a52b_0 91d96d1bee0fa9acac7280fe "/usr/local/bin/dock…" 8 minutes ago Up 8 minutes k8s_filebeat_kylin-job-2_kylin-example_93cc142c-0dc8-4e5e-886d-4408fac76c5d_0 d5d352acbb8d7ea27faa653f "sh -c 'cp $KYLIN_HO…" 8 minutes ago Up 8 minutes k8s_kylin_kylin-job-2_kylin-example_93cc142c-0dc8-4e5e-886d-4408fac76c5d_0 ad05de976d8ak8s.gcr.io/pause:3.2 "/pause" 8 minutes ago Up 8 minutes k8s_POD_kylin-job-2_kylin-example_93cc142c-0dc8-4e5e-886d-4408fac76c5d_0 41de3f26e592a9acac7280fe "/usr/local/bin/dock…" 8 minutes ago Up 8 minutes k8s_filebeat_kylin-job-1_kylin-example_b83623a1-c8a4-456f-95e3-fce19d78afb1_0 b3666e72bc7b7ea27faa653f "sh -c 'cp $KYLIN_HO…" 8 minutes ago Up 8 minutes k8s_kylin_kylin-job-1_kylin-example_b83623a1-c8a4-456f-95e3-fce19d78afb1_0 1489fd6e04dbk8s.gcr.io/pause:3.2 "/pause" 8 minutes ago Up 8 minutes k8s_POD_kylin-job-1_kylin-example_b83623a1-c8a4-456f-95e3-fce19d78afb1_0 root@open-source:/home/ubuntu/example/deployment# ``` - Instance List https://user-images.githubusercontent.com/14030549/80381674-dcaca380-88d3-11ea-9b43-96ffc452b319.png;> - Test another build https://user-images.githubusercontent.com/14030549/80383050-aa03aa80-88d5-11ea-8424-52825dd0d8cd.png;> - Force kill Active JobServer(Failover Test) ```shell root@open-source:/home/ubuntu/example/deployment# docker kill b3666e72bc7b b3666e72bc7b ``` - Check current active job server https://user-images.githubusercontent.com/14030549/80383200-df0ffd00-88d5-11ea-8474-f21de4d0a6e3.png;> - Test a third build This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use the URL above to go to the specific comment. For queries about this service, please contact Infrastructure at: us...@infra.apache.org
[GitHub] [kylin] hit-lacus edited a comment on pull request #1182: KYLIN-4446 Kylin on kubernetes in quick-start and production env
hit-lacus edited a comment on pull request #1182: URL: https://github.com/apache/kylin/pull/1182#issuecomment-619862739 ## Scale Out/In Job Service - https://kubernetes.io/docs/tasks/run-application/scale-stateful-set/ - Modify replica(from 1 to 3) ```shell root@open-source:/home/ubuntu/kylin-kubernetes/kubernetes/example/deployment# vim kylin-job/kylin-job-statefulset.yaml root@open-source:/home/ubuntu/kylin-kubernetes/kubernetes/example/deployment# kubectl apply -f kylin-job/ ``` ```shell root@open-source:/home/ubuntu/kylin-kubernetes/kubernetes/example/deployment# kubectl get pod -n kylin-example NAMEREADY STATUSRESTARTS AGE kylin-job-0 2/2 Running 0 27s kylin-job-1 2/2 Running 0 69s kylin-job-2 2/2 Running 0 67s kylin-memcached-0 1/1 Running 0 131m kylin-query-0 2/2 Running 0 66m root@open-source:/home/ubuntu/kylin-kubernetes/kubernetes/example/deployment# kubectl get pod -n kylin-example NAMEREADY STATUSRESTARTS AGE kylin-job-0 2/2 Running 0 34s kylin-job-1 2/2 Running 0 76s kylin-job-2 2/2 Running 0 74s kylin-memcached-0 1/1 Running 0 131m kylin-query-0 2/2 Running 0 66m root@open-source:/home/ubuntu/kylin-kubernetes/kubernetes/example/deployment# kubectl get statefulset -n kylin-example NAME READY AGE kylin-job 3/3 115m kylin-memcached 1/1 131m kylin-query 1/1 66m root@open-source:/home/ubuntu/example/deployment# docker ps | grep kylin-job- da9c0cf239e4a9acac7280fe "/usr/local/bin/dock…" 8 minutes ago Up 8 minutes k8s_filebeat_kylin-job-0_kylin-example_26c08037-0543-4e15-9ac2-54021266a52b_0 06ff2e6a2d3e7ea27faa653f "sh -c 'cp $KYLIN_HO…" 8 minutes ago Up 8 minutes k8s_kylin_kylin-job-0_kylin-example_26c08037-0543-4e15-9ac2-54021266a52b_0 87062bb80c1bk8s.gcr.io/pause:3.2 "/pause" 8 minutes ago Up 8 minutes k8s_POD_kylin-job-0_kylin-example_26c08037-0543-4e15-9ac2-54021266a52b_0 91d96d1bee0fa9acac7280fe "/usr/local/bin/dock…" 8 minutes ago Up 8 minutes k8s_filebeat_kylin-job-2_kylin-example_93cc142c-0dc8-4e5e-886d-4408fac76c5d_0 d5d352acbb8d7ea27faa653f "sh -c 'cp $KYLIN_HO…" 8 minutes ago Up 8 minutes k8s_kylin_kylin-job-2_kylin-example_93cc142c-0dc8-4e5e-886d-4408fac76c5d_0 ad05de976d8ak8s.gcr.io/pause:3.2 "/pause" 8 minutes ago Up 8 minutes k8s_POD_kylin-job-2_kylin-example_93cc142c-0dc8-4e5e-886d-4408fac76c5d_0 41de3f26e592a9acac7280fe "/usr/local/bin/dock…" 8 minutes ago Up 8 minutes k8s_filebeat_kylin-job-1_kylin-example_b83623a1-c8a4-456f-95e3-fce19d78afb1_0 b3666e72bc7b7ea27faa653f "sh -c 'cp $KYLIN_HO…" 8 minutes ago Up 8 minutes k8s_kylin_kylin-job-1_kylin-example_b83623a1-c8a4-456f-95e3-fce19d78afb1_0 1489fd6e04dbk8s.gcr.io/pause:3.2 "/pause" 8 minutes ago Up 8 minutes k8s_POD_kylin-job-1_kylin-example_b83623a1-c8a4-456f-95e3-fce19d78afb1_0 root@open-source:/home/ubuntu/example/deployment# ``` https://user-images.githubusercontent.com/14030549/80381674-dcaca380-88d3-11ea-9b43-96ffc452b319.png;> This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use the URL above to go to the specific comment. For queries about this service, please contact Infrastructure at: us...@infra.apache.org
[jira] [Commented] (KYLIN-4446) Kylin on kubernetes in a quickstart env
[ https://issues.apache.org/jira/browse/KYLIN-4446?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17093557#comment-17093557 ] ASF GitHub Bot commented on KYLIN-4446: --- hit-lacus edited a comment on pull request #1182: URL: https://github.com/apache/kylin/pull/1182#issuecomment-619862739 ## Scale Out/In Job Service - https://kubernetes.io/docs/tasks/run-application/scale-stateful-set/ - Modify replica(from 1 to 3) ```shell root@open-source:/home/ubuntu/kylin-kubernetes/kubernetes/example/deployment# vim kylin-job/kylin-job-statefulset.yaml root@open-source:/home/ubuntu/kylin-kubernetes/kubernetes/example/deployment# kubectl apply -f kylin-job/ ``` ```shell root@open-source:/home/ubuntu/kylin-kubernetes/kubernetes/example/deployment# kubectl get pod -n kylin-example NAMEREADY STATUSRESTARTS AGE kylin-job-0 2/2 Running 0 27s kylin-job-1 2/2 Running 0 69s kylin-job-2 2/2 Running 0 67s kylin-memcached-0 1/1 Running 0 131m kylin-query-0 2/2 Running 0 66m root@open-source:/home/ubuntu/kylin-kubernetes/kubernetes/example/deployment# kubectl get pod -n kylin-example NAMEREADY STATUSRESTARTS AGE kylin-job-0 2/2 Running 0 34s kylin-job-1 2/2 Running 0 76s kylin-job-2 2/2 Running 0 74s kylin-memcached-0 1/1 Running 0 131m kylin-query-0 2/2 Running 0 66m root@open-source:/home/ubuntu/kylin-kubernetes/kubernetes/example/deployment# kubectl get statefulset -n kylin-example NAME READY AGE kylin-job 3/3 115m kylin-memcached 1/1 131m kylin-query 1/1 66m root@open-source:/home/ubuntu/example/deployment# docker ps | grep kylin-job- da9c0cf239e4a9acac7280fe "/usr/local/bin/dock…" 8 minutes ago Up 8 minutes k8s_filebeat_kylin-job-0_kylin-example_26c08037-0543-4e15-9ac2-54021266a52b_0 06ff2e6a2d3e7ea27faa653f "sh -c 'cp $KYLIN_HO…" 8 minutes ago Up 8 minutes k8s_kylin_kylin-job-0_kylin-example_26c08037-0543-4e15-9ac2-54021266a52b_0 87062bb80c1bk8s.gcr.io/pause:3.2 "/pause" 8 minutes ago Up 8 minutes k8s_POD_kylin-job-0_kylin-example_26c08037-0543-4e15-9ac2-54021266a52b_0 91d96d1bee0fa9acac7280fe "/usr/local/bin/dock…" 8 minutes ago Up 8 minutes k8s_filebeat_kylin-job-2_kylin-example_93cc142c-0dc8-4e5e-886d-4408fac76c5d_0 d5d352acbb8d7ea27faa653f "sh -c 'cp $KYLIN_HO…" 8 minutes ago Up 8 minutes k8s_kylin_kylin-job-2_kylin-example_93cc142c-0dc8-4e5e-886d-4408fac76c5d_0 ad05de976d8ak8s.gcr.io/pause:3.2 "/pause" 8 minutes ago Up 8 minutes k8s_POD_kylin-job-2_kylin-example_93cc142c-0dc8-4e5e-886d-4408fac76c5d_0 41de3f26e592a9acac7280fe "/usr/local/bin/dock…" 8 minutes ago Up 8 minutes k8s_filebeat_kylin-job-1_kylin-example_b83623a1-c8a4-456f-95e3-fce19d78afb1_0 b3666e72bc7b7ea27faa653f "sh -c 'cp $KYLIN_HO…" 8 minutes ago Up 8 minutes k8s_kylin_kylin-job-1_kylin-example_b83623a1-c8a4-456f-95e3-fce19d78afb1_0 1489fd6e04dbk8s.gcr.io/pause:3.2 "/pause" 8 minutes ago Up 8 minutes k8s_POD_kylin-job-1_kylin-example_b83623a1-c8a4-456f-95e3-fce19d78afb1_0 root@open-source:/home/ubuntu/example/deployment# ``` https://user-images.githubusercontent.com/14030549/80381674-dcaca380-88d3-11ea-9b43-96ffc452b319.png;> This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use the URL above to go to the specific comment. For queries about this service, please contact Infrastructure at: us...@infra.apache.org > Kylin on kubernetes in a quickstart env > --- > > Key: KYLIN-4446 > URL: https://issues.apache.org/jira/browse/KYLIN-4446 > Project: Kylin > Issue Type: Sub-task > Components: Integration >Reporter: Xiaoxiang Yu >Assignee: Xiaoxiang Yu >Priority: Major > Labels: kubernetes > Fix For: v3.1.0 > > Original Estimate: 48h > Time Spent: 2h > Remaining Estimate: 46h > > For a quick-start/PoC purpose,
[jira] [Commented] (KYLIN-4446) Kylin on kubernetes in a quickstart env
[
https://issues.apache.org/jira/browse/KYLIN-4446?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17093553#comment-17093553
]
ASF GitHub Bot commented on KYLIN-4446:
---
hit-lacus edited a comment on pull request #1182:
URL: https://github.com/apache/kylin/pull/1182#issuecomment-619862739
## Scale Out/In Query Service
- https://kubernetes.io/docs/tasks/run-application/scale-stateful-set/
- Modify replica(from 1 to 3)
```shell
root@open-source:/home/ubuntu/kylin-kubernetes/kubernetes/example/deployment#
vim kylin-job/kylin-job-statefulset.yaml
root@open-source:/home/ubuntu/kylin-kubernetes/kubernetes/example/deployment#
kubectl apply -f kylin-job/
```
```shell
root@open-source:/home/ubuntu/kylin-kubernetes/kubernetes/example/deployment#
kubectl get pod -n kylin-example
NAMEREADY STATUSRESTARTS AGE
kylin-job-0 2/2 Running 0 27s
kylin-job-1 2/2 Running 0 69s
kylin-job-2 2/2 Running 0 67s
kylin-memcached-0 1/1 Running 0 131m
kylin-query-0 2/2 Running 0 66m
root@open-source:/home/ubuntu/kylin-kubernetes/kubernetes/example/deployment#
root@open-source:/home/ubuntu/kylin-kubernetes/kubernetes/example/deployment#
root@open-source:/home/ubuntu/kylin-kubernetes/kubernetes/example/deployment#
root@open-source:/home/ubuntu/kylin-kubernetes/kubernetes/example/deployment#
kubectl get pod -n kylin-example
NAMEREADY STATUSRESTARTS AGE
kylin-job-0 2/2 Running 0 34s
kylin-job-1 2/2 Running 0 76s
kylin-job-2 2/2 Running 0 74s
kylin-memcached-0 1/1 Running 0 131m
kylin-query-0 2/2 Running 0 66m
root@open-source:/home/ubuntu/kylin-kubernetes/kubernetes/example/deployment#
kubectl get statefulset -n kylin-example
NAME READY AGE
kylin-job 3/3 115m
kylin-memcached 1/1 131m
kylin-query 1/1 66m
```
https://user-images.githubusercontent.com/14030549/80381674-dcaca380-88d3-11ea-9b43-96ffc452b319.png;>
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.
For queries about this service, please contact Infrastructure at:
us...@infra.apache.org
> Kylin on kubernetes in a quickstart env
> ---
>
> Key: KYLIN-4446
> URL: https://issues.apache.org/jira/browse/KYLIN-4446
> Project: Kylin
> Issue Type: Sub-task
> Components: Integration
>Reporter: Xiaoxiang Yu
>Assignee: Xiaoxiang Yu
>Priority: Major
> Labels: kubernetes
> Fix For: v3.1.0
>
> Original Estimate: 48h
> Time Spent: 2h
> Remaining Estimate: 46h
>
> For a quick-start/PoC purpose, please consider use this template, it will
> only deploy one Kylin instance with role {color:#de350b}*ALL* {color}
--
This message was sent by Atlassian Jira
(v8.3.4#803005)
[jira] [Commented] (KYLIN-4446) Kylin on kubernetes in a quickstart env
[
https://issues.apache.org/jira/browse/KYLIN-4446?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17093554#comment-17093554
]
ASF GitHub Bot commented on KYLIN-4446:
---
hit-lacus edited a comment on pull request #1182:
URL: https://github.com/apache/kylin/pull/1182#issuecomment-619862739
## Scale Out/In Job Service
- https://kubernetes.io/docs/tasks/run-application/scale-stateful-set/
- Modify replica(from 1 to 3)
```shell
root@open-source:/home/ubuntu/kylin-kubernetes/kubernetes/example/deployment#
vim kylin-job/kylin-job-statefulset.yaml
root@open-source:/home/ubuntu/kylin-kubernetes/kubernetes/example/deployment#
kubectl apply -f kylin-job/
```
```shell
root@open-source:/home/ubuntu/kylin-kubernetes/kubernetes/example/deployment#
kubectl get pod -n kylin-example
NAMEREADY STATUSRESTARTS AGE
kylin-job-0 2/2 Running 0 27s
kylin-job-1 2/2 Running 0 69s
kylin-job-2 2/2 Running 0 67s
kylin-memcached-0 1/1 Running 0 131m
kylin-query-0 2/2 Running 0 66m
root@open-source:/home/ubuntu/kylin-kubernetes/kubernetes/example/deployment#
root@open-source:/home/ubuntu/kylin-kubernetes/kubernetes/example/deployment#
root@open-source:/home/ubuntu/kylin-kubernetes/kubernetes/example/deployment#
root@open-source:/home/ubuntu/kylin-kubernetes/kubernetes/example/deployment#
kubectl get pod -n kylin-example
NAMEREADY STATUSRESTARTS AGE
kylin-job-0 2/2 Running 0 34s
kylin-job-1 2/2 Running 0 76s
kylin-job-2 2/2 Running 0 74s
kylin-memcached-0 1/1 Running 0 131m
kylin-query-0 2/2 Running 0 66m
root@open-source:/home/ubuntu/kylin-kubernetes/kubernetes/example/deployment#
kubectl get statefulset -n kylin-example
NAME READY AGE
kylin-job 3/3 115m
kylin-memcached 1/1 131m
kylin-query 1/1 66m
```
https://user-images.githubusercontent.com/14030549/80381674-dcaca380-88d3-11ea-9b43-96ffc452b319.png;>
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.
For queries about this service, please contact Infrastructure at:
us...@infra.apache.org
> Kylin on kubernetes in a quickstart env
> ---
>
> Key: KYLIN-4446
> URL: https://issues.apache.org/jira/browse/KYLIN-4446
> Project: Kylin
> Issue Type: Sub-task
> Components: Integration
>Reporter: Xiaoxiang Yu
>Assignee: Xiaoxiang Yu
>Priority: Major
> Labels: kubernetes
> Fix For: v3.1.0
>
> Original Estimate: 48h
> Time Spent: 2h
> Remaining Estimate: 46h
>
> For a quick-start/PoC purpose, please consider use this template, it will
> only deploy one Kylin instance with role {color:#de350b}*ALL* {color}
--
This message was sent by Atlassian Jira
(v8.3.4#803005)
[GitHub] [kylin] hit-lacus edited a comment on pull request #1182: KYLIN-4446 Kylin on kubernetes in quick-start and production env
hit-lacus edited a comment on pull request #1182: URL: https://github.com/apache/kylin/pull/1182#issuecomment-619862739 ## Scale Out/In Job Service - https://kubernetes.io/docs/tasks/run-application/scale-stateful-set/ - Modify replica(from 1 to 3) ```shell root@open-source:/home/ubuntu/kylin-kubernetes/kubernetes/example/deployment# vim kylin-job/kylin-job-statefulset.yaml root@open-source:/home/ubuntu/kylin-kubernetes/kubernetes/example/deployment# kubectl apply -f kylin-job/ ``` ```shell root@open-source:/home/ubuntu/kylin-kubernetes/kubernetes/example/deployment# kubectl get pod -n kylin-example NAMEREADY STATUSRESTARTS AGE kylin-job-0 2/2 Running 0 27s kylin-job-1 2/2 Running 0 69s kylin-job-2 2/2 Running 0 67s kylin-memcached-0 1/1 Running 0 131m kylin-query-0 2/2 Running 0 66m root@open-source:/home/ubuntu/kylin-kubernetes/kubernetes/example/deployment# root@open-source:/home/ubuntu/kylin-kubernetes/kubernetes/example/deployment# root@open-source:/home/ubuntu/kylin-kubernetes/kubernetes/example/deployment# root@open-source:/home/ubuntu/kylin-kubernetes/kubernetes/example/deployment# kubectl get pod -n kylin-example NAMEREADY STATUSRESTARTS AGE kylin-job-0 2/2 Running 0 34s kylin-job-1 2/2 Running 0 76s kylin-job-2 2/2 Running 0 74s kylin-memcached-0 1/1 Running 0 131m kylin-query-0 2/2 Running 0 66m root@open-source:/home/ubuntu/kylin-kubernetes/kubernetes/example/deployment# kubectl get statefulset -n kylin-example NAME READY AGE kylin-job 3/3 115m kylin-memcached 1/1 131m kylin-query 1/1 66m ``` https://user-images.githubusercontent.com/14030549/80381674-dcaca380-88d3-11ea-9b43-96ffc452b319.png;> This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use the URL above to go to the specific comment. For queries about this service, please contact Infrastructure at: us...@infra.apache.org
[GitHub] [kylin] hit-lacus edited a comment on pull request #1182: KYLIN-4446 Kylin on kubernetes in quick-start and production env
hit-lacus edited a comment on pull request #1182: URL: https://github.com/apache/kylin/pull/1182#issuecomment-619862739 ## Scale Out/In Query Service - https://kubernetes.io/docs/tasks/run-application/scale-stateful-set/ - Modify replica(from 1 to 3) ```shell root@open-source:/home/ubuntu/kylin-kubernetes/kubernetes/example/deployment# vim kylin-job/kylin-job-statefulset.yaml root@open-source:/home/ubuntu/kylin-kubernetes/kubernetes/example/deployment# kubectl apply -f kylin-job/ ``` ```shell root@open-source:/home/ubuntu/kylin-kubernetes/kubernetes/example/deployment# kubectl get pod -n kylin-example NAMEREADY STATUSRESTARTS AGE kylin-job-0 2/2 Running 0 27s kylin-job-1 2/2 Running 0 69s kylin-job-2 2/2 Running 0 67s kylin-memcached-0 1/1 Running 0 131m kylin-query-0 2/2 Running 0 66m root@open-source:/home/ubuntu/kylin-kubernetes/kubernetes/example/deployment# root@open-source:/home/ubuntu/kylin-kubernetes/kubernetes/example/deployment# root@open-source:/home/ubuntu/kylin-kubernetes/kubernetes/example/deployment# root@open-source:/home/ubuntu/kylin-kubernetes/kubernetes/example/deployment# kubectl get pod -n kylin-example NAMEREADY STATUSRESTARTS AGE kylin-job-0 2/2 Running 0 34s kylin-job-1 2/2 Running 0 76s kylin-job-2 2/2 Running 0 74s kylin-memcached-0 1/1 Running 0 131m kylin-query-0 2/2 Running 0 66m root@open-source:/home/ubuntu/kylin-kubernetes/kubernetes/example/deployment# kubectl get statefulset -n kylin-example NAME READY AGE kylin-job 3/3 115m kylin-memcached 1/1 131m kylin-query 1/1 66m ``` https://user-images.githubusercontent.com/14030549/80381674-dcaca380-88d3-11ea-9b43-96ffc452b319.png;> This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use the URL above to go to the specific comment. For queries about this service, please contact Infrastructure at: us...@infra.apache.org
[jira] [Commented] (KYLIN-4446) Kylin on kubernetes in a quickstart env
[
https://issues.apache.org/jira/browse/KYLIN-4446?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17093549#comment-17093549
]
ASF GitHub Bot commented on KYLIN-4446:
---
hit-lacus edited a comment on pull request #1182:
URL: https://github.com/apache/kylin/pull/1182#issuecomment-619862739
## Scale Out/In Query Service
- https://kubernetes.io/docs/tasks/run-application/scale-stateful-set/
- Modify replica
```shell
root@open-source:/home/ubuntu/kylin-kubernetes/kubernetes/example/deployment#
vim kylin-job/kylin-job-statefulset.yaml
root@open-source:/home/ubuntu/kylin-kubernetes/kubernetes/example/deployment#
kubectl apply -f kylin-job/
```
```shell
root@open-source:/home/ubuntu/kylin-kubernetes/kubernetes/example/deployment#
kubectl get pod -n kylin-example
NAMEREADY STATUSRESTARTS AGE
kylin-job-0 2/2 Running 0 27s
kylin-job-1 2/2 Running 0 69s
kylin-job-2 2/2 Running 0 67s
kylin-memcached-0 1/1 Running 0 131m
kylin-query-0 2/2 Running 0 66m
root@open-source:/home/ubuntu/kylin-kubernetes/kubernetes/example/deployment#
root@open-source:/home/ubuntu/kylin-kubernetes/kubernetes/example/deployment#
root@open-source:/home/ubuntu/kylin-kubernetes/kubernetes/example/deployment#
root@open-source:/home/ubuntu/kylin-kubernetes/kubernetes/example/deployment#
kubectl get pod -n kylin-example
NAMEREADY STATUSRESTARTS AGE
kylin-job-0 2/2 Running 0 34s
kylin-job-1 2/2 Running 0 76s
kylin-job-2 2/2 Running 0 74s
kylin-memcached-0 1/1 Running 0 131m
kylin-query-0 2/2 Running 0 66m
root@open-source:/home/ubuntu/kylin-kubernetes/kubernetes/example/deployment#
kubectl get statefulset -n kylin-example
NAME READY AGE
kylin-job 3/3 115m
kylin-memcached 1/1 131m
kylin-query 1/1 66m
```
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.
For queries about this service, please contact Infrastructure at:
us...@infra.apache.org
> Kylin on kubernetes in a quickstart env
> ---
>
> Key: KYLIN-4446
> URL: https://issues.apache.org/jira/browse/KYLIN-4446
> Project: Kylin
> Issue Type: Sub-task
> Components: Integration
>Reporter: Xiaoxiang Yu
>Assignee: Xiaoxiang Yu
>Priority: Major
> Labels: kubernetes
> Fix For: v3.1.0
>
> Original Estimate: 48h
> Time Spent: 2h
> Remaining Estimate: 46h
>
> For a quick-start/PoC purpose, please consider use this template, it will
> only deploy one Kylin instance with role {color:#de350b}*ALL* {color}
--
This message was sent by Atlassian Jira
(v8.3.4#803005)
[GitHub] [kylin] hit-lacus edited a comment on pull request #1182: KYLIN-4446 Kylin on kubernetes in quick-start and production env
hit-lacus edited a comment on pull request #1182: URL: https://github.com/apache/kylin/pull/1182#issuecomment-619862739 ## Scale Out/In Query Service - https://kubernetes.io/docs/tasks/run-application/scale-stateful-set/ - Modify replica ```shell root@open-source:/home/ubuntu/kylin-kubernetes/kubernetes/example/deployment# vim kylin-job/kylin-job-statefulset.yaml root@open-source:/home/ubuntu/kylin-kubernetes/kubernetes/example/deployment# kubectl apply -f kylin-job/ ``` ```shell root@open-source:/home/ubuntu/kylin-kubernetes/kubernetes/example/deployment# kubectl get pod -n kylin-example NAMEREADY STATUSRESTARTS AGE kylin-job-0 2/2 Running 0 27s kylin-job-1 2/2 Running 0 69s kylin-job-2 2/2 Running 0 67s kylin-memcached-0 1/1 Running 0 131m kylin-query-0 2/2 Running 0 66m root@open-source:/home/ubuntu/kylin-kubernetes/kubernetes/example/deployment# root@open-source:/home/ubuntu/kylin-kubernetes/kubernetes/example/deployment# root@open-source:/home/ubuntu/kylin-kubernetes/kubernetes/example/deployment# root@open-source:/home/ubuntu/kylin-kubernetes/kubernetes/example/deployment# kubectl get pod -n kylin-example NAMEREADY STATUSRESTARTS AGE kylin-job-0 2/2 Running 0 34s kylin-job-1 2/2 Running 0 76s kylin-job-2 2/2 Running 0 74s kylin-memcached-0 1/1 Running 0 131m kylin-query-0 2/2 Running 0 66m root@open-source:/home/ubuntu/kylin-kubernetes/kubernetes/example/deployment# kubectl get statefulset -n kylin-example NAME READY AGE kylin-job 3/3 115m kylin-memcached 1/1 131m kylin-query 1/1 66m ``` This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use the URL above to go to the specific comment. For queries about this service, please contact Infrastructure at: us...@infra.apache.org
[jira] [Commented] (KYLIN-4446) Kylin on kubernetes in a quickstart env
[
https://issues.apache.org/jira/browse/KYLIN-4446?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17093545#comment-17093545
]
ASF GitHub Bot commented on KYLIN-4446:
---
hit-lacus edited a comment on pull request #1182:
URL: https://github.com/apache/kylin/pull/1182#issuecomment-619862275
## Test Kylin Query Service
- Instance List
https://user-images.githubusercontent.com/14030549/80373561-d4e70200-88c7-11ea-9387-55f8125c69b9.png;>
- Test Query 1
https://user-images.githubusercontent.com/14030549/80374180-d8c75400-88c8-11ea-8c15-dccdb335fdb4.png;>
- Test Query 2
https://user-images.githubusercontent.com/14030549/80380959-d0741680-88d2-11ea-8a94-963e1f0f2d13.png;>
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.
For queries about this service, please contact Infrastructure at:
us...@infra.apache.org
> Kylin on kubernetes in a quickstart env
> ---
>
> Key: KYLIN-4446
> URL: https://issues.apache.org/jira/browse/KYLIN-4446
> Project: Kylin
> Issue Type: Sub-task
> Components: Integration
>Reporter: Xiaoxiang Yu
>Assignee: Xiaoxiang Yu
>Priority: Major
> Labels: kubernetes
> Fix For: v3.1.0
>
> Original Estimate: 48h
> Time Spent: 2h
> Remaining Estimate: 46h
>
> For a quick-start/PoC purpose, please consider use this template, it will
> only deploy one Kylin instance with role {color:#de350b}*ALL* {color}
--
This message was sent by Atlassian Jira
(v8.3.4#803005)
[GitHub] [kylin] hit-lacus edited a comment on pull request #1182: KYLIN-4446 Kylin on kubernetes in quick-start and production env
hit-lacus edited a comment on pull request #1182: URL: https://github.com/apache/kylin/pull/1182#issuecomment-619862275 ## Test Kylin Query Service - Instance List https://user-images.githubusercontent.com/14030549/80373561-d4e70200-88c7-11ea-9387-55f8125c69b9.png;> - Test Query 1 https://user-images.githubusercontent.com/14030549/80374180-d8c75400-88c8-11ea-8c15-dccdb335fdb4.png;> - Test Query 2 https://user-images.githubusercontent.com/14030549/80380959-d0741680-88d2-11ea-8a94-963e1f0f2d13.png;> This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use the URL above to go to the specific comment. For queries about this service, please contact Infrastructure at: us...@infra.apache.org
[jira] [Commented] (KYLIN-4446) Kylin on kubernetes in a quickstart env
[
https://issues.apache.org/jira/browse/KYLIN-4446?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17093536#comment-17093536
]
ASF GitHub Bot commented on KYLIN-4446:
---
coveralls edited a comment on pull request #1182:
URL: https://github.com/apache/kylin/pull/1182#issuecomment-617824003
## Pull Request Test Coverage Report for [Build
5858](https://coveralls.io/builds/30370682)
* **0** of **0** changed or added relevant lines in **0** files are
covered.
* **6** unchanged lines in **2** files lost coverage.
* Overall coverage decreased (**-0.001%**) to **27.465%**
---
| Files with Coverage Reduction | New Missed Lines | % |
| :-|--|--: |
|
[stream-core/src/main/java/org/apache/kylin/stream/core/storage/columnar/ColumnarStoreCache.java](https://coveralls.io/builds/30370682/source?filename=stream-core%2Fsrc%2Fmain%2Fjava%2Forg%2Fapache%2Fkylin%2Fstream%2Fcore%2Fstorage%2Fcolumnar%2FColumnarStoreCache.java#L146)
| 1 | 56.82% |
|
[core-cube/src/main/java/org/apache/kylin/cube/inmemcubing/MemDiskStore.java](https://coveralls.io/builds/30370682/source?filename=core-cube%2Fsrc%2Fmain%2Fjava%2Forg%2Fapache%2Fkylin%2Fcube%2Finmemcubing%2FMemDiskStore.java#L439)
| 5 | 77.81% |
| Totals | [](https://coveralls.io/builds/30370682)
|
| :-- | --: |
| Change from base [Build 5853](https://coveralls.io/builds/30348545): |
-0.001% |
| Covered Lines: | 24315 |
| Relevant Lines: | 88532 |
---
# - [Coveralls](https://coveralls.io)
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.
For queries about this service, please contact Infrastructure at:
us...@infra.apache.org
> Kylin on kubernetes in a quickstart env
> ---
>
> Key: KYLIN-4446
> URL: https://issues.apache.org/jira/browse/KYLIN-4446
> Project: Kylin
> Issue Type: Sub-task
> Components: Integration
>Reporter: Xiaoxiang Yu
>Assignee: Xiaoxiang Yu
>Priority: Major
> Labels: kubernetes
> Fix For: v3.1.0
>
> Original Estimate: 48h
> Time Spent: 2h
> Remaining Estimate: 46h
>
> For a quick-start/PoC purpose, please consider use this template, it will
> only deploy one Kylin instance with role {color:#de350b}*ALL* {color}
--
This message was sent by Atlassian Jira
(v8.3.4#803005)
[GitHub] [kylin] coveralls edited a comment on pull request #1182: KYLIN-4446 Kylin on kubernetes in quick-start and production env
coveralls edited a comment on pull request #1182: URL: https://github.com/apache/kylin/pull/1182#issuecomment-617824003 ## Pull Request Test Coverage Report for [Build 5858](https://coveralls.io/builds/30370682) * **0** of **0** changed or added relevant lines in **0** files are covered. * **6** unchanged lines in **2** files lost coverage. * Overall coverage decreased (**-0.001%**) to **27.465%** --- | Files with Coverage Reduction | New Missed Lines | % | | :-|--|--: | | [stream-core/src/main/java/org/apache/kylin/stream/core/storage/columnar/ColumnarStoreCache.java](https://coveralls.io/builds/30370682/source?filename=stream-core%2Fsrc%2Fmain%2Fjava%2Forg%2Fapache%2Fkylin%2Fstream%2Fcore%2Fstorage%2Fcolumnar%2FColumnarStoreCache.java#L146) | 1 | 56.82% | | [core-cube/src/main/java/org/apache/kylin/cube/inmemcubing/MemDiskStore.java](https://coveralls.io/builds/30370682/source?filename=core-cube%2Fsrc%2Fmain%2Fjava%2Forg%2Fapache%2Fkylin%2Fcube%2Finmemcubing%2FMemDiskStore.java#L439) | 5 | 77.81% | | Totals | [](https://coveralls.io/builds/30370682) | | :-- | --: | | Change from base [Build 5853](https://coveralls.io/builds/30348545): | -0.001% | | Covered Lines: | 24315 | | Relevant Lines: | 88532 | --- # - [Coveralls](https://coveralls.io) This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use the URL above to go to the specific comment. For queries about this service, please contact Infrastructure at: us...@infra.apache.org
[jira] [Commented] (KYLIN-4446) Kylin on kubernetes in a quickstart env
[
https://issues.apache.org/jira/browse/KYLIN-4446?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17093485#comment-17093485
]
ASF GitHub Bot commented on KYLIN-4446:
---
hit-lacus edited a comment on pull request #1182:
URL: https://github.com/apache/kylin/pull/1182#issuecomment-619862275
## Test Kylin Query Service
- Instance List
https://user-images.githubusercontent.com/14030549/80373561-d4e70200-88c7-11ea-9387-55f8125c69b9.png;>
- Test Query 1
https://user-images.githubusercontent.com/14030549/80374180-d8c75400-88c8-11ea-8c15-dccdb335fdb4.png;>
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.
For queries about this service, please contact Infrastructure at:
us...@infra.apache.org
> Kylin on kubernetes in a quickstart env
> ---
>
> Key: KYLIN-4446
> URL: https://issues.apache.org/jira/browse/KYLIN-4446
> Project: Kylin
> Issue Type: Sub-task
> Components: Integration
>Reporter: Xiaoxiang Yu
>Assignee: Xiaoxiang Yu
>Priority: Major
> Labels: kubernetes
> Fix For: v3.1.0
>
> Original Estimate: 48h
> Time Spent: 2h
> Remaining Estimate: 46h
>
> For a quick-start/PoC purpose, please consider use this template, it will
> only deploy one Kylin instance with role {color:#de350b}*ALL* {color}
--
This message was sent by Atlassian Jira
(v8.3.4#803005)
[GitHub] [kylin] hit-lacus edited a comment on pull request #1182: KYLIN-4446 Kylin on kubernetes in quick-start and production env
hit-lacus edited a comment on pull request #1182: URL: https://github.com/apache/kylin/pull/1182#issuecomment-619862275 ## Test Kylin Query Service - Instance List https://user-images.githubusercontent.com/14030549/80373561-d4e70200-88c7-11ea-9387-55f8125c69b9.png;> - Test Query 1 https://user-images.githubusercontent.com/14030549/80374180-d8c75400-88c8-11ea-8c15-dccdb335fdb4.png;> This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use the URL above to go to the specific comment. For queries about this service, please contact Infrastructure at: us...@infra.apache.org
[jira] [Commented] (KYLIN-4446) Kylin on kubernetes in a quickstart env
[
https://issues.apache.org/jira/browse/KYLIN-4446?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17093466#comment-17093466
]
ASF GitHub Bot commented on KYLIN-4446:
---
hit-lacus edited a comment on pull request #1182:
URL: https://github.com/apache/kylin/pull/1182#issuecomment-619862275
## Test Kylin Query Service
- Instance List
https://user-images.githubusercontent.com/14030549/80373561-d4e70200-88c7-11ea-9387-55f8125c69b9.png;>
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.
For queries about this service, please contact Infrastructure at:
us...@infra.apache.org
> Kylin on kubernetes in a quickstart env
> ---
>
> Key: KYLIN-4446
> URL: https://issues.apache.org/jira/browse/KYLIN-4446
> Project: Kylin
> Issue Type: Sub-task
> Components: Integration
>Reporter: Xiaoxiang Yu
>Assignee: Xiaoxiang Yu
>Priority: Major
> Labels: kubernetes
> Fix For: v3.1.0
>
> Original Estimate: 48h
> Time Spent: 2h
> Remaining Estimate: 46h
>
> For a quick-start/PoC purpose, please consider use this template, it will
> only deploy one Kylin instance with role {color:#de350b}*ALL* {color}
--
This message was sent by Atlassian Jira
(v8.3.4#803005)
[jira] [Commented] (KYLIN-4446) Kylin on kubernetes in a quickstart env
[
https://issues.apache.org/jira/browse/KYLIN-4446?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17093463#comment-17093463
]
ASF GitHub Bot commented on KYLIN-4446:
---
hit-lacus edited a comment on pull request #1182:
URL: https://github.com/apache/kylin/pull/1182#issuecomment-619862166
## Create Kylin Query Service
```shell
root@open-source:/home/ubuntu/kylin-kubernetes/kubernetes/example/deployment#
kubectl create configmap -n kylin-example kylin-query-config \
> --from-file=../config/kylin-query/kylin-kafka-consumer.xml \
> --from-file=../config/kylin-query/kylin_hive_conf.xml \
> --from-file=../config/kylin-query/kylin_job_conf.xml \
> --from-file=../config/kylin-query/kylin_job_conf_inmem.xml \
> --from-file=../config/kylin-query/kylin-server-log4j.properties \
> --from-file=../config/kylin-query/kylin-spark-log4j.properties \
> --from-file=../config/kylin-query/kylin-tools-log4j.properties \
> --from-file=../config/kylin-query/kylin.properties \
> --from-file=../config/kylin-query/setenv.sh \
> --from-file=../config/kylin-query/setenv-tool.sh \
> --dry-run -o yaml | kubectl apply -f -
W0427 12:36:38.484197 10902 helpers.go:535] --dry-run is deprecated and
can be replaced with --dry-run=client.
configmap/kylin-query-config configured
root@open-source:/home/ubuntu/kylin-kubernetes/kubernetes/example/deployment#
kubectl apply -f kylin-query
service/kylin-query-svc created
statefulset.apps/kylin-query created
root@open-source:/home/ubuntu/kylin-kubernetes/kubernetes/example/deployment#
kubectl get pod -n kylin-example
NAMEREADY STATUSRESTARTS AGE
kylin-job-0 2/2 Running 0 28m
kylin-memcached-0 1/1 Running 0 44m
kylin-query-0 2/2 Running 0 11s
root@open-source:/home/ubuntu/kylin-kubernetes/kubernetes/example/deployment#
kubectl get statefulset -n kylin-example
NAME READY AGE
kylin-job 1/1 28m
kylin-memcached 1/1 44m
kylin-query 1/1 19s
```
- Go to Web UI http://cloud:30012/kylin/admin
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.
For queries about this service, please contact Infrastructure at:
us...@infra.apache.org
> Kylin on kubernetes in a quickstart env
> ---
>
> Key: KYLIN-4446
> URL: https://issues.apache.org/jira/browse/KYLIN-4446
> Project: Kylin
> Issue Type: Sub-task
> Components: Integration
>Reporter: Xiaoxiang Yu
>Assignee: Xiaoxiang Yu
>Priority: Major
> Labels: kubernetes
> Fix For: v3.1.0
>
> Original Estimate: 48h
> Time Spent: 2h
> Remaining Estimate: 46h
>
> For a quick-start/PoC purpose, please consider use this template, it will
> only deploy one Kylin instance with role {color:#de350b}*ALL* {color}
--
This message was sent by Atlassian Jira
(v8.3.4#803005)
[GitHub] [kylin] hit-lacus edited a comment on pull request #1182: KYLIN-4446 Kylin on kubernetes in quick-start and production env
hit-lacus edited a comment on pull request #1182: URL: https://github.com/apache/kylin/pull/1182#issuecomment-619862166 ## Create Kylin Query Service ```shell root@open-source:/home/ubuntu/kylin-kubernetes/kubernetes/example/deployment# kubectl create configmap -n kylin-example kylin-query-config \ > --from-file=../config/kylin-query/kylin-kafka-consumer.xml \ > --from-file=../config/kylin-query/kylin_hive_conf.xml \ > --from-file=../config/kylin-query/kylin_job_conf.xml \ > --from-file=../config/kylin-query/kylin_job_conf_inmem.xml \ > --from-file=../config/kylin-query/kylin-server-log4j.properties \ > --from-file=../config/kylin-query/kylin-spark-log4j.properties \ > --from-file=../config/kylin-query/kylin-tools-log4j.properties \ > --from-file=../config/kylin-query/kylin.properties \ > --from-file=../config/kylin-query/setenv.sh \ > --from-file=../config/kylin-query/setenv-tool.sh \ > --dry-run -o yaml | kubectl apply -f - W0427 12:36:38.484197 10902 helpers.go:535] --dry-run is deprecated and can be replaced with --dry-run=client. configmap/kylin-query-config configured root@open-source:/home/ubuntu/kylin-kubernetes/kubernetes/example/deployment# kubectl apply -f kylin-query service/kylin-query-svc created statefulset.apps/kylin-query created root@open-source:/home/ubuntu/kylin-kubernetes/kubernetes/example/deployment# kubectl get pod -n kylin-example NAMEREADY STATUSRESTARTS AGE kylin-job-0 2/2 Running 0 28m kylin-memcached-0 1/1 Running 0 44m kylin-query-0 2/2 Running 0 11s root@open-source:/home/ubuntu/kylin-kubernetes/kubernetes/example/deployment# kubectl get statefulset -n kylin-example NAME READY AGE kylin-job 1/1 28m kylin-memcached 1/1 44m kylin-query 1/1 19s ``` - Go to Web UI http://cloud:30012/kylin/admin This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use the URL above to go to the specific comment. For queries about this service, please contact Infrastructure at: us...@infra.apache.org
[GitHub] [kylin] hit-lacus edited a comment on pull request #1182: KYLIN-4446 Kylin on kubernetes in quick-start and production env
hit-lacus edited a comment on pull request #1182: URL: https://github.com/apache/kylin/pull/1182#issuecomment-619862275 ## Test Kylin Query Service - Instance List https://user-images.githubusercontent.com/14030549/80373561-d4e70200-88c7-11ea-9387-55f8125c69b9.png;> This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use the URL above to go to the specific comment. For queries about this service, please contact Infrastructure at: us...@infra.apache.org
[jira] [Commented] (KYLIN-4446) Kylin on kubernetes in a quickstart env
[
https://issues.apache.org/jira/browse/KYLIN-4446?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17093459#comment-17093459
]
ASF GitHub Bot commented on KYLIN-4446:
---
hit-lacus edited a comment on pull request #1182:
URL: https://github.com/apache/kylin/pull/1182#issuecomment-619862166
## Create Kylin Query Service
```shell
root@open-source:/home/ubuntu/kylin-kubernetes/kubernetes/example/deployment#
kubectl create configmap -n kylin-example kylin-query-config \
> --from-file=../config/kylin-query/kylin-kafka-consumer.xml \
> --from-file=../config/kylin-query/kylin_hive_conf.xml \
> --from-file=../config/kylin-query/kylin_job_conf.xml \
> --from-file=../config/kylin-query/kylin_job_conf_inmem.xml \
> --from-file=../config/kylin-query/kylin-server-log4j.properties \
> --from-file=../config/kylin-query/kylin-spark-log4j.properties \
> --from-file=../config/kylin-query/kylin-tools-log4j.properties \
> --from-file=../config/kylin-query/kylin.properties \
> --from-file=../config/kylin-query/setenv.sh \
> --from-file=../config/kylin-query/setenv-tool.sh \
> --dry-run -o yaml | kubectl apply -f -
W0427 12:36:38.484197 10902 helpers.go:535] --dry-run is deprecated and
can be replaced with --dry-run=client.
configmap/kylin-query-config configured
root@open-source:/home/ubuntu/kylin-kubernetes/kubernetes/example/deployment#
kubectl apply -f kylin-query
service/kylin-query-svc created
statefulset.apps/kylin-query created
root@open-source:/home/ubuntu/kylin-kubernetes/kubernetes/example/deployment#
kubectl get pod -n kylin-example
NAMEREADY STATUSRESTARTS AGE
kylin-job-0 2/2 Running 0 28m
kylin-memcached-0 1/1 Running 0 44m
kylin-query-0 2/2 Running 0 11s
root@open-source:/home/ubuntu/kylin-kubernetes/kubernetes/example/deployment#
kubectl get statefulset -n kylin-example
NAME READY AGE
kylin-job 1/1 28m
kylin-memcached 1/1 44m
kylin-query 1/1 19s
```
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.
For queries about this service, please contact Infrastructure at:
us...@infra.apache.org
> Kylin on kubernetes in a quickstart env
> ---
>
> Key: KYLIN-4446
> URL: https://issues.apache.org/jira/browse/KYLIN-4446
> Project: Kylin
> Issue Type: Sub-task
> Components: Integration
>Reporter: Xiaoxiang Yu
>Assignee: Xiaoxiang Yu
>Priority: Major
> Labels: kubernetes
> Fix For: v3.1.0
>
> Original Estimate: 48h
> Time Spent: 2h
> Remaining Estimate: 46h
>
> For a quick-start/PoC purpose, please consider use this template, it will
> only deploy one Kylin instance with role {color:#de350b}*ALL* {color}
--
This message was sent by Atlassian Jira
(v8.3.4#803005)
[GitHub] [kylin] hit-lacus edited a comment on pull request #1182: KYLIN-4446 Kylin on kubernetes in quick-start and production env
hit-lacus edited a comment on pull request #1182: URL: https://github.com/apache/kylin/pull/1182#issuecomment-619862166 ## Create Kylin Query Service ```shell root@open-source:/home/ubuntu/kylin-kubernetes/kubernetes/example/deployment# kubectl create configmap -n kylin-example kylin-query-config \ > --from-file=../config/kylin-query/kylin-kafka-consumer.xml \ > --from-file=../config/kylin-query/kylin_hive_conf.xml \ > --from-file=../config/kylin-query/kylin_job_conf.xml \ > --from-file=../config/kylin-query/kylin_job_conf_inmem.xml \ > --from-file=../config/kylin-query/kylin-server-log4j.properties \ > --from-file=../config/kylin-query/kylin-spark-log4j.properties \ > --from-file=../config/kylin-query/kylin-tools-log4j.properties \ > --from-file=../config/kylin-query/kylin.properties \ > --from-file=../config/kylin-query/setenv.sh \ > --from-file=../config/kylin-query/setenv-tool.sh \ > --dry-run -o yaml | kubectl apply -f - W0427 12:36:38.484197 10902 helpers.go:535] --dry-run is deprecated and can be replaced with --dry-run=client. configmap/kylin-query-config configured root@open-source:/home/ubuntu/kylin-kubernetes/kubernetes/example/deployment# kubectl apply -f kylin-query service/kylin-query-svc created statefulset.apps/kylin-query created root@open-source:/home/ubuntu/kylin-kubernetes/kubernetes/example/deployment# kubectl get pod -n kylin-example NAMEREADY STATUSRESTARTS AGE kylin-job-0 2/2 Running 0 28m kylin-memcached-0 1/1 Running 0 44m kylin-query-0 2/2 Running 0 11s root@open-source:/home/ubuntu/kylin-kubernetes/kubernetes/example/deployment# kubectl get statefulset -n kylin-example NAME READY AGE kylin-job 1/1 28m kylin-memcached 1/1 44m kylin-query 1/1 19s ``` This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use the URL above to go to the specific comment. For queries about this service, please contact Infrastructure at: us...@infra.apache.org
[jira] [Commented] (KYLIN-4446) Kylin on kubernetes in a quickstart env
[
https://issues.apache.org/jira/browse/KYLIN-4446?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17093458#comment-17093458
]
ASF GitHub Bot commented on KYLIN-4446:
---
hit-lacus edited a comment on pull request #1182:
URL: https://github.com/apache/kylin/pull/1182#issuecomment-619862064
## Test Kylin Job Service
- Instance List
https://user-images.githubusercontent.com/14030549/80372342-fcd56600-88c5-11ea-9552-a06878129169.png;>
- Create sample model/cube
https://user-images.githubusercontent.com/14030549/80372032-6e60e480-88c5-11ea-8000-c6bffd328073.png;>
- Submit job and build succeed
https://user-images.githubusercontent.com/14030549/80372793-a74d8900-88c6-11ea-93da-3360cf4bd2f1.png;>
https://user-images.githubusercontent.com/14030549/80372979-f5628c80-88c6-11ea-95cd-b0f49521c178.png;>
https://user-images.githubusercontent.com/14030549/80373078-19be6900-88c7-11ea-96fa-61fd64917a16.png;>
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.
For queries about this service, please contact Infrastructure at:
us...@infra.apache.org
> Kylin on kubernetes in a quickstart env
> ---
>
> Key: KYLIN-4446
> URL: https://issues.apache.org/jira/browse/KYLIN-4446
> Project: Kylin
> Issue Type: Sub-task
> Components: Integration
>Reporter: Xiaoxiang Yu
>Assignee: Xiaoxiang Yu
>Priority: Major
> Labels: kubernetes
> Fix For: v3.1.0
>
> Original Estimate: 48h
> Time Spent: 2h
> Remaining Estimate: 46h
>
> For a quick-start/PoC purpose, please consider use this template, it will
> only deploy one Kylin instance with role {color:#de350b}*ALL* {color}
--
This message was sent by Atlassian Jira
(v8.3.4#803005)
[GitHub] [kylin] hit-lacus edited a comment on pull request #1182: KYLIN-4446 Kylin on kubernetes in quick-start and production env
hit-lacus edited a comment on pull request #1182: URL: https://github.com/apache/kylin/pull/1182#issuecomment-619862064 ## Test Kylin Job Service - Instance List https://user-images.githubusercontent.com/14030549/80372342-fcd56600-88c5-11ea-9552-a06878129169.png;> - Create sample model/cube https://user-images.githubusercontent.com/14030549/80372032-6e60e480-88c5-11ea-8000-c6bffd328073.png;> - Submit job and build succeed https://user-images.githubusercontent.com/14030549/80372793-a74d8900-88c6-11ea-93da-3360cf4bd2f1.png;> https://user-images.githubusercontent.com/14030549/80372979-f5628c80-88c6-11ea-95cd-b0f49521c178.png;> https://user-images.githubusercontent.com/14030549/80373078-19be6900-88c7-11ea-96fa-61fd64917a16.png;> This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use the URL above to go to the specific comment. For queries about this service, please contact Infrastructure at: us...@infra.apache.org
[jira] [Commented] (KYLIN-4446) Kylin on kubernetes in a quickstart env
[
https://issues.apache.org/jira/browse/KYLIN-4446?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17093455#comment-17093455
]
ASF GitHub Bot commented on KYLIN-4446:
---
hit-lacus edited a comment on pull request #1182:
URL: https://github.com/apache/kylin/pull/1182#issuecomment-619862064
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.
For queries about this service, please contact Infrastructure at:
us...@infra.apache.org
> Kylin on kubernetes in a quickstart env
> ---
>
> Key: KYLIN-4446
> URL: https://issues.apache.org/jira/browse/KYLIN-4446
> Project: Kylin
> Issue Type: Sub-task
> Components: Integration
>Reporter: Xiaoxiang Yu
>Assignee: Xiaoxiang Yu
>Priority: Major
> Labels: kubernetes
> Fix For: v3.1.0
>
> Original Estimate: 48h
> Time Spent: 2h
> Remaining Estimate: 46h
>
> For a quick-start/PoC purpose, please consider use this template, it will
> only deploy one Kylin instance with role {color:#de350b}*ALL* {color}
--
This message was sent by Atlassian Jira
(v8.3.4#803005)
[GitHub] [kylin] hit-lacus edited a comment on pull request #1182: KYLIN-4446 Kylin on kubernetes in quick-start and production env
hit-lacus edited a comment on pull request #1182: URL: https://github.com/apache/kylin/pull/1182#issuecomment-619862064 This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use the URL above to go to the specific comment. For queries about this service, please contact Infrastructure at: us...@infra.apache.org
[jira] [Commented] (KYLIN-4446) Kylin on kubernetes in a quickstart env
[
https://issues.apache.org/jira/browse/KYLIN-4446?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17093450#comment-17093450
]
ASF GitHub Bot commented on KYLIN-4446:
---
hit-lacus edited a comment on pull request #1182:
URL: https://github.com/apache/kylin/pull/1182#issuecomment-619862064
## Test Kylin Job Service
- Instance List
https://user-images.githubusercontent.com/14030549/80372342-fcd56600-88c5-11ea-9552-a06878129169.png;>
- Create sample model/cube
https://user-images.githubusercontent.com/14030549/80372032-6e60e480-88c5-11ea-8000-c6bffd328073.png;>
- Submit job and build succeed
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.
For queries about this service, please contact Infrastructure at:
us...@infra.apache.org
> Kylin on kubernetes in a quickstart env
> ---
>
> Key: KYLIN-4446
> URL: https://issues.apache.org/jira/browse/KYLIN-4446
> Project: Kylin
> Issue Type: Sub-task
> Components: Integration
>Reporter: Xiaoxiang Yu
>Assignee: Xiaoxiang Yu
>Priority: Major
> Labels: kubernetes
> Fix For: v3.1.0
>
> Original Estimate: 48h
> Time Spent: 2h
> Remaining Estimate: 46h
>
> For a quick-start/PoC purpose, please consider use this template, it will
> only deploy one Kylin instance with role {color:#de350b}*ALL* {color}
--
This message was sent by Atlassian Jira
(v8.3.4#803005)
[GitHub] [kylin] hit-lacus edited a comment on pull request #1182: KYLIN-4446 Kylin on kubernetes in quick-start and production env
hit-lacus edited a comment on pull request #1182: URL: https://github.com/apache/kylin/pull/1182#issuecomment-619862064 ## Test Kylin Job Service - Instance List https://user-images.githubusercontent.com/14030549/80372342-fcd56600-88c5-11ea-9552-a06878129169.png;> - Create sample model/cube https://user-images.githubusercontent.com/14030549/80372032-6e60e480-88c5-11ea-8000-c6bffd328073.png;> - Submit job and build succeed This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use the URL above to go to the specific comment. For queries about this service, please contact Infrastructure at: us...@infra.apache.org
[jira] [Commented] (KYLIN-4446) Kylin on kubernetes in a quickstart env
[ https://issues.apache.org/jira/browse/KYLIN-4446?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17093433#comment-17093433 ] ASF GitHub Bot commented on KYLIN-4446: --- hit-lacus edited a comment on pull request #1182: URL: https://github.com/apache/kylin/pull/1182#issuecomment-619861990 ## Create Kylin Job Service - Change configuration of memcached related(part-1) ```shell # kylin.cache.memcached.hosts=cache-svc.kylin-example.svc.cluster.local:11211 root@open-source:/home/ubuntu/kylin-kubernetes/kubernetes/example/deployment# cd ../config/ root@open-source:/home/ubuntu/kylin-kubernetes/kubernetes/example/config# vim kylin-job/kylin.properties root@open-source:/home/ubuntu/kylin-kubernetes/kubernetes/example/config# vim kylin-query/kylin.properties ``` - Change configuration of memcached related(part-2) ``` root@open-source:/home/ubuntu/kylin-kubernetes/kubernetes/example/config# vim tomcat/context.xml ``` ```xml ``` - Create related configmap ``` root@open-source:/home/ubuntu/kylin-kubernetes/kubernetes/example/deployment# kubectl create configmap -n kylin-example hadoop-config \ > --from-file=../config/hadoop/core-site.xml \ > --from-file=../config/hadoop/hdfs-site.xml \ > --from-file=../config/hadoop/yarn-site.xml \ > --from-file=../config/hadoop/mapred-site.xml \ > --dry-run -o yaml | kubectl apply -f - W0427 12:09:28.0551604398 helpers.go:535] --dry-run is deprecated and can be replaced with --dry-run=client. configmap/hadoop-config configured root@open-source:/home/ubuntu/kylin-kubernetes/kubernetes/example/deployment# root@open-source:/home/ubuntu/kylin-kubernetes/kubernetes/example/deployment# root@open-source:/home/ubuntu/kylin-kubernetes/kubernetes/example/deployment# kubectl create configmap -n kylin-example hive-config \ > --from-file=../config/hadoop/hive-site.xml \ > --dry-run -o yaml | kubectl apply -f - W0427 12:09:35.4491924525 helpers.go:535] --dry-run is deprecated and can be replaced with --dry-run=client. configmap/hive-config configured root@open-source:/home/ubuntu/kylin-kubernetes/kubernetes/example/deployment# root@open-source:/home/ubuntu/kylin-kubernetes/kubernetes/example/deployment# kubectl create configmap -n kylin-example hbase-config \ > --from-file=../config/hadoop/hbase-site.xml \ > --dry-run -o yaml | kubectl apply -f - W0427 12:09:36.2221424583 helpers.go:535] --dry-run is deprecated and can be replaced with --dry-run=client. configmap/hbase-config configured root@open-source:/home/ubuntu/kylin-kubernetes/kubernetes/example/deployment# root@open-source:/home/ubuntu/kylin-kubernetes/kubernetes/example/deployment# kubectl create configmap -n kylin-example kylin-more-config \ > --from-file=../config/kylin-more/applicationContext.xml \ > --from-file=../config/kylin-more/ehcache.xml \ > --from-file=../config/kylin-more/ehcache-test.xml \ > --from-file=../config/kylin-more/kylinMetrics.xml \ > --from-file=../config/kylin-more/kylinSecurity.xml \ > --dry-run -o yaml | kubectl apply -f - W0427 12:09:43.6784454720 helpers.go:535] --dry-run is deprecated and can be replaced with --dry-run=client. configmap/kylin-more-config configured root@open-source:/home/ubuntu/kylin-kubernetes/kubernetes/example/deployment# kubectl create configmap -n kylin-example filebeat-config \ > --from-file=../config/filebeat/filebeat.yml \ > --dry-run -o yaml | kubectl apply -f - W0427 12:09:51.6864954901 helpers.go:535] --dry-run is deprecated and can be replaced with --dry-run=client. configmap/filebeat-config configured root@open-source:/home/ubuntu/kylin-kubernetes/kubernetes/example/deployment# root@open-source:/home/ubuntu/kylin-kubernetes/kubernetes/example/deployment# kubectl create configmap -n kylin-example tomcat-config \ > --from-file=../config/tomcat/server.xml \ > --from-file=../config/tomcat/context.xml \ > --dry-run -o yaml | kubectl apply -f - W0427 12:09:52.4317754926 helpers.go:535] --dry-run is deprecated and can be replaced with --dry-run=client. configmap/tomcat-config configured root@open-source:/home/ubuntu/kylin-kubernetes/kubernetes/example/deployment# kubectl create configmap -n kylin-example kylin-job-config \ > --from-file=../config/kylin-job/kylin-kafka-consumer.xml \ > --from-file=../config/kylin-job/kylin_hive_conf.xml \ > --from-file=../config/kylin-job/kylin_job_conf.xml \ > --from-file=../config/kylin-job/kylin_job_conf_inmem.xml \ > --from-file=../config/kylin-job/kylin-server-log4j.properties \ > --from-file=../config/kylin-job/kylin-spark-log4j.properties \ >
[GitHub] [kylin] hit-lacus edited a comment on pull request #1182: KYLIN-4446 Kylin on kubernetes in quick-start and production env
hit-lacus edited a comment on pull request #1182: URL: https://github.com/apache/kylin/pull/1182#issuecomment-619861990 ## Create Kylin Job Service - Change configuration of memcached related(part-1) ```shell # kylin.cache.memcached.hosts=cache-svc.kylin-example.svc.cluster.local:11211 root@open-source:/home/ubuntu/kylin-kubernetes/kubernetes/example/deployment# cd ../config/ root@open-source:/home/ubuntu/kylin-kubernetes/kubernetes/example/config# vim kylin-job/kylin.properties root@open-source:/home/ubuntu/kylin-kubernetes/kubernetes/example/config# vim kylin-query/kylin.properties ``` - Change configuration of memcached related(part-2) ``` root@open-source:/home/ubuntu/kylin-kubernetes/kubernetes/example/config# vim tomcat/context.xml ``` ```xml ``` - Create related configmap ``` root@open-source:/home/ubuntu/kylin-kubernetes/kubernetes/example/deployment# kubectl create configmap -n kylin-example hadoop-config \ > --from-file=../config/hadoop/core-site.xml \ > --from-file=../config/hadoop/hdfs-site.xml \ > --from-file=../config/hadoop/yarn-site.xml \ > --from-file=../config/hadoop/mapred-site.xml \ > --dry-run -o yaml | kubectl apply -f - W0427 12:09:28.0551604398 helpers.go:535] --dry-run is deprecated and can be replaced with --dry-run=client. configmap/hadoop-config configured root@open-source:/home/ubuntu/kylin-kubernetes/kubernetes/example/deployment# root@open-source:/home/ubuntu/kylin-kubernetes/kubernetes/example/deployment# root@open-source:/home/ubuntu/kylin-kubernetes/kubernetes/example/deployment# kubectl create configmap -n kylin-example hive-config \ > --from-file=../config/hadoop/hive-site.xml \ > --dry-run -o yaml | kubectl apply -f - W0427 12:09:35.4491924525 helpers.go:535] --dry-run is deprecated and can be replaced with --dry-run=client. configmap/hive-config configured root@open-source:/home/ubuntu/kylin-kubernetes/kubernetes/example/deployment# root@open-source:/home/ubuntu/kylin-kubernetes/kubernetes/example/deployment# kubectl create configmap -n kylin-example hbase-config \ > --from-file=../config/hadoop/hbase-site.xml \ > --dry-run -o yaml | kubectl apply -f - W0427 12:09:36.2221424583 helpers.go:535] --dry-run is deprecated and can be replaced with --dry-run=client. configmap/hbase-config configured root@open-source:/home/ubuntu/kylin-kubernetes/kubernetes/example/deployment# root@open-source:/home/ubuntu/kylin-kubernetes/kubernetes/example/deployment# kubectl create configmap -n kylin-example kylin-more-config \ > --from-file=../config/kylin-more/applicationContext.xml \ > --from-file=../config/kylin-more/ehcache.xml \ > --from-file=../config/kylin-more/ehcache-test.xml \ > --from-file=../config/kylin-more/kylinMetrics.xml \ > --from-file=../config/kylin-more/kylinSecurity.xml \ > --dry-run -o yaml | kubectl apply -f - W0427 12:09:43.6784454720 helpers.go:535] --dry-run is deprecated and can be replaced with --dry-run=client. configmap/kylin-more-config configured root@open-source:/home/ubuntu/kylin-kubernetes/kubernetes/example/deployment# kubectl create configmap -n kylin-example filebeat-config \ > --from-file=../config/filebeat/filebeat.yml \ > --dry-run -o yaml | kubectl apply -f - W0427 12:09:51.6864954901 helpers.go:535] --dry-run is deprecated and can be replaced with --dry-run=client. configmap/filebeat-config configured root@open-source:/home/ubuntu/kylin-kubernetes/kubernetes/example/deployment# root@open-source:/home/ubuntu/kylin-kubernetes/kubernetes/example/deployment# kubectl create configmap -n kylin-example tomcat-config \ > --from-file=../config/tomcat/server.xml \ > --from-file=../config/tomcat/context.xml \ > --dry-run -o yaml | kubectl apply -f - W0427 12:09:52.4317754926 helpers.go:535] --dry-run is deprecated and can be replaced with --dry-run=client. configmap/tomcat-config configured root@open-source:/home/ubuntu/kylin-kubernetes/kubernetes/example/deployment# kubectl create configmap -n kylin-example kylin-job-config \ > --from-file=../config/kylin-job/kylin-kafka-consumer.xml \ > --from-file=../config/kylin-job/kylin_hive_conf.xml \ > --from-file=../config/kylin-job/kylin_job_conf.xml \ > --from-file=../config/kylin-job/kylin_job_conf_inmem.xml \ > --from-file=../config/kylin-job/kylin-server-log4j.properties \ > --from-file=../config/kylin-job/kylin-spark-log4j.properties \ > --from-file=../config/kylin-job/kylin-tools-log4j.properties \ > --from-file=../config/kylin-job/kylin.properties \ > --from-file=../config/kylin-job/setenv.sh \ > --from-file=../config/kylin-job/setenv-tool.sh \ > --dry-run -o yaml | kubectl apply -f - W0427
[jira] [Commented] (KYLIN-4446) Kylin on kubernetes in a quickstart env
[ https://issues.apache.org/jira/browse/KYLIN-4446?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17093431#comment-17093431 ] ASF GitHub Bot commented on KYLIN-4446: --- hit-lacus edited a comment on pull request #1182: URL: https://github.com/apache/kylin/pull/1182#issuecomment-619861990 ## Create Kylin Job Service - Change configuration of memcached related(part-1) ```shell # kylin.cache.memcached.hosts=cache-svc.kylin-example.svc.cluster.local:11211 root@open-source:/home/ubuntu/kylin-kubernetes/kubernetes/example/deployment# cd ../config/ root@open-source:/home/ubuntu/kylin-kubernetes/kubernetes/example/config# vim kylin-job/kylin.properties root@open-source:/home/ubuntu/kylin-kubernetes/kubernetes/example/config# vim kylin-query/kylin.properties ``` - Change configuration of memcached related(part-2) ``` root@open-source:/home/ubuntu/kylin-kubernetes/kubernetes/example/config# vim tomcat/context.xml ``` ```xml ``` - Create related configmap ``` root@open-source:/home/ubuntu/kylin-kubernetes/kubernetes/example/deployment# kubectl create configmap -n kylin-example hadoop-config \ > --from-file=../config/hadoop/core-site.xml \ > --from-file=../config/hadoop/hdfs-site.xml \ > --from-file=../config/hadoop/yarn-site.xml \ > --from-file=../config/hadoop/mapred-site.xml \ > --dry-run -o yaml | kubectl apply -f - W0427 12:09:28.0551604398 helpers.go:535] --dry-run is deprecated and can be replaced with --dry-run=client. configmap/hadoop-config configured root@open-source:/home/ubuntu/kylin-kubernetes/kubernetes/example/deployment# root@open-source:/home/ubuntu/kylin-kubernetes/kubernetes/example/deployment# root@open-source:/home/ubuntu/kylin-kubernetes/kubernetes/example/deployment# kubectl create configmap -n kylin-example hive-config \ > --from-file=../config/hadoop/hive-site.xml \ > --dry-run -o yaml | kubectl apply -f - W0427 12:09:35.4491924525 helpers.go:535] --dry-run is deprecated and can be replaced with --dry-run=client. configmap/hive-config configured root@open-source:/home/ubuntu/kylin-kubernetes/kubernetes/example/deployment# root@open-source:/home/ubuntu/kylin-kubernetes/kubernetes/example/deployment# kubectl create configmap -n kylin-example hbase-config \ > --from-file=../config/hadoop/hbase-site.xml \ > --dry-run -o yaml | kubectl apply -f - W0427 12:09:36.2221424583 helpers.go:535] --dry-run is deprecated and can be replaced with --dry-run=client. configmap/hbase-config configured root@open-source:/home/ubuntu/kylin-kubernetes/kubernetes/example/deployment# root@open-source:/home/ubuntu/kylin-kubernetes/kubernetes/example/deployment# kubectl create configmap -n kylin-example kylin-more-config \ > --from-file=../config/kylin-more/applicationContext.xml \ > --from-file=../config/kylin-more/ehcache.xml \ > --from-file=../config/kylin-more/ehcache-test.xml \ > --from-file=../config/kylin-more/kylinMetrics.xml \ > --from-file=../config/kylin-more/kylinSecurity.xml \ > --dry-run -o yaml | kubectl apply -f - W0427 12:09:43.6784454720 helpers.go:535] --dry-run is deprecated and can be replaced with --dry-run=client. configmap/kylin-more-config configured root@open-source:/home/ubuntu/kylin-kubernetes/kubernetes/example/deployment# kubectl create configmap -n kylin-example filebeat-config \ > --from-file=../config/filebeat/filebeat.yml \ > --dry-run -o yaml | kubectl apply -f - W0427 12:09:51.6864954901 helpers.go:535] --dry-run is deprecated and can be replaced with --dry-run=client. configmap/filebeat-config configured root@open-source:/home/ubuntu/kylin-kubernetes/kubernetes/example/deployment# root@open-source:/home/ubuntu/kylin-kubernetes/kubernetes/example/deployment# kubectl create configmap -n kylin-example tomcat-config \ > --from-file=../config/tomcat/server.xml \ > --from-file=../config/tomcat/context.xml \ > --dry-run -o yaml | kubectl apply -f - W0427 12:09:52.4317754926 helpers.go:535] --dry-run is deprecated and can be replaced with --dry-run=client. configmap/tomcat-config configured root@open-source:/home/ubuntu/kylin-kubernetes/kubernetes/example/deployment# kubectl create configmap -n kylin-example kylin-job-config \ > --from-file=../config/kylin-job/kylin-kafka-consumer.xml \ > --from-file=../config/kylin-job/kylin_hive_conf.xml \ > --from-file=../config/kylin-job/kylin_job_conf.xml \ > --from-file=../config/kylin-job/kylin_job_conf_inmem.xml \ > --from-file=../config/kylin-job/kylin-server-log4j.properties \ > --from-file=../config/kylin-job/kylin-spark-log4j.properties \ >
[GitHub] [kylin] hit-lacus edited a comment on pull request #1182: KYLIN-4446 Kylin on kubernetes in quick-start and production env
hit-lacus edited a comment on pull request #1182: URL: https://github.com/apache/kylin/pull/1182#issuecomment-619861990 ## Create Kylin Job Service - Change configuration of memcached related(part-1) ```shell # kylin.cache.memcached.hosts=cache-svc.kylin-example.svc.cluster.local:11211 root@open-source:/home/ubuntu/kylin-kubernetes/kubernetes/example/deployment# cd ../config/ root@open-source:/home/ubuntu/kylin-kubernetes/kubernetes/example/config# vim kylin-job/kylin.properties root@open-source:/home/ubuntu/kylin-kubernetes/kubernetes/example/config# vim kylin-query/kylin.properties ``` - Change configuration of memcached related(part-2) ``` root@open-source:/home/ubuntu/kylin-kubernetes/kubernetes/example/config# vim tomcat/context.xml ``` ```xml ``` - Create related configmap ``` root@open-source:/home/ubuntu/kylin-kubernetes/kubernetes/example/deployment# kubectl create configmap -n kylin-example hadoop-config \ > --from-file=../config/hadoop/core-site.xml \ > --from-file=../config/hadoop/hdfs-site.xml \ > --from-file=../config/hadoop/yarn-site.xml \ > --from-file=../config/hadoop/mapred-site.xml \ > --dry-run -o yaml | kubectl apply -f - W0427 12:09:28.0551604398 helpers.go:535] --dry-run is deprecated and can be replaced with --dry-run=client. configmap/hadoop-config configured root@open-source:/home/ubuntu/kylin-kubernetes/kubernetes/example/deployment# root@open-source:/home/ubuntu/kylin-kubernetes/kubernetes/example/deployment# root@open-source:/home/ubuntu/kylin-kubernetes/kubernetes/example/deployment# kubectl create configmap -n kylin-example hive-config \ > --from-file=../config/hadoop/hive-site.xml \ > --dry-run -o yaml | kubectl apply -f - W0427 12:09:35.4491924525 helpers.go:535] --dry-run is deprecated and can be replaced with --dry-run=client. configmap/hive-config configured root@open-source:/home/ubuntu/kylin-kubernetes/kubernetes/example/deployment# root@open-source:/home/ubuntu/kylin-kubernetes/kubernetes/example/deployment# kubectl create configmap -n kylin-example hbase-config \ > --from-file=../config/hadoop/hbase-site.xml \ > --dry-run -o yaml | kubectl apply -f - W0427 12:09:36.2221424583 helpers.go:535] --dry-run is deprecated and can be replaced with --dry-run=client. configmap/hbase-config configured root@open-source:/home/ubuntu/kylin-kubernetes/kubernetes/example/deployment# root@open-source:/home/ubuntu/kylin-kubernetes/kubernetes/example/deployment# kubectl create configmap -n kylin-example kylin-more-config \ > --from-file=../config/kylin-more/applicationContext.xml \ > --from-file=../config/kylin-more/ehcache.xml \ > --from-file=../config/kylin-more/ehcache-test.xml \ > --from-file=../config/kylin-more/kylinMetrics.xml \ > --from-file=../config/kylin-more/kylinSecurity.xml \ > --dry-run -o yaml | kubectl apply -f - W0427 12:09:43.6784454720 helpers.go:535] --dry-run is deprecated and can be replaced with --dry-run=client. configmap/kylin-more-config configured root@open-source:/home/ubuntu/kylin-kubernetes/kubernetes/example/deployment# kubectl create configmap -n kylin-example filebeat-config \ > --from-file=../config/filebeat/filebeat.yml \ > --dry-run -o yaml | kubectl apply -f - W0427 12:09:51.6864954901 helpers.go:535] --dry-run is deprecated and can be replaced with --dry-run=client. configmap/filebeat-config configured root@open-source:/home/ubuntu/kylin-kubernetes/kubernetes/example/deployment# root@open-source:/home/ubuntu/kylin-kubernetes/kubernetes/example/deployment# kubectl create configmap -n kylin-example tomcat-config \ > --from-file=../config/tomcat/server.xml \ > --from-file=../config/tomcat/context.xml \ > --dry-run -o yaml | kubectl apply -f - W0427 12:09:52.4317754926 helpers.go:535] --dry-run is deprecated and can be replaced with --dry-run=client. configmap/tomcat-config configured root@open-source:/home/ubuntu/kylin-kubernetes/kubernetes/example/deployment# kubectl create configmap -n kylin-example kylin-job-config \ > --from-file=../config/kylin-job/kylin-kafka-consumer.xml \ > --from-file=../config/kylin-job/kylin_hive_conf.xml \ > --from-file=../config/kylin-job/kylin_job_conf.xml \ > --from-file=../config/kylin-job/kylin_job_conf_inmem.xml \ > --from-file=../config/kylin-job/kylin-server-log4j.properties \ > --from-file=../config/kylin-job/kylin-spark-log4j.properties \ > --from-file=../config/kylin-job/kylin-tools-log4j.properties \ > --from-file=../config/kylin-job/kylin.properties \ > --from-file=../config/kylin-job/setenv.sh \ > --from-file=../config/kylin-job/setenv-tool.sh \ > --dry-run -o yaml | kubectl apply -f - W0427
[jira] [Commented] (KYLIN-4446) Kylin on kubernetes in a quickstart env
[ https://issues.apache.org/jira/browse/KYLIN-4446?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17093426#comment-17093426 ] ASF GitHub Bot commented on KYLIN-4446: --- hit-lacus edited a comment on pull request #1182: URL: https://github.com/apache/kylin/pull/1182#issuecomment-619861990 ## Create Kylin Job Service - Change configuration of memcached related(part-1) ```shell # kylin.cache.memcached.hosts=cache-svc.kylin-example.svc.cluster.local:11211 root@open-source:/home/ubuntu/kylin-kubernetes/kubernetes/example/deployment# cd ../config/ root@open-source:/home/ubuntu/kylin-kubernetes/kubernetes/example/config# vim kylin-job/kylin.properties root@open-source:/home/ubuntu/kylin-kubernetes/kubernetes/example/config# vim kylin-query/kylin.properties ``` - Change configuration of memcached related(part-2) ``` root@open-source:/home/ubuntu/kylin-kubernetes/kubernetes/example/config# vim tomcat/context.xml ``` ```xml ``` - Create related configmap ``` root@open-source:/home/ubuntu/kylin-kubernetes/kubernetes/example/deployment# kubectl create configmap -n kylin-example hadoop-config \ > --from-file=../config/hadoop/core-site.xml \ > --from-file=../config/hadoop/hdfs-site.xml \ > --from-file=../config/hadoop/yarn-site.xml \ > --from-file=../config/hadoop/mapred-site.xml \ > --dry-run -o yaml | kubectl apply -f - W0427 12:09:28.0551604398 helpers.go:535] --dry-run is deprecated and can be replaced with --dry-run=client. configmap/hadoop-config configured root@open-source:/home/ubuntu/kylin-kubernetes/kubernetes/example/deployment# root@open-source:/home/ubuntu/kylin-kubernetes/kubernetes/example/deployment# root@open-source:/home/ubuntu/kylin-kubernetes/kubernetes/example/deployment# kubectl create configmap -n kylin-example hive-config \ > --from-file=../config/hadoop/hive-site.xml \ > --dry-run -o yaml | kubectl apply -f - W0427 12:09:35.4491924525 helpers.go:535] --dry-run is deprecated and can be replaced with --dry-run=client. configmap/hive-config configured root@open-source:/home/ubuntu/kylin-kubernetes/kubernetes/example/deployment# root@open-source:/home/ubuntu/kylin-kubernetes/kubernetes/example/deployment# kubectl create configmap -n kylin-example hbase-config \ > --from-file=../config/hadoop/hbase-site.xml \ > --dry-run -o yaml | kubectl apply -f - W0427 12:09:36.2221424583 helpers.go:535] --dry-run is deprecated and can be replaced with --dry-run=client. configmap/hbase-config configured root@open-source:/home/ubuntu/kylin-kubernetes/kubernetes/example/deployment# root@open-source:/home/ubuntu/kylin-kubernetes/kubernetes/example/deployment# kubectl create configmap -n kylin-example kylin-more-config \ > --from-file=../config/kylin-more/applicationContext.xml \ > --from-file=../config/kylin-more/ehcache.xml \ > --from-file=../config/kylin-more/ehcache-test.xml \ > --from-file=../config/kylin-more/kylinMetrics.xml \ > --from-file=../config/kylin-more/kylinSecurity.xml \ > --dry-run -o yaml | kubectl apply -f - W0427 12:09:43.6784454720 helpers.go:535] --dry-run is deprecated and can be replaced with --dry-run=client. configmap/kylin-more-config configured root@open-source:/home/ubuntu/kylin-kubernetes/kubernetes/example/deployment# kubectl create configmap -n kylin-example filebeat-config \ > --from-file=../config/filebeat/filebeat.yml \ > --dry-run -o yaml | kubectl apply -f - W0427 12:09:51.6864954901 helpers.go:535] --dry-run is deprecated and can be replaced with --dry-run=client. configmap/filebeat-config configured root@open-source:/home/ubuntu/kylin-kubernetes/kubernetes/example/deployment# root@open-source:/home/ubuntu/kylin-kubernetes/kubernetes/example/deployment# kubectl create configmap -n kylin-example tomcat-config \ > --from-file=../config/tomcat/server.xml \ > --from-file=../config/tomcat/context.xml \ > --dry-run -o yaml | kubectl apply -f - W0427 12:09:52.4317754926 helpers.go:535] --dry-run is deprecated and can be replaced with --dry-run=client. configmap/tomcat-config configured root@open-source:/home/ubuntu/kylin-kubernetes/kubernetes/example/deployment# kubectl create configmap -n kylin-example kylin-job-config \ > --from-file=../config/kylin-job/kylin-kafka-consumer.xml \ > --from-file=../config/kylin-job/kylin_hive_conf.xml \ > --from-file=../config/kylin-job/kylin_job_conf.xml \ > --from-file=../config/kylin-job/kylin_job_conf_inmem.xml \ > --from-file=../config/kylin-job/kylin-server-log4j.properties \ > --from-file=../config/kylin-job/kylin-spark-log4j.properties \ >
[GitHub] [kylin] hit-lacus edited a comment on pull request #1182: KYLIN-4446 Kylin on kubernetes in quick-start and production env
hit-lacus edited a comment on pull request #1182: URL: https://github.com/apache/kylin/pull/1182#issuecomment-619861990 ## Create Kylin Job Service - Change configuration of memcached related(part-1) ```shell # kylin.cache.memcached.hosts=cache-svc.kylin-example.svc.cluster.local:11211 root@open-source:/home/ubuntu/kylin-kubernetes/kubernetes/example/deployment# cd ../config/ root@open-source:/home/ubuntu/kylin-kubernetes/kubernetes/example/config# vim kylin-job/kylin.properties root@open-source:/home/ubuntu/kylin-kubernetes/kubernetes/example/config# vim kylin-query/kylin.properties ``` - Change configuration of memcached related(part-2) ``` root@open-source:/home/ubuntu/kylin-kubernetes/kubernetes/example/config# vim tomcat/context.xml ``` ```xml ``` - Create related configmap ``` root@open-source:/home/ubuntu/kylin-kubernetes/kubernetes/example/deployment# kubectl create configmap -n kylin-example hadoop-config \ > --from-file=../config/hadoop/core-site.xml \ > --from-file=../config/hadoop/hdfs-site.xml \ > --from-file=../config/hadoop/yarn-site.xml \ > --from-file=../config/hadoop/mapred-site.xml \ > --dry-run -o yaml | kubectl apply -f - W0427 12:09:28.0551604398 helpers.go:535] --dry-run is deprecated and can be replaced with --dry-run=client. configmap/hadoop-config configured root@open-source:/home/ubuntu/kylin-kubernetes/kubernetes/example/deployment# root@open-source:/home/ubuntu/kylin-kubernetes/kubernetes/example/deployment# root@open-source:/home/ubuntu/kylin-kubernetes/kubernetes/example/deployment# kubectl create configmap -n kylin-example hive-config \ > --from-file=../config/hadoop/hive-site.xml \ > --dry-run -o yaml | kubectl apply -f - W0427 12:09:35.4491924525 helpers.go:535] --dry-run is deprecated and can be replaced with --dry-run=client. configmap/hive-config configured root@open-source:/home/ubuntu/kylin-kubernetes/kubernetes/example/deployment# root@open-source:/home/ubuntu/kylin-kubernetes/kubernetes/example/deployment# kubectl create configmap -n kylin-example hbase-config \ > --from-file=../config/hadoop/hbase-site.xml \ > --dry-run -o yaml | kubectl apply -f - W0427 12:09:36.2221424583 helpers.go:535] --dry-run is deprecated and can be replaced with --dry-run=client. configmap/hbase-config configured root@open-source:/home/ubuntu/kylin-kubernetes/kubernetes/example/deployment# root@open-source:/home/ubuntu/kylin-kubernetes/kubernetes/example/deployment# kubectl create configmap -n kylin-example kylin-more-config \ > --from-file=../config/kylin-more/applicationContext.xml \ > --from-file=../config/kylin-more/ehcache.xml \ > --from-file=../config/kylin-more/ehcache-test.xml \ > --from-file=../config/kylin-more/kylinMetrics.xml \ > --from-file=../config/kylin-more/kylinSecurity.xml \ > --dry-run -o yaml | kubectl apply -f - W0427 12:09:43.6784454720 helpers.go:535] --dry-run is deprecated and can be replaced with --dry-run=client. configmap/kylin-more-config configured root@open-source:/home/ubuntu/kylin-kubernetes/kubernetes/example/deployment# kubectl create configmap -n kylin-example filebeat-config \ > --from-file=../config/filebeat/filebeat.yml \ > --dry-run -o yaml | kubectl apply -f - W0427 12:09:51.6864954901 helpers.go:535] --dry-run is deprecated and can be replaced with --dry-run=client. configmap/filebeat-config configured root@open-source:/home/ubuntu/kylin-kubernetes/kubernetes/example/deployment# root@open-source:/home/ubuntu/kylin-kubernetes/kubernetes/example/deployment# kubectl create configmap -n kylin-example tomcat-config \ > --from-file=../config/tomcat/server.xml \ > --from-file=../config/tomcat/context.xml \ > --dry-run -o yaml | kubectl apply -f - W0427 12:09:52.4317754926 helpers.go:535] --dry-run is deprecated and can be replaced with --dry-run=client. configmap/tomcat-config configured root@open-source:/home/ubuntu/kylin-kubernetes/kubernetes/example/deployment# kubectl create configmap -n kylin-example kylin-job-config \ > --from-file=../config/kylin-job/kylin-kafka-consumer.xml \ > --from-file=../config/kylin-job/kylin_hive_conf.xml \ > --from-file=../config/kylin-job/kylin_job_conf.xml \ > --from-file=../config/kylin-job/kylin_job_conf_inmem.xml \ > --from-file=../config/kylin-job/kylin-server-log4j.properties \ > --from-file=../config/kylin-job/kylin-spark-log4j.properties \ > --from-file=../config/kylin-job/kylin-tools-log4j.properties \ > --from-file=../config/kylin-job/kylin.properties \ > --from-file=../config/kylin-job/setenv.sh \ > --from-file=../config/kylin-job/setenv-tool.sh \ > --dry-run -o yaml | kubectl apply -f - W0427
[jira] [Commented] (KYLIN-3947) TS conflict when kylin update metadata in JDBC (MySQL)
[
https://issues.apache.org/jira/browse/KYLIN-3947?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17093420#comment-17093420
]
Yaqian Zhang commented on KYLIN-3947:
-
Hi:
According to the PR of KYLIN-3562, this problem should have been fixed, no
matter what type of metadata it is.
Do you often encounter this problem?
> TS conflict when kylin update metadata in JDBC (MySQL)
> --
>
> Key: KYLIN-3947
> URL: https://issues.apache.org/jira/browse/KYLIN-3947
> Project: Kylin
> Issue Type: Bug
> Components: Security
>Affects Versions: v2.6.1
>Reporter: Iñigo Martinez
>Assignee: Yaqian Zhang
>Priority: Major
> Fix For: v3.1.0
>
>
> Unable to login in Kylin with admin user. Kylin cluster is composed by two
> nodes, one QUERY node and one ALL node. Our backend for metadata is MySQL
> (not HBASE). Kylin version: 2.6.1
> Solved with same workaround applied in related bug.
> {code:java}
> $KYLIN_HOME/bin/metastore.sh remove /user/admin
> {code}
>
> Tomcat exception follows:
> {code:java}
> Apr 10, 2019 7:30:29 AM org.apache.catalina.core.StandardWrapperValve invoke
> SEVERE: Servlet.service() for servlet [kylin] in context with path [/kylin]
> threw exception
> org.apache.kylin.common.persistence.WriteConflictException: Overwriting
> conflict /user/ADMIN, expect old TS 0, but it is 1554879164739
> at
> org.apache.kylin.common.persistence.JDBCResourceStore$5.execute(JDBCResourceStore.java:482)
> at
> org.apache.kylin.common.persistence.JDBCResourceStore.executeSql(JDBCResourceStore.java:100)
> at
> org.apache.kylin.common.persistence.JDBCResourceStore.checkAndPutResourceInternal(JDBCResourceStore.java:439)
> at
> org.apache.kylin.common.persistence.JDBCResourceStore.checkAndPutResourceImpl(JDBCResourceStore.java:427)
> at
> org.apache.kylin.common.persistence.ResourceStore$6.call(ResourceStore.java:442)
> at
> org.apache.kylin.common.persistence.ResourceStore$6.call(ResourceStore.java:439)
> at
> org.apache.kylin.common.persistence.ExponentialBackoffRetry.doWithRetry(ExponentialBackoffRetry.java:52)
> at
> org.apache.kylin.common.persistence.ResourceStore.checkAndPutResourceWithRetry(ResourceStore.java:439)
> at
> org.apache.kylin.common.persistence.ResourceStore.checkAndPutResourceCheckpoint(ResourceStore.java:427)
> at
> org.apache.kylin.common.persistence.ResourceStore.checkAndPutResource(ResourceStore.java:421)
> at
> org.apache.kylin.common.persistence.ResourceStore.checkAndPutResource(ResourceStore.java:401)
> at
> org.apache.kylin.common.persistence.ResourceStore.checkAndPutResource(ResourceStore.java:380)
> at
> org.apache.kylin.metadata.cachesync.CachedCrudAssist.save(CachedCrudAssist.java:192)
> at
> org.apache.kylin.rest.security.KylinUserManager.update(KylinUserManager.java:124)
> at
> org.apache.kylin.rest.service.KylinUserService.updateUser(KylinUserService.java:86)
> at
> org.apache.kylin.rest.service.KylinUserService.createUser(KylinUserService.java:78)
> at
> org.apache.kylin.rest.security.KylinAuthenticationProvider.authenticate(KylinAuthenticationProvider.java:116)
> at
> org.springframework.security.authentication.ProviderManager.authenticate(ProviderManager.java:174)
> at
> org.springframework.security.authentication.ProviderManager.authenticate(ProviderManager.java:199)
> at
> org.springframework.security.web.authentication.www.BasicAuthenticationFilter.doFilterInternal(BasicAuthenticationFilter.java:180)
> at
> org.springframework.web.filter.OncePerRequestFilter.doFilter(OncePerRequestFilter.java:107)
> at
> org.springframework.security.web.FilterChainProxy$VirtualFilterChain.doFilter(FilterChainProxy.java:331)
> at
> org.springframework.security.web.authentication.AbstractAuthenticationProcessingFilter.doFilter(AbstractAuthenticationProcessingFilter.java:200)
> at
> org.springframework.security.web.FilterChainProxy$VirtualFilterChain.doFilter(FilterChainProxy.java:331)
> at
> org.springframework.security.web.authentication.logout.LogoutFilter.doFilter(LogoutFilter.java:116)
> at
> org.springframework.security.web.FilterChainProxy$VirtualFilterChain.doFilter(FilterChainProxy.java:331)
> at
> org.springframework.security.web.header.HeaderWriterFilter.doFilterInternal(HeaderWriterFilter.java:64)
> at
> org.springframework.web.filter.OncePerRequestFilter.doFilter(OncePerRequestFilter.java:107)
> at
> org.springframework.security.web.FilterChainProxy$VirtualFilterChain.doFilter(FilterChainProxy.java:331)
> at
> org.springframework.security.web.context.request.async.WebAsyncManagerIntegrationFilter.doFilterInternal(WebAsyncManagerIntegrationFilter.java:56)
> at
> org.springframework.web.filter.OncePerRequestFilter.doFilter(OncePerRequestFilter.java:107)
> at
>
[jira] [Commented] (KYLIN-4446) Kylin on kubernetes in a quickstart env
[ https://issues.apache.org/jira/browse/KYLIN-4446?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17093422#comment-17093422 ] ASF GitHub Bot commented on KYLIN-4446: --- hit-lacus edited a comment on pull request #1182: URL: https://github.com/apache/kylin/pull/1182#issuecomment-619861990 ## Create Kylin Job Service - Change configuration of memcached related(part-1) ```shell # kylin.cache.memcached.hosts=cache-svc.kylin-example.svc.cluster.local:11211 root@open-source:/home/ubuntu/kylin-kubernetes/kubernetes/example/deployment# cd ../config/ root@open-source:/home/ubuntu/kylin-kubernetes/kubernetes/example/config# vim kylin-job/kylin.properties root@open-source:/home/ubuntu/kylin-kubernetes/kubernetes/example/config# vim kylin-query/kylin.properties ``` - Change configuration of memcached related(part-2) ``` root@open-source:/home/ubuntu/kylin-kubernetes/kubernetes/example/config# vim tomcat/context.xml ``` ```xml ``` - Create related configmap ``` root@open-source:/home/ubuntu/kylin-kubernetes/kubernetes/example/deployment# kubectl create configmap -n kylin-example hadoop-config \ > --from-file=../config/hadoop/core-site.xml \ > --from-file=../config/hadoop/hdfs-site.xml \ > --from-file=../config/hadoop/yarn-site.xml \ > --from-file=../config/hadoop/mapred-site.xml \ > --dry-run -o yaml | kubectl apply -f - W0427 12:09:28.0551604398 helpers.go:535] --dry-run is deprecated and can be replaced with --dry-run=client. configmap/hadoop-config configured root@open-source:/home/ubuntu/kylin-kubernetes/kubernetes/example/deployment# root@open-source:/home/ubuntu/kylin-kubernetes/kubernetes/example/deployment# root@open-source:/home/ubuntu/kylin-kubernetes/kubernetes/example/deployment# kubectl create configmap -n kylin-example hive-config \ > --from-file=../config/hadoop/hive-site.xml \ > --dry-run -o yaml | kubectl apply -f - W0427 12:09:35.4491924525 helpers.go:535] --dry-run is deprecated and can be replaced with --dry-run=client. configmap/hive-config configured root@open-source:/home/ubuntu/kylin-kubernetes/kubernetes/example/deployment# root@open-source:/home/ubuntu/kylin-kubernetes/kubernetes/example/deployment# kubectl create configmap -n kylin-example hbase-config \ > --from-file=../config/hadoop/hbase-site.xml \ > --dry-run -o yaml | kubectl apply -f - W0427 12:09:36.2221424583 helpers.go:535] --dry-run is deprecated and can be replaced with --dry-run=client. configmap/hbase-config configured root@open-source:/home/ubuntu/kylin-kubernetes/kubernetes/example/deployment# root@open-source:/home/ubuntu/kylin-kubernetes/kubernetes/example/deployment# kubectl create configmap -n kylin-example kylin-more-config \ > --from-file=../config/kylin-more/applicationContext.xml \ > --from-file=../config/kylin-more/ehcache.xml \ > --from-file=../config/kylin-more/ehcache-test.xml \ > --from-file=../config/kylin-more/kylinMetrics.xml \ > --from-file=../config/kylin-more/kylinSecurity.xml \ > --dry-run -o yaml | kubectl apply -f - W0427 12:09:43.6784454720 helpers.go:535] --dry-run is deprecated and can be replaced with --dry-run=client. configmap/kylin-more-config configured root@open-source:/home/ubuntu/kylin-kubernetes/kubernetes/example/deployment# kubectl create configmap -n kylin-example filebeat-config \ > --from-file=../config/filebeat/filebeat.yml \ > --dry-run -o yaml | kubectl apply -f - W0427 12:09:51.6864954901 helpers.go:535] --dry-run is deprecated and can be replaced with --dry-run=client. configmap/filebeat-config configured root@open-source:/home/ubuntu/kylin-kubernetes/kubernetes/example/deployment# root@open-source:/home/ubuntu/kylin-kubernetes/kubernetes/example/deployment# kubectl create configmap -n kylin-example tomcat-config \ > --from-file=../config/tomcat/server.xml \ > --from-file=../config/tomcat/context.xml \ > --dry-run -o yaml | kubectl apply -f - W0427 12:09:52.4317754926 helpers.go:535] --dry-run is deprecated and can be replaced with --dry-run=client. configmap/tomcat-config configured root@open-source:/home/ubuntu/kylin-kubernetes/kubernetes/example/deployment# kubectl create configmap -n kylin-example kylin-job-config \ > --from-file=../config/kylin-job/kylin-kafka-consumer.xml \ > --from-file=../config/kylin-job/kylin_hive_conf.xml \ > --from-file=../config/kylin-job/kylin_job_conf.xml \ > --from-file=../config/kylin-job/kylin_job_conf_inmem.xml \ > --from-file=../config/kylin-job/kylin-server-log4j.properties \ > --from-file=../config/kylin-job/kylin-spark-log4j.properties \ >
[GitHub] [kylin] hit-lacus edited a comment on pull request #1182: KYLIN-4446 Kylin on kubernetes in quick-start and production env
hit-lacus edited a comment on pull request #1182: URL: https://github.com/apache/kylin/pull/1182#issuecomment-619861990 ## Create Kylin Job Service - Change configuration of memcached related(part-1) ```shell # kylin.cache.memcached.hosts=cache-svc.kylin-example.svc.cluster.local:11211 root@open-source:/home/ubuntu/kylin-kubernetes/kubernetes/example/deployment# cd ../config/ root@open-source:/home/ubuntu/kylin-kubernetes/kubernetes/example/config# vim kylin-job/kylin.properties root@open-source:/home/ubuntu/kylin-kubernetes/kubernetes/example/config# vim kylin-query/kylin.properties ``` - Change configuration of memcached related(part-2) ``` root@open-source:/home/ubuntu/kylin-kubernetes/kubernetes/example/config# vim tomcat/context.xml ``` ```xml ``` - Create related configmap ``` root@open-source:/home/ubuntu/kylin-kubernetes/kubernetes/example/deployment# kubectl create configmap -n kylin-example hadoop-config \ > --from-file=../config/hadoop/core-site.xml \ > --from-file=../config/hadoop/hdfs-site.xml \ > --from-file=../config/hadoop/yarn-site.xml \ > --from-file=../config/hadoop/mapred-site.xml \ > --dry-run -o yaml | kubectl apply -f - W0427 12:09:28.0551604398 helpers.go:535] --dry-run is deprecated and can be replaced with --dry-run=client. configmap/hadoop-config configured root@open-source:/home/ubuntu/kylin-kubernetes/kubernetes/example/deployment# root@open-source:/home/ubuntu/kylin-kubernetes/kubernetes/example/deployment# root@open-source:/home/ubuntu/kylin-kubernetes/kubernetes/example/deployment# kubectl create configmap -n kylin-example hive-config \ > --from-file=../config/hadoop/hive-site.xml \ > --dry-run -o yaml | kubectl apply -f - W0427 12:09:35.4491924525 helpers.go:535] --dry-run is deprecated and can be replaced with --dry-run=client. configmap/hive-config configured root@open-source:/home/ubuntu/kylin-kubernetes/kubernetes/example/deployment# root@open-source:/home/ubuntu/kylin-kubernetes/kubernetes/example/deployment# kubectl create configmap -n kylin-example hbase-config \ > --from-file=../config/hadoop/hbase-site.xml \ > --dry-run -o yaml | kubectl apply -f - W0427 12:09:36.2221424583 helpers.go:535] --dry-run is deprecated and can be replaced with --dry-run=client. configmap/hbase-config configured root@open-source:/home/ubuntu/kylin-kubernetes/kubernetes/example/deployment# root@open-source:/home/ubuntu/kylin-kubernetes/kubernetes/example/deployment# kubectl create configmap -n kylin-example kylin-more-config \ > --from-file=../config/kylin-more/applicationContext.xml \ > --from-file=../config/kylin-more/ehcache.xml \ > --from-file=../config/kylin-more/ehcache-test.xml \ > --from-file=../config/kylin-more/kylinMetrics.xml \ > --from-file=../config/kylin-more/kylinSecurity.xml \ > --dry-run -o yaml | kubectl apply -f - W0427 12:09:43.6784454720 helpers.go:535] --dry-run is deprecated and can be replaced with --dry-run=client. configmap/kylin-more-config configured root@open-source:/home/ubuntu/kylin-kubernetes/kubernetes/example/deployment# kubectl create configmap -n kylin-example filebeat-config \ > --from-file=../config/filebeat/filebeat.yml \ > --dry-run -o yaml | kubectl apply -f - W0427 12:09:51.6864954901 helpers.go:535] --dry-run is deprecated and can be replaced with --dry-run=client. configmap/filebeat-config configured root@open-source:/home/ubuntu/kylin-kubernetes/kubernetes/example/deployment# root@open-source:/home/ubuntu/kylin-kubernetes/kubernetes/example/deployment# kubectl create configmap -n kylin-example tomcat-config \ > --from-file=../config/tomcat/server.xml \ > --from-file=../config/tomcat/context.xml \ > --dry-run -o yaml | kubectl apply -f - W0427 12:09:52.4317754926 helpers.go:535] --dry-run is deprecated and can be replaced with --dry-run=client. configmap/tomcat-config configured root@open-source:/home/ubuntu/kylin-kubernetes/kubernetes/example/deployment# kubectl create configmap -n kylin-example kylin-job-config \ > --from-file=../config/kylin-job/kylin-kafka-consumer.xml \ > --from-file=../config/kylin-job/kylin_hive_conf.xml \ > --from-file=../config/kylin-job/kylin_job_conf.xml \ > --from-file=../config/kylin-job/kylin_job_conf_inmem.xml \ > --from-file=../config/kylin-job/kylin-server-log4j.properties \ > --from-file=../config/kylin-job/kylin-spark-log4j.properties \ > --from-file=../config/kylin-job/kylin-tools-log4j.properties \ > --from-file=../config/kylin-job/kylin.properties \ > --from-file=../config/kylin-job/setenv.sh \ > --from-file=../config/kylin-job/setenv-tool.sh \ > --dry-run -o yaml | kubectl apply -f - W0427
[jira] [Commented] (KYLIN-4446) Kylin on kubernetes in a quickstart env
[ https://issues.apache.org/jira/browse/KYLIN-4446?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17093417#comment-17093417 ] ASF GitHub Bot commented on KYLIN-4446: --- hit-lacus edited a comment on pull request #1182: URL: https://github.com/apache/kylin/pull/1182#issuecomment-619861990 ## Create Kylin Job Service - Change configuration of memcached related(part-1) ```shell # kylin.cache.memcached.hosts=cache-svc.kylin-example.svc.cluster.local:11211 root@open-source:/home/ubuntu/kylin-kubernetes/kubernetes/example/deployment# cd ../config/ root@open-source:/home/ubuntu/kylin-kubernetes/kubernetes/example/config# vim kylin-job/kylin.properties root@open-source:/home/ubuntu/kylin-kubernetes/kubernetes/example/config# vim kylin-query/kylin.properties ``` - Change configuration of memcached related(part-2) ``` root@open-source:/home/ubuntu/kylin-kubernetes/kubernetes/example/config# vim tomcat/context.xml ``` ```xml ``` - Create related configmap ``` root@open-source:/home/ubuntu/kylin-kubernetes/kubernetes/example/deployment# kubectl create configmap -n kylin-example hadoop-config \ > --from-file=../config/hadoop/core-site.xml \ > --from-file=../config/hadoop/hdfs-site.xml \ > --from-file=../config/hadoop/yarn-site.xml \ > --from-file=../config/hadoop/mapred-site.xml \ > --dry-run -o yaml | kubectl apply -f - W0427 12:09:28.0551604398 helpers.go:535] --dry-run is deprecated and can be replaced with --dry-run=client. configmap/hadoop-config configured root@open-source:/home/ubuntu/kylin-kubernetes/kubernetes/example/deployment# root@open-source:/home/ubuntu/kylin-kubernetes/kubernetes/example/deployment# root@open-source:/home/ubuntu/kylin-kubernetes/kubernetes/example/deployment# kubectl create configmap -n kylin-example hive-config \ > --from-file=../config/hadoop/hive-site.xml \ > --dry-run -o yaml | kubectl apply -f - W0427 12:09:35.4491924525 helpers.go:535] --dry-run is deprecated and can be replaced with --dry-run=client. configmap/hive-config configured root@open-source:/home/ubuntu/kylin-kubernetes/kubernetes/example/deployment# root@open-source:/home/ubuntu/kylin-kubernetes/kubernetes/example/deployment# kubectl create configmap -n kylin-example hbase-config \ > --from-file=../config/hadoop/hbase-site.xml \ > --dry-run -o yaml | kubectl apply -f - W0427 12:09:36.2221424583 helpers.go:535] --dry-run is deprecated and can be replaced with --dry-run=client. configmap/hbase-config configured root@open-source:/home/ubuntu/kylin-kubernetes/kubernetes/example/deployment# root@open-source:/home/ubuntu/kylin-kubernetes/kubernetes/example/deployment# kubectl create configmap -n kylin-example kylin-more-config \ > --from-file=../config/kylin-more/applicationContext.xml \ > --from-file=../config/kylin-more/ehcache.xml \ > --from-file=../config/kylin-more/ehcache-test.xml \ > --from-file=../config/kylin-more/kylinMetrics.xml \ > --from-file=../config/kylin-more/kylinSecurity.xml \ > --dry-run -o yaml | kubectl apply -f - W0427 12:09:43.6784454720 helpers.go:535] --dry-run is deprecated and can be replaced with --dry-run=client. configmap/kylin-more-config configured root@open-source:/home/ubuntu/kylin-kubernetes/kubernetes/example/deployment# kubectl create configmap -n kylin-example filebeat-config \ > --from-file=../config/filebeat/filebeat.yml \ > --dry-run -o yaml | kubectl apply -f - W0427 12:09:51.6864954901 helpers.go:535] --dry-run is deprecated and can be replaced with --dry-run=client. configmap/filebeat-config configured root@open-source:/home/ubuntu/kylin-kubernetes/kubernetes/example/deployment# root@open-source:/home/ubuntu/kylin-kubernetes/kubernetes/example/deployment# kubectl create configmap -n kylin-example tomcat-config \ > --from-file=../config/tomcat/server.xml \ > --from-file=../config/tomcat/context.xml \ > --dry-run -o yaml | kubectl apply -f - W0427 12:09:52.4317754926 helpers.go:535] --dry-run is deprecated and can be replaced with --dry-run=client. configmap/tomcat-config configured root@open-source:/home/ubuntu/kylin-kubernetes/kubernetes/example/deployment# kubectl create configmap -n kylin-example kylin-job-config \ > --from-file=../config/kylin-job/kylin-kafka-consumer.xml \ > --from-file=../config/kylin-job/kylin_hive_conf.xml \ > --from-file=../config/kylin-job/kylin_job_conf.xml \ > --from-file=../config/kylin-job/kylin_job_conf_inmem.xml \ > --from-file=../config/kylin-job/kylin-server-log4j.properties \ > --from-file=../config/kylin-job/kylin-spark-log4j.properties \ >
[jira] [Commented] (KYLIN-4446) Kylin on kubernetes in a quickstart env
[ https://issues.apache.org/jira/browse/KYLIN-4446?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17093415#comment-17093415 ] ASF GitHub Bot commented on KYLIN-4446: --- hit-lacus edited a comment on pull request #1182: URL: https://github.com/apache/kylin/pull/1182#issuecomment-619861990 ## Create Kylin Job Service - Change configuration of memcached related(part-1) ```shell # kylin.cache.memcached.hosts=cache-svc.kylin-example.svc.cluster.local:11211 root@open-source:/home/ubuntu/kylin-kubernetes/kubernetes/example/deployment# cd ../config/ root@open-source:/home/ubuntu/kylin-kubernetes/kubernetes/example/config# vim kylin-job/kylin.properties root@open-source:/home/ubuntu/kylin-kubernetes/kubernetes/example/config# vim kylin-query/kylin.properties ``` - Change configuration of memcached related(part-2) ``` root@open-source:/home/ubuntu/kylin-kubernetes/kubernetes/example/config# vim tomcat/context.xml ``` ```xml ``` - Create related configmap ``` root@open-source:/home/ubuntu/kylin-kubernetes/kubernetes/example/deployment# kubectl create configmap -n kylin-example hadoop-config \ > --from-file=../config/hadoop/core-site.xml \ > --from-file=../config/hadoop/hdfs-site.xml \ > --from-file=../config/hadoop/yarn-site.xml \ > --from-file=../config/hadoop/mapred-site.xml \ > --dry-run -o yaml | kubectl apply -f - W0427 12:09:28.0551604398 helpers.go:535] --dry-run is deprecated and can be replaced with --dry-run=client. configmap/hadoop-config configured root@open-source:/home/ubuntu/kylin-kubernetes/kubernetes/example/deployment# root@open-source:/home/ubuntu/kylin-kubernetes/kubernetes/example/deployment# root@open-source:/home/ubuntu/kylin-kubernetes/kubernetes/example/deployment# kubectl create configmap -n kylin-example hive-config \ > --from-file=../config/hadoop/hive-site.xml \ > --dry-run -o yaml | kubectl apply -f - W0427 12:09:35.4491924525 helpers.go:535] --dry-run is deprecated and can be replaced with --dry-run=client. configmap/hive-config configured root@open-source:/home/ubuntu/kylin-kubernetes/kubernetes/example/deployment# root@open-source:/home/ubuntu/kylin-kubernetes/kubernetes/example/deployment# kubectl create configmap -n kylin-example hbase-config \ > --from-file=../config/hadoop/hbase-site.xml \ > --dry-run -o yaml | kubectl apply -f - W0427 12:09:36.2221424583 helpers.go:535] --dry-run is deprecated and can be replaced with --dry-run=client. configmap/hbase-config configured root@open-source:/home/ubuntu/kylin-kubernetes/kubernetes/example/deployment# root@open-source:/home/ubuntu/kylin-kubernetes/kubernetes/example/deployment# kubectl create configmap -n kylin-example kylin-more-config \ > --from-file=../config/kylin-more/applicationContext.xml \ > --from-file=../config/kylin-more/ehcache.xml \ > --from-file=../config/kylin-more/ehcache-test.xml \ > --from-file=../config/kylin-more/kylinMetrics.xml \ > --from-file=../config/kylin-more/kylinSecurity.xml \ > --dry-run -o yaml | kubectl apply -f - W0427 12:09:43.6784454720 helpers.go:535] --dry-run is deprecated and can be replaced with --dry-run=client. configmap/kylin-more-config configured root@open-source:/home/ubuntu/kylin-kubernetes/kubernetes/example/deployment# kubectl create configmap -n kylin-example filebeat-config \ > --from-file=../config/filebeat/filebeat.yml \ > --dry-run -o yaml | kubectl apply -f - W0427 12:09:51.6864954901 helpers.go:535] --dry-run is deprecated and can be replaced with --dry-run=client. configmap/filebeat-config configured root@open-source:/home/ubuntu/kylin-kubernetes/kubernetes/example/deployment# root@open-source:/home/ubuntu/kylin-kubernetes/kubernetes/example/deployment# kubectl create configmap -n kylin-example tomcat-config \ > --from-file=../config/tomcat/server.xml \ > --from-file=../config/tomcat/context.xml \ > --dry-run -o yaml | kubectl apply -f - W0427 12:09:52.4317754926 helpers.go:535] --dry-run is deprecated and can be replaced with --dry-run=client. configmap/tomcat-config configured root@open-source:/home/ubuntu/kylin-kubernetes/kubernetes/example/deployment# kubectl create configmap -n kylin-example kylin-job-config \ > --from-file=../config/kylin-job/kylin-kafka-consumer.xml \ > --from-file=../config/kylin-job/kylin_hive_conf.xml \ > --from-file=../config/kylin-job/kylin_job_conf.xml \ > --from-file=../config/kylin-job/kylin_job_conf_inmem.xml \ > --from-file=../config/kylin-job/kylin-server-log4j.properties \ > --from-file=../config/kylin-job/kylin-spark-log4j.properties \ >
[GitHub] [kylin] hit-lacus edited a comment on pull request #1182: KYLIN-4446 Kylin on kubernetes in quick-start and production env
hit-lacus edited a comment on pull request #1182: URL: https://github.com/apache/kylin/pull/1182#issuecomment-619861990 ## Create Kylin Job Service - Change configuration of memcached related(part-1) ```shell # kylin.cache.memcached.hosts=cache-svc.kylin-example.svc.cluster.local:11211 root@open-source:/home/ubuntu/kylin-kubernetes/kubernetes/example/deployment# cd ../config/ root@open-source:/home/ubuntu/kylin-kubernetes/kubernetes/example/config# vim kylin-job/kylin.properties root@open-source:/home/ubuntu/kylin-kubernetes/kubernetes/example/config# vim kylin-query/kylin.properties ``` - Change configuration of memcached related(part-2) ``` root@open-source:/home/ubuntu/kylin-kubernetes/kubernetes/example/config# vim tomcat/context.xml ``` ```xml ``` - Create related configmap ``` root@open-source:/home/ubuntu/kylin-kubernetes/kubernetes/example/deployment# kubectl create configmap -n kylin-example hadoop-config \ > --from-file=../config/hadoop/core-site.xml \ > --from-file=../config/hadoop/hdfs-site.xml \ > --from-file=../config/hadoop/yarn-site.xml \ > --from-file=../config/hadoop/mapred-site.xml \ > --dry-run -o yaml | kubectl apply -f - W0427 12:09:28.0551604398 helpers.go:535] --dry-run is deprecated and can be replaced with --dry-run=client. configmap/hadoop-config configured root@open-source:/home/ubuntu/kylin-kubernetes/kubernetes/example/deployment# root@open-source:/home/ubuntu/kylin-kubernetes/kubernetes/example/deployment# root@open-source:/home/ubuntu/kylin-kubernetes/kubernetes/example/deployment# kubectl create configmap -n kylin-example hive-config \ > --from-file=../config/hadoop/hive-site.xml \ > --dry-run -o yaml | kubectl apply -f - W0427 12:09:35.4491924525 helpers.go:535] --dry-run is deprecated and can be replaced with --dry-run=client. configmap/hive-config configured root@open-source:/home/ubuntu/kylin-kubernetes/kubernetes/example/deployment# root@open-source:/home/ubuntu/kylin-kubernetes/kubernetes/example/deployment# kubectl create configmap -n kylin-example hbase-config \ > --from-file=../config/hadoop/hbase-site.xml \ > --dry-run -o yaml | kubectl apply -f - W0427 12:09:36.2221424583 helpers.go:535] --dry-run is deprecated and can be replaced with --dry-run=client. configmap/hbase-config configured root@open-source:/home/ubuntu/kylin-kubernetes/kubernetes/example/deployment# root@open-source:/home/ubuntu/kylin-kubernetes/kubernetes/example/deployment# kubectl create configmap -n kylin-example kylin-more-config \ > --from-file=../config/kylin-more/applicationContext.xml \ > --from-file=../config/kylin-more/ehcache.xml \ > --from-file=../config/kylin-more/ehcache-test.xml \ > --from-file=../config/kylin-more/kylinMetrics.xml \ > --from-file=../config/kylin-more/kylinSecurity.xml \ > --dry-run -o yaml | kubectl apply -f - W0427 12:09:43.6784454720 helpers.go:535] --dry-run is deprecated and can be replaced with --dry-run=client. configmap/kylin-more-config configured root@open-source:/home/ubuntu/kylin-kubernetes/kubernetes/example/deployment# kubectl create configmap -n kylin-example filebeat-config \ > --from-file=../config/filebeat/filebeat.yml \ > --dry-run -o yaml | kubectl apply -f - W0427 12:09:51.6864954901 helpers.go:535] --dry-run is deprecated and can be replaced with --dry-run=client. configmap/filebeat-config configured root@open-source:/home/ubuntu/kylin-kubernetes/kubernetes/example/deployment# root@open-source:/home/ubuntu/kylin-kubernetes/kubernetes/example/deployment# kubectl create configmap -n kylin-example tomcat-config \ > --from-file=../config/tomcat/server.xml \ > --from-file=../config/tomcat/context.xml \ > --dry-run -o yaml | kubectl apply -f - W0427 12:09:52.4317754926 helpers.go:535] --dry-run is deprecated and can be replaced with --dry-run=client. configmap/tomcat-config configured root@open-source:/home/ubuntu/kylin-kubernetes/kubernetes/example/deployment# kubectl create configmap -n kylin-example kylin-job-config \ > --from-file=../config/kylin-job/kylin-kafka-consumer.xml \ > --from-file=../config/kylin-job/kylin_hive_conf.xml \ > --from-file=../config/kylin-job/kylin_job_conf.xml \ > --from-file=../config/kylin-job/kylin_job_conf_inmem.xml \ > --from-file=../config/kylin-job/kylin-server-log4j.properties \ > --from-file=../config/kylin-job/kylin-spark-log4j.properties \ > --from-file=../config/kylin-job/kylin-tools-log4j.properties \ > --from-file=../config/kylin-job/kylin.properties \ > --from-file=../config/kylin-job/setenv.sh \ > --from-file=../config/kylin-job/setenv-tool.sh \ > --dry-run -o yaml | kubectl apply -f - W0427
[GitHub] [kylin] hit-lacus edited a comment on pull request #1182: KYLIN-4446 Kylin on kubernetes in quick-start and production env
hit-lacus edited a comment on pull request #1182: URL: https://github.com/apache/kylin/pull/1182#issuecomment-619861990 ## Create Kylin Job Service - Change configuration of memcached related(part-1) ```shell # kylin.cache.memcached.hosts=cache-svc.kylin-example.svc.cluster.local:11211 root@open-source:/home/ubuntu/kylin-kubernetes/kubernetes/example/deployment# cd ../config/ root@open-source:/home/ubuntu/kylin-kubernetes/kubernetes/example/config# vim kylin-job/kylin.properties root@open-source:/home/ubuntu/kylin-kubernetes/kubernetes/example/config# vim kylin-query/kylin.properties ``` - Change configuration of memcached related(part-2) ``` root@open-source:/home/ubuntu/kylin-kubernetes/kubernetes/example/config# vim tomcat/context.xml ``` ```xml ``` - Create related configmap ``` root@open-source:/home/ubuntu/kylin-kubernetes/kubernetes/example/deployment# kubectl create configmap -n kylin-example hadoop-config \ > --from-file=../config/hadoop/core-site.xml \ > --from-file=../config/hadoop/hdfs-site.xml \ > --from-file=../config/hadoop/yarn-site.xml \ > --from-file=../config/hadoop/mapred-site.xml \ > --dry-run -o yaml | kubectl apply -f - W0427 12:09:28.0551604398 helpers.go:535] --dry-run is deprecated and can be replaced with --dry-run=client. configmap/hadoop-config configured root@open-source:/home/ubuntu/kylin-kubernetes/kubernetes/example/deployment# root@open-source:/home/ubuntu/kylin-kubernetes/kubernetes/example/deployment# root@open-source:/home/ubuntu/kylin-kubernetes/kubernetes/example/deployment# kubectl create configmap -n kylin-example hive-config \ > --from-file=../config/hadoop/hive-site.xml \ > --dry-run -o yaml | kubectl apply -f - W0427 12:09:35.4491924525 helpers.go:535] --dry-run is deprecated and can be replaced with --dry-run=client. configmap/hive-config configured root@open-source:/home/ubuntu/kylin-kubernetes/kubernetes/example/deployment# root@open-source:/home/ubuntu/kylin-kubernetes/kubernetes/example/deployment# kubectl create configmap -n kylin-example hbase-config \ > --from-file=../config/hadoop/hbase-site.xml \ > --dry-run -o yaml | kubectl apply -f - W0427 12:09:36.2221424583 helpers.go:535] --dry-run is deprecated and can be replaced with --dry-run=client. configmap/hbase-config configured root@open-source:/home/ubuntu/kylin-kubernetes/kubernetes/example/deployment# root@open-source:/home/ubuntu/kylin-kubernetes/kubernetes/example/deployment# kubectl create configmap -n kylin-example kylin-more-config \ > --from-file=../config/kylin-more/applicationContext.xml \ > --from-file=../config/kylin-more/ehcache.xml \ > --from-file=../config/kylin-more/ehcache-test.xml \ > --from-file=../config/kylin-more/kylinMetrics.xml \ > --from-file=../config/kylin-more/kylinSecurity.xml \ > --dry-run -o yaml | kubectl apply -f - W0427 12:09:43.6784454720 helpers.go:535] --dry-run is deprecated and can be replaced with --dry-run=client. configmap/kylin-more-config configured root@open-source:/home/ubuntu/kylin-kubernetes/kubernetes/example/deployment# kubectl create configmap -n kylin-example filebeat-config \ > --from-file=../config/filebeat/filebeat.yml \ > --dry-run -o yaml | kubectl apply -f - W0427 12:09:51.6864954901 helpers.go:535] --dry-run is deprecated and can be replaced with --dry-run=client. configmap/filebeat-config configured root@open-source:/home/ubuntu/kylin-kubernetes/kubernetes/example/deployment# root@open-source:/home/ubuntu/kylin-kubernetes/kubernetes/example/deployment# kubectl create configmap -n kylin-example tomcat-config \ > --from-file=../config/tomcat/server.xml \ > --from-file=../config/tomcat/context.xml \ > --dry-run -o yaml | kubectl apply -f - W0427 12:09:52.4317754926 helpers.go:535] --dry-run is deprecated and can be replaced with --dry-run=client. configmap/tomcat-config configured root@open-source:/home/ubuntu/kylin-kubernetes/kubernetes/example/deployment# kubectl create configmap -n kylin-example kylin-job-config \ > --from-file=../config/kylin-job/kylin-kafka-consumer.xml \ > --from-file=../config/kylin-job/kylin_hive_conf.xml \ > --from-file=../config/kylin-job/kylin_job_conf.xml \ > --from-file=../config/kylin-job/kylin_job_conf_inmem.xml \ > --from-file=../config/kylin-job/kylin-server-log4j.properties \ > --from-file=../config/kylin-job/kylin-spark-log4j.properties \ > --from-file=../config/kylin-job/kylin-tools-log4j.properties \ > --from-file=../config/kylin-job/kylin.properties \ > --from-file=../config/kylin-job/setenv.sh \ > --from-file=../config/kylin-job/setenv-tool.sh \ > --dry-run -o yaml | kubectl apply -f - W0427
[jira] [Commented] (KYLIN-4446) Kylin on kubernetes in a quickstart env
[
https://issues.apache.org/jira/browse/KYLIN-4446?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17093412#comment-17093412
]
ASF GitHub Bot commented on KYLIN-4446:
---
hit-lacus edited a comment on pull request #1182:
URL: https://github.com/apache/kylin/pull/1182#issuecomment-619861990
## Create Kylin Job Service
- Change configuration of memcached related(part-1)
```shell
# kylin.cache.memcached.hosts=cache-svc.kylin-example.svc.cluster.local:11211
root@open-source:/home/ubuntu/kylin-kubernetes/kubernetes/example/deployment#
cd ../config/
root@open-source:/home/ubuntu/kylin-kubernetes/kubernetes/example/config#
vim kylin-job/kylin.properties
root@open-source:/home/ubuntu/kylin-kubernetes/kubernetes/example/config#
vim kylin-query/kylin.properties
```
- Change configuration of memcached related(part-2)
```
root@open-source:/home/ubuntu/kylin-kubernetes/kubernetes/example/config#
vim tomcat/context.xml
```
```xml
```
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.
For queries about this service, please contact Infrastructure at:
us...@infra.apache.org
> Kylin on kubernetes in a quickstart env
> ---
>
> Key: KYLIN-4446
> URL: https://issues.apache.org/jira/browse/KYLIN-4446
> Project: Kylin
> Issue Type: Sub-task
> Components: Integration
>Reporter: Xiaoxiang Yu
>Assignee: Xiaoxiang Yu
>Priority: Major
> Labels: kubernetes
> Fix For: v3.1.0
>
> Original Estimate: 48h
> Time Spent: 2h
> Remaining Estimate: 46h
>
> For a quick-start/PoC purpose, please consider use this template, it will
> only deploy one Kylin instance with role {color:#de350b}*ALL* {color}
--
This message was sent by Atlassian Jira
(v8.3.4#803005)
[GitHub] [kylin] hit-lacus edited a comment on pull request #1182: KYLIN-4446 Kylin on kubernetes in quick-start and production env
hit-lacus edited a comment on pull request #1182: URL: https://github.com/apache/kylin/pull/1182#issuecomment-619861990 ## Create Kylin Job Service - Change configuration of memcached related(part-1) ```shell # kylin.cache.memcached.hosts=cache-svc.kylin-example.svc.cluster.local:11211 root@open-source:/home/ubuntu/kylin-kubernetes/kubernetes/example/deployment# cd ../config/ root@open-source:/home/ubuntu/kylin-kubernetes/kubernetes/example/config# vim kylin-job/kylin.properties root@open-source:/home/ubuntu/kylin-kubernetes/kubernetes/example/config# vim kylin-query/kylin.properties ``` - Change configuration of memcached related(part-2) ``` root@open-source:/home/ubuntu/kylin-kubernetes/kubernetes/example/config# vim tomcat/context.xml ``` ```xml ``` This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use the URL above to go to the specific comment. For queries about this service, please contact Infrastructure at: us...@infra.apache.org
[jira] [Commented] (KYLIN-4446) Kylin on kubernetes in a quickstart env
[
https://issues.apache.org/jira/browse/KYLIN-4446?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17093406#comment-17093406
]
ASF GitHub Bot commented on KYLIN-4446:
---
hit-lacus edited a comment on pull request #1182:
URL: https://github.com/apache/kylin/pull/1182#issuecomment-619861773
## Create Memcached Service
- Create namespace
```shell
root@open-source:/home/ubuntu/kylin-kubernetes/kubernetes/example/deployment#
kubectl create namespace kylin-example
Error from server (AlreadyExists): namespaces "kylin-example" already exists
```
- Create memcached service
```shell
root@open-source:/home/ubuntu/kylin-kubernetes/kubernetes/example/deployment#
kubectl apply -f memcached
service/cache-svc created
statefulset.apps/kylin-memcached created
```
- Check service and pod state
```shell
root@open-source:/home/ubuntu/kylin-kubernetes/kubernetes/example/deployment#
kubectl get pod -n kylin-example
NAMEREADY STATUSRESTARTS AGE
kylin-memcached-0 1/1 Running 0 60s
root@open-source:/home/ubuntu/kylin-kubernetes/kubernetes/example/deployment#
kubectl get svc -n kylin-example
NAMETYPECLUSTER-IP EXTERNAL-IP PORT(S) AGE
cache-svc ClusterIP None 11211/TCP 69s
```
- Check hostname and port listen
```
root@open-source:/home/ubuntu/kylin-kubernetes/kubernetes/example/deployment#
root@open-source:/home/ubuntu/kylin-kubernetes/kubernetes/example/deployment#
kubectl run -it --image=busybox:1.28.4 --rm --restart=Never sh -n test-dnsIf
you don't see a command prompt, try pressing enter.
/ # nslookup cache-svc.kylin-example.svc.cluster.local
Server:10.96.0.10
Address 1: 10.96.0.10 kube-dns.kube-system.svc.cluster.local
Name: cache-svc.kylin-example.svc.cluster.local
Address 1: 192.168.11.9
kylin-memcached-0.cache-svc.kylin-example.svc.cluster.local
/ # telnet cache-svc.kylin-example.svc.cluster.local 11211
^C
```
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.
For queries about this service, please contact Infrastructure at:
us...@infra.apache.org
> Kylin on kubernetes in a quickstart env
> ---
>
> Key: KYLIN-4446
> URL: https://issues.apache.org/jira/browse/KYLIN-4446
> Project: Kylin
> Issue Type: Sub-task
> Components: Integration
>Reporter: Xiaoxiang Yu
>Assignee: Xiaoxiang Yu
>Priority: Major
> Labels: kubernetes
> Fix For: v3.1.0
>
> Original Estimate: 48h
> Time Spent: 2h
> Remaining Estimate: 46h
>
> For a quick-start/PoC purpose, please consider use this template, it will
> only deploy one Kylin instance with role {color:#de350b}*ALL* {color}
--
This message was sent by Atlassian Jira
(v8.3.4#803005)
[GitHub] [kylin] hit-lacus edited a comment on pull request #1182: KYLIN-4446 Kylin on kubernetes in quick-start and production env
hit-lacus edited a comment on pull request #1182: URL: https://github.com/apache/kylin/pull/1182#issuecomment-619861773 ## Create Memcached Service - Create namespace ```shell root@open-source:/home/ubuntu/kylin-kubernetes/kubernetes/example/deployment# kubectl create namespace kylin-example Error from server (AlreadyExists): namespaces "kylin-example" already exists ``` - Create memcached service ```shell root@open-source:/home/ubuntu/kylin-kubernetes/kubernetes/example/deployment# kubectl apply -f memcached service/cache-svc created statefulset.apps/kylin-memcached created ``` - Check service and pod state ```shell root@open-source:/home/ubuntu/kylin-kubernetes/kubernetes/example/deployment# kubectl get pod -n kylin-example NAMEREADY STATUSRESTARTS AGE kylin-memcached-0 1/1 Running 0 60s root@open-source:/home/ubuntu/kylin-kubernetes/kubernetes/example/deployment# kubectl get svc -n kylin-example NAMETYPECLUSTER-IP EXTERNAL-IP PORT(S) AGE cache-svc ClusterIP None 11211/TCP 69s ``` - Check hostname and port listen ``` root@open-source:/home/ubuntu/kylin-kubernetes/kubernetes/example/deployment# root@open-source:/home/ubuntu/kylin-kubernetes/kubernetes/example/deployment# kubectl run -it --image=busybox:1.28.4 --rm --restart=Never sh -n test-dnsIf you don't see a command prompt, try pressing enter. / # nslookup cache-svc.kylin-example.svc.cluster.local Server:10.96.0.10 Address 1: 10.96.0.10 kube-dns.kube-system.svc.cluster.local Name: cache-svc.kylin-example.svc.cluster.local Address 1: 192.168.11.9 kylin-memcached-0.cache-svc.kylin-example.svc.cluster.local / # telnet cache-svc.kylin-example.svc.cluster.local 11211 ^C ``` This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use the URL above to go to the specific comment. For queries about this service, please contact Infrastructure at: us...@infra.apache.org
[GitHub] [kylin] hit-lacus edited a comment on pull request #1182: KYLIN-4446 Kylin on kubernetes in quick-start and production env
hit-lacus edited a comment on pull request #1182: URL: https://github.com/apache/kylin/pull/1182#issuecomment-619861773 ## Create Memcached Service - Create namespace ```shell root@open-source:/home/ubuntu/kylin-kubernetes/kubernetes/example/deployment# kubectl create namespace kylin-example Error from server (AlreadyExists): namespaces "kylin-example" already exists ``` - Create memcached service ```shell root@open-source:/home/ubuntu/kylin-kubernetes/kubernetes/example/deployment# kubectl apply -f memcached service/cache-svc created statefulset.apps/kylin-memcached created ``` - Check service and pod state ```shell root@open-source:/home/ubuntu/kylin-kubernetes/kubernetes/example/deployment# kubectl get pod -n kylin-example NAMEREADY STATUSRESTARTS AGE kylin-memcached-0 1/1 Running 0 60s root@open-source:/home/ubuntu/kylin-kubernetes/kubernetes/example/deployment# kubectl get svc -n kylin-example NAMETYPECLUSTER-IP EXTERNAL-IP PORT(S) AGE cache-svc ClusterIP None 11211/TCP 69s ``` - Check hostname ``` root@open-source:/home/ubuntu/kylin-kubernetes/kubernetes/example/deployment# root@open-source:/home/ubuntu/kylin-kubernetes/kubernetes/example/deployment# kubectl run -it --image=busybox:1.28.4 --rm --restart=Never sh -n test-dnsIf you don't see a command prompt, try pressing enter. / # nslookup cache-svc.kylin-example.svc.cluster.local Server:10.96.0.10 Address 1: 10.96.0.10 kube-dns.kube-system.svc.cluster.local Name: cache-svc.kylin-example.svc.cluster.local Address 1: 192.168.11.9 kylin-memcached-0.cache-svc.kylin-example.svc.cluster.local / # telnet cache-svc.kylin-example.svc.cluster.local 11211 ^C ``` This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use the URL above to go to the specific comment. For queries about this service, please contact Infrastructure at: us...@infra.apache.org
[jira] [Commented] (KYLIN-4446) Kylin on kubernetes in a quickstart env
[
https://issues.apache.org/jira/browse/KYLIN-4446?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17093405#comment-17093405
]
ASF GitHub Bot commented on KYLIN-4446:
---
hit-lacus edited a comment on pull request #1182:
URL: https://github.com/apache/kylin/pull/1182#issuecomment-619861773
## Create Memcached Service
- Create namespace
```shell
root@open-source:/home/ubuntu/kylin-kubernetes/kubernetes/example/deployment#
kubectl create namespace kylin-example
Error from server (AlreadyExists): namespaces "kylin-example" already exists
```
- Create memcached service
```shell
root@open-source:/home/ubuntu/kylin-kubernetes/kubernetes/example/deployment#
kubectl apply -f memcached
service/cache-svc created
statefulset.apps/kylin-memcached created
```
- Check service and pod state
```shell
root@open-source:/home/ubuntu/kylin-kubernetes/kubernetes/example/deployment#
kubectl get pod -n kylin-example
NAMEREADY STATUSRESTARTS AGE
kylin-memcached-0 1/1 Running 0 60s
root@open-source:/home/ubuntu/kylin-kubernetes/kubernetes/example/deployment#
kubectl get svc -n kylin-example
NAMETYPECLUSTER-IP EXTERNAL-IP PORT(S) AGE
cache-svc ClusterIP None 11211/TCP 69s
```
- Check hostname
```
root@open-source:/home/ubuntu/kylin-kubernetes/kubernetes/example/deployment#
root@open-source:/home/ubuntu/kylin-kubernetes/kubernetes/example/deployment#
kubectl run -it --image=busybox:1.28.4 --rm --restart=Never sh -n test-dnsIf
you don't see a command prompt, try pressing enter.
/ # nslookup cache-svc.kylin-example.svc.cluster.local
Server:10.96.0.10
Address 1: 10.96.0.10 kube-dns.kube-system.svc.cluster.local
Name: cache-svc.kylin-example.svc.cluster.local
Address 1: 192.168.11.9
kylin-memcached-0.cache-svc.kylin-example.svc.cluster.local
/ # telnet cache-svc.kylin-example.svc.cluster.local 11211
^C
```
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.
For queries about this service, please contact Infrastructure at:
us...@infra.apache.org
> Kylin on kubernetes in a quickstart env
> ---
>
> Key: KYLIN-4446
> URL: https://issues.apache.org/jira/browse/KYLIN-4446
> Project: Kylin
> Issue Type: Sub-task
> Components: Integration
>Reporter: Xiaoxiang Yu
>Assignee: Xiaoxiang Yu
>Priority: Major
> Labels: kubernetes
> Fix For: v3.1.0
>
> Original Estimate: 48h
> Time Spent: 2h
> Remaining Estimate: 46h
>
> For a quick-start/PoC purpose, please consider use this template, it will
> only deploy one Kylin instance with role {color:#de350b}*ALL* {color}
--
This message was sent by Atlassian Jira
(v8.3.4#803005)
[jira] [Commented] (KYLIN-4446) Kylin on kubernetes in a quickstart env
[
https://issues.apache.org/jira/browse/KYLIN-4446?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17093402#comment-17093402
]
ASF GitHub Bot commented on KYLIN-4446:
---
hit-lacus edited a comment on pull request #1182:
URL: https://github.com/apache/kylin/pull/1182#issuecomment-619861773
## Create Memcached Service
```shell
root@open-source:/home/ubuntu/kylin-kubernetes/kubernetes/example/deployment#
kubectl create namespace kylin-example
Error from server (AlreadyExists): namespaces "kylin-example" already exists
```
```shell
root@open-source:/home/ubuntu/kylin-kubernetes/kubernetes/example/deployment#
kubectl apply -f memcached
service/cache-svc created
statefulset.apps/kylin-memcached created
```
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.
For queries about this service, please contact Infrastructure at:
us...@infra.apache.org
> Kylin on kubernetes in a quickstart env
> ---
>
> Key: KYLIN-4446
> URL: https://issues.apache.org/jira/browse/KYLIN-4446
> Project: Kylin
> Issue Type: Sub-task
> Components: Integration
>Reporter: Xiaoxiang Yu
>Assignee: Xiaoxiang Yu
>Priority: Major
> Labels: kubernetes
> Fix For: v3.1.0
>
> Original Estimate: 48h
> Time Spent: 2h
> Remaining Estimate: 46h
>
> For a quick-start/PoC purpose, please consider use this template, it will
> only deploy one Kylin instance with role {color:#de350b}*ALL* {color}
--
This message was sent by Atlassian Jira
(v8.3.4#803005)
[GitHub] [kylin] hit-lacus edited a comment on pull request #1182: KYLIN-4446 Kylin on kubernetes in quick-start and production env
hit-lacus edited a comment on pull request #1182: URL: https://github.com/apache/kylin/pull/1182#issuecomment-619861773 ## Create Memcached Service ```shell root@open-source:/home/ubuntu/kylin-kubernetes/kubernetes/example/deployment# kubectl create namespace kylin-example Error from server (AlreadyExists): namespaces "kylin-example" already exists ``` ```shell root@open-source:/home/ubuntu/kylin-kubernetes/kubernetes/example/deployment# kubectl apply -f memcached service/cache-svc created statefulset.apps/kylin-memcached created ``` This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use the URL above to go to the specific comment. For queries about this service, please contact Infrastructure at: us...@infra.apache.org
[jira] [Commented] (KYLIN-4446) Kylin on kubernetes in a quickstart env
[
https://issues.apache.org/jira/browse/KYLIN-4446?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17093400#comment-17093400
]
ASF GitHub Bot commented on KYLIN-4446:
---
hit-lacus edited a comment on pull request #1182:
URL: https://github.com/apache/kylin/pull/1182#issuecomment-619861191
## Prepare Hadoop Configuration
- Download https://github.com/hit-lacus/kylin/tree/kubernetes
- Go to `kubernetes/example` dir.
```shell
root@open-source:/home/ubuntu/kylin-kubernetes# cd kubernetes/example/
root@open-source:/home/ubuntu/kylin-kubernetes/kubernetes/example# pwd
/home/ubuntu/kylin-kubernetes/kubernetes/example
root@open-source:/home/ubuntu/kylin-kubernetes/kubernetes/example# ll
total 24
drwxr-xr-x 4 ubuntu ubuntu 4096 Apr 27 11:40 ./
drwxr-xr-x 6 ubuntu ubuntu 4096 Apr 27 11:40 ../
drwxr-xr-x 7 ubuntu ubuntu 4096 Apr 27 11:40 config/
drwxr-xr-x 5 ubuntu ubuntu 4096 Apr 27 11:40 deployment/
-rwxr-xr-x 1 ubuntu ubuntu 7400 Apr 27 11:40 README.md*
```
- Replace hadoop configuration files with yours.
```
root@open-source:/home/ubuntu/kylin-kubernetes/kubernetes/example/config/hadoop#
ll
total 48
drwxr-xr-x 2 ubuntu ubuntu 4096 Apr 27 11:40 ./
drwxr-xr-x 7 ubuntu ubuntu 4096 Apr 27 11:40 ../
-rwxr-xr-x 1 ubuntu ubuntu 4286 Apr 27 11:40 core-site.xml*
-rwxr-xr-x 1 ubuntu ubuntu 3492 Apr 27 11:40 hbase-site.xml*
-rwxr-xr-x 1 ubuntu ubuntu 2458 Apr 27 11:40 hdfs-site.xml*
-rwxr-xr-x 1 ubuntu ubuntu 6336 Apr 27 11:40 hive-site.xml*
-rwxr-xr-x 1 ubuntu ubuntu 5574 Apr 27 11:40 mapred-site.xml*
-rwxr-xr-x 1 ubuntu ubuntu 4305 Apr 27 11:40 yarn-site.xml*
```
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.
For queries about this service, please contact Infrastructure at:
us...@infra.apache.org
> Kylin on kubernetes in a quickstart env
> ---
>
> Key: KYLIN-4446
> URL: https://issues.apache.org/jira/browse/KYLIN-4446
> Project: Kylin
> Issue Type: Sub-task
> Components: Integration
>Reporter: Xiaoxiang Yu
>Assignee: Xiaoxiang Yu
>Priority: Major
> Labels: kubernetes
> Fix For: v3.1.0
>
> Original Estimate: 48h
> Time Spent: 2h
> Remaining Estimate: 46h
>
> For a quick-start/PoC purpose, please consider use this template, it will
> only deploy one Kylin instance with role {color:#de350b}*ALL* {color}
--
This message was sent by Atlassian Jira
(v8.3.4#803005)
[GitHub] [kylin] hit-lacus edited a comment on pull request #1182: KYLIN-4446 Kylin on kubernetes in quick-start and production env
hit-lacus edited a comment on pull request #1182: URL: https://github.com/apache/kylin/pull/1182#issuecomment-619861191 ## Prepare Hadoop Configuration - Download https://github.com/hit-lacus/kylin/tree/kubernetes - Go to `kubernetes/example` dir. ```shell root@open-source:/home/ubuntu/kylin-kubernetes# cd kubernetes/example/ root@open-source:/home/ubuntu/kylin-kubernetes/kubernetes/example# pwd /home/ubuntu/kylin-kubernetes/kubernetes/example root@open-source:/home/ubuntu/kylin-kubernetes/kubernetes/example# ll total 24 drwxr-xr-x 4 ubuntu ubuntu 4096 Apr 27 11:40 ./ drwxr-xr-x 6 ubuntu ubuntu 4096 Apr 27 11:40 ../ drwxr-xr-x 7 ubuntu ubuntu 4096 Apr 27 11:40 config/ drwxr-xr-x 5 ubuntu ubuntu 4096 Apr 27 11:40 deployment/ -rwxr-xr-x 1 ubuntu ubuntu 7400 Apr 27 11:40 README.md* ``` - Replace hadoop configuration files with yours. ``` root@open-source:/home/ubuntu/kylin-kubernetes/kubernetes/example/config/hadoop# ll total 48 drwxr-xr-x 2 ubuntu ubuntu 4096 Apr 27 11:40 ./ drwxr-xr-x 7 ubuntu ubuntu 4096 Apr 27 11:40 ../ -rwxr-xr-x 1 ubuntu ubuntu 4286 Apr 27 11:40 core-site.xml* -rwxr-xr-x 1 ubuntu ubuntu 3492 Apr 27 11:40 hbase-site.xml* -rwxr-xr-x 1 ubuntu ubuntu 2458 Apr 27 11:40 hdfs-site.xml* -rwxr-xr-x 1 ubuntu ubuntu 6336 Apr 27 11:40 hive-site.xml* -rwxr-xr-x 1 ubuntu ubuntu 5574 Apr 27 11:40 mapred-site.xml* -rwxr-xr-x 1 ubuntu ubuntu 4305 Apr 27 11:40 yarn-site.xml* ``` This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use the URL above to go to the specific comment. For queries about this service, please contact Infrastructure at: us...@infra.apache.org
[jira] [Commented] (KYLIN-4446) Kylin on kubernetes in a quickstart env
[
https://issues.apache.org/jira/browse/KYLIN-4446?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17093374#comment-17093374
]
ASF GitHub Bot commented on KYLIN-4446:
---
hit-lacus edited a comment on pull request #1182:
URL: https://github.com/apache/kylin/pull/1182#issuecomment-619833363
## Prepare Docker Image
- Downloads required binary
```shell
xiaoxiang.yu:~/ $ ll Downloads/apache-kylin-3.0.1-bin-cdh57.tar
[18:39:26]
-rw-r--r--@ 1 xiaoxiang.yu INC\Domain Users 253M 4 15 16:49
Downloads/apache-kylin-3.0.1-bin-cdh57.tar
xiaoxiang.yu:~/ $ ll Downloads/spark-2.3.2-bin-hadoop2.7.tgz
[18:39:52]
-rwxrwxrwx 1 xiaoxiang.yu INC\Domain Users 215M 3 23 01:36
Downloads/spark-2.3.2-bin-hadoop2.7.tgz
```
- Downloads required jars
```shell
xiaoxiang.yu:~/ $ ll Downloads/mem*
[18:40:05]
-rw-r--r--@ 1 xiaoxiang.yu INC\Domain Users 163K 4 27 18:45
Downloads/memcached-session-manager-2.1.1.jar
-rw-r--r--@ 1 xiaoxiang.yu INC\Domain Users11K 4 27 18:45
Downloads/memcached-session-manager-tc7-2.1.1.jar
```
- Remove old image
```shell
xiaoxiang.yu:CDH57/ (kubernetes*) $ docker rmi hadoop-client:cdh57
[18:46:33]
Untagged: hadoop-client:cdh57
xiaoxiang.yu:CDH57/ (kubernetes*) $ docker images |grep hadoop-client | grep
wc -l [18:47:31]
xiaoxiang.yu:CDH57/ (kubernetes*) $
xiaoxiang.yu:kylin-client/ (kubernetes*) $ docker rmi
kylin-client:3.0.1-cdh57
[18:51:58]
Untagged: kylin-client:3.0.1-cdh57
Deleted:
sha256:eb16424fc7cae2e4ca105e778290feec0ef370da2cc19e7df8b37ddd7166de57
Deleted:
sha256:5c5d43dc5f482ea5e60f58902f577bbfe3bc22b37175d6a5c28b3f66646f9626
Deleted:
sha256:9e509fdbf7d47b4cc28c45060809fecb888fab4c79b94f27f6826e78ed012431
Deleted:
sha256:3c97b6cb2781d7a594f18cccf357ce90214d7e1317fabf28edfccf45896af502
Deleted:
sha256:64b5601d1cb411c481382e6fe022f18dda4c5d070476a922bc4fd7531bad0846
Deleted:
sha256:fe814862cb919a47a9c162506921c0ee93edca19c5d36006f92153487c4429ef
Deleted:
sha256:1badb3b00a3f56ba66627e8c802b0a8f6a394bc2bc0dfa04d15a3085de9e34b9
Deleted:
sha256:afdb1ccabfabd7f375a184c6a8aa3b0aeb54195e92fd67d5a225a9e6fc501469
Deleted:
sha256:515eaf5fcbabf292b0e39d7fffd2d43f6c02d4b13af4f99be79027d120ce792d
Deleted:
sha256:f88e58969b5f908502fbddf2e058a97d31ed31134c8020b0762eea1224a86383
Deleted:
sha256:24b707ed4fe0ac52d4f3b32f9eac13fcd3698071a521f02ba1494d8cd7ec7646
Deleted:
sha256:664b07d4d73e4a1b587983f0b80fd7500d93f1c1eedbf925adf5b94391583389
Deleted:
sha256:75cdc77ae2aa8a0be849cd09961fc80a4d3856964fe91e265da2580b2d7dbd10
Deleted:
sha256:78e1a1873e763dd81d65d0249869d546e39806fc9ae415d508bff7fac3a1c1eb
```
- Build Hadoop-Client image
```shell
xiaoxiang.yu:CDH57/ (kubernetes*) $ pwd
[18:50:57]
/Users/xiaoxiang.yu/IntelliJ_IDEA_Project/MyKylin/kubernetes/docker/hadoop-client/CDH57
xiaoxiang.yu:CDH57/ (kubernetes*) $ cp
~/Downloads/spark-2.3.2-bin-hadoop2.7.tgz provided-binary
[18:48:25]
xiaoxiang.yu:CDH57/ (kubernetes*) $
[18:48:37]
xiaoxiang.yu:CDH57/ (kubernetes*) $
[18:49:02]
xiaoxiang.yu:CDH57/ (kubernetes*) $ sh build-image.sh
[18:49:02]
Sending build context to Docker daemon 225.9MB
Step 1/26 : FROM centos:7.3.1611
---> c5d48e81b986
... ... ...
Step 26/26 : ADD provided-binary/spark-${SPARK_VERSION}-bin-hadoop2.7.tgz .
---> ee576395a7f4
Successfully built ee576395a7f4
Successfully tagged hadoop-client:cdh57
```
- Build kylin-client image
```shell
xiaoxiang.yu:kylin-client/ (kubernetes*) $ cp
/Users/xiaoxiang.yu/Downloads/memcached-session-manager-2.1.1.jar
apache-kylin-3.0.1-bin-cdh57/tomcat/lib
xiaoxiang.yu:kylin-client/ (kubernetes*) $ cp
/Users/xiaoxiang.yu/Downloads/memcached-session-manager-tc7-2.1.1.jar
apache-kylin-3.0.1-bin-cdh57/tomcat/lib
xiaoxiang.yu:kylin-client/ (kubernetes*) $ sh build-image.sh
[19:06:35]
Sending
[GitHub] [kylin] hit-lacus edited a comment on pull request #1182: KYLIN-4446 Kylin on kubernetes in quick-start and production env
hit-lacus edited a comment on pull request #1182:
URL: https://github.com/apache/kylin/pull/1182#issuecomment-619833363
## Prepare Docker Image
- Downloads required binary
```shell
xiaoxiang.yu:~/ $ ll Downloads/apache-kylin-3.0.1-bin-cdh57.tar
[18:39:26]
-rw-r--r--@ 1 xiaoxiang.yu INC\Domain Users 253M 4 15 16:49
Downloads/apache-kylin-3.0.1-bin-cdh57.tar
xiaoxiang.yu:~/ $ ll Downloads/spark-2.3.2-bin-hadoop2.7.tgz
[18:39:52]
-rwxrwxrwx 1 xiaoxiang.yu INC\Domain Users 215M 3 23 01:36
Downloads/spark-2.3.2-bin-hadoop2.7.tgz
```
- Downloads required jars
```shell
xiaoxiang.yu:~/ $ ll Downloads/mem*
[18:40:05]
-rw-r--r--@ 1 xiaoxiang.yu INC\Domain Users 163K 4 27 18:45
Downloads/memcached-session-manager-2.1.1.jar
-rw-r--r--@ 1 xiaoxiang.yu INC\Domain Users11K 4 27 18:45
Downloads/memcached-session-manager-tc7-2.1.1.jar
```
- Remove old image
```shell
xiaoxiang.yu:CDH57/ (kubernetes*) $ docker rmi hadoop-client:cdh57
[18:46:33]
Untagged: hadoop-client:cdh57
xiaoxiang.yu:CDH57/ (kubernetes*) $ docker images |grep hadoop-client | grep
wc -l [18:47:31]
xiaoxiang.yu:CDH57/ (kubernetes*) $
xiaoxiang.yu:kylin-client/ (kubernetes*) $ docker rmi
kylin-client:3.0.1-cdh57
[18:51:58]
Untagged: kylin-client:3.0.1-cdh57
Deleted:
sha256:eb16424fc7cae2e4ca105e778290feec0ef370da2cc19e7df8b37ddd7166de57
Deleted:
sha256:5c5d43dc5f482ea5e60f58902f577bbfe3bc22b37175d6a5c28b3f66646f9626
Deleted:
sha256:9e509fdbf7d47b4cc28c45060809fecb888fab4c79b94f27f6826e78ed012431
Deleted:
sha256:3c97b6cb2781d7a594f18cccf357ce90214d7e1317fabf28edfccf45896af502
Deleted:
sha256:64b5601d1cb411c481382e6fe022f18dda4c5d070476a922bc4fd7531bad0846
Deleted:
sha256:fe814862cb919a47a9c162506921c0ee93edca19c5d36006f92153487c4429ef
Deleted:
sha256:1badb3b00a3f56ba66627e8c802b0a8f6a394bc2bc0dfa04d15a3085de9e34b9
Deleted:
sha256:afdb1ccabfabd7f375a184c6a8aa3b0aeb54195e92fd67d5a225a9e6fc501469
Deleted:
sha256:515eaf5fcbabf292b0e39d7fffd2d43f6c02d4b13af4f99be79027d120ce792d
Deleted:
sha256:f88e58969b5f908502fbddf2e058a97d31ed31134c8020b0762eea1224a86383
Deleted:
sha256:24b707ed4fe0ac52d4f3b32f9eac13fcd3698071a521f02ba1494d8cd7ec7646
Deleted:
sha256:664b07d4d73e4a1b587983f0b80fd7500d93f1c1eedbf925adf5b94391583389
Deleted:
sha256:75cdc77ae2aa8a0be849cd09961fc80a4d3856964fe91e265da2580b2d7dbd10
Deleted:
sha256:78e1a1873e763dd81d65d0249869d546e39806fc9ae415d508bff7fac3a1c1eb
```
- Build Hadoop-Client image
```shell
xiaoxiang.yu:CDH57/ (kubernetes*) $ pwd
[18:50:57]
/Users/xiaoxiang.yu/IntelliJ_IDEA_Project/MyKylin/kubernetes/docker/hadoop-client/CDH57
xiaoxiang.yu:CDH57/ (kubernetes*) $ cp
~/Downloads/spark-2.3.2-bin-hadoop2.7.tgz provided-binary
[18:48:25]
xiaoxiang.yu:CDH57/ (kubernetes*) $
[18:48:37]
xiaoxiang.yu:CDH57/ (kubernetes*) $
[18:49:02]
xiaoxiang.yu:CDH57/ (kubernetes*) $ sh build-image.sh
[18:49:02]
Sending build context to Docker daemon 225.9MB
Step 1/26 : FROM centos:7.3.1611
---> c5d48e81b986
... ... ...
Step 26/26 : ADD provided-binary/spark-${SPARK_VERSION}-bin-hadoop2.7.tgz .
---> ee576395a7f4
Successfully built ee576395a7f4
Successfully tagged hadoop-client:cdh57
```
- Build kylin-client image
```shell
xiaoxiang.yu:kylin-client/ (kubernetes*) $ cp
/Users/xiaoxiang.yu/Downloads/memcached-session-manager-2.1.1.jar
apache-kylin-3.0.1-bin-cdh57/tomcat/lib
xiaoxiang.yu:kylin-client/ (kubernetes*) $ cp
/Users/xiaoxiang.yu/Downloads/memcached-session-manager-tc7-2.1.1.jar
apache-kylin-3.0.1-bin-cdh57/tomcat/lib
xiaoxiang.yu:kylin-client/ (kubernetes*) $ sh build-image.sh
[19:06:35]
Sending build context to Docker daemon 531.4MB
Step 1/23 : FROM hadoop-client:cdh57
---> ee576395a7f4
Step 2/23 : MAINTAINER Apache Kylin
---> Using cache
---> bd37b4be904f
Step 3/23 : ARG USER=apache_kylin
---> Using
[jira] [Commented] (KYLIN-4446) Kylin on kubernetes in a quickstart env
[
https://issues.apache.org/jira/browse/KYLIN-4446?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17093371#comment-17093371
]
ASF GitHub Bot commented on KYLIN-4446:
---
coveralls edited a comment on pull request #1182:
URL: https://github.com/apache/kylin/pull/1182#issuecomment-617824003
## Pull Request Test Coverage Report for [Build
5857](https://coveralls.io/builds/30367072)
* **0** of **0** changed or added relevant lines in **0** files are
covered.
* **7** unchanged lines in **2** files lost coverage.
* Overall coverage remained the same at **27.466%**
---
| Files with Coverage Reduction | New Missed Lines | % |
| :-|--|--: |
|
[core-job/src/main/java/org/apache/kylin/job/impl/threadpool/DefaultScheduler.java](https://coveralls.io/builds/30367072/source?filename=core-job%2Fsrc%2Fmain%2Fjava%2Forg%2Fapache%2Fkylin%2Fjob%2Fimpl%2Fthreadpool%2FDefaultScheduler.java#L194)
| 2 | 80.23% |
|
[core-cube/src/main/java/org/apache/kylin/cube/inmemcubing/MemDiskStore.java](https://coveralls.io/builds/30367072/source?filename=core-cube%2Fsrc%2Fmain%2Fjava%2Forg%2Fapache%2Fkylin%2Fcube%2Finmemcubing%2FMemDiskStore.java#L439)
| 5 | 77.81% |
| Totals | [](https://coveralls.io/builds/30367072)
|
| :-- | --: |
| Change from base [Build 5853](https://coveralls.io/builds/30348545): |
0.0% |
| Covered Lines: | 24316 |
| Relevant Lines: | 88532 |
---
# - [Coveralls](https://coveralls.io)
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.
For queries about this service, please contact Infrastructure at:
us...@infra.apache.org
> Kylin on kubernetes in a quickstart env
> ---
>
> Key: KYLIN-4446
> URL: https://issues.apache.org/jira/browse/KYLIN-4446
> Project: Kylin
> Issue Type: Sub-task
> Components: Integration
>Reporter: Xiaoxiang Yu
>Assignee: Xiaoxiang Yu
>Priority: Major
> Labels: kubernetes
> Fix For: v3.1.0
>
> Original Estimate: 48h
> Time Spent: 2h
> Remaining Estimate: 46h
>
> For a quick-start/PoC purpose, please consider use this template, it will
> only deploy one Kylin instance with role {color:#de350b}*ALL* {color}
--
This message was sent by Atlassian Jira
(v8.3.4#803005)
[GitHub] [kylin] coveralls edited a comment on pull request #1182: KYLIN-4446 Kylin on kubernetes in quick-start and production env
coveralls edited a comment on pull request #1182: URL: https://github.com/apache/kylin/pull/1182#issuecomment-617824003 ## Pull Request Test Coverage Report for [Build 5857](https://coveralls.io/builds/30367072) * **0** of **0** changed or added relevant lines in **0** files are covered. * **7** unchanged lines in **2** files lost coverage. * Overall coverage remained the same at **27.466%** --- | Files with Coverage Reduction | New Missed Lines | % | | :-|--|--: | | [core-job/src/main/java/org/apache/kylin/job/impl/threadpool/DefaultScheduler.java](https://coveralls.io/builds/30367072/source?filename=core-job%2Fsrc%2Fmain%2Fjava%2Forg%2Fapache%2Fkylin%2Fjob%2Fimpl%2Fthreadpool%2FDefaultScheduler.java#L194) | 2 | 80.23% | | [core-cube/src/main/java/org/apache/kylin/cube/inmemcubing/MemDiskStore.java](https://coveralls.io/builds/30367072/source?filename=core-cube%2Fsrc%2Fmain%2Fjava%2Forg%2Fapache%2Fkylin%2Fcube%2Finmemcubing%2FMemDiskStore.java#L439) | 5 | 77.81% | | Totals | [](https://coveralls.io/builds/30367072) | | :-- | --: | | Change from base [Build 5853](https://coveralls.io/builds/30348545): | 0.0% | | Covered Lines: | 24316 | | Relevant Lines: | 88532 | --- # - [Coveralls](https://coveralls.io) This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use the URL above to go to the specific comment. For queries about this service, please contact Infrastructure at: us...@infra.apache.org
[jira] [Commented] (KYLIN-4404) How to add new users to Kylin 3.0 and odbc driver
[ https://issues.apache.org/jira/browse/KYLIN-4404?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17093353#comment-17093353 ] Yaqian Zhang commented on KYLIN-4404: - Hi: You can click the '+User' button on the System->User page to add new users, and the management of user and user group is also carried out here. You can load kylin ODBC Driver from here: https://kyligence.io/resources/kyligence-odbc-driver-for-apache-kylin-2/ > How to add new users to Kylin 3.0 and odbc driver > -- > > Key: KYLIN-4404 > URL: https://issues.apache.org/jira/browse/KYLIN-4404 > Project: Kylin > Issue Type: Test > Components: Driver - ODBC >Affects Versions: v3.0.1 > Environment: Dev >Reporter: srikanth >Priority: Critical > > I have installed Kylin 3.0 on CDH 6.3.2 version , Can some one guide me how > to add new users to Klyin ui ? > > I am unable to find odbc driver for integrating kylin with power bi. Can some > one guide me for downloading odbc driver -- This message was sent by Atlassian Jira (v8.3.4#803005)
[jira] [Commented] (KYLIN-4446) Kylin on kubernetes in a quickstart env
[
https://issues.apache.org/jira/browse/KYLIN-4446?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17093352#comment-17093352
]
ASF GitHub Bot commented on KYLIN-4446:
---
hit-lacus edited a comment on pull request #1182:
URL: https://github.com/apache/kylin/pull/1182#issuecomment-619833363
## Prepare Docker Image
- Downloads required binary
```shell
xiaoxiang.yu:~/ $ ll Downloads/apache-kylin-3.0.1-bin-cdh57.tar
[18:39:26]
-rw-r--r--@ 1 xiaoxiang.yu INC\Domain Users 253M 4 15 16:49
Downloads/apache-kylin-3.0.1-bin-cdh57.tar
xiaoxiang.yu:~/ $ ll Downloads/spark-2.3.2-bin-hadoop2.7.tgz
[18:39:52]
-rwxrwxrwx 1 xiaoxiang.yu INC\Domain Users 215M 3 23 01:36
Downloads/spark-2.3.2-bin-hadoop2.7.tgz
```
- Downloads required jars
```shell
xiaoxiang.yu:~/ $ ll Downloads/mem*
[18:40:05]
-rw-r--r--@ 1 xiaoxiang.yu INC\Domain Users 163K 4 27 18:45
Downloads/memcached-session-manager-2.1.1.jar
-rw-r--r--@ 1 xiaoxiang.yu INC\Domain Users11K 4 27 18:45
Downloads/memcached-session-manager-tc7-2.1.1.jar
```
- Remove old image
```shell
xiaoxiang.yu:CDH57/ (kubernetes*) $ docker rmi hadoop-client:cdh57
[18:46:33]
Untagged: hadoop-client:cdh57
xiaoxiang.yu:CDH57/ (kubernetes*) $ docker images |grep hadoop-client | grep
wc -l [18:47:31]
xiaoxiang.yu:CDH57/ (kubernetes*) $
xiaoxiang.yu:kylin-client/ (kubernetes*) $ docker rmi
kylin-client:3.0.1-cdh57
[18:51:58]
Untagged: kylin-client:3.0.1-cdh57
Deleted:
sha256:eb16424fc7cae2e4ca105e778290feec0ef370da2cc19e7df8b37ddd7166de57
Deleted:
sha256:5c5d43dc5f482ea5e60f58902f577bbfe3bc22b37175d6a5c28b3f66646f9626
Deleted:
sha256:9e509fdbf7d47b4cc28c45060809fecb888fab4c79b94f27f6826e78ed012431
Deleted:
sha256:3c97b6cb2781d7a594f18cccf357ce90214d7e1317fabf28edfccf45896af502
Deleted:
sha256:64b5601d1cb411c481382e6fe022f18dda4c5d070476a922bc4fd7531bad0846
Deleted:
sha256:fe814862cb919a47a9c162506921c0ee93edca19c5d36006f92153487c4429ef
Deleted:
sha256:1badb3b00a3f56ba66627e8c802b0a8f6a394bc2bc0dfa04d15a3085de9e34b9
Deleted:
sha256:afdb1ccabfabd7f375a184c6a8aa3b0aeb54195e92fd67d5a225a9e6fc501469
Deleted:
sha256:515eaf5fcbabf292b0e39d7fffd2d43f6c02d4b13af4f99be79027d120ce792d
Deleted:
sha256:f88e58969b5f908502fbddf2e058a97d31ed31134c8020b0762eea1224a86383
Deleted:
sha256:24b707ed4fe0ac52d4f3b32f9eac13fcd3698071a521f02ba1494d8cd7ec7646
Deleted:
sha256:664b07d4d73e4a1b587983f0b80fd7500d93f1c1eedbf925adf5b94391583389
Deleted:
sha256:75cdc77ae2aa8a0be849cd09961fc80a4d3856964fe91e265da2580b2d7dbd10
Deleted:
sha256:78e1a1873e763dd81d65d0249869d546e39806fc9ae415d508bff7fac3a1c1eb
```
- Build Hadoop-Client image
```shell
xiaoxiang.yu:CDH57/ (kubernetes*) $ pwd
[18:50:57]
/Users/xiaoxiang.yu/IntelliJ_IDEA_Project/MyKylin/kubernetes/docker/hadoop-client/CDH57
xiaoxiang.yu:CDH57/ (kubernetes*) $ cp
~/Downloads/spark-2.3.2-bin-hadoop2.7.tgz provided-binary
[18:48:25]
xiaoxiang.yu:CDH57/ (kubernetes*) $
[18:48:37]
xiaoxiang.yu:CDH57/ (kubernetes*) $
[18:49:02]
xiaoxiang.yu:CDH57/ (kubernetes*) $ sh build-image.sh
[18:49:02]
Sending build context to Docker daemon 225.9MB
Step 1/26 : FROM centos:7.3.1611
---> c5d48e81b986
... ... ...
Step 26/26 : ADD provided-binary/spark-${SPARK_VERSION}-bin-hadoop2.7.tgz .
---> ee576395a7f4
Successfully built ee576395a7f4
Successfully tagged hadoop-client:cdh57
```
- Build kylin-client image
```shell
xiaoxiang.yu:kylin-client/ (kubernetes*) $ cp
/Users/xiaoxiang.yu/Downloads/memcached-session-manager-2.1.1.jar
apache-kylin-3.0.1-bin-cdh57/tomcat/lib
xiaoxiang.yu:kylin-client/ (kubernetes*) $ cp
/Users/xiaoxiang.yu/Downloads/memcached-session-manager-tc7-2.1.1.jar
apache-kylin-3.0.1-bin-cdh57/tomcat/lib
xiaoxiang.yu:kylin-client/ (kubernetes*) $ sh build-image.sh
[19:06:35]
Sending
[GitHub] [kylin] hit-lacus edited a comment on pull request #1182: KYLIN-4446 Kylin on kubernetes in quick-start and production env
hit-lacus edited a comment on pull request #1182:
URL: https://github.com/apache/kylin/pull/1182#issuecomment-619833363
## Prepare Docker Image
- Downloads required binary
```shell
xiaoxiang.yu:~/ $ ll Downloads/apache-kylin-3.0.1-bin-cdh57.tar
[18:39:26]
-rw-r--r--@ 1 xiaoxiang.yu INC\Domain Users 253M 4 15 16:49
Downloads/apache-kylin-3.0.1-bin-cdh57.tar
xiaoxiang.yu:~/ $ ll Downloads/spark-2.3.2-bin-hadoop2.7.tgz
[18:39:52]
-rwxrwxrwx 1 xiaoxiang.yu INC\Domain Users 215M 3 23 01:36
Downloads/spark-2.3.2-bin-hadoop2.7.tgz
```
- Downloads required jars
```shell
xiaoxiang.yu:~/ $ ll Downloads/mem*
[18:40:05]
-rw-r--r--@ 1 xiaoxiang.yu INC\Domain Users 163K 4 27 18:45
Downloads/memcached-session-manager-2.1.1.jar
-rw-r--r--@ 1 xiaoxiang.yu INC\Domain Users11K 4 27 18:45
Downloads/memcached-session-manager-tc7-2.1.1.jar
```
- Remove old image
```shell
xiaoxiang.yu:CDH57/ (kubernetes*) $ docker rmi hadoop-client:cdh57
[18:46:33]
Untagged: hadoop-client:cdh57
xiaoxiang.yu:CDH57/ (kubernetes*) $ docker images |grep hadoop-client | grep
wc -l [18:47:31]
xiaoxiang.yu:CDH57/ (kubernetes*) $
xiaoxiang.yu:kylin-client/ (kubernetes*) $ docker rmi
kylin-client:3.0.1-cdh57
[18:51:58]
Untagged: kylin-client:3.0.1-cdh57
Deleted:
sha256:eb16424fc7cae2e4ca105e778290feec0ef370da2cc19e7df8b37ddd7166de57
Deleted:
sha256:5c5d43dc5f482ea5e60f58902f577bbfe3bc22b37175d6a5c28b3f66646f9626
Deleted:
sha256:9e509fdbf7d47b4cc28c45060809fecb888fab4c79b94f27f6826e78ed012431
Deleted:
sha256:3c97b6cb2781d7a594f18cccf357ce90214d7e1317fabf28edfccf45896af502
Deleted:
sha256:64b5601d1cb411c481382e6fe022f18dda4c5d070476a922bc4fd7531bad0846
Deleted:
sha256:fe814862cb919a47a9c162506921c0ee93edca19c5d36006f92153487c4429ef
Deleted:
sha256:1badb3b00a3f56ba66627e8c802b0a8f6a394bc2bc0dfa04d15a3085de9e34b9
Deleted:
sha256:afdb1ccabfabd7f375a184c6a8aa3b0aeb54195e92fd67d5a225a9e6fc501469
Deleted:
sha256:515eaf5fcbabf292b0e39d7fffd2d43f6c02d4b13af4f99be79027d120ce792d
Deleted:
sha256:f88e58969b5f908502fbddf2e058a97d31ed31134c8020b0762eea1224a86383
Deleted:
sha256:24b707ed4fe0ac52d4f3b32f9eac13fcd3698071a521f02ba1494d8cd7ec7646
Deleted:
sha256:664b07d4d73e4a1b587983f0b80fd7500d93f1c1eedbf925adf5b94391583389
Deleted:
sha256:75cdc77ae2aa8a0be849cd09961fc80a4d3856964fe91e265da2580b2d7dbd10
Deleted:
sha256:78e1a1873e763dd81d65d0249869d546e39806fc9ae415d508bff7fac3a1c1eb
```
- Build Hadoop-Client image
```shell
xiaoxiang.yu:CDH57/ (kubernetes*) $ pwd
[18:50:57]
/Users/xiaoxiang.yu/IntelliJ_IDEA_Project/MyKylin/kubernetes/docker/hadoop-client/CDH57
xiaoxiang.yu:CDH57/ (kubernetes*) $ cp
~/Downloads/spark-2.3.2-bin-hadoop2.7.tgz provided-binary
[18:48:25]
xiaoxiang.yu:CDH57/ (kubernetes*) $
[18:48:37]
xiaoxiang.yu:CDH57/ (kubernetes*) $
[18:49:02]
xiaoxiang.yu:CDH57/ (kubernetes*) $ sh build-image.sh
[18:49:02]
Sending build context to Docker daemon 225.9MB
Step 1/26 : FROM centos:7.3.1611
---> c5d48e81b986
... ... ...
Step 26/26 : ADD provided-binary/spark-${SPARK_VERSION}-bin-hadoop2.7.tgz .
---> ee576395a7f4
Successfully built ee576395a7f4
Successfully tagged hadoop-client:cdh57
```
- Build kylin-client image
```shell
xiaoxiang.yu:kylin-client/ (kubernetes*) $ cp
/Users/xiaoxiang.yu/Downloads/memcached-session-manager-2.1.1.jar
apache-kylin-3.0.1-bin-cdh57/tomcat/lib
xiaoxiang.yu:kylin-client/ (kubernetes*) $ cp
/Users/xiaoxiang.yu/Downloads/memcached-session-manager-tc7-2.1.1.jar
apache-kylin-3.0.1-bin-cdh57/tomcat/lib
xiaoxiang.yu:kylin-client/ (kubernetes*) $ sh build-image.sh
[19:06:35]
Sending build context to Docker daemon 531.4MB
Step 1/23 : FROM hadoop-client:cdh57
---> ee576395a7f4
Step 2/23 : MAINTAINER Apache Kylin
---> Using cache
---> bd37b4be904f
Step 3/23 : ARG USER=apache_kylin
---> Using
[jira] [Commented] (KYLIN-4446) Kylin on kubernetes in a quickstart env
[
https://issues.apache.org/jira/browse/KYLIN-4446?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17093347#comment-17093347
]
ASF GitHub Bot commented on KYLIN-4446:
---
hit-lacus edited a comment on pull request #1182:
URL: https://github.com/apache/kylin/pull/1182#issuecomment-619833363
## Prepare Docker Image
- Downloads required binary
```shell
xiaoxiang.yu:~/ $ ll Downloads/apache-kylin-3.0.1-bin-cdh57.tar
[18:39:26]
-rw-r--r--@ 1 xiaoxiang.yu INC\Domain Users 253M 4 15 16:49
Downloads/apache-kylin-3.0.1-bin-cdh57.tar
xiaoxiang.yu:~/ $ ll Downloads/spark-2.3.2-bin-hadoop2.7.tgz
[18:39:52]
-rwxrwxrwx 1 xiaoxiang.yu INC\Domain Users 215M 3 23 01:36
Downloads/spark-2.3.2-bin-hadoop2.7.tgz
```
- Downloads required jars
```shell
xiaoxiang.yu:~/ $ ll Downloads/mem*
[18:40:05]
-rw-r--r--@ 1 xiaoxiang.yu INC\Domain Users 163K 4 27 18:45
Downloads/memcached-session-manager-2.1.1.jar
-rw-r--r--@ 1 xiaoxiang.yu INC\Domain Users11K 4 27 18:45
Downloads/memcached-session-manager-tc7-2.1.1.jar
```
- Remove old image
```shell
xiaoxiang.yu:CDH57/ (kubernetes*) $ docker rmi hadoop-client:cdh57
[18:46:33]
Untagged: hadoop-client:cdh57
xiaoxiang.yu:CDH57/ (kubernetes*) $ docker images |grep hadoop-client | grep
wc -l [18:47:31]
xiaoxiang.yu:CDH57/ (kubernetes*) $
xiaoxiang.yu:kylin-client/ (kubernetes*) $ docker rmi
kylin-client:3.0.1-cdh57
[18:51:58]
Untagged: kylin-client:3.0.1-cdh57
Deleted:
sha256:eb16424fc7cae2e4ca105e778290feec0ef370da2cc19e7df8b37ddd7166de57
Deleted:
sha256:5c5d43dc5f482ea5e60f58902f577bbfe3bc22b37175d6a5c28b3f66646f9626
Deleted:
sha256:9e509fdbf7d47b4cc28c45060809fecb888fab4c79b94f27f6826e78ed012431
Deleted:
sha256:3c97b6cb2781d7a594f18cccf357ce90214d7e1317fabf28edfccf45896af502
Deleted:
sha256:64b5601d1cb411c481382e6fe022f18dda4c5d070476a922bc4fd7531bad0846
Deleted:
sha256:fe814862cb919a47a9c162506921c0ee93edca19c5d36006f92153487c4429ef
Deleted:
sha256:1badb3b00a3f56ba66627e8c802b0a8f6a394bc2bc0dfa04d15a3085de9e34b9
Deleted:
sha256:afdb1ccabfabd7f375a184c6a8aa3b0aeb54195e92fd67d5a225a9e6fc501469
Deleted:
sha256:515eaf5fcbabf292b0e39d7fffd2d43f6c02d4b13af4f99be79027d120ce792d
Deleted:
sha256:f88e58969b5f908502fbddf2e058a97d31ed31134c8020b0762eea1224a86383
Deleted:
sha256:24b707ed4fe0ac52d4f3b32f9eac13fcd3698071a521f02ba1494d8cd7ec7646
Deleted:
sha256:664b07d4d73e4a1b587983f0b80fd7500d93f1c1eedbf925adf5b94391583389
Deleted:
sha256:75cdc77ae2aa8a0be849cd09961fc80a4d3856964fe91e265da2580b2d7dbd10
Deleted:
sha256:78e1a1873e763dd81d65d0249869d546e39806fc9ae415d508bff7fac3a1c1eb
```
- Build Hadoop-Client image
```shell
xiaoxiang.yu:CDH57/ (kubernetes*) $ pwd
[18:50:57]
/Users/xiaoxiang.yu/IntelliJ_IDEA_Project/MyKylin/kubernetes/docker/hadoop-client/CDH57
xiaoxiang.yu:CDH57/ (kubernetes*) $ cp
~/Downloads/spark-2.3.2-bin-hadoop2.7.tgz provided-binary
[18:48:25]
xiaoxiang.yu:CDH57/ (kubernetes*) $
[18:48:37]
xiaoxiang.yu:CDH57/ (kubernetes*) $
[18:49:02]
xiaoxiang.yu:CDH57/ (kubernetes*) $ sh build-image.sh
[18:49:02]
Sending build context to Docker daemon 225.9MB
Step 1/26 : FROM centos:7.3.1611
---> c5d48e81b986
... ... ...
Step 26/26 : ADD provided-binary/spark-${SPARK_VERSION}-bin-hadoop2.7.tgz .
---> ee576395a7f4
Successfully built ee576395a7f4
Successfully tagged hadoop-client:cdh57
```
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.
For queries about this service, please contact Infrastructure at:
us...@infra.apache.org
> Kylin on kubernetes in a quickstart env
> ---
>
> Key: KYLIN-4446
> URL: https://issues.apache.org/jira/browse/KYLIN-4446
>
[GitHub] [kylin] hit-lacus edited a comment on pull request #1182: KYLIN-4446 Kylin on kubernetes in quick-start and production env
hit-lacus edited a comment on pull request #1182:
URL: https://github.com/apache/kylin/pull/1182#issuecomment-619833363
## Prepare Docker Image
- Downloads required binary
```shell
xiaoxiang.yu:~/ $ ll Downloads/apache-kylin-3.0.1-bin-cdh57.tar
[18:39:26]
-rw-r--r--@ 1 xiaoxiang.yu INC\Domain Users 253M 4 15 16:49
Downloads/apache-kylin-3.0.1-bin-cdh57.tar
xiaoxiang.yu:~/ $ ll Downloads/spark-2.3.2-bin-hadoop2.7.tgz
[18:39:52]
-rwxrwxrwx 1 xiaoxiang.yu INC\Domain Users 215M 3 23 01:36
Downloads/spark-2.3.2-bin-hadoop2.7.tgz
```
- Downloads required jars
```shell
xiaoxiang.yu:~/ $ ll Downloads/mem*
[18:40:05]
-rw-r--r--@ 1 xiaoxiang.yu INC\Domain Users 163K 4 27 18:45
Downloads/memcached-session-manager-2.1.1.jar
-rw-r--r--@ 1 xiaoxiang.yu INC\Domain Users11K 4 27 18:45
Downloads/memcached-session-manager-tc7-2.1.1.jar
```
- Remove old image
```shell
xiaoxiang.yu:CDH57/ (kubernetes*) $ docker rmi hadoop-client:cdh57
[18:46:33]
Untagged: hadoop-client:cdh57
xiaoxiang.yu:CDH57/ (kubernetes*) $ docker images |grep hadoop-client | grep
wc -l [18:47:31]
xiaoxiang.yu:CDH57/ (kubernetes*) $
xiaoxiang.yu:kylin-client/ (kubernetes*) $ docker rmi
kylin-client:3.0.1-cdh57
[18:51:58]
Untagged: kylin-client:3.0.1-cdh57
Deleted:
sha256:eb16424fc7cae2e4ca105e778290feec0ef370da2cc19e7df8b37ddd7166de57
Deleted:
sha256:5c5d43dc5f482ea5e60f58902f577bbfe3bc22b37175d6a5c28b3f66646f9626
Deleted:
sha256:9e509fdbf7d47b4cc28c45060809fecb888fab4c79b94f27f6826e78ed012431
Deleted:
sha256:3c97b6cb2781d7a594f18cccf357ce90214d7e1317fabf28edfccf45896af502
Deleted:
sha256:64b5601d1cb411c481382e6fe022f18dda4c5d070476a922bc4fd7531bad0846
Deleted:
sha256:fe814862cb919a47a9c162506921c0ee93edca19c5d36006f92153487c4429ef
Deleted:
sha256:1badb3b00a3f56ba66627e8c802b0a8f6a394bc2bc0dfa04d15a3085de9e34b9
Deleted:
sha256:afdb1ccabfabd7f375a184c6a8aa3b0aeb54195e92fd67d5a225a9e6fc501469
Deleted:
sha256:515eaf5fcbabf292b0e39d7fffd2d43f6c02d4b13af4f99be79027d120ce792d
Deleted:
sha256:f88e58969b5f908502fbddf2e058a97d31ed31134c8020b0762eea1224a86383
Deleted:
sha256:24b707ed4fe0ac52d4f3b32f9eac13fcd3698071a521f02ba1494d8cd7ec7646
Deleted:
sha256:664b07d4d73e4a1b587983f0b80fd7500d93f1c1eedbf925adf5b94391583389
Deleted:
sha256:75cdc77ae2aa8a0be849cd09961fc80a4d3856964fe91e265da2580b2d7dbd10
Deleted:
sha256:78e1a1873e763dd81d65d0249869d546e39806fc9ae415d508bff7fac3a1c1eb
```
- Build Hadoop-Client image
```shell
xiaoxiang.yu:CDH57/ (kubernetes*) $ pwd
[18:50:57]
/Users/xiaoxiang.yu/IntelliJ_IDEA_Project/MyKylin/kubernetes/docker/hadoop-client/CDH57
xiaoxiang.yu:CDH57/ (kubernetes*) $ cp
~/Downloads/spark-2.3.2-bin-hadoop2.7.tgz provided-binary
[18:48:25]
xiaoxiang.yu:CDH57/ (kubernetes*) $
[18:48:37]
xiaoxiang.yu:CDH57/ (kubernetes*) $
[18:49:02]
xiaoxiang.yu:CDH57/ (kubernetes*) $ sh build-image.sh
[18:49:02]
Sending build context to Docker daemon 225.9MB
Step 1/26 : FROM centos:7.3.1611
---> c5d48e81b986
... ... ...
Step 26/26 : ADD provided-binary/spark-${SPARK_VERSION}-bin-hadoop2.7.tgz .
---> ee576395a7f4
Successfully built ee576395a7f4
Successfully tagged hadoop-client:cdh57
```
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.
For queries about this service, please contact Infrastructure at:
us...@infra.apache.org
[jira] [Commented] (KYLIN-4446) Kylin on kubernetes in a quickstart env
[
https://issues.apache.org/jira/browse/KYLIN-4446?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17093343#comment-17093343
]
ASF GitHub Bot commented on KYLIN-4446:
---
hit-lacus edited a comment on pull request #1182:
URL: https://github.com/apache/kylin/pull/1182#issuecomment-619833363
## Prepare Docker Image
- Downloads required binary
```shell
xiaoxiang.yu:~/ $ ll Downloads/apache-kylin-3.0.1-bin-cdh57.tar
[18:39:26]
-rw-r--r--@ 1 xiaoxiang.yu INC\Domain Users 253M 4 15 16:49
Downloads/apache-kylin-3.0.1-bin-cdh57.tar
xiaoxiang.yu:~/ $ ll Downloads/spark-2.3.2-bin-hadoop2.7.tgz
[18:39:52]
-rwxrwxrwx 1 xiaoxiang.yu INC\Domain Users 215M 3 23 01:36
Downloads/spark-2.3.2-bin-hadoop2.7.tgz
```
- Downloads required jars
```shell
xiaoxiang.yu:~/ $ ll Downloads/mem*
[18:40:05]
-rw-r--r--@ 1 xiaoxiang.yu INC\Domain Users 163K 4 27 18:45
Downloads/memcached-session-manager-2.1.1.jar
-rw-r--r--@ 1 xiaoxiang.yu INC\Domain Users11K 4 27 18:45
Downloads/memcached-session-manager-tc7-2.1.1.jar
```
- Remove old image
```shell
xiaoxiang.yu:CDH57/ (kubernetes*) $ docker rmi hadoop-client:cdh57
[18:46:33]
Untagged: hadoop-client:cdh57
xiaoxiang.yu:CDH57/ (kubernetes*) $ docker images |grep hadoop-client | grep
wc -l [18:47:31]
xiaoxiang.yu:CDH57/ (kubernetes*) $
xiaoxiang.yu:kylin-client/ (kubernetes*) $ docker rmi
kylin-client:3.0.1-cdh57
[18:51:58]
Untagged: kylin-client:3.0.1-cdh57
Deleted:
sha256:eb16424fc7cae2e4ca105e778290feec0ef370da2cc19e7df8b37ddd7166de57
Deleted:
sha256:5c5d43dc5f482ea5e60f58902f577bbfe3bc22b37175d6a5c28b3f66646f9626
Deleted:
sha256:9e509fdbf7d47b4cc28c45060809fecb888fab4c79b94f27f6826e78ed012431
Deleted:
sha256:3c97b6cb2781d7a594f18cccf357ce90214d7e1317fabf28edfccf45896af502
Deleted:
sha256:64b5601d1cb411c481382e6fe022f18dda4c5d070476a922bc4fd7531bad0846
Deleted:
sha256:fe814862cb919a47a9c162506921c0ee93edca19c5d36006f92153487c4429ef
Deleted:
sha256:1badb3b00a3f56ba66627e8c802b0a8f6a394bc2bc0dfa04d15a3085de9e34b9
Deleted:
sha256:afdb1ccabfabd7f375a184c6a8aa3b0aeb54195e92fd67d5a225a9e6fc501469
Deleted:
sha256:515eaf5fcbabf292b0e39d7fffd2d43f6c02d4b13af4f99be79027d120ce792d
Deleted:
sha256:f88e58969b5f908502fbddf2e058a97d31ed31134c8020b0762eea1224a86383
Deleted:
sha256:24b707ed4fe0ac52d4f3b32f9eac13fcd3698071a521f02ba1494d8cd7ec7646
Deleted:
sha256:664b07d4d73e4a1b587983f0b80fd7500d93f1c1eedbf925adf5b94391583389
Deleted:
sha256:75cdc77ae2aa8a0be849cd09961fc80a4d3856964fe91e265da2580b2d7dbd10
Deleted:
sha256:78e1a1873e763dd81d65d0249869d546e39806fc9ae415d508bff7fac3a1c1eb
```
- Build Hadoop-Client image
```shell
xiaoxiang.yu:CDH57/ (kubernetes*) $ pwd
[18:50:57]
/Users/xiaoxiang.yu/IntelliJ_IDEA_Project/MyKylin/kubernetes/docker/hadoop-client/CDH57
xiaoxiang.yu:CDH57/ (kubernetes*) $ cp
~/Downloads/spark-2.3.2-bin-hadoop2.7.tgz provided-binary
[18:48:25]
xiaoxiang.yu:CDH57/ (kubernetes*) $
[18:48:37]
xiaoxiang.yu:CDH57/ (kubernetes*) $
[18:49:02]
xiaoxiang.yu:CDH57/ (kubernetes*) $ sh build-image.sh
[18:49:02]
Sending build context to Docker daemon 225.9MB
Step 1/26 : FROM centos:7.3.1611
---> c5d48e81b986
Step 2/26 : MAINTAINER Apache Kylin
---> Using cache
---> 7d31909dd19a
Step 3/26 : ENV JAVA_VERSION1.8.0
---> Using cache
---> 596fd0b28b00
Step 4/26 : ENV SPARK_VERSION 2.3.2
---> Using cache
---> ec0263221e5b
Step 5/26 : ENV JAVA_HOME /usr/lib/jvm/java-${JAVA_VERSION}
---> Using cache
---> fcb50630b39a
Step 6/26 : ENV HADOOP_HOME /usr/lib/hadoop
---> Using cache
---> 729ba7b92158
Step 7/26 : ENV HIVE_HOME /usr/lib/hive
---> Using cache
---> 720cd72e9904
Step 8/26 : ENV HCAT_HOME /usr/lib/hive-hcatalog
---> Using cache
---> 7ef4bfdbc4cd
Step 9/26 : ENV HBASE_HOME /usr/lib/hbase
---> Using cache
--->
[GitHub] [kylin] hit-lacus edited a comment on pull request #1182: KYLIN-4446 Kylin on kubernetes in quick-start and production env
hit-lacus edited a comment on pull request #1182:
URL: https://github.com/apache/kylin/pull/1182#issuecomment-619833363
## Prepare Docker Image
- Downloads required binary
```shell
xiaoxiang.yu:~/ $ ll Downloads/apache-kylin-3.0.1-bin-cdh57.tar
[18:39:26]
-rw-r--r--@ 1 xiaoxiang.yu INC\Domain Users 253M 4 15 16:49
Downloads/apache-kylin-3.0.1-bin-cdh57.tar
xiaoxiang.yu:~/ $ ll Downloads/spark-2.3.2-bin-hadoop2.7.tgz
[18:39:52]
-rwxrwxrwx 1 xiaoxiang.yu INC\Domain Users 215M 3 23 01:36
Downloads/spark-2.3.2-bin-hadoop2.7.tgz
```
- Downloads required jars
```shell
xiaoxiang.yu:~/ $ ll Downloads/mem*
[18:40:05]
-rw-r--r--@ 1 xiaoxiang.yu INC\Domain Users 163K 4 27 18:45
Downloads/memcached-session-manager-2.1.1.jar
-rw-r--r--@ 1 xiaoxiang.yu INC\Domain Users11K 4 27 18:45
Downloads/memcached-session-manager-tc7-2.1.1.jar
```
- Remove old image
```shell
xiaoxiang.yu:CDH57/ (kubernetes*) $ docker rmi hadoop-client:cdh57
[18:46:33]
Untagged: hadoop-client:cdh57
xiaoxiang.yu:CDH57/ (kubernetes*) $ docker images |grep hadoop-client | grep
wc -l [18:47:31]
xiaoxiang.yu:CDH57/ (kubernetes*) $
xiaoxiang.yu:kylin-client/ (kubernetes*) $ docker rmi
kylin-client:3.0.1-cdh57
[18:51:58]
Untagged: kylin-client:3.0.1-cdh57
Deleted:
sha256:eb16424fc7cae2e4ca105e778290feec0ef370da2cc19e7df8b37ddd7166de57
Deleted:
sha256:5c5d43dc5f482ea5e60f58902f577bbfe3bc22b37175d6a5c28b3f66646f9626
Deleted:
sha256:9e509fdbf7d47b4cc28c45060809fecb888fab4c79b94f27f6826e78ed012431
Deleted:
sha256:3c97b6cb2781d7a594f18cccf357ce90214d7e1317fabf28edfccf45896af502
Deleted:
sha256:64b5601d1cb411c481382e6fe022f18dda4c5d070476a922bc4fd7531bad0846
Deleted:
sha256:fe814862cb919a47a9c162506921c0ee93edca19c5d36006f92153487c4429ef
Deleted:
sha256:1badb3b00a3f56ba66627e8c802b0a8f6a394bc2bc0dfa04d15a3085de9e34b9
Deleted:
sha256:afdb1ccabfabd7f375a184c6a8aa3b0aeb54195e92fd67d5a225a9e6fc501469
Deleted:
sha256:515eaf5fcbabf292b0e39d7fffd2d43f6c02d4b13af4f99be79027d120ce792d
Deleted:
sha256:f88e58969b5f908502fbddf2e058a97d31ed31134c8020b0762eea1224a86383
Deleted:
sha256:24b707ed4fe0ac52d4f3b32f9eac13fcd3698071a521f02ba1494d8cd7ec7646
Deleted:
sha256:664b07d4d73e4a1b587983f0b80fd7500d93f1c1eedbf925adf5b94391583389
Deleted:
sha256:75cdc77ae2aa8a0be849cd09961fc80a4d3856964fe91e265da2580b2d7dbd10
Deleted:
sha256:78e1a1873e763dd81d65d0249869d546e39806fc9ae415d508bff7fac3a1c1eb
```
- Build Hadoop-Client image
```shell
xiaoxiang.yu:CDH57/ (kubernetes*) $ pwd
[18:50:57]
/Users/xiaoxiang.yu/IntelliJ_IDEA_Project/MyKylin/kubernetes/docker/hadoop-client/CDH57
xiaoxiang.yu:CDH57/ (kubernetes*) $ cp
~/Downloads/spark-2.3.2-bin-hadoop2.7.tgz provided-binary
[18:48:25]
xiaoxiang.yu:CDH57/ (kubernetes*) $
[18:48:37]
xiaoxiang.yu:CDH57/ (kubernetes*) $
[18:49:02]
xiaoxiang.yu:CDH57/ (kubernetes*) $ sh build-image.sh
[18:49:02]
Sending build context to Docker daemon 225.9MB
Step 1/26 : FROM centos:7.3.1611
---> c5d48e81b986
Step 2/26 : MAINTAINER Apache Kylin
---> Using cache
---> 7d31909dd19a
Step 3/26 : ENV JAVA_VERSION1.8.0
---> Using cache
---> 596fd0b28b00
Step 4/26 : ENV SPARK_VERSION 2.3.2
---> Using cache
---> ec0263221e5b
Step 5/26 : ENV JAVA_HOME /usr/lib/jvm/java-${JAVA_VERSION}
---> Using cache
---> fcb50630b39a
Step 6/26 : ENV HADOOP_HOME /usr/lib/hadoop
---> Using cache
---> 729ba7b92158
Step 7/26 : ENV HIVE_HOME /usr/lib/hive
---> Using cache
---> 720cd72e9904
Step 8/26 : ENV HCAT_HOME /usr/lib/hive-hcatalog
---> Using cache
---> 7ef4bfdbc4cd
Step 9/26 : ENV HBASE_HOME /usr/lib/hbase
---> Using cache
---> 818e685192a5
Step 10/26 : ENV SPARK_HOME /opt/spark-${SPARK_VERSION}-bin-hadoop2.7
---> Using cache
---> ec3429565158
Step 11/26 : ENV PATH $PATH:$SPARK_HOME/bin:
---> Using cache
---> f2b052643286
Step 12/26 :
[jira] [Commented] (KYLIN-4446) Kylin on kubernetes in a quickstart env
[
https://issues.apache.org/jira/browse/KYLIN-4446?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17093341#comment-17093341
]
ASF GitHub Bot commented on KYLIN-4446:
---
hit-lacus edited a comment on pull request #1182:
URL: https://github.com/apache/kylin/pull/1182#issuecomment-619833363
## Prepare Docker Image
- Downloads required binary
```shell
xiaoxiang.yu:~/ $ ll Downloads/apache-kylin-3.0.1-bin-cdh57.tar
[18:39:26]
-rw-r--r--@ 1 xiaoxiang.yu INC\Domain Users 253M 4 15 16:49
Downloads/apache-kylin-3.0.1-bin-cdh57.tar
xiaoxiang.yu:~/ $ ll Downloads/spark-2.3.2-bin-hadoop2.7.tgz
[18:39:52]
-rwxrwxrwx 1 xiaoxiang.yu INC\Domain Users 215M 3 23 01:36
Downloads/spark-2.3.2-bin-hadoop2.7.tgz
```
- Downloads required jars
```shell
xiaoxiang.yu:~/ $ ll Downloads/mem*
[18:40:05]
-rw-r--r--@ 1 xiaoxiang.yu INC\Domain Users 163K 4 27 18:45
Downloads/memcached-session-manager-2.1.1.jar
-rw-r--r--@ 1 xiaoxiang.yu INC\Domain Users11K 4 27 18:45
Downloads/memcached-session-manager-tc7-2.1.1.jar
```
- Remove old image
```shell
xiaoxiang.yu:CDH57/ (kubernetes*) $ docker rmi hadoop-client:cdh57
[18:46:33]
Untagged: hadoop-client:cdh57
xiaoxiang.yu:CDH57/ (kubernetes*) $ docker images |grep hadoop-client | grep
wc -l [18:47:31]
xiaoxiang.yu:CDH57/ (kubernetes*) $
```
- Build Hadoop-Client image
```shell
xiaoxiang.yu:CDH57/ (kubernetes*) $ pwd
[18:50:57]
/Users/xiaoxiang.yu/IntelliJ_IDEA_Project/MyKylin/kubernetes/docker/hadoop-client/CDH57
xiaoxiang.yu:CDH57/ (kubernetes*) $ cp
~/Downloads/spark-2.3.2-bin-hadoop2.7.tgz provided-binary
[18:48:25]
xiaoxiang.yu:CDH57/ (kubernetes*) $
[18:48:37]
xiaoxiang.yu:CDH57/ (kubernetes*) $
[18:49:02]
xiaoxiang.yu:CDH57/ (kubernetes*) $ sh build-image.sh
[18:49:02]
Sending build context to Docker daemon 225.9MB
Step 1/26 : FROM centos:7.3.1611
---> c5d48e81b986
Step 2/26 : MAINTAINER Apache Kylin
---> Using cache
---> 7d31909dd19a
Step 3/26 : ENV JAVA_VERSION1.8.0
---> Using cache
---> 596fd0b28b00
Step 4/26 : ENV SPARK_VERSION 2.3.2
---> Using cache
---> ec0263221e5b
Step 5/26 : ENV JAVA_HOME /usr/lib/jvm/java-${JAVA_VERSION}
---> Using cache
---> fcb50630b39a
Step 6/26 : ENV HADOOP_HOME /usr/lib/hadoop
---> Using cache
---> 729ba7b92158
Step 7/26 : ENV HIVE_HOME /usr/lib/hive
---> Using cache
---> 720cd72e9904
Step 8/26 : ENV HCAT_HOME /usr/lib/hive-hcatalog
---> Using cache
---> 7ef4bfdbc4cd
Step 9/26 : ENV HBASE_HOME /usr/lib/hbase
---> Using cache
---> 818e685192a5
Step 10/26 : ENV SPARK_HOME /opt/spark-${SPARK_VERSION}-bin-hadoop2.7
---> Using cache
---> ec3429565158
Step 11/26 : ENV PATH $PATH:$SPARK_HOME/bin:
---> Using cache
---> f2b052643286
Step 12/26 : ENV HADOOP_CONF_DIR /etc/hadoop/conf
---> Using cache
---> 0d76e82d405c
Step 13/26 : ENV HIVE_CONF_DIR/etc/hive/conf
---> Using cache
---> 1ad66c55a1de
Step 14/26 : ENV HBASE_CONF_DIR /etc/hbase/conf
---> Using cache
---> 91e260f7d120
Step 15/26 : ENV HIVE_CONF${HIVE_CONF_DIR}
---> Using cache
---> 4321f4fe59f4
Step 16/26 : ENV HIVE_LIB ${HIVE_HOME}/lib
---> Using cache
---> 6b6b4e2a5ff4
Step 17/26 : RUN echo $'[cloudera-cdh5] \nname=Cloudera\'s Distribution for
Hadoop, Version 5
\nbaseurl=https://archive.cloudera.com/cdh5/redhat/6/x86_64/cdh/5.7.6/ \ngpgkey
=https://archive.cloudera.com/cdh5/redhat/6/x86_64/cdh/RPM-GPG-KEY-cloudera
\ngpgcheck = 1' > /etc/yum.repos.d/cloudera-cdh5.repo
---> Using cache
---> ca7957895170
Step 18/26 : WORKDIR /opt
---> Using cache
---> c85839b823ef
Step 19/26 : RUN set -xeu && yum -y install java-1.8.0-openjdk-devel
---> Using cache
---> 70de99c7c287
Step 20/26 : RUN set -xeu && yum -y install krb5-workstation
---> Using cache
---> ee2d6cf2c56c
Step 21/26 : RUN set -xeu &&
[GitHub] [kylin] hit-lacus edited a comment on pull request #1182: KYLIN-4446 Kylin on kubernetes in quick-start and production env
hit-lacus edited a comment on pull request #1182:
URL: https://github.com/apache/kylin/pull/1182#issuecomment-619833363
## Prepare Docker Image
- Downloads required binary
```shell
xiaoxiang.yu:~/ $ ll Downloads/apache-kylin-3.0.1-bin-cdh57.tar
[18:39:26]
-rw-r--r--@ 1 xiaoxiang.yu INC\Domain Users 253M 4 15 16:49
Downloads/apache-kylin-3.0.1-bin-cdh57.tar
xiaoxiang.yu:~/ $ ll Downloads/spark-2.3.2-bin-hadoop2.7.tgz
[18:39:52]
-rwxrwxrwx 1 xiaoxiang.yu INC\Domain Users 215M 3 23 01:36
Downloads/spark-2.3.2-bin-hadoop2.7.tgz
```
- Downloads required jars
```shell
xiaoxiang.yu:~/ $ ll Downloads/mem*
[18:40:05]
-rw-r--r--@ 1 xiaoxiang.yu INC\Domain Users 163K 4 27 18:45
Downloads/memcached-session-manager-2.1.1.jar
-rw-r--r--@ 1 xiaoxiang.yu INC\Domain Users11K 4 27 18:45
Downloads/memcached-session-manager-tc7-2.1.1.jar
```
- Remove old image
```shell
xiaoxiang.yu:CDH57/ (kubernetes*) $ docker rmi hadoop-client:cdh57
[18:46:33]
Untagged: hadoop-client:cdh57
xiaoxiang.yu:CDH57/ (kubernetes*) $ docker images |grep hadoop-client | grep
wc -l [18:47:31]
xiaoxiang.yu:CDH57/ (kubernetes*) $
```
- Build Hadoop-Client image
```shell
xiaoxiang.yu:CDH57/ (kubernetes*) $ pwd
[18:50:57]
/Users/xiaoxiang.yu/IntelliJ_IDEA_Project/MyKylin/kubernetes/docker/hadoop-client/CDH57
xiaoxiang.yu:CDH57/ (kubernetes*) $ cp
~/Downloads/spark-2.3.2-bin-hadoop2.7.tgz provided-binary
[18:48:25]
xiaoxiang.yu:CDH57/ (kubernetes*) $
[18:48:37]
xiaoxiang.yu:CDH57/ (kubernetes*) $
[18:49:02]
xiaoxiang.yu:CDH57/ (kubernetes*) $ sh build-image.sh
[18:49:02]
Sending build context to Docker daemon 225.9MB
Step 1/26 : FROM centos:7.3.1611
---> c5d48e81b986
Step 2/26 : MAINTAINER Apache Kylin
---> Using cache
---> 7d31909dd19a
Step 3/26 : ENV JAVA_VERSION1.8.0
---> Using cache
---> 596fd0b28b00
Step 4/26 : ENV SPARK_VERSION 2.3.2
---> Using cache
---> ec0263221e5b
Step 5/26 : ENV JAVA_HOME /usr/lib/jvm/java-${JAVA_VERSION}
---> Using cache
---> fcb50630b39a
Step 6/26 : ENV HADOOP_HOME /usr/lib/hadoop
---> Using cache
---> 729ba7b92158
Step 7/26 : ENV HIVE_HOME /usr/lib/hive
---> Using cache
---> 720cd72e9904
Step 8/26 : ENV HCAT_HOME /usr/lib/hive-hcatalog
---> Using cache
---> 7ef4bfdbc4cd
Step 9/26 : ENV HBASE_HOME /usr/lib/hbase
---> Using cache
---> 818e685192a5
Step 10/26 : ENV SPARK_HOME /opt/spark-${SPARK_VERSION}-bin-hadoop2.7
---> Using cache
---> ec3429565158
Step 11/26 : ENV PATH $PATH:$SPARK_HOME/bin:
---> Using cache
---> f2b052643286
Step 12/26 : ENV HADOOP_CONF_DIR /etc/hadoop/conf
---> Using cache
---> 0d76e82d405c
Step 13/26 : ENV HIVE_CONF_DIR/etc/hive/conf
---> Using cache
---> 1ad66c55a1de
Step 14/26 : ENV HBASE_CONF_DIR /etc/hbase/conf
---> Using cache
---> 91e260f7d120
Step 15/26 : ENV HIVE_CONF${HIVE_CONF_DIR}
---> Using cache
---> 4321f4fe59f4
Step 16/26 : ENV HIVE_LIB ${HIVE_HOME}/lib
---> Using cache
---> 6b6b4e2a5ff4
Step 17/26 : RUN echo $'[cloudera-cdh5] \nname=Cloudera\'s Distribution for
Hadoop, Version 5
\nbaseurl=https://archive.cloudera.com/cdh5/redhat/6/x86_64/cdh/5.7.6/ \ngpgkey
=https://archive.cloudera.com/cdh5/redhat/6/x86_64/cdh/RPM-GPG-KEY-cloudera
\ngpgcheck = 1' > /etc/yum.repos.d/cloudera-cdh5.repo
---> Using cache
---> ca7957895170
Step 18/26 : WORKDIR /opt
---> Using cache
---> c85839b823ef
Step 19/26 : RUN set -xeu && yum -y install java-1.8.0-openjdk-devel
---> Using cache
---> 70de99c7c287
Step 20/26 : RUN set -xeu && yum -y install krb5-workstation
---> Using cache
---> ee2d6cf2c56c
Step 21/26 : RUN set -xeu && yum -y install hadoop-client
---> Using cache
---> 7c332c100a62
Step 22/26 : RUN set -xeu && yum -y install hive hive-hcatalog
---> Using cache
---> 54d0c23e2781
Step 23/26 : RUN set -xeu && yum -y install hbase
[jira] [Commented] (KYLIN-4446) Kylin on kubernetes in a quickstart env
[
https://issues.apache.org/jira/browse/KYLIN-4446?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17093337#comment-17093337
]
ASF GitHub Bot commented on KYLIN-4446:
---
hit-lacus edited a comment on pull request #1182:
URL: https://github.com/apache/kylin/pull/1182#issuecomment-619833363
## Prepare Docker Image
- Downloads required binary
```shell
xiaoxiang.yu:~/ $ ll Downloads/apache-kylin-3.0.1-bin-cdh57.tar
[18:39:26]
-rw-r--r--@ 1 xiaoxiang.yu INC\Domain Users 253M 4 15 16:49
Downloads/apache-kylin-3.0.1-bin-cdh57.tar
xiaoxiang.yu:~/ $ ll Downloads/spark-2.3.2-bin-hadoop2.7.tgz
[18:39:52]
-rwxrwxrwx 1 xiaoxiang.yu INC\Domain Users 215M 3 23 01:36
Downloads/spark-2.3.2-bin-hadoop2.7.tgz
```
- Downloads required jars
```shell
xiaoxiang.yu:~/ $ ll Downloads/mem*
[18:40:05]
-rw-r--r--@ 1 xiaoxiang.yu INC\Domain Users 163K 4 27 18:45
Downloads/memcached-session-manager-2.1.1.jar
-rw-r--r--@ 1 xiaoxiang.yu INC\Domain Users11K 4 27 18:45
Downloads/memcached-session-manager-tc7-2.1.1.jar
```
- Remove old image
```shell
xiaoxiang.yu:CDH57/ (kubernetes*) $ docker rmi hadoop-client:cdh57
[18:46:33]
Untagged: hadoop-client:cdh57
xiaoxiang.yu:CDH57/ (kubernetes*) $ docker images |grep hadoop-client | grep
wc -l [18:47:31]
xiaoxiang.yu:CDH57/ (kubernetes*) $
```
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.
For queries about this service, please contact Infrastructure at:
us...@infra.apache.org
> Kylin on kubernetes in a quickstart env
> ---
>
> Key: KYLIN-4446
> URL: https://issues.apache.org/jira/browse/KYLIN-4446
> Project: Kylin
> Issue Type: Sub-task
> Components: Integration
>Reporter: Xiaoxiang Yu
>Assignee: Xiaoxiang Yu
>Priority: Major
> Labels: kubernetes
> Fix For: v3.1.0
>
> Original Estimate: 48h
> Time Spent: 2h
> Remaining Estimate: 46h
>
> For a quick-start/PoC purpose, please consider use this template, it will
> only deploy one Kylin instance with role {color:#de350b}*ALL* {color}
--
This message was sent by Atlassian Jira
(v8.3.4#803005)
[GitHub] [kylin] hit-lacus edited a comment on pull request #1182: KYLIN-4446 Kylin on kubernetes in quick-start and production env
hit-lacus edited a comment on pull request #1182: URL: https://github.com/apache/kylin/pull/1182#issuecomment-619833363 ## Prepare Docker Image - Downloads required binary ```shell xiaoxiang.yu:~/ $ ll Downloads/apache-kylin-3.0.1-bin-cdh57.tar [18:39:26] -rw-r--r--@ 1 xiaoxiang.yu INC\Domain Users 253M 4 15 16:49 Downloads/apache-kylin-3.0.1-bin-cdh57.tar xiaoxiang.yu:~/ $ ll Downloads/spark-2.3.2-bin-hadoop2.7.tgz [18:39:52] -rwxrwxrwx 1 xiaoxiang.yu INC\Domain Users 215M 3 23 01:36 Downloads/spark-2.3.2-bin-hadoop2.7.tgz ``` - Downloads required jars ```shell xiaoxiang.yu:~/ $ ll Downloads/mem* [18:40:05] -rw-r--r--@ 1 xiaoxiang.yu INC\Domain Users 163K 4 27 18:45 Downloads/memcached-session-manager-2.1.1.jar -rw-r--r--@ 1 xiaoxiang.yu INC\Domain Users11K 4 27 18:45 Downloads/memcached-session-manager-tc7-2.1.1.jar ``` - Remove old image ```shell xiaoxiang.yu:CDH57/ (kubernetes*) $ docker rmi hadoop-client:cdh57 [18:46:33] Untagged: hadoop-client:cdh57 xiaoxiang.yu:CDH57/ (kubernetes*) $ docker images |grep hadoop-client | grep wc -l [18:47:31] xiaoxiang.yu:CDH57/ (kubernetes*) $ ``` This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use the URL above to go to the specific comment. For queries about this service, please contact Infrastructure at: us...@infra.apache.org
[jira] [Commented] (KYLIN-4446) Kylin on kubernetes in a quickstart env
[
https://issues.apache.org/jira/browse/KYLIN-4446?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17093336#comment-17093336
]
ASF GitHub Bot commented on KYLIN-4446:
---
hit-lacus edited a comment on pull request #1182:
URL: https://github.com/apache/kylin/pull/1182#issuecomment-619833363
## Prepare Docker Image
- Downloads required binary
```shell
xiaoxiang.yu:~/ $ ll Downloads/apache-kylin-3.0.1-bin-cdh57.tar
[18:39:26]
-rw-r--r--@ 1 xiaoxiang.yu INC\Domain Users 253M 4 15 16:49
Downloads/apache-kylin-3.0.1-bin-cdh57.tar
xiaoxiang.yu:~/ $ ll Downloads/spark-2.3.2-bin-hadoop2.7.tgz
[18:39:52]
-rwxrwxrwx 1 xiaoxiang.yu INC\Domain Users 215M 3 23 01:36
Downloads/spark-2.3.2-bin-hadoop2.7.tgz
```
- Downloads required jars
```shell
xiaoxiang.yu:~/ $ ll Downloads/mem*
[18:40:05]
-rw-r--r--@ 1 xiaoxiang.yu INC\Domain Users 163K 4 27 18:45
Downloads/memcached-session-manager-2.1.1.jar
-rw-r--r--@ 1 xiaoxiang.yu INC\Domain Users11K 4 27 18:45
Downloads/memcached-session-manager-tc7-2.1.1.jar
```
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.
For queries about this service, please contact Infrastructure at:
us...@infra.apache.org
> Kylin on kubernetes in a quickstart env
> ---
>
> Key: KYLIN-4446
> URL: https://issues.apache.org/jira/browse/KYLIN-4446
> Project: Kylin
> Issue Type: Sub-task
> Components: Integration
>Reporter: Xiaoxiang Yu
>Assignee: Xiaoxiang Yu
>Priority: Major
> Labels: kubernetes
> Fix For: v3.1.0
>
> Original Estimate: 48h
> Time Spent: 2h
> Remaining Estimate: 46h
>
> For a quick-start/PoC purpose, please consider use this template, it will
> only deploy one Kylin instance with role {color:#de350b}*ALL* {color}
--
This message was sent by Atlassian Jira
(v8.3.4#803005)
[GitHub] [kylin] hit-lacus edited a comment on pull request #1182: KYLIN-4446 Kylin on kubernetes in quick-start and production env
hit-lacus edited a comment on pull request #1182: URL: https://github.com/apache/kylin/pull/1182#issuecomment-619833363 ## Prepare Docker Image - Downloads required binary ```shell xiaoxiang.yu:~/ $ ll Downloads/apache-kylin-3.0.1-bin-cdh57.tar [18:39:26] -rw-r--r--@ 1 xiaoxiang.yu INC\Domain Users 253M 4 15 16:49 Downloads/apache-kylin-3.0.1-bin-cdh57.tar xiaoxiang.yu:~/ $ ll Downloads/spark-2.3.2-bin-hadoop2.7.tgz [18:39:52] -rwxrwxrwx 1 xiaoxiang.yu INC\Domain Users 215M 3 23 01:36 Downloads/spark-2.3.2-bin-hadoop2.7.tgz ``` - Downloads required jars ```shell xiaoxiang.yu:~/ $ ll Downloads/mem* [18:40:05] -rw-r--r--@ 1 xiaoxiang.yu INC\Domain Users 163K 4 27 18:45 Downloads/memcached-session-manager-2.1.1.jar -rw-r--r--@ 1 xiaoxiang.yu INC\Domain Users11K 4 27 18:45 Downloads/memcached-session-manager-tc7-2.1.1.jar ``` This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use the URL above to go to the specific comment. For queries about this service, please contact Infrastructure at: us...@infra.apache.org
[jira] [Commented] (KYLIN-4446) Kylin on kubernetes in a quickstart env
[
https://issues.apache.org/jira/browse/KYLIN-4446?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17093335#comment-17093335
]
ASF GitHub Bot commented on KYLIN-4446:
---
hit-lacus edited a comment on pull request #1182:
URL: https://github.com/apache/kylin/pull/1182#issuecomment-619833363
## Prepare Docker Image
- Downloads required binary
```shell
xiaoxiang.yu:~/ $ ll Downloads/apache-kylin-3.0.1-bin-cdh57.tar
[18:39:26]
-rw-r--r--@ 1 xiaoxiang.yu INC\Domain Users 253M 4 15 16:49
Downloads/apache-kylin-3.0.1-bin-cdh57.tar
xiaoxiang.yu:~/ $ ll Downloads/spark-2.3.2-bin-hadoop2.7.tgz
[18:39:52]
-rwxrwxrwx 1 xiaoxiang.yu INC\Domain Users 215M 3 23 01:36
Downloads/spark-2.3.2-bin-hadoop2.7.tgz
```
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.
For queries about this service, please contact Infrastructure at:
us...@infra.apache.org
> Kylin on kubernetes in a quickstart env
> ---
>
> Key: KYLIN-4446
> URL: https://issues.apache.org/jira/browse/KYLIN-4446
> Project: Kylin
> Issue Type: Sub-task
> Components: Integration
>Reporter: Xiaoxiang Yu
>Assignee: Xiaoxiang Yu
>Priority: Major
> Labels: kubernetes
> Fix For: v3.1.0
>
> Original Estimate: 48h
> Time Spent: 2h
> Remaining Estimate: 46h
>
> For a quick-start/PoC purpose, please consider use this template, it will
> only deploy one Kylin instance with role {color:#de350b}*ALL* {color}
--
This message was sent by Atlassian Jira
(v8.3.4#803005)
[GitHub] [kylin] hit-lacus edited a comment on pull request #1182: KYLIN-4446 Kylin on kubernetes in quick-start and production env
hit-lacus edited a comment on pull request #1182: URL: https://github.com/apache/kylin/pull/1182#issuecomment-619833363 ## Prepare Docker Image - Downloads required binary ```shell xiaoxiang.yu:~/ $ ll Downloads/apache-kylin-3.0.1-bin-cdh57.tar [18:39:26] -rw-r--r--@ 1 xiaoxiang.yu INC\Domain Users 253M 4 15 16:49 Downloads/apache-kylin-3.0.1-bin-cdh57.tar xiaoxiang.yu:~/ $ ll Downloads/spark-2.3.2-bin-hadoop2.7.tgz [18:39:52] -rwxrwxrwx 1 xiaoxiang.yu INC\Domain Users 215M 3 23 01:36 Downloads/spark-2.3.2-bin-hadoop2.7.tgz ``` This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use the URL above to go to the specific comment. For queries about this service, please contact Infrastructure at: us...@infra.apache.org
[jira] [Commented] (KYLIN-4447) Kylin on kubernetes in a production env
[ https://issues.apache.org/jira/browse/KYLIN-4447?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17093325#comment-17093325 ] Xiaoxiang Yu commented on KYLIN-4447: - See full test, please check this: [https://github.com/apache/kylin/pull/1182#issuecomment-619833208] . > Kylin on kubernetes in a production env > --- > > Key: KYLIN-4447 > URL: https://issues.apache.org/jira/browse/KYLIN-4447 > Project: Kylin > Issue Type: Sub-task > Components: Integration >Reporter: Xiaoxiang Yu >Assignee: Xiaoxiang Yu >Priority: Major > Labels: kubernetes > Fix For: v3.1.0 > > Attachments: 79879570-73cfb200-8421-11ea-8ee3-108e903335a9.png, > 79976447-31fd4500-84cf-11ea-83cb-52986ccc5173.png, BuildingSuccess.png > > Original Estimate: 120h > Remaining Estimate: 120h > > h2. Kylin Cluster Deploy Diagram > > * ElasticSearch cluster is for log collection and analysis. > * Hadoop cluster provided MR/Spark for cube building and HBase/HDFS for cube > storage. > * Kylin cluster is deployed on Kubernetes, including query servers and job > servers. > * Memcached cluster is both deployed on Kubernetes, it provided ability of > tomcat session sharing and external query cache. > > > !79976447-31fd4500-84cf-11ea-83cb-52986ccc5173.png! -- This message was sent by Atlassian Jira (v8.3.4#803005)
[jira] [Comment Edited] (KYLIN-4447) Kylin on kubernetes in a production env
[ https://issues.apache.org/jira/browse/KYLIN-4447?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17092743#comment-17092743 ] Xiaoxiang Yu edited comment on KYLIN-4447 at 4/27/20, 10:27 AM: h2. Explanation # CuratorScheduler is used as default JobScheduler because it is more flexible. # Spark building require use +cluster+ as +deployMode+. If you forget it, your spark application will never submitted successfully because Hadoop cluster can not resolve hostname of Pod (Spark Driver). # To modify +/etc/hosts+ in Pod, please check this : [https://kubernetes.io/docs/concepts/services-networking/add-entries-to-pod-etc-hosts-with-host-aliases/] . # To build you own *kylin-client* docker image, please don't forget to download and put following jars into +KYLIN_HOME/tomcat/lib+ to enable *tomcat session sharing*. ## [https://repo1.maven.org/maven2/de/javakaffee/msm/memcached-session-manager-tc7/2.1.1/] ## [https://repo1.maven.org/maven2/de/javakaffee/msm/memcached-session-manager/2.1.1/] # If you have difficulty in configure *filebeat*, please check this [https://www.elastic.co/guide/en/beats/filebeat/current/index.html] . # External query cache is enabled by default, if you are interested in detail, you may check [http://kylin.apache.org/blog/2019/07/30/detailed-analysis-of-refine-query-cache/] . was (Author: hit_lacus): h2. Explanation # CuratorScheduler is used as default JobScheduler because it is more flexible. # Spark building require use +cluster+ as +deployMode+. If you forget, your spark application will never submitted successfully because Hadoop cluster can not resolve hostname of Spark Driver. # To modify +/etc/hosts+ in Pod, please check this : [https://kubernetes.io/docs/concepts/services-networking/add-entries-to-pod-etc-hosts-with-host-aliases/] . # To build you own *kylin-client* docker image, please don't forget to download and put following jars into +KYLIN_HOME/tomcat/lib+ to enable ++ tomcat session sharing. ## [https://repo1.maven.org/maven2/de/javakaffee/msm/memcached-session-manager-tc7/2.1.1/] ## [https://repo1.maven.org/maven2/de/javakaffee/msm/memcached-session-manager/2.1.1/] [https://repo1.maven.org/maven2/net/spy/spymemcached/2.12.0|https://repo1.maven.org/maven2/net/spy/spymemcached/2.12.0/] # If you have difficulty in configure *filebeat*, please check this [https://www.elastic.co/guide/en/beats/filebeat/current/index.html] . > Kylin on kubernetes in a production env > --- > > Key: KYLIN-4447 > URL: https://issues.apache.org/jira/browse/KYLIN-4447 > Project: Kylin > Issue Type: Sub-task > Components: Integration >Reporter: Xiaoxiang Yu >Assignee: Xiaoxiang Yu >Priority: Major > Labels: kubernetes > Fix For: v3.1.0 > > Attachments: 79879570-73cfb200-8421-11ea-8ee3-108e903335a9.png, > 79976447-31fd4500-84cf-11ea-83cb-52986ccc5173.png, BuildingSuccess.png > > Original Estimate: 120h > Remaining Estimate: 120h > > h2. Kylin Cluster Deploy Diagram > > * ElasticSearch cluster is for log collection and analysis. > * Hadoop cluster provided MR/Spark for cube building and HBase/HDFS for cube > storage. > * Kylin cluster is deployed on Kubernetes, including query servers and job > servers. > * Memcached cluster is both deployed on Kubernetes, it provided ability of > tomcat session sharing and external query cache. > > > !79976447-31fd4500-84cf-11ea-83cb-52986ccc5173.png! -- This message was sent by Atlassian Jira (v8.3.4#803005)
[GitHub] [kylin] hit-lacus edited a comment on pull request #1182: KYLIN-4446 Kylin on kubernetes in quick-start and production env
hit-lacus edited a comment on pull request #1182:
URL: https://github.com/apache/kylin/pull/1182#issuecomment-619833208
## Check Env
Hadoop Env
```shell
[root@cdh-master ~]# hadoop version
Hadoop 2.6.0-cdh5.7.6
Subversion http://github.com/cloudera/hadoop -r
a3edabab129caaada2958ab32061aa0e52a3f7df
Compiled by jenkins on 2017-02-21T23:08Z
Compiled with protoc 2.5.0
From source with checksum 3de3a6f2894b326919cd7a9b4e573e
This command was run using
/opt/cloudera/parcels/CDH-5.7.6-1.cdh5.7.6.p0.6/jars/hadoop-common-2.6.0-cdh5.7.6.jar
```
Elasticsearch Env
```shell
[root@cdh-master elasticsearch-7.6.0]# bin/elasticsearch -V
future versions of Elasticsearch will require Java 11; your Java version
from [/usr/java/jdk1.8.0_171/jre] does not meet this requirement
Version: 7.6.0, Build:
default/tar/7f634e9f44834fbc12724506cc1da681b0c3b1e3/2020-02-06T00:09:00.449973Z,
JVM: 1.8.0_171
```
Kubernetes Env
```shell
root@open-source:/home/ubuntu# lsb_release -a
No LSB modules are available.
Distributor ID: Ubuntu
Description: Ubuntu 18.04.4 LTS
Release: 18.04
Codename:bionic
root@open-source:/home/ubuntu# kubectl version
Client Version: version.Info{Major:"1", Minor:"18", GitVersion:"v1.18.1",
GitCommit:"7879fc12a63337efff607952a323df90cdc7a335", GitTreeState:"clean",
BuildDate:"2020-04-08T17:38:50Z", GoVersion:"go1.13.9", Compiler:"gc",
Platform:"linux/amd64"}
Server Version: version.Info{Major:"1", Minor:"18", GitVersion:"v1.18.1",
GitCommit:"7879fc12a63337efff607952a323df90cdc7a335", GitTreeState:"clean",
BuildDate:"2020-04-08T17:30:47Z", GoVersion:"go1.13.9", Compiler:"gc",
Platform:"linux/amd64"}
root@open-source:/home/ubuntu# free -h
totalusedfree shared buff/cache
available
Mem:19G3.6G 11G2.2M4.5G
15G
Swap:0B 0B 0B
root@open-source:/home/ubuntu# cat /proc/cpuinfo| grep "cpu cores"| uniq
cpu cores: 8
root@open-source:/home/ubuntu# uname -a
Linux open-source 4.15.0-96-generic #97-Ubuntu SMP Wed Apr 1 03:25:46 UTC
2020 x86_64 x86_64 x86_64 GNU/Linux
root@open-source:/home/ubuntu# kubectl get node -o=wide
NAME STATUS ROLESAGE VERSION INTERNAL-IP EXTERNAL-IP
OS-IMAGE KERNEL-VERSION CONTAINER-RUNTIME
open-source Readymaster 11d v1.18.1 10.1.2.41
Ubuntu 18.04.4 LTS 4.15.0-96-generic docker://19.3.8
root@open-source:/home/ubuntu# kubectl get pod -n kube-system
NAME READY STATUSRESTARTS AGE
calico-kube-controllers-555fc8cc5c-jbt4h 1/1 Running 1 11d
calico-node-xzrbs 1/1 Running 1 11d
coredns-66bff467f8-q5j2q 1/1 Running 1 11d
coredns-66bff467f8-sxxfx 1/1 Running 1 11d
etcd-open-source 1/1 Running 1 11d
kube-apiserver-open-source 1/1 Running 1 11d
kube-controller-manager-open-source1/1 Running 3 11d
kube-proxy-mnzq4 1/1 Running 1 11d
kube-scheduler-open-source 1/1 Running 3 11d
root@open-source:/home/ubuntu# kubectl cluster-info
Kubernetes master is running at https://10.1.2.41:6443
KubeDNS is running at
https://10.1.2.41:6443/api/v1/namespaces/kube-system/services/kube-dns:dns/proxy
To further debug and diagnose cluster problems, use 'kubectl cluster-info
dump'.
```
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.
For queries about this service, please contact Infrastructure at:
us...@infra.apache.org
[jira] [Commented] (KYLIN-4446) Kylin on kubernetes in a quickstart env
[
https://issues.apache.org/jira/browse/KYLIN-4446?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17093320#comment-17093320
]
ASF GitHub Bot commented on KYLIN-4446:
---
hit-lacus edited a comment on pull request #1182:
URL: https://github.com/apache/kylin/pull/1182#issuecomment-619833208
## Check Env
Hadoop Env
```shell
[root@cdh-master ~]# hadoop version
Hadoop 2.6.0-cdh5.7.6
Subversion http://github.com/cloudera/hadoop -r
a3edabab129caaada2958ab32061aa0e52a3f7df
Compiled by jenkins on 2017-02-21T23:08Z
Compiled with protoc 2.5.0
From source with checksum 3de3a6f2894b326919cd7a9b4e573e
This command was run using
/opt/cloudera/parcels/CDH-5.7.6-1.cdh5.7.6.p0.6/jars/hadoop-common-2.6.0-cdh5.7.6.jar
```
Elasticsearch Env
```shell
[root@cdh-master elasticsearch-7.6.0]# bin/elasticsearch -V
future versions of Elasticsearch will require Java 11; your Java version
from [/usr/java/jdk1.8.0_171/jre] does not meet this requirement
Version: 7.6.0, Build:
default/tar/7f634e9f44834fbc12724506cc1da681b0c3b1e3/2020-02-06T00:09:00.449973Z,
JVM: 1.8.0_171
```
Kubernetes Env
```shell
root@open-source:/home/ubuntu# lsb_release -a
No LSB modules are available.
Distributor ID: Ubuntu
Description: Ubuntu 18.04.4 LTS
Release: 18.04
Codename:bionic
root@open-source:/home/ubuntu# kubectl version
Client Version: version.Info{Major:"1", Minor:"18", GitVersion:"v1.18.1",
GitCommit:"7879fc12a63337efff607952a323df90cdc7a335", GitTreeState:"clean",
BuildDate:"2020-04-08T17:38:50Z", GoVersion:"go1.13.9", Compiler:"gc",
Platform:"linux/amd64"}
Server Version: version.Info{Major:"1", Minor:"18", GitVersion:"v1.18.1",
GitCommit:"7879fc12a63337efff607952a323df90cdc7a335", GitTreeState:"clean",
BuildDate:"2020-04-08T17:30:47Z", GoVersion:"go1.13.9", Compiler:"gc",
Platform:"linux/amd64"}
root@open-source:/home/ubuntu# free -h
totalusedfree shared buff/cache
available
Mem:19G3.6G 11G2.2M4.5G
15G
Swap:0B 0B 0B
root@open-source:/home/ubuntu# cat /proc/cpuinfo| grep "cpu cores"| uniq
cpu cores: 8
root@open-source:/home/ubuntu# uname -a
Linux open-source 4.15.0-96-generic #97-Ubuntu SMP Wed Apr 1 03:25:46 UTC
2020 x86_64 x86_64 x86_64 GNU/Linux
root@open-source:/home/ubuntu# kubectl get node -o=wide
NAME STATUS ROLESAGE VERSION INTERNAL-IP EXTERNAL-IP
OS-IMAGE KERNEL-VERSION CONTAINER-RUNTIME
open-source Readymaster 11d v1.18.1 10.1.2.41
Ubuntu 18.04.4 LTS 4.15.0-96-generic docker://19.3.8
root@open-source:/home/ubuntu# kubectl get pod -n kube-system
NAME READY STATUSRESTARTS AGE
calico-kube-controllers-555fc8cc5c-jbt4h 1/1 Running 1 11d
calico-node-xzrbs 1/1 Running 1 11d
coredns-66bff467f8-q5j2q 1/1 Running 1 11d
coredns-66bff467f8-sxxfx 1/1 Running 1 11d
etcd-open-source 1/1 Running 1 11d
kube-apiserver-open-source 1/1 Running 1 11d
kube-controller-manager-open-source1/1 Running 3 11d
kube-proxy-mnzq4 1/1 Running 1 11d
kube-scheduler-open-source 1/1 Running 3 11d
root@open-source:/home/ubuntu# kubectl cluster-info
Kubernetes master is running at https://10.1.2.41:6443
KubeDNS is running at
https://10.1.2.41:6443/api/v1/namespaces/kube-system/services/kube-dns:dns/proxy
To further debug and diagnose cluster problems, use 'kubectl cluster-info
dump'.
```
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.
For queries about this service, please contact Infrastructure at:
us...@infra.apache.org
> Kylin on kubernetes in a quickstart env
> ---
>
> Key: KYLIN-4446
> URL: https://issues.apache.org/jira/browse/KYLIN-4446
> Project: Kylin
> Issue Type: Sub-task
> Components: Integration
>Reporter: Xiaoxiang Yu
>Assignee: Xiaoxiang Yu
>Priority: Major
> Labels: kubernetes
> Fix For: v3.1.0
>
> Original Estimate: 48h
> Time Spent: 2h
> Remaining Estimate: 46h
>
> For a quick-start/PoC purpose, please consider use this template, it will
> only deploy one Kylin instance with role
[jira] [Commented] (KYLIN-4446) Kylin on kubernetes in a quickstart env
[
https://issues.apache.org/jira/browse/KYLIN-4446?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17093321#comment-17093321
]
ASF GitHub Bot commented on KYLIN-4446:
---
hit-lacus edited a comment on pull request #1182:
URL: https://github.com/apache/kylin/pull/1182#issuecomment-619833208
## Check Env
Hadoop Env
```shell
[root@cdh-master ~]# hadoop version
Hadoop 2.6.0-cdh5.7.6
Subversion http://github.com/cloudera/hadoop -r
a3edabab129caaada2958ab32061aa0e52a3f7df
Compiled by jenkins on 2017-02-21T23:08Z
Compiled with protoc 2.5.0
From source with checksum 3de3a6f2894b326919cd7a9b4e573e
This command was run using
/opt/cloudera/parcels/CDH-5.7.6-1.cdh5.7.6.p0.6/jars/hadoop-common-2.6.0-cdh5.7.6.jar
```
Elasticsearch Env
```shell
[root@cdh-master elasticsearch-7.6.0]# bin/elasticsearch -V
future versions of Elasticsearch will require Java 11; your Java version
from [/usr/java/jdk1.8.0_171/jre] does not meet this requirement
Version: 7.6.0, Build:
default/tar/7f634e9f44834fbc12724506cc1da681b0c3b1e3/2020-02-06T00:09:00.449973Z,
JVM: 1.8.0_171
```
Kubernetes Env
```shell
root@open-source:/home/ubuntu# lsb_release -a
No LSB modules are available.
Distributor ID: Ubuntu
Description: Ubuntu 18.04.4 LTS
Release: 18.04
Codename:bionic
root@open-source:/home/ubuntu# kubectl version
Client Version: version.Info{Major:"1", Minor:"18", GitVersion:"v1.18.1",
GitCommit:"7879fc12a63337efff607952a323df90cdc7a335", GitTreeState:"clean",
BuildDate:"2020-04-08T17:38:50Z", GoVersion:"go1.13.9", Compiler:"gc",
Platform:"linux/amd64"}
Server Version: version.Info{Major:"1", Minor:"18", GitVersion:"v1.18.1",
GitCommit:"7879fc12a63337efff607952a323df90cdc7a335", GitTreeState:"clean",
BuildDate:"2020-04-08T17:30:47Z", GoVersion:"go1.13.9", Compiler:"gc",
Platform:"linux/amd64"}
root@open-source:/home/ubuntu# free -h
totalusedfree shared buff/cache
available
Mem:19G3.6G 11G2.2M4.5G
15G
Swap:0B 0B 0B
root@open-source:/home/ubuntu# cat /proc/cpuinfo| grep "cpu cores"| uniq
cpu cores: 8
root@open-source:/home/ubuntu# uname -a
Linux open-source 4.15.0-96-generic #97-Ubuntu SMP Wed Apr 1 03:25:46 UTC
2020 x86_64 x86_64 x86_64 GNU/Linux
root@open-source:/home/ubuntu# kubectl get node -o=wide
NAME STATUS ROLESAGE VERSION INTERNAL-IP EXTERNAL-IP
OS-IMAGE KERNEL-VERSION CONTAINER-RUNTIME
open-source Readymaster 11d v1.18.1 10.1.2.41
Ubuntu 18.04.4 LTS 4.15.0-96-generic docker://19.3.8
root@open-source:/home/ubuntu# kubectl get pod -n kube-system
NAME READY STATUSRESTARTS AGE
calico-kube-controllers-555fc8cc5c-jbt4h 1/1 Running 1 11d
calico-node-xzrbs 1/1 Running 1 11d
coredns-66bff467f8-q5j2q 1/1 Running 1 11d
coredns-66bff467f8-sxxfx 1/1 Running 1 11d
etcd-open-source 1/1 Running 1 11d
kube-apiserver-open-source 1/1 Running 1 11d
kube-controller-manager-open-source1/1 Running 3 11d
kube-proxy-mnzq4 1/1 Running 1 11d
kube-scheduler-open-source 1/1 Running 3 11d
root@open-source:/home/ubuntu# kubectl cluster-info
Kubernetes master is running at https://10.1.2.41:6443
KubeDNS is running at
https://10.1.2.41:6443/api/v1/namespaces/kube-system/services/kube-dns:dns/proxy
To further debug and diagnose cluster problems, use 'kubectl cluster-info
dump'.
```
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.
For queries about this service, please contact Infrastructure at:
us...@infra.apache.org
> Kylin on kubernetes in a quickstart env
> ---
>
> Key: KYLIN-4446
> URL: https://issues.apache.org/jira/browse/KYLIN-4446
> Project: Kylin
> Issue Type: Sub-task
> Components: Integration
>Reporter: Xiaoxiang Yu
>Assignee: Xiaoxiang Yu
>Priority: Major
> Labels: kubernetes
> Fix For: v3.1.0
>
> Original Estimate: 48h
> Time Spent: 2h
> Remaining Estimate: 46h
>
> For a quick-start/PoC purpose, please consider use this template, it will
> only deploy one Kylin
[GitHub] [kylin] hit-lacus edited a comment on pull request #1182: KYLIN-4446 Kylin on kubernetes in quick-start and production env
hit-lacus edited a comment on pull request #1182:
URL: https://github.com/apache/kylin/pull/1182#issuecomment-619833208
## Check Env
Hadoop Env
```shell
[root@cdh-master ~]# hadoop version
Hadoop 2.6.0-cdh5.7.6
Subversion http://github.com/cloudera/hadoop -r
a3edabab129caaada2958ab32061aa0e52a3f7df
Compiled by jenkins on 2017-02-21T23:08Z
Compiled with protoc 2.5.0
From source with checksum 3de3a6f2894b326919cd7a9b4e573e
This command was run using
/opt/cloudera/parcels/CDH-5.7.6-1.cdh5.7.6.p0.6/jars/hadoop-common-2.6.0-cdh5.7.6.jar
```
Elasticsearch Env
```shell
[root@cdh-master elasticsearch-7.6.0]# bin/elasticsearch -V
future versions of Elasticsearch will require Java 11; your Java version
from [/usr/java/jdk1.8.0_171/jre] does not meet this requirement
Version: 7.6.0, Build:
default/tar/7f634e9f44834fbc12724506cc1da681b0c3b1e3/2020-02-06T00:09:00.449973Z,
JVM: 1.8.0_171
```
Kubernetes Env
```shell
root@open-source:/home/ubuntu# lsb_release -a
No LSB modules are available.
Distributor ID: Ubuntu
Description: Ubuntu 18.04.4 LTS
Release: 18.04
Codename:bionic
root@open-source:/home/ubuntu# kubectl version
Client Version: version.Info{Major:"1", Minor:"18", GitVersion:"v1.18.1",
GitCommit:"7879fc12a63337efff607952a323df90cdc7a335", GitTreeState:"clean",
BuildDate:"2020-04-08T17:38:50Z", GoVersion:"go1.13.9", Compiler:"gc",
Platform:"linux/amd64"}
Server Version: version.Info{Major:"1", Minor:"18", GitVersion:"v1.18.1",
GitCommit:"7879fc12a63337efff607952a323df90cdc7a335", GitTreeState:"clean",
BuildDate:"2020-04-08T17:30:47Z", GoVersion:"go1.13.9", Compiler:"gc",
Platform:"linux/amd64"}
root@open-source:/home/ubuntu# free -h
totalusedfree shared buff/cache
available
Mem:19G3.6G 11G2.2M4.5G
15G
Swap:0B 0B 0B
root@open-source:/home/ubuntu# cat /proc/cpuinfo| grep "cpu cores"| uniq
cpu cores: 8
root@open-source:/home/ubuntu# uname -a
Linux open-source 4.15.0-96-generic #97-Ubuntu SMP Wed Apr 1 03:25:46 UTC
2020 x86_64 x86_64 x86_64 GNU/Linux
root@open-source:/home/ubuntu# kubectl get node -o=wide
NAME STATUS ROLESAGE VERSION INTERNAL-IP EXTERNAL-IP
OS-IMAGE KERNEL-VERSION CONTAINER-RUNTIME
open-source Readymaster 11d v1.18.1 10.1.2.41
Ubuntu 18.04.4 LTS 4.15.0-96-generic docker://19.3.8
root@open-source:/home/ubuntu# kubectl get pod -n kube-system
NAME READY STATUSRESTARTS AGE
calico-kube-controllers-555fc8cc5c-jbt4h 1/1 Running 1 11d
calico-node-xzrbs 1/1 Running 1 11d
coredns-66bff467f8-q5j2q 1/1 Running 1 11d
coredns-66bff467f8-sxxfx 1/1 Running 1 11d
etcd-open-source 1/1 Running 1 11d
kube-apiserver-open-source 1/1 Running 1 11d
kube-controller-manager-open-source1/1 Running 3 11d
kube-proxy-mnzq4 1/1 Running 1 11d
kube-scheduler-open-source 1/1 Running 3 11d
root@open-source:/home/ubuntu# kubectl cluster-info
Kubernetes master is running at https://10.1.2.41:6443
KubeDNS is running at
https://10.1.2.41:6443/api/v1/namespaces/kube-system/services/kube-dns:dns/proxy
To further debug and diagnose cluster problems, use 'kubectl cluster-info
dump'.
```
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.
For queries about this service, please contact Infrastructure at:
us...@infra.apache.org
[jira] [Commented] (KYLIN-4446) Kylin on kubernetes in a quickstart env
[
https://issues.apache.org/jira/browse/KYLIN-4446?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17093277#comment-17093277
]
ASF GitHub Bot commented on KYLIN-4446:
---
hit-lacus edited a comment on pull request #1182:
URL: https://github.com/apache/kylin/pull/1182#issuecomment-619863981
## Clean up All Service
- https://kubernetes.io/docs/tasks/run-application/delete-stateful-set/
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.
For queries about this service, please contact Infrastructure at:
us...@infra.apache.org
> Kylin on kubernetes in a quickstart env
> ---
>
> Key: KYLIN-4446
> URL: https://issues.apache.org/jira/browse/KYLIN-4446
> Project: Kylin
> Issue Type: Sub-task
> Components: Integration
>Reporter: Xiaoxiang Yu
>Assignee: Xiaoxiang Yu
>Priority: Major
> Labels: kubernetes
> Fix For: v3.1.0
>
> Original Estimate: 48h
> Time Spent: 2h
> Remaining Estimate: 46h
>
> For a quick-start/PoC purpose, please consider use this template, it will
> only deploy one Kylin instance with role {color:#de350b}*ALL* {color}
--
This message was sent by Atlassian Jira
(v8.3.4#803005)
[GitHub] [kylin] hit-lacus edited a comment on pull request #1182: KYLIN-4446 Kylin on kubernetes in quick-start and production env
hit-lacus edited a comment on pull request #1182: URL: https://github.com/apache/kylin/pull/1182#issuecomment-619863981 ## Clean up All Service - https://kubernetes.io/docs/tasks/run-application/delete-stateful-set/ This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use the URL above to go to the specific comment. For queries about this service, please contact Infrastructure at: us...@infra.apache.org
[jira] [Commented] (KYLIN-4446) Kylin on kubernetes in a quickstart env
[
https://issues.apache.org/jira/browse/KYLIN-4446?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17093272#comment-17093272
]
ASF GitHub Bot commented on KYLIN-4446:
---
hit-lacus edited a comment on pull request #1182:
URL: https://github.com/apache/kylin/pull/1182#issuecomment-619862739
## Scale Out/In Query Service
- https://kubernetes.io/docs/tasks/run-application/scale-stateful-set/
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.
For queries about this service, please contact Infrastructure at:
us...@infra.apache.org
> Kylin on kubernetes in a quickstart env
> ---
>
> Key: KYLIN-4446
> URL: https://issues.apache.org/jira/browse/KYLIN-4446
> Project: Kylin
> Issue Type: Sub-task
> Components: Integration
>Reporter: Xiaoxiang Yu
>Assignee: Xiaoxiang Yu
>Priority: Major
> Labels: kubernetes
> Fix For: v3.1.0
>
> Original Estimate: 48h
> Time Spent: 2h
> Remaining Estimate: 46h
>
> For a quick-start/PoC purpose, please consider use this template, it will
> only deploy one Kylin instance with role {color:#de350b}*ALL* {color}
--
This message was sent by Atlassian Jira
(v8.3.4#803005)
[GitHub] [kylin] hit-lacus edited a comment on pull request #1182: KYLIN-4446 Kylin on kubernetes in quick-start and production env
hit-lacus edited a comment on pull request #1182: URL: https://github.com/apache/kylin/pull/1182#issuecomment-619862739 ## Scale Out/In Query Service - https://kubernetes.io/docs/tasks/run-application/scale-stateful-set/ This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use the URL above to go to the specific comment. For queries about this service, please contact Infrastructure at: us...@infra.apache.org
[jira] [Commented] (KYLIN-4446) Kylin on kubernetes in a quickstart env
[
https://issues.apache.org/jira/browse/KYLIN-4446?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17093267#comment-17093267
]
ASF GitHub Bot commented on KYLIN-4446:
---
hit-lacus commented on pull request #1182:
URL: https://github.com/apache/kylin/pull/1182#issuecomment-619863981
## Clean up All Service
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.
For queries about this service, please contact Infrastructure at:
us...@infra.apache.org
> Kylin on kubernetes in a quickstart env
> ---
>
> Key: KYLIN-4446
> URL: https://issues.apache.org/jira/browse/KYLIN-4446
> Project: Kylin
> Issue Type: Sub-task
> Components: Integration
>Reporter: Xiaoxiang Yu
>Assignee: Xiaoxiang Yu
>Priority: Major
> Labels: kubernetes
> Fix For: v3.1.0
>
> Original Estimate: 48h
> Time Spent: 2h
> Remaining Estimate: 46h
>
> For a quick-start/PoC purpose, please consider use this template, it will
> only deploy one Kylin instance with role {color:#de350b}*ALL* {color}
--
This message was sent by Atlassian Jira
(v8.3.4#803005)
[GitHub] [kylin] hit-lacus commented on pull request #1182: KYLIN-4446 Kylin on kubernetes in quick-start and production env
hit-lacus commented on pull request #1182: URL: https://github.com/apache/kylin/pull/1182#issuecomment-619863981 ## Clean up All Service This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use the URL above to go to the specific comment. For queries about this service, please contact Infrastructure at: us...@infra.apache.org
[jira] [Commented] (KYLIN-4446) Kylin on kubernetes in a quickstart env
[
https://issues.apache.org/jira/browse/KYLIN-4446?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17093265#comment-17093265
]
ASF GitHub Bot commented on KYLIN-4446:
---
hit-lacus commented on pull request #1182:
URL: https://github.com/apache/kylin/pull/1182#issuecomment-619862739
## Scale Out Query Service
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.
For queries about this service, please contact Infrastructure at:
us...@infra.apache.org
> Kylin on kubernetes in a quickstart env
> ---
>
> Key: KYLIN-4446
> URL: https://issues.apache.org/jira/browse/KYLIN-4446
> Project: Kylin
> Issue Type: Sub-task
> Components: Integration
>Reporter: Xiaoxiang Yu
>Assignee: Xiaoxiang Yu
>Priority: Major
> Labels: kubernetes
> Fix For: v3.1.0
>
> Original Estimate: 48h
> Time Spent: 2h
> Remaining Estimate: 46h
>
> For a quick-start/PoC purpose, please consider use this template, it will
> only deploy one Kylin instance with role {color:#de350b}*ALL* {color}
--
This message was sent by Atlassian Jira
(v8.3.4#803005)
[jira] [Commented] (KYLIN-4446) Kylin on kubernetes in a quickstart env
[
https://issues.apache.org/jira/browse/KYLIN-4446?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17093263#comment-17093263
]
ASF GitHub Bot commented on KYLIN-4446:
---
hit-lacus commented on pull request #1182:
URL: https://github.com/apache/kylin/pull/1182#issuecomment-619862275
## Test Kylin Query Service
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.
For queries about this service, please contact Infrastructure at:
us...@infra.apache.org
> Kylin on kubernetes in a quickstart env
> ---
>
> Key: KYLIN-4446
> URL: https://issues.apache.org/jira/browse/KYLIN-4446
> Project: Kylin
> Issue Type: Sub-task
> Components: Integration
>Reporter: Xiaoxiang Yu
>Assignee: Xiaoxiang Yu
>Priority: Major
> Labels: kubernetes
> Fix For: v3.1.0
>
> Original Estimate: 48h
> Time Spent: 2h
> Remaining Estimate: 46h
>
> For a quick-start/PoC purpose, please consider use this template, it will
> only deploy one Kylin instance with role {color:#de350b}*ALL* {color}
--
This message was sent by Atlassian Jira
(v8.3.4#803005)
[jira] [Commented] (KYLIN-4446) Kylin on kubernetes in a quickstart env
[
https://issues.apache.org/jira/browse/KYLIN-4446?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17093262#comment-17093262
]
ASF GitHub Bot commented on KYLIN-4446:
---
hit-lacus commented on pull request #1182:
URL: https://github.com/apache/kylin/pull/1182#issuecomment-619862166
## Create Kylin Query Service
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.
For queries about this service, please contact Infrastructure at:
us...@infra.apache.org
> Kylin on kubernetes in a quickstart env
> ---
>
> Key: KYLIN-4446
> URL: https://issues.apache.org/jira/browse/KYLIN-4446
> Project: Kylin
> Issue Type: Sub-task
> Components: Integration
>Reporter: Xiaoxiang Yu
>Assignee: Xiaoxiang Yu
>Priority: Major
> Labels: kubernetes
> Fix For: v3.1.0
>
> Original Estimate: 48h
> Time Spent: 2h
> Remaining Estimate: 46h
>
> For a quick-start/PoC purpose, please consider use this template, it will
> only deploy one Kylin instance with role {color:#de350b}*ALL* {color}
--
This message was sent by Atlassian Jira
(v8.3.4#803005)
[GitHub] [kylin] hit-lacus commented on pull request #1182: KYLIN-4446 Kylin on kubernetes in quick-start and production env
hit-lacus commented on pull request #1182: URL: https://github.com/apache/kylin/pull/1182#issuecomment-619862739 ## Scale Out Query Service This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use the URL above to go to the specific comment. For queries about this service, please contact Infrastructure at: us...@infra.apache.org
[GitHub] [kylin] hit-lacus commented on pull request #1182: KYLIN-4446 Kylin on kubernetes in quick-start and production env
hit-lacus commented on pull request #1182: URL: https://github.com/apache/kylin/pull/1182#issuecomment-619862275 ## Test Kylin Query Service This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use the URL above to go to the specific comment. For queries about this service, please contact Infrastructure at: us...@infra.apache.org
[jira] [Commented] (KYLIN-4446) Kylin on kubernetes in a quickstart env
[
https://issues.apache.org/jira/browse/KYLIN-4446?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17093261#comment-17093261
]
ASF GitHub Bot commented on KYLIN-4446:
---
hit-lacus commented on pull request #1182:
URL: https://github.com/apache/kylin/pull/1182#issuecomment-619861990
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.
For queries about this service, please contact Infrastructure at:
us...@infra.apache.org
> Kylin on kubernetes in a quickstart env
> ---
>
> Key: KYLIN-4446
> URL: https://issues.apache.org/jira/browse/KYLIN-4446
> Project: Kylin
> Issue Type: Sub-task
> Components: Integration
>Reporter: Xiaoxiang Yu
>Assignee: Xiaoxiang Yu
>Priority: Major
> Labels: kubernetes
> Fix For: v3.1.0
>
> Original Estimate: 48h
> Time Spent: 2h
> Remaining Estimate: 46h
>
> For a quick-start/PoC purpose, please consider use this template, it will
> only deploy one Kylin instance with role {color:#de350b}*ALL* {color}
--
This message was sent by Atlassian Jira
(v8.3.4#803005)
[jira] [Commented] (KYLIN-4446) Kylin on kubernetes in a quickstart env
[
https://issues.apache.org/jira/browse/KYLIN-4446?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17093260#comment-17093260
]
ASF GitHub Bot commented on KYLIN-4446:
---
hit-lacus commented on pull request #1182:
URL: https://github.com/apache/kylin/pull/1182#issuecomment-619861773
## Create Memcached Service
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.
For queries about this service, please contact Infrastructure at:
us...@infra.apache.org
> Kylin on kubernetes in a quickstart env
> ---
>
> Key: KYLIN-4446
> URL: https://issues.apache.org/jira/browse/KYLIN-4446
> Project: Kylin
> Issue Type: Sub-task
> Components: Integration
>Reporter: Xiaoxiang Yu
>Assignee: Xiaoxiang Yu
>Priority: Major
> Labels: kubernetes
> Fix For: v3.1.0
>
> Original Estimate: 48h
> Time Spent: 2h
> Remaining Estimate: 46h
>
> For a quick-start/PoC purpose, please consider use this template, it will
> only deploy one Kylin instance with role {color:#de350b}*ALL* {color}
--
This message was sent by Atlassian Jira
(v8.3.4#803005)
[GitHub] [kylin] hit-lacus commented on pull request #1182: KYLIN-4446 Kylin on kubernetes in quick-start and production env
hit-lacus commented on pull request #1182: URL: https://github.com/apache/kylin/pull/1182#issuecomment-619862166 ## Create Kylin Query Service This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use the URL above to go to the specific comment. For queries about this service, please contact Infrastructure at: us...@infra.apache.org
