?????? ????Apache kylin ????Hadoop ??????????

?? ??kylin Hadoop 2.6.0-cdh5.11.0 HBase 1.2.0-cdh5.11.0 Hive 1.1.0-cdh5.11.0 ---- ??:"Xiaoxiang Yu"http://github.com/cloudera/hadoop -r a3edabab129caaada2958ab32061aa0e52a3f7df Compiled

Re: 关于Apache kylin 支持Hadoop 版本的问题

Hi Sir, In my cluster(CDH5.7 with Hadoop 2.6 installed), Kylin could run smoothly. Following is the version info of the most important Hadoop component for Kylin in my env. You may just have a look. [root@cdh-client ~]# hadoop version Hadoop 2.6.0-cdh5.7.6 Subversion

????Apache kylin ????Hadoop ??????????

kylin?? ??Hadoop 2.7+??hadoop??2.6.0 ??apache

Re: kylin#2 Step Error

Hi, In my env(HDP3.1 with Hive3, the same as your env), I test hive -e "use default; set mapreduce.job.reduces=1;", and it didn’t throw any error. And maybe you can modify the configuration of your Hive conf. And if you cannot fix it at Hive side, you can just use

Apache Kylin Meetup @Beijing, Nov. 16, 2019

Hello Kylin users, There will be a Kylin Meetup the week after next (Nov. 16) in Beijing, China. Engineers from Didi(滴滴), WeBank(微众银行), Yidian Inc (一点资讯) and Kyligence will share their use cases and experiences with Kylin & Linkis. Date: Nov. 16, 2019 Time: 1:00 PM - 5:00 PM Location:

Re:when set dim A to mandatory，can't find cuboid only contain dim A

sorry，the configuration “kylin.cube.aggrgroup.is-mandatory-only-valid：true” may not be in effect ，after I restart KYLIN again，and rebuild cube ，it works。 At 2019-10-29 20:51:25, "Johnson" wrote: hi，all： I found a problem，when set dim A to mandatory，can't find cuboid only contain dim

when set dim A to mandatory，can't find cuboid only contain dim A

hi，all： I found a problem，when set dim A to mandatory，can't find cuboid only contain dim A，example： dim：A，B，C ； mandatory：A ；rowkey order A B C when build success，exists cube combination：AB(110),AC(101),ABC(111)，why A(100) not exists？ I looked at the source code，found this configuration： I

kylin#2 Step Error

Error # 2 Step executed in kylin, as indicated in the log.Step by step, finally found in the hive perform “set mapreduce.job.reduces=1”.Error: Error while processing the statement: always modify graphs. The job, reduces the at runtime. It is not in the list of params that are allowed to be

Kylin WriteConflictException

I'm now using apache-kylin-2.6.3-bin-cdh57 ，sometime job will stop with WriteConflictException , after I resume the job ,all work well. what this Exception mean ? I have checked the time use timedatectl , the kylin job server and hbase server , the different between them is not over 1 second.

Re: is there any crontab job in kylin

sorry it is my fault. 2019-10-29 lk_hadoop 发件人："lk_hadoop" 发送时间：2019-10-28 19:27 主题：is there any crontab job in kylin 收件人："dev","user" 抄送： hi,all： I'm now using apache-kylin-2.6.3-bin-cdh57 , every 10 minutes I will see this error log below, first I thought I it is my crontab job for

is there any crontab job in kylin

hi,all： I'm now using apache-kylin-2.6.3-bin-cdh57 , every 10 minutes I will see this error log below, first I thought I it is my crontab job for build system_cube, but now I have delete the crontab job and stop the 'all' and 'job' node , I can see this log from query nodes still . I don't

need help with non-static dimensions

Hi, all. It seems that in Kylin, the dimensions of input data are considered as static. How to use kylin to process input data whose dimensions may change. For example, there are input data with fields "t_date, user_id, user_server, user_os". However, user's login server may change during the

Re: Re: build job keep pending

I don't know if the issue have any relationship with my job pending problem. but after I drop all the job with exception : IllegalArgumentException. my current job begin to running state. thanks @yaqian_zh...@126.com 2019-10-28 lk_hadoop 发件人：Yaqian Zhang 发送时间：2019-10-28 15:51 主题：Re:

build job keep pending

hi,all： My kylin cluster suddenly pending all build job its never happen before . And I see alost of error from log : java.lang.IllegalArgumentException: there is no related output for job id:360aa712-4165-57ae-0ddd-3577c8439e93 and the job id is not my current job id , please

Re: strange error! java.lang.IndexOutOfBoundsException: Index: 43, Size: 43 appear in double select sql query

Thx, I will try to reproduce this error ASAP > 在 2019年10月28日，13:45，Wang rupeng 写道： > > Hi, > I followed your steps and I got the same error too. But I find that if I > add “KYLIN_SALES.LSTG_FORMAT_NAME” in kylin_sales_model’s measures step. > Then your sql that contains

Re: Kylin integrated saiku

Hi, wuming, please send your questions directly. > 在 2019年10月28日，14:42，伍明 写道： > > Hello all， >Anyone familiar with this solution? Can I ask you some questions? Thank > you very much. > >I am looking forward to someone’s reply.

Kylin integrated saiku

Hello all?? Anyone familiar with this solution? Can I ask you some questions? Thank you very much. I am looking forward to someone??s reply.

Re: need help

Hi, Please make sure that kylin has read, wirite and create rights on hdfs, try “hadoop fs -chmod -R 755 /kylin”. If still has the problem, you can find the hive command that create intermediate flat table on hive at kylin frontend page or kylin.log, run this hive command to see if the

Re:Re: need help

First of all, thank you for your reply. My HDFS is: 3.1 hive is: 3.1 hbase is: 2.0 kylin is: 3.1 The binary package kylin USES is: for Hadoop 3.1 + HBase 2.0 (includes Hortonworks HDP 3.0) - apache-kylin-3.0.0-beta-bin-hadoop3.tar.gz I extracted the tar package and configured the dependent

Re: need help

Hi FengTeng: Can you provide more details such as Kylin version and Hadoop version? > 在 2019年10月28日，11:07，冯腾 写道： > > java.io.FileNotFoundException: File does not exist: > /kylin/kylin_metadata/kylin-6de0c22d-9bca-51ed-a321-a9f621283175/kylin_intermediate_q_65639922_e70a_236b_3de3_4be81ca0cc1d

Re: strange error! java.lang.IndexOutOfBoundsException: Index: 43, Size: 43 appear in double select sql query

Hi, which version do you use and can you use the cube generated by sample.sh to reproduce this problem so that we can troubleshoot it? > 在 2019年10月26日，17:43，奥威软件 <3513797...@qq.com > 写道： > > hi > > strange error! java.lang.IndexOutOfBoundsException: Index: 43, Size:

回复： Re: Re: Tableau Server通过JDBC连接Kylin的问题

ok，thanks 来自钉钉专属商务邮箱-- 发件人：Temple Zhou 日　期：2019年10月25日 17:04:00 收件人：禹荣虎; user 主　题：Re: Re: Re: Tableau Server通过JDBC连接Kylin的问题 Hi Tiger I have tried the Tableau Server(2019.2.4) on Windows(2008R2) and Linux(Ubuntu 18.04) and

Re: Re: can I read or write "Extract Fact Table Distinct Columns" result to somewhere

Hi Sir, Another way I knew is the Hive-Mr global dictionary, if you have a COUNT_DISTINCT(BITMAP) in cube, you can fetch all distinct value via related Hive table. But it is first available in 3.0.0-alpha2, you may check this blog for detail:

Time problem

Hello! When I refresh and build the segment with the API, the incoming time is inconsistent with the time of the segment, I want to ask why. refresh : startTime:155980800(2019-06-06 16:00:00)；endTime:156533760(2019-08-09 16:00:00) build: endTime:157158720(2019-10-21 00:00:00) What's

can I read or write "Extract Fact Table Distinct Columns" result to somewhere

hi,all Some dimension like product name may hive many different values ，I need to list all values to users to select what the exactly value they want . because of the step 3 "Extract Fact Table Distinct Columns" have already calculated each dimension's distinct values , can I directly read

Re: web ui error on apache-kylin-3.0.0-alpha2-bin-cdh60, issue reporting and workaround

Hi jiajing, Thank you for your detailed analysis and the workaround provided by you. Issue-1 and Issue-3 is not user-friendly and may mislead user, so we will try fix it in next release. For Issue02, since we test kylin binary on CDH6.1(but not CDH6.2 or higher version) before release, so we did

web ui error on apache-kylin-3.0.0-alpha2-bin-cdh60, issue reporting and workaround

Hi, everyone I am trying to setup kylin inside Docker. working with Centos 7 and CDH 6.3 Everything is going well until I ran into some web ui issue. kylin version: 47faa1810f21fa8c4c109b82af9eb09d44c2f0d14d245a94655aaf783780a143 apache-kylin-3.0.0-alpha2-bin-cdh60.tar.gz appearance :

[Announce] Apache Kylin 2.6.4 released

The Apache Kylin team is pleased to announce the immediate availability of the 2.6.4 release. This is a bugfix release after 2.6.3, with 27 bug fixes and enhancements; All of the changes in this release can be found in: https://kylin.apache.org/docs/release_notes.html You can download the source

#step 8 error??for help

Kylin cluster was upgraded from version 2.4 to version 2.6, and kylin??s #8 step build faild,The error message is as follows?? User class threw exception: java.lang.RuntimeException: error execute org.apache.kylin.engine.spark.SparkCubingByLayer. Root cause: Wrong FS:

Re: [New blog] Connecting Tableau to Kylin via JDBC driver

Awesome!  On Mon, Oct 14, 2019 at 10:22 AM ShaoFeng Shi wrote: > Hello, > > The Tableau Server 2019 supports generic JDBC driver. With this feature, > you can connect Tableau with Kylin via JDBC (instead of ODBC) driver from > Windows, Linux, and Mac. > > Piotr Naszarkowski contributes a new

[Announce] Apache Kylin 2.6.4 released

The Apache Kylin team is pleased to announce the immediate availability of the 2.6.4 release. This is a bugfix release after 2.6.3, with 27 bug fixes and enhancements; All of the changes in this release can be found in: https://kylin.apache.org/docs/release_notes.html You can download the source

回复: Re: The latest snapshot was not generated

Thank you for answering. I have tried to find a solution.The time interval of the cube is designed to be increasing. Cubes have common dimension tables.the time interval of the cube being built may be previous.the current cube build time interval is earlier than the last time interval. The

Re: The latest snapshot was not generated

Hi: Sorry for that reusing dimension table snapshots does have the problems you describe. We have fixed it in the upcoming version Kylin 2.6.4. For more information, please refer to https://issues.apache.org/jira/browse/KYLIN-3628 . > 在

load hive table操作，多kylin节点不一致的问题

hi，all： kylin version 2.6.2；三台节点，角色分别为：all ，query ，query。查询时使用代理到三台节点。 今天出现一个问题，我使用restapi load hive table，POST /kylin/api/tables/{tables}/{project} ，请求的是kylin all节点，然后我在all节点上创建model和cube，之后build

The latest snapshot was not generated

Hi friends: Kylin tries to reuse snapshots of dimension tables in each build, and if they change frequently, reuse will fail. but I find that data changes sometimes build without generating the latest snapshot, which I need What is the judgment of reuse failure that I want to fail every time I

回复: Re: how to create cube or model with RESTful API

 Thanks Yaqian, This is exactly what I need. Thanks a lot. Thanks,Qiuyu 发送自 Windows 10 版邮件应用 发件人: Yaqian Zhang发送时间: Friday, October 11, 2019 1:44 PM收件人: user@kylin.apache.org主题: Re: how to create cube or model with RESTful API Hi Qiuyu： Yes. Before building cube with REST API,  you need to have

Re: how to create cube or model with RESTful API

Hi Qiuyu： Yes. Before building cube with REST API, you need to have cubeDescData. You can get cubeDescData by API of “Get cube descriptor (dimension, measure info, etc) ” ，this requires you to design a cube you

回复: 回复: Re: how to create cube or model with RESTful API

Hi Yaqian, I have got the details by browser’s debug,I found your UI also call restful api. I think this can help me. Is right? Thanks,Qiuyu 发送自 Windows 10 版邮件应用 发件人: playboy...@gmail.com发送时间: Friday, October 11, 2019 11:04 AM收件人: user@kylin.apache.org主题: 回复: Re: how to create cube or model with

回复: Re: how to create cube or model with RESTful API

Hi Yaqian, Thanks for your reply. Could you provide more details for post request body?Because I need post 100 aggregation groups,  I don’t want to do it on UI. For example : how to post “dimensions, measures, aggregation groups, mandatory dimensions and so on… ”, Thanks,Qiuyu 发送自 Windows 10 版邮件应用 

Re: how to create cube or model with RESTful API

Hi： Sorry for the Kylin.apache.org web didn’t provide how to create cube or model with RESTful API. Actually, you can create model and cube with RESTful API as follow: 1、Create a cube with RESTful API: POST http://host:port/kylin/api/cubes

how to create cube or model with RESTful API

Hi folks, In Kylin.apache.org web, I can’t find any RESTful Api to create cube or model, only found “List cubes, build cube, disable cube …”.So, how to create cube with Restful API, or other workarounds? Could you give me some documents as detailed as possible? Thanks,Qiuyu 发送自 Windows 10 版邮件应用 

Re:Re: kylin构建cube过程中，连接hbase超时问题

Hi Yaqian： Thank you very much，I will try。 在 2019-10-10 16:07:30，"Yaqian Zhang" 写道： Hi Johnson: You can set the parameters “kylin.metadata.hbase-rpc-timeout” to modify the timeout, the default value is 5000ms. 在 2019年10月10日，15:10，Johnson 写道： kylin：2.6.2，HBase 1.2.0-cdh5.15.0 The

Re: kylin构建cube过程中，连接hbase超时问题

Hi Johnson: You can set the parameters “kylin.metadata.hbase-rpc-timeout” to modify the timeout, the default value is 5000ms. > 在 2019年10月10日，15:10，Johnson 写道： > > kylin：2.6.2，HBase 1.2.0-cdh5.15.0 > The error occurred in #3 Step Name: Extract Fact Table Distinct Columns > error log： >

Re:kylin构建cube过程中，连接hbase超时问题

I modified hbase-site.xml： hbase.rpc.timeout 60 hbase.client.operation.timeout 60 在 2019-10-10 15:10:10，"Johnson" 写道： kylin：2.6.2，HBase 1.2.0-cdh5.15.0 The error occurred in #3 Step Name: Extract Fact Table Distinct Columns error log： java.lang.RuntimeException:

kylin构建cube过程中，连接hbase超时问题

kylin：2.6.2，HBase 1.2.0-cdh5.15.0 The error occurred in #3 Step Name: Extract Fact Table Distinct Columns error log： java.lang.RuntimeException: org.apache.kylin.job.exception.PersistentException: org.apache.hadoop.hbase.client.RetriesExhaustedException: Failed after attempts=1, exceptions: Thu

Re: [!!Mass Mail][Probable spam]Re: sometimes need quite a long time when building cube

Please check the file size of the intermediate hive table first; The file size should be even after the "Redistribute" step. If not, please check the columns that it redistributed by (the first three dimensions by default). Best regards, Shaofeng Shi 史少锋 Apache Kylin PMC Email:

Re: Apache Kylin Meetup @Berlin, Oct. 24, 2019

Kylin users in the middle of the Euro are all welcomed to join this meetup in Berlin! It is the same day with ApacheCon Europe 2019, you can come after the ApacheCon. Best regards, Shaofeng Shi 史少锋 Apache Kylin PMC Email: shaofeng...@apache.org Apache Kylin FAQ:

Re: Error when building cube

Wuming, thank you for the information. If anyone has clue about this, welcome to share with us, a pull request is welcomed. Best regards, Shaofeng Shi 史少锋 Apache Kylin PMC Email: shaofeng...@apache.org Apache Kylin FAQ: https://kylin.apache.org/docs/gettingstarted/faq.html Join Kylin user mail

Re: [DISCUSS] Upgrade Hadoop-related dependencies’ to Hadoop3 for master branch

+1 Source code release is the core asset that apache project releases, while binary packages are just for convenience. Providing several binary versions is difficult for the maintainer (currently for each release we made 4 binary packages). Now Kylin 3.0 is a good moment that we switch the

Re: [DISCUSS] Upgrade Hadoop-related dependencies’ to Hadoop3 for master branch

+1. Kylin 3 aligns with Hadoop 3 With Warm regards Billy Liu Luke Han 于2019年10月1日周二 下午1:24写道： > > +1, we should move on to next-g Hadoop > > Best Regards! > - > > Luke Han > > > On Mon, Sep 30, 2019 at 12:39 AM nichunen wrote: >> >> Hi all, >> >> >> As more users upgrade

Re: [DISCUSS] Upgrade Hadoop-related dependencies’ to Hadoop3 for master branch

+1, we should move on to next-g Hadoop Best Regards! - Luke Han On Mon, Sep 30, 2019 at 12:39 AM nichunen wrote: > Hi all, > > > As more users upgrade their Hadoop to Hadoop3, to catch up with this > trend, I suggest Kylin’s master branch upgrades the Hadoop-related >

Re: Rest Api “Load Hive Tables ”Return 405

Hi Johnson, You should place those parameters in the url, like this: http://localhost:7070/kylin/api/tables/kylin_table/kylin_project On Mon, Sep 30, 2019 at 4:59 PM Johnson wrote: > hi，all > >- > >I call the API “Load Hive Tables” according to the official document >and return

Rest Api “Load Hive Tables ”Return 405

hi，all I call the API “Load Hive Tables” according to the official document and return 405 result：

[DISCUSS] Upgrade Hadoop-related dependencies’ to Hadoop3 for master branch

Hi all, As more users upgrade their Hadoop to Hadoop3, to catch up with this trend, I suggest Kylin’s master branch upgrades the Hadoop-related dependencies’ version to Hadoop3. So Kylin 3.0-GA will based on Hadoop3, users may download packages which can be run on HDP 3.x and CDH 6.x.

?????? Error when building cube

Hello?? Thank you for your reply. When I use EMR 5.7 andapache-kylin-2.5.0??I have not encountered that problem. ---- ??:"ShaoFeng Shi"https://kylin.apache.org/docs/gettingstarted/faq.html Join Kylin user mail group:

Re: global dictionary scople

Hi : It is a good question, Kylin use Global Dictionary to encode a string into integer, not a specific hashing function, please refer to http://kylin.apache.org/blog/2016/08/01/count-distinct-in-kylin/ for it design. For newer version, we provided build global dictionary in distributed way,

Apache Kylin Meetup @Berlin, Oct. 24, 2019

Hello Kylin users & developers, There will be a Kylin Meetup next month in Berlin, Germany. OLX group and Kyligence will share their use cases and experiences with Kylin. Date: Oct. 24, 2019 Time: 7:00 PM - 8:30 PM Location: OLX Group Karl-Liebknecht Straße 29, 10178 Berlin 16th

global dictionary scople

Hi: As the official document describes, Kylin uses bitmap to achieve precise count ( distinct) . The premise is to map the content to a number using a specific hash function. But, if we don't know how much cardinal number is ，how to confirm the range of mapped numbers? If the

Re: Error when building cube

Both the first step and the second steps are using "hive -e " to execute the data extraction and redistribution. If they were executed on the same node, should be the same. Please resume the job to take a retry. Best regards, Shaofeng Shi 史少锋 Apache Kylin PMC Email: shaofeng...@apache.org

Re: Error when building cube

Hi: Can you provide the detailed error log information and your hive-site.xml? The reason mabe is that hive.metastore.uris property is not set in hive-site.xml. > 在 2019年9月25日，15:54，伍明 写道： > > Hello all, > Env information is as follows: >AWS emr-5.26.0 >

Error when building cube

Hello all, Env information is as follows: AWSemr-5.26.0 apache-kylin-2.6.3-bin-hbase1x I created the sample cube with bin/sample.sh. And when I built the sample cube, in step 3, an execption occured which

Re:Re:Re: 重启kylin server突然报找不到tomcat的相关Class

已经找到原因了 安装kylin的机器有hbase的RegionServer节点，节点lib下放了phoenix的jar包，phoenix的jar包导致kylin server启动不成功。 后续把kylin与hbase节点独立开来安装。。 At 2019-09-16 15:47:14, "邵志鹏" wrote: Hi, Yaqian My Kylin version is 2.6.3, I have install, config and startup kylin server successful some days ago, I have build some

Re: 重启kylin server突然报找不到tomcat的相关Class

Hi, It does not look like kylin’s problem. Using “$KYLIN_HOME/bin/check-env.sh” to make sure there no problems about your environment, and please check your Hadoop components(Hive, Hbase, Zookeeper) running properly. --- Best wishes, Rupeng Wang 发件人: 邵志鹏 答复:

Re:Re: 重启kylin server突然报找不到tomcat的相关Class

Hi, Yaqian My Kylin version is 2.6.3, I have install, config and startup kylin server successful some days ago, I have build some cube examples successful. But, recent days, I stop the kylin server and re-start it, the web site http://x:7070/kylin/login was crashed no response, and then I

Re: 重启kylin server突然报找不到tomcat的相关Class

Hi 邵志鹏： You can provide your Kylin version and more details so that someone can help you. > On Sep 12, 2019, at 6:01 PM, 邵志鹏 wrote: > > Hi all, > > 重启后： > SEVERE: ContainerBase.addChild: start: > org.apache.catalina.LifecycleException: Failed to start component >

Re: apache-kylin-3.0.0-alpha2-bin-hbase1x Issue

Hi 张飞： I reproduced the problem you encountered. In kylin, the query results of a SQL similar to "select *, case when then from table" do not meet expectations, but a SQL like "select sum (name), case when then from table group by 2" is no problem. So I think you are right.Kylin’s parsing of

Re:Get list and status of completed queries

Hi Nikita, Please check your queries in $KYLIN_HOME/logs/kylin.log Best regards, Ni Chunen / George On 09/11/2019 19:16，Nikita Agrawal wrote： Hi , I have executed couple of queries from SQuirrel client where can I check list and status of queries executed in Kylin. Regards, Nikita

Get list and status of completed queries

Hi , I have executed couple of queries from SQuirrel client where can I check list and status of queries executed in Kylin. Regards, Nikita

Re: Function in SQL did not trigger predicate pushdown

Hi yout na: Just change the value of query where condition can not cause the query convert to push down because the mode of query still according with an existing cuboid. -- 陆国圣 / Guosheng Lu 软件工程师 / Software Engineer
 电话 / Mobile: 13914708027

Re: 数据源字段变化引发异常

Hi Shen june: If you change the field name of the data source, you need to delete the model and cube used in the field to reload the table, otherwise there will be a conflict. In general, after designing the model and cube, we do not recommend any changes to the table structure, especially the

Re: Apache Kylin Meetup @Shenzhen, Sep. 7, 2019

Awesome ! --- Best wishes, Rupeng Wang 在 2019/9/4 13:00，“zjsy...@163.com 代表 nichunen” 写入: Hello Kylin users, There will be a Kylin Meetup the week after next (Sep. 7) in Shenzhen, China. Engineers from Tencent(腾讯), Alibaba Group (阿里), Ping An

kylin 2.6 如何把事实表的列同时设置为 维度 和 指标

如题，在kylin 2.6 版本，如何把事实表的一个列在一个CUBE里，同时设置为维度列和指标列？ 谢谢！

Re: Real-time OLAP - NPE in stream receiver when processing event

Hi Andras, Thank you for your collaboration and bravery. I will be happy if I could hear your suggestion in the future. Best wishes, Xiaoxiang Yu 发件人: Andras Nagy 日期: 2019年9月4日 星期三 17:04 收件人: Xiaoxiang Yu 抄送: "user@kylin.apache.org" 主题: Re: Real-time OLAP - NPE in stream

Re: Real-time OLAP - NPE in stream receiver when processing event

Hi Xiaoxiang & Chao! I see, thanks a lot for the reply! I think we will give Xiaoxiang's patch a test drive and compare the results with what we expect for the count distinct. Best regards, Andras On Wed, Sep 4, 2019 at 4:43 AM Xiaoxiang Yu wrote: > Hi Andras, > >Count distinct(Bitmap) for

Re: 回复： fail to open web -- exception class path resource[ehcache-test.xml] cannot be opened because it does not exist

Hi, As far as I can see, could you please delete all backtick character (反斜线)“`” in you setenv.sh? I guess it may work. export KYLIN_JVM_SETTINGS="-Xms16g -Xmx16g -XX:MaxPermSize=512m -XX:NewSize=3g -XX:MaxNewSize=3g -XX:SurvivorRatio=4 -XX:+CMSClassUnloadingEnabled

?????? fail to open web -- exception class path resource[ehcache-test.xml] cannot be opened because it does not exist

hi sorry, my mistake~ i wrote wrong file name in this email , the file was setenv.sh i want allocate More Memory for Kylin, i use more then 20 dimensions i follow the Kylin Configuration Allocate More Memory for Kylin There are two sample settings for KYLIN_JVM_SETTINGS are given in

Re: fail to open web -- exception class path resource [ehcache-test.xml] cannot be opened because it does not exist

Hi： According to the content you provided, it seems that the changes you made are not the contents of the kylin. properties file. Can you tell us the purpose of the changes you made? Maybe this article can help you:http://kylin.apache.org/docs/install/configuration.html > On Sep 3, 2019, at

Apache Kylin Meetup @Shenzhen, Sep. 7, 2019

Hello Kylin users, There will be a Kylin Meetup the week after next (Sep. 7) in Shenzhen, China. Engineers from Tencent(腾讯), Alibaba Group (阿里), Ping An Group(平安) and Kyligence will share their use cases and experiences with Kylin & RocketMQ. Date: Sep. 7, 2019 Time: 12:30 PM - 16:40

Re: Real-time OLAP - NPE in stream receiver when processing event

Hi Andras, Count distinct(Bitmap) for String type is under development, we hope to release it at 3.0.0-beta. If you are interested, maybe you could help us review this PR (https://github.com/apache/kylin/pull/804). Best wishes, Xiaoxiang Yu 发件人: Chao Long 答复:

Re: Real-time OLAP - NPE in stream receiver when processing event

Hi Andras, Real-time does not support count-distinct with non-integer datatype column yet, is there a count-distinct measure with non-integer datatype column? On Tue, Sep 3, 2019 at 10:38 PM Andras Nagy wrote: > Dear All, > > We seem to have run into an issue with real-time streaming (in the

Real-time OLAP - NPE in stream receiver when processing event

Dear All, We seem to have run into an issue with real-time streaming (in the stream-receiver). We get a NPE in the StreamingConsumerChannel thread when an event is received from Kafka: 2019-09-03 13:50:59,341 ERROR [object_movements_channel] consumer.StreamingConsumerChannel:119 : error happens

Please use English as the primary language

Hello Kylin user and developers, As an Apache project, the Kylin community has people all around the world: Asia, Euro, America, and other regions; English should be the primary and recommended language for wider discussion and communication. This is not mandatory; If you have difficult to write

Re: 事实表历史数据的更新，如何更新cube

Kylin 的框架模式是基于预计算的，在涉及数据回填这块算是先天软肋。 这个问题很早之前提过，一直没有人响应。 在 2019年9月3日，下午6:00，王刚 mailto:m...@wanggang1987.com>> 写道： Hi Liu, Thank you for your kind guidance. 刷新数据存在一个问题：当更新旧数据时，是否需要计算从最老到最新的所有数据集。 探讨下这个场景，20190701这个时间区间的订单，在20190901发生了支付状态的更新，那么在计算指标时，应该将20190701和20190901重跑。

Re: 事实表历史数据的更新，如何更新cube

Hi Liu, Thank you for your kind guidance. 刷新数据存在一个问题：当更新旧数据时，是否需要计算从最老到最新的所有数据集。 探讨下这个场景，20190701这个时间区间的订单，在20190901发生了支付状态的更新，那么在计算指标时，应该将20190701和20190901重跑。 但是我无法知道20190801更新的数据，是否也有涉及到20190701时间区间的数据。 是否意味着，我需要将

Re: 事实表历史数据的更新，如何更新cube

数据回填（write-back）目前是不支持的，也不在计划上。 做到更高效的历史数据更新，就是要尽量不重刷无变化的数据，而变化的数据总要重新刷新。Kylin刷新的单位是Segment。如果不需要“支付”“开票”“创建”之间的关联计算，可以把这些字段拆在不同的Cube中，分别做Partition字段，刷新的时候要重刷新旧两个时间段。但这个可能的潜在风险是不同Cube之间，数据的不一致。 一般来说，数据的更新具备冷热属性，即热数据经常更新，冷数据不更新，因此可以针对冷热，设计不同规模的Segment，减少刷新时的复杂度。 With Warm regards Billy Liu

fail to open web -- exception class path resource [ehcache-test.xml] cannot be opened because it does not exist

before i change kylin.properties , everything work ok ~ but after i change kylin.properties to this , web ui not work. export KYLIN_JVM_SETTINGS="-Xms16g -Xmx16g -XX`MaxPermSize=512m -XX`NewSize=3g -XX`MaxNewSize=3g -XX`SurvivorRatio=4 -XX`+CMSClassUnloadingEnabled

Re: Real-time OLAP - NPE in StreamingBuildJobStatusChecker

Hi Andras, If I make no mistake ,I guess you have a code change and build Kylin yourself (because Jar ended with 3.0.0-SNAPSHOT). And NPE occur at Coordinator.java:1372, what it is the code of Line 1372 exactly? Could you please show us your code with line number (Coordinator.java)? Thank

Real-time OLAP - NPE in StreamingBuildJobStatusChecker

Dear All, We have run into an issue releated to the real-time OLAP feature. At some point the streaming_job_status_checker-thread started to fail with a NullPointerException on getting the streaming segment's job build state, and it never recovers from this issue. As a result, it seems like from

Re: Error: Failed to find metadata store by url: kylin_metadata@hbase

Hi, It looks strange. From https://github.com/apache/kylin/blob/0d5f85b0a40c301134122de927204a0d17ad65fa/core-common/src/main/java/org/apache/kylin/common/persistence/ResourceStore.java#L89, we can infer the field “clsName” is Line 89 is null in your env, which should be impossible. Because

Re: Error: Failed to find metadata store by url: kylin_metadata@hbase

If you are familiar with docker, try docker for kylin, see: http://kylin.apache.org/docs/install/kylin_docker.html > 在 2019年9月3日，13:51，Nikita Agrawal 写道： > > Hi Team, > > I am new to Kylin. I have installed Kylin 2.6.3 using below

Error: Failed to find metadata store by url: kylin_metadata@hbase

Hi Team, I am new to Kylin. I have installed Kylin 2.6.3 using below link. http://kylin.apache.org/docs/install/ When I am trying to start Kylin getting below exception. *2019-09-02 00:44:58,245 INFO [main] common.KylinConfig:334 : Use

RE: 事实表历史数据的更新，如何更新cube

这个问题非常具有普遍意义。我司在开发类似财务指标平台的时候也遇到类似问题。 我们不仅需要从Cube里面查询多维度财务指标数据（例如：公司A-华北区-产品A-已支付订单数-1单），有些没有前端系统的汇报单位还要实时填报多维数据（例如：公司A-西南区-产品A-已支付订单数-？？？单）。西南区的负责人填报后需要能够实时汇总到更上一层的区域当中，以供合并查询。 过去我们在Hyperion Essbase中是可以在多维数据库中进行填报的。现在要转型到Kylin，不知填报问题如何解决？请各位大师指点。 谢谢！ 运宁 From: 王刚

Re: 事实表历史数据的更新，如何更新cube

补充一下这个场景： 有事实表orders，以创建时间作为分区，有已支付订单数，已开票订单数两个指标，都以订单创建时间作为统计分区。 order1这条数据，20190801和20190901分别对时间分区为20190701的数据支付时间和开票时间做了更新。 那么20190701这个时间分区的已支付订单数和已开票订单数两个指标都需要更新。 在这个场景中，我们如何进行cube的更新呢 > 在 2019年9月3日，11:44，王刚 写道： > > Hi All > >

Re: Cube building stuck at "Create Intermediate Flat Hive Table"

Did you check the job in YARN resource manager? Is there any job pending for submitting? Sometimes, if YARN doesn't have enough resource, the job will be pending. Best regards, Shaofeng Shi 史少锋 Apache Kylin PMC Email: shaofeng...@apache.org Apache Kylin FAQ:

Re:NullPointerException at Extract Fact Table Distinct Columns

Hi David, It seems that there is dirty data (null value for example) in your hive data source. Best regards, Ni Chunen / George On 06/18/2019 11:33，kisda...@gmail.com wrote： Hi, I am using Kylin 2.6.2 with Hadoop 2.7 (hive-2.1, hbase 1.1.8), and encountered the following problem in

答复: kylin 查询性能

Got it. Thank you very much! 发送自 Windows 10 版邮件应用 发件人: ShaoFeng Shi 发送时间: 2019年9月2日 11:05 收件人: user 抄送: liu.z...@ccfan.com.cn 主题: Re: kylin 查询性能 Yes, it is expected; Most aggregated queries can be returned at 1 second level. Best regards, Shaofeng Shi 史少锋 Apache Kylin PMC Email:

Re: Re: query concurrency

Yes, it depends on the specific scenario. If you can provide the testing scenario, SQL queries, and detailed cube design, then we can discuss it. Best regards, Shaofeng Shi 史少锋 Apache Kylin PMC Email: shaofeng...@apache.org Apache Kylin FAQ: https://kylin.apache.org/docs/gettingstarted/faq.html

Re: Re: query concurrency

But if each SQL statement is different, how much can QPS reach? shicheng31...@gmail.com From: ShaoFeng Shi Date: 2019-09-02 10:52 To: user Subject: Re: query concurrency Hello, Usually, if the cube has been well designed and tunned, one Kylin server can support 50 to 150 QPS. From the

Re: Details about “Extract Fact Table Distinct Columns and Build Dimension Dictionary”

This article can help, to some extend: https://kylin.apache.org/docs/howto/howto_optimize_build.html Best regards, Shaofeng Shi 史少锋 Apache Kylin PMC Email: shaofeng...@apache.org Apache Kylin FAQ: https://kylin.apache.org/docs/gettingstarted/faq.html Join Kylin user mail group:

Re: query concurrency

Hello, Usually, if the cube has been well designed and tunned, one Kylin server can support 50 to 150 QPS. From the Cisco team's experience, with enabling some advanced features like query cache and prepared statement, one Kylin server can support up to 500 QPS:

<    5   6   7   8   9   10   11   12   13   14   >