Re: Error on EMR

2019-12-06 Thread ShaoFeng Shi
Hi Tanmay, Could you share how did you fix the problem? We can update the document if it missed something. Thanks! Best regards, Shaofeng Shi 史少锋 Apache Kylin PMC Email: shaofeng...@apache.org Apache Kylin FAQ: https://kylin.apache.org/docs/gettingstarted/faq.html Join Kylin user mail group:

Re: Releasing Apache Kylin v3.0-GA

2019-12-06 Thread ShaoFeng Shi
Looking forward to the 3.0 GA release; Many users already asked me in private. They want to try this asap. Best regards, Shaofeng Shi 史少锋 Apache Kylin PMC Email: shaofeng...@apache.org Apache Kylin FAQ: https://kylin.apache.org/docs/gettingstarted/faq.html Join Kylin user mail group:

Re: Releasing Apache Kylin v3.0-GA

2019-12-06 Thread Andras Nagy
Great news, and congratulations to the realtime OLAP team to achieving GA status of the feature! And of course, to everyone else working on the release, but I'm really grateful to Xiaoxiang for the help he offered us in realtime OLAP. On Fri, Dec 6, 2019 at 4:11 AM Xiaoxiang Yu wrote: > Good

Re: Need advice and best practices for Kylin query tuning (not cube tuning)

2019-12-06 Thread Andras Nagy
Hi All, Thanks a lot, guys! With your generous help Xiaoxiang we have been able to track down the problem, it was mostly related to too large segments with not enough regions, so low level of parallelism in the HBase side. Now the p95 of query latency is acceptable for the time being, although we

Re: Releasing Apache Kylin v3.0-GA

2019-12-05 Thread Xiaoxiang Yu
Good news, I cannot wait to the next generation of Kylin. Best wishes, Xiaoxiang Yu 发件人: George Ni 答复: "user@kylin.apache.org" 日期: 2019年12月6日 星期五 10:25 收件人: "user@kylin.apache.org" , "d...@kylin.apache.org" 主题: Releasing Apache Kylin v3.0-GA Hi Community, As we have

Re: Error on EMR

2019-12-05 Thread Xiaoxiang Yu
Hi Tanmay, Thank you for your update, and I am glad to hear that you have finally fixed your issue. Best wishes, Xiaoxiang Yu 发件人: Tanmay Movva 日期: 2019年12月6日 星期五 01:51 收件人: Xiaoxiang Yu 主题: Re: Error on EMR Hey Xiaoxiang, Thank you so much. This worked for me. Also

Releasing Apache Kylin v3.0-GA

2019-12-05 Thread George Ni
Hi Community, As we have released v3.0-alpha, v3.0-alpha2, v3.0-beta, we have enough cofidence to release the GA version for v3.0 next week, and I’m planning to create a branch for its release. Detail features, improvements and bug fixes will come later, the main features are: 1. Realtime

how does cube retention range work

2019-12-05 Thread Lu, Kang-Sen
I am running kylin 2.6.3. In kylin GUI configuring cube, at step "Refresh Setting", we can specify "Retention Threshold", say, 30 (days). How would kylin automatically remove cube segments that is older than 30 days? I searched kylin source code, it seems that kylin does save "retentionRange"

Re: Huge number of dimensions

2019-12-05 Thread Support DrakosData
Hi When you are working with many dimension you need works with Derived Dim is mandatory BR, Alberto On 5/12/19 12:52, Yaqian Zhang wrote: Hi Noureddine:        The max physical dimension number (exclude derived column in lookup tables) in a cube is 63; If you can normalize some

Re: Huge number of dimensions

2019-12-05 Thread Yaqian Zhang
Hi Noureddine: The max physical dimension number (exclude derived column in lookup tables) in a cube is 63; If you can normalize some dimensions to lookup tables, with derived dimensions, you can create a cube with more than 100 dimensions. But a cube with > 30 physical

Huge number of dimensions

2019-12-04 Thread Noureddine Dahmane
Hello, i am trying to create a cube in kylin with the following Star schema: - fact table: click with 32 measures - dimension tables: - brand : 2 columns - campaign: 8 columns - traffic_source: 11 columns - shop_source: 40 columns - traffic_source: 4 columns - category; 8

Re:Kylin, Druid and Grafana?

2019-12-03 Thread nichunen
Hi Khalil, Good topic! As I know, there is no plugin for Kylin in Grafana currently. And for your thinking, I think there is no plugin or adaptor in Druid for linking with Kylin as a source now. Maybe other friends have better ideas, I’m waiting for their replies. Best regards, Ni

Kylin, Druid and Grafana?

2019-12-03 Thread Khalil Mejdi
Hello Kyliners [My Problem] Apache Kylin is a powerful OLAP, and such a thing always needs something to show and display its power in a beautiful way, We are using Grafana and we all know that grafana is a thing and I believe both working together would be something amazing, I looked around to

Re:Re: kylin多个子查询嵌套导致查询速度严重变慢(几十秒)

2019-12-02 Thread Johnson
非常感谢您的回复,您的意思是所有模型都做成大宽表的形式(但是这样join的功能就感觉形同虚设)。但是实际业务场景,不可避免多个cube的子查询结果进行join。 我的疑惑是为什么这些子查询不能并行的去执行?串行的话确实很慢。 再次感谢您的回复! 在 2019-11-30 18:19:19,"ShaoFeng Shi" 写道: Hi Johnson, This is a good observation. For a single cube's query, Kylin can dispatch that to HBase for in parallel

Re: Re: Re: kylin

2019-12-02 Thread 肖培栋
谢谢,是这个原因。已经解决 发件人:ShaoFeng Shi 发送时间:2019-12-02 17:56 主题:Re: Re: kylin 收件人:"user" 抄送: Hi, I think TIME is a keyword in Calcite SQL; Please use "TIME" (with the double quotation) to escape (用大写加双引号进行转义). Best regards, Shaofeng Shi 史少锋 Apache Kylin PMC Email: shaofeng...@apache.org

Re: Re: kylin

2019-12-02 Thread ShaoFeng Shi
Hi, I think TIME is a keyword in Calcite SQL; Please use "TIME" (with the double quotation) to escape (用大写加双引号进行转义). Best regards, Shaofeng Shi 史少锋 Apache Kylin PMC Email: shaofeng...@apache.org Apache Kylin FAQ: https://kylin.apache.org/docs/gettingstarted/faq.html Join Kylin user mail

Re: Re: kylin

2019-12-02 Thread 肖培栋
在我执行查询的时候,出现这个问题,别的字段可以查询,time这个字段不行(类型是timestamp) SQL: SELECT TIME,COUNT(*) FROM WX_CLICKS GROUP BY TIME User: ADMIN Success: false Duration: 0.009 Project: kylin_qrcode Realization Names: [] Cuboid Ids: [] Total scan count: 0 Total scan bytes: 0 Result row count: 0 Accept Partial: true Is

Re: kylin

2019-12-02 Thread ShaoFeng Shi
Hi xiaodong, In the FAQ page (https://kylin.apache.org/docs/gettingstarted/faq.html), there is a similar question: "The query result is not exactly matched with that in Hive, what’s the possible reason?" You can search and check that if not. Hope it can help. Best regards, Shaofeng Shi 史少锋

Re: [ANNOUNCE] Please welcome Chunen Ni to the Apache Kylin PMC

2019-12-01 Thread JiaTao Tao
Congratulations! -- Regards! Aron Tao ShaoFeng Shi 于2019年12月1日周日 上午10:47写道: > On behalf of the Apache Kylin PMC, I am pleased to announce that Chunen Ni > has accepted our invitation to become a PMC member on the Kylin project. We > appreciate Chunen stepping up to take more responsibility

Re: Need advice and best practices for Kylin query tuning (not cube tuning)

2019-12-01 Thread Xiaoxiang Yu
Hi andras, I would like to share what I find. There are several step in query execuation, you can find some log which can indicate the start an end of these steps, that will help to you find which step cost a lot time. Step 1. Check SQL ACL and grammar; and then use Calicate to parse SQL into

Re: [ANNOUNCE] Please welcome Chunen Ni to the Apache Kylin PMC

2019-12-01 Thread Xiaoxiang Yu
Congratulation! Wish to hear more voice from you! Best wishes, Xiaoxiang Yu 发件人: Wang rupeng 答复: "user@kylin.apache.org" 日期: 2019年12月2日 星期一 09:48 收件人: "user@kylin.apache.org" 主题: Re: [ANNOUNCE] Please welcome Chunen Ni to the Apache Kylin PMC Great! Congratulations!

Re: [ANNOUNCE] Please welcome Chunen Ni to the Apache Kylin PMC

2019-12-01 Thread Wang rupeng
Great! Congratulations! --- Best wishes, Rupeng Wang 发件人: Yaqian Zhang 答复: 日期: 2019年12月2日 星期一 09:39 收件人: 主题: Re: [ANNOUNCE] Please welcome Chunen Ni to the Apache Kylin PMC Congratulations! 在 2019年12月1日,14:45,Xiaoyuan Gu mailto:xiaoyuan...@kyligence.io>> 写道: Big congrats

Re: [ANNOUNCE] Please welcome Chunen Ni to the Apache Kylin PMC

2019-12-01 Thread Yaqian Zhang
Congratulations! > 在 2019年12月1日,14:45,Xiaoyuan Gu 写道: > > Big congrats to Chunen! > > Best, > Xiaoyuan > > > xiaoyuan.gu > 邮箱:xiaoyuan...@kyligence.io > >

Re: [ANNOUNCE] Please welcome Chunen Ni to the Apache Kylin PMC

2019-11-30 Thread Xiaoyuan Gu
Big congrats to Chunen! Best, Xiaoyuan

Re: [ANNOUNCE] Please welcome Chunen Ni to the Apache Kylin PMC

2019-11-30 Thread codingfor...@126.com
Congratulations, Chunen, you well deserved ! > 在 2019年12月1日,10:47,ShaoFeng Shi 写道: > > On behalf of the Apache Kylin PMC, I am pleased to announce that Chunen Ni > has accepted our invitation to become a PMC member on the Kylin project. We > appreciate Chunen stepping up to take more

[ANNOUNCE] Please welcome Chunen Ni to the Apache Kylin PMC

2019-11-30 Thread ShaoFeng Shi
On behalf of the Apache Kylin PMC, I am pleased to announce that Chunen Ni has accepted our invitation to become a PMC member on the Kylin project. We appreciate Chunen stepping up to take more responsibility in the Kylin project. Please join me in welcoming Chunen to the Kylin PMC! Best

Re: Unable to create a grouping

2019-11-30 Thread ShaoFeng Shi
I see you already got the reason, from the StackOverflow post. Some additional info from my side: when defining the data model, Kylin will automatically add PK/FK to the dimension list. That explains why you explicitly removed STORESALES.ID but it still appears as a dimension. When adding

Re: why kylin.engine.mr.config-override not work

2019-11-30 Thread ShaoFeng Shi
Are the two cubes very similar to each other? You mentioned that the bigger cube has one more step "extract dictionary", does that cube has a "count distinct (precisely)" measure, but the other doesn't have? Which job step didn't have the "mapreduce.input.fileinputformat.split.minsize" parameter

Re: 回复: The results return some fields empty. But when I tried in hive with the same query, I got what I wanted to get.

2019-11-30 Thread ShaoFeng Shi
Hi Qiuyin, I see this problem also be reported by another user in another thread. And Xiaoxiang has replied that currently there is a limitation in Kylin for Hadoop 3 (as well as HDP 3.1): if the lookup table in Hive enabled the ACID feature, Kylin couldn't load that lookup table into Kylin,

Re: kylin多个子查询嵌套导致查询速度严重变慢(几十秒)

2019-11-30 Thread ShaoFeng Shi
Hi Johnson, This is a good observation. For a single cube's query, Kylin can dispatch that to HBase for in parallel computing, which usually is sub-seconds. When there are multiple sub-queries together, Kylin will execute these sub-queries in sequence. After getting the result back to the Kylin

Re: Need advice and best practices for Kylin query tuning (not cube tuning)

2019-11-30 Thread ShaoFeng Shi
Hi Andras, Is this specific to real-time streaming, or it is also related to the normal batch cube? I want to narrow down the scope. Besides, how complex the queries are? I think that may need more inputs. If you can bring some sample queries that would help to some extend. Best regards,

Re: Fw: kylin reload hive table

2019-11-30 Thread ShaoFeng Shi
Not missing jar, but the jar is incompatible. What's your Hadoop distribution and version? Please check whether there are different version of hive-metastore-.jar on your Kylin node. Best regards, Shaofeng Shi 史少锋 Apache Kylin PMC Email: shaofeng...@apache.org Apache Kylin FAQ:

Re: kylin构建立方体时总是自动关闭

2019-11-30 Thread ShaoFeng Shi
Please check the error log in the backend. Besides, please also run metadata cleanup job periodically, if there are many history jobs. Best regards, Shaofeng Shi 史少锋 Apache Kylin PMC Email: shaofeng...@apache.org Apache Kylin FAQ: https://kylin.apache.org/docs/gettingstarted/faq.html Join Kylin

Re: kylin构建立方体时总是自动关闭

2019-11-29 Thread codingfor...@126.com
Please check the error/exception information in the log file $KYLIN_HOME/logs/kylin.log > 在 2019年11月29日,20:48,wangweilin 写道: > > 在构建立方体时总出现这个错误,刷新后页面打不开,需要重新启动kylin。 > kylin版本2.6.3 > hadoop 2.7.1 > hbase 1.2.5 > hive 1.2.1 > > > > wangweilin > sdnuwangwei...@163.com > >

kylin构建立方体时总是自动关闭

2019-11-29 Thread wangweilin
在构建立方体时总出现这个错误,刷新后页面打不开,需要重新启动kylin。 kylin版本2.6.3 hadoop 2.7.1 hbase 1.2.5 hive 1.2.1 | | wangweilin | | sdnuwangwei...@163.com | 签名由网易邮箱大师定制

Fw: kylin reload hive table

2019-11-29 Thread 肖培栋
| | 肖培栋 | | 邮箱:xiaopeidong1...@163.com | 签名由 网易邮箱大师 定制 - Forwarded Message - From: 肖培栋 Date: 11/29/2019 17:38 To: 15192081379 Subject: kylin reload hive table 在reload table的时候: 这是少jar包吗??

回复:启动kylin

2019-11-29 Thread 肖培栋
版本问题,我的hbase版本是2.0+,但是会hadoop的版本不是3.0+,最后下载的hadoop3版本的kylin启动成功 | | 肖培栋 | | 邮箱:xiaopeidong1...@163.com | 签名由 网易邮箱大师 定制 在2019年11月29日 17:13,肖培栋 写道: 没有生成kylin.log这个文件 | | 肖培栋 | | 邮箱:xiaopeidong1...@163.com | 签名由 网易邮箱大师 定制 在2019年11月29日 16:38,Yaqian Zhang 写道: Hi: After kylin starts

回复:启动kylin

2019-11-29 Thread 肖培栋
没有生成kylin.log这个文件 | | 肖培栋 | | 邮箱:xiaopeidong1...@163.com | 签名由 网易邮箱大师 定制 在2019年11月29日 16:38,Yaqian Zhang 写道: Hi: After kylin starts successfully, it will generate kylin.log on ${KYLIN_HOME}/logs/kylin.log,you can check log’s content to find root cause. 在 2019年11月29日,16:13,肖培栋 写道:

Re: 启动kylin

2019-11-29 Thread Yaqian Zhang
Hi: After kylin starts successfully, it will generate kylin.log on ${KYLIN_HOME}/logs/kylin.log,you can check log’s content to find root cause. > 在 2019年11月29日,16:13,肖培栋 写道: > > > > > 肖培栋 > 邮箱:xiaopeidong1...@163.com > >

转发:启动kylin

2019-11-29 Thread 肖培栋
| | 肖培栋 | | 邮箱:xiaopeidong1...@163.com | 签名由 网易邮箱大师 定制 - 转发的邮件 - 发件人: 肖培栋 发送日期: 2019年11月29日 16:13 收件人: 15192081379 主题: 启动kylin 我使用Hadoop集群安装kylin, 提示我启动了,但是无法访问web页面,怎么查找问题,在哪里看错误日志呢?

Re: kafak数据老孺到kylin,采用spark引擎进行计算存在问题

2019-11-28 Thread ShaoFeng Shi
The pic 1 shows the spark job is running, no exception there. If you noticed a spark job was failed, please start the spark history server to check more logs there. Please remember to use the same log folder (/kylin/spark-history) as kylin.properties. Best regards, Shaofeng Shi 史少锋 Apache Kylin

Re:Re: kylin 配置后仍无法通过hue访问

2019-11-27 Thread qmw
我们使用的是cdh上集成的hue,不是用docker容器装载的。 我直接在hue的web端界面中的ini 高级配置处添加了 dbproxy_extra_classpath=/hue/kylin-jdbc-2.4.1.jar # One entry for each type of snippet. [[interpreters]] # Define the name and how to connect and execute the language. [[[kylin]]] name=kylin JDBC

Re: kylin 配置后仍无法通过hue访问

2019-11-26 Thread Yaqian Zhang
Theoretically, the server where hue is located can access kylin's server is OK. Maybe official website documents is too old, you can refer to this document for help: https://www.jianshu.com/p/7ca176b19e35 > 在 2019年11月26日,18:36,qmw 写道: > >

Re:Re: kylin 配置后仍无法通过hue访问

2019-11-26 Thread qmw
kylin 2.4.1 hue3.9.0+cdh5.16.2 我设置了 $CLASSPATH为kylin-2.4.1-jdbc-jar 我重启hue后,kylin.log里面没有jdbc关键字的日志出现,重启那段时间的kylin日志也没有相关内容出现 我怀疑是没有调起jdbc这个jar包,但是我是按照这个官方文档来的,虽然hue和kylin不在一个服务器上,但这个应该不影响吧 "jdbc:kylin://172.17.0.2:7070/learn_kylin" 我把这一段的ip改成kylin所在服务器的地址的 At 2019-11-26 19:01:17, "Yaqian

Re: kylin 配置后仍无法通过hue访问

2019-11-26 Thread Yaqian Zhang
Hi qmw: Is there have some error log in kylin.log? Could you provide your kylin version and hue version? Whether the corresponding version of JDBC jar package is used? > 在 2019年11月26日,18:36,qmw 写道: > > 在参考http://kylin.apache.org/docs21/tutorial/hue.html >

unsubscribe

2019-11-26 Thread @Nandan@
unsubscribe

kylin 配置后仍无法通过hue访问

2019-11-26 Thread qmw
在参考http://kylin.apache.org/docs21/tutorial/hue.html这个文档设置时,设置了[[[kylin]]] name=kylin JDBC interface=jdbc options='{"url": "jdbc:kylin://172.17.0.2:7070/learn_kylin","driver": "org.apache.kylin.jdbc.Driver", "user": "ADMIN", "password": "KYLIN"}' 在hue web端配置的高级配置代码段之后,会导致 impala

Re: metastore clean OutOfMemoryError

2019-11-26 Thread ShaoFeng Shi
Thanks to Temple for the sharing! Best regards, Shaofeng Shi 史少锋 Apache Kylin PMC Email: shaofeng...@apache.org Apache Kylin FAQ: https://kylin.apache.org/docs/gettingstarted/faq.html Join Kylin user mail group: user-subscr...@kylin.apache.org Join Kylin dev mail group:

unsubscribe

2019-11-26 Thread bbs
unsubscribe

kylin 配置后仍无法通过hue访问

2019-11-25 Thread qmw
在参考http://kylin.apache.org/docs21/tutorial/hue.html这个文档设置时,设置了[[[kylin]]] name=kylin JDBC interface=jdbc options='{"url": "jdbc:kylin://172.17.0.2:7070/learn_kylin","driver": "org.apache.kylin.jdbc.Driver", "user": "ADMIN", "password": "KYLIN"}' 在hue web端配置的高级配置代码段之后,会导致 impala

?????? metastore clean OutOfMemoryError

2019-11-22 Thread MrWell
Hi Temple Zhou, Thanks!!! i have solved it. I think u r right. ---- ??:"Temple Zhou"https://kylin.apache.org/docs/gettingstarted/faq.html Join Kylin user mail group: user-subscr...@kylin.apache.org Join Kylin dev mail group:

?????? ?????? metastore clean OutOfMemoryError

2019-11-22 Thread MrWell
Thanks!!! it dose work! ---- ??:"Marc Wu -X (mawu2 - Insigma Hengtian at Cisco)"http://www.apache.org/licenses/LICENSE-2.0 # # Unless required by applicable law or agreed to in writing, software # distributed under the License is distributed

Re: metastore clean OutOfMemoryError

2019-11-22 Thread Temple Zhou
Hi MrWell, You should set the KYLIN_EXTRA_START_OPTS instead of KYLIN_JVM_SETTINGS exec hbase ${KYLIN_EXTRA_START_OPTS} > -Dkylin.hive.dependency=${hive_dependency} > -Dkylin.hbase.dependency=${hbase_dependency} > -Dlog4j.configuration=file:${KYLIN_HOME}/conf/kylin-tools-log4j.properties > "$@"

Re: 回复: metastore clean OutOfMemoryError

2019-11-22 Thread Marc Wu -X (mawu2 - Insigma Hengtian at Cisco)
Sorry for my mistake, can you move the setenv-tool.sh to the $KYLIN_HOME/bin and try again? From: MrWell Reply-To: "user@kylin.apache.org" Date: Friday, November 22, 2019 at 16:24 To: user Subject: 回复: metastore clean OutOfMemoryError Hi Mrac Wu, Thanks, I have tried it, but it failed.

?????? metastore clean OutOfMemoryError

2019-11-22 Thread MrWell
Hi Shaofeng Shi, I have setKYLIN_JVM_SETTINGS="-Xms16g -Xmx16g"in setenv.sh, but it fail. Can metadata be larger than 16g? Thanks for reply. ---- ??:"ShaoFeng Shi"https://kylin.apache.org/docs/gettingstarted/faq.html Join Kylin user mail group:

?????? metastore clean OutOfMemoryError

2019-11-22 Thread MrWell
Hi Mrac Wu, Thanks, I have tried it, but it failed. ---- ??:"Marc Wu -X (mawu2 - Insigma Hengtian at Cisco)"http://www.apache.org/licenses/LICENSE-2.0 # # Unless required by applicable law or agreed to in writing, software # distributed

Re: metastore clean OutOfMemoryError

2019-11-21 Thread ShaoFeng Shi
Excellent Marc! Best regards, Shaofeng Shi 史少锋 Apache Kylin PMC Email: shaofeng...@apache.org Apache Kylin FAQ: https://kylin.apache.org/docs/gettingstarted/faq.html Join Kylin user mail group: user-subscr...@kylin.apache.org Join Kylin dev mail group: dev-subscr...@kylin.apache.org Marc Wu

Re: metastore clean OutOfMemoryError

2019-11-21 Thread ShaoFeng Shi
hi Huangpeng, I guess your JVM heap is small or your Kylin metadata is big. You can try to increase the java heap in "bin/setenv.sh" Best regards, Shaofeng Shi 史少锋 Apache Kylin PMC Email: shaofeng...@apache.org Apache Kylin FAQ: https://kylin.apache.org/docs/gettingstarted/faq.html Join Kylin

Re: metastore clean OutOfMemoryError

2019-11-21 Thread Marc Wu -X (mawu2 - Insigma Hengtian at Cisco)
Hi MrWell, You can try to create a file named setenv-tool.sh in the $KYLIN_HOME/conf directory, and put the following content in the file, then execute your command. It may solve your issues. #!/bin/bash # # Licensed to the Apache Software Foundation (ASF) under one or more # contributor

metastore clean OutOfMemoryError

2019-11-21 Thread MrWell
Hi, Kylin Team. When I execute "bin/metastore.sh clean --delete true" , I get a "OutOfMemoryError" like this java.lang.OutOfMemoryError: Java heap space Dumping heap to java_pid4839.hprof ... Heap dump file created [317991670bytes in 2.120 secs] # # java.lang.OutOfMemoryError: Java heap space

Re: when query,load/remove dict 耗时严重的问题

2019-11-21 Thread Wang rupeng
Hi, You can try to add property kylin.dictionary.max-cache-entry with value bigger than 3000(the default) in $KYLIN_HOME/conf/kylin.properties . --- Best wishes, Rupeng Wang 发件人: Johnson 答复: 日期: 2019年11月21日 星期四 11:40 收件人: "user@kylin.apache.org" 主题: when

when query,load/remove dict 耗时严重的问题

2019-11-20 Thread Johnson
hi,all 最近我在追查慢查询的问题:发现在查询的时候加载dict耗时很长,而且为什么会在查询的时候删除某些系统cube的dict,耗时多达10s,严重影响查询速度 Dict with resource path /dict/KYLIN.HIVE_METRICS_QUERY_RPC_QA/KDAY_DATE/8a4b4c8f-2e81-3ec3-74f1-95dad914745b.dict is removed due to SIZE 如图:

Re: kafak数据老孺到kylin,采用spark引擎进行计算存在问题

2019-11-20 Thread Yaqian Zhang
Hi: The figure 1 does not seem to reflect any error information, could you provide more error log? And which step this error occur? > 在 2019年11月21日,00:27,gaofeng5...@capinfo.com.cn 写道: > > > > > > > > > 以上的spark的配置在cube构建的时候采用官方的kafka数据到kylin,总是存在图一的问题,这个怎么解决,谢谢。 >

when i execute "metastore.sh clean", i get a "OutOfMemoryError"

2019-11-19 Thread MrWell
Hi, Kylin Team. when i execute "bin/metastore.sh clean --delete true" , i get a "OutOfMemoryError" like this java.lang.OutOfMemoryError: Java heap space Dumping heap to java_pid4839.hprof ... Heap dump file created [317991670 bytes in 2.120 secs] # # java.lang.OutOfMemoryError: Java heap

Re: Error in the third step of building cube

2019-11-15 Thread Xiaoxiang Yu
Hi friend, The third step is a MapReduce Job, the log you provided ("ExitCodeException exitCode=1") didn't show complete error message. Would you please find the yarn application id and check the yarn log by execute command "yarn logs -applicationId abc" to see stacktrace inside MapReduce

kylin多个子查询嵌套导致查询速度严重变慢(几十秒)

2019-11-15 Thread Johnson
由于前端需要将多个指标合并展示,故查询kylin时,一个sql可能会嵌套多个多个子查询。生产环境发现,子查询严重影响查询速度。大家知道什么优化方法吗? 测试如下: 1.计算活跃设备 select count(distinct deviceid) dad from KYLIN_VIEW.KYLIN_VIEW_T_DWA_ACT_XXX_DEVICE_ACTIVE where par_dt>='2019-06-01' and par_dt<='2019-11-15' group by par_dt 2.计算活跃用户 select g.par_dt,count(distinct

?????? ?????? The results return some fields empty. But when I tried in hive with the same query, I got what I wanted to get.

2019-11-13 Thread ??????
Thank you for your reply! Ourinstallation environment is HDP 3.1.0.0. And the dimension tables also can be updated. Is it this model and environment induce the problem? I will appreciate it very much if you konw the solution. Best wishes, Qiuying Mei

Re: 回复: The results return some fields empty. But when I tried in hive with the same query, I got what I wanted to get.

2019-11-13 Thread Xiaoxiang Yu
Hi friend, Do you deploy you Kylin on Hadoop3 env like HDP3? And are your dimension table an ACID transaction table? Best wishes, Xiaoxiang Yu 发件人: 梅秋莹 <3281438...@qq.com> 答复: "user@kylin.apache.org" 日期: 2019年11月13日 星期三 19:19 收件人: user 主题: 回复: The results return some

Re: 转发: kafka数据到kylin,构建cube时报错

2019-11-13 Thread Xiaoxiang Yu
Dear sir, We have face the same issue on HDP3.x, and I have find a workaround at [Try-2] of https://issues.apache.org/jira/browse/KYLIN-3970, you may have a try. Best wishes, Xiaoxiang Yu 发件人: "gaofeng5...@capinfo.com.cn" 答复: "user@kylin.apache.org" 日期: 2019年11月14日

转发: kafka数据到kylin,构建cube时报错

2019-11-13 Thread gaofeng5...@capinfo.com.cn
gaofeng5...@capinfo.com.cn 发件人: gaofeng5...@capinfo.com.cn 发送时间: 2019-11-14 00:13 收件人: user 主题: 这个问题怎么处理 gaofeng5...@capinfo.com.cn

Re: Re:using mySql as metadata storage

2019-11-13 Thread ????????
Get it. it's the only clue i found on the website, it would be marvelous if only the feature could be well supported. anyway, thanks?? ---Original--- From: "AS"http://kylin.apache.org/docs/install/configuration.html#mysql-metastore I think it is not recommended now. Note: This feature is

using mySql as metadata storage

2019-11-13 Thread ????????
hey, may i ask, is now the support using mysql as metadata base stable? I've been looking through kylin official website for some time, but found no more hints in release notes after version 2.5.0, are there any details neglected?? best wishes??

?????? The results return some fields empty. But when I tried in hive with the same query, I got what I wanted to get.

2019-11-13 Thread ??????
Firstly, thank you for your reply! In my cube, I have set SHOP_NAME as a derived dimension. And I also found that all normal dimensions can return correctly, but not all derived dimensions returned results. ---- ??:"Yaqian Zhang"

Re: The results return some fields empty. But when I tried in hive with the same query, I got what I wanted to get.

2019-11-13 Thread Yaqian Zhang
Hi: Did you add SHOP_NAME to the dimension when you create cube? If not, kylin will not save the details of the original table when building the cube, and will return null when querying the column. > 在 2019年11月13日,14:01,梅秋莹 <3281438...@qq.com> 写道: > > 1. Environment: > kylin 2.6.3 > > 2.

Re: kylin_cube_error: java.lang.NullPointerException

2019-11-12 Thread Yaqian Zhang
Hi: It seems that Oozie’s error, You can check that Oozie works normally and integrates properly with kylin. > 在 2019年11月12日,13:55,王文辉 写道: > > job's start time is not reached yet

?????? kylin_cube_error: java.lang.NullPointerException

2019-11-11 Thread ??????
Hi, sir: the before problem has solved, but I meet the new problem, when I set a timing job for Oozie, the Oozie status show PREP, and the log as shown the lower: 2019-11-12 09:28:39,714 WARN org.apache.oozie.command.coord.CoordMaterializeTransitionXCommand: SERVER[cdh1] USER[admin] GROUP[-]

Re: why kylin.engine.mr.config-override not work

2019-11-11 Thread lk_hadoop
can any body give me some clue? 2019-11-12 lk_hadoop 发件人:"lk_hadoop" 发送时间:2019-11-11 21:52 主题:why kylin.engine.mr.config-override not work 收件人:"user","dev" 抄送: hi,all: I have two cube , both config wirh kylin.engine.mr.config-override.mapreduce.input.fileinputformat.split.minsize =

Kylin Hybrids Cont distinct got wrong value

2019-11-07 Thread lk_hadoop
hi , all : I have a Measure with Cont distinct algorithm , when I use a Hybrid ,The Hybrid include two cube, each cube have one years data , I can't get the meaningful result when across two year. -- get each year Cont distinct Measure value SELECT ENT_NAME, ORD_YEAR ,SUM(PAID_IN_AMT)

Re: Re: how to config the ipc timeout

2019-11-07 Thread lk_hadoop
@yaqian_zh...@126.com thank you very much. 2019-11-08 lk_hadoop 发件人:Yaqian Zhang 发送时间:2019-11-07 09:49 主题:Re: how to config the ipc timeout 收件人:"user" 抄送: Hi: You can try to adjust "kylin.metadata.hbase-rpc-timeout" to a larger value in kylin.properties, its default is 5000ms. And

Cube Planner Configuration

2019-11-07 Thread changji guo
Hi all: Can someone explain the meaning of the following configuration? kylin.cube.cubeplanner.expansion-threshold kylin.cube.cubeplanner.recommend-cache-max-size kylin.cube.cubeplanner.query-uncertainty-ratio kylin.cube.cubeplanner.bpus-min-benefit-ratio The official documentation has only

Re: how to config the ipc timeout

2019-11-06 Thread Yaqian Zhang
Hi: You can try to adjust "kylin.metadata.hbase-rpc-timeout" to a larger value in kylin.properties, its default is 5000ms. And then run metadata/StorageCleanup. > 在 2019年11月6日,16:16,lk_hadoop 写道: > > hi,all: > I'm using apache-kylin-2.6.3-bin-cdh57 ,I meet CallTimeoutException: >

how to config the ipc timeout

2019-11-06 Thread lk_hadoop
hi,all: I'm using apache-kylin-2.6.3-bin-cdh57 ,I meet CallTimeoutException: org.apache.kylin.job.exception.PersistentException: org.apache.hadoop.hbase.client.RetriesExhaustedException: Failed after attempts=1, exceptions: Wed Nov 06 11:19:58 GMT+08:00 2019,

?????? cube problem

2019-11-05 Thread ??????
the kylin environment is OK, no error, when I execute the script of ./sample.sh??kylin will build a new project of learn_kylin, when I execute the cube job, can meet the same error as previous , so how toPosition problem?? I don't know Where is the problem with deploying kylin?

Re: cube problem

2019-11-05 Thread codingfor...@126.com
It is recommended to execute the script in the $KYLIN_HOME/bin directory to detect whether the kylin environment and dependencies are properly deployed, including: check-env.sh check-hive-usability.sh check-port-availability.sh find-hadoop-conf-dir.sh find-hbase-dependency.sh

Re: one problem about build cube at step 3(build dimension dictionary)

2019-11-05 Thread codingfor...@126.com
Is there resource available for the yarn cluster/queue? > 在 2019年11月6日,10:19,qmw 写道: > > when I build cube at build dimension dictionary ,the job is working at the > step forever,but there is no error showing . and in kylin.log,also show > nothing about this. > <捕获.PNG> > > >

?????? cube problem

2019-11-05 Thread ??????
Hello, Sir: I have configured a set of kylin in the demo environment and production environment, and none of them are configured with kylin.properties. The kylin of the production environment does not report an error when running the task, but the demo environment will show me the error.

Re: cube problem

2019-11-05 Thread Yaqian Zhang
Hi sir: This article on the official website mentions the problem you have encountered. http://kylin.apache.org/blog/2016/06/10/standalone-hbase-cluster/ . You can try again in the following way. > 在 2019年11月6日,09:22,王文辉

cube problem

2019-11-05 Thread ??????
All executing command of hdfs no problems , The job log of Cube as follows: java.lang.IllegalArgumentException: Wrong FS: hdfs://nameservice1/kylin_metadata/kylin-..., excepted: hdfs://node111a11:8020 at org. apache hadoop. fs File System. checkPath(Filesystem. java: 662) at org. apache hadoop

Re: kylin cube job

2019-11-05 Thread codingfor...@126.com
It looks like your hdfs configuration is incorrect, will executing the `hdfs dfs -ls /` command succeed? > 在 2019年11月5日,20:07,王文辉 > 写道: > > when I use kylin scheduling cue,I meeting the following error: > java.lang.IllegalArgumentException: Wrong FS: >

kylin cube job

2019-11-05 Thread ??????
when I use kylin scheduling cue??I meeting the following error: java.lang.IllegalArgumentException: Wrong FS: hdfs://nameservice1/kylin/,expected:hdfs://nodexxx:8020 return code:2 if you can solve my question , I will thank for you.

?????? No registered coprocessor service found for name CubeVisitService in region

2019-11-05 Thread 1510603449
hello?? thank you?? the Hbase coprocessor really isn't loaded for the Hbase table ??Specific cubebut commitInfo is same?? So??the shell command like this "$KYLIN_HOME/bin/kylin.sh org.apache.kylin.storage.hbase.util.DeployCoprocessorCLI $KYLIN_HOME/lib/kylin-coprocessor-*.jar all

Re: A question about the hierarchy dimension in kylin

2019-11-05 Thread Xiaoxiang Yu
Hi Sir, Could you please show us the following information which may help us to reproduce the problem: 1. CubeDesc(a json file) which show us how you design your cube 2. Your Hadoop version 3. Your Kylin version 4. Output of executing “./kylin.sh

Re: No registered coprocessor service found for name CubeVisitService in region

2019-11-05 Thread Yaqian Zhang
Hello: We have tested that kylin works well in this environment. You can check the region server log to see if the Hbase coprocessor is loaded successfully. > 在 2019年11月5日,11:05,1510603449 写道: > > No registered coprocessor service found for

A question about the hierarchy dimension in kylin

2019-11-05 Thread changji guo
Hi : I encountered a question during choosing hierarchy dimension to optimize a cube. The scene is as follows: there is a fact table joining a lookup table, I choose the five dimension in the lookup table as a hierarchy group, but after the cube build completed, I found that the hierarchy

????: ?????? No registered coprocessor service found for name CubeVisitService in region

2019-11-04 Thread chengya...@idengyun.com
14:46:53.009 [main] ERROR com.alibaba.druid.pool.DruidDataSource - testWhileIdle is true, validationQuery not set chengya...@idengyun.com 1510603449 ?? 2019-11-05 14:08 user ?? ?? No registered coprocessor service found for name CubeVisitService in region

?????? No registered coprocessor service found for name CubeVisitService in region

2019-11-04 Thread 1510603449
Hello: HBase vsrsion1.2.0+cdh5.11.0 Kylin version 2.6.3.0 ---- ??:"Yaqian Zhang"

Re: No registered coprocessor service found for name CubeVisitService in region

2019-11-04 Thread Yaqian Zhang
Hi: Can you provide the Kylin version and hbase version? It seems that Hbase have some problem. But I’m not sure. > 在 2019年11月5日,11:05,1510603449 写道: > > Hi, > > when I test my kylin use "Quick Start with Sample Cube" , the following > error occurred > > >

No registered coprocessor service found for name CubeVisitService in region

2019-11-04 Thread 1510603449
Hi?? when I test my kylin use "QuickStartwithSampleCube" , the following error occurred ==[QUERY]=== Query Id: 1916851a-591a-5c0a-4b54-817c2456dbc0 SQL: select part_dt, sum(price) as total_sold, count(distinct seller_id) as sellers

Re: 回复: 关于Apache kylin 支持Hadoop 版本的问题

2019-10-31 Thread Xiaoxiang Yu
Dear Sir, We have test Kylin 2.6.4 https://www.apache.org/dyn/closer.cgi/kylin/apache-kylin-2.6.4/apache-kylin-2.6.4-bin-hbase1x.tar.gz and it works well. I think Kylin could run at CDH5.x (CDH5.7 or higher). So your Hadoop env(5.11) should works well. By the way, since Apache Kylin community

?????? ????Apache kylin ????Hadoop ??????????

2019-10-31 Thread 1510603449
Hi?? Thank you very much! ---- ??:"Xiaoxiang Yu"http://github.com/cloudera/hadoop -r a3edabab129caaada2958ab32061aa0e52a3f7df Compiled by jenkins on 2017-02-21T23:08Z Compiled with protoc 2.5.0 From source with checksum

<    4   5   6   7   8   9   10   11   12   13   >