??????????hadoop3??????????bug

2020-09-08 Thread ????
?? == Just do it ! Mobile:18222891890 e-Mail:weishuai0...@126.com ---- ??:

关于hadoop3文件访问的bug

2020-09-08 Thread wuguo1501
在使用kylin3访问hive3的表时,一直会报 duplicate key的错误,但我看了下,表里没有重复key,后来发现是因为hive3有版本备份的功能,每个表会存多个备份文件,kylin3无法只读取最近的一个版本,而是全都读取了,所以会一直出现重复key的问题, 请问这是bug吗,可以用什么方法规避吗?

referenace

2020-09-06 Thread Omid Vahdaty
Hi, I am about to implement kylin on a large scale data set of 10 trillion records. I was wondering if there anyone i can speak to regarding implementation of kylin on a large scale dataset with 10 trillion records. I would like to get a sense of project implementation complexity so I can plan

Re: kylin 1.6 Not sorted! last error when sending select query on ui

2020-09-04 Thread Yaqian Zhang
Hi: You can setting the encoding type to ‘dict’ and rebuild this cube. Then try this SQL again. > 在 2020年9月2日,15:35,nice 写道: > > Hi, my cube set column REPORT_DATE as time encoding when setting rowkeys. > And it was built sucessfully. > > But when i query on ui, it throws error "Not sorted!

??????spack

2020-08-23 Thread ????
mysql jarmysql??jar http://kylin.apache.org/cn/docs/tutorial/mysql_metastore.html ?? == Just do it ! Mobile:18222891890 e-Mail:weishuai0...@126.com

spack

2020-08-23 Thread sundywuyong
build cube的时候包下面的错误,请问如何解决,谢谢

Some query problems with kylin

2020-08-20 Thread tc...@uhome24.com
Hello! I met some problems when i execute sql in kylin insight。 When i execute the sql below: SELECT CITY, GOODS_CODE, SUM(SALES_AMT) AMT FROM PRO.FCT_GOODS_CITY_PROFILE WHERE "DAY" BETWEEN '2020-08-09' AND '2020-08-15' AND CITY IN ('武汉') AND GOODS_CODE IN

Re: kylin

2020-08-19 Thread Richard hu
Please provide the steps that can reproduce the issue... On 2020/08/11 09:21:09, sundywuyong wrote: > 您好,我在kylin.中设置了kylin.properties中设置source.jdbc.sqoop-home的地址:/home/admin/sqoop-1.4.7.bin__hadoop-2.6.0,然后在cube列表中重新Resume之后,还是报错,错误显示找不到目录,具体配置和错误如下图所示: > 期待您的回复,谢谢

Re: Kylin 2.6.4是否能升级为3.1.0

2020-08-19 Thread Richard hu
可以的吧,可以参考http://kylin.apache.org/docs/howto/howto_upgrade.html On 2020/08/18 08:46:33, "1092465...@qq.com" <1092465...@qq.com> wrote: > > Hi,各位,想问一下各位Kylin2.6.4是否可以升级到3.1.0版本的?版本是基于CDH6的 > > >

回复: 回复:Kylin 2.6.4是否能升级为3.1.0

2020-08-19 Thread 1092465...@qq.com
谢谢。 之前也看了这个链接,但是看到有几个版本升级要手动执行下命令,有些顾虑。 昨天尝试升级,已经升级成功了。 发件人: bai_hong...@sina.com 发送时间: 2020-08-18 23:24 收件人: user@kylin.apache.org 主题: 回复:Kylin 2.6.4是否能升级为3.1.0 应该是可以的。具体可以参考:http://kylin.apache.org/docs/howto/howto_upgrade.html - 原始邮件 - 发件人:"1092465...@qq.com" <1092465...@qq.com>

Some query problems with kylin

2020-08-19 Thread tc...@uhome24.com
I meet some problems when i execute sql in kylin insight。 When i execute the sql below: SELECT CITY, GOODS_CODE, SUM(SALES_AMT) AMT FROM PRO.FCT_GOODS_CITY_PROFILE WHERE "DAY" BETWEEN '2020-08-09' AND '2020-08-15' AND CITY IN ('武汉') AND GOODS_CODE IN

回复:Kylin 2.6.4是否能升级为3.1.0

2020-08-18 Thread bai_hongbin
应该是可以的。具体可以参考:http://kylin.apache.org/docs/howto/howto_upgrade.html - 原始邮件 - 发件人:"1092465...@qq.com" <1092465...@qq.com> 收件人:user 主题:Kylin 2.6.4是否能升级为3.1.0 日期:2020年08月18日 20点10分 Hi,各位,想问一下各位Kylin2.6.4是否可以升级到3.1.0版本的?版本是基于CDH6的

Kylin 2.6.4是否能升级为3.1.0

2020-08-18 Thread 1092465...@qq.com
Hi,各位,想问一下各位Kylin2.6.4是否可以升级到3.1.0版本的?版本是基于CDH6的

Re: 问题

2020-08-13 Thread Yaqian Zhang
You can try execute ‘export SQOOP_HOME=/home/admin/sqoop-1.4.7.bin__hadoop-2.6.0/‘ and start kylin in the same shell. Then kylin will get $SQOOP_HOME from the environment variable, you can use this method replace that config kylin.source.jdbc.sqoop-home in kylin.properties. > 在

Re: 【Asking for help】how to build measures " sum(A+B)"

2020-08-13 Thread Yaqian Zhang
Hi: Kylin does not support precomputation between columns. If you want to perform aggregate operation (such as sum) on the results of adding two columns, you can define a column z = x * y in hive table, and then define sum (z) in kylin as a measure. If you don't want to add a column to the

Re: RAM alloaction

2020-08-13 Thread Yaqian Zhang
Hi: Do you use this method to configure the yarn parameter in Kylin? > 在 2020年8月13日,19:55,Omid Vahdaty 写道: > > HI, > > Just installed kyling using docker. > > I performed a job and got a reduce error > > i have tried increasing the amount of RAM configuration for yarn get same > error > >

RAM alloaction

2020-08-13 Thread Omid Vahdaty
HI, Just installed kyling using docker. I performed a job and got a reduce error i have tried increasing the amount of RAM configuration for yarn get same error i twould seem that regardless of what i configure i keep getting yarn total moery 6GB and total vcores 4, even though u have 40 cores

?????? decimal??19??2?? measure original value is loss

2020-08-13 Thread ????
has resolved , no reply ---- ??: ""

?????? decimal??19??2?? measure original value is loss

2020-08-13 Thread ????
thks for U reply. column ??entrust_balance?? be added to model as a dimension?? andadd measures like sum,max,top as example??the return type is decimal(19,2) ?? SHOW ASdimension??; after build cube success; if query sum(entrust_balance) then return success ; sum return xx.00 max return xx

Re: 转发:How to modify the time zone of hive ? 请问怎么修改hive的时区?

2020-08-12 Thread Rupeng Wang
Hi, Refer to the answer of Cloudera Community , before hive3, you can change the default time zone of hive by changing the time zone of JVM. For Hive3(maybe not your option), refore to the Hive JIRA, https://issues.apache.org/jira/browse/HIVE-16614, we can change time zone with command like

Re: decimal(19,2) measure original value is loss

2020-08-12 Thread Yaqian Zhang
HI: Because kylin only stores the aggregated data, not the detailed information of the data source. If ‘entrust_balance’ be added to model as a dimension, you can query detail like select entrust_balance from table xx and get correct result. If you want to query SQL like ’Select * from table’ ,

Re: kylin-start

2020-08-12 Thread Yaqian Zhang
You can replacing localhost with the correct IP address and try again. > 在 2020年8月13日,09:16,sundywuyong 写道: > > 在服务器上部署的kylin,启动之后显示的ip地址是localhost,而不是服务器的ip地址,这个localhost地址在浏览器上打不开,请问这个如何解决,谢谢!详细信息如下图。 > > > > >

kylin-start

2020-08-12 Thread sundywuyong
在服务器上部署的kylin,启动之后显示的ip地址是localhost,而不是服务器的ip地址,这个localhost地址在浏览器上打不开,请问这个如何解决,谢谢!详细信息如下图。

??????How to modify the time zone of hive ? ????????????hive????????

2020-08-12 Thread ??????
Hivehivekylin??Ambari??kylin??kylin??hive??

Re:Failed to read big resource /dict/KYLIN.HIVE_METRICS_QUERY_CUBE_QA/CUBE_NAME/xxx.dict

2020-08-10 Thread Johnson
Hi Shylin Zhang You can use "${KYLIN_HIME}/bin/metastore.sh remove /dict/KYLIN.HIVE_METRICS_JOB_QA/KUSER/d60c8ffc-c883-24d2-ec6b-c78fc963f8d7.dict" to delete this dict,it should work. At 2020-08-10 16:02:47, "shylinzhang" wrote: Hi Xiaoxiang, I met the issue agin and

Failed to read big resource /dict/KYLIN.HIVE_METRICS_QUERY_CUBE_QA/CUBE_NAME/xxx.dict

2020-08-10 Thread shylinzhang
Hi Xiaoxiang, I met the issue agin and follow what your said last time, and it didn’t work. Here are the details: ERROR: org.apache.kylin.engine.mr.exception.HadoopShellException: java.lang.RuntimeException: java.io.IOException: Failed to read big resource

How to modify the time zone of hive ?

2020-08-04 Thread ??????
Hello everyone, Recently, I encounter a problem, when Iexecute somequery statementswith "date" in kylin, the result returns null or inconsistent with hive. For example: (1)Example one, we can get results. select sum(totalfee) from erp_by_shopsale_fact f left join billperiod_dim b on

Re: Computing aggregate sum on a measurement with a filter

2020-07-31 Thread Yaqian Zhang
Maybe you can try to set the time window to purge the historical data, but there is no way to set the id window according to batch_id. If you can estimate the time period required to receive a batch data that you interested in, you can set the data before this time cycle to be cleaned up,

Re: Computing aggregate sum on a measurement with a filter

2020-07-30 Thread Kirill Bogdanov
Hi Yaqian, Thanks for your reply. After running a few more tests, I noticed that the query time is increasing with the size of the cube. As per my SQL query I am only interested in the sum(VALUE) of the completed BATCH_IDs and I don't need to differentiate between individual BATCH_IDs.

Re: Computing aggregate sum on a measurement with a filter

2020-07-29 Thread Yaqian Zhang
Hi Kirill: Would you want to optimize cube design or SQL statement? You can design cube according the SQL statement you want to query, such as add BATCH_ID and SEGMENT_SIZE to dimension, add sum(VALUE) as a measure. These can make your query faster. > 在 2020年7月29日,21:50,Kirill Bogdanov 写道:

Re: cast string column to date in where clause

2020-07-29 Thread Yaqian Zhang
Hi: Can you provide the detail query log? SegmentPruner may prune the segment by mistake for some reason. > 在 2020年7月22日,19:54,skyyws 写道: > > Hello everyone, > Recently when I use Kylin to query like this: > select dt from table > where cast(dt as date) >= cast('2020-07-21' as date) and

Re: Measure column missing in Kylin 3.0 model

2020-07-29 Thread Yaqian Zhang
Hi: I test this in my env. I have create a model with a fact_table KYLIN_SALES and a lookup table KYLIN_CAL_DT, and the join condition is KYLIN_SALES.PART_DT = KYLIN_CAL_DT.CAL_DT, both columns are added to the list of dimensions in this model. Then I create a cube in this model, add

Measure column missing in Kylin 3.0 model

2020-07-29 Thread Gayathri Rengarajan
Hello This may have been already addressed in an earlier email or documentation but sending an email since I could not find any reference. When building a model in Kylin 3.0 noticed that we are unable to add a column as measure if that column has been used in a join condition with a look up

Re: Computing aggregate sum on a measurement with a filter

2020-07-29 Thread Kirill Bogdanov
To answer my own questions, I have came up with the following SQL statement that seems to work correctly. WITH myview (sgmnt_size, total_batch_val, msg_count) as (SELECT BATCH_SIZE, sum(VALUE), count(MESSAGE_ID) from TABLE2 group by BATCH_ID, SEGMENT_SIZE) SELECT sum(total_batch_val) FROM myview

Computing aggregate sum on a measurement with a filter

2020-07-29 Thread Kirill Bogdanov
Hi, I am working on a real time data analytics and evaluating the possibility of using Kylin for our project. To date, I was able to connect Kafka with Kylin and run basic queries on cubes. However, I have a specific functionality requirements that I currently don't know how to achieve in Kylin.

Re: [DISCUSS] Kylin Parquet storage and 4.0 plan

2020-07-25 Thread ShaoFeng Shi
Hi Xiao, The 3.x will continue to release, especially for bug fix and security issues. For new features and enhancements, it depends. The main consideration is the testing and release effort: now each 3.x release needs to build and test with 4 HBase API versions; even so, many users still

Re: [DISCUSS] Kylin Parquet storage and 4.0 plan

2020-07-24 Thread ShaoFeng Shi
Hi Cinto, Currently, it uses the native Parquet, no additional indexing; in the future, if Parquet enhances its index, Kylin can benefit from it; == "are we using any metastore (like Hive) along with this ?" I'm not sure whether I understand properly. The Cube parquet files are directly

Re:[DISCUSS] Kylin Parquet storage and 4.0 plan

2020-07-24 Thread chuxiao
Will 3.x continue to release?For example,support hbase rsgroup. At 2020-07-24 19:23:11, "ShaoFeng Shi" wrote: Hello, Kylin users, Regarding the Kylin Parquet storage, we hope to update the progress here. At present, we have completed the main development work[1], design

Re: [DISCUSS] Kylin Parquet storage and 4.0 plan

2020-07-24 Thread ShaoFeng Shi
Hi Kang, it will still be KV; If changing to relational, there is too much work to do. Best regards, Shaofeng Shi 史少锋 Apache Kylin PMC Email: shaofeng...@apache.org Apache Kylin FAQ: https://kylin.apache.org/docs/gettingstarted/faq.html Join Kylin user mail group:

Re: [DISCUSS] Kylin Parquet storage and 4.0 plan

2020-07-24 Thread Zhou Kang
I have a question: Metadata based on MySQL, data in MySQL is KV or relational ? Thank you! > 2020年7月24日 下午7:23,ShaoFeng Shi 写道: > > Hello, Kylin users, > > Regarding the Kylin Parquet storage, we hope to update the progress here. At > present, we have completed the main development

[DISCUSS] Kylin Parquet storage and 4.0 plan

2020-07-24 Thread ShaoFeng Shi
Hello, Kylin users, Regarding the Kylin Parquet storage, we hope to update the progress here. At present, we have completed the main development work[1], design document[2], and the benchmark. With the new architecture, Kylin is going to be more efficient and be more cloud-friendly: fully on

?????? About KYLIN-4289-java.lang.NoSuchMethodError: com.google.common.hash.Hasher.putString

2020-07-23 Thread ????
Hi, afterput guava-28.jar to $KYLIN_HOME/tool and $KYLIN_HOME/tomcat/lib, and start kylin, what's the error messages you met? Can you show the error messages? BTW, is the kylin version you downloadedapache-kylin-3.1.0-bin-hadoop3.tar.gz? Best regards, Zhichao Zhang

?????? About KYLIN-4289-java.lang.NoSuchMethodError: com.google.common.hash.Hasher.putString

2020-07-23 Thread Discovery
Unfortunately??it does NOT work either??but still appreciate your help. from my testing results: Kylin 2.6.6 , 3.0.2, 3.1.0 can NOT work on HDP 3.1.4(hadoop 3.1.1,hbase 2.0.2, hive 3.1.0) ---- ??:

Re: About KYLIN-4289-java.lang.NoSuchMethodError: com.google.common.hash.Hasher.putString

2020-07-23 Thread Yaqian Zhang
Yes,so you may need to do something extra to make kylin run in Hadoop 3.1. You can try as below: Download guava 28.jar and put it to $KYLIN_HOME/tool and $KYLIN_HOME/tomcat/lib, and start kylin. > 在 2020年7月23日,16:11,Discovery 写道: > > Hi Yaqian, > I tried kylin 3.1.0 , it run

?????? About KYLIN-4289-java.lang.NoSuchMethodError: com.google.common.hash.Hasher.putString

2020-07-23 Thread Discovery
Hi Yaqian, I tried kylin 3.1.0 , it run into anothe issue when starting kylin service, and I use official 3.1.0 binary distribution. Caused by: java.lang.NoSuchMethodError: com.google.common.base.Preconditions.checkArgument(ZLjava/lang/String;Ljava/lang/Object;)V at

Re: About KYLIN-4289-java.lang.NoSuchMethodError: com.google.common.hash.Hasher.putString

2020-07-23 Thread Yaqian Zhang
Hi Discovery: The latest release 3.1.0 upgrade guava to 28-jre and use putUnencodeChars replaced putString. So I think KYLIN-4289 should has been fixed. You can try Kylin 3.1.0 on your environment. > 在 2020年7月23日,11:25,Discovery 写道: > > Hi Kylin Team, > >I run into

About KYLIN-4289-java.lang.NoSuchMethodError: com.google.common.hash.Hasher.putString

2020-07-22 Thread Discovery
Hi Kylin Team, I run into KYLIN-4289 issues with Kylin 2.6.6 and Hadoop 3.1.1+HBase2.0.2+Hive3.1.0, I wonder if this issue is fixed in latest release 3.1.0? I have checked the release notes and got no fix information about this bug. Could anyone give me some advice on how to

Query Error With Kylin(2.6.4)+Kakfa

2020-07-22 Thread 1092465...@qq.com
Dear all: I having use Kylin(2.6.4) for compute data in hive(2.1.1+cdh6.3.2) half a year ago.It's work and easy use.Kylin in this version can analytical data in kafka (not real time). Recently,I use Kylin to analytical data in Kafka(2.2.1+cdh6.3.2). After create

cast string column to date in where clause

2020-07-22 Thread skyyws
Hello everyone, Recently when I use Kylin to query like this: select dt from table where cast(dt as date) >= cast('2020-07-21' as date) and cast(dt as date) <= cast('2020-07-22' as date) group by dt; The result is null, but when I use this query: select dt from table where dt >= '2020-07-21' and

Re: Connection leak when using S3

2020-07-21 Thread Andras Nagy
Hi Xiaoxiang, Thank you, this indeed seems to be related to what we have. > In the cloud env, FD leak will be convert to connection leak issue, am I right? Yes, that sounds plausible. We will check with netstat. Thanks again, best regards, Andras On Tue, Jul 21, 2020 at 3:55 PM Xiaoxiang Yu

Re:Connection leak when using S3

2020-07-21 Thread Xiaoxiang Yu
Dear sir, If you are using Real-time OLAP, you may check this issue : https://issues.apache.org/jira/browse/KYLIN-4396, and it is the patch link https://github.com/apache/kylin/pull/1134. It is a FD leak issue what I find early this year. In the cloud env, FD leak will be convert to

Connection leak when using S3

2020-07-21 Thread Andras Nagy
Dear All, We run into an issue where after an extended uptime, both Kylin query server and jobs running on EMR stop working. The root cause of the issue in both sides is this exception: Caused by: java.io.IOException: com.amazon.ws.emr.hadoop.fs.shaded.com.amazonaws.SdkClientException: Unable to

[SECURITY][CVE-2020-13926] Apache Kylin SQL injection vulnerability

2020-07-13 Thread ShaoFeng Shi
Versions Affected: 2.0.0, 2.1.0, 2.2.0, 2.3.0, 2.3.1, 2.3.2, 2.4.0, 2.4.1, 2.5.0, 2.5.1, 2.5.2, 2.6.0, 2.6.1, 2.6.2, 2.6.3, 2.6.4, 2.6.5, 2.6.6, 3.0.0-alpha, 3.0.0-alpha2, 3.0.0-beta, 3.0.0, 3.0.1 3.0.2 Description: Kylin concatenates and executes some Hive SQL statements in Hive CLI or beeline

[SECURITY][CVE-2020-13925] Apache Kylin command injection vulnerability

2020-07-13 Thread ShaoFeng Shi
Versions Affected: 2.3.0, 2.3.1, 2.3.2, 2.4.0, 2.4.1, 2.5.0, 2.5.1, 2.5.2, 2.6.0, 2.6.1, 2.6.2, 2.6.3, 2.6.4, 2.6.5, 2.6.6, 3.0.0-alpha, 3.0.0-alpha2, 3.0.0-beta, 3.0.0, 3.0.1 3.0.2 Description: Similar to CVE-2020-1956, Kylin has one more restful API which concatenates the API inputs into OS

kylin

2020-07-13 Thread ????
kylin??hive??kylin??0??0?? ??

Re: Re: 执行cube在第4步报错,提示“打开的文件过多” 是怎么回事?

2020-07-09 Thread ShaoFeng Shi
https://askubuntu.com/questions/181215/too-many-open-files-how-to-find-the-culprit You can do some investigation to see which process open so many files, please refer to above link. I did encounter such a problem several years ago but didn't see it for some time. Best regards, Shaofeng Shi 史少锋

??????Re: ????cube????4?????????????????????????????? ????????????

2020-07-09 Thread ????
Hi, you can use command 'ulimit -a' to see the limitation of opening files, and google how to modify this limitation. Best regards, Zhichao Zhang ---- ??:

??????Re: ????cube????4?????????????????????????????? ????????????

2020-07-09 Thread ??????
??kylin?? ---- ??:""

?????? ????cube????4?????????????????????????????? ????????????

2020-07-09 Thread ??????
We have tried to restart kylin and rebuild the job many times??but it also returned the same errors. If you konw how to solve it ,please contact me . . Thank you very much! ---- ??:"Yaqian Zhang"

Re:Re: 执行cube在第4步报错,提示“打开的文件过多” 是怎么回事?

2020-07-09 Thread 初晓
https://blog.csdn.net/kuyuyingzi/article/details/80049973 不过你的异常为什么是中文,还是第一次见 At 2020-07-09 10:39:53, "Yaqian Zhang" wrote: Hi: If it's useful to restart kylin or rebuild the job? 在 2020年7月8日,11:16,梅秋莹 <3281438...@qq.com> 写道: -- 原始邮件

Re:Re: 执行cube在第4步报错,提示“打开的文件过多” 是怎么回事?

2020-07-09 Thread 初晓
句柄用光了吧,改一下句柄数 At 2020-07-09 10:39:53, "Yaqian Zhang" wrote: Hi: If it's useful to restart kylin or rebuild the job? 在 2020年7月8日,11:16,梅秋莹 <3281438...@qq.com> 写道: -- 原始邮件 -- 发件人: "梅秋莹"<3281438...@qq.com>; 发送时间: 2020年7月3日(星期五) 下午4:55

Re: 执行cube在第4步报错,提示“打开的文件过多” 是怎么回事?

2020-07-08 Thread Yaqian Zhang
Hi: If it's useful to restart kylin or rebuild the job? > 在 2020年7月8日,11:16,梅秋莹 <3281438...@qq.com> 写道: > > > > > -- 原始邮件 -- > 发件人: "梅秋莹"<3281438...@qq.com>; > 发送时间: 2020年7月3日(星期五) 下午4:55 > 收件人: "user"; > 主题: When build cube in kylin, it failed at the 4th step

Re:Re: kylin3.0数据结果异常

2020-07-04 Thread 苑希强
Cube conf and Kylin conf. 在 2020-07-03 23:19:19,"ShaoFeng Shi" 写道: Hi xiqiang, Checked the log, didn't find exceptional information. Did you update the HBase coprocessor after upgrade from 2.6 to 3.0? Or you can try the latest 3.0.2. I didn't remember there is a bug related to this, but it

Re: [Announce] Apache Kylin 3.1.0 released

2020-07-04 Thread Han Luke
That’s cool, thanks everyone. From: ShaoFeng Shi Sent: Thursday, July 2, 2020 10:11:37 PM To: user Cc: dev Subject: Re: [Announce] Apache Kylin 3.1.0 released Great! Thanks to everyone who contributed to this release! We encourage Kylin 2.x users to upgrade

Re: kylin3.0数据结果异常

2020-07-03 Thread ShaoFeng Shi
Hi xiqiang, Checked the log, didn't find exceptional information. Did you update the HBase coprocessor after upgrade from 2.6 to 3.0? Or you can try the latest 3.0.2. I didn't remember there is a bug related to this, but it worth a try. Best regards, Shaofeng Shi 史少锋 Apache Kylin PMC Email:

Re: [Announce] Apache Kylin 3.1.0 released

2020-07-02 Thread ShaoFeng Shi
Great! Thanks to everyone who contributed to this release! We encourage Kylin 2.x users to upgrade to Kylin 3, which has been verified by several early and big users. In the future, we will focus more on 3.1 and 4.0 development. Best regards, Shaofeng Shi 史少锋 Apache Kylin PMC Email:

[Announce] Apache Kylin 3.1.0 released

2020-07-02 Thread George Ni
The Apache Kylin team is pleased to announce the immediate availability of the 3.1.0 release. This is a major release after 3.0.0, with 10 new features and 142 bug fixes and enhancement. All of the changes in this release can be found in: https://kylin.apache.org/docs/release_notes.html You can

Announcing ApacheCon @Home 2020

2020-06-29 Thread Rich Bowen
Hi, Apache enthusiast! (You’re receiving this because you’re subscribed to one or more dev or user mailing lists for an Apache Software Foundation project.) The ApacheCon Planners and the Apache Software Foundation are pleased to announce that ApacheCon @Home will be held online, September

Re:Documentation to test early versions of Kylin on Parquet v2

2020-06-26 Thread Xiaoxiang Yu
Hi, It is a good question, Parquet Storage's source code link is here https://github.com/apache/kylin/tree/kylin-on-parquet-v2 , documentation link is here https://cwiki.apache.org/confluence/display/KYLIN/KIP-1%3A+Parquet+storage (old doc:

Documentation to test early versions of Kylin on Parquet v2

2020-06-24 Thread hubert stefani
Hi, After the exciting webinar on upcoming version of Kylin on Parquet, I would like to test with my team this new approach. Is there an up-to date documentation to help us start ? Hubert

?????? kylin????????

2020-06-22 Thread ????????
60s ---- ??:"ShaoFeng Shi"https://kylin.apache.org/docs/gettingstarted/faq.html Join Kylin user mail group: user-subscr...@kylin.apache.org Join Kylin dev mail group: dev-subscr...@kylin.apache.org

Re: kylin启动问题

2020-06-22 Thread ShaoFeng Shi
should be; you can check the bin/check-hive-usability.sh script, it has a loop which waits for 60 seconds. Best regards, Shaofeng Shi 史少锋 Apache Kylin PMC Email: shaofeng...@apache.org Apache Kylin FAQ: https://kylin.apache.org/docs/gettingstarted/faq.html Join Kylin user mail group:

?????? kylin????????

2020-06-22 Thread ????????
?? hive -e 'select 1'??kylinhive??90s ---- ??:"ShaoFeng Shi"https://kylin.apache.org/docs/gettingstarted/faq.html Join Kylin user mail group:

Re: kylin启动问题

2020-06-22 Thread ShaoFeng Shi
This message means, the Hive command seems not working on the machine. You need to check whether Hive has been properly installed and configured. You can try the "hive" command and then do some operations like show tables, query data, etc. Best regards, Shaofeng Shi 史少锋 Apache Kylin PMC Email:

Re: Query latency information not see in Kylin Metrics cube

2020-06-17 Thread Preeti Vipin
Thank you ,Yaqian, for the prompt response. I did not realize that these values were not added as dimensions, so your explanation makes sense. Thanks Preeti From: Yaqian Zhang Sent: Tuesday, June 16, 2020 4:06 AM To: user@kylin.apache.org Subject: Re: Query

Re: Query latency information not see in Kylin Metrics cube

2020-06-16 Thread Yaqian Zhang
Hi Preeti: I believe you should understand kylin's precomputing features. Kylin does not save the table details. When you query the whole table, you can only see the details of the columns added as dimension. When you query the detailed values of metrics you want in KYLIN_SYSYTEM project,

Fwd: See you at: Apache Kylin on Parquet: Introduction to the New Storage Engine

2020-06-16 Thread ShaoFeng Shi
BEGIN:VCALENDAR VERSION:2.0 PRODID:-//Meetup//Meetup Events v1.0//EN CALSCALE:GREGORIAN METHOD:PUBLISH X-WR-CALNAME:Events - Big Data Bellevue (BDB) X-MS-OLK-FORCEINSPECTOROPEN:TRUE BEGIN:VTIMEZONE TZID:America/Los_Angeles TZURL:http://tzurl.org/zoneinfo-outlook/America/Los_Angeles

Re: Kylin with Parquet

2020-06-14 Thread ShaoFeng Shi
Hi Manish, As parquet support encoding, Kylin doesn't need to do that anymore; That means, it is possible to read the origin values directly from the cube files. Best regards, Shaofeng Shi 史少锋 Apache Kylin PMC Email: shaofeng...@apache.org Apache Kylin FAQ:

Re: Kylin with Parquet

2020-06-13 Thread Manish Jain
It make sense. Are we also planning to change storage encoding or it will remain the same? Will we able read data using normal Hive/Presto queries or it will require Kylin reader only ?! On Sun, 14 Jun 2020 at 7:42 AM, ShaoFeng Shi wrote: > This is a good question; > > One of the purposes of

Re: Kylin with Parquet

2020-06-13 Thread ShaoFeng Shi
This is a good question; One of the purposes of developing the parquet storage is to overcome the limitations of HBase, which also means, to replace HBase; If the new storage is successful, we may stop to maintain the HBase engine. Best regards, Shaofeng Shi 史少锋 Apache Kylin PMC Email:

Re: Kylin with Parquet

2020-06-13 Thread Manish Jain
Ok, thanks. On Sat, 13 Jun 2020 at 8:15 PM, Liukaige wrote: > Hey Manish, > > The new Parquet storage is almost ready but has not been released yet. In > one installation you can only choose one of them, not both together. > I guess the community will continue to maintain HBase version for a

Kylin with Parquet

2020-06-12 Thread Manish Jain
Is Kylin supports storage in Parquet now instead of HBase ? Or it supports both Parquet and Hbase ? -- Best Regards, Manish Jain

Re: 下载Kylin源码放入idea中缺少Jar包

2020-06-12 Thread Yaqian Zhang
Hi: Is the error reported during the `mvn clean install -DskipTests’ or `mvn test`? Do you follow the document below? http://kylin.apache.org/cn/development/dev_env.html > 在 2020年6月10日,09:07,chris_cai <601285...@qq.com> 写道: > > 你好: > 从git上下载Kylin源码放入idea中报错,找不到以下的Jar包,可以提供一下帮助吗??? >

Re: [External Mail]下载Kylin源码放入idea中缺少Jar包

2020-06-10 Thread 刘绍辉
?这些找不到的包都是在: kyligence maven repo里面 https://github.com/apache/kylin/blob/master/pom.xml#L1140 你编译无法拉去的原因猜测可能是maven 配置问题,将所有包依赖都走公司内部的maven仓库 请检查:~/.m2/settings.xml 是否配置了mirrorOf 或者相关配置, * 建议修改成: ? *,!kyligence? -Shaohui Liu From: chris_cai

????Kylin????????idea??????Jar??

2020-06-09 Thread chris_cai
?? ??git??KylinideaJar ?? Multiple annotations found at this line: - Missing artifact org.apache.calcite:calcite-linq4j:jar:1.16.0-kylin-r5 - Missing artifact

????????????If the source table structure changed in Hive, How should I cope with the model and cube which have been created for a time?

2020-06-08 Thread ??????
Hi Johnson,

Re:转发:If the source table structure changed in Hive, How should I cope with the model and cube which have been created for a time?

2020-06-08 Thread Johnson
Hi, 这个问题目前没有太好的解决办法,kylin不支持Online Schema Change。不过可以通过一些其他方式提高你的效率,可以参考我的做法哈: 1.使用hive中的视图(view),这样可以避免一部分表结构变更引起的问题(比如字段名修改之类的,只需改一下视图即可)。但是增加维度列无法避免。 2.使用rest api构建model/cube,可以批量操作。这样比在页面上点击构建效率要高太多了。 在 2020-06-08 09:21:44,"梅秋莹" <3281438...@qq.com> 写道: Hello everyone,

??????If the source table structure changed in Hive, How should I cope with the model and cube which have been created for a time?

2020-06-07 Thread ??????
Hello everyone, Who can help me? Expecting for your reply! ---- ??:"??"<3281438...@qq.com; :2020??6??4??(??) 5:46 ??:"user"

Re: File does not exist

2020-06-05 Thread Yaqian Zhang
Hi liaifan: It seems to be the problem of MapReduce. You can submit MR tasks by copying the commands executed by kylin to the command line to verify whether your MR can work normally. > 在 2020年6月1日,18:30,liaifan 写道: > > Unable to parse prior job history, aborting recovery

If the source table structure changed in Hive, How should I cope with the model and cube which have been created for a time?

2020-06-04 Thread ??????
Hi! Dear kyliners: There is a question confused me for a long time. In some situations, we would change the table structure in Hive. For those tables which were loaded from Hive, we have used it to create the model and build cube in kylin. But if the Hive source table structures have

Re:How to add dimension to an existing cube without purging data.

2020-06-03 Thread 欧秋斌
Purge操作并不会删除你之前构建Cube中的设置。要想增加新的维度和度量自动,好像你只能先Disable,然后Purge。之后开始添加维度或字段 At 2020-06-03 14:19:22, playboy...@gmail.com wrote: Hi guys, I want to add dimension and measures to an existing cube, but I don’t want to purge data. Do you have any idea? Appreciate for any solutions or

RE: How to add dimension to an existing cube without purging data.

2020-06-03 Thread playboymqy
And I don’t want to use hybrid. Do you have any solutions? Sent from Mail for Windows 10 From: playboy...@gmail.comSent: Wednesday, June 3, 2020 2:19 PMTo: user@kylin.apache.orgSubject: How to add dimension to an existing cube without purging data. Hi guys, I want to add dimension and measures to

How to add dimension to an existing cube without purging data.

2020-06-03 Thread playboymqy
Hi guys, I want to add dimension and measures to an existing cube, but I  don’t want to purge data.Do you have any idea? Appreciate for any solutions or documents. Thanks,MQY Sent from Mail for Windows 10 

File does not exist

2020-06-01 Thread liaifan
我在build的时候,出现这种错误,麻烦看看: 2020-06-01 18:10:20,189 INFO [main] org.apache.hadoop.mapreduce.v2.app.MRAppMaster: Created MRAppMaster for application appattempt_1586742822445_9866_02 2020-06-01 18:10:20,339 INFO [main] org.apache.hadoop.mapreduce.v2.app.MRAppMaster: Executing with tokens:

Kylin build cube error with Oracle data source

2020-05-27 Thread 177016964
I setup a kylin test environment, and I try to using oracle as JDBC data source. I can get the table structure in Kylin, but fail to build cube. I find the SQL in cubes : SELECT T_IOT_CARD.ID as T_IOT_CARD_ID FROM UBI_OLAP.T_IOT_CARD as T_IOT_CARD WHERE 1=1 But this sql can't run sucessfull in

Kylin build cube error with Oracle data source

2020-05-27 Thread 177016964
I setup a kylin test environment, and I try to using oracle as JDBC data source. I can get the table structure in Kylin, but fail to build cube. I find the SQL in cubes : SELECT T_IOT_CARD.ID as T_IOT_CARD_ID FROM UBI_OLAP.T_IOT_CARD as T_IOT_CARD WHERE 1=1 But this sql can't run sucessfull in

Re: multi fact tables

2020-05-25 Thread yongjie zhao
I give a suggestion: When creating a view, you must **mark** each fact table, and then add the **add** where clause when you aggregate the query. example: select sum(measure), dims from flat_tbl where flat_tbl.tbl_marker = tb1 group by dims; On Mon, May 25, 2020 at 2:14 PM my is mine

?????? multi fact tables

2020-05-25 Thread my is mine
i have already join the two tables,i mean when i use sum,i calcutated the duplicated rows,how i avoid this ---- ??:"yongjie zhao"

multi fact tables

2020-05-25 Thread my is mine
i join two fact tables with a wide fact tables,but there are duplicated rows in it, it affects the funcation like sum, any suggest, how i sum the column

Re: Start kylin3.0.2 failed due to Guava version mismatch with HBase 2.0.2

2020-05-24 Thread ShaoFeng Shi
I'm not sure on that, I don't have the environment :-); You can take a try, or build a snapshot version from the master branch. Best regards, Shaofeng Shi 史少锋 Apache Kylin PMC Email: shaofeng...@apache.org Apache Kylin FAQ: https://kylin.apache.org/docs/gettingstarted/faq.html Join Kylin user

<    1   2   3   4   5   6   7   8   9   10   >