Hi All,
公司要求我们项目组验证一下kylin的查询性能，我的结果如下:
1 个master, 2 个slave，配置均为4cpu, 16G内存 ubuntu 64bit
我通过hive加载了一张数据表 110个字段，12,000,000条记录,
创建cube有4个维度，10个度量，共用了15分钟
创建后执行了一条group by 语句，用了1.06 秒
想咨询一下根据上面的情况，这个创建时间与查询时间是否是正常的，谢谢！
发送自 Windows 10 版邮件应用
Hello Alex,
Please check below link, this might be helpful.
http://apache-kylin.74782.x6.nabble.com/Extract-Fact-Table-Distinct-Columns-error-td10092.html
Let me know if it helps!
Best Regards,
Nikhil Jain
From: Alex Wang
Reply-To: "user@kylin.apache.org"
Date: Friday, August 30, 2019 at
Hi ALL:
Environment: kylin 1.6
Jdk: 1.8.0_74
Hadoop: 2.7.3
Hbase : 1.2.4
I turned on kerberos. Set kylin.job.status.with.kerberos=true
klist info:
Ticket cache: FILE:/tmp/krb5cc_500
> Default principal: kylin/hado...@xxx.cn
>
> Valid starting Expires Service principal
>
Thank you very much.
2019-08-30
lk_hadoop
发件人：maoxiaomao
发送时间：2019-08-29 15:49
主题：Re:What dose Data Size and Source Table Size mean
收件人："user@kylin.apache.org"
抄送：
Hi lk,
This is my understanding, I'm not quite sure about it. ( my kylin version
v2.6.1 )
1. Data Size : for each
1.kylin版本2.6.2，查看邮件列表，之前有个同学也遇到了这个问题，也是2.6.2版本
2.报错的那个dict不存在，这个cube已经稳定运行数月，各组件权限没有问题。
3.查看kylin log没有发现问题点。
4.之后我反复测试构建该cube，监控hdfs上kylin元数据目录，发现该报错维度的dict文件没有生成，报错信息一样，怀疑是元数据问题。
5.使用kylin cli工具清理存储（包括部分元数据），再构建，报错一致。
Hi,
When this error occurs, you can using “$KYLIN_HOME/bin/metastore.sh fetch
/dict“ to download the dictionaries to local and check if the dictionary file
exist, besides. You can check your hdfs permission. Otherwise, you may show us
more information about your situation like your working
Hi lk,
This is my understanding, I'm not quite sure about it. ( my kylin version
v2.6.1 )
1. Data Size : for each segment, each mr step, it is the output data
size, also it's one of the mapreduce counters. which can be seen in log as
"HDFS Write"(for Step#1) or "HDFS: Number of bytes
Hi,
I building a MERGE job, and it got the following error when Step1. Merge
Dictionary. I merge 3 segment ,and my dict file size is 185.7M*3 (557M)，it's
really larger than normal.
I wonder:
Is there any size limit for dictionary？
How can I make it's size smaller?
env:
Kylin 2.6.1
