Hi:
经过 shaofeng_shi@kyligence 、 Xiaoxiang.Yu和张亚倩 的帮忙排查问题,找到了一个原因:
hbase.client.keyvalue.maxsize的大小在ambari中设置的太小为1mb,而cube的元数据json文件又超过1mb,很可能是由于这个参数太小引起的。后续将调大这个参数,观察一下是否还有问题。
感谢几位大佬的支撑!
Through the help of shaofeng_shi@kyligence, Xiaoxiang.Yu and Zhang Yaqian to
troubleshoot the problem, we found a reason:
Hbase. Client. The keyvalue. Maxsize in ambari set is too small for the size of
the 1 MB, and cube metadata json file more than 1 MB, is likely to be caused by
the parameter is too small.I will increase this parameter later to see if there
are any problems.
Thanks to several experts for their support!
------------------ 原始邮件 ------------------
发件人:
"user"
<[email protected]>;
发送时间: 2021年2月3日(星期三) 晚上7:22
收件人: "user"<[email protected]>;
主题: 回复: Cube disappears during build
Hi:
I've opened open an issue on
https://issues.apache.org/jira/browse/KYLIN-4896
Moreover, The question is does only version 3.1.1 exist?Or does a distributed
build exist?If I want to continue using distributed builds, are there ways I
can avoid them now。
我已经打开了一个Issue。
此外,请问这个问题是只有这个3.1.1版本存在吗?或者说是 分布式构建存在?如果我想继续使用分布式构建,目前有避免的方法吗
Thanks you!
------------------ 原始邮件 ------------------
发件人:
"user"
<[email protected]>;
发送时间: 2021年2月3日(星期三) 晚上7:00
收件人: "user"<[email protected]>;
主题: Re: Cube disappears during build
Hi:I checked the source code through the log you provided. This may be a bug.
Could you open an issue on
https://issues.apache.org/jira/projects/KYLIN/issues to trace this error?
We'll try to fix it in next release.
在 2021年2月3日,14:52,5555 <[email protected]> 写道:
hi ALL:
今天又出现了在cube使用分布式构建过程中,cube metadata丢失的问题了,
构建到第四步(Build Dimension Dictionary)的时候出现了这个cube的metedata丢失的问题。
错误日志如下,
kylin版本3.1.1采用的是 kylin.job.scheduler.default=2,
其余的配置均为正确的。
有大佬遇到过吗?
Today, there is the issue of Cube Metadata being lost when Cube is using
distributed builds,
When building step 4 (Build Dimension Dictionary), the problem of missing the
cube metedata occurred.
Error log as follows, kylin version 3.1.1 uses
kylin.job.scheduler.default=2
the rest of the configuration are correct.
Has anyone come across it?
<[email protected]>
Best Wishes
------------------ 原始邮件 ------------------
发件人: "5555" <[email protected]>;
发送时间: 2021年2月2日(星期二) 下午2:10
收件人: "user"<[email protected]>;
主题: 回复: Cube disappears during build
Hi :
Thank you for your reply.
I make sure my configuration is correct to
the kylin.server.cluster-servers.
<[email protected]>
" the Cube will suddenly disappear during the build “
I can find the Cube being built in Monitor,but it is always pending.
I cannot find the cube being built in the Model, so I can query it before.
I tried Reload Metadata, but the cube disappeared in Model.
------------------ 原始邮件 ------------------
发件人: "user" <[email protected]>;
发送时间: 2021年2月2日(星期二) 中午1:59
收件人: "user"<[email protected]>;
主题: Re: Cube disappears during build
Hi:I can't understand the meaning of " the Cube will suddenly disappear during
the build “. You mean that you can't see the submitted build job in kylin
web monitor page?
You can try to adjust the monitor page to show the jobs within one week, maybe
the jobs you said are not in the selected time range.
<[email protected]>
And when you use ZookeeperJobLock,you should add all job servers and
query servers to the kylin.server.cluster-servers
在 2021年2月2日,12:02,5555 <[email protected]> 写道:
Hi All
I was faced with a thorny problem.
The version of Kylin I use is 3.1.1, Adopt a distributed build.
kylin.job.scheduler.default=2
kylin.job.lock=org.apache.kylin.storage.hbase.util.ZookeeperJobLock
Sometimes the Cube will suddenly disappear during the build , And then the
cube is always pending, When I searched this cube in Kylin Web UI, I found
that the cube could not be searched, and the log kept reporting the error that
the cube could not be found.
<[email protected]>
This problem bothers me very much. I hope you can help me to answer it. Thank
you very much
Best Wishes