Hi:
经过 shaofeng_shi@kyligence 、 Xiaoxiang.Yu和张亚倩 的帮忙排查问题,找到了一个原因:
 
hbase.client.keyvalue.maxsize的大小在ambari中设置的太小为1mb,而cube的元数据json文件又超过1mb,很可能是由于这个参数太小引起的。后续将调大这个参数,观察一下是否还有问题。
感谢几位大佬的支撑!



Through the help of shaofeng_shi@kyligence, Xiaoxiang.Yu and Zhang Yaqian to 
troubleshoot the problem, we found a reason:

Hbase. Client. The keyvalue. Maxsize in ambari set is too small for the size of 
the 1 MB, and cube metadata json file more than 1 MB, is likely to be caused by 
the parameter is too small.I will increase this parameter later to see if there 
are any problems.


Thanks to several experts for their support!


------------------ 原始邮件 ------------------
发件人:                                                                            
                                            "user"                              
                                                      
<[email protected]&gt;;
发送时间:&nbsp;2021年2月3日(星期三) 晚上7:22
收件人:&nbsp;"user"<[email protected]&gt;;

主题:&nbsp;回复: Cube disappears during build



Hi:
I've opened&nbsp;open an issue on 
https://issues.apache.org/jira/browse/KYLIN-4896&nbsp;


Moreover, The question is does only version 3.1.1 exist?Or does a distributed 
build exist?If I want to continue using distributed builds, are there ways I 
can avoid them now。

我已经打开了一个Issue。


此外,请问这个问题是只有这个3.1.1版本存在吗?或者说是 分布式构建存在?如果我想继续使用分布式构建,目前有避免的方法吗


Thanks you!
------------------ 原始邮件 ------------------
发件人:                                                                            
                                            "user"                              
                                                      <[email protected]&gt;;
发送时间:&nbsp;2021年2月3日(星期三) 晚上7:00
收件人:&nbsp;"user"<[email protected]&gt;;

主题:&nbsp;Re: Cube disappears during build



Hi:I checked the source code through the log you provided. This may be a bug. 
Could you open an issue on 
https://issues.apache.org/jira/projects/KYLIN/issues&nbsp;to trace this error? 
We'll try to fix it in next release.

在 2021年2月3日,14:52,5555 <[email protected]&gt; 写道:

hi ALL:


今天又出现了在cube使用分布式构建过程中,cube metadata丢失的问题了,
构建到第四步(Build Dimension Dictionary)的时候出现了这个cube的metedata丢失的问题。
错误日志如下,
kylin版本3.1.1采用的是&nbsp;  kylin.job.scheduler.default=2,
其余的配置均为正确的。
有大佬遇到过吗?


Today, there is the issue of Cube Metadata being lost when Cube is using 
distributed builds,
When building step 4 (Build Dimension Dictionary), the problem of missing the 
cube metedata occurred.
Error log as follows, kylin version 3.1.1 uses&nbsp; &nbsp; 
&nbsp;kylin.job.scheduler.default=2
the rest of the configuration are correct.
Has anyone come across it?

<[email protected]&gt;


Best Wishes


------------------ 原始邮件 ------------------
发件人:&nbsp; "5555" <[email protected]&gt;;
发送时间:&nbsp;2021年2月2日(星期二) 下午2:10
收件人:&nbsp;"user"<[email protected]&gt;;

主题:&nbsp;回复: Cube disappears during build



Hi :
&nbsp;Thank&nbsp;you&nbsp;for&nbsp;your&nbsp;reply.
I make sure my configuration is correct to 
the&nbsp;&nbsp;kylin.server.cluster-servers.


<[email protected]&gt;


&nbsp;" the Cube will suddenly disappear during the build “

I can find the Cube being built in Monitor,but it&nbsp;is always pending.
I cannot find the cube being built in the Model, so I can query it before.
I tried Reload Metadata, but the cube disappeared in&nbsp;Model.


------------------ 原始邮件 ------------------
发件人:&nbsp; "user" <[email protected]&gt;;
发送时间:&nbsp;2021年2月2日(星期二) 中午1:59
收件人:&nbsp;"user"<[email protected]&gt;;

主题:&nbsp;Re: Cube disappears during build



Hi:I can't understand the meaning of " the Cube will suddenly disappear during 
the build “. &nbsp;You mean that you can't see the submitted build job in kylin 
web monitor page?
You can try to adjust the monitor page to show the jobs within one week, maybe 
the jobs you said are not in the selected time range.
<[email protected]&gt;


And when you use ZookeeperJobLock,you should&nbsp;&nbsp;add all job servers and 
query servers to the&nbsp;kylin.server.cluster-servers

在 2021年2月2日,12:02,5555 <[email protected]&gt; 写道:

Hi All

I was faced with a thorny problem.


The version of Kylin I use is 3.1.1,&nbsp;Adopt a distributed build.




kylin.job.scheduler.default=2 
kylin.job.lock=org.apache.kylin.storage.hbase.util.ZookeeperJobLock

Sometimes the Cube will suddenly disappear during the build ,&nbsp;And then the 
cube is always pending,&nbsp;When I searched this cube in Kylin Web UI, I found 
that the cube could not be searched, and the log kept reporting the error that 
the cube could not be found.

<[email protected]&gt;




This problem bothers me very much. I hope you can help me to answer it. Thank 
you very much


Best Wishes

Reply via email to