Re: Why in the Convert Cuboid Data to HFile step to start too many maps and reduces

2017-05-27 Thread Alberto Ramón
Sounds like a YARN configuration problem Parallelize is good :), not all Map / reduces are executed at same times Check some configurations like: - yarn.nodemanager.resource.memory-mb per node - yarn.nodemanager.resource.cpu-vcores per node This can help you to start:

Why in the Convert Cuboid Data to HFile step to start too many maps and reduces

2017-05-27 Thread jianhui.yi
My model have 7 tables,a cube have 15 dimensions, in the “Convert Cuboid Data to HFile” step to start too many maps and reduces(maps 500+,reduces 1. 4k+),This step expend all resources of the small cluster. I set these parameters in the cluster: dfs.block.size=256M

Re: 答复: 答复: 答复: table_snapshot file does not exist

2017-05-27 Thread Li Yang
Sounds good. :-) On Sat, May 27, 2017 at 3:03 PM, jianhui.yi wrote: > Aha, Stupid way: > > 1. backup metadata > > 2. drop all cubes and models > > 3. unload that table > > 4. load that table > > 5. restore metadata. > > > > J > > > > *发件人:* Li Yang

答复: 答复: 答复: table_snapshot file does not exist

2017-05-27 Thread jianhui.yi
Aha, Stupid way: 1. backup metadata 2. drop all cubes and models 3. unload that table 4. load that table 5. restore metadata. J 发件人: Li Yang [mailto:liy...@apache.org] 发送时间: 2017年5月27日 14:50 收件人: user@kylin.apache.org 主题: Re: 答复: 答复: table_snapshot file does not

Re: 答复: Any query returns error 'null'

2017-05-27 Thread Li Yang
Meaning Kylin should be more robust on error cases. Let me see what can be done... On Sat, May 27, 2017 at 2:19 PM, jianhui.yi wrote: > Kylin version is 2.0 on cdh5.7 ,no other stack trace. > > I used metastore reset to fix it, then rebuild model and cube. > > May be

Re: 答复: 答复: table_snapshot file does not exist

2017-05-27 Thread Li Yang
What has been done to fix this issue? Curious to know. On Sat, May 27, 2017 at 1:37 PM, jianhui.yi wrote: > Thanks,I fixed it. > > > > *发件人:* Li Yang [mailto:liy...@apache.org] > *发送时间:* 2017年5月27日 10:29 > *收件人:* user@kylin.apache.org > *主题:* Re: 答复: table_snapshot

答复: Any query returns error 'null'

2017-05-27 Thread jianhui.yi
Kylin version is 2.0 on cdh5.7 ,no other stack trace. I used metastore reset to fix it, then rebuild model and cube. May be caused by a previous metadata error. Thanks 发件人: Li Yang [mailto:liy...@apache.org] 发送时间: 2017年5月27日 14:09 收件人: user@kylin.apache.org 主题: Re: Any query returns

Re: Any query returns error 'null'

2017-05-27 Thread Li Yang
What's your Kylin version? Cannot analyze the stack trace without it. On Thu, May 25, 2017 at 11:04 AM, jianhui.yi wrote: > Hi all: > > My kylin cube is ready, But I run any queries that report the following > errors，When I restart kylin service will be normal, after a