Re: Default Bloom Filters for HTables

2018-10-29 Thread Shrikant Bang
Thank you Yichen, for response. Its a very informative! Regards, Shrikant Bang. On Mon, Oct 29, 2018 at 12:23 PM Yichen Zhou wrote: > Hi Shrikant, > > > Kylin use FuzzyRowFilter instead of Bloom Filter. FuzzyRowFilter can find > the row key which matches the specific pattern and skip scanning

??????Merge Job in inconsistent state

2018-10-29 Thread Chao Long
Hi Ketan, As this merge job is an automatically triggered job, so it start again when you discard it. If you don't want this job to be triggered again, you can remove the "Auto Merge" related configuration on the cube design page until the problem is resolved or fixed(if it's a bug).

答复: Default Bloom Filters for HTables

2018-10-29 Thread Yichen Zhou
Hi Shrikant, Kylin use FuzzyRowFilter instead of Bloom Filter. FuzzyRowFilter can find the row key which matches the specific pattern and skip scanning the records. It is more suitable than bloom filter for kylin in most cases.

Re: Merge Job in inconsistent state

2018-10-29 Thread ShaoFeng Shi
It is a known issue; the auto-merge was triggered on each segment change. Maybe, Kylin should not trigger the auto-merge on canceling/deleting a job/segment? But you can keep that error job/segment, it won't impact on the query. The only thing is an error job there. Do you know the root cause of

Re: Merge Job in inconsistent state

2018-10-29 Thread ShaoFeng Shi
I'm updating the document for modifying metadata in a selective way, but the jenkins has a problem today. Here is the to-add part in https://kylin.apache.org/docs/howto/howto_backup_metadata.html: ## Restore metadata selectively (Recommended) If only changes a couple of metadata files, the

Re: Merge Job in inconsistent state

2018-10-29 Thread kdcool6932
Thanks, ShaoFeng,That's just what we need.I will use 'to-add' as reference, along with the online 'howto', that explains it all.Thanks,ke...@exponential.com Sent from my Samsung Galaxy smartphone. Original message From: ShaoFeng Shi Date: 30/10/2018 7:49 am (GMT+05:30) To:

Re: Merge Job in inconsistent state

2018-10-29 Thread ShaoFeng Shi
Hi Ketan, You're welcome. JIRA is created for this issue: https://issues.apache.org/jira/browse/KYLIN-3652 kdcool6932 于2018年10月30日周二 上午10:49写道: > Thanks, ShaoFeng,That's just what we need.I will use 'to-add' as > reference, along with the online 'howto', that explains it >

[jira] [Created] (KYLIN-3652) Segment auto-merge should not be triggered in some cases

2018-10-29 Thread Shaofeng SHI (JIRA)
Shaofeng SHI created KYLIN-3652: --- Summary: Segment auto-merge should not be triggered in some cases Key: KYLIN-3652 URL: https://issues.apache.org/jira/browse/KYLIN-3652 Project: Kylin Issue

Re: ArrayIndexOutOfBoundsException for NDCuboidBuilder

2018-10-29 Thread ShaoFeng Shi
The root cause is: .ArrayIndexOutOfBoundsException at java.lang.System.arraycopy(Native Method) at org.apache.kylin.engine.mr .common.NDCuboidBuilder.buildKeyInternal(NDCuboidBuilder.java:106) at org.apache.kylin.engine.mr

Re: Merge Job in inconsistent state

2018-10-29 Thread kdcool6932
Thanks guys,, really appreciate the prompt response.@ShaoFeng,Yes we have the data in hive(or we can load that if needed). And we will be rebuilding those segments. Do we have any mail thread or document or blog to refer to for manully editing and restoring metadata. That would actually be

Re: MapReduceException: Counter 0

2018-10-29 Thread liuzhixin
Hello kylin team: # Maybe kylin conf needs hpd.version for running! # Best wishes. > 在 2018年10月22日,下午6:44,liuzhixin 写道: > > Hello kylin team: what’s wrong with the Counter 0? Thank you. > > > # > Best wishes!

ArrayIndexOutOfBoundsException for NDCuboidBuilder

2018-10-29 Thread liuzhixin
Hello kylin team: # When I test the kylin2.5.0-hadoop3.1-hbase2 for hdp3.0, I select spark as the engine type, Sometimes there are some ArrayIndexOutOfBoundsExceptions, And the error info is blow: # # [2018-10-29 11:48:26][INFO][Driver][DAGScheduler:54] Job 1 failed: runJob at