The issue is discussed in https://issues.apache.org/jira/browse/KYLIN-2679

2017-09-29 11:41 GMT+08:00 ShaoFeng Shi <[email protected]>:

> Split that into two cubes: in one it acts as a dimension, in the other, it
> acts as count distinct measure.
>
> 2017-09-29 11:12 GMT+08:00 崔苗 <[email protected]>:
>
>> if a column was  used both as dimension and distinct count,what should be
>> use to encode ?
>> 在 2017-09-29 11:05:28,ShaoFeng Shi <[email protected]> 写道:
>> >Use GD for dimension encoding will cause query inaccurate, that should be
>> >avoided.
>> >
>> >Please use dict or fixed_length encoding for that column.
>> >
>> >2017-09-29 10:37 GMT+08:00 柯南 <[email protected]>:
>> >
>> >> Yes,I am careful to use GD. Could I have another way to instead of GD?
>> >>
>> >>
>> >>
>> >>
>> >>  ------------------ 原始邮件 ------------------
>> >>   发件人: "ShaoFeng Shi";<[email protected]>;
>> >>  发送时间: 2017年9月29日(星期五) 上午9:41
>> >>  收件人: "dev"<[email protected]>;
>> >>
>> >>  主题: Re: A problem about Global Dictionary and cube merge
>> >>
>> >>
>> >>
>> >> I see; Did you use GlobalDictionaryBuilder for a dimension column? The
>> GD
>> >> should only be used for count distinct measure, not suitable for
>> dimension
>> >> encoding.
>> >>
>> >> 2017-09-28 23:57 GMT+08:00 柯南 <[email protected]>:
>> >>
>> >> > Thank you for your reply!
>> >> >  I know this command.But Because its segment could not be merged,
>> even if
>> >> > run this command ,the hbase tables could not be cleaned.
>> >> >
>> >> >
>> >> >
>> >> >
>> >> >  ------------------ 原始邮件 ------------------
>> >> >   发件人: "ShaoFeng Shi";<[email protected]>;
>> >> >  发送时间: 2017年9月28日(星期四) 晚上9:29
>> >> >  收件人: "dev"<[email protected]>;
>> >> >
>> >> >  主题: Re: A problem about Global Dictionary and cube merge
>> >> >
>> >> >
>> >> >
>> >> > You need run this:
>> >> > https://kylin.apache.org/docs21/howto/howto_cleanup_storage.html
>> >> >
>> >> > 2017-09-28 20:40 GMT+08:00 柯南 <[email protected]>:
>> >> >
>> >> > > hi,all:
>> >> > >       Because of our yarn and hbase`s version limited,we deploy
>> apache
>> >> > > kylin 1.6.0. For the correct result of 'count(distinct A_col)'
>> across
>> >> > > segments, we must use Global Dictionary to A_col. When the cube
>> contain
>> >> > > configuration of 'org.apache.kylin.dict.GlobalDictionaryBuilder',
>> its
>> >> > > segment could not be merged.(AppendTrieDictionary class don`t
>> support
>> >> > > getValueBytesFromIdImpl method and error is below) We will build
>> the
>> >> cube
>> >> > > every day, that means a new hbase table will be created every day.
>> And
>> >> > the
>> >> > > segment could not be merged, that means the hbase tables could not
>> be
>> >> > > cleaned. That`t terrible.Give me some advice?
>> >> > >      Thank you! Looking forward to your reply.
>> >> >
>> >> >
>> >> >
>> >> >
>> >> > --
>> >> > Best regards,
>> >> >
>> >> > Shaofeng Shi 史少锋
>> >> >
>> >>
>> >>
>> >>
>> >> --
>> >> Best regards,
>> >>
>> >> Shaofeng Shi 史少锋
>> >>
>> >
>> >
>> >
>> >--
>> >Best regards,
>> >
>> >Shaofeng Shi 史少锋
>>
>>
>>
>
>
> --
> Best regards,
>
> Shaofeng Shi 史少锋
>
>


-- 
Best regards,

Shaofeng Shi 史少锋

Reply via email to