Re: some confuse about Mandatory Dimensions

[Billy(Yiming) Liu]

If you set A, B, and C as mandatory dimensions, that means Kylin will save
the cuboid result by grouping A, B, C internally. But that not means you
could only query by grouping A, B, C.  If you only query A, B. The final
result will do post-aggregation by grouping the above cuboid. Same as query
grouping A. The cost is performance, since more post-aggregation needed.
But if you query by grouping D. There would be no result, since you missed
the mandatory dimension.

2016-11-17 13:31 GMT+08:00 张晓明（zhangxiaoming）-技术产品中心 :

> Hi,all
>
>  I have create a cube in My System with Mandatory Dimensions such
> as  A B C, and the Measure use count distinct filed “u” will HLL ,
>
> When the segment of the cube complete,I query the result with kylin sql
> as “select count(distinct u) from table where A=xxx and b=yyy” or “select
> count(distinct u) from table where A=xxx ”. The result is correct
>
> In my opinion, all of the query condition must be set (A=xxx,B=,C=zzz)
> ,the kylin sql can be wrok,
>
> The question is How the Kylin query the result and the distinct value is
> right ?  that is unbelievable
>



-- 
With Warm regards

Yiming Liu (刘一鸣)

build cube step 3 error

[李尚勇]

Kylin-1.5.4.1 Build cube step 3 error, can anyone please help me understand the 
issue and how to fix it?
java.lang.NoSuchMethodError: 
org.apache.hadoop.yarn.proto.YarnProtos$LocalResourceProto.hashLong(J)I
 at 
org.apache.hadoop.yarn.proto.YarnProtos$LocalResourceProto.hashCode(YarnProtos.java:11655)
 at 
org.apache.hadoop.yarn.api.records.impl.pb.LocalResourcePBImpl.hashCode(LocalResourcePBImpl.java:62)
 at java.util.HashMap.hash(HashMap.java:338)
 at java.util.HashMap.put(HashMap.java:611)
 at 
org.apache.hadoop.mapred.LocalDistributedCacheManager.setup(LocalDistributedCacheManager.java:133)
 at 
org.apache.hadoop.mapred.LocalJobRunner$Job.(LocalJobRunner.java:163)
 at 
org.apache.hadoop.mapred.LocalJobRunner.submitJob(LocalJobRunner.java:731)
 at 
org.apache.hadoop.mapreduce.JobSubmitter.submitJobInternal(JobSubmitter.java:536)
 at org.apache.hadoop.mapreduce.Job$10.run(Job.java:1306)
 at org.apache.hadoop.mapreduce.Job$10.run(Job.java:1303)
 at java.security.AccessController.doPrivileged(Native Method)
 at javax.security.auth.Subject.doAs(Subject.java:422)
 at 
org.apache.hadoop.security.UserGroupInformation.doAs(UserGroupInformation.java:1671)
 at org.apache.hadoop.mapreduce.Job.submit(Job.java:1303)
 at 
org.apache.kylin.engine.mr.common.AbstractHadoopJob.waitForCompletion(AbstractHadoopJob.java:150)
 at 
org.apache.kylin.engine.mr.steps.FactDistinctColumnsJob.run(FactDistinctColumnsJob.java:108)
 at org.apache.kylin.engine.mr.MRUtil.runMRJob(MRUtil.java:88)
 at 
org.apache.kylin.engine.mr.common.MapReduceExecutable.doWork(MapReduceExecutable.java:120)
 at 
org.apache.kylin.job.execution.AbstractExecutable.execute(AbstractExecutable.java:113)
 at 
org.apache.kylin.job.execution.DefaultChainedExecutable.doWork(DefaultChainedExecutable.java:57)
 at 
org.apache.kylin.job.execution.AbstractExecutable.execute(AbstractExecutable.java:113)
 at 
org.apache.kylin.job.impl.threadpool.DefaultScheduler$JobRunner.run(DefaultScheduler.java:136)
 at 
java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1142)
 at 
java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:617)
 at java.lang.Thread.run(Thread.java:745)
Thanks
ShangYong Li

Re: query hbase table data from kylin

[Luke Han]

HBase is just Kylin's storage system.






Best Regards!
-

Luke Han

On Wed, Nov 16, 2016 at 2:41 PM, Billy(Yiming) Liu 
wrote:

> Kylin supports Hive and Kafka as data source, not HBase.
> As a workaround, maybe you could find some tools to transfer the data from
> HBase to Hive first.
>
> 2016-11-16 12:21 GMT+08:00 夏天松 :
>
>> hi kylin team,
>> the version of kylin is 1.5.3
>> Now I want to use kylin as our data warehouse, but I want to query hbase
>> data from kylin( like impala for hbase ).  We put data to hbase realtime,
>> and we can make some verification analysis in kylin.
>>
>> Is there  any method to do this in kylin?
>>
>> thinks.
>>
>
>
>
> --
> With Warm regards
>
> Yiming Liu (刘一鸣)
>