[jira] [Created] (KYLIN-2213) UnsupportedOperationException when excute 'not like' query on cube v1

2016-11-17 Thread zhengdong (JIRA)
zhengdong created KYLIN-2213:


 Summary: UnsupportedOperationException when excute 'not like' 
query on cube v1
 Key: KYLIN-2213
 URL: https://issues.apache.org/jira/browse/KYLIN-2213
 Project: Kylin
  Issue Type: Bug
Affects Versions: v1.5.4.1, v1.5.3
Reporter: zhengdong


sql like 'select from factTabe join dimTable on ... where 
dimTable.columnName not like 'a%' ' 
got UnsupportedOperationException when get flatFilter. Exception stack like 
this:
 {noformat} 
enumerator.OLAPEnumerator:108 : query storage...
at 
org.apache.catalina.core.ApplicationFilterChain.doFilter(ApplicationFilterChain.java:208)
at 
com.thetransactioncompany.cors.CORSFilter.doFilter(CORSFilter.java:195)
at 
com.thetransactioncompany.cors.CORSFilter.doFilter(CORSFilter.java:266)
at 
org.apache.catalina.core.ApplicationFilterChain.internalDoFilter(ApplicationFilterChain.java:241)
at 
org.apache.catalina.core.ApplicationFilterChain.doFilter(ApplicationFilterChain.java:208)
at 
org.apache.catalina.core.StandardWrapperValve.invoke(StandardWrapperValve.java:220)
at 
org.apache.catalina.core.StandardContextValve.invoke(StandardContextValve.java:122)
at 
org.apache.catalina.authenticator.AuthenticatorBase.invoke(AuthenticatorBase.java:505)
at 
org.apache.catalina.core.StandardHostValve.invoke(StandardHostValve.java:169)
at 
org.apache.catalina.valves.ErrorReportValve.invoke(ErrorReportValve.java:103)
at 
org.apache.catalina.valves.AccessLogValve.invoke(AccessLogValve.java:956)
at 
org.apache.catalina.core.StandardEngineValve.invoke(StandardEngineValve.java:116)
at 
org.apache.catalina.connector.CoyoteAdapter.service(CoyoteAdapter.java:436)
at 
org.apache.coyote.http11.AbstractHttp11Processor.process(AbstractHttp11Processor.java:1078)
at 
org.apache.coyote.AbstractProtocol$AbstractConnectionHandler.process(AbstractProtocol.java:625)
at 
org.apache.tomcat.util.net.JIoEndpoint$SocketProcessor.run(JIoEndpoint.java:316)
at 
java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1145)
at 
java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:615)
at 
org.apache.tomcat.util.threads.TaskThread$WrappingRunnable.run(TaskThread.java:61)
at java.lang.Thread.run(Thread.java:745)
Caused by: java.lang.UnsupportedOperationException
at 
org.apache.kylin.metadata.filter.TupleFilter.reverse(TupleFilter.java:117)
at 
org.apache.kylin.metadata.filter.TupleFilter.flattenInternal(TupleFilter.java:178)
at 
org.apache.kylin.metadata.filter.TupleFilter.flattenInternal(TupleFilter.java:148)
at 
org.apache.kylin.metadata.filter.TupleFilter.flatFilter(TupleFilter.java:132)
at 
org.apache.kylin.storage.hbase.cube.v1.CubeStorageQuery.flattenToOrAndFilter(CubeStorageQuery.java:409)
at 
org.apache.kylin.storage.hbase.cube.v1.CubeStorageQuery.search(CubeStorageQuery.java:142)
at 
org.apache.kylin.query.enumerator.OLAPEnumerator.queryStorage(OLAPEnumerator.java:123)
at 
org.apache.kylin.query.enumerator.OLAPEnumerator.moveNext(OLAPEnumerator.java:71)
at Baz$1$1.moveNext(Unknown Source)
at 
org.apache.calcite.linq4j.EnumerableDefaults$15$1.moveNext(EnumerableDefaults.java:1897)
at 
org.apache.calcite.linq4j.EnumerableDefaults.into(EnumerableDefaults.java:2908)
at 
org.apache.calcite.linq4j.DefaultEnumerable.into(DefaultEnumerable.java:343)
at 
org.apache.calcite.linq4j.EnumerableDefaults.distinct(EnumerableDefaults.java:468)
at 
org.apache.calcite.linq4j.DefaultEnumerable.distinct(DefaultEnumerable.java:210)
{noformat} 



--
This message was sent by Atlassian JIRA
(v6.3.4#6332)


Re: Kylin Job Server is single-point

2016-11-17 Thread ??????
Hi, Haile.
Since 1.6.1, Kylin will support distributed job build server and make job 
server more extensible, available and reliable.
The related jira is KYLIN-2006.


-- Original --
From:  "??";;
Date:  Fri, Nov 18, 2016 02:59 PM
To:  "dev"; 

Subject:  Kylin Job Server is single-point



Hello all,
 Kylin's job server must be  single-point ? and if job server crashs,
all job must restart .  There is some method to  solve this problem?

--
View this message in context: 
http://apache-kylin.74782.x6.nabble.com/Kylin-Job-Server-is-single-point-tp6336.html
Sent from the Apache Kylin mailing list archive at Nabble.com.

[jira] [Created] (KYLIN-2212) 'NOT' operator in filter on derived column may get incorrect result

2016-11-17 Thread zhengdong (JIRA)
zhengdong created KYLIN-2212:


 Summary: 'NOT' operator in filter on derived column may get 
incorrect result 
 Key: KYLIN-2212
 URL: https://issues.apache.org/jira/browse/KYLIN-2212
 Project: Kylin
  Issue Type: Bug
Affects Versions: v1.5.4.1, v1.5.3
Reporter: zhengdong
Assignee: zhengdong


when a compare filter on derived column specified in where clause, it will be 
translated into a filter on PK, and further converted to a range filter on PK ( 
GT the min, LT the max) if  the PK values' s size  larger than the threshold. 
However, this loose filter may filter more records out than needed when 
decorated with 'NOT' operator 



--
This message was sent by Atlassian JIRA
(v6.3.4#6332)


[jira] [Created] (KYLIN-2211) IDictionaryValueEnumerator should return String instead of byte[]

2016-11-17 Thread liyang (JIRA)
liyang created KYLIN-2211:
-

 Summary: IDictionaryValueEnumerator should return String instead 
of byte[]
 Key: KYLIN-2211
 URL: https://issues.apache.org/jira/browse/KYLIN-2211
 Project: Kylin
  Issue Type: Bug
Reporter: liyang


Don't confuse raw value with its converted byte[] form. As the source of 
dictionary, the input should be String.



--
This message was sent by Atlassian JIRA
(v6.3.4#6332)


Kylin Job Server is single-point

2016-11-17 Thread 杨海乐
Hello all,
 Kylin's job server must be  single-point ? and if job server crashs,
all job must restart .  There is some method to  solve this problem?

--
View this message in context: 
http://apache-kylin.74782.x6.nabble.com/Kylin-Job-Server-is-single-point-tp6336.html
Sent from the Apache Kylin mailing list archive at Nabble.com.


can kylin query sql with multiple Fields association?

2016-11-17 Thread 杨海乐
Hello all,
  after creating a cube with multiple fields association from two table(
fact table , lookup table), can I query sql with same association condition? 

--
View this message in context: 
http://apache-kylin.74782.x6.nabble.com/can-kylin-query-sql-with-multiple-Fields-association-tp6335.html
Sent from the Apache Kylin mailing list archive at Nabble.com.


SQL "NOT IN" returns incorrect result

2016-11-17 Thread lxw
Hi,


   When I use "NOT IN" in where clause, it returns incorrect result, and 
instead use "<>", then result is OK.
   
Raw data;


SELECT  
c.ad_place_type,
COUNT(1) as cnt 
FROM fact_table a 
LEFT JOIN dim_table as c ON (ad_id = crt_id AND mtid = mtid_) 
WHERE pt = '2016-11-17' 
GROUP by c.ad_place_type;


--results
wap 64578476
app 70764413
pc  3398137
unknown 419942





SQL1(correct) :


SELECT  
c.ad_place_type,
COUNT(1) as cnt 
FROM fact_table a 
LEFT JOIN dim_table as c ON (ad_id = crt_id AND mtid = mtid_) 
WHERE pt = '2016-11-17' 
AND c.ad_place_type <> 'pc' 
GROUP by c.ad_place_type;



--
wap 64578476
app 70764413
unknown 419942



SQL2(incorrect)??


SELECT  
c.ad_place_type,
COUNT(1) as cnt 
FROM fact_table a 
LEFT JOIN dim_table as c ON (ad_id = crt_id AND mtid = mtid_) 
WHERE pt = '2016-11-17' 
AND c.ad_place_type NOT IN ('pc')
GROUP by c.ad_place_type;



--
wap 4718980
app 33253424
unknown 90533



SQL3(incorrect)??


SELECT  
c.ad_place_type,
COUNT(1) as cnt 
FROM fact_table a 
LEFT JOIN dim_table as c ON (ad_id = crt_id AND mtid = mtid_) 
WHERE pt = '2016-11-17' 
AND c.ad_place_type NOT IN ('app','wap') 
GROUP by c.ad_place_type;



--
result(0)  ,


The correct result should be "pc  3398137" and "unknown 419942", 
when instead use "(c.ad_place_type  <> 'app' AND c.ad_place_type <> 'wap')", 
the result is OK.




Who can help me to explain this, thanks!

?????? default.kylin_intermediate not found NoSuchObjectException

2016-11-17 Thread ????????????????-??????
Here is the error log.


java.lang.RuntimeException: java.io.IOException: 
NoSuchObjectException(message:default.kylin_intermediate_kylin_sales_cube_desc_15b80b03_6cc5_4d1a_a4e3_b072c624d7f3
 table not found)   at 
org.apache.kylin.source.hive.HiveMRInput$HiveTableInputFormat.configureJob(HiveMRInput.java:94)
  at 
org.apache.kylin.engine.mr.steps.FactDistinctColumnsJob.setupMapper(FactDistinctColumnsJob.java:123)
 at 
org.apache.kylin.engine.mr.steps.FactDistinctColumnsJob.run(FactDistinctColumnsJob.java:103)
 at org.apache.kylin.engine.mr.MRUtil.runMRJob(MRUtil.java:88)   at 
org.apache.kylin.engine.mr.common.MapReduceExecutable.doWork(MapReduceExecutable.java:120)
   at 
org.apache.kylin.job.execution.AbstractExecutable.execute(AbstractExecutable.java:113)
   at 
org.apache.kylin.job.execution.DefaultChainedExecutable.doWork(DefaultChainedExecutable.java:57)
 at 
org.apache.kylin.job.execution.AbstractExecutable.execute(AbstractExecutable.java:113)
   at 
org.apache.kylin.job.impl.threadpool.DefaultScheduler$JobRunner.run(DefaultScheduler.java:136)
   at 
java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1145) 
 at 
java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:615) 
 at java.lang.Thread.run(Thread.java:745) Caused by: java.io.IOException: 
NoSuchObjectException(message:default.kylin_intermediate_kylin_sales_cube_desc_15b80b03_6cc5_4d1a_a4e3_b072c624d7f3
 table not found)   at 
org.apache.hive.hcatalog.mapreduce.HCatInputFormat.setInput(HCatInputFormat.java:97)
 at 
org.apache.hive.hcatalog.mapreduce.HCatInputFormat.setInput(HCatInputFormat.java:51)
 at 
org.apache.kylin.source.hive.HiveMRInput$HiveTableInputFormat.configureJob(HiveMRInput.java:89)
  ... 11 more Caused by: 
NoSuchObjectException(message:default.kylin_intermediate_kylin_sales_cube_desc_15b80b03_6cc5_4d1a_a4e3_b072c624d7f3
 table not found) at 
org.apache.hadoop.hive.metastore.HiveMetaStore$HMSHandler.get_table_core(HiveMetaStore.java:1885)
at 
org.apache.hadoop.hive.metastore.HiveMetaStore$HMSHandler.get_table(HiveMetaStore.java:1838)
 at sun.reflect.NativeMethodAccessorImpl.invoke0(Native Method)  at 
sun.reflect.NativeMethodAccessorImpl.invoke(NativeMethodAccessorImpl.java:57)   
 at 
sun.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorImpl.java:43)
at java.lang.reflect.Method.invoke(Method.java:606) at 
org.apache.hadoop.hive.metastore.RetryingHMSHandler.invokeInternal(RetryingHMSHandler.java:138)
  at 
org.apache.hadoop.hive.metastore.RetryingHMSHandler.invoke(RetryingHMSHandler.java:99)
   at com.sun.proxy.$Proxy47.get_table(Unknown Source) at 
org.apache.hadoop.hive.metastore.HiveMetaStoreClient.getTable(HiveMetaStoreClient.java:1212)
 at 
org.apache.hive.hcatalog.common.HCatUtil.getTable(HCatUtil.java:180) at 
org.apache.hive.hcatalog.mapreduce.InitializeInput.getInputJobInfo(InitializeInput.java:105)
 at 
org.apache.hive.hcatalog.mapreduce.InitializeInput.setInput(InitializeInput.java:86)
 at 
org.apache.hive.hcatalog.mapreduce.HCatInputFormat.setInput(HCatInputFormat.java:95)
 ... 13 more


Here  is part of the hive-site.xml.


  
javax.jdo.option.ConnectionDriverName
com.mysql.jdbc.Driver
  


  
javax.jdo.option.ConnectionPassword
hive_password
  


  
javax.jdo.option.ConnectionURL

jdbc:mysql://localhost/metastore?createDatabaseIfNotExist=trueuseUnicode=truecharacterEncoding=utf-8failOverReadOnly=false
  


  
javax.jdo.option.ConnectionUserName
hive
  
  
hive.metastore.uris
 thrift://test16:9083
  









--  --
??: "Yiming Liu";;
: 2016??11??17??(??) 2:18
??: "dev"; 

: Re: default.kylin_intermediate not found NoSuchObjectException



No attachment found. I think the attachment may be blocked by mail list
service.

2016-11-17 9:28 GMT+08:00 -?? <775620...@qq.com>:

> Hi all:
>
>  My env is Cloudera Express 5.8.1, apache-kylin-1.5.4.1-cdh5.7-
> bin.tar.gz.
>   I created the sample cube with bin/sample.sh. And when I built the
> sample cube, in step 3, an execption occured which is 
> java.lang.RuntimeException:
> java.io.IOException: NoSuchObjectException(message:
> default.kylin_intermediate_kylin_sale* table not found). And the detailed
> information is in the attachment.
>  I have searched the archive of the mailing list, and  found out
> property hive.metastore.uris should be set , but I already set it before.
> And the intermdeiate table is in hive, while I check it using hive command.
> Can anyone give me a pointer where I should configure to solve the problem.
>
>
>
>
>
>
>


-- 
With Warm regards

Yiming Liu (??)

Re: Auto merge cube error

2016-11-17 Thread Li Yang
100g is definitely out of the scope of a normal JVM. What is your original
problem?

On Mon, Nov 14, 2016 at 2:53 PM, 仇同心  wrote:

> Hi,all:
>
> I met an error when cube was auto merge,I also set -Xmx100g -Xms100g,but
> this error still appeared.
>
>
>
> java.lang.OutOfMemoryError: Requested array size exceeds VM limit
>
>  at java.util.Arrays.copyOf(Arrays.java:2271)
>
>  at java.io.ByteArrayOutputStream.grow(ByteArrayOutputStream.
> java:113)
>
>  at java.io.ByteArrayOutputStream.ensureCapacity(
> ByteArrayOutputStream.java:93)
>
>  at java.io.ByteArrayOutputStream.write(ByteArrayOutputStream.
> java:140)
>
>  at org.apache.commons.io.IOUtils.copyLarge(IOUtils.java:2147)
>
>  at org.apache.commons.io.IOUtils.copy(IOUtils.java:2102)
>
>  at org.apache.commons.io.IOUtils.copyLarge(IOUtils.java:2123)
>
>  at org.apache.commons.io.IOUtils.copy(IOUtils.java:2078)
>
>  at org.apache.kylin.storage.hbase.HBaseResourceStore.
> putResourceImpl(HBaseResourceStore.java:239)
>
>  at org.apache.kylin.common.persistence.ResourceStore.
> putResource(ResourceStore.java:208)
>
>  at org.apache.kylin.dict.DictionaryManager.save(
> DictionaryManager.java:413)
>
>  at org.apache.kylin.dict.DictionaryManager.saveNewDict(
> DictionaryManager.java:209)
>
>  at org.apache.kylin.dict.DictionaryManager.trySaveNewDict(
> DictionaryManager.java:176)
>
>  at org.apache.kylin.dict.DictionaryManager.mergeDictionary(
> DictionaryManager.java:269)
>
>  at org.apache.kylin.engine.mr.steps.MergeDictionaryStep.
> mergeDictionaries(MergeDictionaryStep.java:145)
>
>  at org.apache.kylin.engine.mr.steps.MergeDictionaryStep.
> makeDictForNewSegment(MergeDictionaryStep.java:135)
>
>  at org.apache.kylin.engine.mr.steps.MergeDictionaryStep.
> doWork(MergeDictionaryStep.java:67)
>
>  at org.apache.kylin.job.execution.AbstractExecutable.
> execute(AbstractExecutable.java:113)
>
>  at org.apache.kylin.job.execution.DefaultChainedExecutable.
> doWork(DefaultChainedExecutable.java:57)
>
>  at org.apache.kylin.job.execution.AbstractExecutable.
> execute(AbstractExecutable.java:113)
>
>  at org.apache.kylin.job.impl.threadpool.DefaultScheduler$
> JobRunner.run(DefaultScheduler.java:136)
>
>  at java.util.concurrent.ThreadPoolExecutor.runWorker(
> ThreadPoolExecutor.java:1145)
>
>  at java.util.concurrent.ThreadPoolExecutor$Worker.run(
> ThreadPoolExecutor.java:615)
>
>  at java.lang.Thread.run(Thread.java:745)
>
>
>
>
>
> Thanks!
>


[jira] [Created] (KYLIN-2208) Unclosed FileReader in HiveCmdBuilder#build()

2016-11-17 Thread Ted Yu (JIRA)
Ted Yu created KYLIN-2208:
-

 Summary: Unclosed FileReader in HiveCmdBuilder#build()
 Key: KYLIN-2208
 URL: https://issues.apache.org/jira/browse/KYLIN-2208
 Project: Kylin
  Issue Type: Bug
Reporter: Ted Yu
Priority: Minor


{code}
if (logger.isDebugEnabled()) {
logger.debug("The SQL to execute in beeline: \n" + 
IOUtils.toString(new FileReader(tmpHql)));
{code}
FileReader should be closed upon return from the method.



--
This message was sent by Atlassian JIRA
(v6.3.4#6332)


[jira] [Created] (KYLIN-2207) Ineffective null check in ExtendCubeToHybridCLI#createFromCube()

2016-11-17 Thread Ted Yu (JIRA)
Ted Yu created KYLIN-2207:
-

 Summary: Ineffective null check in 
ExtendCubeToHybridCLI#createFromCube()
 Key: KYLIN-2207
 URL: https://issues.apache.org/jira/browse/KYLIN-2207
 Project: Kylin
  Issue Type: Bug
Reporter: Ted Yu
Priority: Minor


{code}
if (partitionDateStr != null && partitionDate != 
currentSeg.getDateRangeEnd()) {
logger.error("PartitionDate must be end date of one segment.");
return;
}
if (currentSeg != null && partitionDateStr == null)
{code}
The null check in the second if statement is ineffective - currentSeg has been 
de-referenced already.



--
This message was sent by Atlassian JIRA
(v6.3.4#6332)


Re: 答复: Duplicate Column! Error coming while executing the query- Using Kyline 1.6 Snapshot version

2016-11-17 Thread Li Yang
Em.. this worth a JIRA. https://issues.apache.org/jira/browse/KYLIN-2206

On Wed, Nov 9, 2016 at 8:18 PM, roger shi 
wrote:

> Hi Ankur,
>
> Kylin doesn't support this kind of query " ... where fo.pick_due_ts >=
> fo.last_update_ts ... ". You work around by creating view of the origin
> table with a new column, for example larger_pick. The column's value is 1
> for pick_due_ts >= last_update_ts, otherwise the value is 0.
>
> Your query can be this:
> select distinct count(*) from fulfill_order fo left join
> fulfill_order_status fos on ( fo.fulfill_order_id = fos.fulfill_order_id
> and fo.fulfill_order_status_code = fos.fulfill_order_status_code
> and fo.last_update_ts= fos.status_update_timestamp
> ) where fo.fulfill_order_status_code in (7,8) and fo.larger_pick = 1;
> 
> 发件人: Ankur Kapoor 
> 发送时间: 2016年11月9日 12:33:06
> 收件人: dev@kylin.apache.org
> 主题: Re: Duplicate Column! Error coming while executing the query- Using
> Kyline 1.6 Snapshot version
>
> Guys, please help me on this, I am kind of stuck!
>
> --
> View this message in context: http://apache-kylin.74782.x6.
> nabble.com/Duplicate-Column-Error-coming-while-executing-
> the-query-Using-Kyline-1-6-Snapshot-version-tp6230p6237.html
> Sent from the Apache Kylin mailing list archive at Nabble.com.
>


Re: [REPORT] Kylin - November 2016

2016-11-17 Thread Li Yang
Good suggestion, we should record these sessions in future.

On Tue, Nov 8, 2016 at 3:40 PM, Alberto Ramón 
wrote:

> Is There any Youtube channel with all Videos ? I cant find any
>
> 2016-11-08 0:24 GMT+01:00 Luke Han :
>
> > ## Description:
> > ===
> > Apache Kylin is an open source Distributed Analytics Engine designed
> > to provide SQL interface and multi-dimensional analysis (OLAP) on
> > Hadoop supporting extremely large datasets.
> >
> > ## Issues:
> > ==
> > - there are no issues requiring board attention at this time
> >
> > ## Activity:
> > 
> > - Mailing list, JIRA, and commit activity are at or above average
> > - Apache Kylin Meetup hosted on 2016-10-29 in Shenzhen, China
> > engaged more than 200 participants, with 4 sessions from
> > Liangyi Huang (Kylin User), Jongyoul Li (Zeppelin PMC),
> > WeiShuo Zhen (Tableau Expert) and Yang Li (Kylin PMC)
> > - Yang Li presented Kylin topic at ChinaHadoop live broadcast
> > on 2016-11-3, more than 2200 people joined that session
> > - Luke Han presented Kylin streaming topic at
> > Analysys 10 Summit on 2016-10-28 in Beijing
> > - Luke Han presented Kylin open source topic at
> > QCon Shanghai on 2016-10-22
> > - Apache Kylin Practices eBook published on 2016-10-27
> > by InfoQ China
> >
> > ## Community:
> > =
> > - Currently 23 PMC members and committers.
> > - No new PMC member & committer added in the last 3 months
> > - Messages on the dev mailing list after last report: 720
> > - Messages on the user mailing list after last report: 402
> > - 224 JIRA tickets created after last report
> > - 239 JIRA tickets closed/resolved after last report
> >
> > ## Releases:
> > 
> > - The latest release, v1.5.4.1, released on 2016-09-28
> > - v1.5.4, released on 2016-09-15
> >
>


Re: some confuse about Mandatory Dimensions

2016-11-17 Thread ShaoFeng Shi
xiaoming, Kylin saves the HyperLogLog or Bitmap for the distinct count
measure (not just a number!), which means they are mergable for complex
query. So even you mark A+B+C as mandantory, when you query for a certain
sub combination like A, it will use those HLL or Bitmap to merge again to
return what you want.

2016-11-17 14:18 GMT+08:00 张晓明(zhangxiaoming)-技术产品中心 :

> Thanks Billy
>
> If Kylin save the result separate By A B C,The Times Can be understand,
> But “count distinct ” is  merge the same “u” ,Can’t do ++ Operation
> “”
>
>
>
> *From:* Billy(Yiming) Liu [mailto:liuyiming@gmail.com]
> *Sent:* Thursday, November 17, 2016 2:05 PM
> *To:* user 
> *Cc:* dev@kylin.apache.org
> *Subject:* Re: some confuse about Mandatory Dimensions
>
>
>
> If you set A, B, and C as mandatory dimensions, that means Kylin will save
> the cuboid result by grouping A, B, C internally. But that not means you
> could only query by grouping A, B, C.  If you only query A, B. The final
> result will do post-aggregation by grouping the above cuboid. Same as query
> grouping A. The cost is performance, since more post-aggregation needed.
> But if you query by grouping D. There would be no result, since you missed
> the mandatory dimension.
>
>
>
> 2016-11-17 13:31 GMT+08:00 张晓明(zhangxiaoming)-技术产品中心 <
> zhangxiaom...@qiyi.com>:
>
> Hi,all
>
>  I have create a cube in My System with Mandatory Dimensions such
> as  A B C, and the Measure use count distinct filed “u” will HLL ,
>
> When the segment of the cube complete,I query the result with kylin sql
> as “select count(distinct u) from table where A=xxx and b=yyy” or “select
> count(distinct u) from table where A=xxx ”. The result is correct
>
> In my opinion, all of the query condition must be set (A=xxx,B=,C=zzz)
> ,the kylin sql can be wrok,
>
> The question is How the Kylin query the result and the distinct value is
> right ?  that is unbelievable
>
>
>
>
>
> --
>
> With Warm regards
>
> Yiming Liu (刘一鸣)
>



-- 
Best regards,

Shaofeng Shi 史少锋


[jira] [Created] (KYLIN-2205) Use column name as the default measure name

2016-11-17 Thread Shaofeng SHI (JIRA)
Shaofeng SHI created KYLIN-2205:
---

 Summary: Use column name as the default measure name
 Key: KYLIN-2205
 URL: https://issues.apache.org/jira/browse/KYLIN-2205
 Project: Kylin
  Issue Type: Improvement
  Components: Web 
Affects Versions: v1.5.4.1, v1.5.3
Reporter: Shaofeng SHI
Assignee: Zhong,Jason
 Fix For: v1.6.1


When using the batch tool to add dimensions, the wizard will set the name with 
the column full name (DB.TABLE.COLUMN), and when using "derived" for lookup 
columns, it will use duplicated name "DB.TABLE.FK_derived" for all. This is not 
good when there are many column. Suggest to make it simple as just "COLUMN". 

If you see the attachement you will know what I mean.





--
This message was sent by Atlassian JIRA
(v6.3.4#6332)


[jira] [Created] (KYLIN-2204) Export result set as CSV, the double-byte characters are messed up

2016-11-17 Thread Shaofeng SHI (JIRA)
Shaofeng SHI created KYLIN-2204:
---

 Summary: Export result set as CSV, the double-byte characters are 
messed up
 Key: KYLIN-2204
 URL: https://issues.apache.org/jira/browse/KYLIN-2204
 Project: Kylin
  Issue Type: Bug
  Components: Web 
Affects Versions: v1.5.4.1
Reporter: Shaofeng SHI
 Fix For: Future


Execute a query and get results which has double-bytes characters like Chinese 
character, when export it as csv and then open with Excel or other tools, will 
find these characters are invalid. See attachement 



--
This message was sent by Atlassian JIRA
(v6.3.4#6332)