????: Error while executing SQL "select count(*) as nums,courseid from optionaction group by courseid LIMIT 50000": null

2017-04-26 Thread roger shi 
More information is required to answer your question. Would you mind to attach 
kylin log and related metadata json?


??: 35925138 <35925...@qq.com>
: 2017??4??27?? 11:32:44
??: dev
: Error while executing SQL "select count(*) as nums,courseid from 
optionaction group by courseid LIMIT 5": null

??   ??cubesql??null
   cube??
   kylin??1.6.0

[VOTE] Release apache-kylin-2.0.0 (RC3)

2017-04-26 Thread Li Yang 
Hi all,

I have created a build for Apache Kylin 2.0.0, release candidate 3.

Changes highlights:

Support snowflake data model (KYLIN-1875)
Support TPC-H queries (KYLIN-2467)
Spark cubing engine (KYLIN-2331)
Job engine HA (KYLIN-2006)
Percentile measure (KYLIN-2396)
Cloud tested (KYLIN-2351)


Thanks to everyone who has contributed to this release. Here is release
notes:
http://kylin.apache.org/docs20/release_notes.html

The commit to be voted upon (375fd807c281d8c5deff0620747c806be2019782):
https://github.com/apache/kylin/tree/kylin-2.0.0

The artifacts to be voted on are located here:
https://dist.apache.org/repos/dist/dev/kylin/apache-kylin-2.0.0-rc3/

A staged Maven repository is available for review at:
https://repository.apache.org/content/repositories/orgapachekylin-1041/

Release artifacts are signed with the following key:
https://people.apache.org/keys/committer/liyang.asc

Please vote on releasing this package as Apache Kylin 2.0.0.

The vote is open for the next 72 hours and passes if a majority of
at least three +1 PPMC votes are cast.

[ ] +1 Release this package as Apache Kylin 2.0.0
[ ]  0 I don't feel strongly about it, but I'm okay with the release
[ ] -1 Do not release this package because...


Here is my vote:

+1 (binding)


Cheers

[CANCEL] [VOTE] Release apache-kylin-2.0.0 (RC2)

2017-04-26 Thread Li Yang 
Sorry guys, we found the previous bug was not fully fixed. Need a minor fix
and I have to cancel this and do it again.

https://issues.apache.org/jira/browse/KYLIN-2564

This vote is cancelled.

Yang



On Wed, Apr 26, 2017 at 9:44 PM, ShaoFeng Shi 
wrote:

> +1 (binding)
>
> mvn test passed with 1.8.0_111
> verified md5 and sha1;
> verified the package is signed by liyang.
> checked the src package is clean.
>
> 2017-04-26 11:05 GMT+08:00 yu feng :
>
> > +1(no binding)
> > mvn test passed
> > build(mvn clean install -DskipTests) success
> > md5 verified
> >
> > 2017-04-26 6:32 GMT+08:00 Li Yang :
> >
> > > Hi all,
> > >
> > > I have created a build for Apache Kylin 2.0.0, release candidate 2.
> > >
> > > Changes highlights:
> > >
> > > Support snowflake data model (KYLIN-1875)
> > > Support TPC-H queries (KYLIN-2467)
> > > Spark cubing engine (KYLIN-2331)
> > > Job engine HA (KYLIN-2006)
> > > Percentile measure (KYLIN-2396)
> > > Cloud tested (KYLIN-2351)
> > >
> > >
> > > Thanks to everyone who has contributed to this release. Here is release
> > > notes:
> > > http://kylin.apache.org/docs20/release_notes.html
> > >
> > > The commit to be voted upon (1412e954f912201dfb298f086b1eb8
> 8dc57a386d):
> > > https://github.com/apache/kylin/tree/kylin-2.0.0
> > >
> > > The artifacts to be voted on are located here:
> > > https://dist.apache.org/repos/dist/dev/kylin/apache-kylin-2.0.0-rc2/
> > >
> > > A staged Maven repository is available for review at:
> > > https://repository.apache.org/content/repositories/
> orgapachekylin-1040/
> > >
> > > Release artifacts are signed with the following key:
> > > https://people.apache.org/keys/committer/liyang.asc
> > >
> > > Please vote on releasing this package as Apache Kylin 2.0.0.
> > >
> > > The vote is open for the next 72 hours and passes if a majority of
> > > at least three +1 PPMC votes are cast.
> > >
> > > [ ] +1 Release this package as Apache Kylin 2.0.0
> > > [ ]  0 I don't feel strongly about it, but I'm okay with the release
> > > [ ] -1 Do not release this package because...
> > >
> > >
> > > Here is my vote:
> > >
> > > +1 (binding)
> > >
> > >
> > > Cheers
> > >
> >
>
>
>
> --
> Best regards,
>
> Shaofeng Shi 史少锋
>

Re: java.lang.NullPointerException

2017-04-26 Thread ShaoFeng Shi 
It seems the dictionary wasn't found. What's the encoding method for the
"group by" column in TopN (if not specified, it will use dictionary)? Is
the TopN query working well? If you can provide the JSON of the cube, that
would be easier.

在 2017年4月26日 下午4:19，Li Yang 写道：

> Shaofeng knows this better..
>
> 2017-04-26 15:11 GMT+08:00 35925138 <35925...@qq.com>:
>
> > 经过测试，发现只有当我的meansures 定义了topn时，才合并索引时，才会暴这个问题，定义其他类型，例如sum时，没有这个问题，稳定通过，
> 请各位大神看看有木有什么好建议给我。kylin版本1.6.0
> > hive版本1.2.1
> >
> >
> > -- 原始邮件 --
> > *发件人:* "35925138";<35925...@qq.com>;
> > *发送时间:* 2017年4月25日(星期二) 上午8:24
> > *收件人:* "dev";
> > *主题:* java.lang.NullPointerException
> >
> > 你好：
> >我再merge cube时，执行到第四步
> > 的时候报错，错误的日志为：
> > 2017-04-25 08:13:24,313 ERROR [IPC Server handler 3 on 41962]
> > org.apache.hadoop.mapred.TaskAttemptListenerImpl: Task:
> > attempt_1492659249668_0138_m_04_0 - exited :
> > java.lang.NullPointerException
> > at org.apache.kylin.dimension.DictionaryDimEnc.(
> > DictionaryDimEnc.java:56)
> > at org.apache.kylin.dimension.DictionaryDimEnc.(
> > DictionaryDimEnc.java:51)
> > at org.apache.kylin.measure.topn.TopNMeasureType.
> > getDimensionEncodings(TopNMeasureType.java:417)
> > at org.apache.kylin.measure.topn.TopNMeasureType.access$100(
> > TopNMeasureType.java:52)
> > at org.apache.kylin.measure.topn.TopNMeasureType$1.
> > reEncodeDictionary(TopNMeasureType.java:166)
> > at org.apache.kylin.measure.topn.TopNMeasureType$1.
> > reEncodeDictionary(TopNMeasureType.java:117)
> > at org.apache.kylin.engine.mr.steps.MergeCuboidMapper.map(
> > MergeCuboidMapper.java:239)
> > at org.apache.kylin.engine.mr.steps.MergeCuboidMapper.map(
> > MergeCuboidMapper.java:62)
> > at org.apache.hadoop.mapreduce.Mapper.run(Mapper.java:145)
> > at org.apache.hadoop.mapred.MapTask.runNewMapper(MapTask.
> java:784)
> > at org.apache.hadoop.mapred.MapTask.run(MapTask.java:341)
> > at org.apache.hadoop.mapred.YarnChild$2.run(YarnChild.java:163)
> > at java.security.AccessController.doPrivileged(Native Method)
> > at javax.security.auth.Subject.doAs(Subject.java:422)
> > at org.apache.hadoop.security.UserGroupInformation.doAs(
> > UserGroupInformation.java:1628)
> > at org.apache.hadoop.mapred.YarnChild.main(YarnChild.java:158)
> >
> > 这是什么问题，我改如何调整？
> >
>



-- 
Best regards,

Shaofeng Shi 史少锋

[jira] [Created] (KYLIN-2571) cannot get real driver.version from kylin jdbc driver

2017-04-26 Thread Dong Li (JIRA) 
Dong Li created KYLIN-2571:
--

 Summary: cannot get real driver.version from kylin jdbc driver
 Key: KYLIN-2571
 URL: https://issues.apache.org/jira/browse/KYLIN-2571
 Project: Kylin
  Issue Type: Bug
  Components: Driver - JDBC
Affects Versions: v2.0.0
Reporter: Dong Li
Assignee: Dong Li
Priority: Minor


always return 0.0 from jdbc driver



--
This message was sent by Atlassian JIRA
(v6.3.15#6346)

[jira] [Created] (KYLIN-2570) source code is that TopNCounter merge method problem

2017-04-26 Thread aijuanbo (JIRA) 
aijuanbo created KYLIN-2570:
---

 Summary: source code is that TopNCounter merge method problem
 Key: KYLIN-2570
 URL: https://issues.apache.org/jira/browse/KYLIN-2570
 Project: Kylin
  Issue Type: Test
Reporter: aijuanbo


In org.apache.kylin.measure.topn.TopNCounter have a merge method,

I have a question that why notDuplicateItems offer(item, m2);

I think is this.offer(item,entry.getValue().getValue().count);

because item is not found in TopNCounter,it is first offer 




--
This message was sent by Atlassian JIRA
(v6.3.15#6346)

Re: java.lang.NullPointerException

2017-04-26 Thread Li Yang 
Shaofeng knows this better..

2017-04-26 15:11 GMT+08:00 35925138 <35925...@qq.com>:

> 经过测试，发现只有当我的meansures 
> 定义了topn时，才合并索引时，才会暴这个问题，定义其他类型，例如sum时，没有这个问题，稳定通过，请各位大神看看有木有什么好建议给我。kylin版本1.6.0
> hive版本1.2.1
>
>
> -- 原始邮件 --
> *发件人:* "35925138";<35925...@qq.com>;
> *发送时间:* 2017年4月25日(星期二) 上午8:24
> *收件人:* "dev";
> *主题:* java.lang.NullPointerException
>
> 你好：
>我再merge cube时，执行到第四步
> 的时候报错，错误的日志为：
> 2017-04-25 08:13:24,313 ERROR [IPC Server handler 3 on 41962]
> org.apache.hadoop.mapred.TaskAttemptListenerImpl: Task:
> attempt_1492659249668_0138_m_04_0 - exited :
> java.lang.NullPointerException
> at org.apache.kylin.dimension.DictionaryDimEnc.(
> DictionaryDimEnc.java:56)
> at org.apache.kylin.dimension.DictionaryDimEnc.(
> DictionaryDimEnc.java:51)
> at org.apache.kylin.measure.topn.TopNMeasureType.
> getDimensionEncodings(TopNMeasureType.java:417)
> at org.apache.kylin.measure.topn.TopNMeasureType.access$100(
> TopNMeasureType.java:52)
> at org.apache.kylin.measure.topn.TopNMeasureType$1.
> reEncodeDictionary(TopNMeasureType.java:166)
> at org.apache.kylin.measure.topn.TopNMeasureType$1.
> reEncodeDictionary(TopNMeasureType.java:117)
> at org.apache.kylin.engine.mr.steps.MergeCuboidMapper.map(
> MergeCuboidMapper.java:239)
> at org.apache.kylin.engine.mr.steps.MergeCuboidMapper.map(
> MergeCuboidMapper.java:62)
> at org.apache.hadoop.mapreduce.Mapper.run(Mapper.java:145)
> at org.apache.hadoop.mapred.MapTask.runNewMapper(MapTask.java:784)
> at org.apache.hadoop.mapred.MapTask.run(MapTask.java:341)
> at org.apache.hadoop.mapred.YarnChild$2.run(YarnChild.java:163)
> at java.security.AccessController.doPrivileged(Native Method)
> at javax.security.auth.Subject.doAs(Subject.java:422)
> at org.apache.hadoop.security.UserGroupInformation.doAs(
> UserGroupInformation.java:1628)
> at org.apache.hadoop.mapred.YarnChild.main(YarnChild.java:158)
>
> 这是什么问题，我改如何调整？
>

Re: Server goes down while Tableau query is running

2017-04-26 Thread Li Yang 
The query is taking long to run, which means either the cube needs tuning,
or the cluster capacity is running low.

On Tue, Apr 25, 2017 at 6:25 PM, rahulsingh 
wrote:

> Hi all,
>
> I am facing issue when Tableau 10.2 runs query, the kylin node going down
> whenever Tableau runs query.
> I am not understanding what is the actual issue? Should we load the whole
> data in Tableau then prepare a sheet or something other than this.
>
> Whenever I check the kylin logs I am getting below exception.
>
> 2017-04-24 23:55:06,074 INFO  [BadQueryDetector]
> service.BadQueryDetector:179 : Slow query has been running 1881.406 seconds
> (project:MyTaxMarketing, thread: 0x79, user:ANALYST) -- SELECT * FROM
> "DEFAULT"."Tablename"
> 2017-04-24 23:55:30,967 DEBUG [BadQueryDetector]
> badquery.BadQueryHistoryManager:84 : Loaded 10 Bad Query(s)
> 2017-04-24 23:56:05,746 DEBUG [BadQueryDetector]
> hbase.HBaseResourceStore:262 : Update row /bad_query/**.json from
> oldTs:
> 1493103211146, to newTs: 1493103330968, operation result: true
> 2017-04-24 23:56:57,935 INFO  [BadQueryDetector]
> service.BadQueryDetector:169 : Problematic thread 0x79
> at java.nio.HeapByteBuffer.slice(HeapByteBuffer.java:98)
> at org.apache.kylin.common.util.ByteArray.asBuffer(ByteArray.
> java:136)
> at org.apache.kylin.gridtable.GTRecord.getValues(GTRecord.
> java:129)
> at
> org.apache.kylin.storage.gtrecord.CubeTupleConverter.translateResult(
> CubeTupleConverter.java:207)
> at
> org.apache.kylin.storage.gtrecord.SegmentCubeTupleIterator.hasNext(
> SegmentCubeTupleIterator.java:100)
> at com.google.common.collect.Iterators$5.hasNext(Iterators.
> java:596)
> at
> org.apache.kylin.storage.gtrecord.SequentialCubeTupleIterator.hasNext(
> SequentialCubeTupleIterator.java:84)
> at
> org.apache.kylin.query.enumerator.OLAPEnumerator.
> moveNext(OLAPEnumerator.java:68)
> at
> org.apache.calcite.linq4j.Linq4j$EnumeratorIterator.next(Linq4j.java:673)
> at
> org.apache.calcite.avatica.util.IteratorCursor.next(
> IteratorCursor.java:46)
>
> Thank You,
> Rahul Singh
>
> --
> View this message in context: http://apache-kylin.74782.x6.
> nabble.com/Server-goes-down-while-Tableau-query-is-running-tp7764.html
> Sent from the Apache Kylin mailing list archive at Nabble.com.
>

[jira] [Created] (KYLIN-2569) Long Query fails on ODBC driver

2017-04-26 Thread Yifan Zhang (JIRA) 
Yifan Zhang created KYLIN-2569:
--

 Summary: Long Query fails on ODBC driver
 Key: KYLIN-2569
 URL: https://issues.apache.org/jira/browse/KYLIN-2569
 Project: Kylin
  Issue Type: Bug
  Components: Driver - ODBC
 Environment: Windows, IBM Cognos & MS PowerQuery
Reporter: Yifan Zhang


Such long query will fail, so as other queries with similar length
{code:sql}
select 'This is a long long long long long long long long long long long long 
long long long long long long long long long long long long long long long long 
long long long long long long long long long long long long long long long long 
long long long long long long long long long long long long long long long long 
long long long long long long long long long long long long long long long long 
long long long long long long long long long long long long long long long long 
long long long long long long long long long long long long long long long long 
long long long long long long long long long long long long long long long long 
long long long long long long long long long long long long long long long long 
long long long long long long long long long long long long long long long long 
long long long long long long long long long long long long long long long long 
long long long long long long long long long long long long long long long long 
long long long long long long long long long long long long long long long long 
long long long long long long long long long long long long long long long long 
long long long long long long long long long long long long long long long long 
long long long long long long long long long long long long long long long long 
long long long long long long long long long long long long long long long long 
long long long long long long long long long long long long long long long long 
long long long long long long long long long long long long long long long long 
long long long long long long long long long long long long long long long long 
long long long long long long long long long long long long long long long long 
long long long long long long long long long long long long long long long long 
long long long long long long long long long long long long long long long long 
long long long long long long long long long long long long long long long long 
long long long long long long long long long long long long long long long long 
long long long long long long long long long long long long long long long long 
long long long long long long long long long long long long long long long long 
long long long long long long long long long long long long long long long long 
long long long long long long long long long long long long long long long long 
long long long long long long long long long long long long long long long long 
long long long long long long long long long long long long long long long long 
long long long long long long long long long long long long long long long long 
long long long long long long long long long long long long long long long long 
long long long long long long long long long long long long long long long long 
long long long long long long long long long long long long long long long long 
long long long long long long long long long long long long long long long long 
long long long long long long long long long long long long long long long long 
long long long long long long long long long long long long long long long long 
long long long long long long long long long long long long long long long long 
long long long long long long long long long long long long long long long long 
long long long long long long long long long long long long long long long long 
long long long long long long long long long long long long long long long long 
long long long long long long long long long long long long long long long long 
long long long long long long long long long long long long long long long long 
long long long long long long long long long long long long long long long long 
long long long long long long long long long long long long long long long long 
long long long long long long long long long long long long long long long long 
long long long long long long long long long long long long long long long long 
long long long long long long long long long long long long long long long long 
long long long long long long long long long long long long long long long long 
long long long long long long long long long long long long long long long long 
long long long long long long long long long long long long long long long long 
long long long long long long long long long long long long long long long long 
long long long long long long long long long long long long long long long long 
long long long long long long long long long long long long long long long long 
long long long long long long long long long long long

??????java.lang.NullPointerException

2017-04-26 Thread 35925138 
meansures 
??topnsumkylin1.6.0
 hive1.2.1




--  --
??: "35925138";<35925...@qq.com>;
: 2017??4??25??(??) 8:24
??: "dev"; 

: java.lang.NullPointerException



??   merge cube
??
2017-04-25 08:13:24,313 ERROR [IPC Server handler 3 on 41962] 
org.apache.hadoop.mapred.TaskAttemptListenerImpl: Task: 
attempt_1492659249668_0138_m_04_0 - exited : java.lang.NullPointerException
at 
org.apache.kylin.dimension.DictionaryDimEnc.(DictionaryDimEnc.java:56)
at 
org.apache.kylin.dimension.DictionaryDimEnc.(DictionaryDimEnc.java:51)
at 
org.apache.kylin.measure.topn.TopNMeasureType.getDimensionEncodings(TopNMeasureType.java:417)
at 
org.apache.kylin.measure.topn.TopNMeasureType.access$100(TopNMeasureType.java:52)
at 
org.apache.kylin.measure.topn.TopNMeasureType$1.reEncodeDictionary(TopNMeasureType.java:166)
at 
org.apache.kylin.measure.topn.TopNMeasureType$1.reEncodeDictionary(TopNMeasureType.java:117)
at 
org.apache.kylin.engine.mr.steps.MergeCuboidMapper.map(MergeCuboidMapper.java:239)
at 
org.apache.kylin.engine.mr.steps.MergeCuboidMapper.map(MergeCuboidMapper.java:62)
at org.apache.hadoop.mapreduce.Mapper.run(Mapper.java:145)
at org.apache.hadoop.mapred.MapTask.runNewMapper(MapTask.java:784)
at org.apache.hadoop.mapred.MapTask.run(MapTask.java:341)
at org.apache.hadoop.mapred.YarnChild$2.run(YarnChild.java:163)
at java.security.AccessController.doPrivileged(Native Method)
at javax.security.auth.Subject.doAs(Subject.java:422)
at 
org.apache.hadoop.security.UserGroupInformation.doAs(UserGroupInformation.java:1628)
at org.apache.hadoop.mapred.YarnChild.main(YarnChild.java:158)