Re: [Discuss] Disable/hide "RAW" measure in Kylin web GUI

[Xiaoyu Wang]

I’m sorry for too long not maintain it!

I agree with liyang to give a label to the RAW measure “Beta” or others.

I will improve it when I have time!

2016-12-19 10:21 GMT+08:00 Li Yang :

> Or display the Raw with "Beta" or "Experimental" to warn user that it is
> not a mature feature?
>
> On Fri, Dec 16, 2016 at 12:30 PM, 康凯森  wrote:
>
> > +1.
> > But the "RAW" measure is still some useful, we could improve it next year
> > when we have time.
> >
> >
> > -- 原始邮件 --
> > 发件人: "ShaoFeng Shi";;
> > 发送时间: 2016年12月15日(星期四) 中午12:05
> > 收件人: "dev";
> >
> > 主题: [Discuss] Disable/hide "RAW" measure in Kylin web GUI
> >
> >
> >
> > Hello developers and users,
> >
> > I have a proposal want to disucss here, which is about the "RAW" measure
> in
> > Kylin.
> >
> > The RAW measure was developed to solve the requirement for getting raw
> data
> > when user drill down from high level to low levels. It's performance
> would
> > be much better than fetching from source like Hive, so some users like
> it.
> > This blog introduces it:
> > https://kylin.apache.org/blog/2016/05/29/raw-measure-in-kylin/
> >
> > While it has some limitations:
> > 1) always use dictionary encoding, which means it couldn't support UHC;
> > since raw columns usually be transaction IDs, numbers, etc, the building
> > cost is much higher than ordinary dimensions;
> > 2) the raw messages for a dimension combination are persisted in one big
> > cell,; When too many rows dumped in one cell, will get BufferOverflow
> > error. This couldn't be predicted, so for an modeler or analyst he
> doesn't
> > know whether this feature could work when he creates the cube.
> > 3) seems no people maintains it;
> >
> > Based on above, I propose hiding this measure on Web GUI by default, so
> > avoiding confusing user; If someone hear and want to use this, he still
> can
> > enable it by simply set in kylin.properties.
> >
> > Any input is welcomed.
> >
> > --
> > Best regards,
> >
> > Shaofeng Shi 史少锋
> >
>

Re: [VOTE] Release apache-kylin-1.6.0 (RC1)

[Xiaoyu Wang]

I have the same error on the same env with Dong!

> 在 2016年11月12日，20:44，ShaoFeng Shi  写道：
> 
> Hi Dong, interesting... it got success in my Mac with Java 1.7.0_71; Not
> sure whether it relates with Java version; Let's see whether others have
> the same issue.
> 
> 2016-11-12 18:34 GMT+08:00 Dong Li :
> 
>> Hi Shaofeng,
>> 
>> 
>> I have to vote -1, mvn test failed on my dev machine.
>> 
>> 
>> error message is:
>> 
>> Failed tests:
>> 
>> CubeDescTest.testBadInit12
>> 
>> Expected: (an instance of java.lang.IllegalStateException and exception
>> with message a string containing "Aggregation group 0 a dimension exist in
>> more than one hierarchy: [CATEG_LVL2_NAME, META_CATEG_NAME]")
>> 
>>   but: exception with message a string containing "Aggregation group 0 a
>> dimension exist in more than one hierarchy: [CATEG_LVL2_NAME,
>> META_CATEG_NAME]" message was "Aggregation group 0 a dimension exist in
>> more than one hierarchy: [META_CATEG_NAME, CATEG_LVL2_NAME]"
>> 
>> Stacktrace was: java.lang.IllegalStateException: Aggregation group 0 a
>> dimension exist in more than one hierarchy: [META_CATEG_NAME,
>> CATEG_LVL2_NAME]
>> 
>> at org.apache.kylin.cube.model.CubeDesc.validateAggregationGroups(
>> CubeDesc.java:643)
>> 
>> at org.apache.kylin.cube.model.CubeDesc.init(CubeDesc.java:539)
>> 
>> at org.apache.kylin.cube.CubeDescTest.testBadInit12(CubeDescTest.java:192)
>> 
>> at sun.reflect.NativeMethodAccessorImpl.invoke0(Native Method)
>> 
>> at sun.reflect.NativeMethodAccessorImpl.invoke(
>> NativeMethodAccessorImpl.java:62)
>> 
>> at sun.reflect.DelegatingMethodAccessorImpl.invoke(
>> DelegatingMethodAccessorImpl.java:43)
>> 
>> at java.lang.reflect.Method.invoke(Method.java:498)
>> 
>> at org.junit.runners.model.FrameworkMethod$1.runReflectiveCall(
>> FrameworkMethod.java:50)
>> 
>> at org.junit.internal.runners.model.ReflectiveCallable.run(
>> ReflectiveCallable.java:12)
>> 
>> at org.junit.runners.model.FrameworkMethod.invokeExplosively(
>> FrameworkMethod.java:47)
>> 
>> at org.junit.internal.runners.statements.InvokeMethod.
>> evaluate(InvokeMethod.java:17)
>> 
>> at org.junit.internal.runners.statements.RunBefores.
>> evaluate(RunBefores.java:26)
>> 
>> at org.junit.internal.runners.statements.RunAfters.evaluate(
>> RunAfters.java:27)
>> 
>> at org.junit.rules.ExpectedException$ExpectedExceptionStatement.
>> evaluate(ExpectedException.java:239)
>> 
>> at org.junit.rules.RunRules.evaluate(RunRules.java:20)
>> 
>> at org.junit.runners.ParentRunner.runLeaf(ParentRunner.java:325)
>> 
>> at org.junit.runners.BlockJUnit4ClassRunner.runChild(
>> BlockJUnit4ClassRunner.java:78)
>> 
>> at org.junit.runners.BlockJUnit4ClassRunner.runChild(
>> BlockJUnit4ClassRunner.java:57)
>> 
>> at org.junit.runners.ParentRunner$3.run(ParentRunner.java:290)
>> 
>> at org.junit.runners.ParentRunner$1.schedule(ParentRunner.java:71)
>> 
>> at org.junit.runners.ParentRunner.runChildren(ParentRunner.java:288)
>> 
>> at org.junit.runners.ParentRunner.access$000(ParentRunner.java:58)
>> 
>> at org.junit.runners.ParentRunner$2.evaluate(ParentRunner.java:268)
>> 
>> at org.junit.runners.ParentRunner.run(ParentRunner.java:363)
>> 
>> at org.apache.maven.surefire.junit4.JUnit4Provider.execute(
>> JUnit4Provider.java:367)
>> 
>> at org.apache.maven.surefire.junit4.JUnit4Provider.executeWithRerun(
>> JUnit4Provider.java:274)
>> 
>> at org.apache.maven.surefire.junit4.JUnit4Provider.
>> executeTestSet(JUnit4Provider.java:238)
>> 
>> at org.apache.maven.surefire.junit4.JUnit4Provider.invoke(
>> JUnit4Provider.java:161)
>> 
>> at org.apache.maven.surefire.booter.ForkedBooter.
>> invokeProviderInSameClassLoader(ForkedBooter.java:290)
>> 
>> at org.apache.maven.surefire.booter.ForkedBooter.runSuitesInProcess(
>> ForkedBooter.java:242)
>> 
>> at org.apache.maven.surefire.booter.ForkedBooter.main(
>> ForkedBooter.java:121)
>> 
>> 
>> CubeDescTest.testBadInit8
>> 
>> Expected: (an instance of java.lang.IllegalStateException and exception
>> with message a string containing "Aggregation group 0 hierarchy dimensions
>> overlap with joint dimensions: [CATEG_LVL2_NAME, META_CATEG_NAME]")
>> 
>>   but: exception with message a string containing "Aggregation group 0
>> hierarchy dimensions overlap with joint dimensions: [CATEG_LVL2_NAME,
>> META_CATEG_NAME]" message was "Aggregation group 0 hierarchy dimensions
>> overlap with joint dimensions: [META_CATEG_NAME, CATEG_LVL2_NAME]"
>> 
>> Stacktrace was: java.lang.IllegalStateException: Aggregation group 0
>> hierarchy dimensions overlap with joint dimensions: [META_CATEG_NAME,
>> CATEG_LVL2_NAME]
>> 
>> at org.apache.kylin.cube.model.CubeDesc.validateAggregationGroups(
>> CubeDesc.java:628)
>> 
>> at org.apache.kylin.cube.model.CubeDesc.init(CubeDesc.java:539)
>> 
>> at org.apache.kylin.cube.CubeDescTest.testBadInit8(CubeDescTest.java:147)
>> 
>> at sun.reflect.NativeMethodAccessorImpl.invoke0(Native Method)
>> 
>> at 

Re: [VOTE] Release apache-kylin-1.5.3 (release candidate 3)

[Xiaoyu Wang]

+1 (binding)
mvn test passed
signature verified

在 2016年07月27日 06:38, Luke Han 写道:

+1 (binding)

mvn test pass


Best Regards!
-

Luke Han

On Tue, Jul 26, 2016 at 10:36 AM, hongbin ma  wrote:


+1 (binding), mvn test passed

On Tue, Jul 26, 2016 at 7:09 AM, Li Yang  wrote:


+1 (binding)

mvn test pass

java version "1.7.0_71"
OpenJDK Runtime Environment (rhel-2.5.3.1.el6-x86_64 u71-b14)
OpenJDK 64-Bit Server VM (build 24.65-b04, mixed mode)


On Mon, Jul 25, 2016 at 1:45 PM, lidong  wrote:


+1 (binding)


mvn test passed
gpg verify passed
md5/sha1 verify passed


Thanks,
Dong Li


Original Message
Sender:ShaoFeng shishaofeng...@apache.org
Recipient:dev...@kylin.apache.org
Date:Monday, Jul 25, 2016 10:34
Subject:[VOTE] Release apache-kylin-1.5.3 (release candidate 3)


Hi all, I have created a build for Apache Kylin 1.5.3, release

candidate

3. Changes highlights: [KYLIN-1319] - A better way to check hadoop job
status [KYLIN-1705] - Global (and more scalable) dictionary

[KYLIN-1379]

-

More stable and functional precise count distinct implements after
KYLIN-1186 [KYLIN-1656] - Improve performance of MRv2 engine by making

each

mapper handles a configured number of records [KYLIN-1677] - Distribute
source data by certain columns when creating flat table [KYLIN-1706] -
Allow cube to override MR job configuration by properties [KYLIN-1731]

-

Allow non-admin user to edit 'Advenced Setting' step in CubeDesigner
[KYLIN-1747] - Calculate all 0 (except mandatory) cuboids [KYLIN-1749]

-

Allow mandatory only cuboid [KYLIN-1789] - Couldn't use View as Lookup

when

join type is "inner" [KYLIN-1645] - Exception inside coprocessor should
report back to the query thread [KYLIN-1846] - minimize dependencies of
JDBC driver [KYLIN-1478] - TopN measure support non-dictionary encoding
Thanks to everyone who has contributed to this release. Here’s release
notes:


https://issues.apache.org/jira/secure/ReleaseNote.jspa?projectId=12316121version=12335728

The commit to be voted upon:


https://github.com/apache/kylin/commit/4cdc07ea34d0c2fb12951500e0fa28130659affb

Its hash is 4cdc07ea34d0c2fb12951500e0fa28130659affb. The artifacts to

be

voted on are located here:
https://dist.apache.org/repos/dist/dev/kylin/apache-kylin-1.5.3-rc3/

The

hashes of the artifacts are as follows:

apache-kylin-1.5.3-src.tar.gz.md5

e2cdcb3bbdc7e659303844255670b772 apache-kylin-1.5.3-src.tar.gz.sha1
94c56e5377f65421ee6bed604c980dc02ca1514a A staged Maven repository is
available for review at:


https://repository.apache.org/content/repositories/orgapachekylin-1033/

Release artifacts are signed with the following key:
https://people.apache.org/keys/committer/shaofengshi.asc Please vote

on

releasing this package as Apache Kylin 1.5.3. The vote is open for the

next

72 hours and passes if a majority of at least three +1 PPMC votes are

cast.

[ ] +1 Release this package as Apache Kylin 1.5.3 [ ] 0 I don't feel
strongly about it, but I'm okay with the release [ ] -1 Do not release

this

package because... Here is my vote: +1 (binding) -- Best regards,

Shaofeng

Shi



--
Regards,

*Bin Mahone | 马洪宾*

Re: 答复: 答复: select * from fact_table

[Xiaoyu Wang]

Comming soon!

在 2016年05月26日 11:02, Mars J 写道:

I'm looking forward the documents too~

2016-05-26 9:48 GMT+08:00 赵天烁 :


Waiting for the release note~

-

赵天烁
Kevin Zhao
Java工程师
研发中心-Flyme-大数据-平台研发
+ 86 18826908281 | zhaotians...@meizu.com

珠海市魅族科技有限公司
MEIZU Technology Co., Ltd.
广东省珠海市科技创新海岸魅族科技楼
MEIZU Tech Bldg., Technology & Innovation Coast
Zhuhai, 519085, Guangdong, China


meizu.com



-邮件原件-
发件人: lidong [mailto:lid...@apache.org]
发送时间: 2016年5月26日 9:48
收件人: dev@kylin.apache.org
主题: Re: 答复: select * from fact_table

It’s under voting currently.

http://apache-kylin.74782.x6.nabble.com/VOTE-Release-apache-kylin-1-5-2-release-candidate-3-td4672.html
If the vote got passed in 72 hrs, the binary release will roll out soon.


Thanks,
Dong


Original Message
Sender:赵天烁zhaotians...@meizu.com
Recipient:dev@kylin.apache.org...@kylin.apache.org
Date:Thursday, May 26, 2016 09:21
Subject:答复: select * from fact_table


Seems like already,
https://github.com/apache/kylin/releases/tag/kylin-1.5.2
- 赵天烁 Kevin Zhao
Java工程师 研发中心-Flyme-大数据-平台研发 + 86 18826908281 | zhaotians...@meizu.com
珠海市魅族科技有限公司 MEIZU Technology Co., Ltd. 广东省珠海市科技创新海岸魅族科技楼 MEIZU Tech Bldg.,
Technology  Innovation Coast Zhuhai, 519085, Guangdong, China meizu.com
-邮件原件- 发件人: Mars J [mailto:xujiao.myc...@gmail.com] 发送时间:
2016年5月26日 9:16 收件人: dev@kylin.apache.org 主题: Re: select * from
fact_table when 1.5.2 release ? 2016-05-22 13:28 GMT+08:00 Li Yang
liy...@apache.org:  The coming 1.5.2 release has this fixed. Before that,
please specify  the aggregation function or use group by clause.   On Wed,
May 18, 2016 at 3:16 PM, Mars J xujiao.myc...@gmail.com wrote:Hello
all,   after build a cube , using the sql select * from fact_table, it
  will not return actual fact table data but rather the follow one,I   have
define 3   measure include count/min/raw [image: 内嵌图片 1] DIMA_ID
and DIMC_ID are dimension columns defined in model   dimensions  step.
  Why 'select * from fact_table' doesn't return real fact data ? how   to
query the all fact data ?

Re: [VOTE] Release apache-kylin-1.5.2 (release candidate 3)

[Xiaoyu Wang]

+1 (binding)
mvn test passed
signature verified

在 2016年05月24日 14:53, 13802880...@139.com 写道:

+1 (binding)
  




中国移动广东有限公司 网管中心 梁猛
13802880...@139.com
  
From: ShaoFeng Shi

Date: 2016-05-24 14:12
To: dev
Subject: Re: [VOTE] Release apache-kylin-1.5.2 (release candidate 3)
+1 (binding)
  
verified md5 & sha1 hash; verified the signature; and passed mvn test on my

laptop with Java HotSpot(TM) 1.7.0_71.
  
  
  
2016-05-24 13:40 GMT+08:00 Li Yang :
  

+1 (binding)

mvn test pass

java version "1.7.0_79"
OpenJDK Runtime Environment (rhel-2.5.5.1.el6_6-x86_64 u79-b14)
OpenJDK 64-Bit Server VM (build 24.79-b02, mixed mode)


On Mon, May 23, 2016 at 4:29 PM, Dong Li  wrote:


Hi all,

I have created a build for Apache Kylin 1.5.2, release candidate 3.

Changes highlights:

- [KYLIN-1077] - Support Hive View as Lookup Table
- [KYLIN-1515] - Make Kylin run on MapR
- [KYLIN-1600] - Download diagnosis zip from GUI
- [KYLIN-1672] - support kylin on cdh 5.7


Thanks to everyone who has contributed to this release.
Here’s release notes:



https://issues.apache.org/jira/secure/ReleaseNote.jspa?projectId=12316121=12335528

The commit to be voted upon:
*


https://github.com/apache/kylin/commit/af2646b72fbb6dc81699ad6661303fd612a2eebf

<


https://github.com/apache/kylin/commit/af2646b72fbb6dc81699ad6661303fd612a2eebf

*

Its hash is af2646b72fbb6dc81699ad6661303fd612a2eebf.

The artifacts to be voted on are located here:
*https://dist.apache.org/repos/dist/dev/kylin/apache-kylin-1.5.2-rc3/
*

The hashes of the artifacts are as follows:
apache-kylin-1.5.2-src.tar.gz.md511542b6fd4cfc9ed844e8f626d5960b7
apache-kylin-1.5.2-src.tar.gz.sha1
  57c6e33dfcad34ddcfc805965b00ea6f1d04422f

A staged Maven repository is available for review at:
*https://repository.apache.org/content/repositories/orgapachekylin-1028/

Re: [VOTE] Release apache-kylin-1.5.2 (release candidate 1)

[Xiaoyu Wang]

+1 (binding)
mvn test passed
signature verified

在 2016年05月20日 18:08, Li Yang 写道:

+1

mvn test pass

java version "1.7.0_79"
OpenJDK Runtime Environment (rhel-2.5.5.1.el6_6-x86_64 u79-b14)
OpenJDK 64-Bit Server VM (build 24.79-b02, mixed mode)


On Fri, May 20, 2016 at 5:37 PM, Dong Li  wrote:


Hi all,

I have created a build for Apache Kylin 1.5.2, release candidate 1.

Changes highlights:
[KYLIN-1077] - Support Hive View as Lookup Table
[KYLIN-1515] - Make Kylin run on MapR
[KYLIN-1600] - Download diagnosis zip from GUI
[KYLIN-1672] - support kylin on cdh 5.7

Thanks to everyone who has contributed to this release.
Here’s release notes:

https://issues.apache.org/jira/secure/ReleaseNote.jspa?projectId=12316121=12335528

The commit to be voted upon:

https://github.com/apache/kylin/commit/349c004861d0f0a9ae5d8c4646b55e39ebfde282

Its hash is 349c004861d0f0a9ae5d8c4646b55e39ebfde282

The artifacts to be voted on are located here:
https://dist.apache.org/repos/dist/dev/kylin/apache-kylin-1.5.2-rc1/

The hashes of the artifacts are as follows:
apache-kylin-1.5.2-src.tar.gz.mdfde5f5676116beb1693d803a3eb6c277
apache-kylin-1.5.2-src.tar.gz.sha1
  0a8e2cd465825047bf35f078595560605c511f15

A staged Maven repository is available for review at:
https://repository.apache.org/content/repositories/orgapachekylin-1026/

Release artifacts are signed with the following key:
https://people.apache.org/keys/committer/lidong.asc

Please vote on releasing this package as Apache Kylin 1.5.2.

The vote is open for the next 72 hours and passes if a majority of
at least three +1 PPMC votes are cast.

[ ] +1 Release this package as Apache Kylin 1.5.2
[ ] 0 I don't feel strongly about it, but I'm okay with the release
[ ] -1 Do not release this package because...

Here is my vote:
+1 (binding)

Thanks,
Dong Li

Thanks,
Dong Li

2016-05-20 17:24 GMT+08:00 lidong :


Hi all,
I have created a build for Apache Kylin 1.5.2, release candidate 1.
Changes highlights:
[KYLIN-1077] - Support Hive View as Lookup Table[KYLIN-1515] - Make Kylin
run on MapR[KYLIN-1600] - Download diagnosis zip from GUI[KYLIN-1672] -
support kylin on cdh 5.7
Thanks to everyone who has contributed to this release. Here’s release
notes:


https://issues.apache.org/jira/secure/ReleaseNote.jspa?projectId=12316121version=12335528

The commit to be voted upon:


https://github.com/apache/kylin/commit/349c004861d0f0a9ae5d8c4646b55e39ebfde282

Its hash is 349c004861d0f0a9ae5d8c4646b55e39ebfde282
  The artifacts to be voted on are located here:
https://dist.apache.org/repos/dist/dev/kylin/apache-kylin-1.5.2-rc1/ The
hashes of the artifacts are as follows: apache-kylin-1.5.2-src.tar.gz.md
fde5f5676116beb1693d803a3eb6c277 apache-kylin-1.5.2-src.tar.gz.sha1
0a8e2cd465825047bf35f078595560605c511f15 A staged Maven repository is
available for review at:
https://repository.apache.org/content/repositories/orgapachekylin-1026/
Release artifacts are signed with the following key:
https://people.apache.org/keys/committer/lidong.asc Please vote on
releasing this package as Apache Kylin 1.5.2. The vote is open for the

next

72 hours and passes if a majority of at least three +1 PPMC votes are

cast.

[ ] +1 Release this package as Apache Kylin 1.5.2 [ ] 0 I don't feel
strongly about it, but I'm okay with the release [ ] -1 Do not release

this

package because... Here is my vote: +1 (binding) Thanks, Dong Li

Re: cardinality number limit about raw expression

[Xiaoyu Wang]

add the other comment
3) try to add some column which well-distributed to dimension ,so it can 
uniform distribute all the raw values to every row key.

now , 1024 * 1024 values max in one row key !

在 2016年04月27日 13:00, ShaoFeng Shi 写道:

The raw measure need encode the column values with dictionary; while
dictionary is not good for ultra high cardinality. That's why it
complaints; You can try something as workaround:

1) cut a big segment into several segments, if you were trying to build a
large data set at once;
2) set "kylin.dictionary.max.cardinality" in conf/kylin.properties to a
bigger value (default is 500).

2016-04-27 10:55 GMT+08:00 yubo-...@yolo24.com :


hi all,

I am using 1.5.1 for testing.
when I add the raw expression on one column of module, get the following
error message in log file.

Too high cardinality is not suitable for dictionary -- cardinality:
10886118

my question is

1. does this means that the raw expression only allows limited number of
cardinality ?
2. how to modify configuration for this limited number for raw
expression(measure).

--
View this message in context:
http://apache-kylin.74782.x6.nabble.com/cardinality-number-limit-about-raw-expression-tp4286.html
Sent from the Apache Kylin mailing list archive at Nabble.com.

[jira] [Created] (KYLIN-1569) Select any column when adding a custom aggregation in GUI

[Xiaoyu Wang (JIRA)]

Xiaoyu Wang created KYLIN-1569:
--

 Summary: Select any column when adding a custom aggregation in GUI
 Key: KYLIN-1569
 URL: https://issues.apache.org/jira/browse/KYLIN-1569
 Project: Kylin
  Issue Type: Bug
  Components: Web 
Affects Versions: v1.3.0, v1.5.0
Reporter: Xiaoyu Wang
Assignee: Zhong,Jason
 Fix For: v1.3.1, v1.5.1


For the last comment from liyang at KYLIN-1122.
"should have modified GUI such that user can select any column when adding a 
custom aggregation. We have extended the role of aggregation types, it makes 
sense to allow selecting from both dimension columns and measure columns."



--
This message was sent by Atlassian JIRA
(v6.3.4#6332)

[jira] [Created] (KYLIN-1476) Support measure dictionary in 1.x

[Xiaoyu Wang (JIRA)]

Xiaoyu Wang created KYLIN-1476:
--

 Summary: Support measure dictionary in 1.x
 Key: KYLIN-1476
 URL: https://issues.apache.org/jira/browse/KYLIN-1476
 Project: Kylin
  Issue Type: Bug
  Components: Query Engine
Affects Versions: v1.2
Reporter: Xiaoyu Wang
Assignee: liyang
 Fix For: v1.4


In 2.x-staging branch, custom measure function can use dictionary to save 
values.
so,get it back to 1.x branch.



--
This message was sent by Atlassian JIRA
(v6.3.4#6332)

Re: Question about 2.x-staging integration test

[Xiaoyu Wang]

Thanks hongbin!

I add some RAW measures on cube desc.
I will debug the code between the previously and the modified try to 
find the different!


在 2016年02月17日 10:15, hongbin ma 写道:

​did not find ​the official definition of SUM aggregation in ansi sql
standards. but in https://msdn.microsoft.com/en-us/library/ms187810.aspx it
seems the return type for bigint is bigint.

BTW, what changes did you make? why it worked previously?

Re: About the integration test on 2.x-staging

[Xiaoyu Wang]

The same error when run in sandbox KYLIN_HOME:
L4J [2016-01-25 07:49:01,566][ERROR][org.apache.kylin.dict.TrieDictionary] - 
Not a valid value: ??
Tests run: 2, Failures: 0, Errors: 1, Skipped: 0, Time elapsed: 2.585 sec <<< 
FAILURE! - in org.apache.kylin.invertedindex.InvertedIndexLocalTest
testCodec(org.apache.kylin.invertedindex.InvertedIndexLocalTest)  Time elapsed: 
0.727 sec  <<< ERROR!
java.lang.IllegalArgumentException: Value not exists!
at 
org.apache.kylin.common.util.Dictionary.getIdFromValueBytes(Dictionary.java:161)
at 
org.apache.kylin.dict.TrieDictionary.getIdFromValueImpl(TrieDictionary.java:158)
at 
org.apache.kylin.common.util.Dictionary.getIdFromValue(Dictionary.java:97)
at 
org.apache.kylin.common.util.Dictionary.getIdFromValue(Dictionary.java:77)
at 
org.apache.kylin.invertedindex.index.TableRecord.setValueString(TableRecord.java:116)
at 
org.apache.kylin.invertedindex.InvertedIndexLocalTest.loadRecordsSorted(InvertedIndexLocalTest.java:187)
at 
org.apache.kylin.invertedindex.InvertedIndexLocalTest.testCodec(InvertedIndexLocalTest.java:133)


Results :

Tests in error: 
  InvertedIndexLocalTest.testCodec:133->loadRecordsSorted:187 ? IllegalArgument 
...

Tests run: 2, Failures: 0, Errors: 1, Skipped: 0

[INFO] 
[INFO] Reactor Summary:
[INFO] 
[INFO] Kylin:HadoopOLAPEngine . SUCCESS [  0.564 s]
[INFO] Kylin:AtopCalcite .. SUCCESS [  0.749 s]
[INFO] Kylin:Core-Common .. SUCCESS [  0.982 s]
[INFO] Kylin:Core-Metadata  SUCCESS [  0.382 s]
[INFO] Kylin:Core-Dictionary .. SUCCESS [  0.218 s]
[INFO] Kylin:Core-Cube  SUCCESS [  0.310 s]
[INFO] Kylin:Core-Job . SUCCESS [  0.490 s]
[INFO] Kylin:Core-Storage . SUCCESS [  0.394 s]
[INFO] Kylin:InvertedIndex  FAILURE [  6.698 s]
[INFO] Kylin:Engine-MR  SKIPPED
[INFO] Kylin:Engine-Streaming . SKIPPED
[INFO] Kylin:Storage-HBase  SKIPPED


But I run the InvertedIndexLocalTest UT in local machine is ok.



> 在 2016年1月25日，15:45，hongbin ma  写道：
> 
> or maybe you should try this on sandbox's KYLIN_HOME:
> 
> mvn   test -Dtest=org.apache.kylin.invertedindex.InvertedIndexLocalTest
> -DfailIfNoTests=false

Re: 2.x-staging branch CubeDesc problem

[Xiaoyu Wang]

OK!
Thanks Jian!

在 2016年01月08日 15:51, Jian Zhong 写道:

can try 2.x-staging now

On Wed, Dec 16, 2015 at 11:11 AM, Xiaoyu Wang <wangxiao...@jd.com> wrote:


Thanks hongbin and jian!
I will try to use dev-support/test_all_against_hdp_2_2_4_2_2.sh to run
test.


在 2015年12月16日 11:03, Jian Zhong 写道:


will enable 2.x-staging front end ASAP
working on this

On Wed, Dec 16, 2015 at 10:54 AM, hongbin ma <mahong...@apache.org>
wrote:

when developping  KYLIN-976 we didn't use frontend, just leverage the unit

test cases, and the built-in test cubes.

to check how built-in test cubes are built please take a look at
dev-support/test_all_against_hdp_2_2_4_2_2.sh, it will build cubes first
and then run UT (need to turn on kafka in your sandbox)

On Wed, Dec 16, 2015 at 10:45 AM, Xiaoyu Wang <wangxiao...@jd.com>
wrote:

I'm working on KYLIN-1122 dependent on the refactor from KYLIN-976.

Need the newest code in 2.x-staging!


在 2015年12月16日 10:29, hongbin ma 写道:

​hi, xiaoyu

please do not use 2.x-staging as the frontend is falling behind from
backend
use 2.0-rc as it is going to be the official kylin-2.0 release​

On Tue, Dec 15, 2015 at 11:23 PM, 王晓雨 <wangxiao...@jd.com> wrote:

s"]->org.apache.kylin.cube.model.DimensionDesc["column"])


   at com.fasterxml.jackson.databind.JsonMappin






--
Regards,

*Bin Mahone | 马洪宾*
Apache Kylin: http://kylin.io
Github: https://github.com/binmahone

Re: Welcome new Apache Kylin committer: Yu Feng

[Xiaoyu Wang]

Welcome and Congratulations Feng!

> 在 2016年1月9日，10:07，ShaoFeng Shi  写道：
> 
> Welcome Feng Yu!
> 
> 2016-01-09 0:46 GMT+08:00 yu feng :
> 
>> Thanks to all of you, I am very glad to became a committer of Apache Kylin,
>> and thank the community for recognition.
>> 
>> I am working in Hangzhou Research Institute of Netease(www.163.com),one of
>> the earliest Internet companies in China. I am  focus on Kylin in the past
>> six months and do some changes to adapt to our environment, I have done
>> some patchs and a new feature and contributed them to kylin community. In
>> my spare time, I like to communicate with others about kylin in mail list.
>> Besides OLAP and Big Data, I'm interested in distributed storage and NoSQL
>> system.
>> 
>> Currently we are using kylin provides fast and stable OLAP analysis
>> services to multiple products in our company, we choose kylin because it
>> has a lot of advantages, including ease to use, low latency of query
>> ,supports standard SQL etc. At present, our users are very satisfied with
>> the performance of kylin too.
>> 
>> I am very proud to be a committer of Apache Kylin, and I will always do my
>> best to make contributions for Kylin community!
>> 
>> 
>> 2016-01-08 23:46 GMT+08:00 Dong Li :
>> 
>>> Welcome!
>>> 
>>> Thanks,
>>> Dong Li
>>> 
>>> 2016-01-08 23:28 GMT+08:00 Luke Han :
>>> 
 I am very pleased to announce that the Project Management Committee
 (PMC) of Apache Kylin has asked Yu Feng to becomeApache Kylin
>> committer,
 and she has already accepted.
 
 Yu has already made many contributions to Kylin community, to answer
 others questions activity, submit patches for bug fixes and
>> contributing
>>> a
 great
 feature about multi-hive source from different cluster.
 
 Please join me to welcome Yu.
 
 @Yu, please share with us a little about yourself.
 
 Luke Han
 
 On behalf of the Apache Kylin PPMC
 
>>> 
>>> 
>>> 
>>> --
>>> Thanks,
>>> Dong
>>> 
>> 
> 
> 
> 
> -- 
> Best regards,
> 
> Shaofeng Shi

Re: java.io.IOException: NoSuchObjectException(message:default.kylin_intermediate_learn_kylin

[Xiaoyu Wang]

Hi,
I think this exception may cause by the "hive.metastore.uris" property 
is not set in hive-site.xml
Kylin use HCatalog to read Hive table. HCatalog will use 
"hive.metastore.uris" property to create HiveMetaStoreClient and get 
table meta.
if not set . HCatalog use local meta server , so it will throw 
NoSuchObjectException exception.


You can config the "hive.metastore.uris" property in hive-site.xml and 
start hive metastore. so HCatalog can connect to it.



在 2016年01月07日 12:52, yu feng 写道:

you can check whether the table "default.kylin_intermediate_
learn_kylin_four_2015020100_2015123000_8d26cc4b_e012_4414_a89b_
c8d9323ae277" exist in your hive and do any other hive-site.xml exist in
your classpath. it is strange because you can load hive table(before create
and build cube).

2016-01-07 11:47 GMT+08:00 和风 <363938...@qq.com>:


my env hadoop 2.7.1 ,kylin1.2,hive 1.2.1,hbase 0.98.


my hive config :



 javax.jdo.option.ConnectionURL
 jdbc:mysql://10.24.248.196:3306/hive?characterEncoding=UTF-8

 JDBC connect string for a JDBC metastore
   


 javax.jdo.option.ConnectionDriverName
 com.mysql.jdbc.Driver
 Driver class name for a JDBC metastore
   


 javax.jdo.option.ConnectionUserName
 root
 Username to use against metastore database
   


   
 javax.jdo.option.ConnectionPassword
 root
 password to use against metastore database
   

 
   datanucleus.transactionIsolation
   repeatable-read
 

 
   datanucleus.valuegeneration.transactionIsolation
   repeatable-read
 


 
   hive.aux.jars.path

file:///usr/local/hive/lib/json-serde-1.3.6-jar-with-dependencies.jar,file:///usr/local/hive/lib/gson-2.2.4.jar,file:///usr/local/hive/lib/data-hive-udf.jar
   The location of the plugin jars that contain
implementations of user defined functions and serdes.
 





-- 原始邮件 --
发件人: "yu feng";;
发送时间: 2016年1月7日(星期四) 中午11:25
收件人: "dev";

主题: Re: java.io.IOException:
NoSuchObjectException(message:default.kylin_intermediate_learn_kylin



I have encountered this problem, it is more likely because your current
hive metastore config is error, could you tell some more detailed
infomation about your env.

2016-01-07 10:23 GMT+08:00 和风 <363938...@qq.com>:


hi:
   i build cube have a error.
logs:
java.io.IOException:


NoSuchObjectException(message:default.kylin_intermediate_learn_kylin_four_2015020100_2015123000_8d26cc4b_e012_4414_a89b_c8d9323ae277

table not found)
 at


org.apache.hive.hcatalog.mapreduce.HCatInputFormat.setInput(HCatInputFormat.java:97)

 at


org.apache.hive.hcatalog.mapreduce.HCatInputFormat.setInput(HCatInputFormat.java:51)

 at


org.apache.kylin.job.hadoop.cube.FactDistinctColumnsJob.setupMapper(FactDistinctColumnsJob.java:101)

 at


org.apache.kylin.job.hadoop.cube.FactDistinctColumnsJob.run(FactDistinctColumnsJob.java:77)

 at org.apache.hadoop.util.ToolRunner.run(ToolRunner.java:70)
 at org.apache.hadoop.util.ToolRunner.run(ToolRunner.java:84)
 at


org.apache.kylin.job.common.MapReduceExecutable.doWork(MapReduceExecutable.java:120)

 at


org.apache.kylin.job.execution.AbstractExecutable.execute(AbstractExecutable.java:107)

 at


org.apache.kylin.job.execution.DefaultChainedExecutable.doWork(DefaultChainedExecutable.java:51)

 at


org.apache.kylin.job.execution.AbstractExecutable.execute(AbstractExecutable.java:107)

 at


org.apache.kylin.job.impl.threadpool.DefaultScheduler$JobRunner.run(DefaultScheduler.java:130)

 at


java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1145)

 at


java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:615)

 at java.lang.Thread.run(Thread.java:745)
Caused by:


NoSuchObjectException(message:default.kylin_intermediate_learn_kylin_four_2015020100_2015123000_8d26cc4b_e012_4414_a89b_c8d9323ae277

table not found)
 at


org.apache.hadoop.hive.metastore.HiveMetaStore$HMSHandler.get_table_core(HiveMetaStore.java:1808)

 at


org.apache.hadoop.hive.metastore.HiveMetaStore$HMSHandler.get_table(HiveMetaStore.java:1778)

 at sun.reflect.NativeMethodAccessorImpl.invoke0(Native Method)
 at


sun.reflect.NativeMethodAccessorImpl.invoke(NativeMethodAccessorImpl.java:57)

 at


sun.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorImpl.java:43)

 at java.lang.reflect.Method.invoke(Method.java:606)
 at


org.apache.hadoop.hive.metastore.RetryingHMSHandler.invoke(RetryingHMSHandler.java:107)

 at com.sun.proxy.$Proxy47.get_table(Unknown Source)
 at


org.apache.hadoop.hive.metastore.HiveMetaStoreClient.getTable(HiveMetaStoreClient.java:1208)

 at 

Re: Java.lang.NoSuchMethodError: org.apache.hadoop.yarn.conf.YarnConfiguration.getServiceAddressConfKeys (Lorg/apache/hadoop/conf/Configuration; ) Ljava/util/List;

[Xiaoyu Wang]

Hi Sai!
You can see the same topic :
http://apache-kylin.74782.x6.nabble.com/NoSuchMethodError-org-apache-hadoop-yarn-conf-YarnConfiguration-getServiceAddressConfKeys-td2937.html#a2943

在 2016年01月05日 18:27, Kiriti Sai 写道:

Hi,
I've recently update the binaries in my Kylin setup from v1.1 incubating to
v1.2. The cubes which were building fine till now are throwing the above
error.
This error is occuring in the extract fact table distinct columns step.
(Step 2).
Can you please point out any mistakes with the upgrading procedure or
anything else.

Thank you,
Sai Kiriti B.

Re: 答复: sample.sh running error

[Xiaoyu Wang]

It may be the hbase version kylin compile is conflict with your hbase 
cluster.

which version do you use:kylin,hbase and hadoop?


在 2015年12月29日 17:29, 胡志华(万里通科技及数据中心商务智能团队数据分析 
组) 写道:



Why nobody answer my question?



-邮件原件-
发件人: Shi, Shaofeng [mailto:shao...@ebay.com]
发送时间: 2015年12月29日 10:45
收件人: dev@kylin.apache.org
主题: Re: sample.sh running error

Need double check this error:
Caused by: java.lang.NoSuchMethodError:
org.apache.hadoop.hbase.client.HBaseAdmin.(Lorg/apache/hadoop/hbase/c
lient/HConnection;)V
 at
org.apache.kylin.common.persistence.HBaseConnection.createHTableIfNeeded(HB
aseConnection.java:90)
 at
org.apache.kylin.common.persistence.HBaseResourceStore.createHTableIfNeeded
(HBaseResourceStore.java:105)
 at
org.apache.kylin.common.persistence.HBaseResourceStore.(HBaseResource
Store.java:92)
 ... 12 more



What’s your HBase version and Kylin version?

On 12/29/15, 10:16 AM, "胡志华(万里通科技及数据中心商务智能团队数据分析组)"
 wrote:


Caused by: java.lang.NoSuchMethodError:
org.apache.hadoop.hbase.client.HBaseAdmin.(Lorg/apache/hadoop/hbase/
client/HConnection;)V
at
org.apache.kylin.common.persistence.HBaseConnection.createHTableIfNeeded(H
BaseConnection.java:90)
at
org.apache.kylin.common.persistence.HBaseResourceStore.createHTableIfNeede
d(HBaseResourceStore.java:105)
at
org.apache.kylin.common.persistence.HBaseResourceStore.(HBaseResourc
eStore.java:92)
... 12 more






The information in this email is confidential and may be legally privileged. If 
you have received this email in error or are not the intended recipient, please 
immediately notify the sender and delete this message from your computer. Any 
use, distribution, or copying of this email other than by the intended 
recipient is strictly prohibited. All messages sent to and from us may be 
monitored to ensure compliance with internal policies and to protect our 
business.
Emails are not secure and cannot be guaranteed to be error free as they can be 
intercepted, amended, lost or destroyed, or contain viruses. Anyone who 
communicates with us by email is taken to accept these risks.

鏀跺彂閭欢鑰呰娉ㄦ剰锛?鏈偖浠跺惈淇濆瘑淇℃伅锛岃嫢璇敹鏈偖浠讹紝璇峰姟蹇呴€氱煡鍙戦€佷汉骞剁洿鎺ュ垹鍘伙紝涓嶅緱浣跨敤銆佷紶鎾垨澶嶅埗鏈偖浠躲€?杩涘嚭閭欢鍧囧彈鍒版湰鍏徃鍚堣鐩戞帶銆傞偖浠跺彲鑳藉彂鐢熻鎴暀銆佽淇敼銆佷涪澶便€佽鐮村潖鎴栧寘鍚绠楁満鐥呮瘨绛変笉瀹夊叏鎯呭喌銆?

Re: 2.x-staging branch CubeDesc problem

[Xiaoyu Wang]

I'm working on KYLIN-1122 dependent on the refactor from KYLIN-976.
Need the newest code in 2.x-staging!

在 2015年12月16日 10:29, hongbin ma 写道:

​hi, xiaoyu

please do not use 2.x-staging as the frontend is falling behind from backend
use 2.0-rc as it is going to be the official kylin-2.0 release​

On Tue, Dec 15, 2015 at 11:23 PM, 王晓雨  wrote:


s"]->org.apache.kylin.cube.model.DimensionDesc["column"])
 at com.fasterxml.jackson.databind.JsonMappin

Re: About the website build problem

[Xiaoyu Wang]

Thanks hongbin!
I will try it.

在 2015年12月09日 17:50, hongbin ma 写道:

i followed this page and it worked out well:
http://kylin.apache.org/development/howto_docs.html

On Wed, Dec 9, 2015 at 5:45 PM, Xiaoyu Wang <wangxiao...@jd.com> wrote:


I'm try to build the website follow the README guide in
https://github.com/apache/kylin/tree/1.x-staging/website
but meet a problem when execute "bundle install" command!

1.cd website
2.svn co https://svn.apache.org/repos/asf/kylin/site _site
3.sudo apt-get install rubygems ruby2.1-dev zlib1g-dev (linux)
4.sudo gem install bundler github-pages jekyll
5.bundle install

the step 1~4 is passed.
$ ruby -v
ruby 2.0.0p643 (2015-02-25 revision 49749) [x86_64-linux]
$ gem -v
2.4.8
$ jekyll -v
jekyll 3.0.1
$ bundle -v
Bundler version 1.10.6

when execute the 5 step command got the error "Could not locate Gemfile or
.bundle/ directory":
~/apache/kylin/website$ bundle install
Could not locate Gemfile or .bundle/ directory

There is no Gemfile or .bundle directory in the website directory.
Any one meet the same problem?

Re: The Apache Software Foundation Announces Apache™ Kylin™ as a Top-Level Project

[Xiaoyu Wang]

Congratulations!

在 2015年12月09日 11:22, Abhilash L L 写道:

Congrats!

Regards,
Abhilash

On Wed, Dec 9, 2015 at 6:51 AM, 王猛  wrote:


Great ！

2015-12-08 22:25 GMT+08:00 Luke Han :


Hi community,
 I'm so exciting to let you know the official Kylin TLP announcement
from ASF is live now,
 Please  check blow links for more detail.

 Great thanks to all PMCs, committers, contributors, users and
everyone,
especially thanks to our mentors and ASF.

  Thanks.
Luke


- NASDAQ GlobeNewswire


http://globenewswire.com/news-release/2015/12/08/793713/0/en/The-Apache-Software-Foundation-Announces-Apache-Kylin-as-a-Top-Level-Project.html

- ASF "Foundation" blog http://s.apache.org/GZx

- @TheASF Twitter feed
https://twitter.com/TheASF/status/674181852018683904