Re: 关于measure预计算

[王晓雨]

Hi tongxin!
for the in memory build you can see:
https://github.com/apache/kylin/blob/master/core-cube/src/main/java/org/apache/kylin/cube/inmemcubing/InMemCubeBuilder.java
and the mr build:
https://github.com/apache/kylin/blob/master/engine-mr/src/main/java/org/apache/kylin/engine/mr/steps/CuboidReducer.java


在 2016年6月18日，10:05，仇同心 > 写道：

大家好：
在cube构建时，根据cube 设计时，measure可以有不同的聚合函数。我想找到根据不同的聚合函数来做计算的源码，但是在

// Phase 3: Build Cube
addLayerCubingSteps(result, jobId, cuboidRootPath); // layer cubing, only 
selected algorithm will execute
result.addTask(createInMemCubingStep(jobId, cuboidRootPath)); // inmem cubing, 
only selected algorithm will execute
outputSide.addStepPhase3_BuildCube(result, cuboidRootPath);


我并没有找到相应的mapreduce函数来实现度量使用的聚合函数计算，也就是在存入hbase前，预计算的那段代码，谁能告诉我具体在哪实现的？

谢谢！

Re: select * from fact_table

[王晓雨]

I add a document about RAW measure.
see:
http://kylin.apache.org/blog/2016/05/29/raw-measure-in-kylin/

在 2016年5月26日，11:08，王晓雨 <wangxiao...@jd.com<mailto:wangxiao...@jd.com>> 写道：

Comming soon!

在 2016年05月26日 11:02, Mars J 写道:
I'm looking forward the documents too~

2016-05-26 9:48 GMT+08:00 赵天烁 
<zhaotians...@meizu.com<mailto:zhaotians...@meizu.com>>:

Waiting for the release note~

-

赵天烁
Kevin Zhao
Java工程师
研发中心-Flyme-大数据-平台研发
+ 86 18826908281 | zhaotians...@meizu.com<mailto:zhaotians...@meizu.com>

珠海市魅族科技有限公司
MEIZU Technology Co., Ltd.
广东省珠海市科技创新海岸魅族科技楼
MEIZU Tech Bldg., Technology & Innovation Coast
Zhuhai, 519085, Guangdong, China


meizu.com<http://meizu.com>



-邮件原件-
发件人: lidong [mailto:lid...@apache.org]
发送时间: 2016年5月26日 9:48
收件人: dev@kylin.apache.org
主题: Re: 答复: select * from fact_table

It’s under voting currently.

http://apache-kylin.74782.x6.nabble.com/VOTE-Release-apache-kylin-1-5-2-release-candidate-3-td4672.html
If the vote got passed in 72 hrs, the binary release will roll out soon.


Thanks,
Dong


Original Message
Sender:赵天烁zhaotians...@meizu.com
Recipient:dev@kylin.apache.org...@kylin.apache.org
Date:Thursday, May 26, 2016 09:21
Subject:答复: select * from fact_table


Seems like already,
https://github.com/apache/kylin/releases/tag/kylin-1.5.2
- 赵天烁 Kevin Zhao
Java工程师 研发中心-Flyme-大数据-平台研发 + 86 18826908281 | zhaotians...@meizu.com
珠海市魅族科技有限公司 MEIZU Technology Co., Ltd. 广东省珠海市科技创新海岸魅族科技楼 MEIZU Tech Bldg.,
Technology  Innovation Coast Zhuhai, 519085, Guangdong, China meizu.com
-邮件原件- 发件人: Mars J [mailto:xujiao.myc...@gmail.com] 发送时间:
2016年5月26日 9:16 收件人: dev@kylin.apache.org 主题: Re: select * from
fact_table when 1.5.2 release ? 2016-05-22 13:28 GMT+08:00 Li Yang
liy...@apache.org:  The coming 1.5.2 release has this fixed. Before that,
please specify  the aggregation function or use group by clause.   On Wed,
May 18, 2016 at 3:16 PM, Mars J xujiao.myc...@gmail.com wrote:Hello
all,   after build a cube , using the sql select * from fact_table, it
 will not return actual fact table data but rather the follow one,I   have
define 3   measure include count/min/raw [image: 内嵌图片 1] DIMA_ID
and DIMC_ID are dimension columns defined in model   dimensions  step.
 Why 'select * from fact_table' doesn't return real fact data ? how   to
query the all fact data ?

Re: Sample cube giving error on step 2

[王晓雨]

Hi
If your kylin server is a hbase client node not a regionserver or master,
You can replace all hadoop jar files in $HBASE_HOME/lib to your hadoop cluster 
version.

> 在 2016年4月8日，18:33，Li Yang  写道：
> 
> The latest version 1.5.1 under voting will have a package for HBase 1.x.
> Stay tuned and give it a try.
> 
> On Wed, Apr 6, 2016 at 8:38 PM, Yagyank Chadha  wrote:
> 
>> Hi,
>> 
>> I am trying to run sample cube 2 but is stuck on step 2. My problem is same
>> as given here(
>> 
>> http://apache-kylin.74782.x6.nabble.com/NoSuchMethodError-org-apache-hadoop-yarn-conf-YarnConfiguration-getServiceAddressConfKeys-td2937.html
>> )
>> but I dont know how to change the hadoop bundeled whith hbase. Because the
>> hadoop I installed manually is 2.6 and the hadoop  bundled wtih hbase is
>> 2.2 so do I need to upgrade Hbase to 1.1.3 or is there anyother solution?
>> 
>> Below is the error I am getting
>> 
>> java.lang.NoSuchMethodError:
>> 
>> org.apache.hadoop.yarn.conf.YarnConfiguration.getServiceAddressConfKeys(Lorg/apache/hadoop/conf/Configuration;)Ljava/util/List;
>>at
>> org.apache.hadoop.yarn.conf.HAUtil.getConfKeyForRMInstance(HAUtil.java:239)
>>at
>> org.apache.hadoop.yarn.conf.HAUtil.getConfValueForRMInstance(HAUtil.java:250)
>>at
>> org.apache.hadoop.yarn.conf.HAUtil.getConfValueForRMInstance(HAUtil.java:262)
>>at
>> org.apache.kylin.engine.mr.common.MapReduceExecutable.getRestStatusCheckUrl(MapReduceExecutable.java:220)
>>at
>> org.apache.kylin.engine.mr.common.MapReduceExecutable.doWork(MapReduceExecutable.java:137)
>>at
>> org.apache.kylin.job.execution.AbstractExecutable.execute(AbstractExecutable.java:114)
>>at
>> org.apache.kylin.job.execution.DefaultChainedExecutable.doWork(DefaultChainedExecutable.java:50)
>>at
>> org.apache.kylin.job.execution.AbstractExecutable.execute(AbstractExecutable.java:114)
>>at
>> org.apache.kylin.job.impl.threadpool.DefaultScheduler$JobRunner.run(DefaultScheduler.java:124)
>>at
>> java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1142)
>>at
>> java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:617)
>>at java.lang.Thread.run(Thread.java:745)
>> 
>> 
>> 
>> --
>> Regards
>> *Yagyank chadha*
>> 
>> *Undergraduate student*
>> *Computer Science Engineering*
>> *Thapar University, Patiala*
>> 

Re: [VOTE] Release apache-kylin-1.5.0 (release candidate 1)

[王晓雨]

+1(no binding)

verify signature passed
mvn test passed

> 在 2016年3月12日，21:14，ShaoFeng Shi  写道：
> 
> Verified gpg signature and md5/sha1 hash, "mvn test" is passed; here is my
> vote:
> 
> +1 (binding)
> 
> 2016-03-12 19:05 GMT+08:00 Dong Li :
> 
>> +1 (no binding)
>> mvn test passed
>> 
>> 
>> Thanks,
>> Dong Li
>> 
>> 
>> Original Message
>> Sender:Li yangliy...@apache.org
>> Recipient:dev...@kylin.apache.org
>> Date:Saturday, Mar 12, 2016 18:14
>> Subject:[VOTE] Release apache-kylin-1.5.0 (release candidate 1)
>> 
>> 
>> Hi all, I have created a build for Apache Kylin 1.5.0, release candidate
>> 1. It is the first release from the master branch after the reorg.
>> Significant changes have taken place in metadata and cube data, upgrade
>> from v1.3 and before is difficult. Recommend build new cube from scratch
>> with this version. Changes highlights: [KYLIN-875] - A plugin-able
>> architecture, to allow alternative cube engine / storage engine / data
>> source. [KYLIN-1245] - A better MR cubing algorithm, about 1.5 times faster
>> by comparing hundreds of jobs. [KYLIN-942] - A better storage engine, makes
>> query roughly 2 times faster (especially for slow queries) by comparing
>> tens of thousands sqls. [KYLIN-738] - Streaming cubing EXPERIMENTAL
>> support, source from kafka, build cube in-mem at minutes interval
>> [KYLIN-943] - TopN pre-calculation (more UDFs coming) [KYLIN-1065] - ODBC
>> compatible with Tableau 9.1, MS Excel, MS PowerBI [KYLIN-1219] - Kylin
>> support SSO with Spring SAML Thanks to everyone who has contributed to this
>> release. Here’s release notes:
>> https://kylin.apache.org/docs15/release_notes.html The commit to be voted
>> upon:
>> https://github.com/apache/kylin/commit/64d02018fcf082745d4104d604646058fcb7e17c
>> The artifacts to be voted on are located here:
>> https://dist.apache.org/repos/dist/dev/kylin/apache-kylin-1.5.0-rc1/ The
>> hashes of the artifacts are as follows: apache-kylin-1.5.0-src.tar.gz.md5
>> 7121d4eadc71bfaf8519fe843500c7a5 apache-kylin-1.5.0-src.tar.gz.sha1
>> abd34649b162ba06f7732b55748628c6c0f78222 A staged Maven repository is
>> available for review at:
>> https://repository.apache.org/content/repositories/orgapachekylin-1023
>> Release artifacts are signed with the following key:
>> https://people.apache.org/keys/committer/liyang.asc Please vote on
>> releasing this package as Apache Kylin 1.5.0. The vote is open for the next
>> 72 hours and passes if a majority of at least three +1 PPMC votes are cast.
>> [ ] +1 Release this package as Apache Kylin 1.5.0 [ ] 0 I don't feel
>> strongly about it, but I'm okay with the release [ ] -1 Do not release this
>> package because... Here is my vote: +1 (binding) Yang
>> 
> 
> 
> 
> -- 
> Best regards,
> 
> Shaofeng Shi

Re: About the integration test on 2.x-staging

[王晓雨]

It cause by the Chinese garbled true!
I download the Sandbox_HDP_2.2.4.2_VMWare.ova from 
hortonworks.com<http://hortonworks.com>
By default the /etc/sysconfig/i18n is:

LANG="en_US.UTF-8"
SYSFONT="latarcyrheb-sun16"

I execute the command:
yum groupinstall chinese-support

and change the i18n config to :
LANG="en_US.UTF-8"
SUPPORTED="zh_CN.UTF-8:zh_CN:zh"
SYSFONT="latarcyrheb-sun16"

It works!

Thanks hongbin!

在 2016年1月25日，17:31，hongbin ma 
<mahong...@apache.org<mailto:mahong...@apache.org>> 写道：

interesting,, it's also be a lesson to us all.

can you define "VMWare not support Chinese" and why java the UT (actually a
java program) cannot process the file?

On Mon, Jan 25, 2016 at 5:18 PM, 王晓雨 
<wangxiao...@jd.com<mailto:wangxiao...@jd.com>> wrote:

It is cause by My VMWare not support Chinese….
Chinese garbled cause the exception! I will try to make the VM work!


在 2016年1月25日，16:17，Xiaoyu Wang 
<wangxy...@gmail.com<mailto:wangxy...@gmail.com>> 写道：

I see in examples/test_case_data/localmeta/data/flatten_data_for_ii.csv
file has Chinese garbled！
I copy the code from local to sandbox VMWare machine! and in local it is
good. I will have a try to convert the file encoding.



在 2016年1月25日，15:51，Xiaoyu Wang 
<wangxy...@gmail.com<mailto:wangxy...@gmail.com>> 写道：

The same error when run in sandbox KYLIN_HOME:
L4J [2016-01-25
07:49:01,566][ERROR][org.apache.kylin.dict.TrieDictionary] - Not a valid
value: ??
Tests run: 2, Failures: 0, Errors: 1, Skipped: 0, Time elapsed: 2.585
sec <<< FAILURE! - in org.apache.kylin.invertedindex.InvertedIndexLocalTest
testCodec(org.apache.kylin.invertedindex.InvertedIndexLocalTest)  Time
elapsed: 0.727 sec  <<< ERROR!
java.lang.IllegalArgumentException: Value not exists!
at
org.apache.kylin.common.util.Dictionary.getIdFromValueBytes(Dictionary.java:161)
at
org.apache.kylin.dict.TrieDictionary.getIdFromValueImpl(TrieDictionary.java:158)
at
org.apache.kylin.common.util.Dictionary.getIdFromValue(Dictionary.java:97)
at
org.apache.kylin.common.util.Dictionary.getIdFromValue(Dictionary.java:77)
at
org.apache.kylin.invertedindex.index.TableRecord.setValueString(TableRecord.java:116)
at
org.apache.kylin.invertedindex.InvertedIndexLocalTest.loadRecordsSorted(InvertedIndexLocalTest.java:187)
at
org.apache.kylin.invertedindex.InvertedIndexLocalTest.testCodec(InvertedIndexLocalTest.java:133)


Results :

Tests in error:
InvertedIndexLocalTest.testCodec:133->loadRecordsSorted:187 ?
IllegalArgument ...

Tests run: 2, Failures: 0, Errors: 1, Skipped: 0

[INFO]

[INFO] Reactor Summary:
[INFO]
[INFO] Kylin:HadoopOLAPEngine . SUCCESS [
0.564 s]
[INFO] Kylin:AtopCalcite .. SUCCESS [
0.749 s]
[INFO] Kylin:Core-Common .. SUCCESS [
0.982 s]
[INFO] Kylin:Core-Metadata  SUCCESS [
0.382 s]
[INFO] Kylin:Core-Dictionary .. SUCCESS [
0.218 s]
[INFO] Kylin:Core-Cube  SUCCESS [
0.310 s]
[INFO] Kylin:Core-Job . SUCCESS [
0.490 s]
[INFO] Kylin:Core-Storage . SUCCESS [
0.394 s]
[INFO] Kylin:InvertedIndex  FAILURE [
6.698 s]
[INFO] Kylin:Engine-MR  SKIPPED
[INFO] Kylin:Engine-Streaming . SKIPPED
[INFO] Kylin:Storage-HBase  SKIPPED


But I run the InvertedIndexLocalTest UT in local machine is ok.



在 2016年1月25日，15:45，hongbin ma 
<mahong...@apache.org<mailto:mahong...@apache.org>> 写道：

or maybe you should try this on sandbox's KYLIN_HOME:

mvn   test -Dtest=org.apache.kylin.invertedindex.InvertedIndexLocalTest
-DfailIfNoTests=false






--
Regards,

*Bin Mahone | 马洪宾*
Apache Kylin: http://kylin.io
Github: https://github.com/binmahone

About the integration test on 2.x-staging

[王晓雨]

Hi all,
I’m working on KYLIN-1122 integration test.
I update the newest code from 2.x-staging,nothing change.Install the 
Sandbox_HDP_2.2.4.2 in VMWare , Hadoop env is running good.
when I run the test shell test_all_against_hdp_2_2_4_2_2.sh
got exception at Storage-HBase model test, any one meet the same problem?
exception :

2016-01-23 23:13:37,745 ERROR [main] persistence.ResourceStore 
(ResourceStore.java:createResourceStore(88)) - Create new store instance failed
java.lang.reflect.InvocationTargetException
at sun.reflect.NativeConstructorAccessorImpl.newInstance0(Native Method)
at 
sun.reflect.NativeConstructorAccessorImpl.newInstance(NativeConstructorAccessorImpl.java:57)
at 
sun.reflect.DelegatingConstructorAccessorImpl.newInstance(DelegatingConstructorAccessorImpl.java:45)
at java.lang.reflect.Constructor.newInstance(Constructor.java:526)
at 
org.apache.kylin.common.persistence.ResourceStore.createResourceStore(ResourceStore.java:82)
at 
org.apache.kylin.common.persistence.ResourceStore.getStore(ResourceStore.java:101)
at 
org.apache.kylin.storage.hbase.steps.ITHBaseResourceStoreTest.testHBaseStore(ITHBaseResourceStoreTest.java:57)
at sun.reflect.NativeMethodAccessorImpl.invoke0(Native Method)
at sun.reflect.NativeMethodAccessorImpl.invoke(NativeMethodAccessorImpl.java:57)
at 
sun.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorImpl.java:43)
at java.lang.reflect.Method.invoke(Method.java:606)
at 
org.junit.runners.model.FrameworkMethod$1.runReflectiveCall(FrameworkMethod.java:47)
at 
org.junit.internal.runners.model.ReflectiveCallable.run(ReflectiveCallable.java:12)
at 
org.junit.runners.model.FrameworkMethod.invokeExplosively(FrameworkMethod.java:44)
at 
org.junit.internal.runners.statements.InvokeMethod.evaluate(InvokeMethod.java:17)
at org.junit.internal.runners.statements.RunBefores.evaluate(RunBefores.java:26)
at org.junit.internal.runners.statements.RunAfters.evaluate(RunAfters.java:27)
at org.junit.runners.ParentRunner.runLeaf(ParentRunner.java:271)
at 
org.junit.runners.BlockJUnit4ClassRunner.runChild(BlockJUnit4ClassRunner.java:70)
at 
org.junit.runners.BlockJUnit4ClassRunner.runChild(BlockJUnit4ClassRunner.java:50)
at org.junit.runners.ParentRunner$3.run(ParentRunner.java:238)
at org.junit.runners.ParentRunner$1.schedule(ParentRunner.java:63)
at org.junit.runners.ParentRunner.runChildren(ParentRunner.java:236)
at org.junit.runners.ParentRunner.access$000(ParentRunner.java:53)
at org.junit.runners.ParentRunner$2.evaluate(ParentRunner.java:229)
at org.junit.runners.ParentRunner.run(ParentRunner.java:309)
at 
org.apache.maven.surefire.junit4.JUnit4Provider.execute(JUnit4Provider.java:264)
at 
org.apache.maven.surefire.junit4.JUnit4Provider.executeTestSet(JUnit4Provider.java:153)
at 
org.apache.maven.surefire.junit4.JUnit4Provider.invoke(JUnit4Provider.java:124)
at 
org.apache.maven.surefire.booter.ForkedBooter.invokeProviderInSameClassLoader(ForkedBooter.java:200)
at 
org.apache.maven.surefire.booter.ForkedBooter.runSuitesInProcess(ForkedBooter.java:153)
at org.apache.maven.surefire.booter.ForkedBooter.main(ForkedBooter.java:103)
Caused by: org.apache.kylin.common.persistence.StorageException: Error when 
open connection hbase
at org.apache.kylin.storage.hbase.HBaseConnection.get(HBaseConnection.java:153)
at 
org.apache.kylin.storage.hbase.HBaseResourceStore.getConnection(HBaseResourceStore.java:87)
at 
org.apache.kylin.storage.hbase.HBaseResourceStore.createHTableIfNeeded(HBaseResourceStore.java:112)
at 
org.apache.kylin.storage.hbase.HBaseResourceStore.(HBaseResourceStore.java:99)
... 32 more
Caused by: java.io.IOException: java.lang.reflect.InvocationTargetException
at 
org.apache.hadoop.hbase.client.HConnectionManager.createConnection(HConnectionManager.java:417)
at 
org.apache.hadoop.hbase.client.HConnectionManager.createConnection(HConnectionManager.java:310)
at org.apache.kylin.storage.hbase.HBaseConnection.get(HBaseConnection.java:140)
... 35 more
Caused by: java.lang.reflect.InvocationTargetException
at sun.reflect.NativeConstructorAccessorImpl.newInstance0(Native Method)
at 
sun.reflect.NativeConstructorAccessorImpl.newInstance(NativeConstructorAccessorImpl.java:57)
at 
sun.reflect.DelegatingConstructorAccessorImpl.newInstance(DelegatingConstructorAccessorImpl.java:45)
at java.lang.reflect.Constructor.newInstance(Constructor.java:526)
at 
org.apache.hadoop.hbase.client.HConnectionManager.createConnection(HConnectionManager.java:415)
... 37 more
Caused by: java.lang.NoClassDefFoundError: Could not initialize class 
org.apache.hadoop.hbase.protobuf.ProtobufUtil
at org.apache.hadoop.hbase.ClusterId.parseFrom(ClusterId.java:64)
at 
org.apache.hadoop.hbase.zookeeper.ZKClusterId.readClusterIdZNode(ZKClusterId.java:69)
at 
org.apache.hadoop.hbase.client.ZooKeeperRegistry.getClusterId(ZooKeeperRegistry.java:83)
at 
org.apache.hadoop.hbase.client.HConnectionManager$HConnectionImplementation.retrieveClusterId(HConnectionManager.java:858)
at 

Re: About the integration test on 2.x-staging

[王晓雨]

Thanks hongbin’s reply on holiday!
My commit id is same to you,and I’m running it on my local machine! and connect 
to HDP cluster on my VMWare.
I will have a try to run it on sandbox and feedback!

> 在 2016年1月24日，12:24，hongbin ma  写道：
> 
> ​did you run the ​ test_all_against_hdp_2_2_4_2_2.sh on sandbox or locally?
> it is suggested to run it on sandbox, so did our CI.
> 
> last time my CI succeed was on 95918af703f967683c05d57fcf6e3929ad5647b4,
> what is your commit id?
> 
> 
> 
> -- 
> Regards,
> 
> *Bin Mahone | 马洪宾*
> Apache Kylin: http://kylin.io
> Github: https://github.com/binmahone

Re: Java.lang.NoSuchMethodError: org.apache.hadoop.yarn.conf.YarnConfiguration.getServiceAddressConfKeys (Lorg/apache/hadoop/conf/Configuration; ) Ljava/util/List;

[王晓雨]

Hi，
When kylin build cube，it will execute mapreduce job，kylin use ResourceManager 
address to get the mapreduce job status。kylin read the kylin.properties file to 
get the RM url first。if not config，kylin will  read hadoop config to get the RM 
address by HAUtils api in hadoop 2.4+。because hadoop support RM HA after 
hadoop2.4。
but hbase0.98x complie with hadoop 2.2 by default。does not support RM HA。so you 
got the exception！
the config property is correct，kylin will replace the $｛job_id｝to real 
jobid，you can only replace the YOUR_RM_AND_PORT to your RM address and port 
like：192.168.2.2:8088

thanks！


> 在 2016年1月5日，20:29，Kiriti Sai  写道：
> 
> Hi,
> Can you please explain it in a slightly detailed manner. I understand that
> the url you are referring to is the resource manager url, but it's
> particular to a job right? How can something particular to a job be set as
> a property for Kylin. I'm sorry if I'm mistaken.
> Or are you intending that {job_id} will actually get the id of the MR job
> running? Sorry for these naive questions.
> 
> Thank you.
>> On Jan 5, 2016 8:42 PM, "Xiaoyu Wang"  wrote:
>> 
>> Hi,
>> You can set the property in kylin.properties file
>> kylin.job.yarn.app.rest.check.status.url=
>> https://YOUR_RM_AND_PORT/ws/v1/cluster/apps/${job_id}?anonymous=true
>> 
>>> 在 2016年01月05日 19:38, Kiriti Sai 写道:
>>> 
>>> Hi Wang,
>>> The version of Hadoop in the cluster is 2.6. I've setup Hbase 0.98.15
>>> using
>>> binaries, in which there are some jar files of the Hadoop version 2.2,
>>> like
>>> hadoop-yarn-client-2.2.jar.
>>> As I've mentioned already, this setup has worked with the previous version
>>> of Kylin 1.1-incubating, but has been throwing this error after updating
>>> to
>>> v1.2. (Dont know if there is anything due to this, but just mentioning
>>> it).
>>> So, is there any other to solve this other than building HBase from source
>>> using the latest Hadoop libraries.
>>> 
>>> Thank You.
>>> On Jan 5, 2016 8:26 PM, "Xiaoyu Wang"  wrote:
>>> 
>>> Hi,
 The api YarnConfiguration.getServiceAddressConfKeys required Hadoop2.4+
 Which version Hadoop do you use ?
 You can recompile the hbase with hadoop 2.4+ version or your hadoop
 cluster version.
 
 
 
 
 在 2016年01月05日 18:52, Kiriti Sai 写道:
 
 Hi,
> I have looked at the suggested link before posting the question here. I
> didn't understand how to resolve this issue.
> I've tried replacing the 2.2 hadoop yarn libs present in the HBase lib
> directory but then it throws FileNotFoundException.
> Can you please explain in a detailed way how to resolve this issue.
> I'm using Hbase 0.98.15-hadoop2 version.
> 
> Thank you,
> Sai Kiriti B
> On Jan 5, 2016 7:38 PM, "Xiaoyu Wang"  wrote:
> 
> Hi Sai!
> 
>> You can see the same topic :
>> 
>> 
>> 
>> http://apache-kylin.74782.x6.nabble.com/NoSuchMethodError-org-apache-hadoop-yarn-conf-YarnConfiguration-getServiceAddressConfKeys-td2937.html#a2943
>> 
>> 在 2016年01月05日 18:27, Kiriti Sai 写道:
>> 
>> Hi,
>> 
>>> I've recently update the binaries in my Kylin setup from v1.1
>>> incubating
>>> to
>>> v1.2. The cubes which were building fine till now are throwing the
>>> above
>>> error.
>>> This error is occuring in the extract fact table distinct columns
>>> step.
>>> (Step 2).
>>> Can you please point out any mistakes with the upgrading procedure or
>>> anything else.
>>> 
>>> Thank you,
>>> Sai Kiriti B.
>> 

Re: Welcome new Apache Kylin committer: Luwei Chen

[王晓雨]

Welcome!!!

> 在 2015年12月30日，22:42，ShaoFeng Shi  写道：
> 
> Welcome Luwei!
> 
> 2015-12-30 21:52 GMT+08:00 hongbin ma :
> 
>> welcome!
>> 
>> On Wed, Dec 30, 2015 at 9:51 PM, 李栋  wrote:
>> 
>>> Welcome Luwei!
>>> 
>>> Dong Li
>>> 
>>> 
>>> 发自 网易邮箱大师
>>> 
>>> 
>>> 
>>> On 2015-12-30 21:47 , Luke Han Wrote:
>>> 
>>> I am very pleased to announce that the Project Management Committee
>>> (PMC) of Apache Kylin has asked Luwei Chen to become Apache Kylin
>> committer
>>> ,
>>> and she has already accepted.
>>> 
>>> Luwei has already made many contribution to Kylin community, about
>> website,
>>> documentation, UI and others as well.
>>> 
>>> Welcome Luwei, our first female committer:)
>>> Please share with us a little about yourself,
>>> 
>>> Luke
>>> 
>>> On behalf of the Apache Kylin PPMC
>>> 
>> 
>> 
>> 
>> --
>> Regards,
>> 
>> *Bin Mahone | 马洪宾*
>> Apache Kylin: http://kylin.io
>> Github: https://github.com/binmahone
>> 
> 
> 
> 
> -- 
> Best regards,
> 
> Shaofeng Shi

Re: [VOTE] Release apache-kylin-1.2 (release candidate 1)

[王晓雨]

+1(binding)

md5 is OK
mvn test is OK
script/package.sh is OK


> 在 2015年12月17日，18:42，Huang Hua  写道：
> 
> +1(binding)
> 
> md5 & sha1 - verified
> mvn test - verified
> mvn package -DskipTests - verified
> 
>> -邮件原件-
>> 发件人: dev-return-5324-huanghua=mininglamp@kylin.apache.org
>> [mailto:dev-return-5324-huanghua=mininglamp@kylin.apache.org] 代表
>> Luke Han
>> 发送时间: 2015年12月17日 14:25
>> 收件人: dev@kylin.apache.org
>> 主题: Re: [VOTE] Release apache-kylin-1.2 (release candidate 1)
>> 
>> +1(binding)
>> 
>> mvn test passed
>> md5 verified
>> 
>> 
>> 
>> 
>> Best Regards!
>> -
>> 
>> Luke Han
>> 
>> On Thu, Dec 17, 2015 at 1:27 PM, Jian Zhong  wrote:
>> 
>>> mvn test passed
>>> md5 verified
>>> 
>>> +1(binding)
>>> 
>>> On Thu, Dec 17, 2015 at 12:05 AM, Dong Li  wrote:
>>> 
 +1(no binding)
 
 build success
 mvn test passed
 md5 verified
 public key signed verified
 
 Thanks,
 
 Dong Li
 
 2015-12-16 22:36 GMT+08:00 ShaoFeng Shi :
 
> Dear Kylin committers and PMC members,
> 
> Just a kind reminder: v1.2 is the first release after Kylin
> becomes a
 TLP,
> and it includes several important features/fixes, please don't
> forget
>>> to
> verify and vote before you leaving for the vacation; Thanks everybody!
> 
> 2015-12-15 14:51 GMT+08:00 ShaoFeng Shi :
> 
>> Hi all,
>> 
>> I have created a build for Apache Kylin 1.2, release candidate 1.
>> 
>> Changes highlights:
>> 
>> [KYLIN-596] - Support Excel and Power BI [KYLIN-1065] - ODBC
>> driver support tableau 9.1 [KYLIN-1021] - Upload dependent jars
>> of kylin to HDFS and set tmpjars [KYLIN-1168] - Couldn't save
>> cube after doing some modification
>> 
>> Thanks to everyone who has contributed to this release.
>> Here’s release notes:
>> https://kylin.apache.org/docs/release_notes.html
>> 
>> The commit to be voted upon:
>> 
>> 
>> 
> 
 
>>> 
>> https://github.com/apache/kylin/commit/c2589aee4ac5537b460b3b02fa89cdb
>>> 3a922d64e
>> 
>> Its hash is c2589aee4ac5537b460b3b02fa89cdb3a922d64e.
>> 
>> The artifacts to be voted on are located here:
>> https://dist.apache.org/repos/dist/dev/kylin/apache-kylin-1.2-rc
>> 1/
>> 
>> The hashes of the artifacts are as follows:
>> apache-kylin-1.2-src.tar.gz.md5 e1d56376f75117b97f0d6da4ad6eaee3
>> apache-kylin-1.2-src.tar.gz.sha1
 b8d1048825b621bdf4719f987301e4fd03763031
>> 
>> A staged Maven repository is available for review at:
>> 
 https://repository.apache.org/content/repositories/orgapachekylin-10
 16/
>> 
>> Release artifacts are signed with the following key:
>> https://people.apache.org/keys/committer/shaofengshi.asc
>> 
>> Please vote on releasing this package as Apache Kylin 1.2.
>> 
>> The vote is open for the next 72 hours and passes if a majority
>> of at least three +1 PPMC votes are cast.
>> 
>> [ ] +1 Release this package as Apache Kylin 1.2 [ ]  0 I don't
>> feel strongly about it, but I'm okay with the release [ ] -1 Do
>> not release this package because...
>> 
>> 
>> Here is my vote:
>> 
>> +1 (binding)
>> 
>> --
>> Best regards,
>> 
>> Shaofeng Shi
>> 
>> 
> 
> 
> --
> Best regards,
> 
> Shaofeng Shi
> 
 
 
 
 --
 Thanks,
 Dong
 
>>> 
> 
> 

Re: Kylin build cube is failing at step 2 "Extract Fact Table Distinct Columns"

[王晓雨]

It seem the log4j config problem!
Please check log4j.properties in your hadoop cluster.confirm it is correct.


> 在 2015年12月17日，22:55，mkc450  写道：
> 
> 
> Thank you for quick response
> 
> I am sorry I don't know how to do that, but in this file i can the see the
> following message.
> 
> $HADOOP_HOME/logs/userlogs/application_1450352735335_0002/container_1450352735335_0002_01_01/stderr
> 
> 
> log4j:ERROR setFile(null,true) call failed.
> java.io.FileNotFoundException:
> /usr/local/hadoop/logs/userlogs/application_1450352735335_0002/container_1450352735335_0002_01_01
> (Is a directory)
>at java.io.FileOutputStream.open(Native Method)
>at java.io.FileOutputStream.(FileOutputStream.java:221)
>at java.io.FileOutputStream.(FileOutputStream.java:142)
>at org.apache.log4j.FileAppender.setFile(FileAppender.java:294)
>at
> org.apache.log4j.FileAppender.activateOptions(FileAppender.java:165)
>at
> org.apache.hadoop.yarn.ContainerLogAppender.activateOptions(ContainerLogAppender.java:55)
>at
> org.apache.log4j.config.PropertySetter.activate(PropertySetter.java:307)
>at 
> org.apache.log4j.config.PropertySetter.setProperties(PropertySetter.java:172)
>at
> org.apache.log4j.config.PropertySetter.setProperties(PropertySetter.java:104)
>at
> org.apache.log4j.PropertyConfigurator.parseAppender(PropertyConfigurator.java:842)
>at
> org.apache.log4j.PropertyConfigurator.parseCategory(PropertyConfigurator.java:768)
>at
> org.apache.log4j.PropertyConfigurator.configureRootCategory(PropertyConfigurator.java:648)
>at
> org.apache.log4j.PropertyConfigurator.doConfigure(PropertyConfigurator.java:514)
>at
> org.apache.log4j.PropertyConfigurator.doConfigure(PropertyConfigurator.java:580)
>at
> org.apache.log4j.helpers.OptionConverter.selectAndConfigure(OptionConverter.java:526)
>at org.apache.log4j.LogManager.(LogManager.java:127)
>at org.apache.log4j.Logger.getLogger(Logger.java:104)
>at
> org.apache.commons.logging.impl.Log4JLogger.getLogger(Log4JLogger.java:262)
>at
> org.apache.commons.logging.impl.Log4JLogger.(Log4JLogger.java:108)
>at sun.reflect.NativeConstructorAccessorImpl.newInstance0(Native
> Method)
>at
> sun.reflect.NativeConstructorAccessorImpl.newInstance(NativeConstructorAccessorImpl.java:57)
>at
> sun.reflect.DelegatingConstructorAccessorImpl.newInstance(DelegatingConstructorAccessorImpl.java:45)
>at java.lang.reflect.Constructor.newInstance(Constructor.java:526)
>at
> org.apache.commons.logging.impl.LogFactoryImpl.createLogFromClass(LogFactoryImpl.java:1025)
>at
> org.apache.commons.logging.impl.LogFactoryImpl.discoverLogImplementation(LogFactoryImpl.java:844)
>at
> org.apache.commons.logging.impl.LogFactoryImpl.newInstance(LogFactoryImpl.java:541)
>at
> org.apache.commons.logging.impl.LogFactoryImpl.getInstance(LogFactoryImpl.java:292)
>at
> org.apache.commons.logging.impl.LogFactoryImpl.getInstance(LogFactoryImpl.java:269)
>at org.apache.commons.logging.LogFactory.getLog(LogFactory.java:657)
>at
> org.apache.hadoop.service.AbstractService.(AbstractService.java:43)
> log4j:WARN No appenders could be found for logger
> (org.apache.hadoop.ipc.Server).
> log4j:WARN Please initialize the log4j system properly.
> log4j:WARN See http://logging.apache.org/log4j/1.2/faq.html#noconfig for
> more info.
> 
> 
> stdout file is empty 
> 
> --
> View this message in context: 
> http://apache-kylin.74782.x6.nabble.com/Kylin-build-cube-is-failing-at-step-2-Extract-Fact-Table-Distinct-Columns-tp2830p2833.html
> Sent from the Apache Kylin mailing list archive at Nabble.com.

Re: About the website build problem

[王晓雨]

Yes，already pushed。

王晓雨

> 在 2015年12月9日，21:22，Luke Han <luke...@gmail.com> 写道：
> 
> could you push to svn now?
> 
> 
> Best Regards!
> -
> 
> Luke Han
> 
>> On Wed, Dec 9, 2015 at 7:38 PM, Xiaoyu Wang <wangxiao...@jd.com> wrote:
>> 
>> I'm Sorry!
>> I see the README.md has "incubator" key words. and it is not view on the
>> website!
>> Other page is the newest!
>> 
>> 
>>> 在 2015年12月09日 19:20, Xiaoyu Wang 写道:
>>> 
>>> I see the svn code "https://svn.apache.org/repos/asf/kylin/site; is not
>>> the newest.
>>> In the code has already "incubator" words.
>>> 
>>>> 在 2015年12月09日 18:48, Xiaoyu Wang 写道:
>>>> 
>>>> Thanks hongbin!
>>>> I will try it.
>>>> 
>>>>> 在 2015年12月09日 17:50, hongbin ma 写道:
>>>>> 
>>>>> i followed this page and it worked out well:
>>>>> http://kylin.apache.org/development/howto_docs.html
>>>>> 
>>>>> On Wed, Dec 9, 2015 at 5:45 PM, Xiaoyu Wang <wangxiao...@jd.com> wrote:
>>>>> 
>>>>> I'm try to build the website follow the README guide in
>>>>>> https://github.com/apache/kylin/tree/1.x-staging/website
>>>>>> but meet a problem when execute "bundle install" command!
>>>>>> 
>>>>>> 1.cd website
>>>>>> 2.svn co https://svn.apache.org/repos/asf/kylin/site _site
>>>>>> 3.sudo apt-get install rubygems ruby2.1-dev zlib1g-dev (linux)
>>>>>> 4.sudo gem install bundler github-pages jekyll
>>>>>> 5.bundle install
>>>>>> 
>>>>>> the step 1~4 is passed.
>>>>>> $ ruby -v
>>>>>> ruby 2.0.0p643 (2015-02-25 revision 49749) [x86_64-linux]
>>>>>> $ gem -v
>>>>>> 2.4.8
>>>>>> $ jekyll -v
>>>>>> jekyll 3.0.1
>>>>>> $ bundle -v
>>>>>> Bundler version 1.10.6
>>>>>> 
>>>>>> when execute the 5 step command got the error "Could not locate
>>>>>> Gemfile or
>>>>>> .bundle/ directory":
>>>>>> ~/apache/kylin/website$ bundle install
>>>>>> Could not locate Gemfile or .bundle/ directory
>>>>>> 
>>>>>> There is no Gemfile or .bundle directory in the website directory.
>>>>>> Any one meet the same problem?
>>>>> 
>>>>> .
>>>