Re: wrong fs when use two cluster

2017-09-07 Thread ShaoFeng Shi
s(redirectPath)/, so it will throw the above > exception.Please check it out~ > > > -- > Sent from: http://apache-kylin.74782.x6.nabble.com/ > -- Best regards, Shaofeng Shi 史少锋

Re: Kylin on Docker for production use

2017-09-13 Thread ShaoFeng Shi
ur answer. > > Arnault > > -- > Sent from: http://apache-kylin.74782.x6.nabble.com/ > -- Best regards, Shaofeng Shi 史少锋

Re: OutOfMemoryError happened when build cube

2017-09-06 Thread ShaoFeng Shi
38 > MSG_TXN_CODE varchar(10)6 > DELETED char(1) 2 > How can i resolve the problem? Can I use fixed_length in all > dimensions? Maybe the step 4 will take less time. > Thank you. > > > 2017-08-30 18:44 GMT+08:00 ShaoFen

Re: Kylin on Amazon EMR

2017-09-06 Thread ShaoFeng Shi
ill be of great help ! > > > > > > -- > > Sent from: http://apache-kylin.74782.x6.nabble.com/ > > > -- Best regards, Shaofeng Shi 史少锋

Re: OutOfMemoryError happened when build cube

2017-09-07 Thread ShaoFeng Shi
ect? > But i didn't have time to save the picture.Then i refresh the same > segment,it only took three minutes this time(I almost broke down),then i > save the CPU diagram. > [image: 内嵌图片 1] > > > 2017-09-06 22:58 GMT+08:00 ShaoFeng Shi <shaofeng...@apache.org>: >

Re: kylin-1.6-hbase version cluster have a bug

2017-09-07 Thread ShaoFeng Shi
accounter this problem. > > > > -- > > Sent from: http://apache-kylin.74782.x6.nabble.com/ > > > -- Best regards, Shaofeng Shi 史少锋

Re: Kylin 2.2.0 release soon

2017-09-25 Thread ShaoFeng Shi
Cool, when do you plan to kick off the release? 2017-09-25 21:49 GMT+08:00 Li Yang <liy...@apache.org>: > Anything you want to squeeze into the release, it's time. > > > Cheers > Yang > -- Best regards, Shaofeng Shi 史少锋

Re: A problem about Global Dictionary and cube merge

2017-09-28 Thread ShaoFeng Shi
egment could not be merged, even if > run this command ,the hbase tables could not be cleaned. > > > > > -- 原始邮件 ---------- > 发件人: "ShaoFeng Shi";<shaofeng...@apache.org>; > 发送时间: 2017年9月28日(星期四) 晚上9:29 > 收件人: "dev"<d

Re: Re: A problem about Global Dictionary and cube merge

2017-09-28 Thread ShaoFeng Shi
The issue is discussed in https://issues.apache.org/jira/browse/KYLIN-2679 2017-09-29 11:41 GMT+08:00 ShaoFeng Shi <shaofeng...@apache.org>: > Split that into two cubes: in one it acts as a dimension, in the other, it > acts as count distinct measure. > > 2017-09-29 11:12

Re: Re: Re: A problem about Global Dictionary and cube merge

2017-09-29 Thread ShaoFeng Shi
umn in on cube both as > dimension and distinct count? > 在 2017-09-29 11:41:02,ShaoFeng Shi <shaofeng...@apache.org> 写道: > >Split that into two cubes: in one it acts as a dimension, in the other, it > >acts as count distinct measure. > > > >2017-09-29 11:12 GMT+08:00

Re: Re: A problem about Global Dictionary and cube merge

2017-09-28 Thread ShaoFeng Shi
Split that into two cubes: in one it acts as a dimension, in the other, it acts as count distinct measure. 2017-09-29 11:12 GMT+08:00 崔苗 <cuim...@danale.com>: > if a column was used both as dimension and distinct count,what should be > use to encode ? > 在 2017-09-29 11:05:

Re: A problem about Global Dictionary and cube merge

2017-09-28 Thread ShaoFeng Shi
; -- 原始邮件 ------ > 发件人: "ShaoFeng Shi";<shaofeng...@apache.org>; > 发送时间: 2017年9月29日(星期五) 上午9:41 > 收件人: "dev"<dev@kylin.apache.org>; > > 主题: Re: A problem about Global Dictionary and cube merge > > > > I se

Re: Running Kylin query instance just with Standalone Hbase cluster

2017-09-28 Thread ShaoFeng Shi
finished the calculating job, and only the hbase cluster will be left. > > > > our problem is: > > Is that possible that run a simply kylin query instance on hbase cluster > > without the hadoop cluster. > > > > any help is appreciate. > > > > clude > > > -- Best regards, Shaofeng Shi 史少锋

Re: A problem about Global Dictionary and cube merge

2017-09-28 Thread ShaoFeng Shi
build the cube > every day, that means a new hbase table will be created every day. And the > segment could not be merged, that means the hbase tables could not be > cleaned. That`t terrible.Give me some advice? > Thank you! Looking forward to your reply. -- Best regards, Shaofeng Shi 史少锋

Re: query problem

2017-09-28 Thread ShaoFeng Shi
ze(), > kylinConfig.getLargeQueryThreshold())) > { > cacheManager.getCache(SUCCESS_QUERY_CACHE) > .put(new Element(sqlRequest.getCacheKey(), > sqlResponse)); > } > ```

Re: Query is not allowed in web mode.

2017-08-24 Thread ShaoFeng Shi
ight.process( > > AbstractProcessorLight.java:66)\n\tat > > org.apache.coyote.AbstractProtocol$ConnectionH > > andler.process(AbstractProtocol.java:789)\n\tat > > org.apache.tomcat.util.net.NioEndpoint$SocketProcessor. > > doRun(NioEndpoint.java:1437)\n\tat > > org.apache.tomcat.util.net.SocketProcessorBase.run > > (SocketProcessorBase.java:49)\n\tat > > java.util.concurrent.ThreadPoolExecutor.runWorker( > > ThreadPoolExecutor.java:1142)\n\tat > > java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecu > > tor.java:617)\n\tat > > org.apache.tomcat.util.threads.TaskThread$WrappingRunnable.run( > > TaskThread.java:61)\n\tat > > java.lang.Thread.run(Thread.java:745)\n","exception":"Query is not > allowed > > in w eb > > mode.","url":"http://ascv102.prod.hnd1.bdd.local:7070/kylin/api/query"} > > 14336 at > > org.apache.kylin.jdbc.KylinClient.asIOException(KylinClient.java:416) > > 14337 at > > org.apache.kylin.jdbc.KylinClient.executeKylinQuery(KylinCli > ent.java:376) > > 14338 at > > org.apache.kylin.jdbc.KylinClient.executeQuery(KylinClient.java:326) > > 14339 at > > org.apache.kylin.jdbc.KylinResultSet.execute(KylinResultSet.java:69) > > 14340 ... 6 more > > 14341 , Connection String: > > DSN=KYLIN;JDBC;MSTR_JDBC_JAR_FOLDER=/usr/local/mstr/ > > install/JDBC;DRIVER=org.apache.kylin.jdbc.Driver;URL= > > jdbc:kylin://ascv102.prod.hnd1.bdd.local:7070/scv_rat_mart_rat > > _session_summary;UID=ADMIN;, Statement String: SELECT TOP 4 * FROM > > SCV_WORK, > > JdbcCallMade: MIX_JdbcStatement_execute > > 14342 2017-08-22 18:03:52.544+09:00 > > [HOST:ared302.db.test.co.jp][SERVER:CastorServer][PID: > > 39561][THR:2488064][Database > > Classes][Error] JdbcStatementWrapper::ExecQuery failed. > > 14343 Error type: Jdbc success with info. Jdbc operation attempted: > > MIX_JdbcStatement_execute. [:0: on SQLHANDLE] Connection String: > > DSN=KYLIN;JDBC;MSTR_JDBC_JAR_FOLDER=/usr/local/mstr/ > > install/JDBC;DRIVER=org.apache.kylin.jdbc.Driver;URL= > > jdbc:kylin://ascv102.prod.hnd1.bdd.local:7070/scv_rat_ > > mart_rat_session_summary;UID=ADMIN;. > > SQL Statement: SELECT TOP 4 * FROM SCV_WORK. > > 14344 2017-08-22 18:03:52.544+09:00 > > [HOST:ared302.db.test.co.jp][SERVER:CastorServer][PID: > > 39561][THR:2488064][Database > > Classes][Error] Query execution failed when importing data from database > or > > web service. Error message: JdbcStatementWrapper::ExecQuery failed. > > 14345 Error type: Jdbc success with info. Jdbc operation attempted: > > MIX_JdbcStatement_execute. [:0: on SQLHANDLE] Connection String: > > DSN=KYLIN;JDBC;MSTR_JDBC_JAR_FOLDER=/usr/local/mstr/ > > install/JDBC;DRIVER=org.apache.kylin.jdbc.Driver;URL= > > jdbc:kylin://ascv102.prod.hnd1.bdd.local:7070/scv_rat_ > > mart_rat_session_summary;UID=ADMIN;. > > SQL Statement: SELECT TOP 4 * FROM SCV_WORK.. > > 14346 2017-08-22 18:03:52.544+09:00 > > [HOST:ared302.db.test.co.jp][SERVER:CastorServer][PID: > > 39561][THR:2488064][COM > > Shared][Error][0x8004180E] Error in accessing information from the > external > > data source (Database Instance: (DataImport)[0], Error: > > JdbcStatementWrapper::ExecQuery failed. > > 14347 Error type: Jdbc success with info. Jdbc operation attempted: > > MIX_JdbcStatement_execute. [:0: on SQLHANDLE] ) > > 14348 2017-08-22 18:03:52.883+09:00 > > [HOST:ared302.db.test.co.jp][SERVER:CastorServer][PID: > > 39561][THR:2086184704 <020%208618%204704>][COM > > Shared][Error][0x8004180E] Error in accessing information from the > externa > > l data source (Database Instance: (DataImport)[0], Error: > > JdbcStatementWrapper::ExecQuery failed. > > 14349 Error type: Jdbc success with info. Jdbc operation attempted: > > MIX_JdbcStatement_execute. [:0: on SQLHANDLE] ) > > > > 14320,51-58 99% > > > > olap > > > > There is an error on the server. Details > > インデックスが、範囲外です。内部システム エラー: XMLRequest で例外を検出しました。 :: Execute。 Table > pointer > > is null. Cannot perform append operation. > > > > 2017-08-22 18:06:35.518+09:00 > > [HOST:ared302.db.test.co.jp][SERVER:CastorServer][PID: > > 39561][THR:3803707136][Kernel][Info] > > Contract Request Succeeded: Source=MDb::Table, Handle=1887, Size > > =13303808, ContractedTotal=140668928, AvailableTotal=534490736306 > > 14351 2017-08-22 18:06:59.868+09:00 > > [HOST:ared302.db.test.co.jp][SERVER:CastorServer][PID: > > 39561][THR:2050463488 <020%205046%203488>][Dimensional > > Storage][Error] The locale for the dataset is 0 and the locale for > > current server instance is 1033. But don't worry, by default we have > fixed > > it for you. > > 14352 2017-08-22 18:06:59.869+09:00 > > [HOST:ared302.db.test.co.jp][SERVER:CastorServer][PID: > > 39561][THR:2050463488 <020%205046%203488>][Dimensional > > Storage][Error] The locale for the dataset is 0 and the locale for > > current server instance is 1033. But don't worry, by default we have > fixed > > it for you. > > 14353 2017-08-22 18:10:47.768+09:00 > > [HOST:ared302.db.test.co.jp][SERVER:CastorServer][PID: > > 39561][THR:2111399680 <021%201139%209680>][Object > > Server][Error][0x80041018] Index out of range > > > > .. > > > > -- > > View this message in context: http://apache-kylin.74782.x6. > > nabble.com/Query-is-not-allowed-in-web-mode-tp8778.html > > Sent from the Apache Kylin mailing list archive at Nabble.com. > > > > > -- Best regards, Shaofeng Shi 史少锋

Re: Apache Kylin ODBC Driver 2.1.0 rolled out!

2017-08-21 Thread ShaoFeng Shi
ormation on how to report > problems, and to get involved, visit the Apache Kylin website at > https://kylin.apache.org/ > > Thanks, > Dong Li > -- Best regards, Shaofeng Shi 史少锋

Re: OutOfMemoryError happened when build cube

2017-08-27 Thread ShaoFeng Shi
ark: 2.333/2.334 secs] [Times: user=2.37 > sys=0.01, real=2.34 secs] > ... > > Maybe is the error of java Garbage Collection,so i how to solve the > problem?(maybe modify the properties) > > Thanks a lot. > -- Best regards, Shaofeng Shi 史少锋

Re: OutOfMemoryError happened when build cube

2017-08-28 Thread ShaoFeng Shi
g/docs21/howto/howto_optimize_build.html 2017-08-28 13:54 GMT+08:00 周湘伦 <jayzho...@gmail.com>: > Sorry,i got these problems in the step 2:Redistribute Flat Hive > Table,sometimes in the step 4:Build Dimension Dictionary,it is > uncertain.But the step 2 occurs a little more

Re: KYLIN2.1

2017-08-23 Thread ShaoFeng Shi
pache.catalina.core.StandardEngineValve.invoke( > > StandardEngineValve.java:116) > > at > > org.apache.catalina.connector.CoyoteAdapter.service( > > CoyoteAdapter.java:436) > > at > > org.apache.coyote.http11.AbstractHttp11Processor.process( > > AbstractHttp11Processor.java:1078) > > at > > org.apache.coyote.AbstractProtocol$AbstractConnectionHandler. > > process(AbstractProtocol.java:625) > > at > > org.apache.tomcat.util.net.JIoEndpoint$SocketProcessor. > > run(JIoEndpoint.java:318) > > at > > java.util.concurrent.ThreadPoolExecutor.runWorker( > > ThreadPoolExecutor.java:1142) > > at > > java.util.concurrent.ThreadPoolExecutor$Worker.run( > > ThreadPoolExecutor.java:617) > > at > > org.apache.tomcat.util.threads.TaskThread$WrappingRunnable.run( > > TaskThread.java:61) > > at java.lang.Thread.run(Thread.java:745) > > Caused by: java.lang.NoClassDefFoundError: > > org/apache/spark/api/java/function/PairFunction > > at > > org.apache.kylin.engine.spark.SparkBatchCubingJobBuilder2. > > addLayerCubingSteps(SparkBatchCubingJobBuilder2.java:48) > > at > > org.apache.kylin.engine.mr.BatchCubingJobBuilder2.build( > > BatchCubingJobBuilder2.java:66) > > at > > org.apache.kylin.engine.spark.SparkBatchCubingEngine2. > > createBatchCubingJob(SparkBatchCubingEngine2.java:30) > > at > > org.apache.kylin.engine.EngineFactory.createBatchCubingJob( > > EngineFactory.java:56) > > at > > org.apache.kylin.rest.service.JobService.submitJobInternal( > > JobService.java:238) > > at org.apache.kylin.rest.service.JobService.submitJob( > > JobService.java:208) > > at > > org.apache.kylin.rest.service.JobService$$FastClassBySpringCGLIB$$ > > 83a44b2a.invoke() > > at org.springframework.cglib.proxy.MethodProxy.invoke( > > MethodProxy.java:204) > > at > > org.springframework.aop.framework.CglibAopProxy$CglibMethodInvocation. > > invokeJoinpoint(CglibAopProxy.java:720) > > at > > org.springframework.aop.framework.ReflectiveMethodInvocation.proceed( > > ReflectiveMethodInvocation.java:157) > > at > > org.springframework.security.access.intercept.aopalliance. > > MethodSecurityInterceptor.invoke(MethodSecurityInterceptor.java:68) > > at > > org.springframework.aop.framework.ReflectiveMethodInvocation.proceed( > > ReflectiveMethodInvocation.java:179) > > at > > org.springframework.aop.framework.CglibAopProxy$ > DynamicAdvisedInterceptor. > > intercept(CglibAopProxy.java:655) > > at > > org.apache.kylin.rest.service.JobService$$EnhancerBySpringCGLIB$$ > > 39b3ce22.submitJob() > > at > > org.apache.kylin.rest.controller.CubeController. > > buildInternal(CubeController.java:302) > > ... 77 more > > Caused by: java.lang.ClassNotFoundException: > > org.apache.spark.api.java.function.PairFunction > > at > > org.apache.catalina.loader.WebappClassLoaderBase.loadClass( > > WebappClassLoaderBase.java:1858) > > at > > org.apache.catalina.loader.WebappClassLoaderBase.loadClass( > > WebappClassLoaderBase.java:1701) > > ... 92 more > > > > -- > > View this message in context: http://apache-kylin.74782.x6. > > nabble.com/KYLIN2-1-tp8782.html > > Sent from the Apache Kylin mailing list archive at Nabble.com. > > > -- Best regards, Shaofeng Shi 史少锋

Re: KYLIN2.1

2017-08-23 Thread ShaoFeng Shi
Change SPARK_HOME to $KYLIN_HOME/spark, or unset it before start Kylin should solve the issue. Just take a try. 2017-08-24 9:13 GMT+08:00 ShaoFeng Shi <shaofeng...@apache.org>: > Please check whether your environment has SPARK_HOME variable pointing to > another folder, which

Re: Any status update about KYLIN-2720?

2017-08-31 Thread ShaoFeng Shi
Hi Mingming, I put my comment in the JIRA, please check. 2017-08-31 15:31 GMT+08:00 qiumingming <csurj...@gmail.com>: > Hi Shaofeng SHI, Is there any status update? Should I start to make a new > version patch for KYLIN-2720? I am afraid you have not seen my message > below >

Re: Can't edit cube

2017-09-03 Thread ShaoFeng Shi
.java:655) > > >at org.apache.kylin.rest.service.CubeService$$ > > EnhancerBySpringCGLIB$$a843c409.updateCubeAndDesc() > > >at org.apache.kylin.rest.controller.CubeController. > > updateCubeDesc(CubeController.java:511) > > >at sun.reflect.NativeMethodAccessorImpl.invoke0(Native Method) > > >at sun.reflect.NativeMethodAccessorImpl.invoke( > > NativeMethodAccessorImpl.java:62) > > >at sun.reflect.DelegatingMethodAccessorImpl.invoke( > > DelegatingMethodAccessorImpl.java:43) > > >at java.lang.reflect.Method.invoke(Method.java:498) > > > > > > > > > > > >apache_...@163.com > > > -- Best regards, Shaofeng Shi 史少锋

Re: how to filter long tail data

2017-09-03 Thread ShaoFeng Shi
t; On Fri, Sep 1, 2017 at 2:47 PM, 杨浩 <yangha...@gmail.com> wrote: >> >> > If a index is less than 2, we don't want to store it in hbase . How to >> > filter the long tail data ? >> > >> > > -- Best regards, Shaofeng Shi 史少锋

Re: issue: Context initialization failed

2017-08-31 Thread ShaoFeng Shi
jectMapperBuilder.java:554) > at org.springframework.http.converter.json. > MappingJackson2HttpMessageConverter.(MappingJackson2HttpMessageConv > erter.java:57) > at org.springframework.http.converter.support. > AllEncompassingFormHttpMessageConverter.( > AllEncompassingFormHttpMessageConverter.java:61) > at org.springframework.web.servlet.mvc.method.annotation. > RequestMappingHandlerAdapter.(RequestMappingHandlerAdapter.java:187) > at sun.reflect.NativeConstructorAccessorImpl.newInstance0(Native > Method) > at sun.reflect.NativeConstructorAccessorImpl.newInstance( > NativeConstructorAccessorImpl.java:62) > at sun.reflect.DelegatingConstructorAccessorImpl.newInstance( > DelegatingConstructorAccessorImpl.java:45) > at java.lang.reflect.Constructor.newInstance(Constructor.java:423) > at org.springframework.beans.BeanUtils.instantiateClass( > BeanUtils.java:147) > ... 28 more > > > thanks! > > > > zili_w...@163.com > -- Best regards, Shaofeng Shi 史少锋

Document for Kylin with MicroStrategy

2017-08-31 Thread ShaoFeng Shi
Hi, Joanna He (jingke...@kyligence.io) contributed a doc on how to integrate Kylin with MicroStrategy. The doc has been published on Kylin website[1] today. Thanks Joanna's contribution. https://kylin.apache.org/docs21/tutorial/microstrategy.html -- Best regards, Shaofeng Shi 史少锋

Re: Re: use timestamp for cube partition

2017-10-10 Thread ShaoFeng Shi
Flat Hive Table was null. I want to know > could kylin derive other time values like “year_start”, “day_start” from > the bigint timestamp in hive as it does in kafka table? or we must change > the bigint timestamp into data format such as "2017-10-09" in hive? > At 2017-10-

Re: data format when building increment cube

2017-10-23 Thread ShaoFeng Shi
t;KYLIN_SALES.PART_DT", "partition_time_column" : null, "partition_date_start" : 0, "partition_date_format" : "-MM-dd", "partition_time_format" : "HH:mm:ss", "partition_type" : "APPEND", &

Re: data format when building increment cube

2017-10-23 Thread ShaoFeng Shi
find the json file > or you mean change it on kylin web? > > > > > ------ 原始邮件 -- > 发件人: "ShaoFeng Shi";<shaofeng...@apache.org>; > 发送时间: 2017年10月23日(星期一) 下午5:09 > 收件人: "dev"<dev@kylin.apache.org>; > >

Re: 退订

2017-10-24 Thread ShaoFeng Shi
Please drop an email to dev-unsubscr...@kylin.apache.org to proceed. 在 2017年10月24日 下午1:45,郭元培 <yuanpei@marcpoint.com>写道: > 退订,谢谢了 -- Best regards, Shaofeng Shi 史少锋

Re: Re: how to change the order of rowkey_columns

2017-11-15 Thread ShaoFeng Shi
sition the frequent column before > >> others, such as partition column date should be at the first for every > >> query would contain it. Then how to change the order of > rowkey_columns, or > >> in other words, what decides the order of rowkey_columns? > >> > > > > > -- Best regards, Shaofeng Shi 史少锋

Re: [Discuss] Disable/hide "RAW" measure in Kylin web GUI

2017-11-26 Thread ShaoFeng Shi
GMT+08:00 Li Yang <liy...@apache.org>: > > > > > > > Or display the Raw with "Beta" or "Experimental" to warn user that it > > is > > > > not a mature feature? > > > > > > > > On Fri, Dec 16, 2016 at 12:30 PM, 康凯森 <kangka

Re: kylin 监控JMX

2017-12-18 Thread ShaoFeng Shi
m/ > -- Best regards, Shaofeng Shi 史少锋

Fwd: EOL HBase 1.1

2017-12-14 Thread ShaoFeng Shi
onal and volunteer contributors who made branch-1.1 possible. Thanks, Nick -- Best regards, Shaofeng Shi 史少锋

Re: Changing the name of existing cube

2017-12-18 Thread ShaoFeng Shi
; I am using Kylin 2.2, need to know if there is any possible way to change > the name of existing cube in Kylin. > Hope the meta bindings are to the UUID for the cube or the name of the > cube ? > > Thanks, > Ketan -- Best regards, Shaofeng Shi 史少锋

Re: kylin 监控JMX

2017-12-18 Thread ShaoFeng Shi
+08:00 jun <1063489...@qq.com>: > Is this problem solved? > > -- > Sent from: http://apache-kylin.74782.x6.nabble.com/ > -- Best regards, Shaofeng Shi 史少锋

Re: kylin merge

2017-12-18 Thread ShaoFeng Shi
rity.UserGroupInformation.doAs( > UserGroupInformation.java:1698) > at org.apache.hadoop.mapred.YarnChild.main(YarnChild.java:158) > > > -- > Sent from: http://apache-kylin.74782.x6.nabble.com/ > -- Best regards, Shaofeng Shi 史少锋

Re: 使用RESTful api查询,如果where条件中key对应的value为字符串类型,查询报错,请问下是什么原因?

2017-12-18 Thread ShaoFeng Shi
ould not read document: Unrecognized character escape '2' (code 50)\n at > [Source: java.io.PushbackInputStream@47bd0a81; line: 1, column: 106] > (through reference chain: > org.apache.kylin.rest.request.SQLRequest[\"sql\"]); > 明显转义的又有问题,有点不知所措,现在只能先读源码了,看下处理逻辑和kylin的sql解析引擎工作机制, > 但先把问题先反馈到这里,又遇到的也麻烦回复下,非常感谢! > > > -- > Sent from: http://apache-kylin.74782.x6.nabble.com/ > -- Best regards, Shaofeng Shi 史少锋

New document: Install Kylin on AWS EMR

2017-11-13 Thread ShaoFeng Shi
. -- Best regards, Shaofeng Shi 史少锋

Re: Unable to sync Hive tables with users with ROLE as "ROLE_MODELER"

2017-11-03 Thread ShaoFeng Shi
; Thanks in advance. > > -- > Sent from: http://apache-kylin.74782.x6.nabble.com/ > -- Best regards, Shaofeng Shi 史少锋

Re: cube run 3 setp:org.apache.thrift.transport.TTransportException

2017-11-04 Thread ShaoFeng Shi
) > at org.apache.thrift.protocol.TBinaryProtocol.readMessageBegin( > TBinaryProtocol.java:219) > at org.apache.thrift.TServiceClient.receiveBase( > TServiceClient.java:77) > at org.apache.hadoop.hive.metastore.api. > ThriftHiveMetastore$Client.recv_get_table(ThriftHiveMetastore.java:1260) > at org.apache.hadoop.hive.metastore.api. > ThriftHiveMetastore$Client.get_table(ThriftHiveMetastore.java:1246) > at org.apache.hadoop.hive.metastore.HiveMetaStoreClient. > getTable(HiveMetaStoreClient.java:1357) > at sun.reflect.NativeMethodAccessorImpl.invoke0(Native Method) > at sun.reflect.NativeMethodAccessorImpl.invoke( > NativeMethodAccessorImpl.java:62) > at sun.reflect.DelegatingMethodAccessorImpl.invoke( > DelegatingMethodAccessorImpl.java:43) > at java.lang.reflect.Method.invoke(Method.java:498) > at org.apache.hadoop.hive.metastore.RetryingMetaStoreClient. > invoke(RetryingMetaStoreClient.java:153) > at com.sun.proxy.$Proxy58.getTable(Unknown Source) > at org.apache.hive.hcatalog.common.HCatUtil.getTable( > HCatUtil.java:180) > at org.apache.hive.hcatalog.mapreduce.InitializeInput. > getInputJobInfo(InitializeInput.java:105) > at org.apache.hive.hcatalog.mapreduce.InitializeInput. > setInput(InitializeInput.java:88) > at org.apache.hive.hcatalog.mapreduce.HCatInputFormat. > setInput(HCatInputFormat.java:95) > ... 13 more > 2017-11-04 21:25:11,307 INFO [Job 8557407a-8e87-49aa-9cff-b7e3f58c2f12-102] > execution.ExecutableManager:425 : job > id:8557407a-8e87-49aa-9cff-b7e3f58c2f12-02 > from RUNNING to ERROR > > > > > > > apache_...@163.com > -- Best regards, Shaofeng Shi 史少锋

Changes on "How to contribute"

2017-11-05 Thread ShaoFeng Shi
l automatically name it, upload JIRA, and create a review board. Please take a try; if meet any problem, feel free to let us know. This tool is from HBase, thanks again to HBase community! [1] https://kylin.apache.org/development/howto_contribute.html -- Best regards, Shaofeng Shi 史少锋

Re: Connecting Pentaho BI Server to Kylin

2017-11-03 Thread ShaoFeng Shi
Hi Priti, I don't have an open document on this, but I have some other materials, so let me send you offline.

Re: kylin cube merge

2017-11-04 Thread ShaoFeng Shi
un(YarnChild.java:164) at > java.security.AccessController.doPrivileged(Native Method) at > javax.security.auth.Subject.doAs(Subject.java:422) at > org.apache.hadoop.security.UserGroupInformation.doAs(UserGroupInformation.java:1698) > at org.apache.hadoop.mapred.YarnChild.main(YarnChild.java:158) -- Best regards, Shaofeng Shi 史少锋

Re: KYLIN-2846 : TableNotFoundException while executing the step: cuboid Data to HFile

2017-11-04 Thread ShaoFeng Shi
to > HFile > > > > org.apache.hadoop.hbase.TableNotFoundException:ISW:KYLIN_F3KD3ZC1LU > > at org.apache.hadoop.hbase.client.HBaseAdmin. > getTableDescriptor(HBaseAdmin.java:575) > > > > I checked the HBase namespace ‘isw’ through hbase shell ,the table > KYLIN_F3KD3ZC1LU has been created successfully. > > I don’t know how to solve this problem > > > > -- Best regards, Shaofeng Shi 史少锋

Re: kylin streaming cube merge strategy?

2017-12-07 Thread ShaoFeng Shi
er. I can manual merge the cube now,So can somebody tell me the streaming > cube merge strategy automatic ? > > -- > Sent from: http://apache-kylin.74782.x6.nabble.com/ > -- Best regards, Shaofeng Shi 史少锋

Re: kylin streaming cube merge strategy?

2017-12-08 Thread ShaoFeng Shi
estamp means that it will be merged with internal > timestamp (data structure must contains a 'timestamp' field in kafka).is > that rigtht ? > > -- > Sent from: http://apache-kylin.74782.x6.nabble.com/ > -- Best regards, Shaofeng Shi 史少锋

Re: kylin streaming cube merge strategy?

2017-12-07 Thread ShaoFeng Shi
: > Hi: > I try to use kylin streaming cube for building cube from kafka. > And when I design the cube I set cube merge options on advanced Settings > panel. > when I build cube for times .I found the merge strategy not valid > Can somebody help? > > > 446463...@qq.com > -- Best regards, Shaofeng Shi 史少锋

Re: 【问题求解】kylin维度支持上限

2017-12-12 Thread ShaoFeng Shi
师 定制 > > > > 在2017年12月07日 01:55,柴 写道: > > 见字问好: > > dev大大们好~ 想咨询一下 kylin2.x支持的最大维度能有多少呢? 对大规模多维度的数据是否支持? > > > > > > 感谢! > > > -- Best regards, Shaofeng Shi 史少锋

Re: data format when building increment cube

2017-10-26 Thread ShaoFeng Shi
ter to take a backup): "metastore.sh remove /execute" 2017-10-26 9:29 GMT+08:00 op <520075...@qq.com>: > hello shaofeng . > i want to know how to clean the monitor list. could you help me? > > > > > ------ 原始邮件 -- > 发件人: "Shao

Re: question about joint dimensions

2017-10-25 Thread ShaoFeng Shi
ot;group by A B C E" , is it OK? > -- Best regards, Shaofeng Shi 史少锋

Re: [VOTE] Release apache-kylin-2.2.0 (RC1)

2017-10-30 Thread ShaoFeng Shi
passes if a majority of > > at least three +1 PPMC votes are cast. > > > > [ ] +1 Release this package as Apache Kylin 2.2.0 > > [ ] 0 I don't feel strongly about it, but I'm okay with the release > > [ ] -1 Do not release this package because... > > > > Here is my vote: > > > > +1 (binding) > > > > Thanks, > > Dong Li > > > -- Best regards, Shaofeng Shi 史少锋

Re: Kylin new metrics

2017-10-31 Thread ShaoFeng Shi
> https://issues.apache.org/jira/browse/KYLIN-2725 < > https://issues.apache.org/jira/browse/KYLIN-2725> > > Thanks, > Ketan > > > On 31-Oct-2017, at 12:36 PM, ShaoFeng Shi <shaofeng...@apache.org> > wrote: > > > > Hi Ketan, > > > > Whi

Re: Kylin new metrics

2017-10-31 Thread ShaoFeng Shi
kylin new metrics, any > plans of it making to v2.2. > > Thanks, > Ketan -- Best regards, Shaofeng Shi 史少锋

Re: Error while starting kylin 2.1

2017-10-31 Thread ShaoFeng Shi
cChannelImplementation.callBlockingMethod( > AbstractRpcClient.java:336) > at org.apache.hadoop.hbase.protobuf.generated. > ClientProtos$ClientService$BlockingStub.scan(ClientProtos.java:34094) > at org.apache.hadoop.hbase.client.ScannerCallable. > openScanner(ScannerCallable..java:400) > ... 10 more > 2017-10-31 15:52:02,377 INFO [Thread-1] > client.ConnectionManager$HConnectionImplementation:1843 > : Closing zookeeper sessionid=0x15f731612a1001e > > Thanks, > Ketan -- Best regards, Shaofeng Shi 史少锋

Re: kylin merge

2017-12-21 Thread ShaoFeng Shi
t;.Shaofeng,have you some advice for me? > > -- > Sent from: http://apache-kylin.74782.x6.nabble.com/ > -- Best regards, Shaofeng Shi 史少锋

Using Apache Kylin as data source for Spark

2018-05-17 Thread ShaoFeng Shi
. -- Best regards, Shaofeng Shi 史少锋

Re: Partition Date Issue

2018-05-16 Thread ShaoFeng Shi
to this that I see is that give the user an option during > configuration to specify separate columns like this and then create the > query accordingly. > > My only concern is that if this will impact the cube's "Refresh Settings" > > Please let me know if this should be done. I'm open to do the development > and open a PR. > > Regards, > Debdutto Chakraborty > -- Best regards, Shaofeng Shi 史少锋

Re: Facing Issues with Kylin 2.3.1

2018-05-21 Thread ShaoFeng Shi
us better use the tool. > > Thanks Ketan@Exponential > > > > Sent from my Samsung Galaxy smartphone. > Original message From: ShaoFeng Shi < > shaofeng...@apache.org> Date: 06/04/2018 8:29 pm (GMT+05:30) To: dev < > dev@kylin.apache.org> Subje

Re: 答复: Partition Date Issue

2018-05-24 Thread ShaoFeng Shi
f create a view with adding a new column which combined > with the three column can simplify the problem? > > > Thank you > ________ > 发件人: ShaoFeng Shi <shaofeng...@apache.org> > 发送时间: 2018年5月16日 20:00 > 收件人: dev > 抄送: user > 主题: Re:

Re: do you have any idea

2018-06-11 Thread ShaoFeng Shi
o > not go down.And there is no errors。Have you encountered this problem? -- Best regards, Shaofeng Shi 史少锋

[KYLIN-3388] Hive data may become inconsistent after redistribution

2018-06-12 Thread ShaoFeng Shi
roperties. A restart is needed to take effect. Thanks for the attention. -- Best regards, Shaofeng Shi 史少锋

Re: add na new dimension to the cube

2018-06-14 Thread ShaoFeng Shi
Ha, just found Billy also replied the same. Ignore my message. 2018-06-14 20:37 GMT+08:00 ShaoFeng Shi : > Hi zhang, you may need Hybrid model: https://kylin.apache.or > g/blog/2015/09/25/hybrid-model/ > > Community user Roberto shared his experience before, you can check thi

Apache Kylin Meetup @Shenzhen 23 June

2018-06-13 Thread ShaoFeng Shi
. -- Best regards, Shaofeng Shi 史少锋

Re: Convert Cuboid Data to HFile is taking most of time

2018-06-15 Thread ShaoFeng Shi
engine type. > > is there any way to make this step run on spark instead of MR ? > > also there any configuration which can help to optimize this step? > > > > thanks > > > > -- > > Sent from: http://apache-kylin.74782.x6.nabble.com/ > > > -- Best regards, Shaofeng Shi 史少锋

Re: Jenkins for Apache Kylin Integration test

2018-05-28 Thread ShaoFeng Shi
12, 2018 at 6:04 PM, Luke Han wrote: > > > This is great progress of our community, hope this could help > > a little bit to speed up everyone's productivity. > > > > Thanks Shaofeng for all the efforts. > > > > Luke > > > > ShaoFeng

Re: Unable to connect to Kylin Web UI

2018-05-29 Thread ShaoFeng Shi
/apache-kylin.74782.x6.nabble.com/ > -- Best regards, Shaofeng Shi 史少锋

Re: [VOTE] Release apache-kylin-2.3.2 (RC1)

2018-06-25 Thread ShaoFeng Shi
kage as Apache Kylin 2.3.2. > > > > The vote is open for the next 72 hours and passes if a majority of > > at least three +1 PPMC votes are cast. > > > > [ ] +1 Release this package as Apache Kylin 2.3.2 > > [ ] 0 I don't feel strongly about it, but I'm okay with the release > > [ ] -1 Do not release this package because... > > > > > > Here is my vote: > > > > +1 > > > > -- > > Best regards, > > > > KaiSen Kang 康凯森 > > > > -- > > Sent from: http://apache-kylin.74782.x6.nabble.com/ > -- Best regards, Shaofeng Shi 史少锋

[Announce] Apache Kylin 2.4.0 released

2018-06-25 Thread ShaoFeng Shi
to everyone who has contributed to the 2.4.0 release. We welcome your help and feedback. For more information on how to report problems, and to get involved, visit the project website at https://kylin.apache.org/ -- Best regards, Shaofeng Shi 史少锋

Re: Doubt about Cube Planner

2018-06-22 Thread ShaoFeng Shi
max,min..etc > or any other constraint? > > Kindly guide me? > > > -- Best regards, Shaofeng Shi 史少锋

[RESULT] [VOTE] Release apache-kylin-2.4.0 (RC1)

2018-06-23 Thread ShaoFeng Shi
Thanks to everyone who has tested the release candidate and given their comments and votes. The tally is as follows. 4 binding +1s: Shaofeng Shi Dong Li Luke Han Billy Liu 3 non-binding +1s: Julian Pan Kaisen Kang Jianhua Peng No 0s or -1s. Therefore I am delighted to announce

Re: kylin2.1 NoSuchMethodError: org.apache.hadoop.hbase.coprocessor.RegionCoprocessorEnvironment.getRegion()

2018-06-19 Thread ShaoFeng Shi
/apache-kylin.74782.x6.nabble.com/ > -- Best regards, Shaofeng Shi 史少锋

Re: 删除cube报错

2018-06-20 Thread ShaoFeng Shi
Hi, the picture couldn't be displayed. Please provide the error log as well as your Kylin version info. Thanks. 在 2018年6月20日 上午11:09,鲨鱼 <786510...@qq.com>写道: > 你好, > 我想删除一个build时报错的cube,这个失败的job已经被删除了,仍报如下错误,,请问如何解决: > -- Best regards, Shaofeng Shi 史少锋

[VOTE] Release apache-kylin-2.4.0 (RC1)

2018-06-20 Thread ShaoFeng Shi
this package as Apache Kylin 2.4.0 [ ] 0 I don't feel strongly about it, but I'm okay with the release [ ] -1 Do not release this package because... Here is my vote: +1 (binding) -- Best regards, Shaofeng Shi 史少锋

Re: 退订

2018-06-20 Thread ShaoFeng Shi
Hi Gao Lv, please send an email to dev-unsubscr...@kylin.apache.org, not dev@kylin.apache.org. 2018-06-20 16:00 GMT+08:00 高旅 : > 退订 > > -- Best regards, Shaofeng Shi 史少锋

Re: [VOTE] Release apache-kylin-2.3.2 (RC2)

2018-06-27 Thread ShaoFeng Shi
next 72 hours and passes if a majority of > at least three +1 PPMC votes are cast. > > [ ] +1 Release this package as Apache Kylin 2.3.2 > [ ] 0 I don't feel strongly about it, but I'm okay with the release > [ ] -1 Do not release this package because... > > > Here is my vote: > > +1 > > -- > Best regards, > > KaiSen Kang 康凯森 > > -- > Sent from: http://apache-kylin.74782.x6.nabble.com/ > -- Best regards, Shaofeng Shi 史少锋

Re: how to add a new database dialect

2018-07-02 Thread ShaoFeng Shi
dd this dialect? -- Best regards, Shaofeng Shi 史少锋

Re: How to configure the default data type measure decimal(19, 4)?

2018-07-03 Thread ShaoFeng Shi
: > Currently, I am not able to select the data type of the measure. I want to > have decimal(19,6) but in my current version 2.2.0, kylin defaults the data > type to decimal(19,4). How can I change this? Please respond. > > -- > Sent from: http://apache-kylin.74782.x6.nabble.com/ > -- Best regards, Shaofeng Shi 史少锋

Re: [RESULT] [VOTE] Release apache-kylin-2.3.2 (RC2)

2018-06-30 Thread ShaoFeng Shi
Thank you Kaisen! 2018-06-30 17:20 GMT+08:00 kangkaisen : > Thanks to everyone who has tested the release candidate and given > their comments and votes. > > The tally is as follows. > > 5 binding +1s: > Shaofeng Shi > Yerui Sun > Dayue Gao > Billy Liu > Dong L

Re: it run error when run step 1. Execution failed with exit status: 3

2018-06-30 Thread ShaoFeng Shi
-07-01 10:46:50 Processing rows: 90 Hashtable size: 89 Memory > usage: 828289456 percentage: 0.792 > 2018-07-01 10:46:57 Processing rows: 100 Hashtable size: 99 Memory > usage: 908630072 percentage: 0.868 > 2018-07-01 10:47:11 Processing rows: 110 Hashtable size: 109 > Memory usage: 994774944 percentage: 0.951 > Execution failed with exit status: 3 > Obtaining error information > > Task failed! > Task ID: > Stage-34 > > Logs: > > /tmp/hdfs/hive.log > FAILED: Execution Error, return code 3 from org.apache.hadoop.hive.ql. > exec.mr.MapredLocalTask > > > > > apache_...@163.com > -- Best regards, Shaofeng Shi 史少锋

Apache Kylin Chinese documents updated / Kylin 中文文档已更新

2018-07-02 Thread ShaoFeng Shi
to get the new content. We welcome public contribution on documents as well, regarding how to write and contribute, please check: https://kylin.apache.org/development/howto_docs.html -- Best regards, Shaofeng Shi 史少锋

Re: How to configure the default data type measure decimal(19, 4)?

2018-07-03 Thread ShaoFeng Shi
precision=19 > and restarted kylin. But still I get the default as decimal(19,4). Please > help. > > -- > Sent from: http://apache-kylin.74782.x6.nabble.com/ > -- Best regards, Shaofeng Shi 史少锋

Re: How to configure the default data type measure decimal(19, 4)?

2018-07-03 Thread ShaoFeng Shi
"next_parameter" : null }, "returntype" : "decimal(19,4)" } }, 2018-07-03 19:14 GMT+08:00 mvneethu : > Yes, I have sync the hive table again and seems to take the default > decimal(19,4). > > -- > Sent from: http://apache-kylin.74782.x6.nabble.com/ > -- Best regards, Shaofeng Shi 史少锋

Re: question about joint dimensions

2017-10-26 Thread ShaoFeng Shi
planation. If we want to add new aggregation group , what > should I do? > > 2017-10-25 18:36 GMT+08:00 ShaoFeng Shi <shaofeng...@apache.org>: > > > Hi hao, > > > > It will go to the base cuboid: ABCDE, and aggregate D at running time. So > > in theory, it

Re: data format when building increment cube

2017-10-23 Thread ShaoFeng Shi
3 18:00 GMT+08:00 op <520075...@qq.com>: > on kylin web,there is no "Edit Json" . my version 2.0 > > > ------ 原始邮件 -- > *发件人:* "ShaoFeng Shi";<shaofeng...@apache.org>; > *发送时间:* 2017年10月23日(星期一) 下午5:53 >

Re: How to configure the default data type measure decimal(19, 4)?

2018-07-03 Thread ShaoFeng Shi
gt; been changed to decimal(19,6). When I try to build the cube it says, it > gives me an error saying that "inconsistent cubedesc_signature". Is there > anything I should do for that? > > -- > Sent from: http://apache-kylin.74782.x6.nabble.com/ > -- Best regards, Shaofeng Shi 史少锋

Re: 答复: Calculate count distinct with 2 segments not correct

2018-01-11 Thread ShaoFeng Shi
I add the global dictionary the rate of > expansion does not increase > > > > > 发件人: ShaoFeng Shi <shaofeng...@apache.org> > 发送时间: 2018年1月11日 16:58 > 收件人: dev > 主题: Re: Calculate count distinct with 2 segments not correct > >

Re: Calculate count distinct with 2 segments not correct

2018-01-11 Thread ShaoFeng Shi
ery in both 2 segments, > the result of count distinct is not correct, > > after I merge the 2 segments and finally the result seems correct. > > So I have the question, if I want to calculate a count distinct with > whenever start and whenever end, I should always merge all the segm

Re: Re: Support embedded JSON format ?

2018-01-15 Thread ShaoFeng Shi
erties.put(EMBEDDED_PROPERTY_SEPARATOR, "_"); > } > > and I rebuild this module and replace it to tomcat webapps > but error has still happened > I wonder Why? > > > > 446463...@qq.com > > From: ShaoFeng Shi > Date: 2018-01-15 16:37 > To: de

Re: Support embedded JSON format ?

2018-01-15 Thread ShaoFeng Shi
nal_price": "xxx", > "page_name": "xxx", > "pay_result": "", > "pay_type": "", > "product_name": "xxx", > "scan_app": "", > "scan_result": "" > }, > "device":"" > } > but build cube throw Error > Property ‘app’ is not embedded format ? > > > > > > 446463...@qq.coms > -- Best regards, Shaofeng Shi 史少锋

Re: 答复: Can't delete segment

2018-02-02 Thread ShaoFeng Shi
gt; > So it turn out to be a dilemma for, I can't build/refresh the segment, > and > > I can't delete either. > > Finally I purge the cube... > > I wonder if it is a bug or there is some solutions? > > > > > > version 2.2.0 > > > > > > thanks > > > > > > > -- > Best regards, > > Shaofeng Shi 史少锋 > -- Best regards, Shaofeng Shi 史少锋

Re: [Discuss] Apache Kylin Component Owner Plan

2018-02-03 Thread ShaoFeng Shi
verage. I've seen lots > > patches without proper tests > > > > On Fri, Feb 2, 2018 at 2:57 PM, Jianhua Peng <pengjian...@apache.org> > wrote: > > > >> +1 > >> > >> On 2018/02/02 02:39:38, ShaoFeng Shi <shaofeng...@apache.org> wrote:

Re: [Discuss] Apache Kylin Component Owner Plan

2018-02-03 Thread ShaoFeng Shi
I would like to take the ownership in "Documentation" and "Streaming" part. 2018-02-03 20:11 GMT+08:00 ShaoFeng Shi <shaofeng...@apache.org>: > Thanks guys; > > I have added liyang as one owner of "Metadata", Roger Shi as one owner of > "

Re: Can't delete segment

2018-02-02 Thread ShaoFeng Shi
ersion 2.2.0 > > > thanks > > -- Best regards, Shaofeng Shi 史少锋

[Discuss] Patch +1 Policy

2018-02-01 Thread ShaoFeng Shi
r comments; If no objection, we will update it to Kylin's development process and enforce it in the future. Thanks! -- Best regards, Shaofeng Shi 史少锋

[Discuss] Apache Kylin Component Owner Plan

2018-02-01 Thread ShaoFeng Shi
, Shaofeng Shi 史少锋

Re: Welcome new Apache Kylin committer: Jianhua Peng

2018-02-01 Thread ShaoFeng Shi
, to answer > > others questions actively, submit patches for bug fixes and contribute to > > some features. We are so glad to have him to be our new committer. > > > > Please join me to welcome Jianhua. > > > > Luke Han > > > > On behalf of the Apache Kylin PPMC > > > -- Best regards, Shaofeng Shi 史少锋

Re: [Discuss] Patch +1 Policy

2018-02-02 Thread ShaoFeng Shi
Billy, this is an open discussion; A vote usually happens after the discussion. I'm not sure whether it is needed if all members are okay with it. 2018-02-02 14:56 GMT+08:00 Jianhua Peng <pengjian...@apache.org>: > +1 > > On 2018/02/02 03:10:32, ShaoFeng Shi <shaofeng...

Re: [Discuss] Patch +1 Policy

2018-02-02 Thread ShaoFeng Shi
Hi Jianhua, Thanks for your suggestion. In another thread, Billy is proposing to use apache gitbox to host Kylin repository. After that, we may switch to GitHub PR for review and merge. If so, I think the review board is no longer recommended. 2018-02-02 17:20 GMT+08:00 ShaoFeng Shi <shaof

Re: [Discuss] Apache Kylin Component Owner Plan

2018-02-04 Thread ShaoFeng Shi
his year,I and Dayue will contribute and take over "Storage-Druid" > components. > > -- > Sent from: http://apache-kylin.74782.x6.nabble.com/ > -- Best regards, Shaofeng Shi 史少锋

<    1   2   3   4   5   6   7   8   9   10   >