Re: Re: cube run 3 setp:org.apache.thrift.transport.TTransportException
Hi,Billy: Good Idea,It's work . Think you. 1.conf/setenv.sh source /opt/ficlient/bigdata_env kinit -k -t /home/xxx/kylin/conf/user.keytab kylin 2.conf/kylin.properties ## Hive client, valid value [cli, beeline] kylin.source.hive.client=beeline kylin.source.hive.beeline-params=-u "jdbc:hive2://xx.xx.xx.xx:24002,xx.xx.xx.xx::24002,xx.xx.xx.xx::24002/kylin;user.keytab=/home/nlp/kylin21/conf/user.keytab;serviceDis coveryMode=zooKeeper;zooKeeperNamespace=hiveserver2;sasl.qop=auth-conf;auth=KERBEROS;principal=hive/hadoop.hadoop@hadoop.com" 3.merge hivemetastore-site.xml into hive-site.xml put hive-site.xml kylin/conf/ directory apache_...@163.com From: Billy Liu Date: 2017-11-05 10:59 To: dev Subject: Re: cube run 3 setp:org.apache.thrift.transport.TTransportException Try copy all properties in hivemetastore-site.xml into hive-site.xml 2017-11-04 22:57 GMT+08:00 ShaoFeng Shi <shaofeng...@apache.org>: > Hi, > > The pre-built Kylin binary package doesn't support FusionInsight I think. > At least you need re-compile (with FI's Hadoop/HBase/Hive version) and also > do some tunning with FI specific configurations. That is what I heard from > some user. > > 2017-11-04 21:58 GMT+08:00 apache_...@163.com <apache_...@163.com>: > > > Hi, > > > >Kylin2.1 on Huawei FusionInsight C60. > > > > > > when cube run #3 Step Name: Extract Fact Table Distinct Columns ,it get > > error,What's the reason? > > > > 2017-11-04 21:25:09,703 INFO [Job 8557407a-8e87-49aa-9cff- > b7e3f58c2f12-102] > > hive.metastore:480 : Trying to connect to metastore with URI thrift:// > > 10.10.20.54:21088 > > 2017-11-04 21:25:09,744 INFO [Job 8557407a-8e87-49aa-9cff- > b7e3f58c2f12-102] > > hive.metastore:525 : Opened a connection to metastore, current > connections: > > 1 > > 2017-11-04 21:25:09,801 WARN [Job 8557407a-8e87-49aa-9cff- > b7e3f58c2f12-102] > > hive.metastore:576 : set_ugi() not successful, Likely cause: new client > > talking to old server. Continuing without it. > > org.apache.thrift.transport.TTransportException > > at org.apache.thrift.transport.TIOStreamTransport.read( > > TIOStreamTransport.java:132) > > at org.apache.thrift.transport.TTransport.readAll(TTransport. > > java:86) > > at org.apache.thrift.protocol.TBinaryProtocol.readStringBody( > > TBinaryProtocol.java:380) > > at org.apache.thrift.protocol.TBinaryProtocol.readMessageBegin( > > TBinaryProtocol.java:230) > > at org.apache.thrift.TServiceClient.receiveBase( > > TServiceClient.java:77) > > at org.apache.hadoop.hive.metastore.api. > > ThriftHiveMetastore$Client.recv_set_ugi(ThriftHiveMetastore.java:3794) > > at org.apache.hadoop.hive.metastore.api. > > ThriftHiveMetastore$Client.set_ugi(ThriftHiveMetastore.java:3780) > > at org.apache.hadoop.hive.metastore.HiveMetaStoreClient. > > open(HiveMetaStoreClient.java:568) > > at org.apache.hadoop.hive.metastore.HiveMetaStoreClient. > > (HiveMetaStoreClient.java:249) > > at org.apache.hadoop.hive.metastore.HiveMetaStoreClient. > > (HiveMetaStoreClient.java:194) > > at org.apache.hive.hcatalog.common.HiveClientCache$ > > CacheableHiveMetaStoreClient.(HiveClientCache.java:330) > > at sun.reflect.NativeConstructorAccessorImpl.newInstance0(Native > > Method) > > at sun.reflect.NativeConstructorAccessorImpl.newInstance( > > NativeConstructorAccessorImpl.java:62) > > at sun.reflect.DelegatingConstructorAccessorImpl.newInstance( > > DelegatingConstructorAccessorImpl.java:45) > > at java.lang.reflect.Constructor.newInstance(Constructor.java: > 423) > > at org.apache.hadoop.hive.metastore.MetaStoreUtils. > > newInstance(MetaStoreUtils.java:1530) > > at org.apache.hadoop.hive.metastore. > RetryingMetaStoreClient. > > (RetryingMetaStoreClient.java:87) > > at org.apache.hadoop.hive.metastore.RetryingMetaStoreClient. > > getProxy(RetryingMetaStoreClient.java:133) > > at org.apache.hadoop.hive.metastore.RetryingMetaStoreClient. > > getProxy(RetryingMetaStoreClient.java:119) > > at org.apache.hive.hcatalog.common.HiveClientCache$5.call( > > HiveClientCache.java:231) > > at org.apache.hive.hcatalog.common.HiveClientCache$5.call( > > HiveClientCache.java:227) > > at com.google.common.cache.LocalCache$LocalManualCache$1. > > load(LocalCache.java:4791) > > at com.google.common.cache.LocalCache$LoadingValueReference. > > loadFuture(LocalCache.java:3584) > >
cube run 3 setp:org.apache.thrift.transport.TTransportException
(FactDistinctColumnsJob.java:141) at org.apache.kylin.engine.mr.steps.FactDistinctColumnsJob.run(FactDistinctColumnsJob.java:119) at org.apache.kylin.engine.mr.MRUtil.runMRJob(MRUtil.java:92) at org.apache.kylin.engine.mr.common.MapReduceExecutable.doWork(MapReduceExecutable.java:122) at org.apache.kylin.job.execution.AbstractExecutable.execute(AbstractExecutable.java:125) at org.apache.kylin.job.execution.DefaultChainedExecutable.doWork(DefaultChainedExecutable.java:65) at org.apache.kylin.job.execution.AbstractExecutable.execute(AbstractExecutable.java:125) at org.apache.kylin.job.impl.threadpool.DefaultScheduler$JobRunner.run(DefaultScheduler.java:141) at java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1142) at java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:617) at java.lang.Thread.run(Thread.java:745) Caused by: java.io.IOException: org.apache.thrift.transport.TTransportException at org.apache.hive.hcatalog.mapreduce.HCatInputFormat.setInput(HCatInputFormat.java:97) at org.apache.hive.hcatalog.mapreduce.HCatInputFormat.setInput(HCatInputFormat.java:51) at org.apache.kylin.source.hive.HiveMRInput$HiveTableInputFormat.configureJob(HiveMRInput.java:110) ... 11 more Caused by: org.apache.thrift.transport.TTransportException at org.apache.thrift.transport.TIOStreamTransport.read(TIOStreamTransport.java:132) at org.apache.thrift.transport.TTransport.readAll(TTransport.java:86) at org.apache.thrift.protocol.TBinaryProtocol.readAll(TBinaryProtocol.java:429) at org.apache.thrift.protocol.TBinaryProtocol.readI32(TBinaryProtocol.java:318) at org.apache.thrift.protocol.TBinaryProtocol.readMessageBegin(TBinaryProtocol.java:219) at org.apache.thrift.TServiceClient.receiveBase(TServiceClient.java:77) at org.apache.hadoop.hive.metastore.api.ThriftHiveMetastore$Client.recv_get_table(ThriftHiveMetastore.java:1260) at org.apache.hadoop.hive.metastore.api.ThriftHiveMetastore$Client.get_table(ThriftHiveMetastore.java:1246) at org.apache.hadoop.hive.metastore.HiveMetaStoreClient.getTable(HiveMetaStoreClient.java:1357) at sun.reflect.NativeMethodAccessorImpl.invoke0(Native Method) at sun.reflect.NativeMethodAccessorImpl.invoke(NativeMethodAccessorImpl.java:62) at sun.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorImpl.java:43) at java.lang.reflect.Method.invoke(Method.java:498) at org.apache.hadoop.hive.metastore.RetryingMetaStoreClient.invoke(RetryingMetaStoreClient.java:153) at com.sun.proxy.$Proxy58.getTable(Unknown Source) at org.apache.hive.hcatalog.common.HCatUtil.getTable(HCatUtil.java:180) at org.apache.hive.hcatalog.mapreduce.InitializeInput.getInputJobInfo(InitializeInput.java:105) at org.apache.hive.hcatalog.mapreduce.InitializeInput.setInput(InitializeInput.java:88) at org.apache.hive.hcatalog.mapreduce.HCatInputFormat.setInput(HCatInputFormat.java:95) ... 13 more 2017-11-04 21:25:11,307 INFO [Job 8557407a-8e87-49aa-9cff-b7e3f58c2f12-102] execution.ExecutableManager:425 : job id:8557407a-8e87-49aa-9cff-b7e3f58c2f12-02 from RUNNING to ERROR apache_...@163.com
cube run 3 setp:org.apache.thrift.transport.TTransportException
) at org.apache.kylin.engine.mr.steps.FactDistinctColumnsJob.run(FactDistinctColumnsJob.java:119) at org.apache.kylin.engine.mr.MRUtil.runMRJob(MRUtil.java:92) at org.apache.kylin.engine.mr.common.MapReduceExecutable.doWork(MapReduceExecutable.java:122) at org.apache.kylin.job.execution.AbstractExecutable.execute(AbstractExecutable.java:125) at org.apache.kylin.job.execution.DefaultChainedExecutable.doWork(DefaultChainedExecutable.java:65) at org.apache.kylin.job.execution.AbstractExecutable.execute(AbstractExecutable.java:125) at org.apache.kylin.job.impl.threadpool.DefaultScheduler$JobRunner.run(DefaultScheduler.java:141) at java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1142) at java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:617) at java.lang.Thread.run(Thread.java:745) Caused by: java.io.IOException: org.apache.thrift.transport.TTransportException at org.apache.hive.hcatalog.mapreduce.HCatInputFormat.setInput(HCatInputFormat.java:97) at org.apache.hive.hcatalog.mapreduce.HCatInputFormat.setInput(HCatInputFormat.java:51) at org.apache.kylin.source.hive.HiveMRInput$HiveTableInputFormat.configureJob(HiveMRInput.java:110) ... 11 more Caused by: org.apache.thrift.transport.TTransportException at org.apache.thrift.transport.TIOStreamTransport.read(TIOStreamTransport.java:132) at org.apache.thrift.transport.TTransport.readAll(TTransport.java:86) at org.apache.thrift.protocol.TBinaryProtocol.readAll(TBinaryProtocol.java:429) at org.apache.thrift.protocol.TBinaryProtocol.readI32(TBinaryProtocol.java:318) at org.apache.thrift.protocol.TBinaryProtocol.readMessageBegin(TBinaryProtocol.java:219) at org.apache.thrift.TServiceClient.receiveBase(TServiceClient.java:77) at org.apache.hadoop.hive.metastore.api.ThriftHiveMetastore$Client.recv_get_table(ThriftHiveMetastore.java:1260) at org.apache.hadoop.hive.metastore.api.ThriftHiveMetastore$Client.get_table(ThriftHiveMetastore.java:1246) at org.apache.hadoop.hive.metastore.HiveMetaStoreClient.getTable(HiveMetaStoreClient.java:1357) at sun.reflect.NativeMethodAccessorImpl.invoke0(Native Method) at sun.reflect.NativeMethodAccessorImpl.invoke(NativeMethodAccessorImpl.java:62) at sun.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorImpl.java:43) at java.lang.reflect.Method.invoke(Method.java:498) at org.apache.hadoop.hive.metastore.RetryingMetaStoreClient.invoke(RetryingMetaStoreClient.java:153) at com.sun.proxy.$Proxy58.getTable(Unknown Source) at org.apache.hive.hcatalog.common.HCatUtil.getTable(HCatUtil.java:180) at org.apache.hive.hcatalog.mapreduce.InitializeInput.getInputJobInfo(InitializeInput.java:105) at org.apache.hive.hcatalog.mapreduce.InitializeInput.setInput(InitializeInput.java:88) at org.apache.hive.hcatalog.mapreduce.HCatInputFormat.setInput(HCatInputFormat.java:95) ... 13 more 2017-11-04 21:25:11,307 INFO [Job 8557407a-8e87-49aa-9cff-b7e3f58c2f12-102] execution.ExecutableManager:425 : job id:8557407a-8e87-49aa-9cff-b7e3f58c2f12-02 from RUNNING to ERROR apache_...@163.com
kylin2.1 on FusionInsight C60,start tomcat error.
Hi, Huawei FusionInsight C60 have open kerberos authentication; Hava set parameter in setenv.sh kinit -k -t ~/keytab/user.keytab user run sh kylin.sh start,is well but tomcat is error? please help. INFO: Initializing ProtocolHandler ["ajp-bio-9009"] Nov 04, 2017 12:54:08 PM org.apache.catalina.startup.Catalina load INFO: Initialization processed in 1842 ms Nov 04, 2017 12:54:08 PM org.apache.catalina.core.StandardService startInternal INFO: Starting service Catalina Nov 04, 2017 12:54:08 PM org.apache.catalina.core.StandardEngine startInternal INFO: Starting Servlet Engine: Apache Tomcat/7.0.69 Nov 04, 2017 12:54:08 PM org.apache.catalina.startup.HostConfig deployWAR INFO: Deploying web application archive /home/xxx/kylin21/tomcat/webapps/kylin.war Nov 04, 2017 12:54:08 PM org.apache.catalina.core.ContainerBase addChildInternal SEVERE: ContainerBase.addChild: start: org.apache.catalina.LifecycleException: Failed to start component [StandardEngine[Catalina].StandardHost[localhost].StandardContext[/kylin]] at org.apache.catalina.util.LifecycleBase.start(LifecycleBase.java:153) at org.apache.catalina.core.ContainerBase.addChildInternal(ContainerBase.java:899) at org.apache.catalina.core.ContainerBase.addChild(ContainerBase.java:875) at org.apache.catalina.core.StandardHost.addChild(StandardHost.java:652) at org.apache.catalina.startup.HostConfig.deployWAR(HostConfig.java:1092) at org.apache.catalina.startup.HostConfig$DeployWar.run(HostConfig.java:1984) at java.util.concurrent.Executors$RunnableAdapter.call(Executors.java:511) at java.util.concurrent.FutureTask.run(FutureTask.java:266) at java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1142) at java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:617) at java.lang.Thread.run(Thread.java:745) Caused by: java.lang.NullPointerException at org.eclipse.jetty.websocket.jsr356.server.deploy.WebSocketServerContainerInitializer.isEnabled(WebSocketServerContainerInitializer.java:122) at org.eclipse.jetty.websocket.jsr356.server.deploy.WebSocketServerContainerInitializer.onStartup(WebSocketServerContainerInitializer.java:137) at org.apache.catalina.core.StandardContext.startInternal(StandardContext.java:5573) at org.apache.catalina.util.LifecycleBase.start(LifecycleBase.java:147) ... 10 more Nov 04, 2017 12:54:08 PM org.apache.catalina.startup.HostConfig deployWAR SEVERE: Error deploying web application archive /home/xxx/kylin21/tomcat/webapps/kylin.war java.lang.IllegalStateException: ContainerBase.addChild: start: org.apache.catalina.LifecycleException: Failed to start component [StandardEngine[Catalina].StandardHost[localhost].StandardContext[/kylin]] at org.apache.catalina.core.ContainerBase.addChildInternal(ContainerBase.java:903) at org.apache.catalina.core.ContainerBase.addChild(ContainerBase.java:875) at org.apache.catalina.core.StandardHost.addChild(StandardHost.java:652) at org.apache.catalina.startup.HostConfig.deployWAR(HostConfig.java:1092) at org.apache.catalina.startup.HostConfig$DeployWar.run(HostConfig.java:1984) at java.util.concurrent.Executors$RunnableAdapter.call(Executors.java:511) at java.util.concurrent.FutureTask.run(FutureTask.java:266) at java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1142) at java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:617) at java.lang.Thread.run(Thread.java:745) Nov 04, 2017 12:54:08 PM org.apache.catalina.startup.HostConfig deployWAR INFO: Deployment of web application archive /home/xxx/kylin21/tomcat/webapps/kylin.war has finished in 660 ms Nov 04, 2017 12:54:08 PM org.apache.coyote.AbstractProtocol start INFO: Starting ProtocolHandler ["http-bio-7070"] Nov 04, 2017 12:54:08 PM org.apache.coyote.AbstractProtocol start INFO: Starting ProtocolHandler ["ajp-bio-9009"] Nov 04, 2017 12:54:08 PM org.apache.catalina.startup.Catalina start INFO: Server startup in 765 ms /etc/host: 127.0.0.1 localhost localhost.localdomain localhost4 localhost4.localdomain4 xx.xx.xx.xx bd05 xx.xx.xx.xx bd03 xx.xx.xx.xxbd02 xx.xx.xx.xx bd04 xx.xx.xx.xx bd01 apache_...@163.com
Cube can run right,but query is error
ot;: null
},
{
"name": "FORE_LON_TYPE",
"table": "LOAN_GROUP",
"column": "FORE_LON_TYPE",
"derived": null
},
{
"name": "BC_FLAG",
"table": "LOAN_GROUP",
"column": "BC_FLAG",
"derived": null
},
{
"name": "STRA_INDU_NAME",
"table": "LOAN_GROUP",
"column": "STRA_INDU_NAME",
"derived": null
},
{
"name": "INDU_TRF_UPD_PRO",
"table": "LOAN_GROUP",
"column": "INDU_TRF_UPD_PRO",
"derived": null
},
{
"name": "ATRE_TYPE_NAME",
"table": "LOAN_GROUP",
"column": "ATRE_TYPE_NAME",
"derived": null
},
{
"name": "ESTATE_TYPE",
"table": "LOAN_GROUP",
"column": "ESTATE_TYPE",
"derived": null
},
{
"name": "DATE_CD",
"table": "DIM_DATE",
"column": "DATE_CD",
"derived": null
},
{
"name": "LAST_D",
"table": "DIM_DATE",
"column": null,
"derived": [
"LAST_D"
]
},
{
"name": "LAST_M",
"table": "DIM_DATE",
"column": null,
"derived": [
"LAST_M"
]
},
{
"name": "LAST_Q",
"table": "DIM_DATE",
"column": null,
"derived": [
"LAST_Q"
]
},
{
"name": "LAST_Y",
"table": "DIM_DATE",
"column": null,
"derived": [
"LAST_Y"
]
},
{
"name": "M_END",
"table": "DIM_DATE",
"column": null,
"derived": [
"M_END"
]
},
{
"name": "Q_END",
"table": "DIM_DATE",
"column": null,
"derived": [
"Q_END"
]
},
{
"name": "Y_END",
"table": "DIM_DATE",
"column": null,
"derived": [
"Y_END"
]
},
{
"name": "ORG_CD",
"table": "DIM_ORG",
"column": "ORG_CD",
"derived": null
},
{
"name": "ORG_NAME",
"table": "DIM_ORG",
"column": null,
"derived": [
"ORG_NAME"
]
},
{
"name": "CURR_CD",
"table": "DIM_CURR",
"column": "CURR_CD",
"derived": null
},
{
"name": "CURR_NAME",
"table": "DIM_CURR",
"column": null,
"derived": [
"CURR_NAME"
]
},
{
"name": "ENT_SCA_CD",
"table": "DIM_ENT_SCA",
"column": "ENT_SCA_CD",
"derived": null
},
{
"name": "ENT_SCA_NAME",
"table": "DIM_ENT_SCA",
"column": null,
"derived": [
"ENT_SCA_NAME"
]
},
{
"name": "INDU_CD",
"table": "DIM_INDU",
"column": "INDU_CD",
"derived": null
},
{
"name": "INDU_NAME",
"table": "DIM_INDU",
"column": null,
"derived": [
"INDU_NAME"
]
},
{
"name": "INDU_LV",
"table": "DIM_INDU",
"column": null,
"derived": [
"INDU_LV"
]
},
{
"name": "INDU_CD_LV1",
"table": "DIM_INDU",
"column": null,
"derived": [
"INDU_CD_LV1"
]
},
{
"name": "INDU_NAME_LV1",
"table": "DIM_INDU",
"column": null,
"derived": [
"INDU_NAME_LV1"
]
},
{
"name": "ENT_PSN_CD",
"table": "DIM_ENT_PSN",
"column": "ENT_PSN_CD",
"derived": null
},
{
"name": "ENT_PSN_NAME",
"table": "DIM_ENT_PSN",
"column": null,
"derived": [
"ENT_PSN_NAME"
]
},
{
"name": "PER_LOAN_CD",
"table": "DIM_PER_LOAN",
"column": "PER_LOAN_CD",
"derived": null
},
{
"name": "PER_LOAN_NAME",
"table": "DIM_PER_LOAN",
"column": null,
"derived": [
"PER_LOAN_NAME"
]
},
{
"name": "PER_LOAN_LV",
"table": "DIM_PER_LOAN",
"column": null,
"derived": [
"PER_LOAN_LV"
]
},
{
"name": "PER_LOAN_CD_LV1",
"table": "DIM_PER_LOAN",
"column": null,
"derived": [
"PER_LOAN_CD_LV1"
]
},
{
"name": "PER_LOAN_NAME_LV1",
"table": "DIM_PER_LOAN",
"column": null,
"derived": [
"PER_LOAN_NAME_LV1"
]
},
{
"name": "APPR_CREXT_RENT",
"table": "DIM_APPR_CREXT",
"column": "APPR_CREXT_RENT",
"derived": null
},
{
"name": "APPR_CREXT_RENT_DES",
"table": "DIM_APPR_CREXT",
"column": null,
"derived": [
"APPR_CREXT_RENT_DES"
]
},
{
"name": "CUST_LON_TYPE",
"table": "DIM_CUST_LON",
"column": "CUST_LON_TYPE",
"derived": null
},
{
"name": "CUST_LON_NAME",
"table": "DIM_CUST_LON",
"column": null,
"derived": [
"CUST_LON_NAME"
]
},
{
"name": "CLASS_FIVE_CD",
"table": "DIM_CLASS_FIVE",
"column": "CLASS_FIVE_CD",
"derived": null
},
{
"name": "CLASS_FIVE_NAME",
"table": "DIM_CLASS_FIVE",
"column": null,
"derived": [
"CLASS_FIVE_NAME"
]
},
{
"name": "CLASS_FIVE_TYPE",
"table": "DIM_CLASS_FIVE",
"column": null,
"derived": [
"CLASS_FIVE_TYPE"
]
},
{
"name": "MAIN_GUAR_CD",
"table": "DIM_MAIN_GUAR",
"column": "MAIN_GUAR_CD",
"derived": null
},
{
"name": "MAIN_GUAR_NAME",
"table": "DIM_MAIN_GUAR",
"column": null,
"derived": [
"MAIN_GUAR_NAME"
]
},
{
"name": "ESTATE_CD",
"table": "DIM_ESTATE_LON",
"column": "ESTATE_CD",
"derived": null
},
{
"name": "ESTATE_DES",
"table": "DIM_ESTATE_LON",
"column": null,
"derived": [
"ESTATE_DES"
]
},
{
"name": "ESTATE_LV",
"table": "DIM_ESTATE_LON",
"column": null,
"derived": [
"ESTATE_LV"
]
},
{
"name": "ESTATE_CD_LV1",
"table": "DIM_ESTATE_LON",
"column": null,
"derived": [
"ESTATE_CD_LV1"
]
},
{
"name": "ESTATE_DES_LV1",
"table": "DIM_ESTATE_LON",
"column": null,
"derived": [
"ESTATE_DES_LV1"
]
},
{
"name": "GL_ACC_CD",
"table": "DIM_GL_ACC",
"column": "GL_ACC_CD",
"derived": null
},
{
"name": "GL_ACC_NAME",
"table": "DIM_GL_ACC",
"column": null,
"derived": [
"GL_ACC_NAME"
]
}
],
"measures": [
{
"name": "_COUNT_",
"function": {
"expression": "COUNT",
"parameter": {
"type": "constant",
"value": "1"
},
"returntype": "bigint"
}
},
{
"name": "1",
"function": {
"expression": "SUM",
"parameter": {
"type": "column",
"value": "LOAN_GROUP.BAL"
},
"returntype": "decimal(19,4)"
}
}
],
"dictionaries": [],
"rowkey": {
"rowkey_columns": [
{
"column": "LOAN_GROUP.DATE_CD",
"encoding": "date",
"isShardBy": false
},
{
"column": "LOAN_GROUP.ORG_CD",
"encoding": "dict",
"isShardBy": false
},
{
"column": "LOAN_GROUP.CURR_CD",
"encoding": "dict",
"isShardBy": false
},
{
"column": "LOAN_GROUP.GL_ACC_CD",
"encoding": "dict",
"isShardBy": false
},
{
"column": "LOAN_GROUP.ENT_SCA_CD",
"encoding": "dict",
"isShardBy": false
},
{
"column": "LOAN_GROUP.INDU_CD",
"encoding": "dict",
"isShardBy": false
},
{
"column": "LOAN_GROUP.ENT_PSN_CD",
"encoding": "dict",
"isShardBy": false
},
{
"column": "LOAN_GROUP.PER_LON_CD",
"encoding": "dict",
"isShardBy": false
},
{
"column": "LOAN_GROUP.APPR_CREXT_RENT",
"encoding": "dict",
"isShardBy": false
},
{
"column": "LOAN_GROUP.PRD_NO",
"encoding": "dict",
"isShardBy": false
},
{
"column": "LOAN_GROUP.CUST_LON_TYPE",
"encoding": "dict",
"isShardBy": false
},
{
"column": "LOAN_GROUP.PRD_PINGZ",
"encoding": "dict",
"isShardBy": false
},
{
"column": "LOAN_GROUP.CLASS_FIVE_CD",
"encoding": "dict",
"isShardBy": false
},
{
"column": "LOAN_GROUP.MAIN_GUAR_CD",
"encoding": "dict",
"isShardBy": false
},
{
"column": "LOAN_GROUP.REG_ADMI_AREA",
"encoding": "dict",
"isShardBy": false
},
{
"column": "LOAN_GROUP.FORE_LON_TYPE",
"encoding": "dict",
"isShardBy": false
},
{
"column": "LOAN_GROUP.BC_FLAG",
"encoding": "dict",
"isShardBy": false
},
{
"column": "LOAN_GROUP.STRA_INDU_NAME",
"encoding": "dict",
"isShardBy": false
},
{
"column": "LOAN_GROUP.INDU_TRF_UPD_PRO",
"encoding": "dict",
"isShardBy": false
},
{
"column": "LOAN_GROUP.ATRE_TYPE_NAME",
"encoding": "dict",
"isShardBy": false
},
{
"column": "LOAN_GROUP.ESTATE_TYPE",
"encoding": "dict",
"isShardBy": false
},
{
"column": "DIM_DATE.DATE_CD",
"encoding": "date",
"isShardBy": false
},
{
"column": "DIM_ORG.ORG_CD",
"encoding": "dict",
"isShardBy": false
},
{
"column": "DIM_CURR.CURR_CD",
"encoding": "dict",
"isShardBy": false
},
{
"column": "DIM_ENT_SCA.ENT_SCA_CD",
"encoding": "dict",
"isShardBy": false
},
{
"column": "DIM_INDU.INDU_CD",
"encoding": "dict",
"isShardBy": false
},
{
"column": "DIM_ENT_PSN.ENT_PSN_CD",
"encoding": "dict",
"isShardBy": false
},
{
"column": "DIM_PER_LOAN.PER_LOAN_CD",
"encoding": "dict",
"isShardBy": false
},
{
"column": "DIM_APPR_CREXT.APPR_CREXT_RENT",
"encoding": "dict",
"isShardBy": false
},
{
"column": "DIM_CUST_LON.CUST_LON_TYPE",
"encoding": "dict",
"isShardBy": false
},
{
"column": "DIM_CLASS_FIVE.CLASS_FIVE_CD",
"encoding": "dict",
"isShardBy": false
},
{
"column": "DIM_MAIN_GUAR.MAIN_GUAR_CD",
"encoding": "dict",
"isShardBy": false
},
{
"column": "DIM_ESTATE_LON.ESTATE_CD",
"encoding": "dict",
"isShardBy": false
},
{
"column": "DIM_GL_ACC.GL_ACC_CD",
"encoding": "dict",
"isShardBy": false
}
]
},
"hbase_mapping": {
"column_family": [
{
"name": "F1",
"columns": [
{
"qualifier": "M",
"measure_refs": [
"_COUNT_",
"1"
]
}
]
}
]
},
"aggregation_groups": [
{
"includes": [
"LOAN_GROUP.DATE_CD",
"LOAN_GROUP.ORG_CD",
"LOAN_GROUP.ENT_SCA_CD",
"LOAN_GROUP.INDU_CD",
"LOAN_GROUP.ENT_PSN_CD",
"LOAN_GROUP.PER_LON_CD",
"LOAN_GROUP.APPR_CREXT_RENT",
"LOAN_GROUP.ESTATE_TYPE",
"DIM_APPR_CREXT.APPR_CREXT_RENT"
],
"select_rule": {
"hierarchy_dims": [],
"mandatory_dims": [],
"joint_dims": []
}
}
],
"signature": "QmuvExlbmaV2+dowq1fs3w==",
"notify_list": [],
"status_need_notify": [
"ERROR",
"DISCARDED",
"SUCCEED"
],
"partition_date_start": 145160640,
"partition_date_end": 31536,
"auto_merge_time_ranges": [
60480,
241920
],
"retention_range": 0,
"engine_type": 2,
"storage_type": 2,
"override_kylin_properties": {},
"cuboid_black_list": [],
"parent_forward": 3
}
apache_...@163.com
How to look at SQL's execution plan
Hi, How to look at SQL's execution plan in Kylin? Think you. apache_...@163.com
when run cube 3 step ,get error.
Hi, Env:kylin2.1 HDP2.5.3 when cube run #3 Step Name: Extract Fact Table Distinct Columns Duration: 0.87 mins Waiting: 12 seconds It failed.Hadoop error is: Error: java.lang.NullPointerException at org.apache.kylin.cube.model.RowKeyDesc.getColDesc(RowKeyDesc.java:64) at org.apache.kylin.cube.model.RowKeyDesc.isUseDictionary(RowKeyDesc.java:71) at org.apache.kylin.cube.model.CubeDesc.getAllColumnsHaveDictionary(CubeDesc.java:1165) at org.apache.kylin.cube.model.CubeDesc.getAllColumnsNeedDictionaryBuilt(CubeDesc.java:1191) at org.apache.kylin.cube.CubeManager.getAllDictColumnsOnFact(CubeManager.java:900) at org.apache.kylin.engine.mr.steps.FactDistinctColumnsMapperBase.setup(FactDistinctColumnsMapperBase.java:79) at org.apache.kylin.engine.mr.steps.FactDistinctColumnsMapper.setup(FactDistinctColumnsMapper.java:86) at org.apache.hadoop.mapreduce.Mapper.run(Mapper.java:143) at org.apache.hadoop.mapred.MapTask.runNewMapper(MapTask.java:787) at org.apache.hadoop.mapred.MapTask.run(MapTask.java:341) at org.apache.hadoop.mapred.YarnChild$2.run(YarnChild.java:168) at java.security.AccessController.doPrivileged(Native Method) at javax.security.auth.Subject.doAs(Subject.java:422) at org.apache.hadoop.security.UserGroupInformation.doAs(UserGroupInformation.java:1724) at org.apache.hadoop.mapred.YarnChild.main(YarnChild.java:162) What is the cause? apache_...@163.com
Re: Re: How to clean up the invisible cube
) at org.springframework.security.web.authentication.logout.LogoutFilter.doFilter(LogoutFilter.java:120) at org.springframework.security.web.FilterChainProxy$VirtualFilterChain.doFilter(FilterChainProxy.java:330) at org.springframework.security.web.header.HeaderWriterFilter.doFilterInternal(HeaderWriterFilter.java:64) at org.springframework.web.filter.OncePerRequestFilter.doFilter(OncePerRequestFilter.java:107) at org.springframework.security.web.FilterChainProxy$VirtualFilterChain.doFilter(FilterChainProxy.java:330) at org.springframework.security.web.context.request.async.WebAsyncManagerIntegrationFilter.doFilterInternal(WebAsyncManagerIntegrationFilter.java:53) at org.springframework.web.filter.OncePerRequestFilter.doFilter(OncePerRequestFilter.java:107) at org.springframework.security.web.FilterChainProxy$VirtualFilterChain.doFilter(FilterChainProxy.java:330) at org.springframework.security.web.context.SecurityContextPersistenceFilter.doFilter(SecurityContextPersistenceFilter.java:91) at org.springframework.security.web.FilterChainProxy$VirtualFilterChain.doFilter(FilterChainProxy.java:330) at org.springframework.security.web.FilterChainProxy.doFilterInternal(FilterChainProxy.java:213) at org.springframework.security.web.FilterChainProxy.doFilter(FilterChainProxy.java:176) at org.springframework.web.filter.DelegatingFilterProxy.invokeDelegate(DelegatingFilterProxy.java:346) at org.springframework.web.filter.DelegatingFilterProxy.doFilter(DelegatingFilterProxy.java:262) at org.apache.catalina.core.ApplicationFilterChain.internalDoFilter(ApplicationFilterChain.java:241) at org.apache.catalina.core.ApplicationFilterChain.doFilter(ApplicationFilterChain.java:208) at com.thetransactioncompany.cors.CORSFilter.doFilter(CORSFilter.java:209) at com.thetransactioncompany.cors.CORSFilter.doFilter(CORSFilter.java:244) at org.apache.catalina.core.ApplicationFilterChain.internalDoFilter(ApplicationFilterChain.java:241) at org.apache.catalina.core.ApplicationFilterChain.doFilter(ApplicationFilterChain.java:208) at org.apache.catalina.core.StandardWrapperValve.invoke(StandardWrapperValve.java:220) at org.apache.catalina.core.StandardContextValve.invoke(StandardContextValve.java:122) at org.apache.catalina.authenticator.AuthenticatorBase.invoke(AuthenticatorBase.java:505) at org.apache.catalina.core.StandardHostValve.invoke(StandardHostValve.java:169) at org.apache.catalina.valves.ErrorReportValve.invoke(ErrorReportValve.java:103) at org.apache.catalina.valves.AccessLogValve.invoke(AccessLogValve.java:956) at org.apache.catalina.core.StandardEngineValve.invoke(StandardEngineValve.java:116) at org.apache.catalina.connector.CoyoteAdapter.service(CoyoteAdapter.java:436) at org.apache.coyote.http11.AbstractHttp11Processor.process(AbstractHttp11Processor.java:1078) at org.apache.coyote.AbstractProtocol$AbstractConnectionHandler.process(AbstractProtocol.java:625) at org.apache.tomcat.util.net.JIoEndpoint$SocketProcessor.run(JIoEndpoint.java:318) at java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1142) at java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:617) at org.apache.tomcat.util.threads.TaskThread$WrappingRunnable.run(TaskThread.java:61) at java.lang.Thread.run(Thread.java:748) Caused by: org.apache.kylin.rest.exception.BadRequestException: Model is referenced by Cube 'cube_0831' , could not dropped at org.apache.kylin.rest.service.ModelService.dropModel(ModelService.java:151) at org.apache.kylin.rest.service.ModelService$$FastClassBySpringCGLIB$$eb0205be.invoke() at org.springframework.cglib.proxy.MethodProxy.invoke(MethodProxy.java:204) at org.springframework.aop.framework.CglibAopProxy$CglibMethodInvocation.invokeJoinpoint(CglibAopProxy.java:720) at org.springframework.aop.framework.ReflectiveMethodInvocation.proceed(ReflectiveMethodInvocation.java:157) at org.springframework.security.access.intercept.aopalliance.MethodSecurityInterceptor.invoke(MethodSecurityInterceptor.java:68) at org.springframework.aop.framework.ReflectiveMethodInvocation.proceed(ReflectiveMethodInvocation.java:179) at org.springframework.aop.framework.CglibAopProxy$DynamicAdvisedInterceptor.intercept(CglibAopProxy.java:655) at org.apache.kylin.rest.service.ModelService$$EnhancerBySpringCGLIB$$63dbdcd1.dropModel() at org.apache.kylin.rest.controller.ModelController.deleteModel(ModelController.java:161) ... 76 more 2017-09-19 18:59:23,782 INFO [pool-8-thread-1] threadpool.DefaultScheduler:123 : Job Fetcher: 0 should running, 0 actual running, 0 stopped, 0 ready, 136 already succeed, 21 error, 5 discarded, 0 others apache_...@163.com From: Li Yang Date: 2017-09-17 15
Re: Re: How to set time parameter on the kylin server
thiks.
apache_...@163.com
From: Billy Liu
Date: 2017-09-06 16:43
To: dev
Subject: Re: How to set time parameter on the kylin server
Kylin use GMT timezone to process the the segment timestamp. Check code
makeSegmentName in CubeSegment class.
2017-09-06 14:27 GMT+08:00 apache_...@163.com <apache_...@163.com>:
>
> Hi:
>
>
> When i build a cube by api:
>
> Reques body is:
>
> {"startTime":132854400, "endTime":1328716799000, "buildType":"BUILD"}
> 2012/2/7 0:0:0 2012/2/8 23:59:59
>
> But response error:
>msg": "Segments overlap: day1[2012020100_2012020700] and
> day1[2012020616_20120208155959]",
>
> The time difference between the request and the request is 8 hours.
> How should set the time zone on the server to get the correct request
> time?
>
> Thinks .
>
>
>
>
>
> apache_...@163.com
>
How to set time parameter on the kylin server
Hi:
When i build a cube by api:
Reques body is:
{"startTime":132854400, "endTime":1328716799000, "buildType":"BUILD"}
2012/2/7 0:0:0 2012/2/8 23:59:59
But response error:
msg": "Segments overlap: day1[2012020100_2012020700] and
day1[2012020616_20120208155959]",
The time difference between the request and the request is 8 hours.
How should set the time zone on the server to get the correct request time?
Thinks .
apache_...@163.com
Is it really deleted?
Hi, Does it delete HBase data on hdfs through api/kylin API(DELETE submit )? Does it delete old HBase data on hdfs when refresh a cube? apache_...@163.com
Re: Re: Can't edit cube
Thinks. version: apache-kylin-2.1.0-bin-hbase1x.tar.gz deployed: single . apache_...@163.com From: ShaoFeng Shi Date: 2017-09-03 22:31 To: dev Subject: Re: Can't edit cube You'd better provide Kylin version, and how it be deployed (single or clustered). 2017-09-03 19:26 GMT+08:00 Li Yang <liy...@apache.org>: > As a workaround, you can reload metadata (under System tab) and edit again. > > On Thu, Aug 31, 2017 at 3:22 PM, Cheng Wang <cheng.w...@kyligence.io> > wrote: > > > Sometimes it happens because one Kylin instance is used by multi-users. > > Please make sure there are no others using the Kylin at the same time. > > > > > > > > > > On 8/31/17, 3:19 PM, "apache_...@163.com" <apache_...@163.com> wrote: > > > > >Hi, > > > > > >When edit the exist cube,can't save.Please help see what's the problem? > > > > > >Error message: > > > > > > > > >2017-08-31 15:20:08,022 ERROR [http-bio-7070-exec-28] > > controller.CubeController:516 : Failed to deal with the > request:Overwriting > > conflict /cube_desc/cube_0830.json, expect old TS 1504057946524, but it > is > > 1504163743354 > > >java.lang.IllegalStateException: Overwriting conflict > > /cube_desc/cube_0830.json, expect old TS 1504057946524, but it is > > 1504163743354 > > >at org.apache.kylin.storage.hbase.HBaseResourceStore. > > checkAndPutResourceImpl(HBaseResourceStore.java:315) > > >at org.apache.kylin.common.persistence.ResourceStore. > > checkAndPutResourceCheckpoint(ResourceStore.java:294) > > >at org.apache.kylin.common.persistence.ResourceStore. > > putResource(ResourceStore.java:280) > > >at org.apache.kylin.common.persistence.ResourceStore. > > putResource(ResourceStore.java:260) > > >at org.apache.kylin.cube.CubeDescManager.updateCubeDesc( > > CubeDescManager.java:380) > > >at org.apache.kylin.rest.service.CubeService.updateCubeAndDesc( > > CubeService.java:255) > > >at org.apache.kylin.rest.service.CubeService$$ > > FastClassBySpringCGLIB$$17a07c0e.invoke() > > >at org.springframework.cglib.proxy.MethodProxy.invoke( > > MethodProxy.java:204) > > >at org.springframework.aop.framework.CglibAopProxy$ > > CglibMethodInvocation.invokeJoinpoint(CglibAopProxy.java:720) > > >at org.springframework.aop.framework. > ReflectiveMethodInvocation. > > proceed(ReflectiveMethodInvocation.java:157) > > >at org.springframework.security.access.intercept.aopalliance. > > MethodSecurityInterceptor.invoke(MethodSecurityInterceptor.java:68) > > >at org.springframework.aop.framework. > ReflectiveMethodInvocation. > > proceed(ReflectiveMethodInvocation.java:179) > > >at org.springframework.aop.framework.CglibAopProxy$ > > DynamicAdvisedInterceptor.intercept(CglibAopProxy.java:655) > > >at org.apache.kylin.rest.service.CubeService$$ > > EnhancerBySpringCGLIB$$a843c409.updateCubeAndDesc() > > >at org.apache.kylin.rest.controller.CubeController. > > updateCubeDesc(CubeController.java:511) > > >at sun.reflect.NativeMethodAccessorImpl.invoke0(Native Method) > > >at sun.reflect.NativeMethodAccessorImpl.invoke( > > NativeMethodAccessorImpl.java:62) > > >at sun.reflect.DelegatingMethodAccessorImpl.invoke( > > DelegatingMethodAccessorImpl.java:43) > > >at java.lang.reflect.Method.invoke(Method.java:498) > > > > > > > > > > > >apache_...@163.com > > > -- Best regards, Shaofeng Shi 史少锋
How to set timezone in JDBC parameter?
Hi,
when i query data by kylin insight(dimension table join column in hive
is date type,data is 20170731),query result is rigth(have setting
:kylin.web.timezone=GMT+8)
but query by jdbc the result data is 20170330.
After setting in jdbc connect .
Properties info = new Properties();
info.put("timeZone", "GMT +08");
rs.getDate(part_dt) ,result is 20170731
rs.getString(part_dt),result is 20170330.
rs is java resultset
What's the reason?
How can I set the result right(getString(part_dt) is 20170331)?
apache_...@163.com
From: apache_...@163.com
Date: 2017-08-29 15:50
To: dev
Subject: Re: How to set timezone in JDBC parameter?
Hi,
This problem have now been sorted, Thinks
Properties info = new Properties();
info.put("timeZone", "GMT +08");
apache_...@163.com
From: apache_...@163.com
Date: 2017-08-29 11:57
To: dev
Subject: How to set timezone in JDBC parameter?
Hi,
when i query data by kylin insight(dimension table join column in hive
is date type,data is 20170731),query result is rigth(have setting
:kylin.web.timezone=GMT+8)
but query by jdbc the result data is 20170329.
How to set time zone in JDBC parameter?
Thinks.
apache_...@163.com
Re: How to set timezone in JDBC parameter?
Hi,
This problem have now been sorted, Thinks
Properties info = new Properties();
info.put("timeZone", "GMT +08");
apache_...@163.com
From: apache_...@163.com
Date: 2017-08-29 11:57
To: dev
Subject: How to set timezone in JDBC parameter?
Hi,
when i query data by kylin insight(dimension table join column in hive
is date type,data is 20170731),query result is rigth(have setting
:kylin.web.timezone=GMT+8)
but query by jdbc the result data is 20170329.
How to set time zone in JDBC parameter?
Thinks.
apache_...@163.com
How to set timezone in JDBC parameter?
Hi, when i query data by kylin insight(dimension table join column in hive is date type,data is 20170731),query result is rigth(have setting :kylin.web.timezone=GMT+8) but query by jdbc the result data is 20170330. How to set time zone in JDBC parameter? Thinks. apache_...@163.com
How to set timezone in JDBC parameter?
Hi, when i query data by kylin insight(dimension table join column in hive is date type,data is 20170731),query result is rigth(have setting :kylin.web.timezone=GMT+8) but query by jdbc the result data is 20170329. How to set time zone in JDBC parameter? Thinks. apache_...@163.com
回复: How to get a job status?
Hi,
I run a cube by api(/kylin/api/cubes/{cubeName}/build), It's daily task。
How do I get the status job information(job Id,job name,job steup,job
status,job result) for this task?
Can I get it from cube build task response body?
Thinks.
apache_...@163.com
How to get a job status?
Hi,
I run a cube by api(/kylin/api/cubes/{cubeName}/build), It's daily task。
How do I get the status job information(job Id,job name,job steup,job
status,job result) for this task?
Thinks.
apache_...@163.com
Re: Re: Subquery cann't work
Thinks .
This issue not found in kylin v2.1.
apache_...@163.com
From: Li Yang
Date: 2017-08-20 14:31
To: dev
Subject: Re: Subquery cann't work
Seems a bug to me. Please log a JIRA.
On Thu, Aug 17, 2017 at 10:17 AM, apache_...@163.com <apache_...@163.com>
wrote:
> Hi,
>
> There seems to be a problem with sql parsing engine? please confirm
>
> This Sql can work.
>
> SELECT T8_0.*, T8_0.Ieceb82a4498247aeb911ba59f82148f0 - T8_1.
> Ieceb82a4498247aeb911ba59f82148f0 AS D81e0286e9b9c404cb7cb04c0b92cd7c2,
> T8_2.Ieceb82a4498247aeb911ba59f82148f0 AS Dcc3b3deff3c043e8834b70b6f41f8
> 009
> FROM (SELECT KYLIN_SALES.PART_DT, KYLIN_SALES.SELLER_ID,
> SUM(KYLIN_SALES.PRICE) AS Ieceb82a4498247aeb911ba59f82148f0
> FROM KYLIN_SALES
> INNER JOIN KYLIN_CAL_DT ON KYLIN_SALES.PART_DT = KYLIN_CAL_DT.CAL_DT
> WHERE PART_DT IN ('2012-01-01', '2012-01-02', '2012-01-03')
> GROUP BY KYLIN_SALES.PART_DT, KYLIN_SALES.SELLER_ID
> ) T8_0
> JOIN KYLIN_CAL_DT ON T8_0.PART_DT = KYLIN_CAL_DT.CAL_DT
> LEFT JOIN (SELECT KYLIN_SALES.PART_DT, KYLIN_SALES.SELLER_ID,
> SUM(KYLIN_SALES.PRICE) AS Ieceb82a4498247aeb911ba59f82148f0
> FROM KYLIN_SALES
> INNER JOIN KYLIN_CAL_DT ON KYLIN_SALES.PART_DT = KYLIN_CAL_DT.CAL_DT
> WHERE PART_DT IN ('2012-01-01', '2012-01-02', '2012-01-03')
> GROUP BY KYLIN_SALES.PART_DT, KYLIN_SALES.SELLER_ID
> ) T8_1 ON T8_1.PART_DT = KYLIN_CAL_DT.YEAR_BEG_DT
> AND T8_0.SELLER_ID = T8_1.SELLER_ID
> LEFT JOIN (SELECT KYLIN_SALES.PART_DT, KYLIN_SALES.SELLER_ID,
> SUM(KYLIN_SALES.PRICE) AS Ieceb82a4498247aeb911ba59f82148f0
> FROM KYLIN_SALES
> INNER JOIN KYLIN_CAL_DT ON KYLIN_SALES.PART_DT = KYLIN_CAL_DT.CAL_DT
> WHERE PART_DT IN ('2012-01-01', '2012-01-02', '2012-01-03')
> GROUP BY KYLIN_SALES.PART_DT, KYLIN_SALES.SELLER_ID
> ) T8_2 ON T8_2.PART_DT = KYLIN_CAL_DT.MONTH_BEG_DT
> AND T8_0.SELLER_ID = T8_2.SELLER_ID
>
>
> but after add a aggregation condition (boldface) ,it run error.
>
>
> SELECT PART_DT, SUM(D81e0286e9b9c404cb7cb04c0b92cd7c2)
> FROM (SELECT T8_0.*, T8_0.Ieceb82a4498247aeb911ba59f82148f0 - T8_1.
> Ieceb82a4498247aeb911ba59f82148f0 AS D81e0286e9b9c404cb7cb04c0b92cd7c2,
> T8_2.Ieceb82a4498247aeb911ba59f82148f0 AS Dcc3b3deff3c043e8834b70b6f41f8
> 009
> FROM (SELECT KYLIN_SALES.PART_DT, KYLIN_SALES.SELLER_ID,
> SUM(KYLIN_SALES.PRICE) AS Ieceb82a4498247aeb911ba59f82148f0
> FROM KYLIN_SALES
> INNER JOIN KYLIN_CAL_DT ON KYLIN_SALES.PART_DT = KYLIN_CAL_DT.CAL_DT
> WHERE PART_DT IN ('2012-01-01', '2012-01-02', '2012-01-03')
> GROUP BY KYLIN_SALES.PART_DT, KYLIN_SALES.SELLER_ID
> ) T8_0
> JOIN KYLIN_CAL_DT ON T8_0.PART_DT = KYLIN_CAL_DT.CAL_DT
> LEFT JOIN (SELECT KYLIN_SALES.PART_DT, KYLIN_SALES.SELLER_ID,
> SUM(KYLIN_SALES.PRICE) AS Ieceb82a4498247aeb911ba59f82148f0
> FROM KYLIN_SALES
> INNER JOIN KYLIN_CAL_DT ON KYLIN_SALES.PART_DT = KYLIN_CAL_DT.CAL_DT
> WHERE PART_DT IN ('2012-01-01', '2012-01-02', '2012-01-03')
> GROUP BY KYLIN_SALES.PART_DT, KYLIN_SALES.SELLER_ID
> ) T8_1 ON T8_1.PART_DT = KYLIN_CAL_DT.YEAR_BEG_DT
> AND T8_0.SELLER_ID = T8_1.SELLER_ID
> LEFT JOIN (SELECT KYLIN_SALES.PART_DT, KYLIN_SALES.SELLER_ID,
> SUM(KYLIN_SALES.PRICE) AS Ieceb82a4498247aeb911ba59f82148f0
> FROM KYLIN_SALES
> INNER JOIN KYLIN_CAL_DT ON KYLIN_SALES.PART_DT = KYLIN_CAL_DT.CAL_DT
> WHERE PART_DT IN ('2012-01-01', '2012-01-02', '2012-01-03')
> GROUP BY KYLIN_SALES.PART_DT, KYLIN_SALES.SELLER_ID
> ) T8_2 ON T8_2.PART_DT = KYLIN_CAL_DT.MONTH_BEG_DT
> AND T8_0.SELLER_ID = T8_2.SELLER_ID
> )
> GROUP BY PART_DT
>
>
> error info:
>
> Error while executing SQL "SELECT PART_DT, SUM(
> D81e0286e9b9c404cb7cb04c0b92cd7c2) FROM (SELECT T8_0.*, T8_0.
> Ieceb82a4498247aeb911ba59f82148f0 - T8_1.Ieceb82a4498247aeb911ba59f82148f0
> AS D81e0286e9b9c404cb7cb04c0b92cd7c2, T8_2.Ieceb82a4498247aeb911ba59f82148f0
> AS Dcc3b3deff3c043e8834b70b6f41f8009 FROM (SELECT KYLIN_SALES.PART_DT,
> KYLIN_SALES.SELLER_ID, SUM(KYLIN_SALES.PRICE) AS
> Ieceb82a4498247aeb911ba59f82148f0 FROM KYLIN_SALES INNER JOIN
> KYLIN_CAL_DT ON KYLIN_SALES.PART_DT = KYLIN_CAL_DT.CAL_DT WHERE PART_DT IN
> ('2012-01-01', '2012-01-02', '2012-01-03') GROUP BY KYLIN_SALES.PART_DT,
> KYLIN_SALES.SELLER_ID ) T8_0 JOIN KYLIN_CAL_DT ON T8_0.PART_DT =
> KYLIN_CAL_DT.CAL_DT LEFT JOIN (SELECT KYLIN_SALES.PART_DT,
> KYLIN_SALES.SELLER_ID, SUM(KYLIN_SALES.PRICE) AS
> Ieceb82a4498247aeb911ba59f82148f0 FROM KYLIN_SALES INNER JOIN
> KYLIN_CAL_DT ON KYLIN_SALES.PART_DT = KYLIN_CAL_DT.CAL_DT WHERE PART_DT IN
> ('2012-01-01', '2012-01-02', '2012-01-03') GROUP BY KYLIN_SALES.PART_DT,
> KYLIN_SALES.SELLER_ID ) T8_1 ON T8_1.PART_DT = KYLIN_CAL_DT.YEAR_BEG_DT AND
> T8_0.SELLER_ID = T8_1.SELLER_ID LEFT JOIN (SELECT KYLIN_SALES.PART_DT,
> KYLIN_SALES.SELLER_ID, SUM(KYLIN_SALES.PRICE) AS
> Ieceb82a4498247aeb911ba59f
LAST_DAY function?
Hi, There are a lot of surprises in kylin 2.1 version.It's amazing. Ask a question: What functions can be used to calculate the date of the end of the month in kylin? Like oracle LAST_DAY function apache_...@163.com
Subquery cann't work
Hi,
There seems to be a problem with sql parsing engine? please confirm
This Sql can work.
SELECT T8_0.*, T8_0.Ieceb82a4498247aeb911ba59f82148f0 -
T8_1.Ieceb82a4498247aeb911ba59f82148f0 AS D81e0286e9b9c404cb7cb04c0b92cd7c2,
T8_2.Ieceb82a4498247aeb911ba59f82148f0 AS Dcc3b3deff3c043e8834b70b6f41f8009
FROM (SELECT KYLIN_SALES.PART_DT, KYLIN_SALES.SELLER_ID, SUM(KYLIN_SALES.PRICE)
AS Ieceb82a4498247aeb911ba59f82148f0
FROM KYLIN_SALES
INNER JOIN KYLIN_CAL_DT ON KYLIN_SALES.PART_DT = KYLIN_CAL_DT.CAL_DT
WHERE PART_DT IN ('2012-01-01', '2012-01-02', '2012-01-03')
GROUP BY KYLIN_SALES.PART_DT, KYLIN_SALES.SELLER_ID
) T8_0
JOIN KYLIN_CAL_DT ON T8_0.PART_DT = KYLIN_CAL_DT.CAL_DT
LEFT JOIN (SELECT KYLIN_SALES.PART_DT, KYLIN_SALES.SELLER_ID,
SUM(KYLIN_SALES.PRICE) AS Ieceb82a4498247aeb911ba59f82148f0
FROM KYLIN_SALES
INNER JOIN KYLIN_CAL_DT ON KYLIN_SALES.PART_DT = KYLIN_CAL_DT.CAL_DT
WHERE PART_DT IN ('2012-01-01', '2012-01-02', '2012-01-03')
GROUP BY KYLIN_SALES.PART_DT, KYLIN_SALES.SELLER_ID
) T8_1 ON T8_1.PART_DT = KYLIN_CAL_DT.YEAR_BEG_DT
AND T8_0.SELLER_ID = T8_1.SELLER_ID
LEFT JOIN (SELECT KYLIN_SALES.PART_DT, KYLIN_SALES.SELLER_ID,
SUM(KYLIN_SALES.PRICE) AS Ieceb82a4498247aeb911ba59f82148f0
FROM KYLIN_SALES
INNER JOIN KYLIN_CAL_DT ON KYLIN_SALES.PART_DT = KYLIN_CAL_DT.CAL_DT
WHERE PART_DT IN ('2012-01-01', '2012-01-02', '2012-01-03')
GROUP BY KYLIN_SALES.PART_DT, KYLIN_SALES.SELLER_ID
) T8_2 ON T8_2.PART_DT = KYLIN_CAL_DT.MONTH_BEG_DT
AND T8_0.SELLER_ID = T8_2.SELLER_ID
but after add a aggregation condition (boldface) ,it run error.
SELECT PART_DT, SUM(D81e0286e9b9c404cb7cb04c0b92cd7c2)
FROM (SELECT T8_0.*, T8_0.Ieceb82a4498247aeb911ba59f82148f0 -
T8_1.Ieceb82a4498247aeb911ba59f82148f0 AS D81e0286e9b9c404cb7cb04c0b92cd7c2,
T8_2.Ieceb82a4498247aeb911ba59f82148f0 AS Dcc3b3deff3c043e8834b70b6f41f8009
FROM (SELECT KYLIN_SALES.PART_DT, KYLIN_SALES.SELLER_ID, SUM(KYLIN_SALES.PRICE)
AS Ieceb82a4498247aeb911ba59f82148f0
FROM KYLIN_SALES
INNER JOIN KYLIN_CAL_DT ON KYLIN_SALES.PART_DT = KYLIN_CAL_DT.CAL_DT
WHERE PART_DT IN ('2012-01-01', '2012-01-02', '2012-01-03')
GROUP BY KYLIN_SALES.PART_DT, KYLIN_SALES.SELLER_ID
) T8_0
JOIN KYLIN_CAL_DT ON T8_0.PART_DT = KYLIN_CAL_DT.CAL_DT
LEFT JOIN (SELECT KYLIN_SALES.PART_DT, KYLIN_SALES.SELLER_ID,
SUM(KYLIN_SALES.PRICE) AS Ieceb82a4498247aeb911ba59f82148f0
FROM KYLIN_SALES
INNER JOIN KYLIN_CAL_DT ON KYLIN_SALES.PART_DT = KYLIN_CAL_DT.CAL_DT
WHERE PART_DT IN ('2012-01-01', '2012-01-02', '2012-01-03')
GROUP BY KYLIN_SALES.PART_DT, KYLIN_SALES.SELLER_ID
) T8_1 ON T8_1.PART_DT = KYLIN_CAL_DT.YEAR_BEG_DT
AND T8_0.SELLER_ID = T8_1.SELLER_ID
LEFT JOIN (SELECT KYLIN_SALES.PART_DT, KYLIN_SALES.SELLER_ID,
SUM(KYLIN_SALES.PRICE) AS Ieceb82a4498247aeb911ba59f82148f0
FROM KYLIN_SALES
INNER JOIN KYLIN_CAL_DT ON KYLIN_SALES.PART_DT = KYLIN_CAL_DT.CAL_DT
WHERE PART_DT IN ('2012-01-01', '2012-01-02', '2012-01-03')
GROUP BY KYLIN_SALES.PART_DT, KYLIN_SALES.SELLER_ID
) T8_2 ON T8_2.PART_DT = KYLIN_CAL_DT.MONTH_BEG_DT
AND T8_0.SELLER_ID = T8_2.SELLER_ID
)
GROUP BY PART_DT
error info:
Error while executing SQL "SELECT PART_DT,
SUM(D81e0286e9b9c404cb7cb04c0b92cd7c2) FROM (SELECT T8_0.*,
T8_0.Ieceb82a4498247aeb911ba59f82148f0 - T8_1.Ieceb82a4498247aeb911ba59f82148f0
AS D81e0286e9b9c404cb7cb04c0b92cd7c2, T8_2.Ieceb82a4498247aeb911ba59f82148f0 AS
Dcc3b3deff3c043e8834b70b6f41f8009 FROM (SELECT KYLIN_SALES.PART_DT,
KYLIN_SALES.SELLER_ID, SUM(KYLIN_SALES.PRICE) AS
Ieceb82a4498247aeb911ba59f82148f0 FROM KYLIN_SALES INNER JOIN KYLIN_CAL_DT ON
KYLIN_SALES.PART_DT = KYLIN_CAL_DT.CAL_DT WHERE PART_DT IN ('2012-01-01',
'2012-01-02', '2012-01-03') GROUP BY KYLIN_SALES.PART_DT, KYLIN_SALES.SELLER_ID
) T8_0 JOIN KYLIN_CAL_DT ON T8_0.PART_DT = KYLIN_CAL_DT.CAL_DT LEFT JOIN
(SELECT KYLIN_SALES.PART_DT, KYLIN_SALES.SELLER_ID, SUM(KYLIN_SALES.PRICE) AS
Ieceb82a4498247aeb911ba59f82148f0 FROM KYLIN_SALES INNER JOIN KYLIN_CAL_DT ON
KYLIN_SALES.PART_DT = KYLIN_CAL_DT.CAL_DT WHERE PART_DT IN ('2012-01-01',
'2012-01-02', '2012-01-03') GROUP BY KYLIN_SALES.PART_DT, KYLIN_SALES.SELLER_ID
) T8_1 ON T8_1.PART_DT = KYLIN_CAL_DT.YEAR_BEG_DT AND T8_0.SELLER_ID =
T8_1.SELLER_ID LEFT JOIN (SELECT KYLIN_SALES.PART_DT, KYLIN_SALES.SELLER_ID,
SUM(KYLIN_SALES.PRICE) AS Ieceb82a4498247aeb911ba59f82148f0 FROM KYLIN_SALES
INNER JOIN KYLIN_CAL_DT ON KYLIN_SALES.PART_DT = KYLIN_CAL_DT.CAL_DT WHERE
PART_DT IN ('2012-01-01', '2012-01-02', '2012-01-03') GROUP BY
KYLIN_SALES.PART_DT, KYLIN_SALES.SELLER_ID ) T8_2 ON T8_2.PART_DT =
KYLIN_CAL_DT.MONTH_BEG_DT AND T8_0.SELLER_ID = T8_2.SELLER_ID ) GROUP BY
PART_DT LIMIT 5": Can't find any realization. Please confirm with
providers. SQL digest: fact table DEFAULT.KYLIN_CAL_DT,group by
[DEFAULT.KYLIN_SALES.PART_DT],filter on [],with aggregates[FunctionDesc
[expression=SUM, parameter=-($2, $9), returnType=null]].
apache_...@163.com
Re: Re: Leap Month calculate error
Run :
select date '2011-03-31' - INTERVAL '1' month from KYLIN_CAL_DT
got same result :2011-03-01
The result is incorrect
apache_...@163.com
From: Alberto Ramón
Date: 2017-08-15 16:21
To: dev
Subject: Re: Leap Month calculate error
Try to use DATE statement
http://apache-kylin.74782.x6.nabble.com/about-kylin-sql-key-words-IN-td5908.html
On 15 August 2017 at 08:59, apache_...@163.com <apache_...@163.com> wrote:
> Hi,
>
> when i run sql by kyline GUI,Right result is 2011-02-28,but i got
> 2011-03-01,is bug?
>
> select cast('2011-03-31' as date) - INTERVAL '1' month from KYLIN_CAL_DT
>
>
>
>
>
> apache_...@163.com
>
Leap Month calculate error
Hi,
when i run sql by kyline GUI,Right result is 2011-02-28,but i got
2011-03-01,is bug?
select cast('2011-03-31' as date) - INTERVAL '1' month from KYLIN_CAL_DT
apache_...@163.com
Re: Re: kylin load hive table rest is error
Analyze tomcat logs,GUI method seems to have more step than rest client .but
rest client get a 500 status.
What's the reason? thinks.
This is tomcat log:
(Kylin GUI load table Log,sucess.)
192.168.224.4 - - [14/Aug/2017:16:26:25 +0800] "GET
/kylin/api/tables?ext=true=api HTTP/1.1" 200 2
192.168.224.4 - - [14/Aug/2017:16:26:25 +0800] "GET
/kylin/api/cubes?limit=15=0=api HTTP/1.1" 200 2
192.168.224.4 - - [14/Aug/2017:16:26:28 +0800] "GET /kylin/api/tables/hive
HTTP/1.1" 200 110
192.168.224.4 - - [14/Aug/2017:16:26:33 +0800] "GET
/kylin/api/tables/hive/metric HTTP/1.1" 200 91
127.0.0.1 - - [14/Aug/2017:16:26:43 +0800] "PUT
/kylin/api/cache/table_ext/METRIC.FACT1/update HTTP/1.1" 500 8766
192.168.224.4 - - [14/Aug/2017:16:26:43 +0800] "POST
/kylin/api/tables/metric.fact1,/api HTTP/1.1" 200 55
127.0.0.1 - - [14/Aug/2017:16:26:43 +0800] "PUT
/kylin/api/cache/table/METRIC.FACT1/update HTTP/1.1" 500 8759
127.0.0.1 - - [14/Aug/2017:16:26:43 +0800] "PUT
/kylin/api/cache/project/api/update HTTP/1.1" 200 -
127.0.0.1 - - [14/Aug/2017:16:26:43 +0800] "PUT
/kylin/api/cache/table_ext/METRIC.FACT1/update HTTP/1.1" 500 8766
192.168.224.4 - - [14/Aug/2017:16:26:43 +0800] "GET
/kylin/api/tables?ext=true=api HTTP/1.1" 200 665
127.0.0.1 - - [14/Aug/2017:16:27:32 +0800] "PUT
/kylin/api/cache/table_ext/METRIC.FACT1/update HTTP/1.1" 500 8766
(rest load table log,failed)
192.168.224.4 - - [14/Aug/2017:16:27:56 +0800] "POST
/kylin/api/tables/metric.fact2,/api HTTP/1.1" 500 148
apache_...@163.com
From: ShaoFeng Shi
Date: 2017-08-14 13:33
To: dev
Subject: Re: Re: kylin load hive table rest is error
Kylin Web GUI calls the same REST API; So if Kylin GUI works, you need
check your script. You can open the debug mode of browser to see the detail
HTTP request header/body, and then use the same in your script.
2017-08-14 11:36 GMT+08:00 apache_...@163.com <apache_...@163.com>:
> Yes.
>
> metric.date_dim is table name in hive
>
> load is kylin project.
>
> Executing it in two environments have same error.
>
> Kylin version:2.0
>
> red part is tomcat log:
> xx.xx.xx.xx - - [14/Aug/2017:11:37:58 +0800] "GET
> /kylin/api/cubes/validEncodings
> HTTP/1.1" 200 98
> xx.xx.xx.xx - - [14/Aug/2017:11:39:25 +0800] "POST
> /kylin/api/tables/metric.date_dim/load HTTP/1.1" 500 9919
>
>
>
> apache_...@163.com
>
> From: Billy Liu
> Date: 2017-08-13 23:35
> To: dev
> Subject: Re: Re: kylin load hive table rest is error
> As the document says {tables} and {project} are path parameters, so in your
> case, is metric.date_dim the table name, and load the project name?
>
> http://xx.xx.xx.xx:7070/kylin/api/tables/metric.date_dim/load
>
> 2017-08-13 22:28 GMT+08:00 apache_...@163.com <apache_...@163.com>:
>
> > it can work by Kylin GUI.
> >
> > I refer to the API document,but is not work.
> >
> > Load Hive Tables
> > POST /kylin/api/tables/{tables}/{project}
> > Request Parameters
> > tables - required string table names you want to load from hive,
> separated
> > with comma.
> > project - required String the project which the tables will be loaded
> into.
> >
> >
> >
> > apache_...@163.com
> >
> > From: ShaoFeng Shi
> > Date: 2017-08-13 14:23
> > To: dev
> > Subject: Re: Re: kylin load hive table rest is error
> > Besides, can you sync the table from Kylin GUI? If GUI doesn't work
> either,
> > that should be env problem. Otherwise it would be API usage mistake.
> >
> > 2017-08-13 14:22 GMT+08:00 ShaoFeng Shi <shaofeng...@apache.org>:
> >
> > > Any message in tomcat/logs/* or logs/kylin.out?
> > >
> > > 2017-08-13 10:21 GMT+08:00 apache_...@163.com <apache_...@163.com>:
> > >
> > >> Hi,shaofeng:
> > >>
> > >> Kylin2.0 on HDP2.5.3.
> > >>
> > >>
> > >> hive> use metric;
> > >> OK
> > >> Time taken: 0.029 seconds
> > >> hive> show tables;
> > >> OK
> > >> buss_info
> > >> dim
> > >> dim_curr
> > >> dim_date
> > >> dim_dtyp
> > >> dim_gl_acc
> > >> dim_org
> > >> fact1
> > >> fact2
> > >> Time taken: 0.245 seconds, Fetched: 9 row(s)
> > >>
> > >> post url: http://xx.xx.xx.xx:7070/kylin/api/tables/metric.date_
> > >> dim/load
> > >> return error:
> > >> Server returned HTTP response code: 500 for URL:
> > >> http://xx.xx.xx.xx:7070/kylin/api/tables/metri
Re: Re: kylin load hive table rest is error
Yes.
metric.date_dim is table name in hive
load is kylin project.
Executing it in two environments have same error.
Kylin version:2.0
red part is tomcat log:
xx.xx.xx.xx - - [14/Aug/2017:11:37:58 +0800] "GET
/kylin/api/cubes/validEncodings HTTP/1.1" 200 98
xx.xx.xx.xx - - [14/Aug/2017:11:39:25 +0800] "POST
/kylin/api/tables/metric.date_dim/load HTTP/1.1" 500 9919
apache_...@163.com
From: Billy Liu
Date: 2017-08-13 23:35
To: dev
Subject: Re: Re: kylin load hive table rest is error
As the document says {tables} and {project} are path parameters, so in your
case, is metric.date_dim the table name, and load the project name?
http://xx.xx.xx.xx:7070/kylin/api/tables/metric.date_dim/load
2017-08-13 22:28 GMT+08:00 apache_...@163.com <apache_...@163.com>:
> it can work by Kylin GUI.
>
> I refer to the API document,but is not work.
>
> Load Hive Tables
> POST /kylin/api/tables/{tables}/{project}
> Request Parameters
> tables - required string table names you want to load from hive, separated
> with comma.
> project - required String the project which the tables will be loaded into.
>
>
>
> apache_...@163.com
>
> From: ShaoFeng Shi
> Date: 2017-08-13 14:23
> To: dev
> Subject: Re: Re: kylin load hive table rest is error
> Besides, can you sync the table from Kylin GUI? If GUI doesn't work either,
> that should be env problem. Otherwise it would be API usage mistake.
>
> 2017-08-13 14:22 GMT+08:00 ShaoFeng Shi <shaofeng...@apache.org>:
>
> > Any message in tomcat/logs/* or logs/kylin.out?
> >
> > 2017-08-13 10:21 GMT+08:00 apache_...@163.com <apache_...@163.com>:
> >
> >> Hi,shaofeng:
> >>
> >> Kylin2.0 on HDP2.5.3.
> >>
> >>
> >> hive> use metric;
> >> OK
> >> Time taken: 0.029 seconds
> >> hive> show tables;
> >> OK
> >> buss_info
> >> dim
> >> dim_curr
> >> dim_date
> >> dim_dtyp
> >> dim_gl_acc
> >> dim_org
> >> fact1
> >> fact2
> >> Time taken: 0.245 seconds, Fetched: 9 row(s)
> >>
> >> post url: http://xx.xx.xx.xx:7070/kylin/api/tables/metric.date_
> >> dim/load
> >> return error:
> >> Server returned HTTP response code: 500 for URL:
> >> http://xx.xx.xx.xx:7070/kylin/api/tables/metric.date_dim/load
> >>
> >> but no relevant logs in kylin.log
> >>
> >>
> >>
> >>
> >>
> >> apache_...@163.com
> >>
> >> From: ShaoFeng Shi
> >> Date: 2017-08-12 14:59
> >> To: dev
> >> Subject: Re: kylin load hive table rest is error
> >> Is there any clue in kylin.log?
> >>
> >> 2017-08-12 9:58 GMT+08:00 apache_...@163.com <apache_...@163.com>:
> >>
> >> >
> >> > Hi,
> >> >
> >> > Please help confirm a question(bug?),when i run load hive table by
> >> > kylin rest interface, it return a error page info
> >> >
> >> > example:
> >> >
> >> > post http://xx.xx.xx.xx:7070/kylin/api/metric.date_dim/load
> >> > metric.data_dim is hive table, load is kylin project.
> >> >
> >> > No body.
> >> >
> >> >
> >> > return page info:
> >> >
> >> >
> >> > >> > http-equiv="X-UA-Compatible" content="IE=edge,chrome=1">
> >> >
> >> >
> >> >
> >> >
> >> >
> >> >
> >> >
> >> > type="image/x-icon">
> >> > Kylin
> >> >
> >> >
> >> >
> >> >
> >> >
> >> > >> > ng-include="'partials/header.html'">
> >> >
> >> >
> >> >
> >> >
> >> >
> >> > >> > ng-include="'partials/footer.html'">
> >> >
> >> >
> >> >
> >> >
> >> > <div class="callout">
> >> > <h4>Error Message</h4>
> >> > <p>{{text}}</p>
> >> > </div>
> >> > <div class="callout callout-danger">
> >> > <h4>Cube Schema</h4>
> >> > <pre>{{schema}}</pre>
> >> > </div>
> >> >
Re: Re: kylin load hive table rest is error
Yes.
metric.date_dim is table name in hive
load is kylin project.
Executing it in two environments have same error.
Kylin version:2.0
apache_...@163.com
From: Billy Liu
Date: 2017-08-13 23:35
To: dev
Subject: Re: Re: kylin load hive table rest is error
As the document says {tables} and {project} are path parameters, so in your
case, is metric.date_dim the table name, and load the project name?
http://xx.xx.xx.xx:7070/kylin/api/tables/metric.date_dim/load
2017-08-13 22:28 GMT+08:00 apache_...@163.com <apache_...@163.com>:
> it can work by Kylin GUI.
>
> I refer to the API document,but is not work.
>
> Load Hive Tables
> POST /kylin/api/tables/{tables}/{project}
> Request Parameters
> tables - required string table names you want to load from hive, separated
> with comma.
> project - required String the project which the tables will be loaded into.
>
>
>
> apache_...@163.com
>
> From: ShaoFeng Shi
> Date: 2017-08-13 14:23
> To: dev
> Subject: Re: Re: kylin load hive table rest is error
> Besides, can you sync the table from Kylin GUI? If GUI doesn't work either,
> that should be env problem. Otherwise it would be API usage mistake.
>
> 2017-08-13 14:22 GMT+08:00 ShaoFeng Shi <shaofeng...@apache.org>:
>
> > Any message in tomcat/logs/* or logs/kylin.out?
> >
> > 2017-08-13 10:21 GMT+08:00 apache_...@163.com <apache_...@163.com>:
> >
> >> Hi,shaofeng:
> >>
> >> Kylin2.0 on HDP2.5.3.
> >>
> >>
> >> hive> use metric;
> >> OK
> >> Time taken: 0.029 seconds
> >> hive> show tables;
> >> OK
> >> buss_info
> >> dim
> >> dim_curr
> >> dim_date
> >> dim_dtyp
> >> dim_gl_acc
> >> dim_org
> >> fact1
> >> fact2
> >> Time taken: 0.245 seconds, Fetched: 9 row(s)
> >>
> >> post url: http://xx.xx.xx.xx:7070/kylin/api/tables/metric.date_
> >> dim/load
> >> return error:
> >> Server returned HTTP response code: 500 for URL:
> >> http://xx.xx.xx.xx:7070/kylin/api/tables/metric.date_dim/load
> >>
> >> but no relevant logs in kylin.log
> >>
> >>
> >>
> >>
> >>
> >> apache_...@163.com
> >>
> >> From: ShaoFeng Shi
> >> Date: 2017-08-12 14:59
> >> To: dev
> >> Subject: Re: kylin load hive table rest is error
> >> Is there any clue in kylin.log?
> >>
> >> 2017-08-12 9:58 GMT+08:00 apache_...@163.com <apache_...@163.com>:
> >>
> >> >
> >> > Hi,
> >> >
> >> > Please help confirm a question(bug?),when i run load hive table by
> >> > kylin rest interface, it return a error page info
> >> >
> >> > example:
> >> >
> >> > post http://xx.xx.xx.xx:7070/kylin/api/metric.date_dim/load
> >> > metric.data_dim is hive table, load is kylin project.
> >> >
> >> > No body.
> >> >
> >> >
> >> > return page info:
> >> >
> >> >
> >> > >> > http-equiv="X-UA-Compatible" content="IE=edge,chrome=1">
> >> >
> >> >
> >> >
> >> >
> >> >
> >> >
> >> >
> >> > type="image/x-icon">
> >> > Kylin
> >> >
> >> >
> >> >
> >> >
> >> >
> >> > >> > ng-include="'partials/header.html'">
> >> >
> >> >
> >> >
> >> >
> >> >
> >> > >> > ng-include="'partials/footer.html'">
> >> >
> >> >
> >> >
> >> >
> >> > <div class="callout">
> >> > <h4>Error Message</h4>
> >> > <p>{{text}}</p>
> >> > </div>
> >> > <div class="callout callout-danger">
> >> > <h4>Cube Schema</h4>
> >> > <pre>{{schema}}</pre>
> >> > </div>
> >> >
> >> >
> >> > <div class="callout callout-info">
> >> > <p>{{text}}</p>
> >> > </div>
> >> >
> >> >
> >> >
> >> >
> >> > <div class="callout callout-info">
> >> > <h4>Error Message</h4>
> >> > <p>{{text}}</p>
> >> > </div>
> >> > <div class="callout callout-danger">
> >> > <h4>Model Schema</h4>
> >> > <pre>{{schema}}</pre>
> >> > </div>
> >> >
> >> >
> >> > <div class="callout callout-info">
> >> > <p>{{text}}</p>
> >> > </div>
> >> >
> >> >
> >> >
> >> > <div class="callout">
> >> > <h4>Error Message</h4>
> >> > <p>{{text}}</p>
> >> > </div>
> >> > <div class="callout callout-danger">
> >> > <h4>Streaming Schema</h4>
> >> > <pre>{{streamingSchema}}</pre>
> >> > </div>
> >> > <div class="callout callout-danger">
> >> > <h4>Kafka Schema</h4>
> >> > <pre>{{kfkSchema}}</pre>
> >> > </div>
> >> >
> >> >
> >> > <div class="callout callout-info">
> >> > <p>{{text}}</p>
> >> > </div>
> >> >
> >> >
> >> >
> >> >
> >> >
> >> >
> >> >
> >> >
> >> >
> >> >
> >> > apache_...@163.com
> >> >
> >>
> >>
> >>
> >> --
> >> Best regards,
> >>
> >> Shaofeng Shi 史少锋
> >>
> >
> >
> >
> > --
> > Best regards,
> >
> > Shaofeng Shi 史少锋
> >
> >
>
>
> --
> Best regards,
>
> Shaofeng Shi 史少锋
>
Re: Re: kylin load hive table rest is error
it can work by Kylin GUI.
I refer to the API document,but is not work.
Load Hive Tables
POST /kylin/api/tables/{tables}/{project}
Request Parameters
tables - required string table names you want to load from hive, separated with
comma.
project - required String the project which the tables will be loaded into.
apache_...@163.com
From: ShaoFeng Shi
Date: 2017-08-13 14:23
To: dev
Subject: Re: Re: kylin load hive table rest is error
Besides, can you sync the table from Kylin GUI? If GUI doesn't work either,
that should be env problem. Otherwise it would be API usage mistake.
2017-08-13 14:22 GMT+08:00 ShaoFeng Shi <shaofeng...@apache.org>:
> Any message in tomcat/logs/* or logs/kylin.out?
>
> 2017-08-13 10:21 GMT+08:00 apache_...@163.com <apache_...@163.com>:
>
>> Hi,shaofeng:
>>
>> Kylin2.0 on HDP2.5.3.
>>
>>
>> hive> use metric;
>> OK
>> Time taken: 0.029 seconds
>> hive> show tables;
>> OK
>> buss_info
>> dim
>> dim_curr
>> dim_date
>> dim_dtyp
>> dim_gl_acc
>> dim_org
>> fact1
>> fact2
>> Time taken: 0.245 seconds, Fetched: 9 row(s)
>>
>> post url: http://xx.xx.xx.xx:7070/kylin/api/tables/metric.date_
>> dim/load
>> return error:
>> Server returned HTTP response code: 500 for URL:
>> http://xx.xx.xx.xx:7070/kylin/api/tables/metric.date_dim/load
>>
>> but no relevant logs in kylin.log
>>
>>
>>
>>
>>
>> apache_...@163.com
>>
>> From: ShaoFeng Shi
>> Date: 2017-08-12 14:59
>> To: dev
>> Subject: Re: kylin load hive table rest is error
>> Is there any clue in kylin.log?
>>
>> 2017-08-12 9:58 GMT+08:00 apache_...@163.com <apache_...@163.com>:
>>
>> >
>> > Hi,
>> >
>> > Please help confirm a question(bug?),when i run load hive table by
>> > kylin rest interface, it return a error page info
>> >
>> > example:
>> >
>> > post http://xx.xx.xx.xx:7070/kylin/api/metric.date_dim/load
>> > metric.data_dim is hive table, load is kylin project.
>> >
>> > No body.
>> >
>> >
>> > return page info:
>> >
>> >
>> > > > http-equiv="X-UA-Compatible" content="IE=edge,chrome=1">
>> >
>> >
>> >
>> >
>> >
>> >
>> >
>> >
>> > Kylin
>> >
>> >
>> >
>> >
>> >
>> > > > ng-include="'partials/header.html'">
>> >
>> >
>> >
>> >
>> >
>> > > > ng-include="'partials/footer.html'">
>> >
>> >
>> >
>> >
>> > <div class="callout">
>> > <h4>Error Message</h4>
>> > <p>{{text}}</p>
>> > </div>
>> > <div class="callout callout-danger">
>> > <h4>Cube Schema</h4>
>> > <pre>{{schema}}</pre>
>> > </div>
>> >
>> >
>> > <div class="callout callout-info">
>> > <p>{{text}}</p>
>> > </div>
>> >
>> >
>> >
>> >
>> > <div class="callout callout-info">
>> > <h4>Error Message</h4>
>> > <p>{{text}}</p>
>> > </div>
>> > <div class="callout callout-danger">
>> > <h4>Model Schema</h4>
>> > <pre>{{schema}}</pre>
>> > </div>
>> >
>> >
>> > <div class="callout callout-info">
>> > <p>{{text}}</p>
>> > </div>
>> >
>> >
>> >
>> > <div class="callout">
>> > <h4>Error Message</h4>
>> > <p>{{text}}</p>
>> > </div>
>> > <div class="callout callout-danger">
>> > <h4>Streaming Schema</h4>
>> > <pre>{{streamingSchema}}</pre>
>> > </div>
>> > <div class="callout callout-danger">
>> > <h4>Kafka Schema</h4>
>> > <pre>{{kfkSchema}}</pre>
>> > </div>
>> >
>> >
>> > <div class="callout callout-info">
>> > <p>{{text}}</p>
>> > </div>
>> >
>> >
>> >
>> >
>> >
>> >
>> >
>> >
>> >
>> >
>> > apache_...@163.com
>> >
>>
>>
>>
>> --
>> Best regards,
>>
>> Shaofeng Shi 史少锋
>>
>
>
>
> --
> Best regards,
>
> Shaofeng Shi 史少锋
>
>
--
Best regards,
Shaofeng Shi 史少锋
Re: Re: kylin load hive table rest is error
Hi,shaofeng:
Kylin2.0 on HDP2.5.3.
hive> use metric;
OK
Time taken: 0.029 seconds
hive> show tables;
OK
buss_info
dim
dim_curr
dim_date
dim_dtyp
dim_gl_acc
dim_org
fact1
fact2
Time taken: 0.245 seconds, Fetched: 9 row(s)
post url: http://xx.xx.xx.xx:7070/kylin/api/tables/metric.date_dim/load
return error:
Server returned HTTP response code: 500 for URL:
http://xx.xx.xx.xx:7070/kylin/api/tables/metric.date_dim/load
but no relevant logs in kylin.log
apache_...@163.com
From: ShaoFeng Shi
Date: 2017-08-12 14:59
To: dev
Subject: Re: kylin load hive table rest is error
Is there any clue in kylin.log?
2017-08-12 9:58 GMT+08:00 apache_...@163.com <apache_...@163.com>:
>
> Hi,
>
> Please help confirm a question(bug?),when i run load hive table by
> kylin rest interface, it return a error page info
>
> example:
>
> post http://xx.xx.xx.xx:7070/kylin/api/metric.date_dim/load
> metric.data_dim is hive table, load is kylin project.
>
> No body.
>
>
> return page info:
>
>
> http-equiv="X-UA-Compatible" content="IE=edge,chrome=1">
>
>
>
>
>
>
>
>
> Kylin
>
>
>
>
>
> ng-include="'partials/header.html'">
>
>
>
>
>
> ng-include="'partials/footer.html'">
>
>
>
>
> <div class="callout">
> <h4>Error Message</h4>
> <p>{{text}}</p>
> </div>
> <div class="callout callout-danger">
> <h4>Cube Schema</h4>
> <pre>{{schema}}</pre>
> </div>
>
>
> <div class="callout callout-info">
> <p>{{text}}</p>
> </div>
>
>
>
>
> <div class="callout callout-info">
> <h4>Error Message</h4>
> <p>{{text}}</p>
> </div>
> <div class="callout callout-danger">
> <h4>Model Schema</h4>
> <pre>{{schema}}</pre>
> </div>
>
>
> <div class="callout callout-info">
> <p>{{text}}</p>
> </div>
>
>
>
> <div class="callout">
> <h4>Error Message</h4>
> <p>{{text}}</p>
> </div>
> <div class="callout callout-danger">
> <h4>Streaming Schema</h4>
> <pre>{{streamingSchema}}</pre>
> </div>
> <div class="callout callout-danger">
> <h4>Kafka Schema</h4>
> <pre>{{kfkSchema}}</pre>
> </div>
>
>
> <div class="callout callout-info">
> <p>{{text}}</p>
> </div>
>
>
>
>
>
>
>
>
>
>
> apache_...@163.com
>
--
Best regards,
Shaofeng Shi 史少锋
kylin load hive table rest is error
Hi,
Please help confirm a question(bug?),when i run load hive table by kylin
rest interface, it return a error page info
example:
post http://xx.xx.xx.xx:7070/kylin/api/metric.date_dim/load
metric.data_dim is hive table, load is kylin project.
No body.
return page info:
Kylin
<div class="callout">
<h4>Error Message</h4>
<p>{{text}}</p>
</div>
<div class="callout callout-danger">
<h4>Cube Schema</h4>
<pre>{{schema}}</pre>
</div>
<div class="callout callout-info">
<p>{{text}}</p>
</div>
<div class="callout callout-info">
<h4>Error Message</h4>
<p>{{text}}</p>
</div>
<div class="callout callout-danger">
<h4>Model Schema</h4>
<pre>{{schema}}</pre>
</div>
<div class="callout callout-info">
<p>{{text}}</p>
</div>
<div class="callout">
<h4>Error Message</h4>
<p>{{text}}</p>
</div>
<div class="callout callout-danger">
<h4>Streaming Schema</h4>
<pre>{{streamingSchema}}</pre>
</div>
<div class="callout callout-danger">
<h4>Kafka Schema</h4>
<pre>{{kfkSchema}}</pre>
</div>
<div class="callout callout-info">
<p>{{text}}</p>
</div>
apache_...@163.com
kylin load hive table rest is error
Hi,
Please help me confirm a question,when i run load hive table by rest, it
return a error page info
example:
post http://xx.xx.xx.xx:7070/kylin/api/metric.date_dim/load
metric.data_dim is hive table, load is kylin project.
No body.
return page info:
Kylin
<div class="callout">
<h4>Error Message</h4>
<p>{{text}}</p>
</div>
<div class="callout callout-danger">
<h4>Cube Schema</h4>
<pre>{{schema}}</pre>
</div>
<div class="callout callout-info">
<p>{{text}}</p>
</div>
<div class="callout callout-info">
<h4>Error Message</h4>
<p>{{text}}</p>
</div>
<div class="callout callout-danger">
<h4>Model Schema</h4>
<pre>{{schema}}</pre>
</div>
<div class="callout callout-info">
<p>{{text}}</p>
</div>
<div class="callout">
<h4>Error Message</h4>
<p>{{text}}</p>
</div>
<div class="callout callout-danger">
<h4>Streaming Schema</h4>
<pre>{{streamingSchema}}</pre>
</div>
<div class="callout callout-danger">
<h4>Kafka Schema</h4>
<pre>{{kfkSchema}}</pre>
</div>
<div class="callout callout-info">
<p>{{text}}</p>
</div>
apache_...@163.com
Re: Re: query Sql run Error
Is it a bug to be sure?Is there any way around this issue?
this sql cann't work
select F16,sum(F0) from
(
select T8.PART_DT as F16,T8.I_eceb82a4498247aeb911ba59f82148f0 as F0 from
(
select KYLIN_SALES.PART_DT, KYLIN_SALES.SELLER_ID, sum(KYLIN_SALES.PRICE)
I_eceb82a4498247aeb911ba59f82148f0
from KYLIN_SALES where PART_DT in('2012-01-01', '2012-01-02', '2012-01-03')
group by KYLIN_SALES.PART_DT, KYLIN_SALES.SELLER_ID
) T8
inner join KYLIN_CAL_DT T17
on T8.PART_DT = T17.CAL_DT
) T7
group by F16
but when i remove join sql
inner join KYLIN_CAL_DT T17
on T8.PART_DT = T17.CAL_DT
is can work.
select F16,sum(F0) from
(
select T8.PART_DT as F16,T8.I_eceb82a4498247aeb911ba59f82148f0 as F0 from
(
select KYLIN_SALES.PART_DT, KYLIN_SALES.SELLER_ID, sum(KYLIN_SALES.PRICE)
I_eceb82a4498247aeb911ba59f82148f0
from KYLIN_SALES where PART_DT in('2012-01-01', '2012-01-02', '2012-01-03')
group by KYLIN_SALES.PART_DT, KYLIN_SALES.SELLER_ID
) T8
) T7
group by F16
apache_...@163.com
From: apache_...@163.com
Date: 2017-08-02 12:41
To: dev
Subject: Re: Re: query Sql run Error
I would like to explain one point ,first sql is Bi(smartbi) tools auto
created,This example has normal typical.
apache_...@163.com
From: apache_...@163.com
Date: 2017-08-01 18:36
To: dev
Subject: Re: Re: query Sql run Error
thinks,
Kylin2.0 on HDP2.5.3.
sql is not work.
select T7.F16 as F3,SUM(T7.F0) as F4
from (
select T17.QTR_ID as F16,T8.I_eceb82a4498247aeb911ba59f82148f0 as F0
from KYLIN_CAL_DT T17
inner join
(
select KYLIN_SALES.PART_DT, KYLIN_SALES.SELLER_ID, sum(KYLIN_SALES.PRICE)
I_eceb82a4498247aeb911ba59f82148f0
from KYLIN_SALES where PART_DT in('2012-01-01', '2012-01-02', '2012-01-03')
group by KYLIN_SALES.PART_DT, KYLIN_SALES.SELLER_ID
) T8
on T8.PART_DT = T17.CAL_DT
) T7
group by T7.F16
but this sql can work normal.
select T7.F16 as F3,SUM(T7.F0) as F4 from
(
select F16,F0 from
(
select T17.QTR_ID as F16,T8.I_eceb82a4498247aeb911ba59f82148f0 as F0
from KYLIN_CAL_DT T17
inner join
(
select KYLIN_SALES.PART_DT, KYLIN_SALES.SELLER_ID, sum(KYLIN_SALES.PRICE)
I_eceb82a4498247aeb911ba59f82148f0
from KYLIN_SALES where PART_DT in('2012-01-01', '2012-01-02', '2012-01-03')
group by KYLIN_SALES.PART_DT, KYLIN_SALES.SELLER_ID
) T8
on T8.PART_DT = T17.CAL_DT
) T7
group by F16,F0
) T7
group by T7.F16
apache_...@163.com
From: Billy Liu
Date: 2017-08-01 17:28
To: dev
Subject: Re: query Sql run Error
please check log first.
2017-08-01 16:08 GMT+08:00 apache_...@163.com <apache_...@163.com>:
> Hi,
>
> Kylin2.0 on HDP2.5.3.
>
> sql is not work.
>select T7.F16 as F3,SUM(T7.F0) as F4
> from (
> select T17.QTR_ID as F16,T8.I_eceb82a4498247aeb911ba59f82148f0 as F0
> from KYLIN_CAL_DT T17
> inner join
> (
> select KYLIN_SALES.PART_DT, KYLIN_SALES.SELLER_ID, sum(KYLIN_SALES.PRICE)
> I_eceb82a4498247aeb911ba59f82148f0
> from KYLIN_SALES where PART_DT in('2012-01-01', '2012-01-02', '2012-01-03')
> group by KYLIN_SALES.PART_DT, KYLIN_SALES.SELLER_ID
> ) T8
> on T8.PART_DT = T17.CAL_DT
> ) T7
> group by T7.F16
>
> but this sql can work
>
> select T7.F16 as F3,SUM(T7.F0) as F4 from
> (
> select F16,F0 from
> (
> select T17.QTR_ID as F16,T8.I_eceb82a4498247aeb911ba59f82148f0 as F0
> from KYLIN_CAL_DT T17
> inner join
> (
> select KYLIN_SALES.PART_DT, KYLIN_SALES.SELLER_ID, sum(KYLIN_SALES.PRICE)
> I_eceb82a4498247aeb911ba59f82148f0
> from KYLIN_SALES where PART_DT in('2012-01-01', '2012-01-02', '2012-01-03')
> group by KYLIN_SALES.PART_DT, KYLIN_SALES.SELLER_ID
> ) T8
> on T8.PART_DT = T17.CAL_DT
> ) T7
> group by F16,F0
> ) T7
> group by T7.F16
>
> What's the reason?
>
>
>
> apache_...@163.com
>
sql often running error
rChainProxy.java:342) at org.springframework.security.web.savedrequest.RequestCacheAwareFilter.doFilter(RequestCacheAwareFilter.java:45) at org.springframework.security.web.FilterChainProxy$VirtualFilterChain.doFilter(FilterChainProxy.java:342) at org.springframework.security.web.authentication.www.BasicAuthenticationFilter.doFilter(BasicAuthenticationFilter.java:201) at org.springframework.security.web.FilterChainProxy$VirtualFilterChain.doFilter(FilterChainProxy.java:342) at org.springframework.security.web.authentication.ui.DefaultLoginPageGeneratingFilter.doFilter(DefaultLoginPageGeneratingFilter.java:91) at org.springframework.security.web.FilterChainProxy$VirtualFilterChain.doFilter(FilterChainProxy.java:342) at org.springframework.security.web.authentication.AbstractAuthenticationProcessingFilter.doFilter(AbstractAuthenticationProcessingFilter.java:183) at org.springframework.security.web.FilterChainProxy$VirtualFilterChain.doFilter(FilterChainProxy.java:342) at org.springframework.security.web.authentication.logout.LogoutFilter.doFilter(LogoutFilter.java:105) at org.springframework.security.web.FilterChainProxy$VirtualFilterChain.doFilter(FilterChainProxy.java:342) at org.springframework.security.web.context.SecurityContextPersistenceFilter.doFilter(SecurityContextPersistenceFilter.java:87) at org.springframework.security.web.FilterChainProxy$VirtualFilterChain.doFilter(FilterChainProxy.java:342) at org.springframework.security.web.FilterChainProxy.doFilterInternal(FilterChainProxy.java:192) at org.springframework.security.web.FilterChainProxy.doFilter(FilterChainProxy.java:160) at org.springframework.web.filter.DelegatingFilterProxy.invokeDelegate(DelegatingFilterProxy.java:343) at org.springframework.web.filter.DelegatingFilterProxy.doFilter(DelegatingFilterProxy.java:260) at org.apache.catalina.core.ApplicationFilterChain.internalDoFilter(ApplicationFilterChain.java:241) at org.apache.catalina.core.ApplicationFilterChain.doFilter(ApplicationFilterChain.java:208) at com.thetransactioncompany.cors.CORSFilter.doFilter(CORSFilter.java:209) at com.thetransactioncompany.cors.CORSFilter.doFilter(CORSFilter.java:244) at org.apache.catalina.core.ApplicationFilterChain.internalDoFilter(ApplicationFilterChain.java:241) at org.apache.catalina.core.ApplicationFilterChain.doFilter(ApplicationFilterChain.java:208) at org.apache.catalina.core.StandardWrapperValve.invoke(StandardWrapperValve.java:220) at org.apache.catalina.core.StandardContextValve.invoke(StandardContextValve.java:122) at org.apache.catalina.authenticator.AuthenticatorBase.invoke(AuthenticatorBase.java:505) at org.apache.catalina.core.StandardHostValve.invoke(StandardHostValve.java:169) at org.apache.catalina.valves.ErrorReportValve.invoke(ErrorReportValve.java:103) at org.apache.catalina.valves.AccessLogValve.invoke(AccessLogValve.java:956) at org.apache.catalina.core.StandardEngineValve.invoke(StandardEngineValve.java:116) at org.apache.catalina.connector.CoyoteAdapter.service(CoyoteAdapter.java:436) at org.apache.coyote.http11.AbstractHttp11Processor.process(AbstractHttp11Processor.java:1078) at org.apache.coyote.AbstractProtocol$AbstractConnectionHandler.process(AbstractProtocol.java:625) at org.apache.tomcat.util.net.JIoEndpoint$SocketProcessor.run(JIoEndpoint.java:316) at java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1142) at java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:617) at org.apache.tomcat.util.threads.TaskThread$WrappingRunnable.run(TaskThread.java:61) at java.lang.Thread.run(Thread.java:748) apache_...@163.com From: apache_...@163.com Date: 2017-08-03 17:24 To: dev Subject: ql often running error Hi, sql does often running error,but after restart kylin server,SQL can execute properly How do I find out the reason? apache_...@163.com
sql often running error
Hi, Kylin2.0 on HDP2.5.3. sql does often running error,but after restart kylin server,SQL can execute properly How do I find out the reason? apache_...@163.com
ql often running error
Hi, sql does often running error,but after restart kylin server,SQL can execute properly How do I find out the reason? apache_...@163.com
回复: How can I edit model & cube?
These problems have now been sorted thinks. apache_...@163.com 发件人： apache_...@163.com 发送时间： 2017-08-02 12:14 收件人： dev 主题： How can I edit model & cube? Hi, How can I edit model & cube by rest interface? could you share some ways to edit it by api(not kylin UI)，thinks . apache_...@163.com
How can I edit model & cube?
Hi, How can I edit model & cube by rest interface? could you share some ways to edit it by api(not kylin UI)，thinks . apache_...@163.com
query Sql run Error
Hi,
Kylin2.0 on HDP2.5.3.
sql is not work.
select T7.F16 as F3,SUM(T7.F0) as F4
from (
select T17.QTR_ID as F16,T8.I_eceb82a4498247aeb911ba59f82148f0 as F0
from KYLIN_CAL_DT T17
inner join
(
select KYLIN_SALES.PART_DT, KYLIN_SALES.SELLER_ID, sum(KYLIN_SALES.PRICE)
I_eceb82a4498247aeb911ba59f82148f0
from KYLIN_SALES where PART_DT in('2012-01-01', '2012-01-02', '2012-01-03')
group by KYLIN_SALES.PART_DT, KYLIN_SALES.SELLER_ID
) T8
on T8.PART_DT = T17.CAL_DT
) T7
group by T7.F16
but this sql can work
select T7.F16 as F3,SUM(T7.F0) as F4 from
(
select F16,F0 from
(
select T17.QTR_ID as F16,T8.I_eceb82a4498247aeb911ba59f82148f0 as F0
from KYLIN_CAL_DT T17
inner join
(
select KYLIN_SALES.PART_DT, KYLIN_SALES.SELLER_ID, sum(KYLIN_SALES.PRICE)
I_eceb82a4498247aeb911ba59f82148f0
from KYLIN_SALES where PART_DT in('2012-01-01', '2012-01-02', '2012-01-03')
group by KYLIN_SALES.PART_DT, KYLIN_SALES.SELLER_ID
) T8
on T8.PART_DT = T17.CAL_DT
) T7
group by F16,F0
) T7
group by T7.F16
What's the reason?
apache_...@163.com
and method edit exist model
Hi, Have any method edit model(Scenario:add some dimensions or measures after base hive table is chanage,but don't want to create a new model),This model have a include some cub. Only add some dimensions or measures in exist model. apache_...@163.com
Re: Re: sum function error download URL: http://pan.baidu.com/s/1slFedyt
Sorry,
Kylin2.0 on HDP2.5.3
step printscreent in word,download url,please view in mail subject.
apache_...@163.com
From: Billy Liu
Date: 2017-07-26 22:51
To: dev
Subject: Re: sum function error
When you describe something is wrong, could you show the reproduce steps,
versions, expected result and your analysis?
For example, which kylin version, what measure and dimensions have been
defined, what's your expected SUM result? What's the actual result.
2017-07-26 14:16 GMT+08:00 apache_...@163.com <apache_...@163.com>:
>
> Photo maybe cann't open.
>
> I run insight:
>
> select sum(TEM.C) from TEM,result is wrong
>
> but run:
> select sum(TEM.B) from TEM,result is right
>
>
> apache_...@163.com
>
> From: apache_...@163.com
> Date: 2017-07-26 11:47
> To: dev
> Subject: sum function error
> Hi,
>when i run sum function,get a error result:
>
>
>
>
>
>
> Hive table,no lookup table
>
> create table tem(a varchar(1),b bigint,c bigint);
>
> insert into tem values('A',null,1);
> insert into tem values('A',1,1);
> insert into tem values('A',2,1);
> insert into tem values('B',3,1);
> insert into tem values('B',1,1);
> insert into tem values('C',4,1);
>
>
>
>
>
>
> apache_...@163.com
>
Re: Re: sum function error URL: http://pan.baidu.com/s/1slFedyt
sorry,
printScreen File(2.4M) is too large for mail server,could you download it in
attachments url, maybe attachments mail was intercepted ,please view mail
subject
apache_...@163.com
From: Billy Liu
Date: 2017-07-26 22:51
To: dev
Subject: Re: sum function error
When you describe something is wrong, could you show the reproduce steps,
versions, expected result and your analysis?
For example, which kylin version, what measure and dimensions have been
defined, what's your expected SUM result? What's the actual result.
2017-07-26 14:16 GMT+08:00 apache_...@163.com <apache_...@163.com>:
>
> Photo maybe cann't open.
>
> I run insight:
>
> select sum(TEM.C) from TEM,result is wrong
>
> but run:
> select sum(TEM.B) from TEM,result is right
>
>
> apache_...@163.com
>
> From: apache_...@163.com
> Date: 2017-07-26 11:47
> To: dev
> Subject: sum function error
> Hi,
>when i run sum function,get a error result:
>
>
>
>
>
>
> Hive table,no lookup table
>
> create table tem(a varchar(1),b bigint,c bigint);
>
> insert into tem values('A',null,1);
> insert into tem values('A',1,1);
> insert into tem values('A',2,1);
> insert into tem values('B',3,1);
> insert into tem values('B',1,1);
> insert into tem values('C',4,1);
>
>
>
>
>
>
> apache_...@163.com
>
Re: Re: sum function error
sorry,
printScreen File(2.4M) is too large for mail server,could you download it in
attachments url:
apache_...@163.com
From: Billy Liu
Date: 2017-07-26 22:51
To: dev
Subject: Re: sum function error
When you describe something is wrong, could you show the reproduce steps,
versions, expected result and your analysis?
For example, which kylin version, what measure and dimensions have been
defined, what's your expected SUM result? What's the actual result.
2017-07-26 14:16 GMT+08:00 apache_...@163.com <apache_...@163.com>:
>
> Photo maybe cann't open.
>
> I run insight:
>
> select sum(TEM.C) from TEM,result is wrong
>
> but run:
> select sum(TEM.B) from TEM,result is right
>
>
> apache_...@163.com
>
> From: apache_...@163.com
> Date: 2017-07-26 11:47
> To: dev
> Subject: sum function error
> Hi,
>when i run sum function,get a error result:
>
>
>
>
>
>
> Hive table,no lookup table
>
> create table tem(a varchar(1),b bigint,c bigint);
>
> insert into tem values('A',null,1);
> insert into tem values('A',1,1);
> insert into tem values('A',2,1);
> insert into tem values('B',3,1);
> insert into tem values('B',1,1);
> insert into tem values('C',4,1);
>
>
>
>
>
>
> apache_...@163.com
>
Re: sum function error
Photo maybe cann't open.
I run insight:
select sum(TEM.C) from TEM,result is wrong
but run:
select sum(TEM.B) from TEM,result is right
apache_...@163.com
From: apache_...@163.com
Date: 2017-07-26 11:47
To: dev
Subject: sum function error
Hi,
when i run sum function,get a error result:
Hive table,no lookup table
create table tem(a varchar(1),b bigint,c bigint);
insert into tem values('A',null,1);
insert into tem values('A',1,1);
insert into tem values('A',2,1);
insert into tem values('B',3,1);
insert into tem values('B',1,1);
insert into tem values('C',4,1);
apache_...@163.com
sum function error
Hi,
when i run sum function,get a error result:
Hive table,no lookup table
create table tem(a varchar(1),b bigint,c bigint);
insert into tem values('A',null,1);
insert into tem values('A',1,1);
insert into tem values('A',2,1);
insert into tem values('B',3,1);
insert into tem values('B',1,1);
insert into tem values('C',4,1);
apache_...@163.com
Re: Re: Cube view
Hi, column level. Similar to the create many view(one or many column) on one table(result data) in rdbms. apache_...@163.com From: ShaoFeng Shi Date: 2017-07-25 21:24 To: dev Subject: Re: Cube view Do you mean more fine granularify access control (row level and column level)? For example some user can get the overall data, while some user can only access partial data, from one cube. 2017-07-25 19:59 GMT+08:00 Li Yang <liy...@apache.org>: > No such plan yet. Please create a JIRA and describe the requirement in more > details if you think it is important. Thanks! > > Yang > > On Fri, Jul 21, 2017 at 12:33 PM, apache_...@163.com <apache_...@163.com> > wrote: > > > Hi, > > > > Sometime,the Cube result must share some departments,department can only > > access part of cube columns, Have any plans to support the Cube view? > > > > > > > > apache_...@163.com > > > -- Best regards, Shaofeng Shi 史少锋
paged query
Hi,
Kylin can support paged query? This sql can't work
select * from KYLIN_SALES OFFSET 100 ROWS FETCH FIRST 10 ROWS
Calcite doc:
query:
values | WITH withItem [ , withItem ]* query | { select | selectWithoutFrom |
query UNION [ ALL | DISTINCT ] query | query EXCEPT [ ALL | DISTINCT ] query |
query MINUS [ ALL | DISTINCT ] query | query INTERSECT [ ALL | DISTINCT ] query
} [ ORDER BY orderItem [, orderItem ]* ] [ LIMIT { count | ALL } ] [ OFFSET
start { ROW | ROWS } ] [ FETCH { FIRST | NEXT } [ count ] { ROW | ROWS } ]
apache_...@163.com
Cube view
Hi, Sometime,the Cube result must share some departments,department can only access part of cube columns, Have any plans to support the Cube view? apache_...@163.com
build cube error
Hi, After i created model(m01) and cube(c001 base m01),when i build the c001 cube, get a error, "cube c001 doesn't contain and ready segment",What's the reason, please? apache_...@163.com
Re: Re: about Measures result stroage
shaofeng, thinks. Is it(measures result) calculated during the cube running or calculated at query time? apache_...@163.com From: ShaoFeng Shi Date: 2017-07-18 17:31 To: dev Subject: Re: about Measures result stroage One Cube may has 1 or multiple Cube segments; Each segment will be saved as a HBase table. All your measures will be saved together in HTable. So the HBase table number will be equals to Cube segment numbers. 2017-07-18 15:34 GMT+08:00 apache_...@163.com <apache_...@163.com>: > Hi, > > I have a question, when i create model(have many measures) ,and run a > cube base this model >what store about measures result in hbase , Other Single hbase > table ? > > > > apache_...@163.com > -- Best regards, Shaofeng Shi 史少锋
about Measures result stroage
Hi, I have a question, when i create model(have many measures) ,and run a cube base this model what store about measures result in hbase , Other Single hbase table ? apache_...@163.com
