Re: How to query the Cube via API and use the dataset for other purpose

2024-04-03 Thread Nam Đỗ Duy
val data = (parsedJson \ "results").extract[List[List[Any]]] // convert data to RDD[Row] val rowsRDD = spark.sparkContext.parallelize(data.map(row => Row.fromSeq(row.map(_.asInstanceOf[AnyRef] val df = spark.createDataFrame(rowsRDD, schema) df.show(20

Re: How to query the Cube via API and use the dataset for other purpose

2024-03-31 Thread Lionel CL
Hi Nam, You can refer to the spark docs https://spark.apache.org/docs/latest/sql-data-sources-jdbc.html Regards, Lu Cao From: Nam Đỗ Duy Date: Sunday, March 31, 2024 at 08:53 To: dev , u...@kylin.apache.org Subject: Re: How to query the Cube via API and use the dataset for other purpose Dear

Re: How to query the Cube via API and use the dataset for other purpose

2024-03-30 Thread Nam Đỗ Duy
Dear Sirs/Madames Could anyone here help me to figureout the way to use scala to query an select SQL against kylin cube via API then turn that table result into a dataframe in scala for other purpose? Thank you so much for your time! Best regards On Fri, 29 Mar 2024 at 17:52 Nam Đỗ Duy wrote

How to query the Cube via API and use the dataset for other purpose

2024-03-29 Thread Nam Đỗ Duy
Hi Xiaoxiang, Sir & Madames, I use the following code to query the cube via API but I cannot use the result as a dataframe, could you suggest a way to do that because it is very important for our project. Thanks and best regards === import org.apache.spark

[jira] [Created] (KYLIN-5590) spark cube job supports priority, add job execution limit

2023-06-09 Thread Chuang Lee (Jira)
Chuang Lee created KYLIN-5590: - Summary: spark cube job supports priority, add job execution limit Key: KYLIN-5590 URL: https://issues.apache.org/jira/browse/KYLIN-5590 Project: Kylin Issue Type

[jira] [Created] (KYLIN-5539) Kylin4 JobServer在每次Cube构建后未关闭已打开的HDFS文件流,产生大量CLOSE_WAIT

2023-04-28 Thread Liu Zhao (Jira)
Liu Zhao created KYLIN-5539: --- Summary: Kylin4 JobServer在每次Cube构建后未关闭已打开的HDFS文件流,产生大量CLOSE_WAIT Key: KYLIN-5539 URL: https://issues.apache.org/jira/browse/KYLIN-5539 Project: Kylin Issue Type: Bug

[jira] [Created] (KYLIN-5514) Support batch build Cube and batch refresh Cube

2023-04-13 Thread Chuang Lee (Jira)
Chuang Lee created KYLIN-5514: - Summary: Support batch build Cube and batch refresh Cube Key: KYLIN-5514 URL: https://issues.apache.org/jira/browse/KYLIN-5514 Project: Kylin Issue Type: New

[jira] [Created] (KYLIN-5513) Kylin supports query qps current limit of cube

2023-04-13 Thread Chuang Lee (Jira)
Chuang Lee created KYLIN-5513: - Summary: Kylin supports query qps current limit of cube Key: KYLIN-5513 URL: https://issues.apache.org/jira/browse/KYLIN-5513 Project: Kylin Issue Type: New

[jira] [Created] (KYLIN-5472) Prompt CUBE when performing sum or count aggregation operations on the derived column_ UNMATCHED_ AGGREGATION[FunctionDesc [expression=SUM, parameter=2_2231359f:xxx, retu

2023-03-02 Thread Liu Zhao (Jira)
Liu Zhao created KYLIN-5472: --- Summary: Prompt CUBE when performing sum or count aggregation operations on the derived column_ UNMATCHED_ AGGREGATION[FunctionDesc [expression=SUM, parameter=2_2231359f:xxx, returnType=null]] Key: KYLIN

[jira] [Created] (KYLIN-5332) After turning on the switch "kylin.query.use-tableindex-answer-select-star.enabled", select * only answers the dimension in the cube, but the table index contains more co

2022-12-05 Thread sibing.zhang (Jira)
sibing.zhang created KYLIN-5332: --- Summary: After turning on the switch "kylin.query.use-tableindex-answer-select-star.enabled", select * only answers the dimension in the cube, but the table index contains more columns

[jira] [Created] (KYLIN-5305) kylin4.0.1 build cube error

2022-11-27 Thread lsy_budd (Jira)
lsy_budd created KYLIN-5305: --- Summary: kylin4.0.1 build cube error Key: KYLIN-5305 URL: https://issues.apache.org/jira/browse/KYLIN-5305 Project: Kylin Issue Type: Bug Components: Spark

Re: building a cube for demographic data queries

2022-10-16 Thread Li Yang
upport sum exprssion, and Kylin > 4.x > > >> is the version you are using. > > >> > > >> 4) Does Kylin support MEDIAN? > > >> > > >> Yes, Kylin should support but I didn't test it. In fact, Kylin has a > > >> measure PE

Re: building a cube for demographic data queries

2022-10-14 Thread Will Glass-Husain
in should support but I didn't test it. In fact, Kylin has a > >> measure PERCENTILE, and I think 50th percentile is equal to MEDIAN, am I > >> right? > >> > >> -- > >> *Best wishes to you ! * > >> *From :**Xiaoxiang Yu* > >> >

Re: building a cube for demographic data queries

2022-10-12 Thread Xiaoxiang Yu
. In fact, Kylin has a >> measure PERCENTILE, and I think 50th percentile is equal to MEDIAN, am I >> right? >> >> -- >> *Best wishes to you ! * >> *From :**Xiaoxiang Yu* >> >> >> >> At 2022-10-11 14:03:14, "Will Glass-Husain"

Re:Re: building a cube for demographic data queries

2022-10-11 Thread Mukvin
is equal to MEDIAN, am I >> right? >> >> -- >> *Best wishes to you ! * >> *From :**Xiaoxiang Yu* >> >> >> >> At 2022-10-11 14:03:14, "Will Glass-Husain" wrote: >> >Hi, >> > >> >Thanks for the recent help as I

Re: building a cube for demographic data queries

2022-10-11 Thread Will Glass-Husain
, am I > right? > > -- > *Best wishes to you ! * > *From :**Xiaoxiang Yu* > > > > At 2022-10-11 14:03:14, "Will Glass-Husain" wrote: > >Hi, > > > >Thanks for the recent help as I set up my first Kylin system. I have a > >question r

Re:building a cube for demographic data queries

2022-10-11 Thread Xiaoxiang Yu
percentile is equal to MEDIAN, am I right? -- Best wishes to you ! From :Xiaoxiang Yu At 2022-10-11 14:03:14, "Will Glass-Husain" wrote: >Hi, > >Thanks for the recent help as I set up my first Kylin system. I have a >question regarding proper design of a cube to run som

building a cube for demographic data queries

2022-10-11 Thread Will Glass-Husain
Hi, Thanks for the recent help as I set up my first Kylin system. I have a question regarding proper design of a cube to run some demographic queries. I want to make this accessible in a webapp, with reasonable response time. I have a CSV file with about 80 columns on sex, race, state, age

[jira] [Created] (KYLIN-5254) Is there method in api to determine whether the current query search is in the cube or in the push down engine

2022-09-05 Thread zys (Jira)
zys created KYLIN-5254: -- Summary: Is there method in api to determine whether the current query search is in the cube or in the push down engine Key: KYLIN-5254 URL: https://issues.apache.org/jira/browse/KYLIN-5254

[jira] [Created] (KYLIN-5231) RuntimeException in cube build with Spark engine

2022-08-17 Thread Sandeep Putrevu (Jira)
Sandeep Putrevu created KYLIN-5231: -- Summary: RuntimeException in cube build with Spark engine Key: KYLIN-5231 URL: https://issues.apache.org/jira/browse/KYLIN-5231 Project: Kylin Issue

[jira] [Created] (KYLIN-5215) The metadata information returned by Kylin pushdown query and Cube query is inconsistent

2022-07-25 Thread gaogao (Jira)
gaogao created KYLIN-5215: - Summary: The metadata information returned by Kylin pushdown query and Cube query is inconsistent Key: KYLIN-5215 URL: https://issues.apache.org/jira/browse/KYLIN-5215 Project

[jira] [Created] (KYLIN-5211) 采用 kylin提供的api拉取数据的时候,发现project没有起作用,下线的cube依然可以通过api拉取数据

2022-07-13 Thread y_jleo (Jira)
y_jleo created KYLIN-5211: - Summary: 采用 kylin提供的api拉取数据的时候,发现project没有起作用,下线的cube依然可以通过api拉取数据 Key: KYLIN-5211 URL: https://issues.apache.org/jira/browse/KYLIN-5211 Project: Kylin Issue Type: Bug

[jira] [Created] (KYLIN-5208) kylin 4.0.1 构建cube 2个表1对多关系 ,报错 DUP key found ,key=venue_id

2022-07-08 Thread huang song (Jira)
huang song created KYLIN-5208: - Summary: kylin 4.0.1 构建cube 2个表1对多关系 ,报错 DUP key found ,key=venue_id Key: KYLIN-5208 URL: https://issues.apache.org/jira/browse/KYLIN-5208 Project: Kylin Issue

[jira] [Created] (KYLIN-5180) multi cube job with count distinct building will failed,because the dictionary lock is error

2022-04-26 Thread yuanhongjun (Jira)
yuanhongjun created KYLIN-5180: -- Summary: multi cube job with count distinct building will failed,because the dictionary lock is error Key: KYLIN-5180 URL: https://issues.apache.org/jira/browse/KYLIN-5180

Re: Kyin HDFS Encryption - Cube Build Job Failed

2022-03-25 Thread Singh Sonu
; > Hi Experts, We need your help with below query: > > > > We enabled HDFS encryption using, hadoop KMS ( Hadoop 3.1.0 ).. > > hdfs-site.xml and core-site.xml is moved to $KYLIN_HOME/spark/conf with > the > > details of the kms keyprovider... > > > &g

Re: Kyin HDFS Encryption - Cube Build Job Failed

2022-03-18 Thread Yaqian Zhang
ith below query: > > We enabled HDFS encryption using, hadoop KMS ( Hadoop 3.1.0 ).. > hdfs-site.xml and core-site.xml is moved to $KYLIN_HOME/spark/conf with the > details of the kms keyprovider... > > (Kylin 3.1.2) After this the spark cube build is failing in the job step : >

Kyin HDFS Encryption - Cube Build Job Failed

2022-03-17 Thread Singh Sonu
Hi Experts, We need your help with below query: We enabled HDFS encryption using, hadoop KMS ( Hadoop 3.1.0 ).. hdfs-site.xml and core-site.xml is moved to $KYLIN_HOME/spark/conf with the details of the kms keyprovider... (Kylin 3.1.2) After this the spark cube build is failing in the job step

[jira] [Created] (KYLIN-5166) Use SQL hint to specify the cube that the user wants to query

2022-03-06 Thread Yaqian Zhang (Jira)
Yaqian Zhang created KYLIN-5166: --- Summary: Use SQL hint to specify the cube that the user wants to query Key: KYLIN-5166 URL: https://issues.apache.org/jira/browse/KYLIN-5166 Project: Kylin

[jira] [Created] (KYLIN-5148) kylin4 构建 cube 报错,Global dict build error on column ITEM_ID, key distinct count is 5076, and value distinct count is 6771

2022-01-09 Thread frankhu855 (Jira)
frankhu855 created KYLIN-5148: - Summary: kylin4 构建 cube 报错,Global dict build error on column ITEM_ID, key distinct count is 5076, and value distinct count is 6771 Key: KYLIN-5148 URL: https://issues.apache.org/jira

[jira] [Created] (KYLIN-5133) Error while building a cube

2021-11-23 Thread Keshav (Jira)
Keshav created KYLIN-5133: - Summary: Error while building a cube Key: KYLIN-5133 URL: https://issues.apache.org/jira/browse/KYLIN-5133 Project: Kylin Issue Type: Bug Reporter: Keshav I

[jira] [Created] (KYLIN-5127) support clone cube with original cube's cuboid bytes

2021-11-15 Thread mukvin (Jira)
mukvin created KYLIN-5127: - Summary: support clone cube with original cube's cuboid bytes Key: KYLIN-5127 URL: https://issues.apache.org/jira/browse/KYLIN-5127 Project: Kylin Issue Type: Improvement

[jira] [Created] (KYLIN-5124) Fail to build cube in the first step

2021-11-15 Thread wenjunzhang (Jira)
wenjunzhang created KYLIN-5124: -- Summary: Fail to build cube in the first step Key: KYLIN-5124 URL: https://issues.apache.org/jira/browse/KYLIN-5124 Project: Kylin Issue Type: Bug

关于kylin-3.1.2构建kafka streaming cube报错的咨询

2021-11-04 Thread xiezhanling
各位大神: 我是一位刚接触kylin的小白,目前碰到以下问题,期待各位大佬的回复! 报错日志: 2021-11-04 23:50:44,454 INFO [main] org.apache.kafka.clients.consumer.KafkaConsumer: [Consumer clientId=consumer-cube_xzl_feesserial_streaming-1, groupId=cube_xzl_feesserial_streaming] Seeking to offset 419176 for partition

[jira] [Created] (KYLIN-5114) Build cube error:java.lang.NoSuchMethodError

2021-11-01 Thread qingquanzhang (Jira)
qingquanzhang created KYLIN-5114: Summary: Build cube error:java.lang.NoSuchMethodError Key: KYLIN-5114 URL: https://issues.apache.org/jira/browse/KYLIN-5114 Project: Kylin Issue Type: Bug

[jira] [Created] (KYLIN-5107) when excuting the cube job at "Convert Cuboid Data to HFile" step:Error running child

2021-10-20 Thread mzz (Jira)
mzz created KYLIN-5107: -- Summary: when excuting the cube job at "Convert Cuboid Data to HFile" step:Error running child Key: KYLIN-5107 URL: https://issues.apache.org/jira/browse/KYLIN-5107 Proj

[jira] [Created] (KYLIN-5104) 成功构建cube后,hive元库失效

2021-10-19 Thread qingquanzhang (Jira)
qingquanzhang created KYLIN-5104: Summary: 成功构建cube后,hive元库失效 Key: KYLIN-5104 URL: https://issues.apache.org/jira/browse/KYLIN-5104 Project: Kylin Issue Type: Bug Affects Versions

[jira] [Created] (KYLIN-5102) learn_kylin项目,构建cube一直在构建,不能构建完成

2021-10-15 Thread qingquanzhang (Jira)
qingquanzhang created KYLIN-5102: Summary: learn_kylin项目,构建cube一直在构建,不能构建完成 Key: KYLIN-5102 URL: https://issues.apache.org/jira/browse/KYLIN-5102 Project: Kylin Issue Type: Bug

[jira] [Created] (KYLIN-5100) 构建cube失败 可能是因为虚拟内存不足

2021-10-14 Thread qingquanzhang (Jira)
qingquanzhang created KYLIN-5100: Summary: 构建cube失败 可能是因为虚拟内存不足 Key: KYLIN-5100 URL: https://issues.apache.org/jira/browse/KYLIN-5100 Project: Kylin Issue Type: Bug Reporter

Re: [jira] [Created] (KYLIN-4922) Failed to build cube

2021-10-14 Thread MAMERI Jamal - externe
lin v4.0.0、CDH-7.1.6、Spark version 2.4.7 What was your environmental problem ? Best Regards, Jamal Mameri On 2021/03/02 09:20:00, "YANG LIU (Jira)" mailto:j...@apache.org>> wrote: > YANG LIU created KYLIN-4922:> > --->

[jira] [Created] (KYLIN-5098) build cube failure

2021-10-12 Thread qingquanzhang (Jira)
qingquanzhang created KYLIN-5098: Summary: build cube failure Key: KYLIN-5098 URL: https://issues.apache.org/jira/browse/KYLIN-5098 Project: Kylin Issue Type: Bug Reporter

[jira] [Created] (KYLIN-5092) Unable to use API to refresh a cube - "Name is null" error

2021-09-20 Thread Andrew Lane (Jira)
Andrew Lane created KYLIN-5092: -- Summary: Unable to use API to refresh a cube - "Name is null" error Key: KYLIN-5092 URL: https://issues.apache.org/jira/browse/KYLIN-5092 Project: Kylin

[jira] [Created] (KYLIN-5088) kylin4 build cube cannot correct process explode array column

2021-09-13 Thread Guowei Zhu (Jira)
Guowei Zhu created KYLIN-5088: - Summary: kylin4 build cube cannot correct process explode array column Key: KYLIN-5088 URL: https://issues.apache.org/jira/browse/KYLIN-5088 Project: Kylin Issue

[jira] [Created] (KYLIN-5071) kylin.engine.build-base-cuboid-enabled=false and kylin.cube.cubeplanner.enabled=true are conflict on build cube step, and will throw NPE.

2021-09-01 Thread mukvin (Jira)
mukvin created KYLIN-5071: - Summary: kylin.engine.build-base-cuboid-enabled=false and kylin.cube.cubeplanner.enabled=true are conflict on build cube step, and will throw NPE. Key: KYLIN-5071 URL: https

[jira] [Created] (KYLIN-5062) 配置为S3的kylin.env.hdfs-working-dir目录下kylin_metadata子目录下有大量的cube构建临时目录

2021-08-16 Thread star_dev (Jira)
star_dev created KYLIN-5062: --- Summary: 配置为S3的kylin.env.hdfs-working-dir目录下kylin_metadata子目录下有大量的cube构建临时目录 Key: KYLIN-5062 URL: https://issues.apache.org/jira/browse/KYLIN-5062 Project: Kylin

[jira] [Created] (KYLIN-5059) Fix error when using different HDFS cluster in cube building

2021-08-10 Thread Shengjun Zheng (Jira)
Shengjun Zheng created KYLIN-5059: - Summary: Fix error when using different HDFS cluster in cube building Key: KYLIN-5059 URL: https://issues.apache.org/jira/browse/KYLIN-5059 Project: Kylin

[jira] [Created] (KYLIN-5058) Throws ConcurrentModificationException when building cube

2021-08-09 Thread Zhichao Zhang (Jira)
Zhichao Zhang created KYLIN-5058: - Summary: Throws ConcurrentModificationException when building cube Key: KYLIN-5058 URL: https://issues.apache.org/jira/browse/KYLIN-5058 Project: Kylin

[jira] [Created] (KYLIN-5044) Kylin 3.1.2 - Cube processing fails on Step 4 when hive client is switched to beeline.

2021-07-26 Thread Piotr Naszarkowski (Jira)
Piotr Naszarkowski created KYLIN-5044: - Summary: Kylin 3.1.2 - Cube processing fails on Step 4 when hive client is switched to beeline. Key: KYLIN-5044 URL: https://issues.apache.org/jira/browse/KYLIN-5044

[jira] [Created] (KYLIN-5041) Not check whether the model exists, when migrating the cube

2021-07-21 Thread Kun Liu (Jira)
Kun Liu created KYLIN-5041: -- Summary: Not check whether the model exists, when migrating the cube Key: KYLIN-5041 URL: https://issues.apache.org/jira/browse/KYLIN-5041 Project: Kylin Issue Type

[jira] [Created] (KYLIN-5037) Delete segment by UUID should disable the cube first

2021-07-16 Thread jimmydeng (Jira)
jimmydeng created KYLIN-5037: Summary: Delete segment by UUID should disable the cube first Key: KYLIN-5037 URL: https://issues.apache.org/jira/browse/KYLIN-5037 Project: Kylin Issue Type: Bug

[jira] [Created] (KYLIN-5034) forbid creating stream cube with non-MR building engine.

2021-07-12 Thread Kun Liu (Jira)
Kun Liu created KYLIN-5034: -- Summary: forbid creating stream cube with non-MR building engine. Key: KYLIN-5034 URL: https://issues.apache.org/jira/browse/KYLIN-5034 Project: Kylin Issue Type: Bug

[jira] [Created] (KYLIN-5021) FilePruner throws NPE when there is no timePartitionColumn in cube

2021-06-30 Thread tianhui (Jira)
tianhui created KYLIN-5021: -- Summary: FilePruner throws NPE when there is no timePartitionColumn in cube Key: KYLIN-5021 URL: https://issues.apache.org/jira/browse/KYLIN-5021 Project: Kylin Issue

[jira] [Created] (KYLIN-5015) stream cube migration: can't migrate cube to diff project

2021-06-23 Thread Kun Liu (Jira)
Kun Liu created KYLIN-5015: -- Summary: stream cube migration: can't migrate cube to diff project Key: KYLIN-5015 URL: https://issues.apache.org/jira/browse/KYLIN-5015 Project: Kylin Issue Type: Bug

[jira] [Created] (KYLIN-5012) kylin cube planner

2021-06-16 Thread star_dev (Jira)
star_dev created KYLIN-5012: --- Summary: kylin cube planner Key: KYLIN-5012 URL: https://issues.apache.org/jira/browse/KYLIN-5012 Project: Kylin Issue Type: Bug Components: Job Engine

[jira] [Created] (KYLIN-5002) Forbidden build segment while run cube optimize.

2021-05-31 Thread JiangYang (Jira)
JiangYang created KYLIN-5002: Summary: Forbidden build segment while run cube optimize. Key: KYLIN-5002 URL: https://issues.apache.org/jira/browse/KYLIN-5002 Project: Kylin Issue Type

[jira] [Created] (KYLIN-5001) When using the "group by cube(...)" query statement, the query result is abnormal

2021-05-31 Thread Zheng Yang (Jira)
Zheng Yang created KYLIN-5001: - Summary: When using the "group by cube(...)" query statement, the query result is abnormal Key: KYLIN-5001 URL: https://issues.apache.org/jira/browse/KYLIN-5001

[jira] [Created] (KYLIN-4994) Add TOP_N cube definition validation in API?

2021-05-17 Thread zhangwusheng (Jira)
zhangwusheng created KYLIN-4994: --- Summary: Add TOP_N cube definition validation in API? Key: KYLIN-4994 URL: https://issues.apache.org/jira/browse/KYLIN-4994 Project: Kylin Issue Type: Bug

Re: Error while creating a cube on Spark engine

2021-04-26 Thread Yaqian Zhang
. My team has > been stuck in one of the issues related to Kerberos security, although, we > are not incorporating any services related to security like a Kerberos but > still getting the issue when I create the cube in Spark mode. The MapReduce > mode is working fine, through tha

Error while creating a cube on Spark engine

2021-04-25 Thread Gourav Gupta
getting the issue when I create the cube in Spark mode. The MapReduce mode is working fine, through that we were able to create the cube. The error is mentioned below : [cid:image001.png@01D73726.B28B5680] Looking for a positive response from your side. Regards, Gourav

Re: Active cube run set to pending and a new cube request is run without finishing

2021-04-23 Thread Yaqian Zhang
Hi: In my opinion, what you are describing is a normal phenomenon. When executing the cube build job, kylin will add the task of each step in the job into a map. The FetcherRunner will periodically fetch the tasks that can be executed from the map and add them to the JobPool. If it is found

Active cube run set to pending and a new cube request is run without finishing

2021-04-22 Thread xatax
I have obeserved that when the "kylin.job.max-concurrent-jobs" properties is used for a cluster configuration and set to for e.g. lets say value 1. Then for a given cube building job cluster, during a cube build if another cube build request is submitted the currently running job is set

[jira] [Created] (KYLIN-4987) Unable to build cube for JDBC MS SQL Connection

2021-04-22 Thread Lim Sing Yik (Jira)
Lim Sing Yik created KYLIN-4987: --- Summary: Unable to build cube for JDBC MS SQL Connection Key: KYLIN-4987 URL: https://issues.apache.org/jira/browse/KYLIN-4987 Project: Kylin Issue Type: Bug

[jira] [Created] (KYLIN-4986) Unable to build cube for JDBC MS SQL Connection

2021-04-22 Thread Lim Sing Yik (Jira)
Lim Sing Yik created KYLIN-4986: --- Summary: Unable to build cube for JDBC MS SQL Connection Key: KYLIN-4986 URL: https://issues.apache.org/jira/browse/KYLIN-4986 Project: Kylin Issue Type: Bug

[jira] [Created] (KYLIN-4983) The stream cube will be paused when user append a batch segment first

2021-04-20 Thread Kun Liu (Jira)
Kun Liu created KYLIN-4983: -- Summary: The stream cube will be paused when user append a batch segment first Key: KYLIN-4983 URL: https://issues.apache.org/jira/browse/KYLIN-4983 Project: Kylin

[jira] [Created] (KYLIN-4976) error java.lang.NoSuchMethodError: scala.Predef$.refArrayOps([Ljava/lang/Object;)[Ljava/lang/Object; while building sample cube

2021-04-15 Thread Gaurav Rawat (Jira)
Gaurav Rawat created KYLIN-4976: --- Summary: error java.lang.NoSuchMethodError: scala.Predef$.refArrayOps([Ljava/lang/Object;)[Ljava/lang/Object; while building sample cube Key: KYLIN-4976 URL: https

[jira] [Created] (KYLIN-4968) Error while Building the cube.

2021-04-11 Thread Malinda Peiris (Jira)
Malinda Peiris created KYLIN-4968: - Summary: Error while Building the cube. Key: KYLIN-4968 URL: https://issues.apache.org/jira/browse/KYLIN-4968 Project: Kylin Issue Type: Bug

[jira] [Created] (KYLIN-4967) Forbid to set 'spark.sql.adaptive.enabled' to true when building cube with Spark 2.X

2021-04-11 Thread Zhichao Zhang (Jira)
Zhichao Zhang created KYLIN-4967: - Summary: Forbid to set 'spark.sql.adaptive.enabled' to true when building cube with Spark 2.X Key: KYLIN-4967 URL: https://issues.apache.org/jira/browse/KYLIN-4967

[jira] [Created] (KYLIN-4965) model中使用join表中的字段作为filter过滤条件,在cube构建时报错

2021-04-08 Thread liulei_first (Jira)
liulei_first created KYLIN-4965: --- Summary: model中使用join表中的字段作为filter过滤条件,在cube构建时报错 Key: KYLIN-4965 URL: https://issues.apache.org/jira/browse/KYLIN-4965 Project: Kylin Issue Type: Bug

[jira] [Created] (KYLIN-4950) Kylin create cube error: execute get hive table rows result fail: java.lang.NumberFormatException: For input string:

2021-04-01 Thread Mingming Lee (Jira)
Mingming Lee created KYLIN-4950: --- Summary: Kylin create cube error: execute get hive table rows result fail: java.lang.NumberFormatException: For input string: Key: KYLIN-4950 URL: https://issues.apache.org/jira

[jira] [Created] (KYLIN-4949) Spark build Cube java.lang.NullPointerException

2021-03-30 Thread yukunpeng (Jira)
yukunpeng created KYLIN-4949: Summary: Spark build Cube java.lang.NullPointerException Key: KYLIN-4949 URL: https://issues.apache.org/jira/browse/KYLIN-4949 Project: Kylin Issue Type: Bug

[jira] [Created] (KYLIN-4947) Implement spark engine for cube optimization jobs

2021-03-30 Thread JiangYang (Jira)
JiangYang created KYLIN-4947: Summary: Implement spark engine for cube optimization jobs Key: KYLIN-4947 URL: https://issues.apache.org/jira/browse/KYLIN-4947 Project: Kylin Issue Type: New

[jira] [Created] (KYLIN-4946) cube planner multiple records share the same key in aggregated cuboid data for cuboid

2021-03-29 Thread yangmin luo (Jira)
yangmin luo created KYLIN-4946: -- Summary: cube planner multiple records share the same key in aggregated cuboid data for cuboid Key: KYLIN-4946 URL: https://issues.apache.org/jira/browse/KYLIN-4946

Can cube be queried while it is refreshing

2021-03-24 Thread xatax
Can a cube be queried while it is refreshing? If yes, how does it handle the switch over to the refreshed data? Can that involve downtime? Thanks! -- Sent from: http://apache-kylin.74782.x6.nabble.com/

[jira] [Created] (KYLIN-4939) Transform lookup table snapshot from segment level to cube level

2021-03-19 Thread JiangYang (Jira)
JiangYang created KYLIN-4939: Summary: Transform lookup table snapshot from segment level to cube level Key: KYLIN-4939 URL: https://issues.apache.org/jira/browse/KYLIN-4939 Project: Kylin

[jira] [Created] (KYLIN-4931) How to migrate real-time stream cube

2021-03-10 Thread Kun Liu (Jira)
Kun Liu created KYLIN-4931: -- Summary: How to migrate real-time stream cube Key: KYLIN-4931 URL: https://issues.apache.org/jira/browse/KYLIN-4931 Project: Kylin Issue Type: Improvement

Re: lambda streaming cube question

2021-03-09 Thread Yaqian Zhang
Hi: Do you find only streaming data based on the query results? You can provide some related log, if only the phenomenon description is difficult to analyze this problem. > 在 2021年3月9日,11:41,344955119 <344955...@qq.com> 写道: > > Hi,I just followed thelambda streaming

lambda streaming cube question

2021-03-08 Thread 344955119
Hi,I just followed thelambda streaming cube at http://kylin.apache.org/docs30/tutorial/lambda_mode_and_timezone_realtime_olap.html website.And I finally did not get history data merged with streaming.It is like just streaming cube without lambda now.May you give me some suggestion?

??????Question about normal cube merge streaming cube

2021-03-02 Thread 344955119
Sorry,the mail before has some wrong sentences and this is as the newest mail. Hi,I checked the log content and found my kylin table name is wrong. I solved the problem and just now I made up this cube,rebuild,but now there is only one segment from hive table.So and I can not get data from kafka

??????Question about normal cube merge streaming cube

2021-03-02 Thread 344955119
Hi,I checked the log content and found my kylin table name is wrong. I solved the problem and just now I made up this cube,rebuild,but now there is only one segment from hive table.So and I can not get data from kafka now. May you give me some aggestion? Segment Number:1Total Size:less than 1

[jira] [Created] (KYLIN-4922) Failed to build cube

2021-03-02 Thread YANG LIU (Jira)
YANG LIU created KYLIN-4922: --- Summary: Failed to build cube Key: KYLIN-4922 URL: https://issues.apache.org/jira/browse/KYLIN-4922 Project: Kylin Issue Type: Bug Components: Spark Engine

Re:Question about normal cube merge streaming cube

2021-03-01 Thread Xiaoxiang Yu
> "dev" > >发送时间:2021年2月26日(星期五) 下午5:05 >收件人:"dev" >主题:Re: Question about normal cube merge streaming cube > > > >There is no Chinese version of this document at present. >Y

?????? Question about normal cube merge streaming cube

2021-03-01 Thread 344955119
docs/tutorial/lambda_mode_and_timezone_realtime_olap.htmlgt; gt; ?? 2021??2??2316:52??344955119 <344955...@qq.comgt; ?? gt; gt; Hi, gt; gt; gt; My group is looking for a way to concat a streaming cube (realtime data) with a normal cube (history data).May be it's about the buttonamp;nbsp;"merg

?????? Question about normal cube merge streaming cube

2021-03-01 Thread 344955119
119 <344955...@qq.comgt; ?? gt; gt; Hi, gt; gt; gt; My group is looking for a way to concat a streaming cube (realtime data) with a normal cube (history data).May be it's about the buttonamp;nbsp;"merge"amp;nbsp;in visable interface ,but I found it cann't work as "mer

Cube migration across hadoop clusters: What is -updateMappingPath updateTableMapping.json

2021-02-26 Thread xatax
Per documentation: http://kylin.apache.org/docs/tutorial/cube_migration.html In the example for "II. Migrate across two Hadoop clusters" ./bin/kylin.sh org.apache.kylin.tool.migration.CubeMigrationCrossClusterCLI -kylinUriSrc ADMIN:ky...@qa.env:17070 -kylinUriDst ADMIN:ky...@prod.env:1

Re: Cube migration across hadoop clusters

2021-02-26 Thread xatax
.internal:7070 -kylinUriDst ADMIN:KYLIN@ip-172-31-91-198.ec2.internal:7070 -cube kylin_sales_cube -execute true -overwrite true -schemaOnly false Using cached dependency... OpenJDK 64-Bit Server VM warning: ignoring option MaxPermSize=512M; support was removed in 8.0 SLF4J: Class path contains multiple

Re: Question about normal cube merge streaming cube

2021-02-26 Thread Yaqian Zhang
-原始邮件-- > 发件人: > "dev" > > 发送时间:2021年2月25日(星期四) 上午10:29 > 收件人:"dev" > 主题:Re: Question about normal cube merge stre

[jira] [Created] (KYLIN-4918) Set Cube Level configuration in FilePruner

2021-02-25 Thread ShengJun Zheng (Jira)
ShengJun Zheng created KYLIN-4918: - Summary: Set Cube Level configuration in FilePruner Key: KYLIN-4918 URL: https://issues.apache.org/jira/browse/KYLIN-4918 Project: Kylin Issue Type

?????? Question about normal cube merge streaming cube

2021-02-25 Thread 344955119
ml <http://kylin.apache.org/docs/tutorial/lambda_mode_and_timezone_realtime_olap.html; ?? 2021??2??2316:52??344955119 <344955...@qq.com ?? Hi, My group is looking for a way to concat a streaming cube (realtime data) with a normal cube (history data).May be it's about the b

Re: Cube migration across hadoop clusters

2021-02-25 Thread Zhichao Zhang
Hi, please add this parameter '-schemaOnly false' in CMD '${KYLIN_HOME}/bin/kylin.sh org.apache.kylin.tool.migration.CubeMigrationCrossClusterCLI'. schemaOnly parameter specifies whether only migrate cube related schema, the default value is true, when set to false, it will migrate data too

Re: Cube migration across hadoop clusters

2021-02-25 Thread xatax
n instance on emr 5.29 with the Hbase S3 location same on both. (2) Migrate from one kylin instance on emr 5.29 to another kylin instance on emr 5.29 with Hbase s3 location different. In both ways the cube metadata/definition was migrated but not the cube data. Here is the log for (1): [hadoop@ip

Re: Question about normal cube merge streaming cube

2021-02-24 Thread Yaqian Zhang
ial/lambda_mode_and_timezone_realtime_olap.html> > 在 2021年2月23日,16:52,344955119 <344955...@qq.com> 写道: > > Hi, > > > My group is looking for a way to concat a streaming cube (realtime data) with > a normal cube (history data).May be it's about the > button"merge"in

Re: Cube migration across hadoop clusters

2021-02-24 Thread Yaqian Zhang
Hi: There are three ways of cube migration in the document of cube migration. Which one do you use? And what's your kylin version? Is the Hadoop version used by QA cluster and dev cluster consistent? Are there any errors reported during migration? > 在 2021年2月25日,03:04,xatax 写道: > >

[jira] [Created] (KYLIN-4915) 创建cube设置jdbc属性无效

2021-02-24 Thread quxiangshun (Jira)
quxiangshun created KYLIN-4915: -- Summary: 创建cube设置jdbc属性无效 Key: KYLIN-4915 URL: https://issues.apache.org/jira/browse/KYLIN-4915 Project: Kylin Issue Type: Improvement Affects Versions

Cube migration across hadoop clusters

2021-02-24 Thread xatax
Per: http://kylin.apache.org/docs/tutorial/cube_migration.html It says: "Support to migrate cube data (segments data on HBase) from QA env to PROD env." I tried the migration but it only migrates the cube metadata without the data. The source kylin instance has the cube buiilt and in r

[jira] [Created] (KYLIN-4912) Support setting parquet row group size at cube level

2021-02-23 Thread ShengJun Zheng (Jira)
ShengJun Zheng created KYLIN-4912: - Summary: Support setting parquet row group size at cube level Key: KYLIN-4912 URL: https://issues.apache.org/jira/browse/KYLIN-4912 Project: Kylin Issue

Question about normal cube merge streaming cube

2021-02-23 Thread 344955119
Hi, My group is looking for a way to concat a streaming cube (realtime data) with a normal cube (history data).May be it's about the button"merge"in visable interface ,but I found it cann't work as "merge" only supports cubes in the same model and they need to be from

STREAMING CUBE QUERY RESULT ERROR

2021-02-23 Thread 344955119
Hi, My group is looking for a way to concat a streaming cube (realtime data) with a normal cube (history data).May be it's about the button "merge" in visable interface ,but I found it cann't work as "merge" only supports cubes in the same model. In the other s

??????STREAMING CUBE QUERY RESULT ERROR

2021-02-21 Thread 344955119
Thanks.Got that?? ---- ??: "dev"

Re:STREAMING CUBE QUERY RESULT ERROR

2021-02-21 Thread Xiaoxiang Yu
"344955119" <344955...@qq.com> 写道: | Hi, I am a new studier. I am trying to build a Kylin streaming cube on single hive table. Everything seems to be fine,but then responses querying error: For input string: "4.0" while executing SQL: "select * from FRONT_DB" .

STREAMING CUBE QUERY RESULT ERROR

2021-02-21 Thread 344955119
Hi, I am a new studier. I am trying to build a Kylin streaming cube on single hive table. Everythingseems to be fine,but then responses querying error: For input string: "4.0" while executing SQL: "select * from FRONT_DB". Then I realized it may occures from "Streami

[jira] [Created] (KYLIN-4896) 构建过程中, cube metadata 丢失

2021-02-03 Thread hejian (Jira)
hejian created KYLIN-4896: - Summary: 构建过程中, cube metadata 丢失 Key: KYLIN-4896 URL: https://issues.apache.org/jira/browse/KYLIN-4896 Project: Kylin Issue Type: Bug Affects Versions: v3.1.1

  1   2   3   4   5   6   7   8   9   10   >