Re: ACID with Hive/Kylin

2023-12-11 Thread Xiaoxiang Yu
/precompute_join_relations 2. not create a bitmap measure on these columns, so these columns won't be built into dict With warm regard Xiaoxiang Yu On Tue, Dec 12, 2023 at 12:11 PM Nam Đỗ Duy wrote: > Dear Xiaoxiang, Sirs/Madams > > I face an issue with deleting data of user

Re: Pinot/Kylin/Druid quick comparision

2023-12-10 Thread Xiaoxiang Yu
replace each other. Ranger can integrate with Kerberos, please check ranger's website for information. With warm regard Xiaoxiang Yu On Sat, Dec 9, 2023 at 8:01 AM Nam Đỗ Duy wrote: > Thank you Xiaoxiang for your reply > > - > Do you have any

Re: Pinot/Kylin/Druid quick comparision

2023-12-07 Thread Xiaoxiang Yu
I guess the release date should be 2024/01 . Do you have any suggestions/wishes for kylin 5(except real-time feature)? With warm regard Xiaoxiang Yu On Thu, Dec 7, 2023 at 3:44 PM Nam Đỗ Duy wrote: > Thank you very much xiaoxiang, I did the presentation this morn

Re: Pinot/Kylin/Druid quick comparision

2023-12-06 Thread Xiaoxiang Yu
/blog/2021/07/02/Apache-Kylin4-A-new-storage-and-compute-architecture/ - https://kylin.apache.org/5.0/docs/development/roadmap With warm regard Xiaoxiang Yu On Wed, Dec 6, 2023 at 6:53 PM Nam Đỗ Duy wrote: > Hi Xiaoxiang, tomorrow is the main presentation between Ky

Re: Pinot/Kylin/Druid quick comparision

2023-12-05 Thread Xiaoxiang Yu
Done. Github branch changed to kylin5. With warm regard Xiaoxiang Yu On Tue, Dec 5, 2023 at 11:13 AM Xiaoxiang Yu wrote: > A JIRA ticket has been opened, waiting for INFRA : > https://issues.apache.org/jira/browse/INFRA-25238 . > &g

Re: Pinot/Kylin/Druid quick comparision

2023-12-04 Thread Xiaoxiang Yu
A JIRA ticket has been opened, waiting for INFRA : https://issues.apache.org/jira/browse/INFRA-25238 . With warm regard Xiaoxiang Yu On Tue, Dec 5, 2023 at 10:30 AM Nam Đỗ Duy wrote: > Thank you Xiaoxiang, please update me when you have changed your default >

Re: Pinot/Kylin/Druid quick comparision

2023-12-04 Thread Xiaoxiang Yu
them together to provide unified data analytics services for their customers. With warm regard Xiaoxiang Yu On Mon, Dec 4, 2023 at 4:01 PM Nam Đỗ Duy wrote: > Hi Xiaoxiang, thank you > > In case my client uses cloud computing service like gcp or aws, which &g

Re: Pinot/Kylin/Druid quick comparision

2023-12-03 Thread Xiaoxiang Yu
, the upfront computational cost can be amortized over each query, so it is the most economical. --- Translated with DeepL.com (free version) With warm regard Xiaoxiang Yu On Mon, Dec 4, 2023 at 3:16 PM Nam Đỗ Duy wrote: > Thank you Xiaoxiang for the near real t

Re: Pinot/Kylin/Druid quick comparision

2023-12-03 Thread Xiaoxiang Yu
that you need to run and monitor a long-running job. This feature is based on Spark Streaming, so you need knowledge of it. I am curious about what is the maximum time-lag your customers can tolerate? Personally, I guess minute level time-lag is ok for most cases. ---- With warm

Re: Pinot/Kylin/Druid quick comparision

2023-11-30 Thread Xiaoxiang Yu
. With warm regard Xiaoxiang Yu On Fri, Dec 1, 2023 at 11:11 AM Nam Đỗ Duy wrote: > Dear Xiaoxiang, > Sirs/Madams, > > May I post my boss's question: > > What are the pros and cons of the OLAP platform Kylin compared to Pinot and > Druid? > > Please kindl

Re: How to use measure of Kylin in query

2023-11-22 Thread Xiaoxiang Yu
Your summary "I write query normally to query the desired column and Kylin uses the index mechanism to accelerate query" is almost right. And I cannot understand exactly what your question is. With warm regard Xiaoxiang Yu On Wed, Nov 22, 2023 at 5:32 PM

Re: Kylin real usecase on AI/ML (data science) project

2023-11-13 Thread Xiaoxiang Yu
Yes, you are right. -- Best wishes to you ! From :Xiaoxiang Yu At 2023-11-13 17:57:59, "Nam Đỗ Duy via user" wrote: Thank you Xiaoxiang, 1. For my question of near real time data: this scenario is not about querying the cube (index), I am mentioning the query against the

Re: Kylin real usecase on AI/ML (data science) project

2023-11-13 Thread Xiaoxiang Yu
in Kylin insight window. -- Best wishes to you ! From :Xiaoxiang Yu At 2023-11-13 17:09:59, "Nam Đỗ Duy via user" wrote: Thank you Xiaoxiang for answering my previous question 1. For previous question 1, if I can ingest data near real-time into Hive table, can that nea

Re: Kylin real usecase on AI/ML (data science) project

2023-11-13 Thread Xiaoxiang Yu
ne = >>> sa.create_engine('kylin://ADMIN:KYLIN@sandbox/learn_kylin?timeout=60_debug=1') >>> sql = 'select * from kylin_sales limit 10' >>> pd.read_sql(sql, kylin_engine) ``` -- Best wishes to you ! From :Xiaoxiang Yu At 2023-11-13 16:02:20, "Nam

Re:Kylin real usecase on AI/ML (data science) project

2023-11-12 Thread Xiaoxiang Yu
I'm just curious. How much does MDX and AI/ML influenced your company's decision to use Kylin 5? Is it a nice-to-have requirement or a must-have requirement? Thanks. -- Best wishes to you ! From :Xiaoxiang Yu At 2023-11-13 15:38:17, "Xiaoxiang Yu" wrote: Do you have an

Re:Has anyone used MDX in Kylin 5.0 ?

2023-11-12 Thread Xiaoxiang Yu
Currently I think there is no such use case. -- Best wishes to you ! From :Xiaoxiang Yu At 2023-11-13 11:33:13, "Nam Đỗ Duy via user" wrote: Dear Sir/Madam I found document on MDX on Kylin 4.0 but still not found MDX on document of 5.0 Has anyone been using MDX on

Re:Kylin real usecase on AI/ML (data science) project

2023-11-12 Thread Xiaoxiang Yu
Do you have any specific business scenario? Looks like there is not such real usecase at the moment. -- Best wishes to you ! From :Xiaoxiang Yu At 2023-11-13 11:36:35, "Nam Đỗ Duy via user" wrote: Dear Sir/Madam I am persuading my company to use kylin as olap platform

Docker Image for Kylin 5.0-beta is available now

2023-09-08 Thread Xiaoxiang Yu
\ apachekylin/apache-kylin-standalone:5.0-beta docker logs --follow Kylin5-Machine Please visit https://hub.docker.com/r/apachekylin/apache-kylin-standalone for more information. -- Best wishes to you ! From :Xiaoxiang Yu

[Announce] Apache Kylin 5.0.0-beta released

2023-08-30 Thread Xiaoxiang Yu
, and to get involved, visit the project website at https://kylin.apache.org/ With warm regard Xiaoxiang Yu

Re: Kylin defaut storage system is HDFS?

2023-08-27 Thread Xiaoxiang Yu
/5.0/docs/deployment/on-premises/installation/platform/install_on_apache_hadoop With warm regard Xiaoxiang Yu On Sat, Aug 26, 2023 at 8:03 PM marc nicole wrote: > Hello, > > I have few questions regarding storage mean for Kylin: > > I was wondering if K

Re:退订

2023-08-02 Thread Xiaoxiang Yu
request-confirmation . -- Best wishes to you ! From :Xiaoxiang Yu 在 2023-08-02 16:53:32,"雷利娜" 写道: 退订 你好,由于工作原因退订所有相关的邮件。 谢谢!

Re: measure column showing 1 as values instead of the actual values in Kylin SQL Query answer table

2023-08-02 Thread Xiaoxiang Yu
:Xiaoxiang Yu At 2023-08-02 15:45:57, "李甜彪" wrote: 问题就是,维度数据每构建一次就需要变动一次,导致了前面构建的也用了最新的维度数据,但是构建时间跨天就不会有这种问题,还是维度快照的更新机制问题,怎么能解决维度数据变了,前面已经构建过的关联的维表还是当时的那种状态呢? | | 李甜彪 | | ltb1...@163.com | Replied Message | From | P.F. ZHAN | | Date | 8/2/2023 15:34 | | To | | | Su

Re:measure column showing 1 as values instead of the actual values in Kylin SQL Query answer table

2023-08-01 Thread Xiaoxiang Yu
Do you check the answer by Hive/SparkSQL, do Hive/SparkSQL give the expected answer? If you have checked, I think you can give us you cube defination(CubeDesc in Json) and the SQL statement you queried, so we can discuss in detail? -- Best wishes to you ! From :Xiaoxiang Yu At 2023

Re:kylin5.0启动报错

2023-07-28 Thread Xiaoxiang Yu
sbin/prepare-hadoop-conf-dir.sh -- Best wishes to you ! From :Xiaoxiang Yu 在 2023-07-28 18:22:30,"独忆往昔" <2788309...@qq.com> 写道: 在启动 kylin5.0的时候出错,日志显示的出错信息是 Missing hadoop conf files. Please contact Community support for more details. 请求解决。 kylin.properties中配置的内容如下图所示:

[Announce] Apache Kylin 5.0.0-alpha released

2023-04-26 Thread Xiaoxiang Yu
, and to get involved, visit the project website at https://kylin.apache.org/ With warm regard Xiaoxiang Yu

Re:Does Kylin 5.0 do not supported JDBC data source, only old version can supported?

2022-12-13 Thread Xiaoxiang Yu
in it, community developers may increase its priority. -- Best wishes to you ! From :Xiaoxiang Yu At 2022-12-13 11:34:13, "WangYong" wrote: Does Kylin 5.0 do not supported JDBC data source, only old version can supported? -Refrence--- In 5.0 Documents: Questio

Re: KYLIN自定义聚合函数

2022-11-27 Thread Xiaoxiang Yu
I think this video tutorial may be helpful. https://www.bilibili.com/video/BV1Wt4y1s7rZ -- Best wishes to you ! From :Xiaoxiang Yu 在 2022-11-27 16:56:02,"chinacsj" 写道: 能否出一点KYLIN使用的视频教程? | chinacsj 15180809...@139.com 15180809092 电子名片新出VIP模板啦,快来体验>> |

[Announce] Apache Kylin 4.0.2 released

2022-10-11 Thread Xiaoxiang Yu
to this release. We welcome your help and feedback. For more information on how to report problems, and to get involved, visit the project website at https://kylin.apache.org/ -- Best wishes to you ! From :Xiaoxiang Yu

Re:请求支持,实时消费KAFKA

2022-05-12 Thread Xiaoxiang Yu
Looks like that https://kylin.apache.org/docs31/tutorial/realtime_olap.html has provided enough information for you set up a demo. -- Best wishes to you ! From :Xiaoxiang Yu 在 2022-05-11 16:29:21,"朱杨坤" 写道: 目前在用KYLIN3.0版本,不知道怎么消费KAKFA。 1、如果您更喜欢以微批量方式摄取 kafka 事件(大约 10 分钟级别的

Re:kylin Software Requirements

2022-05-12 Thread Xiaoxiang Yu
Hi, I suggest you to check our doc : https://cwiki.apache.org/confluence/display/KYLIN/Support+Hadoop+Version+Matrix+of+Kylin+4 .You can try Kylin 4.0.1-spark3 package. -- Best wishes to you ! From :Xiaoxiang Yu At 2022-05-12 23:43:51, "Gao Michael" wrote:

Re:kylin start incorrect

2022-03-28 Thread Xiaoxiang Yu
Have you ever this wiki : https://cwiki.apache.org/confluence/display/KYLIN/Support+Hadoop+Version+Matrix+of+Kylin+4 ? -- Best wishes to you ! From :Xiaoxiang Yu At 2022-03-26 17:31:02, "Gao Michael" wrote: Hi all I’m new to kylin. I’ve download and install kylin4, an

Re:Trying to add an implementation: MINIO as metadata

2022-03-01 Thread Xiaoxiang Yu
Yes, you are right. -- Best wishes to you ! From :Xiaoxiang Yu 在 2022-03-01 18:19:19,"guqiujun" 写道: There are currently two implementations of kylin4.x metadata databases. MYSQL and HBASE. I am trying to add an implementation: MINIO as metadata , just need to

Re: How to UNSUBSCRIBING

2022-01-11 Thread Xiaoxiang Yu
...@kylin.apache.org,发送此类“退订”文字到 user@kylin.apache.org 或者 d...@kylin.apache.org 无法使你不再接受此邮件组的邮件!! FURTHER READING https://www.apache.org/foundation/mailinglists.html https://infra.apache.org/contrib-email-tips -- Best wishes to you ! From :Xiaoxiang Yu 在 2022-01-11 17:18:18,"jiang_wen...@16

Re:[DISCUSS] The future of Apache Kylin

2022-01-10 Thread Xiaoxiang Yu
is Ready without purge the any useful cuboid/segmemnt . -- Best wishes to you ! From :Xiaoxiang Yu At 2022-01-11 13:59:13, "Li Yang" wrote: >Hi All > >Apache Kylin has been stable for quite a while and it may be a good time to >think about the future of it. Below are

Re:退订

2022-01-10 Thread Xiaoxiang Yu
-unsubscr...@kylin.apache.org,发送此类退订邮件到 @user@kylin.apache.org 或者 @d...@kylin.apache.org 无法使你不再接受此邮件组的邮件。 -- Best wishes to you ! From :Xiaoxiang Yu 在 2022-01-07 09:04:21,"Liu Ya Meng"

CVE-2021-31522: Apache Kylin unsafe class loading

2022-01-06 Thread Xiaoxiang Yu
. Mitigation: Users of Kylin 2.x & Kylin 3.x should upgrade to 3.1.3 or apply patch https://github.com/apache/kylin/pull/1695. Users of Kylin 4.x should upgrade to 4.0.1 or apply patch https://github.com/apache/kylin/pull/1763. Credit: bo yu-- Best wishes to you ! From :Xiaoxiang Yu

CVE-2021-27738: Apache Kylin: Improper Access Control to Streaming Coordinator & SSRF

2022-01-06 Thread Xiaoxiang Yu
prior to 3.1.2. Mitigation: Users of Kylin 3.x should upgrade to 3.1.3 or apply patch https://github.com/apache/kylin/pull/1646. Credit: Wei Lin Ngo -- Best wishes to you ! From :Xiaoxiang Yu

CVE-2021-45456: Apache Kylin: Command injection

2022-01-06 Thread Xiaoxiang Yu
: Alvaro Munoz -- Best wishes to you ! From :Xiaoxiang Yu

CVE-2021-36774: Apache Kylin: Mysql JDBC Connector Deserialize RCE

2022-01-06 Thread Xiaoxiang Yu
edit: jinchen sheng -- Best wishes to you ! From :Xiaoxiang Yu

CVE-2021-45458: Apache Kylin: Hardcoded credentials

2022-01-06 Thread Xiaoxiang Yu
gure the value of `kylin.security.encrypt.cipher.ivSpec` in kylin.properties for encryption algorithm, and then re-encrypt the password they need to encrypt. Credit: Alvaro Munoz -- Best wishes to you ! From :Xiaoxiang Yu

[Announce] Apache Kylin 3.1.3 released

2022-01-06 Thread Xiaoxiang Yu
to this release. We welcome your help and feedback. For more information on how to report problems, and to get involved, visit the project website at https://kylin.apache.org/ -- Best wishes to you ! From :Xiaoxiang Yu

[Announce] Apache Kylin 4.0.1 released

2022-01-06 Thread Xiaoxiang Yu
help and feedback. For more information on how to report problems, and to get involved, visit the project website at https://kylin.apache.org/ -- Best wishes to you ! From :Xiaoxiang Yu

Re: maozhaolin

2021-11-02 Thread Xiaoxiang Yu
Hi, Unfortunately, there is no such tools to do migration for global dictionary, you have to rebuild the cube and delete old ones. -- Xiaoxiang Yu 在 2021-11-02 17:34:28,"maozhaolin" 写道: 您好,我这边在kylin的使用中,初始是使用了kylin本身的job server进行的字典构建,但是现在遇到瓶

Re:Problem with CUBING data

2021-10-20 Thread Xiaoxiang Yu
Hello, I am glad to see that you are willing to choose and try Kylin to serve your data analysis, and I can understand the pain you sufferred waiting cubing finished in past week. To narrow it down , we gonna need more information. I think maybe slack is good place to share and discuss

Re:cube卡在构建字典

2021-10-18 Thread Xiaoxiang Yu
Please provided more detail to let us has enough background to analyse the root cause: 1. Kylin logs, 2. Kylin version, 3. input records count, 4. all measures in your cube, 5. gc information and so on 在 2021-10-18 13:25:59,"maozhaolin" 写道: cube构建时,一直卡在build dimension

[Announce] Apache Kylin 4.0.0 released

2021-08-30 Thread Xiaoxiang Yu
or RESTful API. Thanks to everyone who has contributed to this release. We welcome your help and feedback. For more information on how to report problems, and to get involved, visit the project website at https://kylin.apache.org/ -- Best wishes to you ! From :Xiaoxiang Yu

Re: Kylin 4.0 error in the first step of building cube

2021-08-25 Thread Xiaoxiang Yu
On each hadoop platform/env we tested, we do NOT use the spark provided by env(HDP, CDH or AWS EMR), but download specific version of Apache Spark. For CDH 6.2, we use Apache Spark 3.1.1 (and I think Spark 2.4.6 should works as well). -- Best wishes to you ! From :Xiaoxiang Yu At 2021-08

Re:Kylin 4.0 error in the first step of building cube

2021-08-25 Thread Xiaoxiang Yu
choose to use our recommended hadoop platform. -- Best wishes to you ! From :Xiaoxiang Yu 在 2021-08-25 15:38:25,"washyou112" 写道: Kylin 4.0 error in the first step of building cube kylin.log: 2021-08-24 10:45:00,232 ERROR [Thread-1] application.JobMonitor : Job failed t

[Event] ApacheCon Asia Coming to your living room this August!

2021-08-05 Thread Xiaoxiang Yu
are free to register at one of our three optional donation levels, $10, $20, or $50, to help support the event, and the Apache Software Foundation. -- Best wishes to you ! From :Xiaoxiang Yu

Re: Kylin Docker on Windows 10 fails #139

2021-06-20 Thread Xiaoxiang Yu
Hi, I have tested and reply you on the link : https://stackoverflow.com/questions/67126007/apache-kylin-docker-image-fails-to-start. Hope my answer can help to solve your problem. -- Best wishes to you ! From :Xiaoxiang Yu At 2021-06-19 02:46:35, "Harsh V.Bhaiya" wrote: &g

Re:streaming storage

2021-06-02 Thread Xiaoxiang Yu
Hi , If you want to remove wrong data (in specific time range), please consider using Lambda streaming cube to do so. Please check http://kylin.apache.org/docs/tutorial/lambda_mode_and_timezone_realtime_olap.html . -- Best wishes to you ! From :Xiaoxiang Yu At 2021-05-27

[Announce] Apache Kylin 3.1.2 released

2021-04-28 Thread Xiaoxiang Yu
to this release. We welcome your help and feedback. For more information on how to report problems, and to get involved, visit the project website at https://kylin.apache.org/ - Best wishes to you ! From :Xiaoxiang Yu

Re:Mandatory Cuboids

2021-04-27 Thread Xiaoxiang Yu
Should be the format of export function in cube planner( I guess it is json format), please check http://kylin.apache.org/docs/tutorial/use_cube_planner.html if you are not familiar with cube planner. - --Best wishes to you ! From :Xiaoxiang Yu 在 2021-04-27 14:31:43,"zy

[Announce] Apache Kylin 4.0.0-beta released

2021-02-07 Thread Xiaoxiang Yu
contributed to this release. We welcome your help and feedback. For more information on how to report problems, and to get involved, visit the project website at https://kylin.apache.org/ . -- Best wishes to you ! From :Xiaoxiang Yu

Re:Error in Load HFile to HBase Table - "Message missing required fields: bulk_token"

2021-01-27 Thread Xiaoxiang Yu
Have you ever try to use sample cube(http://kylin.apache.org/docs/tutorial/kylin_sample.html) to verify compatiblity? Maybe Kylin is not compatible with your hadoop version. -- Best wishes to you ! From :Xiaoxiang Yu At 2021-01-27 20:22:36, "Kumar, Priyanshu" wrote: >Hi T

Re:query result is not consistence

2021-01-07 Thread Xiaoxiang Yu
Hi, Have you ever check "Why I got an error when running a “select * “ query?" in Kylin FAQ? Check this link : http://kylin.apache.org/docs/gettingstarted/faq.html. -- Best wishes to you ! From :Xiaoxiang Yu 在 2021-01-06 14:53:35,"刘波" <1091643...@qq.com> 写道: d

Re: kafka table cube build, first step error

2020-12-21 Thread Xiaoxiang Yu
Please check https://issues.apache.org/jira/browse/KYLIN-3970 . -- Best wishes to you ! From :Xiaoxiang Yu 在 2020-12-21 20:02:53,"刘波" <1091643...@qq.com> 写道: Env kylin apache-kylin-3.1.1-bin-hadoop3 | HDFS | 3.1.1 | | YARN | 3.1.1 | | MapReduce2 | 3.1.1 | | Hive | 3.1.0 |

Re: Performance tunning guide for Kylin 4

2020-11-05 Thread Xiaoxiang Yu
have any question. Here is the link of tunning guide : https://cwiki.apache.org/confluence/display/KYLIN/How+to+improve+cube+building+and+query+performance . -- Best wishes to you ! From :Xiaoxiang Yu At 2020-09-12 16:31:50, "Ivan Georgiev" wrote: >Hi all, >as I r

Re:Kylin-Spark Cube Build Issue

2020-10-22 Thread Xiaoxiang Yu
Hi, did you set/export SPARK_HOME in your system variable? -- Best wishes to you ! From :Xiaoxiang Yu At 2020-10-22 20:28:01, "Kumar, Priyanshu" wrote: >Hi Team, > >I have installed and setup Kylin on my HDP 2.6 cluster as per the Kylin >documentation. I am able to

[SECURITY][CVE-2020-13937] Unauthenticated Configuration Disclosure

2020-10-19 Thread Xiaoxiang Yu
, restart all Kylin instances to make it effective. Otherwise, you can upgrade Kylin to 3.1.1. Credit: This issue was discovered by Ngo Wei Lin (@Creastery) of STAR Labs (@starlabs_sg). -- Best wishes to you ! From :Xiaoxiang Yu

[Announce] Apache Kylin 3.1.1 released

2020-10-18 Thread Xiaoxiang Yu
to this release. We welcome your help and feedback. For more information on how to report problems, and to get involved, visit the project website at https://kylin.apache.org/ -- Best wishes to you ! From :Xiaoxiang Yu

Re:来自li_cong521的邮件

2020-10-07 Thread Xiaoxiang Yu
Hi, Are you using Kylin4.0.0-alpha? As far as I know, CardinalityExecutable is removed in Kylin4. If so, this error message can be ignored and I guess it will be removed in next release. -- Best wishes to you ! From :Xiaoxiang Yu At 2020-10-05 16:14:34, "li_cong521&qu

Re:关于hadoop3文件访问的bug

2020-09-08 Thread Xiaoxiang Yu
Hi, As far as I know, Kylin did not support Hive3 ACID table offically. Maybe you turn off ACID feature as a workaround. (I guess you are using Hive3) -- Best wishes to you ! From :Xiaoxiang Yu 在 2020-09-08 15:33:38,"wuguo1501" 写道: 在使用kylin3访问hive3的表时,一直会报

Re:Connection leak when using S3

2020-07-21 Thread Xiaoxiang Yu
to connection leak issue, am I right? If you think it is a connection leak issue which maybe cause by other reason, please let us know your network stats information, maybe command output of "netstat -anp" ? Good luck to you! -- Best wishes to you ! From :Xiaoxiang Yu At 2020-07-2

Re:Documentation to test early versions of Kylin on Parquet v2

2020-06-26 Thread Xiaoxiang Yu
/wiki). The dev team is still doing test so there is no binary provided at the moment. They will find a right time to share a tech pre-review version, keep tuned! -- Best wishes to you ! From :Xiaoxiang Yu At 2020-06-24 21:27:13, "hubert stefani" wrote: Hi, After th

Re:erros on building cube in kylin

2020-05-06 Thread Xiaoxiang Yu
Hi, Have you ever check this doc : http://kylin.apache.org/docs/install/configuration.html#mr-config-override and increase the heap of Mapper or Reducer? -- Best wishes to you ! From :Xiaoxiang Yu At 2020-05-06 19:45:43, "我是天才" <50308...@qq.com> wrote: He

Re:Streaming Table kafka parsing, parsing json string

2020-04-17 Thread Xiaoxiang Yu
Hi, Both Near Real-time Streaming and Realtime OLAP support such case (data structure: Map) in the latest version, https://issues.apache.org/jira/browse/KYLIN-3942. -- Best wishes to you ! From :Xiaoxiang Yu 在 2020-04-17 11:53:55,"a773807...@gmail.com" 写道: h

Re:Building Cubes with UHC Dimmensions

2020-04-12 Thread Xiaoxiang Yu
n share us your opinion on this feature. -- Best wishes to you ! From :Xiaoxiang Yu At 2020-04-11 17:26:39, "Fatemeh Ahmadi" wrote: Dear Sir/Madam, I am using Apache Kylin and I have multiple real UHC dimensions (unfortunately I can not remove them) and because of that

Re:webui出不来

2020-04-12 Thread Xiaoxiang Yu
Dear friend, Please try to check the content of $KYLIN_HOME/logs/kylin.out,$KYLIN_HOME/tomcats/logs/*.log. I think you will find some error messages. Please find and share the error message with us. -- Best wishes to you ! From :Xiaoxiang Yu 在 2020-04-13 10:29:05,"

Re:Failed to read big resource /dict/KYLIN.HIVE_METRICS_QUERY_CUBE_QA/CUBE_NAME/xxx.dict

2020-02-18 Thread Xiaoxiang Yu
side. Here is some advice provided by apache website: 1. http://www.catb.org/~esr/faqs/smart-questions.html, 2. http://www.apache.org/dev/contrib-email-tips . -- Best wishes to you ! From :Xiaoxiang Yu 在 2020-02-18 19:43:15,"shylinzhang" 写道: Hi Xiaoxiang, I

Re:Failed to read big resource /dict/KYLIN.HIVE_METRICS_QUERY_CUBE_QA/CUBE_NAME/xxx.dict

2020-02-17 Thread Xiaoxiang Yu
e "delete" to delete that empty entry. Before doing this, I think you should back up your metadata. -- Best wishes to you ! From :Xiaoxiang Yu 在 2020-02-17 10:44:23,"shylinzhang" 写道: Hi George, Thank you for your reply, I tried to delete the remaining marker, i

Re: [Discuss] Add webhook to Kylin

2020-02-05 Thread Xiaoxiang Yu
ocalhost: -- Best wishes to you ! From :Xiaoxiang Yu At 2020-02-05 10:03:13, "codingforfun" wrote: I think we can refer to the implementation of spark lis

Re:Questions About Force Hit Cube or Hybrid Feature

2020-01-21 Thread Xiaoxiang Yu
could have a better idea in the future. -- Best wishes to you ! From :Xiaoxiang Yu At 2020-01-21 15:21:58, "毛洪玥" wrote: Hi all, Recently we has gone live "Force Hit Cube or Hybrid" feature both back-end and front-end based on issue KYLIN-4312 which sol

Re:[Discuss] Add webhook to Kylin

2020-01-20 Thread Xiaoxiang Yu
It looks good, and it should be useful for IT team, please go ahead! -- Best wishes to you ! From :Xiaoxiang Yu At 2020-01-20 19:58:40, "Zhou Kang" wrote: Hi Kylin users & developers: Many apps support webhook, it is one way that apps can send autom

Re: intersect_value raise error

2020-01-13 Thread Xiaoxiang Yu
Thank you for your suggestion, I think it is very valuable. Currently, doc's maintainer choose to use "/docs" as url for the LATEST documentation, and "/docsxx" (such as /docs24) as url for the specific version. -- Best wishes to you ! From :Xiaoxiang Yu At 2020

Re:[Discuss] Reposition Kylin as "Analytical Data warehouse for big data"

2020-01-12 Thread Xiaoxiang Yu
+1 Great suggestion. And I wish in the future, Kylin could support more and more data source and provided better performance when build segment . -- Best wishes to you ! From :Xiaoxiang Yu At 2020-01-12 20:32:12, "ShaoFeng Shi" wrote: Hello, Kylin developers and users,

Re:intersect_value raise error

2020-01-12 Thread Xiaoxiang Yu
Hi friend, As far as I know, intersect_value is not available at the moment. I guess it is not very easy to implement it because this feature need a bidirectional global dictionary. -- Best wishes to you ! From :Xiaoxiang Yu At 2020-01-13 13:47:21, "ZF" <310866...@qq.co

Re: 构建cube的第一步到了如下错误, 版本 apache-kylin-2.6.4-bin-cdh60.tar.gz

2019-12-09 Thread Xiaoxiang Yu
ect value for dfs.encryption.key.provider.uri? I think you should copy the SQL generated by Kylin and pasted them into Hive CLI, and change your configuration with Hive and HDFS to ensure sql can be executed successfully. Best wishes, Xiaoxiang Yu 发件人: 欧阳苗 答复: "user@kylin.apache.org

Re: Releasing Apache Kylin v3.0-GA

2019-12-05 Thread Xiaoxiang Yu
Good news, I cannot wait to the next generation of Kylin. Best wishes, Xiaoxiang Yu 发件人: George Ni 答复: "user@kylin.apache.org" 日期: 2019年12月6日 星期五 10:25 收件人: "user@kylin.apache.org" , "d...@kylin.apache.org" 主题: Releasing Apache Kylin v3.0

Re: Error on EMR

2019-12-05 Thread Xiaoxiang Yu
Hi Tanmay, Thank you for your update, and I am glad to hear that you have finally fixed your issue. Best wishes, Xiaoxiang Yu 发件人: Tanmay Movva 日期: 2019年12月6日 星期五 01:51 收件人: Xiaoxiang Yu 主题: Re: Error on EMR Hey Xiaoxiang, Thank you so much. This worked for me. Also

Re: Need advice and best practices for Kylin query tuning (not cube tuning)

2019-12-01 Thread Xiaoxiang Yu
-a6e8-d6f9-cd50-152b4d7b0c5a-62] service.QueryService:491 : Stats of SQL response: isException: false, duration: 21170, total scan count 1565099 Best wishes, Xiaoxiang Yu 发件人: Andras Nagy 答复: "user@kylin.apache.org" 日期: 2019年11月28日 星期四 21:06 收件人: "user@kylin.apache

Re: [ANNOUNCE] Please welcome Chunen Ni to the Apache Kylin PMC

2019-12-01 Thread Xiaoxiang Yu
Congratulation! Wish to hear more voice from you! Best wishes, Xiaoxiang Yu 发件人: Wang rupeng 答复: "user@kylin.apache.org" 日期: 2019年12月2日 星期一 09:48 收件人: "user@kylin.apache.org" 主题: Re: [ANNOUNCE] Please welcome Chunen Ni to the Apache Kylin PMC Gr

Re: Error in the third step of building cube

2019-11-15 Thread Xiaoxiang Yu
ace inside MapReduce container. That will let you know what actually happen. And it is consider to change the MR related config by http://kylin.apache.org/docs/install/configuration.html#mr-config-override . ---- Best wishes, Xiaoxiang Yu 发件人: 1037474325 <1037474...@qq.com>

Re: 回复: The results return some fields empty. But when I tried in hive with the same query, I got what I wanted to get.

2019-11-13 Thread Xiaoxiang Yu
Hi friend, Do you deploy you Kylin on Hadoop3 env like HDP3? And are your dimension table an ACID transaction table? Best wishes, Xiaoxiang Yu 发件人: 梅秋莹 <3281438...@qq.com> 答复: "user@kylin.apache.org" 日期: 2019年11月13日 星期三 19:19 收件人: user 主题: 回复: The res

Re: 转发: kafka数据到kylin,构建cube时报错

2019-11-13 Thread Xiaoxiang Yu
Dear sir, We have face the same issue on HDP3.x, and I have find a workaround at [Try-2] of https://issues.apache.org/jira/browse/KYLIN-3970, you may have a try. Best wishes, Xiaoxiang Yu 发件人: "gaofeng5...@capinfo.com.cn" 答复: "user@kylin.apache.org"

Re: A question about the hierarchy dimension in kylin

2019-11-05 Thread Xiaoxiang Yu
org.apache.kylin.engine.mr.common.CubeStatsReader [cubeName]” 5. Other information which may help us to reproduce this mistake. Best wishes, Xiaoxiang Yu 发件人: changji guo 答复: "user@kylin.apache.org" 日期: 2019年11月5日 星期二 19:27 收件人: "user@kylin.apache.org" 主题: A question about the

Re: 回复: 关于Apache kylin 支持Hadoop 版本的问题

2019-10-31 Thread Xiaoxiang Yu
is a global organization, using formal English is preferred. Thank you. Best wishes, Xiaoxiang Yu 发件人: 1510603449 答复: "user@kylin.apache.org" 日期: 2019年10月31日 星期四 15:47 收件人: user 主题: 回复: 关于Apache kylin 支持Hadoop 版本的问题 大佬, 请问你们使用的是哪一个版本kylin呢? 我们的版本情况如下:

Re: 关于Apache kylin 支持Hadoop 版本的问题

2019-10-31 Thread Xiaoxiang Yu
/generic-package-rhel64-6-0/topdir/BUILD/hive-1.1.0-cdh5.7.6 -r Unknown Compiled by jenkins on Tue Feb 21 14:49:03 PST 2017 From source with checksum 2e88d4c1b4053829c847d58bf016afd1 Best wishes, Xiaoxiang Yu 发件人: 1510603449 答复: "user@kylin.apache.org" 日期: 2019年10月31日 星期

Re: kylin#2 Step Error

2019-10-29 Thread Xiaoxiang Yu
n just use “kylin.source.hive.redistribute-flat-table” to skip step2, I think it should work(but not a good practice). Best wishes, Xiaoxiang Yu 发件人: 冯腾 答复: "user@kylin.apache.org" 日期: 2019年10月29日 星期二 14:26 收件人: "user@kylin.apache.org" 主题: kylin#2 Step Error Error # 2 Step e

Re: Re: can I read or write "Extract Fact Table Distinct Columns" result to somewhere

2019-10-21 Thread Xiaoxiang Yu
/howto_use_hive_mr_dict.html . Best wishes, Xiaoxiang Yu 发件人: lk_hadoop 答复: "user@kylin.apache.org" 日期: 2019年10月21日 星期一 16:11 收件人: "user@kylin.apache.org" 主题: Re: Re: can I read or write "Extract Fact Table Distinct Columns" result to somewhere thank

Re: web ui error on apache-kylin-3.0.0-alpha2-bin-cdh60, issue reporting and workaround

2019-10-18 Thread Xiaoxiang Yu
not face the class miss problem. We will consider check in more newer version of CDH. We will be glad if hear more suggestion from you in the future. Best wishes, Xiaoxiang Yu 发件人: Jiajing Li 答复: "user@kylin.apache.org" 日期: 2019年10月17日 星期四 11:23 收件人: user 主题: we

Re: global dictionary scople

2019-09-26 Thread Xiaoxiang Yu
-global-dict.html and https://blog.bcmeng.com/post/kylin-distinct-count.html and https://hexiaoqiao.github.io/blog/2016/11/27/exact-count-and-global-dictionary-of-apache-kylin/ for further information. Best wishes, Xiaoxiang Yu 发件人: "shicheng31...@gmail.com"

Re: Real-time OLAP - NPE in stream receiver when processing event

2019-09-04 Thread Xiaoxiang Yu
Hi Andras, Thank you for your collaboration and bravery. I will be happy if I could hear your suggestion in the future. Best wishes, Xiaoxiang Yu 发件人: Andras Nagy 日期: 2019年9月4日 星期三 17:04 收件人: Xiaoxiang Yu 抄送: "user@kylin.apache.org" 主题: Re: Real-time OLAP - NPE

Re: 回复: fail to open web -- exception class path resource[ehcache-test.xml] cannot be opened because it does not exist

2019-09-04 Thread Xiaoxiang Yu
ation -XX:NumberOfGCLogFiles=10 -XX:GCLogFileSize=64M" Best wishes, Xiaoxiang Yu 发件人: 奥威软件 <3513797...@qq.com> 答复: "user@kylin.apache.org" 日期: 2019年9月4日 星期三 16:53 收件人: user 主题: 回复: fail to open web -- exception class path resource[ehcache-test.xml] cannot

Re: Real-time OLAP - NPE in stream receiver when processing event

2019-09-03 Thread Xiaoxiang Yu
Hi Andras, Count distinct(Bitmap) for String type is under development, we hope to release it at 3.0.0-beta. If you are interested, maybe you could help us review this PR (https://github.com/apache/kylin/pull/804). Best wishes, Xiaoxiang Yu 发件人: Chao Long 答复: "

Re: Real-time OLAP - NPE in StreamingBuildJobStatusChecker

2019-09-03 Thread Xiaoxiang Yu
. Best wishes, Xiaoxiang Yu 发件人: Andras Nagy 答复: "user@kylin.apache.org" 日期: 2019年9月3日 星期二 15:47 收件人: "user@kylin.apache.org" 主题: Real-time OLAP - NPE in StreamingBuildJobStatusChecker Dear All, We have run into an issue releated to the real-time OLAP fe

Re: Error: Failed to find metadata store by url: kylin_metadata@hbase

2019-09-03 Thread Xiaoxiang Yu
ld provide us with more message for detailed analysis, such as kylin.properties and full kylin.log. Thank you. If you use Kylin for the first time and you are familiar with Docker, maybe you can run a docker container to have a technical preview. Please refer to http://kylin.apache.or

Re: Unable to create cube in Spark Mode -Apache Kylin on Cloudera

2019-08-30 Thread Xiaoxiang Yu
etc. Following screenshot is a gateway node in my test env. [cid:image001.png@01D55F66.D07C07F0] Best wishes, Xiaoxiang Yu 发件人: Wang rupeng 答复: "user@kylin.apache.org" 日期: 2019年8月30日 星期五 15:31 收件人: Gourav Gupta , "user@kylin.apache.org" 主题: Re: Unable to

Re: Failed to read big resource /dict/xxxx

2019-08-30 Thread Xiaoxiang Yu
f found. And I want to say thank you to issue's reporter for their patience and assistance. If anyone find any mistake, please let me know. Thank you. ---- Best wishes, Xiaoxiang Yu 发件人: Johnson 答复: "user@kylin.apache.org" 日期: 2019年8月29日 星期四 21:44 收件人: Wang rupeng 抄送: &

Re: kylin 查询性能

2019-08-30 Thread Xiaoxiang Yu
Dear Katte For response time/benchmark of Kylin query, please refer to https://github.com/Kyligence/ssb-kylin & https://github.com/Kyligence/kylin-tpch . Best wishes, Xiaoxiang Yu 发件人: Katte 答复: "user@kylin.apache.org" 日期: 2019年8月30日 星期五 13

  1   2   >