[jira] [Commented] (KYLIN-5283) JobWorker execute方法无法捕获原始异常

2022-10-30 Thread liyang (Jira)
[ https://issues.apache.org/jira/browse/KYLIN-5283?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17626226#comment-17626226 ] liyang commented on KYLIN-5283: --- 值得修复,来个PR? > JobWorker execute方法无法捕获原始异常 > --- >

[jira] [Commented] (KYLIN-5286) Improve QueryConnection.getConnection?

2022-10-30 Thread liyang (Jira)
[ https://issues.apache.org/jira/browse/KYLIN-5286?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17626223#comment-17626223 ] liyang commented on KYLIN-5286: --- The QueryConnection is a lightweight object by design. That means there is

[jira] [Commented] (KYLIN-5286) Improve QueryConnection.getConnection?

2022-10-30 Thread liyang (Jira)
[ https://issues.apache.org/jira/browse/KYLIN-5286?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17626216#comment-17626216 ] liyang commented on KYLIN-5286: --- Technically, cache is always possible, at the cost of designing how to

[jira] [Commented] (KYLIN-5279) Default null collation for Kylin5.0 sqls should be null-last for ASC order and null-first for DESC order.

2022-10-22 Thread liyang (Jira)
[ https://issues.apache.org/jira/browse/KYLIN-5279?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17622601#comment-17622601 ] liyang commented on KYLIN-5279: --- NULL is smaller or larger? It depends. The answe depends on the SQL

[jira] [Commented] (KYLIN-5278) Support Pivot feature of SQL

2022-10-22 Thread liyang (Jira)
[ https://issues.apache.org/jira/browse/KYLIN-5278?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17622600#comment-17622600 ] liyang commented on KYLIN-5278: --- So PIVOT function gets +1 Let's see it will get more votes. > Support

[jira] [Commented] (KYLIN-5267) force limit to protect the service when SQL has no limit

2022-10-01 Thread liyang (Jira)
[ https://issues.apache.org/jira/browse/KYLIN-5267?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17612011#comment-17612011 ] liyang commented on KYLIN-5267: --- If what you need is something beyond the above two configs, feel free to

[jira] [Commented] (KYLIN-5268) kylin4.0.1服务每天都会内存溢出java.lang.OutOfMemoryError: Java heap space

2022-10-01 Thread liyang (Jira)
[ https://issues.apache.org/jira/browse/KYLIN-5268?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17612010#comment-17612010 ] liyang commented on KYLIN-5268: --- > 如果tableau发出的奇怪sql不多固定,似乎修改源码的

[jira] [Commented] (KYLIN-5267) force limit to protect the service when SQL has no limit

2022-10-01 Thread liyang (Jira)
[ https://issues.apache.org/jira/browse/KYLIN-5267?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17612009#comment-17612009 ] liyang commented on KYLIN-5267: --- As a result of KYLIN-2649, a config parameter called

[jira] [Commented] (KYLIN-5272) The "case when" command may cause the field value to be different from the user's expectation.

2022-10-01 Thread liyang (Jira)
[ https://issues.apache.org/jira/browse/KYLIN-5272?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17612006#comment-17612006 ] liyang commented on KYLIN-5272: --- Could you provide a complete SQL and related table structure, such that

[jira] [Commented] (KYLIN-5263) replace log4j with logback

2022-09-15 Thread liyang (Jira)
[ https://issues.apache.org/jira/browse/KYLIN-5263?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17605544#comment-17605544 ] liyang commented on KYLIN-5263: --- 有没有办法评估一下换成 logback 能提升多少? any estimate of the improvement after change

[jira] [Commented] (KYLIN-5253) Is there any plan to add field processing method

2022-09-12 Thread liyang (Jira)
[ https://issues.apache.org/jira/browse/KYLIN-5253?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17602996#comment-17602996 ] liyang commented on KYLIN-5253: --- any of these work? * SUBSTRING(string FROM integer1 FOR integer2) *

[jira] [Commented] (KYLIN-5255) UTF-8 column name support

2022-09-12 Thread liyang (Jira)
[ https://issues.apache.org/jira/browse/KYLIN-5255?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17602992#comment-17602992 ] liyang commented on KYLIN-5255: --- Nice improvement suggestion.  > UTF-8 column name support >

[jira] [Commented] (KYLIN-5259) Support DAY*, WEEK*, MONTH*, YEAR* functions from SQL

2022-09-12 Thread liyang (Jira)
[ https://issues.apache.org/jira/browse/KYLIN-5259?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17602983#comment-17602983 ] liyang commented on KYLIN-5259: --- try * DAYOFYEAR(date) * DAYOFMONTH(date) * DAYOFWEEK(date) *

[jira] [Commented] (KYLIN-5258) kylin5 HiveMetaStore

2022-09-12 Thread liyang (Jira)
[ https://issues.apache.org/jira/browse/KYLIN-5258?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17602978#comment-17602978 ] liyang commented on KYLIN-5258: --- There must be deeper cause (likely caused by) not mentioned in the log.

[jira] [Commented] (KYLIN-5261) Suggest to add group owner to identify the usergoup's owner

2022-09-12 Thread liyang (Jira)
[ https://issues.apache.org/jira/browse/KYLIN-5261?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17602977#comment-17602977 ] liyang commented on KYLIN-5261: --- Good idea. Code commit is welcome.  :) > Suggest to add group owner to

[jira] [Updated] (KYLIN-5246) long running job's log staying in mem, may cause job server oom

2022-09-03 Thread liyang (Jira)
[ https://issues.apache.org/jira/browse/KYLIN-5246?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] liyang updated KYLIN-5246: -- Summary: long running job's log staying in mem, may cause job server oom (was: long running jobs may cause

[jira] [Commented] (KYLIN-5246) long running jobs may cause memory problems in the job server

2022-09-03 Thread liyang (Jira)
[ https://issues.apache.org/jira/browse/KYLIN-5246?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17599820#comment-17599820 ] liyang commented on KYLIN-5246: ---  Good suggestion! > long running jobs may cause memory problems in the

[jira] [Commented] (KYLIN-5230) The bug from change password

2022-08-18 Thread liyang (Jira)
[ https://issues.apache.org/jira/browse/KYLIN-5230?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17581445#comment-17581445 ] liyang commented on KYLIN-5230: --- Nice suggestion and thanks for the report! > The bug from change password

[jira] [Commented] (KYLIN-5114) Build cube error:java.lang.NoSuchMethodError

2022-08-18 Thread liyang (Jira)
[ https://issues.apache.org/jira/browse/KYLIN-5114?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17581443#comment-17581443 ] liyang commented on KYLIN-5114: --- 通常是数据量太大了,超过了集群现有的资源负载范围,建议用小数据量先试试。   对数据量和所需的资源有数了以后,也可以用人工指定 spark

[jira] [Commented] (KYLIN-5231) RuntimeException in cube build with Spark engine

2022-08-18 Thread liyang (Jira)
[ https://issues.apache.org/jira/browse/KYLIN-5231?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17581442#comment-17581442 ] liyang commented on KYLIN-5231: --- Most likely a env problem. Is this set of env used to work? Or it is a

[jira] [Updated] (KYLIN-5114) Build cube error:java.lang.NoSuchMethodError

2022-08-16 Thread liyang (Jira)
[ https://issues.apache.org/jira/browse/KYLIN-5114?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] liyang updated KYLIN-5114: -- Labels: Question (was: ) > Build cube error:java.lang.NoSuchMethodError >

[jira] [Updated] (KYLIN-5114) Build cube error:java.lang.NoSuchMethodError

2022-08-16 Thread liyang (Jira)
[ https://issues.apache.org/jira/browse/KYLIN-5114?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] liyang updated KYLIN-5114: -- Issue Type: Task (was: Bug) > Build cube error:java.lang.NoSuchMethodError >

[jira] [Comment Edited] (KYLIN-5114) Build cube error:java.lang.NoSuchMethodError

2022-08-16 Thread liyang (Jira)
[ https://issues.apache.org/jira/browse/KYLIN-5114?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17580400#comment-17580400 ] liyang edited comment on KYLIN-5114 at 8/16/22 4:41 PM:

[jira] [Commented] (KYLIN-5114) Build cube error:java.lang.NoSuchMethodError

2022-08-16 Thread liyang (Jira)
[ https://issues.apache.org/jira/browse/KYLIN-5114?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17580400#comment-17580400 ] liyang commented on KYLIN-5114: --- 这类是环境问题,假如不是一模一样的环境(centos7,Hive 3.1.2,hadoop 3.1.3,spark

[jira] [Updated] (KYLIN-5224) kylin 4.0.1 does not support limit..offset (requires spark 3.4)

2022-08-14 Thread liyang (Jira)
[ https://issues.apache.org/jira/browse/KYLIN-5224?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] liyang updated KYLIN-5224: -- Summary: kylin 4.0.1 does not support limit..offset (requires spark 3.4) (was: kylin 4.0.1 不支持分页查询) > kylin

[jira] [Commented] (KYLIN-5224) kylin 4.0.1 不支持分页查询

2022-08-14 Thread liyang (Jira)
[ https://issues.apache.org/jira/browse/KYLIN-5224?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17579441#comment-17579441 ] liyang commented on KYLIN-5224: --- then the request changes to support spark 3.4  :) > kylin 4.0.1 不支持分页查询 >

[jira] [Closed] (KYLIN-5227) Kylin association query does not use ad hoc query, but push down spark query

2022-08-14 Thread liyang (Jira)
[ https://issues.apache.org/jira/browse/KYLIN-5227?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] liyang closed KYLIN-5227. - Resolution: Not A Problem > Kylin association query does not use ad hoc query, but push down spark query >

[jira] [Closed] (KYLIN-5212) cannot get HiveTableMeta

2022-08-14 Thread liyang (Jira)
[ https://issues.apache.org/jira/browse/KYLIN-5212?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] liyang closed KYLIN-5212. - Resolution: Not A Problem > cannot get HiveTableMeta > > > Key:

[jira] [Commented] (KYLIN-5227) Kylin association query does not use ad hoc query, but push down spark query

2022-08-14 Thread liyang (Jira)
[ https://issues.apache.org/jira/browse/KYLIN-5227?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17579388#comment-17579388 ] liyang commented on KYLIN-5227: --- Without group by and aggregate function, this is a raw query. It is

[jira] [Commented] (KYLIN-5215) The metadata information returned by Kylin pushdown query and Cube query is inconsistent

2022-08-02 Thread liyang (Jira)
[ https://issues.apache.org/jira/browse/KYLIN-5215?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17574176#comment-17574176 ] liyang commented on KYLIN-5215: --- Kylin 的对外元数据默认都是大写,也就是比如 hive 数据源中用的是小写的表名和列名,从 Kylin 暴漏出来后将都是大写。

[jira] [Commented] (KYLIN-3739) Use table alias rather than table identity for snapshots in CubeSegment, CubeInstance, CubeDesc

2018-12-31 Thread liyang (JIRA)
[ https://issues.apache.org/jira/browse/KYLIN-3739?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16731520#comment-16731520 ] liyang commented on KYLIN-3739: --- Sounds fine to me if we can keep it backward compatible. I guess the logic

[jira] [Updated] (KYLIN-3423) Performance improvement in FactDistinctColumnsMapper

2018-06-22 Thread liyang (JIRA)
[ https://issues.apache.org/jira/browse/KYLIN-3423?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] liyang updated KYLIN-3423: -- Description: Currently FactDistinctColumnsMapper writes every cell to mapper output. In spite of mapper side

[jira] [Created] (KYLIN-3423) Performance improvement in FactDistinctColumnsMapper

2018-06-21 Thread liyang (JIRA)
liyang created KYLIN-3423: - Summary: Performance improvement in FactDistinctColumnsMapper Key: KYLIN-3423 URL: https://issues.apache.org/jira/browse/KYLIN-3423 Project: Kylin Issue Type: Improvement

[jira] [Commented] (KYLIN-3364) Make the behavior of BigDecimalSumAggregator consistent with hive

2018-06-09 Thread liyang (JIRA)
[ https://issues.apache.org/jira/browse/KYLIN-3364?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16507223#comment-16507223 ] liyang commented on KYLIN-3364: --- This is fine, given we are aware that all aggregators must have consistent

[jira] [Commented] (KYLIN-3399) Leaked lookup table in DictionaryGeneratorCLI#processSegment

2018-06-09 Thread liyang (JIRA)
[ https://issues.apache.org/jira/browse/KYLIN-3399?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16507222#comment-16507222 ] liyang commented on KYLIN-3399: --- The {{cubeMgr.getLookupTable(cubeSeg, join);}} is to check if any

[jira] [Comment Edited] (KYLIN-3400) wipeCache and createCubeDesc make deadlock happenning

2018-06-09 Thread liyang (JIRA)
[ https://issues.apache.org/jira/browse/KYLIN-3400?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16507221#comment-16507221 ] liyang edited comment on KYLIN-3400 at 6/10/18 1:05 AM: This seems introduced by

[jira] [Comment Edited] (KYLIN-3400) wipeCache and createCubeDesc make deadlock happenning

2018-06-09 Thread liyang (JIRA)
[ https://issues.apache.org/jira/browse/KYLIN-3400?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16507221#comment-16507221 ] liyang edited comment on KYLIN-3400 at 6/10/18 1:05 AM: This seems introduced by

[jira] [Commented] (KYLIN-3400) wipeCache and createCubeDesc make deadlock happenning

2018-06-09 Thread liyang (JIRA)
[ https://issues.apache.org/jira/browse/KYLIN-3400?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16507221#comment-16507221 ] liyang commented on KYLIN-3400: --- This seems introduced by commit:

[jira] [Commented] (KYLIN-3389) intersect_count error

2018-06-09 Thread liyang (JIRA)
[ https://issues.apache.org/jira/browse/KYLIN-3389?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16507204#comment-16507204 ] liyang commented on KYLIN-3389: --- We need the cube_desc json to help. Also before certain it is a bug,

[jira] [Commented] (KYLIN-3388) Data may become not correct if mappers fail during the cube building step, "distribute by rand()"

2018-06-09 Thread liyang (JIRA)
[ https://issues.apache.org/jira/browse/KYLIN-3388?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16507197#comment-16507197 ] liyang commented on KYLIN-3388: --- Really!! This sounds like a critical bug in hive. > Data may become not

[jira] [Commented] (KYLIN-3364) Make the behavior of BigDecimalSumAggregator consistent with hive

2018-05-28 Thread liyang (JIRA)
[ https://issues.apache.org/jira/browse/KYLIN-3364?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16493008#comment-16493008 ] liyang commented on KYLIN-3364: --- Besides BigDecimalSumAggregator, other aggregators have the same issue I

[jira] [Resolved] (KYLIN-1729) Error at #3 Step Name: Build Dimension Dictionary Duration

2018-05-26 Thread liyang (JIRA)
[ https://issues.apache.org/jira/browse/KYLIN-1729?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] liyang resolved KYLIN-1729. --- Resolution: Fixed Assignee: liyang (was: Dong Li) Fix Version/s: v2.0.0 This has been fixed

[jira] [Updated] (KYLIN-2662) NegativeArraySizeException in "Extract Fact Table Distinct Columns"

2018-05-26 Thread liyang (JIRA)
[ https://issues.apache.org/jira/browse/KYLIN-2662?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] liyang updated KYLIN-2662: -- Fix Version/s: v2.4.0 > NegativeArraySizeException in "Extract Fact Table Distinct Columns" >

[jira] [Closed] (KYLIN-1729) Error at #3 Step Name: Build Dimension Dictionary Duration

2018-05-26 Thread liyang (JIRA)
[ https://issues.apache.org/jira/browse/KYLIN-1729?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] liyang closed KYLIN-1729. - > Error at #3 Step Name: Build Dimension Dictionary Duration >

[jira] [Assigned] (KYLIN-2662) NegativeArraySizeException in "Extract Fact Table Distinct Columns"

2018-05-26 Thread liyang (JIRA)
[ https://issues.apache.org/jira/browse/KYLIN-2662?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] liyang reassigned KYLIN-2662: - Assignee: liyang > NegativeArraySizeException in "Extract Fact Table Distinct Columns" >

[jira] [Commented] (KYLIN-3071) Add config to reuse dict to reduce dict size

2018-05-25 Thread liyang (JIRA)
[ https://issues.apache.org/jira/browse/KYLIN-3071?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16490410#comment-16490410 ] liyang commented on KYLIN-3071: --- I see the difference between Growing Dict and Reuse Dict. It is useful.

[jira] [Commented] (KYLIN-3071) Add config to reuse dict to reduce dict size

2018-05-07 Thread liyang (JIRA)
[ https://issues.apache.org/jira/browse/KYLIN-3071?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16465584#comment-16465584 ] liyang commented on KYLIN-3071: --- How is this different from {{KylinConfigBase.isGrowingDictEnabled()}} ? >

[jira] [Created] (KYLIN-3356) Constant in SecretKeySpec

2018-04-30 Thread liyang (JIRA)
liyang created KYLIN-3356: - Summary: Constant in SecretKeySpec Key: KYLIN-3356 URL: https://issues.apache.org/jira/browse/KYLIN-3356 Project: Kylin Issue Type: Improvement Reporter:

[jira] [Commented] (KYLIN-3335) Add project & cube related info to the job id for better filtering

2018-04-30 Thread liyang (JIRA)
[ https://issues.apache.org/jira/browse/KYLIN-3335?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16458515#comment-16458515 ] liyang commented on KYLIN-3335: --- +1 for upgrade, prefer simpler approach  :) > Add project & cube related

[jira] [Commented] (KYLIN-3308) Improvement exception in REST

2018-04-30 Thread liyang (JIRA)
[ https://issues.apache.org/jira/browse/KYLIN-3308?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16458509#comment-16458509 ] liyang commented on KYLIN-3308: --- Nice proposal~ > Improvement exception in REST >

[jira] [Updated] (KYLIN-3352) Segment pruning bug, e.g. date_col > "max_date+1"

2018-04-27 Thread liyang (JIRA)
[ https://issues.apache.org/jira/browse/KYLIN-3352?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] liyang updated KYLIN-3352: -- Summary: Segment pruning bug, e.g. date_col > "max_date+1" (was: Segment pruning bug when date_col >

[jira] [Created] (KYLIN-3352) Segment pruning bug when date_col > "max_date+1"

2018-04-27 Thread liyang (JIRA)
liyang created KYLIN-3352: - Summary: Segment pruning bug when date_col > "max_date+1" Key: KYLIN-3352 URL: https://issues.apache.org/jira/browse/KYLIN-3352 Project: Kylin Issue Type: Bug

[jira] [Created] (KYLIN-3348) "missing LastBuildJobID" error when building new cube segment

2018-04-25 Thread liyang (JIRA)
liyang created KYLIN-3348: - Summary: "missing LastBuildJobID" error when building new cube segment Key: KYLIN-3348 URL: https://issues.apache.org/jira/browse/KYLIN-3348 Project: Kylin Issue Type:

[jira] [Commented] (KYLIN-3342) Cubing level calculation inconsistent?

2018-04-18 Thread liyang (JIRA)
[ https://issues.apache.org/jira/browse/KYLIN-3342?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16442154#comment-16442154 ] liyang commented on KYLIN-3342: --- I see. Then this Jira is invalid. Closing it. Thanks [~yaho]! > Cubing

[jira] [Created] (KYLIN-3342) Cubing level calculation inconsistent?

2018-04-18 Thread liyang (JIRA)
liyang created KYLIN-3342: - Summary: Cubing level calculation inconsistent? Key: KYLIN-3342 URL: https://issues.apache.org/jira/browse/KYLIN-3342 Project: Kylin Issue Type: Bug Reporter:

[jira] [Created] (KYLIN-3337) Refactor KylinConfig.setKylinConfigThreadLocal()

2018-04-13 Thread liyang (JIRA)
liyang created KYLIN-3337: - Summary: Refactor KylinConfig.setKylinConfigThreadLocal() Key: KYLIN-3337 URL: https://issues.apache.org/jira/browse/KYLIN-3337 Project: Kylin Issue Type: Improvement

[jira] [Updated] (KYLIN-3337) Refactor KylinConfig.setKylinConfigThreadLocal()

2018-04-13 Thread liyang (JIRA)
[ https://issues.apache.org/jira/browse/KYLIN-3337?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] liyang updated KYLIN-3337: -- Description: Use an auto-closeable style API to replace {{KylinConfig.setKylinConfigThreadLocal()}}. Remind

[jira] [Commented] (KYLIN-2899) Enable segment level query cache

2018-04-02 Thread liyang (JIRA)
[ https://issues.apache.org/jira/browse/KYLIN-2899?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16423397#comment-16423397 ] liyang commented on KYLIN-2899: --- Very good document! Thanks Ma Gang! Very helpful for understanding. >

[jira] [Commented] (KYLIN-3221) Some improvements for lookup table

2018-04-02 Thread liyang (JIRA)
[ https://issues.apache.org/jira/browse/KYLIN-3221?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16423395#comment-16423395 ] liyang commented on KYLIN-3221: --- +1 Nice proposal. The global snapshot table can be one way to support

[jira] [Commented] (KYLIN-3321) Set MALLOC_ARENA_MAX in script

2018-04-02 Thread liyang (JIRA)
[ https://issues.apache.org/jira/browse/KYLIN-3321?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16423373#comment-16423373 ] liyang commented on KYLIN-3321: --- Interesting information!! Thank you Ted! > Set MALLOC_ARENA_MAX in script

[jira] [Commented] (KYLIN-3001) Fix the wrong Cache key issue

2018-04-02 Thread liyang (JIRA)
[ https://issues.apache.org/jira/browse/KYLIN-3001?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16423344#comment-16423344 ] liyang commented on KYLIN-3001: --- Sorry I don't understand the patch. Replace "[ ]" with " ", replace a space

[jira] [Created] (KYLIN-3324) NegativeArraySizeException in CreateDictionaryJob$2.getDictionary()

2018-03-28 Thread liyang (JIRA)
liyang created KYLIN-3324: - Summary: NegativeArraySizeException in CreateDictionaryJob$2.getDictionary() Key: KYLIN-3324 URL: https://issues.apache.org/jira/browse/KYLIN-3324 Project: Kylin Issue

[jira] [Created] (KYLIN-3322) TopN requires a SUM to work

2018-03-27 Thread liyang (JIRA)
liyang created KYLIN-3322: - Summary: TopN requires a SUM to work Key: KYLIN-3322 URL: https://issues.apache.org/jira/browse/KYLIN-3322 Project: Kylin Issue Type: Bug Reporter: liyang

[jira] [Updated] (KYLIN-3311) Segments overlap error (refactor write conflict exception)

2018-03-25 Thread liyang (JIRA)
[ https://issues.apache.org/jira/browse/KYLIN-3311?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] liyang updated KYLIN-3311: -- Summary: Segments overlap error (refactor write conflict exception) (was: Segments overlap error) > Segments

[jira] [Comment Edited] (KYLIN-3311) Segments overlap error

2018-03-24 Thread liyang (JIRA)
[ https://issues.apache.org/jira/browse/KYLIN-3311?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16412880#comment-16412880 ] liyang edited comment on KYLIN-3311 at 3/25/18 5:26 AM: Thanks for reporting. I'm

[jira] [Commented] (KYLIN-3311) Segments overlap error

2018-03-24 Thread liyang (JIRA)
[ https://issues.apache.org/jira/browse/KYLIN-3311?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16412880#comment-16412880 ] liyang commented on KYLIN-3311: --- Thanks for reporting. I'm not sure of the root cause yet. It seems the

[jira] [Commented] (KYLIN-3287) When a shard by column is in dict encoding, dict building error.

2018-03-12 Thread liyang (JIRA)
[ https://issues.apache.org/jira/browse/KYLIN-3287?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16395155#comment-16395155 ] liyang commented on KYLIN-3287: --- +1 patch verified > When a shard by column is in dict encoding, dict

[jira] [Commented] (KYLIN-2899) Enable segment level query cache

2018-02-27 Thread liyang (JIRA)
[ https://issues.apache.org/jira/browse/KYLIN-2899?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16379763#comment-16379763 ] liyang commented on KYLIN-2899: --- Segment level cache is a new idea. Can we have an elaboration of design and

[jira] [Commented] (KYLIN-3002) Use Spark as default engine in web

2018-02-26 Thread liyang (JIRA)
[ https://issues.apache.org/jira/browse/KYLIN-3002?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16377967#comment-16377967 ] liyang commented on KYLIN-3002: --- Recently verified that the measures are already supported by Spark engine.

[jira] [Created] (KYLIN-3266) Improve CI coverage

2018-02-23 Thread liyang (JIRA)
liyang created KYLIN-3266: - Summary: Improve CI coverage Key: KYLIN-3266 URL: https://issues.apache.org/jira/browse/KYLIN-3266 Project: Kylin Issue Type: Improvement Reporter: liyang

[jira] [Commented] (KYLIN-2672) Only clean necessary cache for CubeMigrationCLI

2018-02-05 Thread liyang (JIRA)
[ https://issues.apache.org/jira/browse/KYLIN-2672?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16352228#comment-16352228 ] liyang commented on KYLIN-2672: --- I rebased and merged the patch into branch KYLIN-2672. The code looks good.

[jira] [Commented] (KYLIN-3045) Too many open files raised from new Configuration()

2018-02-04 Thread liyang (JIRA)
[ https://issues.apache.org/jira/browse/KYLIN-3045?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16351989#comment-16351989 ] liyang commented on KYLIN-3045: --- The "fixed version=2.3.0" removed. > Too many open files raised from new

[jira] [Updated] (KYLIN-3045) Too many open files raised from new Configuration()

2018-02-04 Thread liyang (JIRA)
[ https://issues.apache.org/jira/browse/KYLIN-3045?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] liyang updated KYLIN-3045: -- Fix Version/s: (was: v2.3.0) > Too many open files raised from new Configuration() >

[jira] [Commented] (KYLIN-3045) Too many open files raised from new Configuration()

2018-02-04 Thread liyang (JIRA)
[ https://issues.apache.org/jira/browse/KYLIN-3045?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16351988#comment-16351988 ] liyang commented on KYLIN-3045: --- My attempt didn't work out. Seems it did not hit the root cause. > Too

[jira] [Created] (KYLIN-3194) Tolerate broken job metadata caused by executable ClassNotFoundException

2018-01-23 Thread liyang (JIRA)
liyang created KYLIN-3194: - Summary: Tolerate broken job metadata caused by executable ClassNotFoundException Key: KYLIN-3194 URL: https://issues.apache.org/jira/browse/KYLIN-3194 Project: Kylin

[jira] [Updated] (KYLIN-3164) HBase connection must be closed when clearing connection pool

2018-01-14 Thread liyang (JIRA)
[ https://issues.apache.org/jira/browse/KYLIN-3164?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] liyang updated KYLIN-3164: -- Description: Currently {{HBaseConnection.clearConnCache()}} does not invoke  {{close()}} on hbase connections.

[jira] [Created] (KYLIN-3164) HBase connection must be closed when clearing connection pool

2018-01-14 Thread liyang (JIRA)
liyang created KYLIN-3164: - Summary: HBase connection must be closed when clearing connection pool Key: KYLIN-3164 URL: https://issues.apache.org/jira/browse/KYLIN-3164 Project: Kylin Issue Type:

[jira] [Updated] (KYLIN-3158) Metadata broadcast should only retry failed node

2018-01-08 Thread liyang (JIRA)
[ https://issues.apache.org/jira/browse/KYLIN-3158?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] liyang updated KYLIN-3158: -- Description: In commit https://github.com/apache/kylin/commit/ecc01458c4ad361aaf863505884d51474a8fec9d, Kylin

[jira] [Created] (KYLIN-3158) Metadata broadcast should only retry failed node

2018-01-08 Thread liyang (JIRA)
liyang created KYLIN-3158: - Summary: Metadata broadcast should only retry failed node Key: KYLIN-3158 URL: https://issues.apache.org/jira/browse/KYLIN-3158 Project: Kylin Issue Type: Improvement

[jira] [Commented] (KYLIN-2990) Add warning window of exist model names for other project selected

2017-12-31 Thread liyang (JIRA)
[ https://issues.apache.org/jira/browse/KYLIN-2990?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16307337#comment-16307337 ] liyang commented on KYLIN-2990: --- Note I reverted the check-dup logic in ModelService. Many direct REST API

[jira] [Commented] (KYLIN-2726) Introduce a dashboard for showing kylin service related metrics, like query count, query latency, job count, etc

2017-12-31 Thread liyang (JIRA)
[ https://issues.apache.org/jira/browse/KYLIN-2726?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16307338#comment-16307338 ] liyang commented on KYLIN-2726: --- FYI, I reverted the {{QueryService.queryWithoutSecure()}} during a big code

[jira] [Commented] (KYLIN-2764) Build the dict for UHC column with MR

2017-12-31 Thread liyang (JIRA)
[ https://issues.apache.org/jira/browse/KYLIN-2764?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16307336#comment-16307336 ] liyang commented on KYLIN-2764: --- Note I have renamed the config to

[jira] [Comment Edited] (KYLIN-2764) Build the dict for UHC column with MR

2017-12-31 Thread liyang (JIRA)
[ https://issues.apache.org/jira/browse/KYLIN-2764?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16307336#comment-16307336 ] liyang edited comment on KYLIN-2764 at 1/1/18 12:17 AM: Note I have renamed the

[jira] [Commented] (KYLIN-2723) Introduce metrics collector for query & job metrics

2017-12-31 Thread liyang (JIRA)
[ https://issues.apache.org/jira/browse/KYLIN-2723?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16307334#comment-16307334 ] liyang commented on KYLIN-2723: --- FYI. I have renamed config "kylin.core.metrics.xxx" to "kylin.metrics.xxx"

[jira] [Commented] (KYLIN-3022) Add clone() for ISegment, which is needed when updating cube segment

2017-12-31 Thread liyang (JIRA)
[ https://issues.apache.org/jira/browse/KYLIN-3022?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16307328#comment-16307328 ] liyang commented on KYLIN-3022: --- Many issues (if not all) in KYLIN-3022 has been resolved by KYLIN-3085,

[jira] [Commented] (KYLIN-2986) Segments overlap issue may happen when concurrent merge or build

2017-12-31 Thread liyang (JIRA)
[ https://issues.apache.org/jira/browse/KYLIN-2986?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16307327#comment-16307327 ] liyang commented on KYLIN-2986: --- Yes [~yaho], I just merged https://issues.apache.org/jira/browse/KYLIN-3085

[jira] [Commented] (KYLIN-3059) Query got IllegalArgumentException

2017-12-31 Thread liyang (JIRA)
[ https://issues.apache.org/jira/browse/KYLIN-3059?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16307324#comment-16307324 ] liyang commented on KYLIN-3059: --- With https://issues.apache.org/jira/browse/KYLIN-3092 I think this issue

[jira] [Resolved] (KYLIN-3125) Support SparkSql in Cube building step "Create Intermediate Flat Hive Table"

2017-12-31 Thread liyang (JIRA)
[ https://issues.apache.org/jira/browse/KYLIN-3125?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] liyang resolved KYLIN-3125. --- Resolution: Fixed Fix Version/s: v2.3.0 > Support SparkSql in Cube building step "Create Intermediate

[jira] [Commented] (KYLIN-3125) Support SparkSql in Cube building step "Create Intermediate Flat Hive Table"

2017-12-31 Thread liyang (JIRA)
[ https://issues.apache.org/jira/browse/KYLIN-3125?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16307320#comment-16307320 ] liyang commented on KYLIN-3125: --- Code merge done.

[jira] [Updated] (KYLIN-3092) Synchronize read/write operations on Managers

2017-12-31 Thread liyang (JIRA)
[ https://issues.apache.org/jira/browse/KYLIN-3092?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] liyang updated KYLIN-3092: -- Description: To prevent abnormal behavior when reading cache (those getXXX methods) and writing cache

[jira] [Commented] (KYLIN-3092) Synchronize read/write operations on Managers

2017-12-31 Thread liyang (JIRA)
[ https://issues.apache.org/jira/browse/KYLIN-3092?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16307319#comment-16307319 ] liyang commented on KYLIN-3092: --- Code merge done.

[jira] [Resolved] (KYLIN-3092) Synchronize read/write operations on Managers

2017-12-31 Thread liyang (JIRA)
[ https://issues.apache.org/jira/browse/KYLIN-3092?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] liyang resolved KYLIN-3092. --- Resolution: Fixed Assignee: liyang Fix Version/s: v2.3.0 > Synchronize read/write operations

[jira] [Resolved] (KYLIN-3090) Refactor to consolidate all caches and managers under KylinConfig

2017-12-31 Thread liyang (JIRA)
[ https://issues.apache.org/jira/browse/KYLIN-3090?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] liyang resolved KYLIN-3090. --- Resolution: Fixed Assignee: liyang Fix Version/s: v2.3.0 > Refactor to consolidate all caches

[jira] [Commented] (KYLIN-3090) Refactor to consolidate all caches and managers under KylinConfig

2017-12-31 Thread liyang (JIRA)
[ https://issues.apache.org/jira/browse/KYLIN-3090?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16307316#comment-16307316 ] liyang commented on KYLIN-3090: --- Code merge done.

[jira] [Resolved] (KYLIN-3085) CubeManager.updateCube() must not update the cached CubeInstance

2017-12-31 Thread liyang (JIRA)
[ https://issues.apache.org/jira/browse/KYLIN-3085?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] liyang resolved KYLIN-3085. --- Resolution: Fixed Fix Version/s: v2.3.0 > CubeManager.updateCube() must not update the cached

[jira] [Commented] (KYLIN-3085) CubeManager.updateCube() must not update the cached CubeInstance

2017-12-31 Thread liyang (JIRA)
[ https://issues.apache.org/jira/browse/KYLIN-3085?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16307315#comment-16307315 ] liyang commented on KYLIN-3085: --- Code merge done.

[jira] [Commented] (KYLIN-3040) Refresh a non-partitioned cube changes the segment name to "19700101000000_2922789940817071255"

2017-12-31 Thread liyang (JIRA)
[ https://issues.apache.org/jira/browse/KYLIN-3040?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16307314#comment-16307314 ] liyang commented on KYLIN-3040: --- Code merge done.

[jira] [Resolved] (KYLIN-3040) Refresh a non-partitioned cube changes the segment name to "19700101000000_2922789940817071255"

2017-12-31 Thread liyang (JIRA)
[ https://issues.apache.org/jira/browse/KYLIN-3040?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] liyang resolved KYLIN-3040. --- Resolution: Fixed > Refresh a non-partitioned cube changes the segment name to >

[jira] [Updated] (KYLIN-3040) Refresh a non-partitioned cube changes the segment name to "19700101000000_2922789940817071255"

2017-12-31 Thread liyang (JIRA)
[ https://issues.apache.org/jira/browse/KYLIN-3040?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] liyang updated KYLIN-3040: -- Fix Version/s: v2.3.0 > Refresh a non-partitioned cube changes the segment name to >

[jira] [Resolved] (KYLIN-2991) Query hit NumberFormatException if partitionDateFormat is not yyyy-MM-dd

2017-12-31 Thread liyang (JIRA)
[ https://issues.apache.org/jira/browse/KYLIN-2991?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] liyang resolved KYLIN-2991. --- Resolution: Fixed > Query hit NumberFormatException if partitionDateFormat is not -MM-dd >

  1   2   3   4   5   6   7   8   9   10   >