Re: [VOTE] Release apache-kylin-4.0.4 (RC1)

2024-01-22 Thread hongbin ma
/by-fingerprint/CF488F242BBC3A885DB7C6DF685F5B5DD254DE89 > > > >Please vote on releasing this package as Apache Kylin 4.0.4. > > > >The vote is open for the next 72 hours and passes if a majority of at > least > >three +1 PMC votes are cast. > > > > > >[ ] +1 Release this package as Apache Kylin 3.0.2 > >[ ] 0 I don't feel strongly about it, but I'm okay with the release > >[ ] -1 Do not release this package because... > > > >Here is my vote: > >+1 (binding) > > > >Best regards, > >Li Yang > -- Regards, Hongbin Ma

[jira] [Created] (KYLIN-3379) timestampadd test coverage is not enough

2018-05-12 Thread hongbin ma (JIRA)
hongbin ma created KYLIN-3379: - Summary: timestampadd test coverage is not enough Key: KYLIN-3379 URL: https://issues.apache.org/jira/browse/KYLIN-3379 Project: Kylin Issue Type: Bug Affects

Re: [Discuss] Apache Kylin Component Owner Plan

2018-02-01 Thread hongbin ma
+1 suggest to establish more solid rules on test coverage. I've seen lots patches without proper tests On Fri, Feb 2, 2018 at 2:57 PM, Jianhua Peng wrote: > +1 > > On 2018/02/02 02:39:38, ShaoFeng Shi wrote: > > Hello, Kylin community, > > > >

[jira] [Created] (KYLIN-3149) Calcite's ReduceExpressionsRule.PROJECT_INSTANCE not working as expected

2018-01-03 Thread hongbin ma (JIRA)
hongbin ma created KYLIN-3149: - Summary: Calcite's ReduceExpressionsRule.PROJECT_INSTANCE not working as expected Key: KYLIN-3149 URL: https://issues.apache.org/jira/browse/KYLIN-3149 Project: Kylin

[jira] [Created] (KYLIN-3106) DefaultScheduler#shutdown should use shutdownNow instead of shutdown

2017-12-13 Thread hongbin ma (JIRA)
hongbin ma created KYLIN-3106: - Summary: DefaultScheduler#shutdown should use shutdownNow instead of shutdown Key: KYLIN-3106 URL: https://issues.apache.org/jira/browse/KYLIN-3106 Project: Kylin

[jira] [Created] (KYLIN-2985) Cache temp json file created by each Calcite Connection

2017-11-01 Thread hongbin ma (JIRA)
hongbin ma created KYLIN-2985: - Summary: Cache temp json file created by each Calcite Connection Key: KYLIN-2985 URL: https://issues.apache.org/jira/browse/KYLIN-2985 Project: Kylin Issue Type

[jira] [Created] (KYLIN-2982) Avoid upgrade column in OLAPTable

2017-11-01 Thread hongbin ma (JIRA)
hongbin ma created KYLIN-2982: - Summary: Avoid upgrade column in OLAPTable Key: KYLIN-2982 URL: https://issues.apache.org/jira/browse/KYLIN-2982 Project: Kylin Issue Type: Improvement

[jira] [Created] (KYLIN-2823) Trim TupleFilter after dictionary-based filter optimization

2017-08-30 Thread hongbin ma (JIRA)
hongbin ma created KYLIN-2823: - Summary: Trim TupleFilter after dictionary-based filter optimization Key: KYLIN-2823 URL: https://issues.apache.org/jira/browse/KYLIN-2823 Project: Kylin Issue

[jira] [Created] (KYLIN-2782) Replace DailyRollingFileAppender with RollingFileAppender to allow log retention

2017-08-09 Thread hongbin ma (JIRA)
hongbin ma created KYLIN-2782: - Summary: Replace DailyRollingFileAppender with RollingFileAppender to allow log retention Key: KYLIN-2782 URL: https://issues.apache.org/jira/browse/KYLIN-2782 Project

[DISCUSS] On removing Cube ACL

2017-08-06 Thread hongbin ma
Current ACL design is based on very early versions where kylin merely had simple concepts like projects and cubes. With the advent of Kylin v2.0, and several new concepts like Data Model ( http://kylin.apache.org/docs/gettingstarted/concepts.html) and Query Pushdown (KYLIN-2515), the original

Re: sql语句中当in的列表超过一定数据量的时候性能突然变差,如何解决?

2017-08-04 Thread hongbin ma
take a look at kylin.storage.hbase.max-fuzzykey-scan in org.apache.kylin.common.KylinConfigBase#getQueryScanFuzzyKeyMax 2017-08-03 20:25 GMT+08:00 ShaoFeng Shi : > It might be related with storage layer cache. You can make more tests to > see the differences. Besides, if

Re: [jira] [Updated] (KYLIN-2669) Cube is ready but insight tables not result

2017-06-17 Thread hongbin ma
can you try latest kylin 2.0? On Wed, Jun 14, 2017 at 12:23 PM, YUNFEI CHEN (JIRA) wrote: > > [ https://issues.apache.org/jira/browse/KYLIN-2669?page= > com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] > > YUNFEI CHEN updated KYLIN-2669: >

[jira] [Created] (KYLIN-2671) Speed up prepared query execution

2017-06-15 Thread hongbin ma (JIRA)
hongbin ma created KYLIN-2671: - Summary: Speed up prepared query execution Key: KYLIN-2671 URL: https://issues.apache.org/jira/browse/KYLIN-2671 Project: Kylin Issue Type: Improvement

[jira] [Created] (KYLIN-2667) Ignore whitespace when caching query

2017-06-11 Thread hongbin ma (JIRA)
hongbin ma created KYLIN-2667: - Summary: Ignore whitespace when caching query Key: KYLIN-2667 URL: https://issues.apache.org/jira/browse/KYLIN-2667 Project: Kylin Issue Type: Improvement

[jira] [Created] (KYLIN-2659) Refactor KylinConfig so that all the default configurations are hidden in kylin-defaults.properties

2017-06-06 Thread hongbin ma (JIRA)
hongbin ma created KYLIN-2659: - Summary: Refactor KylinConfig so that all the default configurations are hidden in kylin-defaults.properties Key: KYLIN-2659 URL: https://issues.apache.org/jira/browse/KYLIN-2659

[jira] [Created] (KYLIN-2646) Project level query authorization

2017-05-25 Thread hongbin ma (JIRA)
hongbin ma created KYLIN-2646: - Summary: Project level query authorization Key: KYLIN-2646 URL: https://issues.apache.org/jira/browse/KYLIN-2646 Project: Kylin Issue Type: Improvement

[jira] [Created] (KYLIN-2636) optimize case when in group by

2017-05-22 Thread hongbin ma (JIRA)
hongbin ma created KYLIN-2636: - Summary: optimize case when in group by Key: KYLIN-2636 URL: https://issues.apache.org/jira/browse/KYLIN-2636 Project: Kylin Issue Type: Improvement

[jira] [Created] (KYLIN-2631) Seek to next model when no cube in current model satisfies query

2017-05-19 Thread hongbin ma (JIRA)
hongbin ma created KYLIN-2631: - Summary: Seek to next model when no cube in current model satisfies query Key: KYLIN-2631 URL: https://issues.apache.org/jira/browse/KYLIN-2631 Project: Kylin

[jira] [Created] (KYLIN-2630) NPE when a subquery joins another lookup tables

2017-05-18 Thread hongbin ma (JIRA)
hongbin ma created KYLIN-2630: - Summary: NPE when a subquery joins another lookup tables Key: KYLIN-2630 URL: https://issues.apache.org/jira/browse/KYLIN-2630 Project: Kylin Issue Type: Bug

[jira] [Created] (KYLIN-2625) not null filter clause should be evaluable in storage

2017-05-16 Thread hongbin ma (JIRA)
hongbin ma created KYLIN-2625: - Summary: not null filter clause should be evaluable in storage Key: KYLIN-2625 URL: https://issues.apache.org/jira/browse/KYLIN-2625 Project: Kylin Issue Type

[jira] [Created] (KYLIN-2610) Optimize BuiltInFunctionTransformer performance

2017-05-11 Thread hongbin ma (JIRA)
hongbin ma created KYLIN-2610: - Summary: Optimize BuiltInFunctionTransformer performance Key: KYLIN-2610 URL: https://issues.apache.org/jira/browse/KYLIN-2610 Project: Kylin Issue Type

[jira] [Created] (KYLIN-2608) Bubble sort bug in JoinDesc

2017-05-11 Thread hongbin ma (JIRA)
hongbin ma created KYLIN-2608: - Summary: Bubble sort bug in JoinDesc Key: KYLIN-2608 URL: https://issues.apache.org/jira/browse/KYLIN-2608 Project: Kylin Issue Type: Bug Reporter

[jira] [Created] (KYLIN-2599) select * in subquery fail due to bug in hackSelectStar

2017-05-09 Thread hongbin ma (JIRA)
hongbin ma created KYLIN-2599: - Summary: select * in subquery fail due to bug in hackSelectStar Key: KYLIN-2599 URL: https://issues.apache.org/jira/browse/KYLIN-2599 Project: Kylin Issue Type

[jira] [Created] (KYLIN-2598) Should not translate filter to a in-clause filter with too many elements

2017-05-09 Thread hongbin ma (JIRA)
hongbin ma created KYLIN-2598: - Summary: Should not translate filter to a in-clause filter with too many elements Key: KYLIN-2598 URL: https://issues.apache.org/jira/browse/KYLIN-2598 Project: Kylin

[jira] [Created] (KYLIN-2597) Deal with trivial expression in filters like x = 1 + 2

2017-05-09 Thread hongbin ma (JIRA)
hongbin ma created KYLIN-2597: - Summary: Deal with trivial expression in filters like x = 1 + 2 Key: KYLIN-2597 URL: https://issues.apache.org/jira/browse/KYLIN-2597 Project: Kylin Issue Type

[jira] [Created] (KYLIN-2586) use random port for CacheServiceTest as fixed port 7777 might have been occupied

2017-05-04 Thread hongbin ma (JIRA)
hongbin ma created KYLIN-2586: - Summary: use random port for CacheServiceTest as fixed port might have been occupied Key: KYLIN-2586 URL: https://issues.apache.org/jira/browse/KYLIN-2586 Project

[jira] [Created] (KYLIN-2580) Improvement on subqueries: allow grouping by columns from subquery

2017-05-01 Thread hongbin ma (JIRA)
hongbin ma created KYLIN-2580: - Summary: Improvement on subqueries: allow grouping by columns from subquery Key: KYLIN-2580 URL: https://issues.apache.org/jira/browse/KYLIN-2580 Project: Kylin

[jira] [Created] (KYLIN-2579) Improvement on subqueries: reroder subqueries joins with RelOptRule

2017-05-01 Thread hongbin ma (JIRA)
hongbin ma created KYLIN-2579: - Summary: Improvement on subqueries: reroder subqueries joins with RelOptRule Key: KYLIN-2579 URL: https://issues.apache.org/jira/browse/KYLIN-2579 Project: Kylin

Re: [VOTE] Release apache-kylin-2.0.0 (RC3)

2017-04-28 Thread hongbin ma
+1 mvn test passed mvn integration test passed On Thu, Apr 27, 2017 at 8:38 AM, 《秦殇》!健 wrote: > +1 > It's great!!! > -- 原始邮件 -- > 发件人: "Li Yang";; > 发送时间: 2017年4月27日(星期四) 上午7:22 > 收件人: "dev"; > >

[jira] [Created] (KYLIN-2551) separate table desc by each project

2017-04-17 Thread hongbin ma (JIRA)
hongbin ma created KYLIN-2551: - Summary: separate table desc by each project Key: KYLIN-2551 URL: https://issues.apache.org/jira/browse/KYLIN-2551 Project: Kylin Issue Type: Improvement

Re: [DISCUSS] fork Calcite and include the fork as a a submodule

2017-04-17 Thread hongbin ma
ite. How to handle those patches that are important to kylin but not > so > > urgent to calcite. Having a fork of calcite obviously is a solution. But > I > > too don't know whether it is common and appropriate in the open source > > world. > > > > Yang > > >

[DISCUSS] fork Calcite and include the fork as a a submodule

2017-04-16 Thread hongbin ma
Recently I'm testing kylin connectivity with multiple BI tools like Tableau, Cognos, etc. During the test I find it necessary to fix several Calcite issues, like CALCITE-1754. I'm more than willing to contribute the fixes back to calcite, however there're still two potential issues: 1. Calcite

Re: Kylin-over-Alluxio

2017-04-14 Thread hongbin ma
besides, in https://github.com/Alluxio/alluxio/pull/4426/files TeddyBear1314 says he tried and failed, can you please address his concern first? thank you very much! On Sat, Apr 15, 2017 at 11:01 AM, George Ni (Chunen Ni) < chunen...@kyligence.io> wrote: > Hi Huangzhi, > > Below are links of

Re: Question regarding topN measure on string column

2017-03-31 Thread hongbin ma
​hi, i believe it's not supported. besides, how do you define "order" on string? I don't think it's a reasonable requirement -- Regards, *Bin Mahone | 马洪宾*

[jira] [Created] (KYLIN-2528) refine job email notification to support starttls and customized port

2017-03-31 Thread hongbin ma (JIRA)
hongbin ma created KYLIN-2528: - Summary: refine job email notification to support starttls and customized port Key: KYLIN-2528 URL: https://issues.apache.org/jira/browse/KYLIN-2528 Project: Kylin

[jira] [Created] (KYLIN-2527) Speedup LookupStringTable, use HashMap instead of ConcurrentHashMap

2017-03-31 Thread hongbin ma (JIRA)
hongbin ma created KYLIN-2527: - Summary: Speedup LookupStringTable, use HashMap instead of ConcurrentHashMap Key: KYLIN-2527 URL: https://issues.apache.org/jira/browse/KYLIN-2527 Project: Kylin

[jira] [Created] (KYLIN-2521) upgrade to calcite 1.12.0

2017-03-27 Thread hongbin ma (JIRA)
hongbin ma created KYLIN-2521: - Summary: upgrade to calcite 1.12.0 Key: KYLIN-2521 URL: https://issues.apache.org/jira/browse/KYLIN-2521 Project: Kylin Issue Type: Task Reporter

[jira] [Created] (KYLIN-2495) query exception when integer column encoded as date/time encoding

2017-03-09 Thread hongbin ma (JIRA)
hongbin ma created KYLIN-2495: - Summary: query exception when integer column encoded as date/time encoding Key: KYLIN-2495 URL: https://issues.apache.org/jira/browse/KYLIN-2495 Project: Kylin

[jira] [Created] (KYLIN-2483) SortedIteratorMergerWithLimit could be slower when number of total merge rows is small

2017-03-05 Thread hongbin ma (JIRA)
hongbin ma created KYLIN-2483: - Summary: SortedIteratorMergerWithLimit could be slower when number of total merge rows is small Key: KYLIN-2483 URL: https://issues.apache.org/jira/browse/KYLIN-2483

[jira] [Created] (KYLIN-2441) protocol for REST API result format

2017-02-09 Thread hongbin ma (JIRA)
hongbin ma created KYLIN-2441: - Summary: protocol for REST API result format Key: KYLIN-2441 URL: https://issues.apache.org/jira/browse/KYLIN-2441 Project: Kylin Issue Type: Bug

Re: Problem while querying Cube

2017-02-07 Thread hongbin ma
ength" is only valid with string types. On Wed, Feb 8, 2017 at 2:34 PM, Shailesh Prajapati <shail...@infoworks.io> wrote: > Hi HongBin, > > Cube for which i provided logs has been deleted, So attaching description > gist of another Cube which is giving the same error, > >

[jira] [Created] (KYLIN-2435) two EXTRACT on a column will fail if there exists NULL values for the column

2017-02-07 Thread hongbin ma (JIRA)
hongbin ma created KYLIN-2435: - Summary: two EXTRACT on a column will fail if there exists NULL values for the column Key: KYLIN-2435 URL: https://issues.apache.org/jira/browse/KYLIN-2435 Project: Kylin

Re: Problem while querying Cube

2017-02-06 Thread hongbin ma
hi Shailesh, can you please attach the cube description? It can be found by click on the cube and find "CUBE(json)". I guess you're using fixed_length encoding for integer type column ORDER_ID, such setting is found to be buggy( https://issues.apache.org/jira/browse/KYLIN-2179) On Sun, Feb 5,

Re: Problem while querying Cube

2017-02-06 Thread hongbin ma
are we mixing two separate issues in the same thread here? On Mon, Feb 6, 2017 at 9:26 PM, ShaoFeng Shi wrote: > NoSuchObjectException(message:default.kylin_intermediate_ > kylin_sales_cube_desc_3a41df7d_93e1_4445_9 > usually this error indicates that hive-site.xml wasn't

Re: Proposal for updating master branch to use HBase 1.x

2017-01-22 Thread hongbin ma
+1 With more and more prod env upgrading to hbase 1.x, Kaige's proposal can help kylin developer to upgrade their development environment( sandbox, qa cluster, etc), so that the gap between dev env and prod env can be minimal. A key message here is we're not stopping support for hbase 0.98.

[jira] [Created] (KYLIN-2302) push the value in statement.setMaxRows(10) to storage

2016-12-20 Thread hongbin ma (JIRA)
hongbin ma created KYLIN-2302: - Summary: push the value in statement.setMaxRows(10) to storage Key: KYLIN-2302 URL: https://issues.apache.org/jira/browse/KYLIN-2302 Project: Kylin Issue Type

Re: [DISCUSS] Call the next release v2.0?

2016-12-18 Thread hongbin ma
+1 On Mon, Dec 19, 2016 at 2:27 PM, roger shi wrote: > +1 > > On 19/12/2016, 2:23 PM, "Li Yang" wrote: > > Guys, > > I'm thinking maybe it's time to call the next release v2.0. Like to > hear > your thoughts. > > Actually the

[jira] [Created] (KYLIN-2292) workaround for CALCITE-1540

2016-12-16 Thread hongbin ma (JIRA)
hongbin ma created KYLIN-2292: - Summary: workaround for CALCITE-1540 Key: KYLIN-2292 URL: https://issues.apache.org/jira/browse/KYLIN-2292 Project: Kylin Issue Type: Bug Reporter

[jira] [Created] (KYLIN-2290) minor improvements on limit

2016-12-16 Thread hongbin ma (JIRA)
hongbin ma created KYLIN-2290: - Summary: minor improvements on limit Key: KYLIN-2290 URL: https://issues.apache.org/jira/browse/KYLIN-2290 Project: Kylin Issue Type: Improvement

[jira] [Created] (KYLIN-2272) limit push down should be disabled for "dimension distinct count"

2016-12-12 Thread hongbin ma (JIRA)
hongbin ma created KYLIN-2272: - Summary: limit push down should be disabled for "dimension distinct count" Key: KYLIN-2272 URL: https://issues.apache.org/jira/browse/KYLIN-2272 Proj

Re: Welcome new Apache Kylin committer: Billy Liu

2016-12-10 Thread hongbin ma
Welcome! On Wed, Nov 30, 2016 at 11:56 AM, Li Yang wrote: > Welcome Billy~~~ > > On Wed, Nov 30, 2016 at 11:13 AM, Yerui Sun wrote: > > > Welcome aboard, Billy! > > > > > 在 2016年11月30日,10:52,2376579413 <2376579...@qq.com> 写道: > > > > > > Congratulations,

Re: Use Spark Cube Engine

2016-12-10 Thread hongbin ma
And the bad news is the spark cubing engine is out of maintenance recently On Sat, Dec 10, 2016 at 5:12 PM, hongbin ma <mahong...@apache.org> wrote: > I'm afraid being experimental also means we don't have documentation for > it, you'll have to dig into the source code a little bi

Re: Use Spark Cube Engine

2016-12-10 Thread hongbin ma
I'm afraid being experimental also means we don't have documentation for it, you'll have to dig into the source code a little bit On Tue, Dec 6, 2016 at 6:09 PM, Luke_Selina wrote: > Though Spark is a experimental component, I still want to have a try, > please > tell

Re: select * clause still case all regionserver crash

2016-12-10 Thread hongbin ma
Hi, are you "qstar" from https://issues.apache.org/jira/browse/KYLIN-1936?focusedCommentId=15727422=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel#comment-15727422 ? Just want to make sure whether it's a individual case or common case On Thu, Dec 8, 2016 at 10:00 AM, alaleiwang

Re: kylin 1.6.0 cardinality can't greater than 5000000 ?

2016-12-10 Thread hongbin ma
You should first figure out the dimension really suits dimension encoding. If a dimension has more than millions of cardinality, its built dictionary's size will lose control. The bad news is that Kylin caches the dictionary in query server's heap as well as in some of the MR mappers head. It

Re: Update default config for sandbox environment

2016-12-08 Thread hongbin ma
hi billy that's really good idea, how do you plan to approach this? On Thu, Dec 8, 2016 at 6:30 PM, Billy Liu wrote: > Hi dev community, > > Most users deploy Kylin on their own sandbox for the first trial. Most > sandbox has most 8G memory. The most used sandboxes are

[jira] [Created] (KYLIN-2246) redesign the way to decide layer cubing reducer count

2016-12-02 Thread hongbin ma (JIRA)
hongbin ma created KYLIN-2246: - Summary: redesign the way to decide layer cubing reducer count Key: KYLIN-2246 URL: https://issues.apache.org/jira/browse/KYLIN-2246 Project: Kylin Issue Type

[jira] [Created] (KYLIN-2240) Add a toggle to ignore all cube signature inconsistency temporally

2016-11-30 Thread hongbin ma (JIRA)
hongbin ma created KYLIN-2240: - Summary: Add a toggle to ignore all cube signature inconsistency temporally Key: KYLIN-2240 URL: https://issues.apache.org/jira/browse/KYLIN-2240 Project: Kylin

[jira] [Created] (KYLIN-2236) statement.setMaxRows(10) is not working

2016-11-30 Thread hongbin ma (JIRA)
hongbin ma created KYLIN-2236: - Summary: statement.setMaxRows(10) is not working Key: KYLIN-2236 URL: https://issues.apache.org/jira/browse/KYLIN-2236 Project: Kylin Issue Type: Bug

Re: [VOTE] Release apache-kylin-1.6.0 (RC2)

2016-11-24 Thread hongbin ma
+1 (binding) mvn test passed -- Regards, *Bin Mahone | 马洪宾*

[jira] [Created] (KYLIN-2227) rename kylin-log4j.properties to kylin-tools-log4j.properties and move it to global conf folder

2016-11-23 Thread hongbin ma (JIRA)
hongbin ma created KYLIN-2227: - Summary: rename kylin-log4j.properties to kylin-tools-log4j.properties and move it to global conf folder Key: KYLIN-2227 URL: https://issues.apache.org/jira/browse/KYLIN-2227

[jira] [Created] (KYLIN-2222) web GUI should use the column types to valid encodings mapping provided by backend

2016-11-22 Thread hongbin ma (JIRA)
hongbin ma created KYLIN-: - Summary: web GUI should use the column types to valid encodings mapping provided by backend Key: KYLIN- URL: https://issues.apache.org/jira/browse/KYLIN- Project

[jira] [Created] (KYLIN-2221) rethink on KYLIN-1684

2016-11-21 Thread hongbin ma (JIRA)
hongbin ma created KYLIN-2221: - Summary: rethink on KYLIN-1684 Key: KYLIN-2221 URL: https://issues.apache.org/jira/browse/KYLIN-2221 Project: Kylin Issue Type: Improvement Reporter

[jira] [Created] (KYLIN-2193) parameterise org.apache.kylin.storage.translate.DerivedFilterTranslator#IN_THRESHOLD

2016-11-15 Thread hongbin ma (JIRA)
hongbin ma created KYLIN-2193: - Summary: parameterise org.apache.kylin.storage.translate.DerivedFilterTranslator#IN_THRESHOLD Key: KYLIN-2193 URL: https://issues.apache.org/jira/browse/KYLIN-2193 Project

[jira] [Created] (KYLIN-2181) remove integer as fixed_length in test_kylin_cube_with_slr_empty desc

2016-11-13 Thread hongbin ma (JIRA)
hongbin ma created KYLIN-2181: - Summary: remove integer as fixed_length in test_kylin_cube_with_slr_empty desc Key: KYLIN-2181 URL: https://issues.apache.org/jira/browse/KYLIN-2181 Project: Kylin

[jira] [Created] (KYLIN-2179) should disable limit push down if there exists fixed_lenth encoding for integers in the rowkey

2016-11-13 Thread hongbin ma (JIRA)
hongbin ma created KYLIN-2179: - Summary: should disable limit push down if there exists fixed_lenth encoding for integers in the rowkey Key: KYLIN-2179 URL: https://issues.apache.org/jira/browse/KYLIN-2179

[jira] [Created] (KYLIN-2175) cubestatsreader support reading unfinished segments

2016-11-10 Thread hongbin ma (JIRA)
hongbin ma created KYLIN-2175: - Summary: cubestatsreader support reading unfinished segments Key: KYLIN-2175 URL: https://issues.apache.org/jira/browse/KYLIN-2175 Project: Kylin Issue Type

[jira] [Created] (KYLIN-2168) changes on cube-level-config will cause cube inconsistency

2016-11-07 Thread hongbin ma (JIRA)
hongbin ma created KYLIN-2168: - Summary: changes on cube-level-config will cause cube inconsistency Key: KYLIN-2168 URL: https://issues.apache.org/jira/browse/KYLIN-2168 Project: Kylin Issue

[jira] [Created] (KYLIN-2156) support filters like a != 0

2016-11-03 Thread hongbin ma (JIRA)
hongbin ma created KYLIN-2156: - Summary: support filters like a != 0 Key: KYLIN-2156 URL: https://issues.apache.org/jira/browse/KYLIN-2156 Project: Kylin Issue Type: Bug Reporter

[jira] [Created] (KYLIN-2152) TopN group by column does not distinguish between NULL and ""

2016-11-02 Thread hongbin ma (JIRA)
hongbin ma created KYLIN-2152: - Summary: TopN group by column does not distinguish between NULL and "" Key: KYLIN-2152 URL: https://issues.apache.org/jira/browse/KYLIN-2152 Project: Kylin

[jira] [Created] (KYLIN-2145) StorageCleanupJob will fail when beeline enabled

2016-11-01 Thread hongbin ma (JIRA)
hongbin ma created KYLIN-2145: - Summary: StorageCleanupJob will fail when beeline enabled Key: KYLIN-2145 URL: https://issues.apache.org/jira/browse/KYLIN-2145 Project: Kylin Issue Type: Bug

[jira] [Created] (KYLIN-2134) Kylin will treat empty string as NULL by mistake

2016-10-27 Thread hongbin ma (JIRA)
hongbin ma created KYLIN-2134: - Summary: Kylin will treat empty string as NULL by mistake Key: KYLIN-2134 URL: https://issues.apache.org/jira/browse/KYLIN-2134 Project: Kylin Issue Type: Bug

[jira] [Created] (KYLIN-2125) Support using beeline to load hive table metadata

2016-10-24 Thread hongbin ma (JIRA)
hongbin ma created KYLIN-2125: - Summary: Support using beeline to load hive table metadata Key: KYLIN-2125 URL: https://issues.apache.org/jira/browse/KYLIN-2125 Project: Kylin Issue Type: Bug

[jira] [Created] (KYLIN-2071) automatically renew kerbose tgt

2016-10-08 Thread hongbin ma (JIRA)
hongbin ma created KYLIN-2071: - Summary: automatically renew kerbose tgt Key: KYLIN-2071 URL: https://issues.apache.org/jira/browse/KYLIN-2071 Project: Kylin Issue Type: Improvement

Re: kylin-1.5.4同步hive元数据报错

2016-09-20 Thread hongbin ma
cannot reproduce either when you run kylin.sh, there will be stdout telling the extracted hive/hbase dependency paths, can you attach them for further analysis? On Tue, Sep 20, 2016 at 10:51 AM, Li Yang wrote: > We may not be able to reproduce the problem (at least I

[jira] [Created] (KYLIN-2031) some more DimensionEncoding

2016-09-19 Thread hongbin ma (JIRA)
hongbin ma created KYLIN-2031: - Summary: some more DimensionEncoding Key: KYLIN-2031 URL: https://issues.apache.org/jira/browse/KYLIN-2031 Project: Kylin Issue Type: New Feature

[jira] [Created] (KYLIN-2021) Cognos Issues

2016-09-17 Thread hongbin ma (JIRA)
hongbin ma created KYLIN-2021: - Summary: Cognos Issues Key: KYLIN-2021 URL: https://issues.apache.org/jira/browse/KYLIN-2021 Project: Kylin Issue Type: Improvement Reporter: hongbin

Re: [Announce] Apache Kylin 1.5.4 released

2016-09-17 Thread hongbin ma
thanks shaofeng! On Fri, Sep 16, 2016 at 10:34 PM, Billy(Yiming) Liu wrote: > Thanks Shaofeng and our community. > > 2016-09-16 21:25 GMT+08:00 ShaoFeng Shi : > >> The Apache Kylin team is pleased to announce the immediate availability of >> the

Re: 答复: [VOTE] Release apache-kylin-1.5.4 (release candidate 1)

2016-09-13 Thread hongbin ma
+1 binding ​signature verifed -- Regards, *Bin Mahone | 马洪宾*

[jira] [Created] (KYLIN-2005) Move all storage side behavior hints to GTScanRequest

2016-09-09 Thread hongbin ma (JIRA)
hongbin ma created KYLIN-2005: - Summary: Move all storage side behavior hints to GTScanRequest Key: KYLIN-2005 URL: https://issues.apache.org/jira/browse/KYLIN-2005 Project: Kylin Issue Type

[jira] [Created] (KYLIN-1999) Use some compression at UT/IT

2016-09-07 Thread hongbin ma (JIRA)
hongbin ma created KYLIN-1999: - Summary: Use some compression at UT/IT Key: KYLIN-1999 URL: https://issues.apache.org/jira/browse/KYLIN-1999 Project: Kylin Issue Type: Improvement

Re: Do not order columns for Auto Generate Dimensions in Cube Design

2016-09-03 Thread hongbin ma
"desc table", no reorder happens, and the original order normal has some > kinds of relationship. > > 2016-09-03 16:13 GMT+08:00 hongbin ma <mahong...@apache.org>: > > > ​+1 > > > > ​alphabetical order obviously makes no sense. can we sort them

Re: Turn off some hive configuration commands when they are not allowed

2016-09-03 Thread hongbin ma
Do we have JIRAs to track the issue? it's easy to forget On Sat, Sep 3, 2016 at 5:57 PM, Yiming Liu <liuyiming@gmail.com> wrote: > No progress, pending. > > 2016-09-03 17:36 GMT+08:00 hongbin ma <mahong...@apache.org>: > > > do we have any progress on such do

Re: Turn off some hive configuration commands when they are not allowed

2016-09-03 Thread hongbin ma
do we have any progress on such documents? On Tue, Aug 2, 2016 at 8:50 AM, Yiming Liu wrote: > Thanks, Shaofeng. It makes sense to grant enough privileges to Kylin for > Cube building. Just in some extreme cases, the privilege issue will be a > show stop. > > The

Re: Do not order columns for Auto Generate Dimensions in Cube Design

2016-09-03 Thread hongbin ma
​+1 ​alphabetical order obviously makes no sense. can we sort them by cardinality? -- Regards, *Bin Mahone | 马洪宾*

Re: [jira] [Commented] (KYLIN-1994) Build Cube failing

2016-09-03 Thread hongbin ma
hi guys please try to use JIRA comment instead of email reply. cuz email reply messages are not appearing on JIRA https://issues.apache.org/jira/browse/INFRA-12561 On Sat, Sep 3, 2016 at 11:08 AM, siva kumar Rachaputi (JIRA) < j...@apache.org> wrote: > > [

[jira] [Created] (KYLIN-1981) PK/FK derived will break for left join in some cases

2016-08-29 Thread hongbin ma (JIRA)
hongbin ma created KYLIN-1981: - Summary: PK/FK derived will break for left join in some cases Key: KYLIN-1981 URL: https://issues.apache.org/jira/browse/KYLIN-1981 Project: Kylin Issue Type: Bug

[jira] [Created] (KYLIN-1979) Move hackNoGroupByAggregation to cube-based storage implementations

2016-08-28 Thread hongbin ma (JIRA)
hongbin ma created KYLIN-1979: - Summary: Move hackNoGroupByAggregation to cube-based storage implementations Key: KYLIN-1979 URL: https://issues.apache.org/jira/browse/KYLIN-1979 Project: Kylin

Re: Kylin Query Performance

2016-08-27 Thread hongbin ma
does your test query contain any aggregations? like min max sum. If no aggregation exists, then the query will seek to scan base cuboid, which is nearly as large as raw data in some bad cases. On Fri, Aug 19, 2016 at 11:10 AM, Mars J wrote: > just 'select A,B from Fact

Re: [jira] [Commented] (KYLIN-1908) Collect Metrics to JMX

2016-08-27 Thread hongbin ma
​The documentation itself looks good. where should we put the document? the blog(current approach) or "Docs"? I prefer the latter because JMX is basic feature and it should be better categoried On Sun, Aug 28, 2016 at 10:23 AM, Billy(Yiming) Liu (JIRA) wrote: > > [

[jira] [Created] (KYLIN-1964) Add a companion tool of CubeMetaExtractor for cube importing

2016-08-18 Thread hongbin ma (JIRA)
hongbin ma created KYLIN-1964: - Summary: Add a companion tool of CubeMetaExtractor for cube importing Key: KYLIN-1964 URL: https://issues.apache.org/jira/browse/KYLIN-1964 Project: Kylin Issue

Re: Derived measures in Kylin

2016-08-10 Thread hongbin ma
I still don't quite understand your problem. What exception are your witnessing when you run queries containing (SUM(BaseSalary) + SUM(Hra))/SUM(DA)? On Wed, Aug 10, 2016 at 1:10 PM, Reshma wrote: > Hi,To clarify, lets says we want feature likeI have following columns

Re: Re: Build Cube killed by admin

2016-08-10 Thread hongbin ma
​As the step output indicates the job failed because of "killed by admin", in these cases you usually need to check hadoop's log​ -- Regards, *Bin Mahone | 马洪宾*

Re: 答复: Question abount BuildInFunctionTransformer

2016-08-10 Thread hongbin ma
JIRA: https://issues.apache.org/jira/browse/KYLIN-1954 thanks for reporting! On Thu, Aug 11, 2016 at 10:54 AM, hongbin ma <mahong...@apache.org> wrote: > I think you're right on this. > > the code modifies the filter in the first CubeSegmentScanner and won't get > modified

[jira] [Created] (KYLIN-1954) BuildInFunctionTransformer should be executed per CubeSegmentScanner

2016-08-10 Thread hongbin ma (JIRA)
hongbin ma created KYLIN-1954: - Summary: BuildInFunctionTransformer should be executed per CubeSegmentScanner Key: KYLIN-1954 URL: https://issues.apache.org/jira/browse/KYLIN-1954 Project: Kylin

Re: 答复: Question abount BuildInFunctionTransformer

2016-08-10 Thread hongbin ma
I think you're right on this. the code modifies the filter in the first CubeSegmentScanner and won't get modified in the subsequent CubeSegmentScanners again. Due to the difference of different segment's dictionaries, it might be wrong. I'm opening a JIRA for this and it will be fixed in 1.5.4

Re: Kylin Cube Performance

2016-08-04 Thread hongbin ma
roach it if that's the case. > > On Thu, Aug 4, 2016 at 10:31 AM, hongbin ma <mahong...@apache.org> wrote: > > > Hi Jason > > > > As Shaofeng explained it's not reasonable to expect sub-second latency if > > you're returning tens of millions of records. You

Re: Kylin Cube Performance

2016-08-04 Thread hongbin ma
Hi Jason As Shaofeng explained it's not reasonable to expect sub-second latency if you're returning tens of millions of records. You data model is quite simple and you don't have costly measure like distinct count etc., so kylin should be performant on normal OLAP queries. Another advise: if the

Re: Build Cube killed by admin

2016-08-04 Thread hongbin ma
​no zip files found have you checked the hadoop logs?​ On Thu, Aug 4, 2016 at 4:12 PM, liuhua...@neusoft.com wrote: > > onf /opt/apache-kylin-1.5.3-bin/conf/kylin_job_conf_inmem.xml -cubename > test0804 -segmentname FULL_BUILD -output >

Re: Question abount BuildInFunctionTransformer

2016-08-04 Thread hongbin ma
To me the translation is expected behavior On Thu, Aug 4, 2016 at 10:47 PM, Yiming Liu wrote: > Why do you think that's not expectation? What's the expected translation? > Kylin will encode the dimension column original value into internal > representation. And based on

  1   2   3   >