[jira] [Commented] (KYLIN-2022) Kylin support change HBASE_HOME at runtime.
[ https://issues.apache.org/jira/browse/KYLIN-2022?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15500232#comment-15500232 ] Billy(Yiming) Liu commented on KYLIN-2022: -- It's a mutil-tenancy requirement, currently Kylin has not supported yet. Hi [~liguohui] Do you have patch for it? The contribution is welcomed. But I don't think there is guarantee to finish it in 1.6.0. > Kylin support change HBASE_HOME at runtime. > --- > > Key: KYLIN-2022 > URL: https://issues.apache.org/jira/browse/KYLIN-2022 > Project: Kylin > Issue Type: New Feature >Reporter: Guohui LI > Fix For: v1.6.0 > > > In multi-tenancy system. each tenant can create one or more hbase cluster. > Different user may use different HBASE_HOME when using Kylin. So it's better > for user to point out HBASE_HOME when operating Cube or query. -- This message was sent by Atlassian JIRA (v6.3.4#6332)
[jira] [Closed] (KYLIN-2007) CUBOID_CACHE is not cleared when rebuilding ALL cache
[ https://issues.apache.org/jira/browse/KYLIN-2007?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Dayue Gao closed KYLIN-2007. Resolution: Fixed Fix Version/s: v1.6.0 > CUBOID_CACHE is not cleared when rebuilding ALL cache > - > > Key: KYLIN-2007 > URL: https://issues.apache.org/jira/browse/KYLIN-2007 > Project: Kylin > Issue Type: Bug > Components: Query Engine >Affects Versions: v1.5.3 >Reporter: Dayue Gao >Assignee: Dayue Gao >Priority: Minor > Fix For: v1.6.0 > > Attachments: KYLIN-2007.patch > > > CubeMigrationCLI tool sends requests to wipe ALL cache of kylin instances to > invalidate possibly stale cache. However we forgot to clear > Cuboid.CUBOID_CACHE in CacheService#rebuildCache, which can lead to incorrect > query results. -- This message was sent by Atlassian JIRA (v6.3.4#6332)
[jira] [Updated] (KYLIN-1978) kylin.sh compatible issue on Ubuntu
[
https://issues.apache.org/jira/browse/KYLIN-1978?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
]
Billy(Yiming) Liu updated KYLIN-1978:
-
Attachment: KYLIN-1978.patch
> kylin.sh compatible issue on Ubuntu
> ---
>
> Key: KYLIN-1978
> URL: https://issues.apache.org/jira/browse/KYLIN-1978
> Project: Kylin
> Issue Type: Bug
> Components: Environment
>Affects Versions: v1.5.3
>Reporter: Shaofeng SHI
>Assignee: Billy(Yiming) Liu
> Fix For: Backlog
>
> Attachments: KYLIN-1978.patch
>
>
> Reported by Marcelo(marcelo.n...@quantium.com.au) in the mailing list:
> DISTRIB_ID=Ubuntu
> DISTRIB_RELEASE=14.04
> DISTRIB_CODENAME=trusty
> DISTRIB_DESCRIPTION="Ubuntu 14.04.4 LTS"
> NAME="Ubuntu"
> VERSION="14.04.4 LTS, Trusty Tahr"
> ID=ubuntu
> ID_LIKE=debian
> PRETTY_NAME="Ubuntu 14.04.4 LTS"
> VERSION_ID="14.04"
> HOME_URL="http://www.ubuntu.com/;
> SUPPORT_URL="http://help.ubuntu.com/;
> BUG_REPORT_URL="http://bugs.launchpad.net/ubuntu/;
> mapr@qtausc-vpcsdev04:~/kylin/apache-kylin-1.5.3-HBase1.x-bin/bin$ ./kylin.sh
> start
> *KYLIN_HOME is set to /home/mapr/kylin/apache-kylin-1.5.3-HBase1.x-bin*
> cat: invalid option -- '1'
> Try 'cat --help' for more information.
> -mkdir: Not enough arguments: expected 1 but got 0
> Usage: hadoop fs [generic options] -mkdir [-p] ...
> failed to create , Please make sure the user has right to access
> That is what is happening when I try to start kylin.
> I traced the error and the first one come from get-properties.sh at these
> line
> for i in `cat ${KYLIN_HOME}/conf/kylin.properties | grep -w "^$1" | grep -v
> '^#' | awk -F= '{ n = index($0,"="); print substr($0,n+1)}' | cut -c 1-`
> and as you can see kylin home is set.
--
This message was sent by Atlassian JIRA
(v6.3.4#6332)
[jira] [Updated] (KYLIN-1978) kylin.sh compatible issue on Ubuntu
[
https://issues.apache.org/jira/browse/KYLIN-1978?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
]
Billy(Yiming) Liu updated KYLIN-1978:
-
Attachment: (was: KYLIN-1978)
> kylin.sh compatible issue on Ubuntu
> ---
>
> Key: KYLIN-1978
> URL: https://issues.apache.org/jira/browse/KYLIN-1978
> Project: Kylin
> Issue Type: Bug
> Components: Environment
>Affects Versions: v1.5.3
>Reporter: Shaofeng SHI
>Assignee: Billy(Yiming) Liu
> Fix For: Backlog
>
> Attachments: KYLIN-1978.patch
>
>
> Reported by Marcelo(marcelo.n...@quantium.com.au) in the mailing list:
> DISTRIB_ID=Ubuntu
> DISTRIB_RELEASE=14.04
> DISTRIB_CODENAME=trusty
> DISTRIB_DESCRIPTION="Ubuntu 14.04.4 LTS"
> NAME="Ubuntu"
> VERSION="14.04.4 LTS, Trusty Tahr"
> ID=ubuntu
> ID_LIKE=debian
> PRETTY_NAME="Ubuntu 14.04.4 LTS"
> VERSION_ID="14.04"
> HOME_URL="http://www.ubuntu.com/;
> SUPPORT_URL="http://help.ubuntu.com/;
> BUG_REPORT_URL="http://bugs.launchpad.net/ubuntu/;
> mapr@qtausc-vpcsdev04:~/kylin/apache-kylin-1.5.3-HBase1.x-bin/bin$ ./kylin.sh
> start
> *KYLIN_HOME is set to /home/mapr/kylin/apache-kylin-1.5.3-HBase1.x-bin*
> cat: invalid option -- '1'
> Try 'cat --help' for more information.
> -mkdir: Not enough arguments: expected 1 but got 0
> Usage: hadoop fs [generic options] -mkdir [-p] ...
> failed to create , Please make sure the user has right to access
> That is what is happening when I try to start kylin.
> I traced the error and the first one come from get-properties.sh at these
> line
> for i in `cat ${KYLIN_HOME}/conf/kylin.properties | grep -w "^$1" | grep -v
> '^#' | awk -F= '{ n = index($0,"="); print substr($0,n+1)}' | cut -c 1-`
> and as you can see kylin home is set.
--
This message was sent by Atlassian JIRA
(v6.3.4#6332)
[jira] [Updated] (KYLIN-1978) kylin.sh compatible issue on Ubuntu
[
https://issues.apache.org/jira/browse/KYLIN-1978?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
]
Billy(Yiming) Liu updated KYLIN-1978:
-
Attachment: KYLIN-1978.patch
Patch is ready for review
> kylin.sh compatible issue on Ubuntu
> ---
>
> Key: KYLIN-1978
> URL: https://issues.apache.org/jira/browse/KYLIN-1978
> Project: Kylin
> Issue Type: Bug
> Components: Environment
>Affects Versions: v1.5.3
>Reporter: Shaofeng SHI
>Assignee: Billy(Yiming) Liu
> Fix For: Backlog
>
> Attachments: KYLIN-1978.patch
>
>
> Reported by Marcelo(marcelo.n...@quantium.com.au) in the mailing list:
> DISTRIB_ID=Ubuntu
> DISTRIB_RELEASE=14.04
> DISTRIB_CODENAME=trusty
> DISTRIB_DESCRIPTION="Ubuntu 14.04.4 LTS"
> NAME="Ubuntu"
> VERSION="14.04.4 LTS, Trusty Tahr"
> ID=ubuntu
> ID_LIKE=debian
> PRETTY_NAME="Ubuntu 14.04.4 LTS"
> VERSION_ID="14.04"
> HOME_URL="http://www.ubuntu.com/;
> SUPPORT_URL="http://help.ubuntu.com/;
> BUG_REPORT_URL="http://bugs.launchpad.net/ubuntu/;
> mapr@qtausc-vpcsdev04:~/kylin/apache-kylin-1.5.3-HBase1.x-bin/bin$ ./kylin.sh
> start
> *KYLIN_HOME is set to /home/mapr/kylin/apache-kylin-1.5.3-HBase1.x-bin*
> cat: invalid option -- '1'
> Try 'cat --help' for more information.
> -mkdir: Not enough arguments: expected 1 but got 0
> Usage: hadoop fs [generic options] -mkdir [-p] ...
> failed to create , Please make sure the user has right to access
> That is what is happening when I try to start kylin.
> I traced the error and the first one come from get-properties.sh at these
> line
> for i in `cat ${KYLIN_HOME}/conf/kylin.properties | grep -w "^$1" | grep -v
> '^#' | awk -F= '{ n = index($0,"="); print substr($0,n+1)}' | cut -c 1-`
> and as you can see kylin home is set.
--
This message was sent by Atlassian JIRA
(v6.3.4#6332)
[jira] [Created] (KYLIN-2021) Cognos Issues
hongbin ma created KYLIN-2021: - Summary: Cognos Issues Key: KYLIN-2021 URL: https://issues.apache.org/jira/browse/KYLIN-2021 Project: Kylin Issue Type: Improvement Reporter: hongbin ma Assignee: hongbin ma cognos will generate some queries that kylin does not support yet -- This message was sent by Atlassian JIRA (v6.3.4#6332)
[jira] [Commented] (KYLIN-1978) kylin.sh compatible issue on Ubuntu
[
https://issues.apache.org/jira/browse/KYLIN-1978?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15500032#comment-15500032
]
Billy(Yiming) Liu commented on KYLIN-1978:
--
The issue is not related with 'awk statement' which trims the whitespace. It's
related the variable 'IFS'.
If we remove the IFS, it works. But I have no idea why IFS was defined '\n'.
[~shaofengniu] What do you think ,could we remove the IFS?
> kylin.sh compatible issue on Ubuntu
> ---
>
> Key: KYLIN-1978
> URL: https://issues.apache.org/jira/browse/KYLIN-1978
> Project: Kylin
> Issue Type: Bug
> Components: Environment
>Affects Versions: v1.5.3
>Reporter: Shaofeng SHI
>Assignee: Billy(Yiming) Liu
> Fix For: Backlog
>
>
> Reported by Marcelo(marcelo.n...@quantium.com.au) in the mailing list:
> DISTRIB_ID=Ubuntu
> DISTRIB_RELEASE=14.04
> DISTRIB_CODENAME=trusty
> DISTRIB_DESCRIPTION="Ubuntu 14.04.4 LTS"
> NAME="Ubuntu"
> VERSION="14.04.4 LTS, Trusty Tahr"
> ID=ubuntu
> ID_LIKE=debian
> PRETTY_NAME="Ubuntu 14.04.4 LTS"
> VERSION_ID="14.04"
> HOME_URL="http://www.ubuntu.com/;
> SUPPORT_URL="http://help.ubuntu.com/;
> BUG_REPORT_URL="http://bugs.launchpad.net/ubuntu/;
> mapr@qtausc-vpcsdev04:~/kylin/apache-kylin-1.5.3-HBase1.x-bin/bin$ ./kylin.sh
> start
> *KYLIN_HOME is set to /home/mapr/kylin/apache-kylin-1.5.3-HBase1.x-bin*
> cat: invalid option -- '1'
> Try 'cat --help' for more information.
> -mkdir: Not enough arguments: expected 1 but got 0
> Usage: hadoop fs [generic options] -mkdir [-p] ...
> failed to create , Please make sure the user has right to access
> That is what is happening when I try to start kylin.
> I traced the error and the first one come from get-properties.sh at these
> line
> for i in `cat ${KYLIN_HOME}/conf/kylin.properties | grep -w "^$1" | grep -v
> '^#' | awk -F= '{ n = index($0,"="); print substr($0,n+1)}' | cut -c 1-`
> and as you can see kylin home is set.
--
This message was sent by Atlassian JIRA
(v6.3.4#6332)
[jira] [Updated] (KYLIN-1978) kylin.sh compatible issue on Ubuntu
[
https://issues.apache.org/jira/browse/KYLIN-1978?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
]
Billy(Yiming) Liu updated KYLIN-1978:
-
Attachment: KYLIN-1978
The patch is updated to support multiple spaces split value.
> kylin.sh compatible issue on Ubuntu
> ---
>
> Key: KYLIN-1978
> URL: https://issues.apache.org/jira/browse/KYLIN-1978
> Project: Kylin
> Issue Type: Bug
> Components: Environment
>Affects Versions: v1.5.3
>Reporter: Shaofeng SHI
>Assignee: Billy(Yiming) Liu
> Fix For: Backlog
>
> Attachments: KYLIN-1978
>
>
> Reported by Marcelo(marcelo.n...@quantium.com.au) in the mailing list:
> DISTRIB_ID=Ubuntu
> DISTRIB_RELEASE=14.04
> DISTRIB_CODENAME=trusty
> DISTRIB_DESCRIPTION="Ubuntu 14.04.4 LTS"
> NAME="Ubuntu"
> VERSION="14.04.4 LTS, Trusty Tahr"
> ID=ubuntu
> ID_LIKE=debian
> PRETTY_NAME="Ubuntu 14.04.4 LTS"
> VERSION_ID="14.04"
> HOME_URL="http://www.ubuntu.com/;
> SUPPORT_URL="http://help.ubuntu.com/;
> BUG_REPORT_URL="http://bugs.launchpad.net/ubuntu/;
> mapr@qtausc-vpcsdev04:~/kylin/apache-kylin-1.5.3-HBase1.x-bin/bin$ ./kylin.sh
> start
> *KYLIN_HOME is set to /home/mapr/kylin/apache-kylin-1.5.3-HBase1.x-bin*
> cat: invalid option -- '1'
> Try 'cat --help' for more information.
> -mkdir: Not enough arguments: expected 1 but got 0
> Usage: hadoop fs [generic options] -mkdir [-p] ...
> failed to create , Please make sure the user has right to access
> That is what is happening when I try to start kylin.
> I traced the error and the first one come from get-properties.sh at these
> line
> for i in `cat ${KYLIN_HOME}/conf/kylin.properties | grep -w "^$1" | grep -v
> '^#' | awk -F= '{ n = index($0,"="); print substr($0,n+1)}' | cut -c 1-`
> and as you can see kylin home is set.
--
This message was sent by Atlassian JIRA
(v6.3.4#6332)
[jira] [Updated] (KYLIN-1978) kylin.sh compatible issue on Ubuntu
[
https://issues.apache.org/jira/browse/KYLIN-1978?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
]
Billy(Yiming) Liu updated KYLIN-1978:
-
Attachment: (was: KYLIN-1978.patch)
> kylin.sh compatible issue on Ubuntu
> ---
>
> Key: KYLIN-1978
> URL: https://issues.apache.org/jira/browse/KYLIN-1978
> Project: Kylin
> Issue Type: Bug
> Components: Environment
>Affects Versions: v1.5.3
>Reporter: Shaofeng SHI
>Assignee: Billy(Yiming) Liu
> Fix For: Backlog
>
>
> Reported by Marcelo(marcelo.n...@quantium.com.au) in the mailing list:
> DISTRIB_ID=Ubuntu
> DISTRIB_RELEASE=14.04
> DISTRIB_CODENAME=trusty
> DISTRIB_DESCRIPTION="Ubuntu 14.04.4 LTS"
> NAME="Ubuntu"
> VERSION="14.04.4 LTS, Trusty Tahr"
> ID=ubuntu
> ID_LIKE=debian
> PRETTY_NAME="Ubuntu 14.04.4 LTS"
> VERSION_ID="14.04"
> HOME_URL="http://www.ubuntu.com/;
> SUPPORT_URL="http://help.ubuntu.com/;
> BUG_REPORT_URL="http://bugs.launchpad.net/ubuntu/;
> mapr@qtausc-vpcsdev04:~/kylin/apache-kylin-1.5.3-HBase1.x-bin/bin$ ./kylin.sh
> start
> *KYLIN_HOME is set to /home/mapr/kylin/apache-kylin-1.5.3-HBase1.x-bin*
> cat: invalid option -- '1'
> Try 'cat --help' for more information.
> -mkdir: Not enough arguments: expected 1 but got 0
> Usage: hadoop fs [generic options] -mkdir [-p] ...
> failed to create , Please make sure the user has right to access
> That is what is happening when I try to start kylin.
> I traced the error and the first one come from get-properties.sh at these
> line
> for i in `cat ${KYLIN_HOME}/conf/kylin.properties | grep -w "^$1" | grep -v
> '^#' | awk -F= '{ n = index($0,"="); print substr($0,n+1)}' | cut -c 1-`
> and as you can see kylin home is set.
--
This message was sent by Atlassian JIRA
(v6.3.4#6332)
[jira] [Issue Comment Deleted] (KYLIN-1978) kylin.sh compatible issue on Ubuntu
[
https://issues.apache.org/jira/browse/KYLIN-1978?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
]
Billy(Yiming) Liu updated KYLIN-1978:
-
Comment: was deleted
(was: Patch is ready for review)
> kylin.sh compatible issue on Ubuntu
> ---
>
> Key: KYLIN-1978
> URL: https://issues.apache.org/jira/browse/KYLIN-1978
> Project: Kylin
> Issue Type: Bug
> Components: Environment
>Affects Versions: v1.5.3
>Reporter: Shaofeng SHI
>Assignee: Billy(Yiming) Liu
> Fix For: Backlog
>
>
> Reported by Marcelo(marcelo.n...@quantium.com.au) in the mailing list:
> DISTRIB_ID=Ubuntu
> DISTRIB_RELEASE=14.04
> DISTRIB_CODENAME=trusty
> DISTRIB_DESCRIPTION="Ubuntu 14.04.4 LTS"
> NAME="Ubuntu"
> VERSION="14.04.4 LTS, Trusty Tahr"
> ID=ubuntu
> ID_LIKE=debian
> PRETTY_NAME="Ubuntu 14.04.4 LTS"
> VERSION_ID="14.04"
> HOME_URL="http://www.ubuntu.com/;
> SUPPORT_URL="http://help.ubuntu.com/;
> BUG_REPORT_URL="http://bugs.launchpad.net/ubuntu/;
> mapr@qtausc-vpcsdev04:~/kylin/apache-kylin-1.5.3-HBase1.x-bin/bin$ ./kylin.sh
> start
> *KYLIN_HOME is set to /home/mapr/kylin/apache-kylin-1.5.3-HBase1.x-bin*
> cat: invalid option -- '1'
> Try 'cat --help' for more information.
> -mkdir: Not enough arguments: expected 1 but got 0
> Usage: hadoop fs [generic options] -mkdir [-p] ...
> failed to create , Please make sure the user has right to access
> That is what is happening when I try to start kylin.
> I traced the error and the first one come from get-properties.sh at these
> line
> for i in `cat ${KYLIN_HOME}/conf/kylin.properties | grep -w "^$1" | grep -v
> '^#' | awk -F= '{ n = index($0,"="); print substr($0,n+1)}' | cut -c 1-`
> and as you can see kylin home is set.
--
This message was sent by Atlassian JIRA
(v6.3.4#6332)
[jira] [Updated] (KYLIN-2022) Kylin support change HBASE_HOME at runtime.
[ https://issues.apache.org/jira/browse/KYLIN-2022?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Guohui LI updated KYLIN-2022: - Fix Version/s: v1.6.0 > Kylin support change HBASE_HOME at runtime. > --- > > Key: KYLIN-2022 > URL: https://issues.apache.org/jira/browse/KYLIN-2022 > Project: Kylin > Issue Type: New Feature >Reporter: Guohui LI > Fix For: v1.6.0 > > > In multi-tenancy system. each tenant can create one or more hbase cluster. > Different user may use different HBASE_HOME when using Kylin. So it's better > for user to point out HBASE_HOME when operating Cube or query. -- This message was sent by Atlassian JIRA (v6.3.4#6332)
[jira] [Created] (KYLIN-2022) Kylin support change HBASE_HOME at runtime.
Guohui LI created KYLIN-2022: Summary: Kylin support change HBASE_HOME at runtime. Key: KYLIN-2022 URL: https://issues.apache.org/jira/browse/KYLIN-2022 Project: Kylin Issue Type: New Feature Reporter: Guohui LI In multi-tenancy system. each tenant can create one or more hbase cluster. Different user may use different HBASE_HOME when using Kylin. So it's better for user to point out HBASE_HOME when operating Cube or query. -- This message was sent by Atlassian JIRA (v6.3.4#6332)
[jira] [Updated] (KYLIN-1989) Sum(expression): result not consistent with hive
[ https://issues.apache.org/jira/browse/KYLIN-1989?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] liyang updated KYLIN-1989: -- Summary: Sum(expression): result not consistent with hive (was: Sum issue: result not consistent with hive) > Sum(expression): result not consistent with hive > > > Key: KYLIN-1989 > URL: https://issues.apache.org/jira/browse/KYLIN-1989 > Project: Kylin > Issue Type: Bug >Affects Versions: v1.5.2 >Reporter: Le Van Ha >Assignee: hongbin ma > Attachments: hive_result.png, kylin_result.png > > > When do the following query, > SELECT channel.name, sum(case when product.product_vendor <> '' then > fact_product.quantity else 0 end) > FROM fact_product_sales as fact_product > join dim_product as product on fact_product.product_id = product.id > join dim_channel as channel on fact_product.channel_id = channel.id > GROUP BY channel.name > --- > The result by kylin: > Buy Button0 > Online Store 0 > --- > The result by hive is shown in figure. > Why is that? -- This message was sent by Atlassian JIRA (v6.3.4#6332)
[jira] [Updated] (KYLIN-2006) Make job build server distributed and HA
[ https://issues.apache.org/jira/browse/KYLIN-2006?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] liyang updated KYLIN-2006: -- Summary: Make job build server distributed and HA (was: Make job build server distributed) > Make job build server distributed and HA > > > Key: KYLIN-2006 > URL: https://issues.apache.org/jira/browse/KYLIN-2006 > Project: Kylin > Issue Type: New Feature > Components: Job Engine >Reporter: kangkaisen >Assignee: kangkaisen > > Currently, the Kylin job build server is single-point。 > In order to make Kylin job build server more extensible, available and > reliable, we should support distributed job build server. -- This message was sent by Atlassian JIRA (v6.3.4#6332)
[jira] [Commented] (KYLIN-1962) Split kylin.properties into two files
[ https://issues.apache.org/jira/browse/KYLIN-1962?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15498884#comment-15498884 ] Billy(Yiming) Liu commented on KYLIN-1962: -- If no need, I'd like remove the changed code. > Split kylin.properties into two files > - > > Key: KYLIN-1962 > URL: https://issues.apache.org/jira/browse/KYLIN-1962 > Project: Kylin > Issue Type: Improvement >Reporter: liyang >Assignee: Billy(Yiming) Liu > > Split kylin.properties into two files: normal properties and security > sensitive properties -- This message was sent by Atlassian JIRA (v6.3.4#6332)
[jira] [Commented] (KYLIN-1573) aggregator expression like sum(a+b) is not working
[ https://issues.apache.org/jira/browse/KYLIN-1573?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15499096#comment-15499096 ] hongbin ma commented on KYLIN-1573: --- maybe we can borrow the idea of UDAF frameworks from hive to allow customized aggregate functions. With UDAF users can define his own aggregator (with a separate jar) that will be used both in cube building and cube querying. The drawback is he has to create and use a new aggregator name, which will be a problem if the queries are automatically generated by BI tools. Hive UDAF is already the de facto standard and spark borrows it too. Creating a new column with Hive View is the suggested option for now. > aggregator expression like sum(a+b) is not working > -- > > Key: KYLIN-1573 > URL: https://issues.apache.org/jira/browse/KYLIN-1573 > Project: Kylin > Issue Type: Bug > Components: Query Engine >Affects Versions: 1.x-HBase1.1.3 >Reporter: Babulal >Assignee: liyang >Priority: Minor > Labels: newbie, test > > In Kylin expression like + ,/.* ..ect are not working . > for example > select country, >city, > sum(male_population+Female_population) > > from population > group by country,city. > Error > Caused by: java.lang.NullPointerException > at > org.apache.kylin.cube.CubeCapabilityChecker.tryDimensionAsMeasures(CubeCapabilityChecker.java:170) > at > org.apache.kylin.cube.CubeCapabilityChecker.check(CubeCapabilityChecker.java:73) > at org.apache.kylin.cube.CubeInstance.isCapable(CubeInstance.java:330) > at > org.apache.kylin.query.routing.rules.RemoveUncapableRealizationsRule.apply(RemoveUncapableRealizationsRule.java:36) > at > org.apache.kylin.query.routing.RoutingRule.applyRules(RoutingRule.java:47) > at > org.apache.kylin.query.routing.QueryRouter.selectRealization(QueryRouter.java:63) > at > org.apache.kylin.query.relnode.OLAPToEnumerableConverter.implement(OLAPToEnumerableConverter.java:80) > at > org.apache.calcite.adapter.enumerable.EnumerableRelImplementor.implementRoot(EnumerableRelImplementor.java:102) > at > org.apache.calcite.adapter.enumerable.EnumerableInterpretable.toBindable(EnumerableInterpretable.java:92) > at > org.apache.calcite.prepare.CalcitePrepareImpl$CalcitePreparingStmt.implement(CalcitePrepareImpl.java:1171) > at org.apache.calcite.prepare.Prepare.prepareSql(Prepare.java:297) > at org.apache.calcite.prepare.Prepare.prepareSql(Prepare.java:196) > When Query changed as below it is working fine . > select country, >city, > sum(male_population)+sum(Female_population) > > from population > group by country,city. -- This message was sent by Atlassian JIRA (v6.3.4#6332)
[jira] [Commented] (KYLIN-1801) Project level cube admin can not see the cubes of the projects after login
[ https://issues.apache.org/jira/browse/KYLIN-1801?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15499047#comment-15499047 ] Billy(Yiming) Liu commented on KYLIN-1801: -- What kinds of authentication you use? Which Kylin version? Could you list the reproduce steps? > Project level cube admin can not see the cubes of the projects after login > -- > > Key: KYLIN-1801 > URL: https://issues.apache.org/jira/browse/KYLIN-1801 > Project: Kylin > Issue Type: Bug > Components: Web >Reporter: qianqiaoneng >Assignee: qianqiaoneng > -- This message was sent by Atlassian JIRA (v6.3.4#6332)
[jira] [Commented] (KYLIN-1945) Cuboid.translateToValidCuboid method throw exception while cube building or query execute
[ https://issues.apache.org/jira/browse/KYLIN-1945?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15499098#comment-15499098 ] hongbin ma commented on KYLIN-1945: --- not yet > Cuboid.translateToValidCuboid method throw exception while cube building or > query execute > - > > Key: KYLIN-1945 > URL: https://issues.apache.org/jira/browse/KYLIN-1945 > Project: Kylin > Issue Type: Bug >Affects Versions: v1.5.3 > Environment: centos 6.4 ，hadoop 2.6.4，kylin 1.5.3 hbase 1.2.1 >Reporter: logicigam >Assignee: hongbin ma > > I manage to reproduce that exception at sample cube,just by add all of > defined dimension as Mandatory Dimensions into that Aggregation Groups,then > another group contain just part of dims. > === > here is the error stack while query execute: > Caused by: java.util.NoSuchElementException > at java.util.ArrayList$Itr.next(ArrayList.java:834) > at java.util.Collections.min(Collections.java:665) > at > org.apache.kylin.cube.cuboid.Cuboid.translateToValidCuboid(Cuboid.java:217) > at > org.apache.kylin.cube.cuboid.Cuboid.translateToValidCuboid(Cuboid.java:141) > at org.apache.kylin.cube.cuboid.Cuboid.findById(Cuboid.java:83) > at org.apache.kylin.cube.cuboid.Cuboid.identifyCuboid(Cuboid.java:68) > at > org.apache.kylin.storage.gtrecord.GTCubeStorageQueryBase.search(GTCubeStorageQueryBase.java:97) > at > org.apache.kylin.query.enumerator.OLAPEnumerator.queryStorage(OLAPEnumerator.java:120) > at > org.apache.kylin.query.enumerator.OLAPEnumerator.moveNext(OLAPEnumerator.java:69) > at Baz$1$1.moveNext(Unknown Source) > at > org.apache.calcite.linq4j.EnumerableDefaults.groupBy_(EnumerableDefaults.java:819) > at > org.apache.calcite.linq4j.EnumerableDefaults.groupBy(EnumerableDefaults.java:754) > at > org.apache.calcite.linq4j.DefaultEnumerable.groupBy(DefaultEnumerable.java:302) > at Baz.bind(Unknown Source) > at > org.apache.calcite.jdbc.CalcitePrepare$CalciteSignature.enumerable(CalcitePrepare.java:326) > at > org.apache.calcite.jdbc.CalciteConnectionImpl.enumerable(CalciteConnectionImpl.java:281) > at > org.apache.calcite.jdbc.CalciteMetaImpl._createIterable(CalciteMetaImpl.java:545) > and the same thing happen while cube building,exception log could be found at > hadoop job monitor page -- This message was sent by Atlassian JIRA (v6.3.4#6332)
[jira] [Commented] (KYLIN-1962) Split kylin.properties into two files
[ https://issues.apache.org/jira/browse/KYLIN-1962?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15498877#comment-15498877 ] liyang commented on KYLIN-1962: --- Do we still want this feature? If not, perhaps just close the JIRA. > Split kylin.properties into two files > - > > Key: KYLIN-1962 > URL: https://issues.apache.org/jira/browse/KYLIN-1962 > Project: Kylin > Issue Type: Improvement >Reporter: liyang >Assignee: Billy(Yiming) Liu > > Split kylin.properties into two files: normal properties and security > sensitive properties -- This message was sent by Atlassian JIRA (v6.3.4#6332)
[jira] [Commented] (KYLIN-2012) more robust approach to hive schema changes
[
https://issues.apache.org/jira/browse/KYLIN-2012?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15498907#comment-15498907
]
Billy(Yiming) Liu commented on KYLIN-2012:
--
Thanks, [~gaodayue]. The check rules make sense. As you figured out, KYLIN-1985
has been fixed recently. Could you update the rules on lookup table? Then all
tables has same rules.
> more robust approach to hive schema changes
> ---
>
> Key: KYLIN-2012
> URL: https://issues.apache.org/jira/browse/KYLIN-2012
> Project: Kylin
> Issue Type: Bug
> Components: Metadata, REST Service, Web
>Affects Versions: v1.5.3
>Reporter: Dayue Gao
>Assignee: Dayue Gao
> Fix For: v1.6.0
>
>
> Our users occasionally want to change their existing cube, such as
> adding/renaming/removing a dimension. Some of these changes require
> modifications to its source hive table. So our user changed the table schema
> and reloaded its metadata in Kylin, then several issues can happen depends on
> what he changed.
> I did some schema changing tests based on 1.5.3, the results after reloading
> table are listed below
> || type of changes || fact table || lookup table ||
> | *minor* | both query and build still works | query can fail or return wrong
> answer |
> | *major* | fail to load related cube | fail to load related cube |
> {{minor}} changes refer to those doesn't change columns used in cubes, such
> as insert/append new column, remove/change unused column.
> {{major}} changes are the opposite, like remove/rename/change type of used
> column.
> Clearly from the table, reload a changed table is problematic in certain
> cases. KYLIN-1536 reports a similar problem.
> So what can we do to support this kind of iterative development process (load
> -> define cube -> build -> reload -> change cube -> rebuild)?
> My first thought is simply detect-and-prohibit reloading used table. User
> should be able to know which cube is preventing him from reloading, and then
> he could drop and recreate cube after reloading. However, defining a cube is
> not an easy task (consider editing 100 measures). Force users to recreate
> their cube over and over again will certainly not make them happy.
> A better idea is to allow cube to be editable even if it's broken due to some
> columns changed after reloading. Broken cube can't be built or queried, it
> can only be edit or dropped. In fact, there is a cube status called
> {{RealizationStatusEnum.DESCBROKEN}} in code, but was never used. We should
> take advantage of it.
> An enabled cube shouldn't allow schema changes, otherwise an unintentional
> reload could make it unavailable. Similarly, a disabled but unpurged cube
> shouldn't allow schema changes since it still has data in it.
--
This message was sent by Atlassian JIRA
(v6.3.4#6332)
