[jira] [Updated] (KYLIN-2199) refined KYLIN-2191 due to KYLIN-2198
[ https://issues.apache.org/jira/browse/KYLIN-2199?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] hongbin ma updated KYLIN-2199: -- Summary: refined KYLIN-2191 due to KYLIN-2198 (was: revert KYLIN-2191 due to KYLIN-2198) > refined KYLIN-2191 due to KYLIN-2198 > > > Key: KYLIN-2199 > URL: https://issues.apache.org/jira/browse/KYLIN-2199 > Project: Kylin > Issue Type: Improvement >Reporter: hongbin ma >Assignee: hongbin ma > -- This message was sent by Atlassian JIRA (v6.3.4#6332)
[jira] [Created] (KYLIN-2199) revert KYLIN-2191 due to KYLIN-2198
hongbin ma created KYLIN-2199: - Summary: revert KYLIN-2191 due to KYLIN-2198 Key: KYLIN-2199 URL: https://issues.apache.org/jira/browse/KYLIN-2199 Project: Kylin Issue Type: Improvement Reporter: hongbin ma Assignee: hongbin ma -- This message was sent by Atlassian JIRA (v6.3.4#6332)
[jira] [Created] (KYLIN-2198) Add a framework to allow major changes in DimensionEncoding
hongbin ma created KYLIN-2198: - Summary: Add a framework to allow major changes in DimensionEncoding Key: KYLIN-2198 URL: https://issues.apache.org/jira/browse/KYLIN-2198 Project: Kylin Issue Type: Improvement Reporter: hongbin ma Assignee: hongbin ma Recently a fatal error is found in one of the DimensionEncoding called IntegerDimEnc(KYLIN-2191). The bug fix will cause cube content differs after applying the bug fix. Such result will confuse users. Since major changes on DimensionEncoding is always possible, either due to optimization purpose or bug fix purpose. A framework that takes into consideration of "DimensionEncoding version" is necessary. By default all DimensionEncoding has version number 1. Whenever a major change is applied on a DimensionEncoding subclass (for example IntegerDimEnc), instead of applying the change directly on the DimensionEncoding subclass (for example IntegerDimEnc), we fork a new subclass of DimensionEncoding (for example IntegerDimEncV2), which increases the original class's version number. The "encode name" remains same(for example "integer") After a DimensionEncoding with newer version is published in a new Kylin release, legacy cubes can still use the older DimensionEncoding. However they have take the risky of using the old DimensionEncoding. The web GUI will only prompt users with the latest version of DimensionEncodings. For legacy cubes, a label of "deprecated" will be shown for out-dated DimensionEncodings. -- This message was sent by Atlassian JIRA (v6.3.4#6332)
[jira] [Created] (KYLIN-2197) Has only base cuboid for some cube desc
liyang created KYLIN-2197: - Summary: Has only base cuboid for some cube desc Key: KYLIN-2197 URL: https://issues.apache.org/jira/browse/KYLIN-2197 Project: Kylin Issue Type: Bug Reporter: liyang -- This message was sent by Atlassian JIRA (v6.3.4#6332)
[jira] [Updated] (KYLIN-2196) Update Tomcat clas loader to parallel loader
[ https://issues.apache.org/jira/browse/KYLIN-2196?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Billy(Yiming) Liu updated KYLIN-2196: - Attachment: KYLIN-2196.patch Patch is ready for review. > Update Tomcat clas loader to parallel loader > > > Key: KYLIN-2196 > URL: https://issues.apache.org/jira/browse/KYLIN-2196 > Project: Kylin > Issue Type: Improvement > Components: Web >Reporter: Billy(Yiming) Liu >Assignee: Billy(Yiming) Liu >Priority: Minor > Attachments: KYLIN-2196.patch > > > The related article: > https://bz.apache.org/bugzilla/show_bug.cgi?id=57681 > https://yq.aliyun.com/articles/4227 -- This message was sent by Atlassian JIRA (v6.3.4#6332)
[jira] [Created] (KYLIN-2196) Update Tomcat clas loader to parallel loader
Billy(Yiming) Liu created KYLIN-2196: Summary: Update Tomcat clas loader to parallel loader Key: KYLIN-2196 URL: https://issues.apache.org/jira/browse/KYLIN-2196 Project: Kylin Issue Type: Improvement Components: Web Reporter: Billy(Yiming) Liu Assignee: Billy(Yiming) Liu Priority: Minor The related article: https://bz.apache.org/bugzilla/show_bug.cgi?id=57681 https://yq.aliyun.com/articles/4227 -- This message was sent by Atlassian JIRA (v6.3.4#6332)
[jira] [Commented] (KYLIN-2135) Enlarge FactDistinctColumns reducer number
[
https://issues.apache.org/jira/browse/KYLIN-2135?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15669277#comment-15669277
]
XIE FAN commented on KYLIN-2135:
Can we specify different reducers number for different columns? Or we need to
use the same number of reducers for all the columns
> Enlarge FactDistinctColumns reducer number
> --
>
> Key: KYLIN-2135
> URL: https://issues.apache.org/jira/browse/KYLIN-2135
> Project: Kylin
> Issue Type: Improvement
> Components: Job Engine
>Affects Versions: v1.5.4.1
>Reporter: kangkaisen
>Assignee: kangkaisen
> Fix For: v1.6.1
>
> Attachments: KYLIN-2135.patch, new.png, old.png
>
>
> When the hive table has billions of rows and use global dictionary for
> precise count distinct measures, the {{Extract Fact Table Distinct Columns}}
> job will run o long time.
> So we could use more reducer to deal with the one column.
--
This message was sent by Atlassian JIRA
(v6.3.4#6332)
[jira] [Resolved] (KYLIN-2193) parameterise org.apache.kylin.storage.translate.DerivedFilterTranslator#IN_THRESHOLD
[ https://issues.apache.org/jira/browse/KYLIN-2193?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] hongbin ma resolved KYLIN-2193. --- Resolution: Fixed Fix Version/s: v1.6.1 > parameterise > org.apache.kylin.storage.translate.DerivedFilterTranslator#IN_THRESHOLD > > > Key: KYLIN-2193 > URL: https://issues.apache.org/jira/browse/KYLIN-2193 > Project: Kylin > Issue Type: Improvement >Reporter: hongbin ma >Assignee: hongbin ma > Fix For: v1.6.1 > > > currently > org.apache.kylin.storage.translate.DerivedFilterTranslator#IN_THRESHOLD is > hard coded to 5, which is too small in many scenarios. I'm proposing to > increase the default value to 20, and add a new config entry to allow tuning > this parameter. -- This message was sent by Atlassian JIRA (v6.3.4#6332)
[jira] [Created] (KYLIN-2195) Setup naming convention for kylin properties
liyang created KYLIN-2195: - Summary: Setup naming convention for kylin properties Key: KYLIN-2195 URL: https://issues.apache.org/jira/browse/KYLIN-2195 Project: Kylin Issue Type: Improvement Reporter: liyang -- This message was sent by Atlassian JIRA (v6.3.4#6332)
[jira] [Created] (KYLIN-2194) Fix checkstyle warning in DerivedFilterTranslator.java
Ted Yu created KYLIN-2194:
-
Summary: Fix checkstyle warning in DerivedFilterTranslator.java
Key: KYLIN-2194
URL: https://issues.apache.org/jira/browse/KYLIN-2194
Project: Kylin
Issue Type: Bug
Reporter: Ted Yu
Priority: Trivial
{code}
[INFO] Starting audit...
/mnt/disk2/a/kylin/core-storage/src/main/java/org/apache/kylin/storage/translate/DerivedFilterTranslator.java:89:121:
error: ',' is not followed by whitespace.
[ERROR] Failed to execute goal
org.apache.maven.plugins:maven-checkstyle-plugin:2.17:check (validate) on
project kylin-core-storage: Failed during checkstyle execution: There is 1
error reported by Checkstyle 6.11.2 with dev-support/checkstyle.xml ruleset. ->
[Help 1]
{code}
There should be whitespace between comma and "//"
--
This message was sent by Atlassian JIRA
(v6.3.4#6332)
[jira] [Created] (KYLIN-2193) parameterise org.apache.kylin.storage.translate.DerivedFilterTranslator#IN_THRESHOLD
hongbin ma created KYLIN-2193: - Summary: parameterise org.apache.kylin.storage.translate.DerivedFilterTranslator#IN_THRESHOLD Key: KYLIN-2193 URL: https://issues.apache.org/jira/browse/KYLIN-2193 Project: Kylin Issue Type: Improvement Reporter: hongbin ma Assignee: hongbin ma currently org.apache.kylin.storage.translate.DerivedFilterTranslator#IN_THRESHOLD is hard coded to 5, which is too small in many scenarios. I'm proposing to increase the default value to 20, and add a new config entry to allow tuning this parameter. -- This message was sent by Atlassian JIRA (v6.3.4#6332)
[jira] [Created] (KYLIN-2192) More Robust Global Dictionary
Yerui Sun created KYLIN-2192: Summary: More Robust Global Dictionary Key: KYLIN-2192 URL: https://issues.apache.org/jira/browse/KYLIN-2192 Project: Kylin Issue Type: Improvement Components: Job Engine Affects Versions: v1.5.4.1 Reporter: Yerui Sun Assignee: Yerui Sun Fix For: v1.6.0 Global dictionary have been released over 2 months, I've received some feedbacks and bug reports. Here's the patch to make global dictionary more robust, including some functional improvements. * Break through 255 bytes limitation for value, but still recommend value length less than 8K, avoiding stack overflow error; * Fix 'Value not exists' or stack overflow error when dict size is larger than 1GB, the root cause is similar with KYLIN-1834; A check tool also provided for check corrupted or not of existing dict data; * Support parallel dictionary building in one job server, used for parallel segments building; -- This message was sent by Atlassian JIRA (v6.3.4#6332)
[jira] [Closed] (KYLIN-2190) The visitCube function of the CubeVisitService class occured error when we compiled the kylin project using hbase-server-1.2.x.jar.
[ https://issues.apache.org/jira/browse/KYLIN-2190?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Billy(Yiming) Liu closed KYLIN-2190. Resolution: Duplicate > The visitCube function of the CubeVisitService class occured error when we > compiled the kylin project using hbase-server-1.2.x.jar. > --- > > Key: KYLIN-2190 > URL: https://issues.apache.org/jira/browse/KYLIN-2190 > Project: Kylin > Issue Type: Bug > Components: Storage - HBase >Affects Versions: v1.5.3, v1.5.4, v1.5.4.1 > Environment: CentOS Linux release 7.2.1511、maven 3.2.5、jdk1.7.0_80 >Reporter: Qiang Zhang >Assignee: liyang > Labels: patch > > The RegionCoprocessorEnvironment interface was different between > hbase-server-1.2.x.jar and hbase-server-0.9.8.jar. The value type of the > getRegion function for the RegionCoprocessorEnvironment interface is HRegion > class in hbase-server-0.9.8.jar. And it's value type is Region class in > hbase-server-1.2.x.jar. The visitCube function of the CubeVisitService class > couldn't be compatible with hbase-server-1.2.x.jar and hbase-server-0.9.8.jar. > The reappear steps is as following: > 1. Get source code using git from git://git.apache.org/kylin.git; > 2. Run the mvn command to compile the kylin project; > 3. Compile successfully; > 4. Modify the value of the to 1.2.0 in the pom.xml of > the kylin project; > 5. Run the mvn command to compile the kylin project; > 3. Compile fail; -- This message was sent by Atlassian JIRA (v6.3.4#6332)
[jira] [Closed] (KYLIN-2183) The HTableInterface interface was different between hbase-client-1.2.x.jar and hbase-client-0.9.8.jar. The MockHTable class occured error when we compiled the kylin projec
[ https://issues.apache.org/jira/browse/KYLIN-2183?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Billy(Yiming) Liu closed KYLIN-2183. Resolution: Duplicate > The HTableInterface interface was different between hbase-client-1.2.x.jar > and hbase-client-0.9.8.jar. The MockHTable class occured error when we > compiled the kylin project using hbase-client-1.2.x.jar. > -- > > Key: KYLIN-2183 > URL: https://issues.apache.org/jira/browse/KYLIN-2183 > Project: Kylin > Issue Type: Bug > Components: REST Service >Affects Versions: v1.5.3, v1.5.2.1, v1.5.4.1 > Environment: CentOS Linux release 7.2.1511、maven 3.2.5、jdk1.7.0_80 >Reporter: Qiang Zhang >Assignee: Zhong,Jason > Labels: patch > > 1. Get source code using git from git://git.apache.org/kylin.git; > 2. Run the mvn command to compile the kylin project; > 3. Compile successfully; > 4. Modify the value of the to 1.2.0 in the pom.xml of > the kylin project; > 5. Run the mvn command to compile the kylin project; > 3. Compile fail; -- This message was sent by Atlassian JIRA (v6.3.4#6332)
[jira] [Closed] (KYLIN-2186) The AggregationScanner class occured error when we compiled the kylin project using hbase-server-1.2.x.jar.
[ https://issues.apache.org/jira/browse/KYLIN-2186?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Billy(Yiming) Liu closed KYLIN-2186. Resolution: Duplicate > The AggregationScanner class occured error when we compiled the kylin project > using hbase-server-1.2.x.jar. > --- > > Key: KYLIN-2186 > URL: https://issues.apache.org/jira/browse/KYLIN-2186 > Project: Kylin > Issue Type: Bug > Components: Storage - HBase >Affects Versions: v1.5.3, v1.5.2.1, v1.5.4, v1.5.4.1 > Environment: CentOS Linux release 7.2.1511、maven 3.2.5、jdk1.7.0_80 >Reporter: Qiang Zhang >Assignee: liyang > Labels: patch > > The RegionScanner and InternalScanner interface was different between > hbase-server-1.2.x.jar and hbase-server-0.9.8.jar. The AggregationScanner > class inherited the RegionScanner interface. But it couldn't be compatible > with hbase-server-1.2.x.jar and hbase-server-0.9.8.jar. > The reappear steps is as following: > 1. Get source code using git from git://git.apache.org/kylin.git; > 2. Run the mvn command to compile the kylin project; > 3. Compile successfully; > 4. Modify the value of the to 1.2.0 in the pom.xml of > the kylin project; > 5. Run the mvn command to compile the kylin project; > 3. Compile fail; -- This message was sent by Atlassian JIRA (v6.3.4#6332)
[jira] [Closed] (KYLIN-2185) The AggregateRegionObserver class occured error when we compiled the kylin project using hbase-server-1.2.x.jar
[ https://issues.apache.org/jira/browse/KYLIN-2185?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Billy(Yiming) Liu closed KYLIN-2185. Resolution: Duplicate > The AggregateRegionObserver class occured error when we compiled the kylin > project using hbase-server-1.2.x.jar > --- > > Key: KYLIN-2185 > URL: https://issues.apache.org/jira/browse/KYLIN-2185 > Project: Kylin > Issue Type: Bug > Components: Storage - HBase >Affects Versions: v1.5.3, v1.5.2.1, v1.5.4.1 > Environment: CentOS Linux release 7.2.1511、maven 3.2.5、jdk1.7.0_80 >Reporter: Qiang Zhang >Assignee: liyang > Labels: patch > > The return value of the getRegion function in RegionCoprocessorEnvironment > interface was different between hbase-server-1.2.x.jar and > hbase-server-0.9.8.jar. The getRegion function was called and the return > value didn't appropriately converted in the AggregateRegionObserver class. So > the AggregateRegionObserver class occured error when we compiled the kylin > project using hbase-server-1.2.x.jar. > The reappear steps is as following: > 1. Get source code using git from git://git.apache.org/kylin.git; > 2. Run the mvn command to compile the kylin project; > 3. Compile successfully; > 4. Modify the value of the to 1.2.0 in the pom.xml of > the kylin project; > 5. Run the mvn command to compile the kylin project; > 3. Compile fail; -- This message was sent by Atlassian JIRA (v6.3.4#6332)
[jira] [Closed] (KYLIN-2184) The RegionScanner and InternalScanner interface was different between hbase-client-1.2.x.jar and hbase-client-0.9.8.jar. The RegionScannerAdapter class occured error when
[ https://issues.apache.org/jira/browse/KYLIN-2184?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Billy(Yiming) Liu closed KYLIN-2184. Resolution: Duplicate > The RegionScanner and InternalScanner interface was different between > hbase-client-1.2.x.jar and hbase-client-0.9.8.jar. The RegionScannerAdapter > class occured error when we compiled the kylin project using > hbase-client-1.2.x.jar. > -- > > Key: KYLIN-2184 > URL: https://issues.apache.org/jira/browse/KYLIN-2184 > Project: Kylin > Issue Type: Bug > Components: Storage - HBase >Affects Versions: v1.5.3, v1.5.2.1, v1.5.4.1 > Environment: CentOS Linux release 7.2.1511、maven 3.2.5、jdk1.7.0_80 >Reporter: Qiang Zhang >Assignee: liyang > Labels: patch > > 1. Get source code using git from git://git.apache.org/kylin.git; > 2. Run the mvn command to compile the kylin project; > 3. Compile successfully; > 4. Modify the value of the to 1.2.0 in the pom.xml of > the kylin project; > 5. Run the mvn command to compile the kylin project; > 3. Compile fail; -- This message was sent by Atlassian JIRA (v6.3.4#6332)
[jira] [Commented] (KYLIN-2190) The visitCube function of the CubeVisitService class occured error when we compiled the kylin project using hbase-server-1.2.x.jar.
[ https://issues.apache.org/jira/browse/KYLIN-2190?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15666812#comment-15666812 ] Billy(Yiming) Liu commented on KYLIN-2190: -- Please try to compile the code in branch master-HBase1.x if you want to compile against HBase 1.2. If the compile failed, maybe some incompatible code are there. But it's not a bug. If the Hbase 1.X distribution could not work on your HBase cluster, that may be an issue. > The visitCube function of the CubeVisitService class occured error when we > compiled the kylin project using hbase-server-1.2.x.jar. > --- > > Key: KYLIN-2190 > URL: https://issues.apache.org/jira/browse/KYLIN-2190 > Project: Kylin > Issue Type: Bug > Components: Storage - HBase >Affects Versions: v1.5.3, v1.5.4, v1.5.4.1 > Environment: CentOS Linux release 7.2.1511、maven 3.2.5、jdk1.7.0_80 >Reporter: Qiang Zhang >Assignee: liyang > Labels: patch > > The RegionCoprocessorEnvironment interface was different between > hbase-server-1.2.x.jar and hbase-server-0.9.8.jar. The value type of the > getRegion function for the RegionCoprocessorEnvironment interface is HRegion > class in hbase-server-0.9.8.jar. And it's value type is Region class in > hbase-server-1.2.x.jar. The visitCube function of the CubeVisitService class > couldn't be compatible with hbase-server-1.2.x.jar and hbase-server-0.9.8.jar. > The reappear steps is as following: > 1. Get source code using git from git://git.apache.org/kylin.git; > 2. Run the mvn command to compile the kylin project; > 3. Compile successfully; > 4. Modify the value of the to 1.2.0 in the pom.xml of > the kylin project; > 5. Run the mvn command to compile the kylin project; > 3. Compile fail; -- This message was sent by Atlassian JIRA (v6.3.4#6332)
[jira] [Commented] (KYLIN-2187) Enhance TableExt metadata
[ https://issues.apache.org/jira/browse/KYLIN-2187?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15666718#comment-15666718 ] liyang commented on KYLIN-2187: --- Current table extended info is just KV pairs. To embed more info into it, we need some structure first. Let's make it a JSON object first. > Enhance TableExt metadata > - > > Key: KYLIN-2187 > URL: https://issues.apache.org/jira/browse/KYLIN-2187 > Project: Kylin > Issue Type: Improvement >Reporter: Wang Cheng >Assignee: Wang Cheng >Priority: Minor > Labels: patch > > metadata "table_ext" is not very elegant and difficult to manage. Here will > enrich it. -- This message was sent by Atlassian JIRA (v6.3.4#6332)
[jira] [Commented] (KYLIN-2188) The AggregationRegionScanner class occured error when we compiled the kylin project using hbase-server-1.2.x.jar.
[ https://issues.apache.org/jira/browse/KYLIN-2188?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15666588#comment-15666588 ] Shaofeng SHI commented on KYLIN-2188: - HBase's API is different between 0.98 and 1.x; Please checkout Kylin's '*hbase1.x' branch like "master-hbase1.x" > The AggregationRegionScanner class occured error when we compiled the kylin > project using hbase-server-1.2.x.jar. > - > > Key: KYLIN-2188 > URL: https://issues.apache.org/jira/browse/KYLIN-2188 > Project: Kylin > Issue Type: Bug > Components: Storage - HBase >Affects Versions: v1.5.3, v1.5.4, v1.5.4.1 > Environment: CentOS Linux release 7.2.1511、maven 3.2.5、jdk1.7.0_80 >Reporter: Qiang Zhang >Assignee: liyang > Labels: patch > > The RegionScanner and InternalScanner interface was different between > hbase-server-1.2.x.jar and hbase-server-0.9.8.jar. The > AggregationRegionScanner class inherited the RegionScanner interface. But it > couldn't be compatible with hbase-server-1.2.x.jar and hbase-server-0.9.8.jar. > The reappear steps is as following: > 1. Get source code using git from git://git.apache.org/kylin.git; > 2. Run the mvn command to compile the kylin project; > 3. Compile successfully; > 4. Modify the value of the to 1.2.0 in the pom.xml of > the kylin project; > 5. Run the mvn command to compile the kylin project; > 3. Compile fail; -- This message was sent by Atlassian JIRA (v6.3.4#6332)
[jira] [Updated] (KYLIN-2191) Integer encoding error for width from 5 to 7
[ https://issues.apache.org/jira/browse/KYLIN-2191?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Roger Shi updated KYLIN-2191: - Summary: Integer encoding error for width from 5 to 7 (was: Integer encoding error for width from 3 to 7) > Integer encoding error for width from 5 to 7 > > > Key: KYLIN-2191 > URL: https://issues.apache.org/jira/browse/KYLIN-2191 > Project: Kylin > Issue Type: Bug >Reporter: Roger Shi >Assignee: Roger Shi > > For integer encoding, if width is 3, 4, 5, 6 and 7. The decoded value is not > right. -- This message was sent by Atlassian JIRA (v6.3.4#6332)
