[jira] [Commented] (KYLIN-3296) cube合并时，java.lang.ArrayIndexOutOfBoundsException at java.lang.System.arraycopy(Native Method)
[ https://issues.apache.org/jira/browse/KYLIN-3296?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16410833#comment-16410833 ] RenZhiMin commented on KYLIN-3296: -- Hi [~yimingliu] I have manually generate a patch by git . Please check it. > cube合并时，java.lang.ArrayIndexOutOfBoundsException at > java.lang.System.arraycopy(Native Method) > - > > Key: KYLIN-3296 > URL: https://issues.apache.org/jira/browse/KYLIN-3296 > Project: Kylin > Issue Type: Bug > Components: Job Engine >Affects Versions: v2.3.0 >Reporter: RenZhiMin >Priority: Major > Labels: patch > Attachments: JIRA.master.3296.patch > > > cube中，设计rowkey时，有个维度设置编码方式是固定长度500。每天采用内存构建算法。在合并cube时，在生成的mr中的map任务执行中出现“java.lang.ArrayIndexOutOfBoundsException > at java.lang.System.arraycopy(Native Method)” > 错误。经查看在生成的mr中的map任务中需要对要合并的cuboiddata数据的rowkey进行切分，切分时，根据每个维度的编码方式获取对应的长度，然后从rowkey中获取，并赋值给SplittedBytes的value中，由于value数组初始化时设置的固定值255，所以在切分大于255的维度值时，出现下标越界错误。 -- This message was sent by Atlassian JIRA (v7.6.3#76005)
[jira] [Updated] (KYLIN-3296) cube合并时，java.lang.ArrayIndexOutOfBoundsException at java.lang.System.arraycopy(Native Method)
[ https://issues.apache.org/jira/browse/KYLIN-3296?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] RenZhiMin updated KYLIN-3296: - Attachment: JIRA.master.3296.patch > cube合并时，java.lang.ArrayIndexOutOfBoundsException at > java.lang.System.arraycopy(Native Method) > - > > Key: KYLIN-3296 > URL: https://issues.apache.org/jira/browse/KYLIN-3296 > Project: Kylin > Issue Type: Bug > Components: Job Engine >Affects Versions: v2.3.0 >Reporter: RenZhiMin >Priority: Major > Labels: patch > Attachments: JIRA.master.3296.patch > > > cube中，设计rowkey时，有个维度设置编码方式是固定长度500。每天采用内存构建算法。在合并cube时，在生成的mr中的map任务执行中出现“java.lang.ArrayIndexOutOfBoundsException > at java.lang.System.arraycopy(Native Method)” > 错误。经查看在生成的mr中的map任务中需要对要合并的cuboiddata数据的rowkey进行切分，切分时，根据每个维度的编码方式获取对应的长度，然后从rowkey中获取，并赋值给SplittedBytes的value中，由于value数组初始化时设置的固定值255，所以在切分大于255的维度值时，出现下标越界错误。 -- This message was sent by Atlassian JIRA (v7.6.3#76005)
[jira] [Updated] (KYLIN-3296) cube合并时，java.lang.ArrayIndexOutOfBoundsException at java.lang.System.arraycopy(Native Method)
[ https://issues.apache.org/jira/browse/KYLIN-3296?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] RenZhiMin updated KYLIN-3296: - Attachment: (was: JIRA.master.3296.patch) > cube合并时，java.lang.ArrayIndexOutOfBoundsException at > java.lang.System.arraycopy(Native Method) > - > > Key: KYLIN-3296 > URL: https://issues.apache.org/jira/browse/KYLIN-3296 > Project: Kylin > Issue Type: Bug > Components: Job Engine >Affects Versions: v2.3.0 >Reporter: RenZhiMin >Priority: Major > Labels: patch > > cube中，设计rowkey时，有个维度设置编码方式是固定长度500。每天采用内存构建算法。在合并cube时，在生成的mr中的map任务执行中出现“java.lang.ArrayIndexOutOfBoundsException > at java.lang.System.arraycopy(Native Method)” > 错误。经查看在生成的mr中的map任务中需要对要合并的cuboiddata数据的rowkey进行切分，切分时，根据每个维度的编码方式获取对应的长度，然后从rowkey中获取，并赋值给SplittedBytes的value中，由于value数组初始化时设置的固定值255，所以在切分大于255的维度值时，出现下标越界错误。 -- This message was sent by Atlassian JIRA (v7.6.3#76005)
[jira] [Closed] (KYLIN-3269) 把project的权限授权给不存在用户时，出现错误。
[ https://issues.apache.org/jira/browse/KYLIN-3269?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Zhixiong Chen closed KYLIN-3269. Resolution: Fixed I think this issue had been fixed in version 2.2 So I close this jira. > 把project的权限授权给不存在用户时，出现错误。 > -- > > Key: KYLIN-3269 > URL: https://issues.apache.org/jira/browse/KYLIN-3269 > Project: Kylin > Issue Type: Bug > Components: REST Service, Web >Affects Versions: v2.0.0 >Reporter: RenZhiMin >Priority: Major > Fix For: v2.2.0 > > Attachments: aclService.patch > > > 把project的权限授权给不存在用户时，会提示用户不存在，并且project上之前的权限都丢失了！所以应该在删除前先判断新的数据是否正确 -- This message was sent by Atlassian JIRA (v7.6.3#76005)
[jira] [Updated] (KYLIN-3269) 把project的权限授权给不存在用户时，出现错误。
[ https://issues.apache.org/jira/browse/KYLIN-3269?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Zhixiong Chen updated KYLIN-3269: - Fix Version/s: v2.2.0 > 把project的权限授权给不存在用户时，出现错误。 > -- > > Key: KYLIN-3269 > URL: https://issues.apache.org/jira/browse/KYLIN-3269 > Project: Kylin > Issue Type: Bug > Components: REST Service, Web >Affects Versions: v2.0.0 >Reporter: RenZhiMin >Priority: Major > Fix For: v2.2.0 > > Attachments: aclService.patch > > > 把project的权限授权给不存在用户时，会提示用户不存在，并且project上之前的权限都丢失了！所以应该在删除前先判断新的数据是否正确 -- This message was sent by Atlassian JIRA (v7.6.3#76005)
[jira] [Resolved] (KYLIN-3292) The setting config dialog will cause NPE in Kylin server
[
https://issues.apache.org/jira/browse/KYLIN-3292?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
]
Zhixiong Chen resolved KYLIN-3292.
--
Resolution: Fixed
Fix Version/s: v2.4.0
Thanks,[~xingpeng1]
I had merged it into master.
> The setting config dialog will cause NPE in Kylin server
>
>
> Key: KYLIN-3292
> URL: https://issues.apache.org/jira/browse/KYLIN-3292
> Project: Kylin
> Issue Type: Bug
> Components: Web
>Affects Versions: v2.3.0
>Reporter: Peng Xing
>Assignee: Peng Xing
>Priority: Minor
> Fix For: v2.4.0
>
> Attachments: Set_config_null.png
>
>
> Open the 'Set Config' dialog, when the default key and value are null, the
> update button should be disabled, please refer to the attach picture.
> Otherwise it will cause NPE in Kylin server, as follows.
> {code:java}
> java.lang.NullPointerException
> at
> java.util.concurrent.ConcurrentHashMap.hash(ConcurrentHashMap.java:333)
> at
> java.util.concurrent.ConcurrentHashMap.get(ConcurrentHashMap.java:988)
> at
> org.apache.kylin.common.BackwardCompatibilityConfig.check(BackwardCompatibilityConfig.java:91)
> at
> org.apache.kylin.common.KylinConfigBase.setProperty(KylinConfigBase.java:197)
> at
> org.apache.kylin.rest.service.AdminService.updateConfig(AdminService.java:87)
> at
> org.apache.kylin.rest.service.AdminService$$FastClassBySpringCGLIB$$e043a6d8.invoke()
> at
> org.springframework.cglib.proxy.MethodProxy.invoke(MethodProxy.java:204)
> at
> org.springframework.aop.framework.CglibAopProxy$CglibMethodInvocation.invokeJoinpoint(CglibAopProxy.java:738)
> at
> org.springframework.aop.framework.ReflectiveMethodInvocation.proceed(ReflectiveMethodInvocation.java:157)
> at
> org.springframework.security.access.intercept.aopalliance.MethodSecurityInterceptor.invoke(MethodSecurityInterceptor.java:69)
> at
> org.springframework.aop.framework.ReflectiveMethodInvocation.proceed(ReflectiveMethodInvocation.java:179)
> at
> org.springframework.aop.framework.CglibAopProxy$DynamicAdvisedInterceptor.intercept(CglibAopProxy.java:673)
> at
> org.apache.kylin.rest.service.AdminService$$EnhancerBySpringCGLIB$$f1977d91.updateConfig()
> at
> org.apache.kylin.rest.controller.AdminController.updateKylinConfig(AdminController.java:106)
> {code}
--
This message was sent by Atlassian JIRA
(v7.6.3#76005)
[jira] [Commented] (KYLIN-3292) The setting config dialog will cause NPE in Kylin server
[
https://issues.apache.org/jira/browse/KYLIN-3292?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16410690#comment-16410690
]
ASF GitHub Bot commented on KYLIN-3292:
---
chenzhx closed pull request #116: KYLIN-3292
URL: https://github.com/apache/kylin/pull/116
This is a PR merged from a forked repository.
As GitHub hides the original diff on merge, it is displayed below for
the sake of provenance:
As this is a foreign pull request (from a fork), the diff is supplied
below (as it won't show otherwise due to GitHub magic):
diff --git a/webapp/app/partials/admin/admin.html
b/webapp/app/partials/admin/admin.html
index b57ce0eb0e..5c66942a7e 100644
--- a/webapp/app/partials/admin/admin.html
+++ b/webapp/app/partials/admin/admin.html
@@ -123,7 +123,7 @@ Update Config
- Update
+ Update
Cancel
This is an automated message from the Apache Git Service.
To respond to the message, please log on GitHub and use the
URL above to go to the specific comment.
For queries about this service, please contact Infrastructure at:
us...@infra.apache.org
> The setting config dialog will cause NPE in Kylin server
>
>
> Key: KYLIN-3292
> URL: https://issues.apache.org/jira/browse/KYLIN-3292
> Project: Kylin
> Issue Type: Bug
> Components: Web
>Affects Versions: v2.4.0
>Reporter: Peng Xing
>Assignee: Peng Xing
>Priority: Minor
> Attachments: Set_config_null.png
>
>
> Open the 'Set Config' dialog, when the default key and value are null, the
> update button should be disabled, please refer to the attach picture.
> Otherwise it will cause NPE in Kylin server, as follows.
> {code:java}
> java.lang.NullPointerException
> at
> java.util.concurrent.ConcurrentHashMap.hash(ConcurrentHashMap.java:333)
> at
> java.util.concurrent.ConcurrentHashMap.get(ConcurrentHashMap.java:988)
> at
> org.apache.kylin.common.BackwardCompatibilityConfig.check(BackwardCompatibilityConfig.java:91)
> at
> org.apache.kylin.common.KylinConfigBase.setProperty(KylinConfigBase.java:197)
> at
> org.apache.kylin.rest.service.AdminService.updateConfig(AdminService.java:87)
> at
> org.apache.kylin.rest.service.AdminService$$FastClassBySpringCGLIB$$e043a6d8.invoke()
> at
> org.springframework.cglib.proxy.MethodProxy.invoke(MethodProxy.java:204)
> at
> org.springframework.aop.framework.CglibAopProxy$CglibMethodInvocation.invokeJoinpoint(CglibAopProxy.java:738)
> at
> org.springframework.aop.framework.ReflectiveMethodInvocation.proceed(ReflectiveMethodInvocation.java:157)
> at
> org.springframework.security.access.intercept.aopalliance.MethodSecurityInterceptor.invoke(MethodSecurityInterceptor.java:69)
> at
> org.springframework.aop.framework.ReflectiveMethodInvocation.proceed(ReflectiveMethodInvocation.java:179)
> at
> org.springframework.aop.framework.CglibAopProxy$DynamicAdvisedInterceptor.intercept(CglibAopProxy.java:673)
> at
> org.apache.kylin.rest.service.AdminService$$EnhancerBySpringCGLIB$$f1977d91.updateConfig()
> at
> org.apache.kylin.rest.controller.AdminController.updateKylinConfig(AdminController.java:106)
> {code}
--
This message was sent by Atlassian JIRA
(v7.6.3#76005)
[jira] [Commented] (KYLIN-3292) The setting config dialog will cause NPE in Kylin server
[
https://issues.apache.org/jira/browse/KYLIN-3292?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16410691#comment-16410691
]
ASF subversion and git services commented on KYLIN-3292:
Commit cfb21d7c97d72c9c4dfc1079b7d147ef8363b2f4 in kylin's branch
refs/heads/master from [~xingpeng1]
[ https://gitbox.apache.org/repos/asf?p=kylin.git;h=cfb21d7 ]
KYLIN-3292 The update button should be disabled with none key and value in
setting config dialog (#116)
> The setting config dialog will cause NPE in Kylin server
>
>
> Key: KYLIN-3292
> URL: https://issues.apache.org/jira/browse/KYLIN-3292
> Project: Kylin
> Issue Type: Bug
> Components: Web
>Affects Versions: v2.4.0
>Reporter: Peng Xing
>Assignee: Peng Xing
>Priority: Minor
> Attachments: Set_config_null.png
>
>
> Open the 'Set Config' dialog, when the default key and value are null, the
> update button should be disabled, please refer to the attach picture.
> Otherwise it will cause NPE in Kylin server, as follows.
> {code:java}
> java.lang.NullPointerException
> at
> java.util.concurrent.ConcurrentHashMap.hash(ConcurrentHashMap.java:333)
> at
> java.util.concurrent.ConcurrentHashMap.get(ConcurrentHashMap.java:988)
> at
> org.apache.kylin.common.BackwardCompatibilityConfig.check(BackwardCompatibilityConfig.java:91)
> at
> org.apache.kylin.common.KylinConfigBase.setProperty(KylinConfigBase.java:197)
> at
> org.apache.kylin.rest.service.AdminService.updateConfig(AdminService.java:87)
> at
> org.apache.kylin.rest.service.AdminService$$FastClassBySpringCGLIB$$e043a6d8.invoke()
> at
> org.springframework.cglib.proxy.MethodProxy.invoke(MethodProxy.java:204)
> at
> org.springframework.aop.framework.CglibAopProxy$CglibMethodInvocation.invokeJoinpoint(CglibAopProxy.java:738)
> at
> org.springframework.aop.framework.ReflectiveMethodInvocation.proceed(ReflectiveMethodInvocation.java:157)
> at
> org.springframework.security.access.intercept.aopalliance.MethodSecurityInterceptor.invoke(MethodSecurityInterceptor.java:69)
> at
> org.springframework.aop.framework.ReflectiveMethodInvocation.proceed(ReflectiveMethodInvocation.java:179)
> at
> org.springframework.aop.framework.CglibAopProxy$DynamicAdvisedInterceptor.intercept(CglibAopProxy.java:673)
> at
> org.apache.kylin.rest.service.AdminService$$EnhancerBySpringCGLIB$$f1977d91.updateConfig()
> at
> org.apache.kylin.rest.controller.AdminController.updateKylinConfig(AdminController.java:106)
> {code}
--
This message was sent by Atlassian JIRA
(v7.6.3#76005)
[jira] [Created] (KYLIN-3310) Use lint for maven-compiler-plugin
Ted Yu created KYLIN-3310:
-
Summary: Use lint for maven-compiler-plugin
Key: KYLIN-3310
URL: https://issues.apache.org/jira/browse/KYLIN-3310
Project: Kylin
Issue Type: Improvement
Reporter: Ted Yu
lint helps identify structural problems.
We should enable lint for maven-compiler-plugin
{code}
maven-compiler-plugin
${maven-compiler-plugin.version}
1.8
1.8
-Xlint:all
${compiler.error.flag}
-Xlint:-options
-Xlint:-cast
-Xlint:-deprecation
-Xlint:-processing
-Xlint:-rawtypes
-Xlint:-serial
-Xlint:-try
-Xlint:-unchecked
-Xlint:-varargs
true
false
{code}
--
This message was sent by Atlassian JIRA
(v7.6.3#76005)
[jira] [Commented] (KYLIN-3296) cube合并时，java.lang.ArrayIndexOutOfBoundsException at java.lang.System.arraycopy(Native Method)
[ https://issues.apache.org/jira/browse/KYLIN-3296?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16409335#comment-16409335 ] Billy Liu commented on KYLIN-3296: -- Hi [~renzm], this is not standard patch format. The patch should contain your committer info. > cube合并时，java.lang.ArrayIndexOutOfBoundsException at > java.lang.System.arraycopy(Native Method) > - > > Key: KYLIN-3296 > URL: https://issues.apache.org/jira/browse/KYLIN-3296 > Project: Kylin > Issue Type: Bug > Components: Job Engine >Affects Versions: v2.3.0 >Reporter: RenZhiMin >Priority: Major > Labels: patch > Attachments: JIRA.master.3296.patch > > > cube中，设计rowkey时，有个维度设置编码方式是固定长度500。每天采用内存构建算法。在合并cube时，在生成的mr中的map任务执行中出现“java.lang.ArrayIndexOutOfBoundsException > at java.lang.System.arraycopy(Native Method)” > 错误。经查看在生成的mr中的map任务中需要对要合并的cuboiddata数据的rowkey进行切分，切分时，根据每个维度的编码方式获取对应的长度，然后从rowkey中获取，并赋值给SplittedBytes的value中，由于value数组初始化时设置的固定值255，所以在切分大于255的维度值时，出现下标越界错误。 -- This message was sent by Atlassian JIRA (v7.6.3#76005)
[jira] [Commented] (KYLIN-3293) FixedLenHexDimEnc return a wrong code length leads to cut bytes error.
[
https://issues.apache.org/jira/browse/KYLIN-3293?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16409193#comment-16409193
]
ASF GitHub Bot commented on KYLIN-3293:
---
tttMelody closed pull request #117: KYLIN-3293, fix FixedLenHexDimEnc.java
return a wrong code length lea…
URL: https://github.com/apache/kylin/pull/117
This is a PR merged from a forked repository.
As GitHub hides the original diff on merge, it is displayed below for
the sake of provenance:
As this is a foreign pull request (from a fork), the diff is supplied
below (as it won't show otherwise due to GitHub magic):
diff --git
a/core-metadata/src/main/java/org/apache/kylin/dimension/FixedLenHexDimEnc.java
b/core-metadata/src/main/java/org/apache/kylin/dimension/FixedLenHexDimEnc.java
index a931450a0b..1eb0565062 100644
---
a/core-metadata/src/main/java/org/apache/kylin/dimension/FixedLenHexDimEnc.java
+++
b/core-metadata/src/main/java/org/apache/kylin/dimension/FixedLenHexDimEnc.java
@@ -117,7 +117,6 @@ public DimensionEncoding createDimensionEncoding(String
encodingName, String[] a
//
private int hexLength;
-private int bytelen;
transient private int avoidVerbose = 0;
transient private int avoidVerbose2 = 0;
@@ -131,7 +130,6 @@ public FixedLenHexDimEnc(int len) {
throw new IllegalArgumentException("len has to be positive: " +
len);
}
this.hexLength = len;
-this.bytelen = (hexLength + 1) / 2;
}
@Override
@@ -153,20 +151,20 @@ public int hashCode() {
@Override
public int getLengthOfEncoding() {
-return bytelen;
+return getByteLen();
}
@Override
public void encode(String valueStr, byte[] output, int outputOffset) {
if (valueStr == null) {
-Arrays.fill(output, outputOffset, outputOffset + bytelen, NULL);
+Arrays.fill(output, outputOffset, outputOffset + getByteLen(),
NULL);
return;
}
byte[] value = Bytes.toBytes(valueStr);
int valueLen = value.length;
-int endOffset = outputOffset + bytelen;
-
+int endOffset = outputOffset + getByteLen();
+
if (valueLen > hexLength) {
if (avoidVerbose++ % 1 == 0) {
logger.warn("Expect at most " + hexLength + " bytes, but got "
+ valueLen + ", will truncate, value string: " + Bytes.toString(value, 0,
valueLen) + " times:" + avoidVerbose);
@@ -199,7 +197,7 @@ public void encode(String valueStr, byte[] output, int
outputOffset) {
@Override
public String decode(byte[] bytes, int offset, int len) {
-Preconditions.checkArgument(len == bytelen, "len " + len + " not
equals " + bytelen);
+Preconditions.checkArgument(len == getByteLen(), "len " + len + " not
equals " + getByteLen());
if (isNull(bytes, offset, len)) {
return null;
@@ -229,7 +227,7 @@ public String decode(byte[] bytes, int offset, int len) {
private byte[] currentBuf() {
byte[] buf = (byte[]) current.get();
if (buf == null) {
-buf = new byte[bytelen];
+buf = new byte[getByteLen()];
current.set(buf);
}
return buf;
@@ -252,17 +250,17 @@ public Object deserialize(ByteBuffer in) {
@Override
public int peekLength(ByteBuffer in) {
-return bytelen;
+return getByteLen();
}
@Override
public int maxLength() {
-return bytelen;
+return getByteLen();
}
@Override
public int getStorageBytesEstimate() {
-return bytelen;
+return getByteLen();
}
@Override
@@ -290,4 +288,7 @@ private boolean isF(byte[] value, int offset, int length) {
return true;
}
+private int getByteLen() {
+return (this.hexLength + 1) / 2;
+}
}
This is an automated message from the Apache Git Service.
To respond to the message, please log on GitHub and use the
URL above to go to the specific comment.
For queries about this service, please contact Infrastructure at:
us...@infra.apache.org
> FixedLenHexDimEnc return a wrong code length leads to cut bytes error.
> --
>
> Key: KYLIN-3293
> URL: https://issues.apache.org/jira/browse/KYLIN-3293
> Project: Kylin
> Issue Type: Bug
>Reporter: jiatao.tao
>Assignee: jiatao.tao
>Priority: Major
>
> FixedLenHexDimEnc lost its byteLen when deserializing, so in
> GTRecord#loadColumnsFromColumnBlocks, the byte after cutting are wrong.
--
This message
[jira] [Commented] (KYLIN-3296) cube合并时，java.lang.ArrayIndexOutOfBoundsException at java.lang.System.arraycopy(Native Method)
[ https://issues.apache.org/jira/browse/KYLIN-3296?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16409176#comment-16409176 ] RenZhiMin commented on KYLIN-3296: -- I have already submitted it again. Please check it. > cube合并时，java.lang.ArrayIndexOutOfBoundsException at > java.lang.System.arraycopy(Native Method) > - > > Key: KYLIN-3296 > URL: https://issues.apache.org/jira/browse/KYLIN-3296 > Project: Kylin > Issue Type: Bug > Components: Job Engine >Affects Versions: v2.3.0 >Reporter: RenZhiMin >Priority: Major > Labels: patch > Attachments: JIRA.master.3296.patch > > > cube中，设计rowkey时，有个维度设置编码方式是固定长度500。每天采用内存构建算法。在合并cube时，在生成的mr中的map任务执行中出现“java.lang.ArrayIndexOutOfBoundsException > at java.lang.System.arraycopy(Native Method)” > 错误。经查看在生成的mr中的map任务中需要对要合并的cuboiddata数据的rowkey进行切分，切分时，根据每个维度的编码方式获取对应的长度，然后从rowkey中获取，并赋值给SplittedBytes的value中，由于value数组初始化时设置的固定值255，所以在切分大于255的维度值时，出现下标越界错误。 -- This message was sent by Atlassian JIRA (v7.6.3#76005)
[jira] [Issue Comment Deleted] (KYLIN-3303) 全局字典没有增加cube区分
[
https://issues.apache.org/jira/browse/KYLIN-3303?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
]
RenZhiMin updated KYLIN-3303:
-
Comment: was deleted
(was: [~Shaofengshi] [~yimingliu] Please check it.)
> 全局字典没有增加cube区分
> --
>
> Key: KYLIN-3303
> URL: https://issues.apache.org/jira/browse/KYLIN-3303
> Project: Kylin
> Issue Type: Bug
> Components: Job Engine
>Affects Versions: v2.0.0
>Reporter: RenZhiMin
>Priority: Major
>
> cube设计中，某个COUNT_DISTINCT指标使用全局字典。当构建cube时会在hdfs生成字典文件，对应的目录是：{kylin.env.hdfs-working-dir}/resources/GlobalDict/dict/database.tableName/column/，同时会在hbase元数据中生成元数据信息，hbase中元数据rowkey信息：/dict/database.tableName/column/。value信息指定对应的hdfs路径。问题是：当删除cube时没有删除对应的hdfs数据和hbase数据。另外hdfs数据路径和hbase元数据rowkey信息都没有指定具体的cube，如果某一个表的列在多个cube中都使用到了全局字典，会导致多个cube共用一份字典数据。
--
This message was sent by Atlassian JIRA
(v7.6.3#76005)
[jira] [Issue Comment Deleted] (KYLIN-3296) cube合并时，java.lang.ArrayIndexOutOfBoundsException at java.lang.System.arraycopy(Native Method)
[ https://issues.apache.org/jira/browse/KYLIN-3296?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] RenZhiMin updated KYLIN-3296: - Comment: was deleted (was: [~Shaofengshi] I have already submitted it again. Please check it.) > cube合并时，java.lang.ArrayIndexOutOfBoundsException at > java.lang.System.arraycopy(Native Method) > - > > Key: KYLIN-3296 > URL: https://issues.apache.org/jira/browse/KYLIN-3296 > Project: Kylin > Issue Type: Bug > Components: Job Engine >Affects Versions: v2.3.0 >Reporter: RenZhiMin >Priority: Major > Labels: patch > Attachments: JIRA.master.3296.patch > > > cube中，设计rowkey时，有个维度设置编码方式是固定长度500。每天采用内存构建算法。在合并cube时，在生成的mr中的map任务执行中出现“java.lang.ArrayIndexOutOfBoundsException > at java.lang.System.arraycopy(Native Method)” > 错误。经查看在生成的mr中的map任务中需要对要合并的cuboiddata数据的rowkey进行切分，切分时，根据每个维度的编码方式获取对应的长度，然后从rowkey中获取，并赋值给SplittedBytes的value中，由于value数组初始化时设置的固定值255，所以在切分大于255的维度值时，出现下标越界错误。 -- This message was sent by Atlassian JIRA (v7.6.3#76005)
[jira] [Updated] (KYLIN-3285) "Value NNN not exists" error run executing query
[
https://issues.apache.org/jira/browse/KYLIN-3285?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
]
Billy Liu updated KYLIN-3285:
-
Fix Version/s: (was: v2.3.1)
> "Value NNN not exists" error run executing query
> -
>
> Key: KYLIN-3285
> URL: https://issues.apache.org/jira/browse/KYLIN-3285
> Project: Kylin
> Issue Type: Bug
> Components: Query Engine
>Affects Versions: v2.3.0
>Reporter: Shaofeng SHI
>Priority: Major
> Attachments: cube (1).json, kylin.log
>
>
> Reported by community user zxxb...@163.com:
>
> {color:#b94a48}Kylin version update from 2.2.0 to 2.3.0; cube was build
> before update, and query without error.{color}
> {color:#b94a48}After updatge to version 2.3.0 and query {color}"select
> count(userid) num,day_time from record_ap group by day_time LIMIT
> 1000{color:#b94a48}”{color}
> {color:#b94a48}show errors below:{color}
> Column 0 value '2018-03-06' met dictionary error: Value '2018-03-06'
> (2018-03-06) not exists! while executing SQL: "select count(userid)
> num,day_time from record_ap group by day_time LIMIT 1000”
>
> {color:#b94a48}Where {color}{color:#b94a48}'2018-03-06’ come from? I was
> fully confused.{color}
> {color:#b94a48}Cube have several segments:{color}
> {color:#b94a48}Starttime-endtime{color}
> {color:#b94a48}20180101-20180225{color}
> 20180225-20180304
>
> Attached the log and cube JSON.
--
This message was sent by Atlassian JIRA
(v7.6.3#76005)
[jira] [Updated] (KYLIN-3289) Refactor the storage garbage clean up code
[
https://issues.apache.org/jira/browse/KYLIN-3289?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
]
Billy Liu updated KYLIN-3289:
-
Fix Version/s: (was: v2.3.1)
> Refactor the storage garbage clean up code
> --
>
> Key: KYLIN-3289
> URL: https://issues.apache.org/jira/browse/KYLIN-3289
> Project: Kylin
> Issue Type: Improvement
>Affects Versions: v2.3.0
>Reporter: Guangyao Li
>Priority: Minor
>
> Kylin will produce some garbage data in storage when it runs.
> Now, the clean up tool "{{kylin.sh org.apache.kylin.tool.StorageCleanupJob}}"
> can show what is garbage data or clean up the garbage by setting options
> "–delete false" or "delete true".
> But Kylin can't show the size of garbage data for users.
> This reconfiguration adds some member variables and methods recording the
> garbage size in the detection process.
> After clean up job running over, Kylin can get the information about garbage
> size.
--
This message was sent by Atlassian JIRA
(v7.6.3#76005)
[jira] [Resolved] (KYLIN-3270) Add integration test for Optimize Job
[ https://issues.apache.org/jira/browse/KYLIN-3270?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Billy Liu resolved KYLIN-3270. -- Resolution: Fixed > Add integration test for Optimize Job > - > > Key: KYLIN-3270 > URL: https://issues.apache.org/jira/browse/KYLIN-3270 > Project: Kylin > Issue Type: Sub-task > Components: Tools, Build and Test >Reporter: Zhong Yanghong >Assignee: Zhong Yanghong >Priority: Critical > Fix For: v2.3.1 > > Attachments: APACHE-KYLIN-3270-fix-for-2.3.1.patch, > APACHE-KYLIN-3270-master.patch, APACHE-KYLIN-3270.patch > > -- This message was sent by Atlassian JIRA (v7.6.3#76005)
[jira] [Updated] (KYLIN-2914) Visualization tools for data lineage
[ https://issues.apache.org/jira/browse/KYLIN-2914?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Pan, Julian updated KYLIN-2914: --- Priority: Minor (was: Major) > Visualization tools for data lineage > - > > Key: KYLIN-2914 > URL: https://issues.apache.org/jira/browse/KYLIN-2914 > Project: Kylin > Issue Type: New Feature >Reporter: Pan, Julian >Assignee: Pan, Julian >Priority: Minor > > Visualization the relationship about table, model and cubes. -- This message was sent by Atlassian JIRA (v7.6.3#76005)
