[jira] [Commented] (KYLIN-3296) cube合并时,java.lang.ArrayIndexOutOfBoundsException at java.lang.System.arraycopy(Native Method)
[ https://issues.apache.org/jira/browse/KYLIN-3296?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16410833#comment-16410833 ] RenZhiMin commented on KYLIN-3296: -- Hi [~yimingliu] I have manually generate a patch by git . Please check it. > cube合并时,java.lang.ArrayIndexOutOfBoundsException at > java.lang.System.arraycopy(Native Method) > - > > Key: KYLIN-3296 > URL: https://issues.apache.org/jira/browse/KYLIN-3296 > Project: Kylin > Issue Type: Bug > Components: Job Engine >Affects Versions: v2.3.0 >Reporter: RenZhiMin >Priority: Major > Labels: patch > Attachments: JIRA.master.3296.patch > > > cube中,设计rowkey时,有个维度设置编码方式是固定长度500。每天采用内存构建算法。在合并cube时,在生成的mr中的map任务执行中出现“java.lang.ArrayIndexOutOfBoundsException > at java.lang.System.arraycopy(Native Method)” > 错误。经查看在生成的mr中的map任务中需要对要合并的cuboiddata数据的rowkey进行切分,切分时,根据每个维度的编码方式获取对应的长度,然后从rowkey中获取,并赋值给SplittedBytes的value中,由于value数组初始化时设置的固定值255,所以在切分大于255的维度值时,出现下标越界错误。 -- This message was sent by Atlassian JIRA (v7.6.3#76005)
[jira] [Commented] (KYLIN-3296) cube合并时,java.lang.ArrayIndexOutOfBoundsException at java.lang.System.arraycopy(Native Method)
[ https://issues.apache.org/jira/browse/KYLIN-3296?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16409335#comment-16409335 ] Billy Liu commented on KYLIN-3296: -- Hi [~renzm], this is not standard patch format. The patch should contain your committer info. > cube合并时,java.lang.ArrayIndexOutOfBoundsException at > java.lang.System.arraycopy(Native Method) > - > > Key: KYLIN-3296 > URL: https://issues.apache.org/jira/browse/KYLIN-3296 > Project: Kylin > Issue Type: Bug > Components: Job Engine >Affects Versions: v2.3.0 >Reporter: RenZhiMin >Priority: Major > Labels: patch > Attachments: JIRA.master.3296.patch > > > cube中,设计rowkey时,有个维度设置编码方式是固定长度500。每天采用内存构建算法。在合并cube时,在生成的mr中的map任务执行中出现“java.lang.ArrayIndexOutOfBoundsException > at java.lang.System.arraycopy(Native Method)” > 错误。经查看在生成的mr中的map任务中需要对要合并的cuboiddata数据的rowkey进行切分,切分时,根据每个维度的编码方式获取对应的长度,然后从rowkey中获取,并赋值给SplittedBytes的value中,由于value数组初始化时设置的固定值255,所以在切分大于255的维度值时,出现下标越界错误。 -- This message was sent by Atlassian JIRA (v7.6.3#76005)
[jira] [Commented] (KYLIN-3296) cube合并时,java.lang.ArrayIndexOutOfBoundsException at java.lang.System.arraycopy(Native Method)
[ https://issues.apache.org/jira/browse/KYLIN-3296?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16409176#comment-16409176 ] RenZhiMin commented on KYLIN-3296: -- I have already submitted it again. Please check it. > cube合并时,java.lang.ArrayIndexOutOfBoundsException at > java.lang.System.arraycopy(Native Method) > - > > Key: KYLIN-3296 > URL: https://issues.apache.org/jira/browse/KYLIN-3296 > Project: Kylin > Issue Type: Bug > Components: Job Engine >Affects Versions: v2.3.0 >Reporter: RenZhiMin >Priority: Major > Labels: patch > Attachments: JIRA.master.3296.patch > > > cube中,设计rowkey时,有个维度设置编码方式是固定长度500。每天采用内存构建算法。在合并cube时,在生成的mr中的map任务执行中出现“java.lang.ArrayIndexOutOfBoundsException > at java.lang.System.arraycopy(Native Method)” > 错误。经查看在生成的mr中的map任务中需要对要合并的cuboiddata数据的rowkey进行切分,切分时,根据每个维度的编码方式获取对应的长度,然后从rowkey中获取,并赋值给SplittedBytes的value中,由于value数组初始化时设置的固定值255,所以在切分大于255的维度值时,出现下标越界错误。 -- This message was sent by Atlassian JIRA (v7.6.3#76005)
[jira] [Commented] (KYLIN-3296) cube合并时,java.lang.ArrayIndexOutOfBoundsException at java.lang.System.arraycopy(Native Method)
[ https://issues.apache.org/jira/browse/KYLIN-3296?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16405774#comment-16405774 ] RenZhiMin commented on KYLIN-3296: -- [~Shaofengshi] I have already submitted it again. Please check it. > cube合并时,java.lang.ArrayIndexOutOfBoundsException at > java.lang.System.arraycopy(Native Method) > - > > Key: KYLIN-3296 > URL: https://issues.apache.org/jira/browse/KYLIN-3296 > Project: Kylin > Issue Type: Bug > Components: Job Engine >Affects Versions: v2.3.0 >Reporter: RenZhiMin >Priority: Major > Labels: patch > Attachments: JIRA.master.3296.patch > > > cube中,设计rowkey时,有个维度设置编码方式是固定长度500。每天采用内存构建算法。在合并cube时,在生成的mr中的map任务执行中出现“java.lang.ArrayIndexOutOfBoundsException > at java.lang.System.arraycopy(Native Method)” > 错误。经查看在生成的mr中的map任务中需要对要合并的cuboiddata数据的rowkey进行切分,切分时,根据每个维度的编码方式获取对应的长度,然后从rowkey中获取,并赋值给SplittedBytes的value中,由于value数组初始化时设置的固定值255,所以在切分大于255的维度值时,出现下标越界错误。 -- This message was sent by Atlassian JIRA (v7.6.3#76005)
[jira] [Commented] (KYLIN-3296) cube合并时,java.lang.ArrayIndexOutOfBoundsException at java.lang.System.arraycopy(Native Method)
[ https://issues.apache.org/jira/browse/KYLIN-3296?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16405689#comment-16405689 ] Billy Liu commented on KYLIN-3296: -- Nice found. > cube合并时,java.lang.ArrayIndexOutOfBoundsException at > java.lang.System.arraycopy(Native Method) > - > > Key: KYLIN-3296 > URL: https://issues.apache.org/jira/browse/KYLIN-3296 > Project: Kylin > Issue Type: Bug > Components: Job Engine >Affects Versions: v2.3.0 >Reporter: RenZhiMin >Priority: Major > Labels: patch > Attachments: RowKeySplitter.patch > > > cube中,设计rowkey时,有个维度设置编码方式是固定长度500。每天采用内存构建算法。在合并cube时,在生成的mr中的map任务执行中出现“java.lang.ArrayIndexOutOfBoundsException > at java.lang.System.arraycopy(Native Method)” > 错误。经查看在生成的mr中的map任务中需要对要合并的cuboiddata数据的rowkey进行切分,切分时,根据每个维度的编码方式获取对应的长度,然后从rowkey中获取,并赋值给SplittedBytes的value中,由于value数组初始化时设置的固定值255,所以在切分大于255的维度值时,出现下标越界错误。 -- This message was sent by Atlassian JIRA (v7.6.3#76005)