[
https://issues.apache.org/jira/browse/KYLIN-1737?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=15313322#comment-15313322
]
liyang commented on KYLIN-1737:
-------------------------------
KYLIN-1718 should have this covered.
> BufferOverflowException when calculate raw measure
> --------------------------------------------------
>
> Key: KYLIN-1737
> URL: https://issues.apache.org/jira/browse/KYLIN-1737
> Project: Kylin
> Issue Type: Bug
> Components: Job Engine
> Affects Versions: v1.5.1
> Environment: centos 6.5
> Reporter: zhou degao
> Assignee: Dong Li
>
> Input records: 6M+ (no this error if the input records is less than 3M)
> Error: java.nio.BufferOverflowException at
> java.nio.HeapByteBuffer.put(HeapByteBuffer.java:189) at
> java.nio.ByteBuffer.put(ByteBuffer.java:859) at
> org.apache.kylin.common.util.BytesUtil.writeByteArray(BytesUtil.java:338) at
> org.apache.kylin.measure.raw.RawSerializer.serialize(RawSerializer.java:88)
> at
> org.apache.kylin.measure.raw.RawSerializer.serialize(RawSerializer.java:30)
> at org.apache.kylin.measure.MeasureCodec.encode(MeasureCodec.java:89) at
> org.apache.kylin.engine.mr.steps.CuboidReducer.reduce(CuboidReducer.java:105)
> at
> org.apache.kylin.engine.mr.steps.CuboidReducer.reduce(CuboidReducer.java:43)
> at org.apache.hadoop.mapreduce.Reducer.run(Reducer.java:171) at
> org.apache.hadoop.mapred.ReduceTask.runNewReducer(ReduceTask.java:627) at
> org.apache.hadoop.mapred.ReduceTask.run(ReduceTask.java:389) at
> org.apache.hadoop.mapred.YarnChild$2.run(YarnChild.java:168) at
> java.security.AccessController.doPrivileged(Native Method) at
> javax.security.auth.Subject.doAs(Subject.java:422) at
> org.apache.hadoop.security.UserGroupInformation.doAs(UserGroupInformation.java:1657)
> at org.apache.hadoop.mapred.YarnChild.main(YarnChild.java:162)
--
This message was sent by Atlassian JIRA
(v6.3.4#6332)
