Hi,
I am a newbie in kylin
While I am building the cube I got an java.lang.StackOverflowError
exception at the 3rd step(Build Dimension Dictionary).
I got this error only when building cube with large table with inner join.
I have changed the reducer maximum memmory size and maximum concurrent
thread to lower level. But still the error.
Somebody please help me.
Thank you
My system configurations,
KYLIN_JVM_SETTINGS is -Xms1024M -Xmx4096M -XX:MaxPermSize=128M
kylin.job.mapreduce.default.reduce.input.mb=100
kylin.job.concurrent.max.limit=7
Error Log
java.lang.StackOverflowError
at java.lang.ThreadLocal$ThreadLocalMap.getEntry(ThreadLocal.java:419)
at java.lang.ThreadLocal$ThreadLocalMap.access$000(ThreadLocal.java:298)
at java.lang.ThreadLocal.get(ThreadLocal.java:163)
at org.apache.hadoop.io.Text.decode(Text.java:406)
at org.apache.hadoop.io.Text.decode(Text.java:389)
at
org.apache.hadoop.hive.serde2.lazy.LazyUtils.convertToString(LazyUtils.java:126)
at
org.apache.hadoop.hive.serde2.lazy.LazyInteger.parse(LazyInteger.java:151)
at
org.apache.hadoop.hive.serde2.lazy.LazyInteger.parseInt(LazyInteger.java:116)
at
org.apache.hadoop.hive.serde2.lazy.LazyInteger.init(LazyInteger.java:55)
at
org.apache.hadoop.hive.serde2.lazy.LazyStruct.uncheckedGetField(LazyStruct.java:226)
at
org.apache.hadoop.hive.serde2.lazy.LazyStruct.getField(LazyStruct.java:202)
at
org.apache.hadoop.hive.serde2.lazy.objectinspector.LazySimpleStructObjectInspector.getStructFieldData(LazySimpleStructObjectInspector.java:128)
at
org.apache.hive.hcatalog.data.LazyHCatRecord.get(LazyHCatRecord.java:53)
at
org.apache.hive.hcatalog.data.LazyHCatRecord.get(LazyHCatRecord.java:97)
at
org.apache.hive.hcatalog.mapreduce.HCatRecordReader.nextKeyValue(HCatRecordReader.java:204)
at
org.apache.hive.hcatalog.data.transfer.impl.HCatInputFormatReader$HCatRecordItr.hasNext(HCatInputFormatReader.java:107)
at
org.apache.kylin.dict.lookup.HiveTableReader.next(HiveTableReader.java:92)
at
org.apache.kylin.dict.TableColumnValueEnumerator.moveNext(TableColumnValueEnumerator.java:46)
at
org.apache.kylin.dict.TableColumnValueEnumerator.moveNext(TableColumnValueEnumerator.java:63)
at
org.apache.kylin.dict.TableColumnValueEnumerator.moveNext(TableColumnValueEnumerator.java:63)
at
org.apache.kylin.dict.TableColumnValueEnumerator.moveNext(TableColumnValueEnumerator.java:63)
at
org.apache.kylin.dict.TableColumnValueEnumerator.moveNext(TableColumnValueEnumerator.java:63)
...
