Hi,
When this error occurs, you can using “$KYLIN_HOME/bin/metastore.sh fetch
/dict“ to download the dictionaries to local and check if the dictionary file
exist, besides. You can check your hdfs permission. Otherwise, you may show us
more information about your situation like your working scene.
-------------------
Best wishes,
Rupeng Wang
发件人: Johnson <[email protected]>
答复: "[email protected]" <[email protected]>
日期: 2019年8月29日 星期四 10:49
收件人: "[email protected]" <[email protected]>
主题: Failed to read big resource /dict/xxxx
hi，大家好，
今天发现一个失败的任务，失败在#4 Step Name: Build Dimension Dictionary
报错信息如下：之后我把这个任务drop掉，重新构建还是一直报这个错，大家知道怎么解决吗
org.apache.kylin.engine.mr.exception.HadoopShellException:
java.lang.RuntimeException: java.io.IOException: Failed to read big resource
/dict/KYLIN_VIEW.xxxxxxxxxxxxxxxx/COUNTRY/66292068-e8eb-975a-3e44-b56c933c14cc.dict
at
org.apache.kylin.dict.DictionaryManager.getDictionaryInfo(DictionaryManager.java:108)
at
org.apache.kylin.dict.DictionaryManager.checkDupByContent(DictionaryManager.java:173)
at
org.apache.kylin.dict.DictionaryManager.trySaveNewDict(DictionaryManager.java:151)
at
org.apache.kylin.dict.DictionaryManager.saveDictionary(DictionaryManager.java:320)
at
org.apache.kylin.cube.CubeManager$DictionaryAssist.saveDictionary(CubeManager.java:1127)
at org.apache.kylin.cube.CubeManager.saveDictionary(CubeManager.java:1089)
at
org.apache.kylin.cube.cli.DictionaryGeneratorCLI.processSegment(DictionaryGeneratorCLI.java:74)
at
org.apache.kylin.cube.cli.DictionaryGeneratorCLI.processSegment(DictionaryGeneratorCLI.java:55)
at
org.apache.kylin.engine.mr.steps.CreateDictionaryJob.run(CreateDictionaryJob.java:73)
at org.apache.kylin.engine.mr.MRUtil.runMRJob(MRUtil.java:93)
