1.kylin版本2.6.2,查看邮件列表,之前有个同学也遇到了这个问题,也是2.6.2版本 2.报错的那个dict不存在,这个cube已经稳定运行数月,各组件权限没有问题。 3.查看kylin log没有发现问题点。 4.之后我反复测试构建该cube,监控hdfs上kylin元数据目录,发现该报错维度的dict文件没有生成,报错信息一样,怀疑是元数据问题。 5.使用kylin cli工具清理存储(包括部分元数据),再构建,报错一致。 6.对报错cube使用到的hive表,建hive视图(改名),导入kylin,新建了一样的cube,之后构建这个新cube没有报错。怀疑kylin构建之前那个hive 表元数据问题。
| | itzhangqiang | | 邮箱[email protected] | 签名由 网易邮箱大师 定制 On 08/29/2019 19:38, Wang rupeng wrote: Hi, When this error occurs, you can using “$KYLIN_HOME/bin/metastore.sh fetch /dict“ to download the dictionaries to local and check if the dictionary file exist, besides. You can check your hdfs permission. Otherwise, you may show us more information about your situation like your working scene. ------------------- Best wishes, Rupeng Wang 发件人: Johnson <[email protected]> 答复: "[email protected]" <[email protected]> 日期: 2019年8月29日星期四 10:49 收件人: "[email protected]" <[email protected]> 主题: Failed to read big resource /dict/xxxx hi,大家好, 今天发现一个失败的任务,失败在#4 Step Name: Build Dimension Dictionary 报错信息如下:之后我把这个任务drop掉,重新构建还是一直报这个错,大家知道怎么解决吗 org.apache.kylin.engine.mr.exception.HadoopShellException: java.lang.RuntimeException: java.io.IOException: Failed to read big resource /dict/KYLIN_VIEW.xxxxxxxxxxxxxxxx/COUNTRY/66292068-e8eb-975a-3e44-b56c933c14cc.dict at org.apache.kylin.dict.DictionaryManager.getDictionaryInfo(DictionaryManager.java:108) at org.apache.kylin.dict.DictionaryManager.checkDupByContent(DictionaryManager.java:173) at org.apache.kylin.dict.DictionaryManager.trySaveNewDict(DictionaryManager.java:151) at org.apache.kylin.dict.DictionaryManager.saveDictionary(DictionaryManager.java:320) at org.apache.kylin.cube.CubeManager$DictionaryAssist.saveDictionary(CubeManager.java:1127) at org.apache.kylin.cube.CubeManager.saveDictionary(CubeManager.java:1089) at org.apache.kylin.cube.cli.DictionaryGeneratorCLI.processSegment(DictionaryGeneratorCLI.java:74) at org.apache.kylin.cube.cli.DictionaryGeneratorCLI.processSegment(DictionaryGeneratorCLI.java:55) at org.apache.kylin.engine.mr.steps.CreateDictionaryJob.run(CreateDictionaryJob.java:73) at org.apache.kylin.engine.mr.MRUtil.runMRJob(MRUtil.java:93)
