Hi ShaoFeng, Thanks for your suggestion. However since ours is a daily build, I guess there’s no concurrent issue. The problem stops us from building subsequent segments. I try to remove one of the Dicts from hbase and try a rebuild, but seems that they are referenced at somewhere else and I got ‘java.lang.IllegalStateException: No resource found at -- /dict/APPLYDATA_DSDCADMIN.FLY_ZHUANGHUALV_PROC1/LOGINKEY/ae5a65ca-022f-4c81-89f2-7cacb2789888.dict’ problem at step 3 ‘Extract Fact Table Distinct Columns’. Of course I can add the key back and let it continue, but without surprise it will stop at setp4 ‘Build Dimension Dictionary’ with same error I encountered before ‘GlobalDict xxxx should have 0 or 1 append dict but 2’ How can I resolve this and continue my cube building? Any suggestion is appreciated, thanks!
发件人: ShaoFeng Shi [mailto:[email protected]] 发送时间: 2017年1月24日 17:01 收件人: user 主题: Re: more than 1 append dict for globalDict Hi zhangda, Do you have multiple segments (which has the count distinct measure) building concurrently? In 1.6.0 and before there is a concurrent bug I think; Yerui Sun fixed it in https://issues.apache.org/jira/browse/KYLIN-2192 So, please check whether it is this problem first; If yes, you need add some control (lock) to avoid concurrent build for this cube. 2017-01-24 16:33 GMT+08:00 市场中心-ZHANGDA32698 <[email protected]<mailto:[email protected]>>: Hi there, I have a cube computing for some UV statistics. Since it requires global count distinct operation, in the advanced dictionaries setting I put UV key column’s builder class as ‘GlobalDictionaryBuilder’. Everyday build went on without any problem until yesterday there was a ‘GlobalDict xxxx should have 0 or 1 append dict but 2"’ exception. I checked the ‘kylin_metadata’ table in the hbase , and saw there were indeed 2 dict '/dict/APPLYDATA_DSDCADMIN.FLY_ZHUANGHUALV_PROC1/LOGINKEY/ae5a65ca-022f-4c81-89f2-7cacb2789888.dict' /dict/APPLYDATA_DSDCADMIN.FLY_ZHUANGHUALV_PROC1/LOGINKEY/cedce514-657d-4032-a591-7f01d984df65.dict' Fyi, APPLYDATA_DSDCADMIN.FLY_ZHUANGHUALV_PROC1 is the hive table name, LOGINKEY is the count distinct key I’m not sure what had gone wrong, and I suppose global dict on 1 key should be unique. Has anyone ever encountered similar error before, can share some ideas? Thanks! -- Best regards, Shaofeng Shi 史少锋
