Yerui is on vacation; If you're urgent, you can try this way (also confirmed with yerui);
1) backup your metadata to local folder; 2) copy to backup the two global dictionaries in some other folder; 3) among the two dictionaries, pick the bigger one (it should includes all values in the smaller one), and then in the cube json, replace all the references to smaller dict with the bigger one; You can edit the Cube json from Kylin's web gui, in the "Admin" -> "Edit JSON"; 4) remove the smaller one dict from kylin metadata, use kylin's command, like : "./bin/metastore.sh remove /dict/APPLYDATA_DSDCADMIN.FLY_ ZHUANGHUALV_PROC1/LOGINKEY/ae5a65ca-022f-4c81-89f2-7cacb2789888.dict" 2017-01-24 20:14 GMT+08:00 ShaoFeng Shi <[email protected]>: > @Yerui, do you have suggestion on this? > > 2017-01-24 18:19 GMT+08:00 市场中心-ZHANGDA32698 <[email protected]>: > >> Hi ShaoFeng, >> >> >> >> Thanks for your suggestion. However since ours is a daily build, I guess >> there’s no concurrent issue. >> >> The problem stops us from building subsequent segments. I try to remove >> one of the Dicts from hbase and try a rebuild, but seems that they are >> referenced at somewhere else and I got ‘java.lang.IllegalStateException: >> No resource found at -- /dict/APPLYDATA_DSDCADMIN.FLY_ >> ZHUANGHUALV_PROC1/LOGINKEY/ae5a65ca-022f-4c81-89f2-7cacb2789888.dict’ >> problem at step 3 ‘Extract Fact Table Distinct Columns’. Of course I can >> add the key back and let it continue, but without surprise it will stop at >> setp4 ‘Build Dimension Dictionary’ with same error I encountered before >> ‘GlobalDict xxxx should have 0 or 1 append dict but 2’ >> >> How can I resolve this and continue my cube building? Any suggestion is >> appreciated, thanks! >> >> >> >> >> >> *发件人:* ShaoFeng Shi [mailto:[email protected]] >> *发送时间:* 2017年1月24日 17:01 >> *收件人:* user >> *主题:* Re: more than 1 append dict for globalDict >> >> >> >> Hi zhangda, >> >> >> >> Do you have multiple segments (which has the count distinct measure) >> building concurrently? In 1.6.0 and before there is a concurrent bug I >> think; Yerui Sun fixed it in https://issues.apache.org/jira >> /browse/KYLIN-2192 >> >> >> >> So, please check whether it is this problem first; If yes, you need add >> some control (lock) to avoid concurrent build for this cube. >> >> >> >> 2017-01-24 16:33 GMT+08:00 市场中心-ZHANGDA32698 <[email protected]>: >> >> Hi there, >> >> >> >> I have a cube computing for some UV statistics. Since it requires global >> count distinct operation, in the advanced dictionaries setting I put UV key >> column’s builder class as ‘GlobalDictionaryBuilder’. >> >> Everyday build went on without any problem until yesterday there was a >> ‘GlobalDict xxxx should have 0 or 1 append dict but 2"’ exception. I >> checked the ‘kylin_metadata’ table in the hbase , and saw there were indeed >> 2 dict >> >> '/dict/APPLYDATA_DSDCADMIN.FLY_ZHUANGHUALV_PROC1/LOGINKEY/ >> ae5a65ca-022f-4c81-89f2-7cacb2789888.dict' >> >> /dict/APPLYDATA_DSDCADMIN.FLY_ZHUANGHUALV_PROC1/LOGINKEY/ced >> ce514-657d-4032-a591-7f01d984df65.dict' >> >> Fyi, APPLYDATA_DSDCADMIN.FLY_ZHUANGHUALV_PROC1 is the hive table name, >> LOGINKEY is the count distinct key >> >> I’m not sure what had gone wrong, and I suppose global dict on 1 key >> should be unique. Has anyone ever encountered similar error before, can >> share some ideas? Thanks! >> >> >> >> >> >> -- >> >> Best regards, >> >> >> >> Shaofeng Shi 史少锋 >> >> >> > > > > -- > Best regards, > > Shaofeng Shi 史少锋 > > -- Best regards, Shaofeng Shi 史少锋
