ok,I'll try to make it configurable in kylin.properties ________________________________ 赵天烁 Kevin Zhao [email protected]<mailto:[email protected]>
珠海市魅族科技有限公司 MEIZU Technology Co., Ltd. 广东省珠海市科技创新海岸魅族科技楼 MEIZU Tech Bldg., Technology & Innovation Coast Zhuhai, 519085, Guangdong, China meizu.com From: ShaoFeng Shi<mailto:[email protected]> Date: 2016-08-02 22:37 To: user<mailto:[email protected]> Subject: Re: Re: Scan row count exceeded threshold This is a new change introduced in 1.5.3, JIRA is: https://issues.apache.org/jira/browse/KYLIN-1787 In a short, it tries to avoid scanning too many rows (1 million) in one query. But the threshold wasn't externalized as a parameter. @Tianshuo, would you mind to contribute a patch? Besides, the query has "limit 1" but Kylin didn't smartly aware that. @Tian sheng, what's the SQL query looks like in your case? 2016-08-02 21:14 GMT+08:00 张天生 <[email protected]<mailto:[email protected]>>: I meet the same question. In 1.5.2.1 version it worked fine, but switched 1.5.3 it ofter report this error. 赵天烁 <[email protected]<mailto:[email protected]>>于2016年8月2日周二 上午11:57写道： yes, it is 1.5.3,after limit the date range to a week,it still cost about 7 second to response, is there any way to get the query execute detail just like the diagnosis log? ________________________________ 赵天烁 Kevin Zhao [email protected]<mailto:[email protected]> 珠海市魅族科技有限公司 MEIZU Technology Co., Ltd. 广东省珠海市科技创新海岸魅族科技楼 MEIZU Tech Bldg., Technology & Innovation Coast Zhuhai, 519085, Guangdong, China meizu.com<http://meizu.com> From: ShaoFeng Shi<mailto:[email protected]> Date: 2016-08-01 20:20 To: user<mailto:[email protected]> Subject: Re: Scan row count exceeded threshold are you on 1.5.3? If not, suggest to upgrade and then retry it. Besides, you can add some "where" contition to reduce the records to scan, as the error message mentioned. 2016-08-01 15:37 GMT+08:00 赵天烁 <[email protected]<mailto:[email protected]>>: recently I got the following error while execute query on a cube which is not that big( about 400mb, 20milion record) ================== Error while executing SQL "select FCRASHTIME,count(1) from UXIP.EDL_FDT_OUC_UPLOAD_FILES group by FCRASH_ANALYSIS_ID,FCRASHTIME limit 1": Scan row count exceeded threshold: 10000000, please add filter condition to narrow down backend scan range, like where clause. I guess what it scan were the intermediate result, but It doesn't any order by,also the result count is limit to just 1.so it could scan to find any record with those two dimension and wala. waiting kylin expert to give me some detail on that. btw how to configure that threshold, any properties in kylin.properties? ________________________________ 赵天烁 Kevin Zhao [email protected]<mailto:[email protected]> 珠海市魅族科技有限公司 MEIZU Technology Co., Ltd. 广东省珠海市科技创新海岸魅族科技楼 MEIZU Tech Bldg., Technology & Innovation Coast Zhuhai, 519085, Guangdong, China meizu.com<http://meizu.com> -- Best regards, Shaofeng Shi -- Best regards, Shaofeng Shi
