Because the query has the "order by"? The sorting need happens in Kylin
side, so couldn't push down the limit to HBase.

Best regards,

Shaofeng Shi 史少锋
Apache Kylin PMC
Email: [email protected]

Apache Kylin FAQ: https://kylin.apache.org/docs/gettingstarted/faq.html
Join Kylin user mail group: [email protected]
Join Kylin dev mail group: [email protected]




lk_hadoop <[email protected]> 于2019年5月28日周二 下午1:28写道:

> I've know the reason , because
> GTCubeStorageQueryBase.enableStorageLimitIfPossible method will change the
> limit push down behavior.
>
> 2019-05-28
> ------------------------------
> lk_hadoop
> ------------------------------
>
> *发件人:*"lk_hadoop"<[email protected]>
> *发送时间:*2019-05-28 10:38
> *主题:*Re: Re: Re: jdbc query with limit not work
> *收件人:*"user"<[email protected]>,"lk_hadoop"<[email protected]>
> *抄送:*
>
> I was useing JDBC , I just add the limit clause at the end of the query
> sql .
> And When I do a query with aggregate functions   , I can see the log like
> :
> storage.StorageContext:167 : Enabling limit push down: 200000 at level:
> LIMIT_ON_RETURN_SIZE
> when I qury what values dose a dim have , for example :
> "SELECT "SH_FETCH_SALE_BASE_FACT_ALL_NEW"."GOODS_SPEC" FROM
> "GJST"."SH_FETCH_SALE_BASE_FACT_ALL_NEW" "SH_FETCH_SALE_BASE_FACT_ALL_NEW"
> GROUP BY "SH_FETCH_SALE_BASE_FACT_ALL_NEW"."GOODS_SPEC" ORDER BY
> "SH_FETCH_SALE_BASE_FACT_ALL_NEW"."GOODS_SPEC" limit 1000"
> I can't see any limit push down log .
> But, What I really want is limit push down level : LIMIT_ON_SCAN
> I have config the property :
> kylin.storage.limit-push-down-enabled=true
>
> 2019-05-28
> ------------------------------
> lk_hadoop
> ------------------------------
>
> *发件人:*"lk_hadoop"<[email protected]>
> *发送时间:*2019-05-28 10:03
> *主题:*Re: Re: jdbc query with limit not work
> *收件人:*"user"<[email protected]>
> *抄送:*
>
>
> 2019-05-28
> ------------------------------
> lk_hadoop
> ------------------------------
>
> *发件人:*JiaTao Tao <[email protected]>
> *发送时间:*2019-05-27 19:47
> *主题:*Re: jdbc query with limit not work
> *收件人:*"user"<[email protected]>
> *抄送:*
>
> Hi
> Try to set "kylin.query.max-return-rows" a larger value(>1042201), and
> re-run your query.
>
>
> --
>
>
> Regards!
>
> Aron Tao
>
> lk_hadoop <[email protected]> 于2019年5月27日周一 上午11:00写道:
>
>> hi,all:
>>     I'm using kylin2.6.1 , when I use JDBC Driver to connect to Kylin and
>> query data, I got such error :
>>
>> org.apache.kylin.rest.exception.InternalErrorException: Query returned
>> 1042201 rows exceeds threshold 1000000
>> while executing SQL: "SELECT
>> "SH_FETCH_SALE_BASE_FACT_ALL_NEW"."GOODS_SPEC" FROM
>> "GJST"."SH_FETCH_SALE_BASE_FACT_ALL_NEW" "SH_FETCH_SALE_BASE_FACT_ALL_NEW"
>> GROUP BY "SH_FETCH_SALE_BASE_FACT_ALL_NEW"."GOODS_SPEC" ORDER BY
>> "SH_FETCH_SALE_BASE_FACT_ALL_NEW"."GOODS_SPEC" limit 1000"
>> why ?
>>
>> 2019-05-27
>> ------------------------------
>> lk_hadoop
>>
>
>
>

Reply via email to