[
https://issues.apache.org/jira/browse/KYLIN-5879?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
]
liyang closed KYLIN-5879.
-------------------------
> use dataset iterator api to reduce driver memory use
> ----------------------------------------------------
>
> Key: KYLIN-5879
> URL: https://issues.apache.org/jira/browse/KYLIN-5879
> Project: Kylin
> Issue Type: New Feature
> Components: Query Engine
> Affects Versions: 5.0-alpha
> Reporter: pengfei.zhan
> Assignee: pengfei.zhan
> Priority: Major
> Fix For: 5.0.0
>
>
> Full Scenario OLAP Service/Data Unification Service Outlet
> * The query result set should not reasonably have a Limit limit.
> * Scenarios answered by hierarchical storage/detailed indexing can support
> large-scale data exporting
> * scenarios answered by query down, querying through JDBC provided by KE, the
> performance is not significantly lower than using JDBC provided by the data
> source directly, such as querying Hive JDBC directly.
> * the amount of data returned does not set a limit on the number of data
> entries / or data size, because customer data is growing, the analysis of the
> scene is not fixed.
> * customer behavior using data in a uniform manner, the current asynchronous
> query in the data use scenarios have limitations.
--
This message was sent by Atlassian Jira
(v8.20.10#820010)
