[
https://issues.apache.org/jira/browse/ARROW-6219?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=16905814#comment-16905814
]
Micah Kornfield commented on ARROW-6219:
----------------------------------------
I think field selection certainly. I'm not sure about row limit. It some
cases it can be a lot more efficient to not have a row-limit then doing
repeated queries with row-limit and offset. I'm guessing that
https://issues.apache.org/jira/browse/ARROW-6202 is one case where a limit was
not being used.
> [Java] Add API for JDBC adapter that can convert less then the full result
> set at a time.
> -----------------------------------------------------------------------------------------
>
> Key: ARROW-6219
> URL: https://issues.apache.org/jira/browse/ARROW-6219
> Project: Apache Arrow
> Issue Type: Improvement
> Components: Java
> Reporter: Micah Kornfield
> Assignee: Ji Liu
> Priority: Major
>
> Somehow we should configure number of rows per batch and either let clients
> iterate or provide an iterator API. Otherwise for large result sets we might
> run out of memory.
--
This message was sent by Atlassian JIRA
(v7.6.14#76016)
