Re: Fetch query result iteratively to avoid OOM

2020-07-09 Thread Julian Feinauer
Hi Jialin, this is a very good point, indeed. I remember in Calcite there was the Linq4j Module which was based on an extension of an "Iterable / Iterator" which was basically Lazy Loading / Computation. This object was assembled throughout the query and finally given to the Servers handler who

Fetch query result iteratively to avoid OOM

2020-07-09 Thread Jialin Qiao
Hi, Currently, Haihang and Yuan Tian added an improvement to fetch the results of show timeseries iteratively to avoid OOM [1]. For data queries, we use the QueryDataSet which provides the hasNext & next iterator. Then the client could fetch result by fetchSize. However, for most metadata q