+1. I wanted to express my admiration for the remarkable progress you've made with the IoTDB query engine! Implementing memory control for FE query plans would significantly enhance our system's robustness and reliability.
Best regards, Yanze Chen Liao Lanyu <[email protected]> 于2024年5月23日周四 11:08写道： > Hi, > Currently, the IoTDB query engine does not implement memory control at the > FE (Frontend) stage. In scenarios with massive series queries (e.g., select > * from root.**), the query plans generated at the FE stage can become > excessively large. Roughly estimating, the size of a single SeriesScanNode > is about 1/2 KB, which means that two million series corresponding to two > million SeriesScanNodes would occupy 1 GB, posing a potential risk of > Out-Of-Memory (OOM). In high concurrency scenarios, even if a single query > plan is not large, the total memory occupied by multiple query plans can > still lead to OOM. > Therefore, it is now desired to introduce memory size control for FE query > plans within the query engine. > The PR is: https://github.com/apache/iotdb/pull/12573 > > > > > 1435078631 > [email protected] > > > > -- Yanze Chen School of Software, Tsinghua University
