JackieTien97 opened a new pull request, #17071: URL: https://github.com/apache/iotdb/pull/17071
This pull request primarily addresses improvements in memory allocation and timeout handling for query execution in the DataNode module. The most significant changes include refining the calculation of memory limits per query thread, updating the initialization sequence for memory-related properties, and enhancing the robustness of timeout management for driver tasks. **Memory Allocation Improvements:** * The calculation of `maxBytesPerFragmentInstance` in `DataNodeMemoryConfig` is now divided by `queryThreadCount`, ensuring fairer memory distribution among query threads and preventing overallocation. * The initialization of `queryThreadCount` from configuration properties is moved to occur after the `dataExchangeMemoryManager` is initialized, ensuring that dependent memory calculations use the correct thread count. * The logic for setting `maxBytesPerFragmentInstance` during memory allocation initialization has been removed, as this is now handled dynamically when the query thread count is set. * The setter for `queryThreadCount` now updates `maxBytesPerFragmentInstance` based on the current state of the memory manager, ensuring consistency if the thread count changes at runtime. **Timeout Handling Enhancement:** * In `DriverTask`, the computation of the deadline (`ddl`) now checks for integer overflow when adding large timeouts, assigning `Long.MAX_VALUE` if an overflow is detected to avoid infinite timeout loops during schema fetch operations. -- This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use the URL above to go to the specific comment. To unsubscribe, e-mail: [email protected] For queries about this service, please contact Infrastructure at: [email protected]
