Joe McDonnell created IMPALA-11905:
--------------------------------------
Summary: Add an option to use direct IO for the data cache
Key: IMPALA-11905
URL: https://issues.apache.org/jira/browse/IMPALA-11905
Project: IMPALA
Issue Type: Improvement
Components: Backend
Affects Versions: Impala 4.3.0
Reporter: Joe McDonnell
The data cache typically makes use of fast SSDs for storage. Given how fast
those SSDs are, it may be better to do direct IO rather than going through the
OS buffer cache. Excessive traffic through the OS buffer cache can create
memory pressure and performance issues. We should add a startup option to use
direct IO (i.e. O_DIRECT when opening the file) and test performance.
--
This message was sent by Atlassian Jira
(v8.20.10#820010)
