[
https://issues.apache.org/jira/browse/IMPALA-10545?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
]
Michael Smith resolved IMPALA-10545.
------------------------------------
Fix Version/s: Impala 4.2.0
Resolution: Fixed
> Tune data_cache_write_concurrency based on the type of IO device
> ----------------------------------------------------------------
>
> Key: IMPALA-10545
> URL: https://issues.apache.org/jira/browse/IMPALA-10545
> Project: IMPALA
> Issue Type: Improvement
> Components: Backend
> Affects Versions: Impala 4.0.0
> Reporter: Joe McDonnell
> Assignee: Michael Smith
> Priority: Major
> Labels: ramp-up
> Fix For: Impala 4.2.0
>
> Attachments: test.sh, test1.out, test8.out
>
>
> The data cache limits concurrency writes to the cache to avoid overwhelming
> the underlying IO device. This is controlled by the
> data_cache_write_concurrency flags and defaults to 1. For SSDs, we should be
> able to increase this to allow more concurrent writes to the data cache. This
> would allow the data cache to warm up faster and stay more up to date.
> One option is to detect the underlying IO device (similar to how we do this
> for other parts of Disk IO Mgr) and tune this parameter higher for SSDs.
--
This message was sent by Atlassian Jira
(v8.20.10#820010)
