[ 
https://issues.apache.org/jira/browse/HDDS-11191?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
 ]

Sadanand Shenoy updated HDDS-11191:
-----------------------------------
    Description: 
Currently the max_open_files rocksdb config is -1 by default and not set 
anywhere via Ozone code. However in situations where the number of SST Files in 
the rocksdb instance becomes greater than the ulimit (open file limit of the 
OS), Rocksdb will not respect the OS config and try to open all files at once 
thereby leading to "Too many open files" error. 

Introducing a config in Ozone to set this is helpful to avoid/recover from such 
crashes.

  was:
Currently the max_open_files rocksdb config is -1 by default and not set 
anywhere via Ozone code. However in situations where the number of SST Files in 
the rocksdb instance becomes greater than the ulimit (open file limit of the 
OS), Rocksdb will not respect the OS config and try to open all files at once 
thereby leading to "Too many files" error. 

Introducing a config in Ozone to set this is helpful to avoid/recover from such 
crashes.


> Add a config to set max_open_files for OM RocksDB.
> --------------------------------------------------
>
>                 Key: HDDS-11191
>                 URL: https://issues.apache.org/jira/browse/HDDS-11191
>             Project: Apache Ozone
>          Issue Type: Bug
>          Components: OM
>            Reporter: Sadanand Shenoy
>            Assignee: Sadanand Shenoy
>            Priority: Major
>
> Currently the max_open_files rocksdb config is -1 by default and not set 
> anywhere via Ozone code. However in situations where the number of SST Files 
> in the rocksdb instance becomes greater than the ulimit (open file limit of 
> the OS), Rocksdb will not respect the OS config and try to open all files at 
> once thereby leading to "Too many open files" error. 
> Introducing a config in Ozone to set this is helpful to avoid/recover from 
> such crashes.



--
This message was sent by Atlassian Jira
(v8.20.10#820010)

---------------------------------------------------------------------
To unsubscribe, e-mail: [email protected]
For additional commands, e-mail: [email protected]

Reply via email to