[ 
https://issues.apache.org/jira/browse/SAMZA-2655?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
 ]

Adam Faris resolved SAMZA-2655.
-------------------------------
    Resolution: Fixed

Here's the github PR where this has been added.
https://github.com/apache/samza/pull/1500

> Expose RocksDB maxOpenFiles setting as Samza parameter
> ------------------------------------------------------
>
>                 Key: SAMZA-2655
>                 URL: https://issues.apache.org/jira/browse/SAMZA-2655
>             Project: Samza
>          Issue Type: Improvement
>          Components: kv-store
>            Reporter: Adam Faris
>            Priority: Minor
>          Time Spent: 1h 20m
>  Remaining Estimate: 0h
>
> This is a feature request to expose RocksDB's maxOpenFiles setting as a Samza 
> Parameter.  It's needed to prevent large databases from opening more files 
> than what's allowed by ulimit settings and causing the container to fail.
> https://github.com/facebook/rocksdb/blob/master/include/rocksdb/options.h#L460
> {noformat}
> // Number of open files that can be used by the DB.  You may need to  
> // increase this if your database has a large working set. Value -1 means  
> // files opened are always kept open. You can estimate number of files based 
> // on target_file_size_base and target_file_size_multiplier for level-based  
> // compaction. For universal-style compaction, you can usually set it to -1.  
> // {noformat}



--
This message was sent by Atlassian Jira
(v8.3.4#803005)

Reply via email to