[
https://issues.apache.org/jira/browse/SAMZA-2655?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
]
Adam Faris resolved SAMZA-2655.
-------------------------------
Resolution: Fixed
Here's the github PR where this has been added.
https://github.com/apache/samza/pull/1500
> Expose RocksDB maxOpenFiles setting as Samza parameter
> ------------------------------------------------------
>
> Key: SAMZA-2655
> URL: https://issues.apache.org/jira/browse/SAMZA-2655
> Project: Samza
> Issue Type: Improvement
> Components: kv-store
> Reporter: Adam Faris
> Priority: Minor
> Time Spent: 1h 20m
> Remaining Estimate: 0h
>
> This is a feature request to expose RocksDB's maxOpenFiles setting as a Samza
> Parameter. It's needed to prevent large databases from opening more files
> than what's allowed by ulimit settings and causing the container to fail.
> https://github.com/facebook/rocksdb/blob/master/include/rocksdb/options.h#L460
> {noformat}
> // Number of open files that can be used by the DB. You may need to
> // increase this if your database has a large working set. Value -1 means
> // files opened are always kept open. You can estimate number of files based
> // on target_file_size_base and target_file_size_multiplier for level-based
> // compaction. For universal-style compaction, you can usually set it to -1.
> // {noformat}
--
This message was sent by Atlassian Jira
(v8.3.4#803005)