[
https://issues.apache.org/jira/browse/FLINK-33741?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=17795142#comment-17795142
]
Yun Tang commented on FLINK-33741:
----------------------------------
[~zhoujira86] I think there exists valuable information in the RocksDB
statistics, assigned to you, please go ahead.
> Exposed Rocksdb statistics in Flink metrics and introduce 2 Rocksdb statistic
> related configuration
> ---------------------------------------------------------------------------------------------------
>
> Key: FLINK-33741
> URL: https://issues.apache.org/jira/browse/FLINK-33741
> Project: Flink
> Issue Type: New Feature
> Reporter: xiaogang zhou
> Assignee: xiaogang zhou
> Priority: Major
>
> I think we can also parse the multi-line string of the rocksdb statistics.
> {code:java}
> // code placeholder
> /**
> * DB implements can export properties about their state
> * via this method on a per column family level.
> *
> * <p>If {@code property} is a valid property understood by this DB
> * implementation, fills {@code value} with its current value and
> * returns true. Otherwise returns false.</p>
> *
> * <p>Valid property names include:
> * <ul>
> * <li>"rocksdb.num-files-at-level<N>" - return the number of files at
> * level <N>, where <N> is an ASCII representation of a level
> * number (e.g. "0").</li>
> * <li>"rocksdb.stats" - returns a multi-line string that describes statistics
> * about the internal operation of the DB.</li>
> * <li>"rocksdb.sstables" - returns a multi-line string that describes all
> * of the sstables that make up the db contents.</li>
> * </ul>
> *
> * @param columnFamilyHandle {@link org.rocksdb.ColumnFamilyHandle}
> * instance, or null for the default column family.
> * @param property to be fetched. See above for examples
> * @return property value
> *
> * @throws RocksDBException thrown if error happens in underlying
> * native library.
> */
> public String getProperty(
> /* @Nullable */ final ColumnFamilyHandle columnFamilyHandle,
> final String property) throws RocksDBException { {code}
>
> Then we can directly export these rt latency number in metrics.
>
> I'd like to introduce 2 rocksdb statistic related configuration.
> Then we can customize stats
> {code:java}
> // code placeholder
> Statistics s = new Statistics();
> s.setStatsLevel(EXCEPT_TIME_FOR_MUTEX);
> currentOptions.setStatsDumpPeriodSec(internalGetOption(RocksDBConfigurableOptions.STATISTIC_DUMP_PERIOD))
> .setStatistics(s); {code}
--
This message was sent by Atlassian Jira
(v8.20.10#820010)
