LuciferYang opened a new pull request, #39140: URL: https://github.com/apache/spark/pull/39140
### What changes were proposed in this pull request? This pr aims to upgrade rocksdbjni from 7.7.3 to 7.8.3. ### Why are the changes needed? This version bring the performance of compaction and fixes some bugs, the release notes as follows: - https://github.com/facebook/rocksdb/releases/tag/v7.8.3 ### Does this PR introduce _any_ user-facing change? No ### How was this patch tested? - Pass GitHub Actions - Manual test `RocksDBBenchmark`: **7.7.3** ``` [INFO] Running org.apache.spark.util.kvstore.RocksDBBenchmark count mean min max 95th dbClose 4 0.327 0.208 0.561 0.561 dbCreation 4 68.818 3.662 264.586 264.586 naturalIndexCreateIterator 1024 0.005 0.002 1.565 0.006 naturalIndexDescendingCreateIterator 1024 0.005 0.004 0.063 0.006 naturalIndexDescendingIteration 1024 0.006 0.004 0.325 0.008 naturalIndexIteration 1024 0.006 0.004 0.057 0.009 randomDeleteIndexed 1024 0.026 0.019 0.340 0.036 randomDeletesNoIndex 1024 0.014 0.012 0.037 0.016 randomUpdatesIndexed 1024 0.084 0.033 30.394 0.094 randomUpdatesNoIndex 1024 0.034 0.030 0.532 0.039 randomWritesIndexed 1024 0.121 0.033 53.532 0.124 randomWritesNoIndex 1024 0.039 0.034 1.469 0.044 refIndexCreateIterator 1024 0.004 0.004 0.021 0.006 refIndexDescendingCreateIterator 1024 0.003 0.002 0.027 0.004 refIndexDescendingIteration 1024 0.006 0.005 0.047 0.008 refIndexIteration 1024 0.007 0.005 0.049 0.010 sequentialDeleteIndexed 1024 0.022 0.018 0.202 0.028 sequentialDeleteNoIndex 1024 0.015 0.012 0.039 0.017 sequentialUpdatesIndexed 1024 0.048 0.040 0.886 0.062 sequentialUpdatesNoIndex 1024 0.041 0.033 0.872 0.051 sequentialWritesIndexed 1024 0.049 0.037 2.440 0.055 sequentialWritesNoIndex 1024 0.043 0.036 3.630 0.045 ``` **7.8.3** ``` [INFO] Running org.apache.spark.util.kvstore.RocksDBBenchmark count mean min max 95th dbClose 4 0.360 0.298 0.505 0.505 dbCreation 4 67.968 3.955 259.443 259.443 naturalIndexCreateIterator 1024 0.005 0.002 1.386 0.006 naturalIndexDescendingCreateIterator 1024 0.004 0.004 0.065 0.006 naturalIndexDescendingIteration 1024 0.006 0.004 0.026 0.009 naturalIndexIteration 1024 0.006 0.004 0.060 0.010 randomDeleteIndexed 1024 0.026 0.019 0.244 0.038 randomDeletesNoIndex 1024 0.014 0.012 0.048 0.016 randomUpdatesIndexed 1024 0.085 0.034 29.611 0.100 randomUpdatesNoIndex 1024 0.035 0.030 0.744 0.039 randomWritesIndexed 1024 0.119 0.033 52.163 0.125 randomWritesNoIndex 1024 0.040 0.033 2.311 0.045 refIndexCreateIterator 1024 0.004 0.004 0.016 0.006 refIndexDescendingCreateIterator 1024 0.003 0.002 0.031 0.004 refIndexDescendingIteration 1024 0.006 0.005 0.051 0.008 refIndexIteration 1024 0.007 0.005 0.283 0.009 sequentialDeleteIndexed 1024 0.021 0.017 0.119 0.026 sequentialDeleteNoIndex 1024 0.015 0.012 0.047 0.018 sequentialUpdatesIndexed 1024 0.041 0.036 1.003 0.049 sequentialUpdatesNoIndex 1024 0.043 0.029 1.285 0.064 sequentialWritesIndexed 1024 0.051 0.040 2.358 0.072 sequentialWritesNoIndex 1024 0.038 0.030 2.824 0.049 ``` -- This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use the URL above to go to the specific comment. To unsubscribe, e-mail: [email protected] For queries about this service, please contact Infrastructure at: [email protected] --------------------------------------------------------------------- To unsubscribe, e-mail: [email protected] For additional commands, e-mail: [email protected]
