SteNicholas opened a new pull request, #2480: URL: https://github.com/apache/celeborn/pull/2480
https://github.com/apache/ratis/pull/https://github.com/apache/ratis/pull/https://github.com/apache/ratis/pull/ What changes were proposed in this pull request? Bump Ratis version from 2.5.1 to 3.0.1. https://github.com/apache/ratis/pull/https://github.com/apache/ratis/pull/https://github.com/apache/ratis/pull/ Why are the changes needed? Bump Ratis version from 2.5.1 to 3.0.1. Netty has released v3.0.0, v3.0.1, which release note refers to [3.0.0](https://ratis.apache.org/post/3.0.0.html), [3.0.1](https://ratis.apache.org/post/3.0.1.html). The 3.0.x version include new features like pluggable metrics and lease read, etc, some improvements and bugfixes including: - 3.0.0: Change list of ratis 3.0.0 In total, there are roughly 100 commits diffing from 2.5.1. - Incompatible Changes - RaftStorage Auto-Format - RATIS-1677. Do not auto format RaftStorage in RECOVER. (https://github.com/apache/ratis/pull/718) - RATIS-1694. Fix the compatibility issue of RATIS-1677. (https://github.com/apache/ratis/pull/731) - RATIS-1871. Auto format RaftStorage when there is only one directory configured. (https://github.com/apache/ratis/pull/903) - Pluggable Ratis-Metrics (RATIS-1688) - RATIS-1689. Remove the use of the thirdparty Gauge. (https://github.com/apache/ratis/pull/728) - RATIS-1692. Remove the use of the thirdparty Counter. (https://github.com/apache/ratis/pull/732) - RATIS-1693. Remove the use of the thirdparty Timer. (https://github.com/apache/ratis/pull/734) - RATIS-1703. Move MetricsReporting and JvmMetrics to impl. (https://github.com/apache/ratis/pull/741) - RATIS-1704. Fix SuppressWarnings(“VisibilityModifier”) in RatisMetrics. (https://github.com/apache/ratis/pull/742) - RATIS-1710. Refactor metrics api and implementation to separated modules. (https://github.com/apache/ratis/pull/749) - RATIS-1712. Add a dropwizard 3 implementation of ratis-metrics-api. (https://github.com/apache/ratis/pull/751) - RATIS-1391. Update library dropwizard.metrics version to 4.x (https://github.com/apache/ratis/pull/632) - RATIS-1601. Use the shaded dropwizard metrics and remove the dependency (https://github.com/apache/ratis/pull/671) - Streaming Protocol Change - RATIS-1569. Move the asyncRpcApi.sendForward(..) call to the client side. (https://github.com/apache/ratis/pull/635) - New Features - Leader Lease (RATIS-1864) - RATIS-1865. Add leader lease bound ratio configuration (https://github.com/apache/ratis/pull/897) - RATIS-1866. Maintain leader lease after AppendEntries (https://github.com/apache/ratis/pull/898) - RATIS-1894. Implement ReadOnly based on leader lease (https://github.com/apache/ratis/pull/925) - RATIS-1882. Support read-after-write consistency (https://github.com/apache/ratis/pull/913) - StateMachine API - RATIS-1874. Add notifyLeaderReady function in IStateMachine (https://github.com/apache/ratis/pull/906) - RATIS-1897. Make TransactionContext available in DataApi.write(..). (https://github.com/apache/ratis/pull/930) - New Configuration Properties - RATIS-1862. Add the parameter whether to take Snapshot when stopping to adapt to different services (https://github.com/apache/ratis/pull/896) - RATIS-1930. Add a conf for enable/disable majority-add. (https://github.com/apache/ratis/pull/961) - RATIS-1918. Introduces parameters that separately control the shutdown of RaftServerProxy by JVMPauseMonitor. (https://github.com/apache/ratis/pull/950) - RATIS-1636. Support re-config ratis properties (https://github.com/apache/ratis/pull/800) - RATIS-1860. Add ratis-shell cmd to generate a new raft-meta.conf. (https://github.com/apache/ratis/pull/901) - Improvements & Bug Fixes - Streaming & Netty - RATIS-1550. Rewrite stream client reply queue. (https://github.com/apache/ratis/pull/740) - RATIS-1847. Stream has memory leak. (https://github.com/apache/ratis/pull/884) - RATIS-1850. When the stream server side receives a disconnection, memory is cleared (https://github.com/apache/ratis/pull/887) - RATIS-1853. When the stream server channelInactive, all requests in the channel. (https://github.com/apache/ratis/pull/889) - RATIS-1880. Optimize Stream client&server side channel pipeline Create (https://github.com/apache/ratis/pull/910) - RATIS-1898. Netty should use EpollEventLoopGroup by default (https://github.com/apache/ratis/pull/931) - RATIS-1899. Use EpollEventLoopGroup for Netty Proxies (https://github.com/apache/ratis/pull/932) - RATIS-1913. Assert that the primary peers in DataStreamClient and RoutingTable are equal (https://github.com/apache/ratis/pull/945) - RATIS-1921. Shared worker group in WorkerGroupGetter should be closed. (https://github.com/apache/ratis/pull/955) - RATIS-1923. Netty: atomic operations require side-effect-free functions. (https://github.com/apache/ratis/pull/956) - Read Index - RATIS-1856. Notify apply index change of all RaftLog entries (https://github.com/apache/ratis/pull/893) - RATIS-1895. IllegalStateException: Failed to updateIncreasingly for nextIndex. (https://github.com/apache/ratis/pull/926) - RATIS-1861. NullPointerException in readAsync when Ratis leader is changing (https://github.com/apache/ratis/pull/895) - RATIS-1888. Handle exception of readIndexAsync in gRPC readIndex impl (https://github.com/apache/ratis/pull/920) - RATIS-1927. Use double check to eliminate data race in ReadRequests. (https://github.com/apache/ratis/pull/958) - RaftServer - RATIS-1924. Increase the default of raft.server.log.segment.size.max. (https://github.com/apache/ratis/pull/957) - RATIS-1892. Unify the lifetime of the RaftServerProxy thread pool (https://github.com/apache/ratis/pull/923) - RATIS-1889. NoSuchMethodError: RaftServerMetricsImpl.addNumPendingRequestsGauge https://github.com/apache/ratis/pull/922 (https://github.com/apache/ratis/pull/922) - RATIS-761. Handle writeStateMachineData failure in leader. (https://github.com/apache/ratis/pull/927) - RATIS-1902. The snapshot index is set incorrectly in InstallSnapshotReplyProto. (https://github.com/apache/ratis/pull/933) - RATIS-1912. Fix infinity election when perform membership change. (https://github.com/apache/ratis/pull/954) - RATIS-1858. Follower keeps logging first election timeout. (https://github.com/apache/ratis/pull/894) - AppendEntries & GrpcLogAppender - RATIS-1804. Change the default number of outstanding append entries. (https://github.com/apache/ratis/pull/838) - RATIS-1883. Next Index should be always larger than Match Index in GrpcLogAppender (https://github.com/apache/ratis/pull/914) - RATIS-1886. AppendLog sleep fixed time cause significant drop in write throughput. (https://github.com/apache/ratis/pull/929) - RATIS-1909. Fix Decreasing Next Index When GrpcLogAppender Reset Client. (https://github.com/apache/ratis/pull/939) - RATIS-1920. NPE in AppendLogResponseHandler. (https://github.com/apache/ratis/pull/952) - RATIS-1928. Join the LogAppenders when closing the server. (https://github.com/apache/ratis/pull/959) - RATIS-1705. Fix metrics leak (https://github.com/apache/ratis/pull/744) - RaftLog & RaftLog Cache - RATIS-1887. Gap between segement log (https://github.com/apache/ratis/pull/919) - RATIS-1890. SegmentedRaftLogCachehttps://github.com/apache/ratis/pull/shouldEvict should only iterate over closed segments once (https://github.com/apache/ratis/pull/921) - RATIS-1893. In SegmentedRaftLogCache, start a daemon thread to checkAndEvictCache. (https://github.com/apache/ratis/pull/924) - RATIS-1884. Fix retry cache warning condition (https://github.com/apache/ratis/pull/915) - RATIS-872. Invalidate replied calls in retry cache. (https://github.com/apache/ratis/pull/942) - RATIS-1916. OrderAsync does not call handReply. (https://github.com/apache/ratis/pull/948) - 3.0.1:This is a bugfix release. See the [changes between 3.0.0 and 3.0.1](https://github.com/apache/ratis/compare/ratis-3.0.0...ratis-3.0.1) releases. ### Does this PR introduce _any_ user-facing change? No. ### How was this patch tested? Cluster manual test. -- This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use the URL above to go to the specific comment. To unsubscribe, e-mail: [email protected] For queries about this service, please contact Infrastructure at: [email protected]
