Agree on the derived systems part. One thing to explore though would be if this can be applied to the real-time segment commit protocol.
Cheers, Mayank Sent from my iPhone > On Feb 24, 2020, at 1:17 PM, kishore g <[email protected]> wrote: > > We should define a new set of tests for derived systems > >> On Mon, Feb 24, 2020 at 1:13 PM kishore g <[email protected]> wrote: >> >> Does not make sense for Pinot >> >> On Mon, Feb 24, 2020 at 1:10 PM siddharth teotia < >> [email protected]> wrote: >> >>> I think at some point we should think about using Jepsen for >>> safety-testing >>> of Pinot. While the tool has been predominantly used in databases that >>> have distributed transactions, extensive node communication, algorithms >>> relying on clock-skew, it can still be used to introduced faults in the >>> cluster and check for existence of problems. >>> >>> I believe Helix and ZK are the perfect candidates (but that work is going >>> to be orthogonal to Pinot). However, since we use these extensively, it >>> might still be worthwhile to see if Jepsen framework can expose some >>> problems in Pinot. >>> >>> https://jepsen.io/ >>> >>> Thanks, >>> Sidd >>> >> --------------------------------------------------------------------- To unsubscribe, e-mail: [email protected] For additional commands, e-mail: [email protected]
