mcvsubbu opened a new issue #4001: Create test suite across pinot releases and services URL: https://github.com/apache/incubator-pinot/issues/4001 We should write a test suite that verifies that pinot releases are compatible with each other in terms of segment format, zookeeper data formats, protocols between components, etc. Something like this may help decide if we have a strict deployment order for a release or an y random deployment order will work. We will need to start zk and kafka, and keep it running throughout the test, while starting and stopping other components in old and new releases. With four components, each one being in old or new release, we have 16 possible release pairs to test. If we want to test things in a set upgrade order, then we have only 4. We can choose to add downgrade tests as well. For each combination, we could: * refresh an offline segment * push a new offline segment * (push to kafka and) consume enough rows to create at lease one new segment * execute some simple queries with expected results at each stage. The goal of this test is not to test any individual component (e.g. does retention manager work right), but to test that operations done in one release works consistently when another release is started on any component. We can grow the suite by adding more tests as we see fit
---------------------------------------------------------------- This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use the URL above to go to the specific comment. For queries about this service, please contact Infrastructure at: [email protected] With regards, Apache Git Services --------------------------------------------------------------------- To unsubscribe, e-mail: [email protected] For additional commands, e-mail: [email protected]
