Hi all,

I'd like to suggest something that might make voting on releases a little 
clearer and easier. I feel like we've been a bit vague about what kind of 
testing PMC members are supposed to do on a release candidate, and I see 
different folks (including myself) running different kinds of ad hoc testing.

I'd like to suggest that we should mostly focus on things that are either 
apache requirements for voting on releases or can't reasonably be testing in CI.

The apache release policy [1] says

"Before voting +1 PMC members are required to download the signed source code 
package, compile it as provided, and test the resulting executable on their own 
platform, along with also verifying that the package meets the requirements of 
the ASF policy on releases."

I checked in a script that can do the building and signature verification for 
you [2]. My hope is that we can improve this script do to all of the testing 
that we think is important to do on a developers machine before VOTING +1, and 
free up more time to look at the commits, source files etc. and thinking about 
if this is what we should be releasing.

I'm not trying to discourage any ad hoc testing someone feels like they want to 
do, but I do want to make sure that everyone is in agreement on what we should 
be doing before voting on a release and hopefully make it so that everyone 
feels comfortable voting without wondering what they are supposed to test.

[1] https://www.apache.org/legal/release-policy.html#approving-a-release
[2] https://github.com/apache/geode/tree/develop/dev-tools/release-testing

Thanks,
-Dan

Reply via email to