rotty3000 commented on pull request #307: URL: https://github.com/apache/tomcat/pull/307#issuecomment-648856220
I do not disagree that adding a third could be confusing. What I like about actions in addition to the points you've made is: - runs on forks as well (which means I can iterate with CI before even sending PR to main repo) - easily test full matrix of Java versions (including EAs, i.e. `15-ea`) - is super fast To differentiate between the official Apache BuildBot (which runs everything and takes very long because it is absolutely comprehensive) I was thinking to make use of github actions to be a form of soak test which builds all the main artifacts, on all supported Java versions, runs a small but comprehensive battery of tests, and runs a set of baseline tests against the 4 runtime assemblies: - **original** - catalina.sh on classpath - **embed** - need to figure out how to assemble this for run - **OSGi** - already have it locally - **jpms** - already have it locally Finally, i would like to see all that run in no more than 10 minutes to allow for pretty darn fast iterations with low risk of regression. As you can note in my change I've actually trimmed to run just the `nio` suite and disabled the openssl tests toward the goal of good testing but fast. Of course I need lots more input about what constitutes a comprehensive (yet fast) set of tests. Thoughts? ---------------------------------------------------------------- This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use the URL above to go to the specific comment. For queries about this service, please contact Infrastructure at: us...@infra.apache.org --------------------------------------------------------------------- To unsubscribe, e-mail: dev-unsubscr...@tomcat.apache.org For additional commands, e-mail: dev-h...@tomcat.apache.org