rotty3000 commented on pull request #307:
URL: https://github.com/apache/tomcat/pull/307#issuecomment-648856220


   I do not disagree that adding a third could be confusing. What I like about 
actions in addition to the points you've made is:
   
   - runs on forks as well (which means I can iterate with CI before even 
sending PR to main repo)
   - easily test full matrix of Java versions (including EAs, i.e. `15-ea`)
   - is super fast
   
   To differentiate between the official Apache BuildBot (which runs everything 
and takes very long because it is absolutely comprehensive) I was thinking to 
make use of github actions to be a form of soak test which builds all the main 
artifacts, on all supported Java versions, runs a small but comprehensive 
battery of tests, and runs a set of baseline tests against the 4 runtime 
assemblies:
   - **original** - catalina.sh on classpath
   - **embed** - need to figure out how to assemble this for run
   - **OSGi** - already have it locally
   - **jpms** - already have it locally
   
   Finally, i would like to see all that run in no more than 10 minutes to 
allow for pretty darn fast iterations with low risk of regression.
   
   As you can note in my change I've actually trimmed to run just the `nio` 
suite and disabled the openssl tests toward the goal of good testing but fast. 
Of course I need lots more input about what constitutes a comprehensive (yet 
fast) set of tests.
   
   Thoughts?


----------------------------------------------------------------
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.

For queries about this service, please contact Infrastructure at:
us...@infra.apache.org



---------------------------------------------------------------------
To unsubscribe, e-mail: dev-unsubscr...@tomcat.apache.org
For additional commands, e-mail: dev-h...@tomcat.apache.org

Reply via email to