At the wikipedia regression testing page https://en.wikipedia.org/wiki/Regression_testing <https://en.wikipedia.org/wiki/Regression_testing> Under use " Regression tests can be broadly categorized as functional tests <https://en.wikipedia.org/wiki/Functional_test> or unit tests <https://en.wikipedia.org/wiki/Unit_testing>. Functional tests exercise the complete program with various inputs. Unit tests exercise individual functions, subroutines <https://en.wikipedia.org/wiki/Subroutine>, or object methods. Both functional testing tools and unit-testing tools tend to be automated and are often third-party products that are not part of the compiler suite. A functional test may be a scripted series of program inputs, possibly even involving an automated mechanism for controlling mouse movements and clicks. A unit test may be a set of separate functions within the code itself or a driver layer that links to the code without altering the code being tested. "
When you change or add anything to Spark. You fork the git repo. then you make the changes, then you make a new branch. and push the branch to yours fork git repo. "Push commits to your branch. This will trigger “Build and test” and “Report test results” workflows on your forked repository and start testing and validating your changes." This is number 7 in Howto contributing to Spark under Pull request <https://spark.apache.org/contributing.html> So to answer your question. Yes, every change is tested before the change [PR] goes to the master branch. We don't have unit tests for everything, so we have to test things manually after building. tor. 24. mar. 2022 kl. 20:47 skrev Mich Talebzadeh < mich.talebza...@gmail.com>: > good point. > > I just wanted to know when we do changes to releases or RC, is there some > mechanism that ensures the Spark release still functions as expected > after any code changes, updates etc? > > For example there was a recent discussion about Kafka upgrade to 3.x with > Spark upgrade to 3.x and its likely impact. Integration testing can be > achieved through CI/CD which I believe Spark relied on Jenkins until > recently. > > HTH > > > > view my Linkedin profile > <https://www.linkedin.com/in/mich-talebzadeh-ph-d-5205b2/> > > > https://en.everybodywiki.com/Mich_Talebzadeh > > > > *Disclaimer:* Use it at your own risk. Any and all responsibility for any > loss, damage or destruction of data or any other property which may arise > from relying on this email's technical content is explicitly disclaimed. > The author will in no case be liable for any monetary damages arising from > such loss, damage or destruction. > > > > > On Thu, 24 Mar 2022 at 19:38, Sean Owen <sro...@gmail.com> wrote: > >> Hm, then what are you looking for besides all the tests in Spark? >> >> On Thu, Mar 24, 2022, 2:34 PM Mich Talebzadeh <mich.talebza...@gmail.com> >> wrote: >> >>> Thanks >>> >>> I know what unit testing is. The question was not about unit testing. it >>> was specific to regression testing >>> <https://katalon.com/resources-center/blog/regression-testing#:~:text=Regression%20testing%20is%20a%20software,functionality%20of%20the%20existing%20features.> >>> artifacts . >>> >>> >>> cheers, >>> >>> >>> Mich >>> >>> >>> view my Linkedin profile >>> <https://www.linkedin.com/in/mich-talebzadeh-ph-d-5205b2/> >>> >>> >>> https://en.everybodywiki.com/Mich_Talebzadeh >>> >>> >>> >>> *Disclaimer:* Use it at your own risk. Any and all responsibility for >>> any loss, damage or destruction of data or any other property which may >>> arise from relying on this email's technical content is explicitly >>> disclaimed. The author will in no case be liable for any monetary damages >>> arising from such loss, damage or destruction. >>> >>> >>> >>> >>> On Thu, 24 Mar 2022 at 19:02, Bjørn Jørgensen <bjornjorgen...@gmail.com> >>> wrote: >>> >>>> Yes, Spark uses unit tests. >>>> >>>> https://app.codecov.io/gh/apache/spark >>>> >>>> https://en.wikipedia.org/wiki/Unit_testing >>>> >>>> >>>> >>>> man. 21. mar. 2022 kl. 15:46 skrev Mich Talebzadeh < >>>> mich.talebza...@gmail.com>: >>>> >>>>> Hi, >>>>> >>>>> As a matter of interest do Spark releases deploy a specific regression >>>>> testing tool? >>>>> >>>>> Thanks >>>>> >>>>> >>>>> >>>>> view my Linkedin profile >>>>> <https://www.linkedin.com/in/mich-talebzadeh-ph-d-5205b2/> >>>>> >>>>> >>>>> https://en.everybodywiki.com/Mich_Talebzadeh >>>>> >>>>> >>>>> >>>>> *Disclaimer:* Use it at your own risk. Any and all responsibility for >>>>> any loss, damage or destruction of data or any other property which may >>>>> arise from relying on this email's technical content is explicitly >>>>> disclaimed. The author will in no case be liable for any monetary damages >>>>> arising from such loss, damage or destruction. >>>>> >>>>> >>>>> >>>> >>>> >>>> -- >>>> Bjørn Jørgensen >>>> Vestre Aspehaug 4, 6010 Ålesund >>>> Norge >>>> >>>> +47 480 94 297 >>>> >>> -- Bjørn Jørgensen Vestre Aspehaug 4, 6010 Ålesund Norge +47 480 94 297
