Re: [GSoC] Proposal - Automated webapp tests
I just created MYFACESTEST-6 and labeled it accordingly. In addition Gerhard Petracek and I are willing to mentor it. Regards, Jakob 2010/3/26 Gerhard Petracek gerhard.petra...@gmail.com i just mention the most important issue (to keep it short): imo the current module is ~ok for basic myfaces-core tests. however, it doesn't fit e.g. for testing extensions. (the module uses too much mock implementations.) you won't see some important issues. so some tests aren't really reliable as soon as you are using it for testing something like extensions. imo it would be nice to have e.g. a jetty based test environment which we (and also our users) can use for testing extensions, (sample-) webapps, ... based on such an environment we can run unit tests (which shouldn't be as verbose as the current unit tests) with myfaces-core and also with mojarra. with the same environment we could also run jmeter- and something like httpunit-tests. the final solution should be a convenient test-suite with detailed and clear test-reports. regards, gerhard http://www.irian.at Your JSF powerhouse - JSF Consulting, Development and Courses in English and German Professional Support for Apache MyFaces 2010/3/26 Jakob Korherr jakob.korh...@gmail.com Frankly, I like MyFaces test. It just has to be improved, but we can totally use it (actually that's what we're doing right now). The only thing we can't use MyFaces test is for a real webapp-test, and that is were the GSoC project comes up! Furthermore I don't think we need a subproject for this. Everything which fits into automated testing fits into MyFaces test, so why not use the existing one and improve it instead of creating yet another thing. Regards, Jakob 2010/3/26 Gerhard Petracek gerhard.petra...@gmail.com yes - it's an improved version of shale test. however, it would be nice to have a more modern solution e.g. with a fluent api, better reporting, ... so we could compare it with the existing solution. regards, gerhard http://www.irian.at Your JSF powerhouse - JSF Consulting, Development and Courses in English and German Professional Support for Apache MyFaces 2010/3/26 Rudy De Busscher rdebussc...@gmail.com Isn't the Myfaces test (svn.apache.org/repos/asf/myfaces/test) not the successor of shale test ? Automated test are indeed very useful, an alternative (easier to set up maybe) of JSFUnit would be great. Regards, Rudy. On 26 March 2010 12:38, Gerhard Petracek gerhard.petra...@gmail.comwrote: hi jakob, additions: #1: yesterday (in our discussion about it) we also talked about a replacement for shale-test (e.g. based on easymock or mockito or ...). #2: since we also need it for sub-projects like extval, codi,... we should create e.g. a new extensions- or myfaces-commons-module for it. regards, gerhard http://www.irian.at Your JSF powerhouse - JSF Consulting, Development and Courses in English and German Professional Support for Apache MyFaces 2010/3/26 Jakob Korherr jakob.korh...@gmail.com Hi, As we currently only have normal JUnit tests for automated testing in MyFaces Core, it would be really great to have a way to test MyFaces Core automatically in a real webapp at build time with maven. Of course, we currently have the test-webapp, but we still have to check each page manually here, if we want to test everything, which is long-winded. To accomplish something like that we could use test frameworks like e.g. Canoo WebTest or HttpUnit + Jetty or something similar. I also want to mention JSFUnit here, although we won't be able to use it since it is LGPL licensed. The goal of this GSoC project would be to find alternatives and also to find the best-fitting test framework for MyFaces Core. Then the goal would be to integrate it with MyFaces Core, to define rules and provide how-tos and to write a bunch of test cases. This would help us enormously in ensuring and improving the quality of MyFaces Core by getting a far bigger test coverage and more possibilities to test. What do you think? Are there any students who are interested in working on this? Regards, Jakob
Re: [GSoC] Proposal - Automated webapp tests
Hi, This sounds really good, I would enjoy working on this. So, if it's ok with everybody, I would really like to dig in on this issue and the test frameworks that can be used for this. Regards, Cosmin On Fri, Mar 26, 2010 at 2:25 AM, Jakob Korherr jakob.korh...@gmail.comwrote: Hi, As we currently only have normal JUnit tests for automated testing in MyFaces Core, it would be really great to have a way to test MyFaces Core automatically in a real webapp at build time with maven. Of course, we currently have the test-webapp, but we still have to check each page manually here, if we want to test everything, which is long-winded. To accomplish something like that we could use test frameworks like e.g. Canoo WebTest or HttpUnit + Jetty or something similar. I also want to mention JSFUnit here, although we won't be able to use it since it is LGPL licensed. The goal of this GSoC project would be to find alternatives and also to find the best-fitting test framework for MyFaces Core. Then the goal would be to integrate it with MyFaces Core, to define rules and provide how-tos and to write a bunch of test cases. This would help us enormously in ensuring and improving the quality of MyFaces Core by getting a far bigger test coverage and more possibilities to test. What do you think? Are there any students who are interested in working on this? Regards, Jakob
Re: [GSoC] Proposal - Automated webapp tests
Hi guys, a great idea. best regards, Martin On Fri, Mar 26, 2010 at 11:24 AM, Martinconi Cosmin cosmin.martinc...@codebeat.ro wrote: Hi, This sounds really good, I would enjoy working on this. So, if it's ok with everybody, I would really like to dig in on this issue and the test frameworks that can be used for this. Regards, Cosmin On Fri, Mar 26, 2010 at 2:25 AM, Jakob Korherr jakob.korh...@gmail.com wrote: Hi, As we currently only have normal JUnit tests for automated testing in MyFaces Core, it would be really great to have a way to test MyFaces Core automatically in a real webapp at build time with maven. Of course, we currently have the test-webapp, but we still have to check each page manually here, if we want to test everything, which is long-winded. To accomplish something like that we could use test frameworks like e.g. Canoo WebTest or HttpUnit + Jetty or something similar. I also want to mention JSFUnit here, although we won't be able to use it since it is LGPL licensed. The goal of this GSoC project would be to find alternatives and also to find the best-fitting test framework for MyFaces Core. Then the goal would be to integrate it with MyFaces Core, to define rules and provide how-tos and to write a bunch of test cases. This would help us enormously in ensuring and improving the quality of MyFaces Core by getting a far bigger test coverage and more possibilities to test. What do you think? Are there any students who are interested in working on this? Regards, Jakob -- http://www.irian.at Your JSF powerhouse - JSF Consulting, Development and Courses in English and German Professional Support for Apache MyFaces
Re: [GSoC] Proposal - Automated webapp tests
+1! On 26 March 2010 10:56, Martin Marinschek martin.marinsc...@gmail.comwrote: Hi guys, a great idea. best regards, Martin On Fri, Mar 26, 2010 at 11:24 AM, Martinconi Cosmin cosmin.martinc...@codebeat.ro wrote: Hi, This sounds really good, I would enjoy working on this. So, if it's ok with everybody, I would really like to dig in on this issue and the test frameworks that can be used for this. Regards, Cosmin On Fri, Mar 26, 2010 at 2:25 AM, Jakob Korherr jakob.korh...@gmail.com wrote: Hi, As we currently only have normal JUnit tests for automated testing in MyFaces Core, it would be really great to have a way to test MyFaces Core automatically in a real webapp at build time with maven. Of course, we currently have the test-webapp, but we still have to check each page manually here, if we want to test everything, which is long-winded. To accomplish something like that we could use test frameworks like e.g. Canoo WebTest or HttpUnit + Jetty or something similar. I also want to mention JSFUnit here, although we won't be able to use it since it is LGPL licensed. The goal of this GSoC project would be to find alternatives and also to find the best-fitting test framework for MyFaces Core. Then the goal would be to integrate it with MyFaces Core, to define rules and provide how-tos and to write a bunch of test cases. This would help us enormously in ensuring and improving the quality of MyFaces Core by getting a far bigger test coverage and more possibilities to test. What do you think? Are there any students who are interested in working on this? Regards, Jakob -- http://www.irian.at Your JSF powerhouse - JSF Consulting, Development and Courses in English and German Professional Support for Apache MyFaces
Re: [GSoC] Proposal - Automated webapp tests
hi jakob, additions: #1: yesterday (in our discussion about it) we also talked about a replacement for shale-test (e.g. based on easymock or mockito or ...). #2: since we also need it for sub-projects like extval, codi,... we should create e.g. a new extensions- or myfaces-commons-module for it. regards, gerhard http://www.irian.at Your JSF powerhouse - JSF Consulting, Development and Courses in English and German Professional Support for Apache MyFaces 2010/3/26 Jakob Korherr jakob.korh...@gmail.com Hi, As we currently only have normal JUnit tests for automated testing in MyFaces Core, it would be really great to have a way to test MyFaces Core automatically in a real webapp at build time with maven. Of course, we currently have the test-webapp, but we still have to check each page manually here, if we want to test everything, which is long-winded. To accomplish something like that we could use test frameworks like e.g. Canoo WebTest or HttpUnit + Jetty or something similar. I also want to mention JSFUnit here, although we won't be able to use it since it is LGPL licensed. The goal of this GSoC project would be to find alternatives and also to find the best-fitting test framework for MyFaces Core. Then the goal would be to integrate it with MyFaces Core, to define rules and provide how-tos and to write a bunch of test cases. This would help us enormously in ensuring and improving the quality of MyFaces Core by getting a far bigger test coverage and more possibilities to test. What do you think? Are there any students who are interested in working on this? Regards, Jakob
Re: [GSoC] Proposal - Automated webapp tests
Isn't the Myfaces test (svn.apache.org/repos/asf/myfaces/test) not the successor of shale test ? Automated test are indeed very useful, an alternative (easier to set up maybe) of JSFUnit would be great. Regards, Rudy. On 26 March 2010 12:38, Gerhard Petracek gerhard.petra...@gmail.com wrote: hi jakob, additions: #1: yesterday (in our discussion about it) we also talked about a replacement for shale-test (e.g. based on easymock or mockito or ...). #2: since we also need it for sub-projects like extval, codi,... we should create e.g. a new extensions- or myfaces-commons-module for it. regards, gerhard http://www.irian.at Your JSF powerhouse - JSF Consulting, Development and Courses in English and German Professional Support for Apache MyFaces 2010/3/26 Jakob Korherr jakob.korh...@gmail.com Hi, As we currently only have normal JUnit tests for automated testing in MyFaces Core, it would be really great to have a way to test MyFaces Core automatically in a real webapp at build time with maven. Of course, we currently have the test-webapp, but we still have to check each page manually here, if we want to test everything, which is long-winded. To accomplish something like that we could use test frameworks like e.g. Canoo WebTest or HttpUnit + Jetty or something similar. I also want to mention JSFUnit here, although we won't be able to use it since it is LGPL licensed. The goal of this GSoC project would be to find alternatives and also to find the best-fitting test framework for MyFaces Core. Then the goal would be to integrate it with MyFaces Core, to define rules and provide how-tos and to write a bunch of test cases. This would help us enormously in ensuring and improving the quality of MyFaces Core by getting a far bigger test coverage and more possibilities to test. What do you think? Are there any students who are interested in working on this? Regards, Jakob
Re: [GSoC] Proposal - Automated webapp tests
yes - it's an improved version of shale test. however, it would be nice to have a more modern solution e.g. with a fluent api, better reporting, ... so we could compare it with the existing solution. regards, gerhard http://www.irian.at Your JSF powerhouse - JSF Consulting, Development and Courses in English and German Professional Support for Apache MyFaces 2010/3/26 Rudy De Busscher rdebussc...@gmail.com Isn't the Myfaces test (svn.apache.org/repos/asf/myfaces/test) not the successor of shale test ? Automated test are indeed very useful, an alternative (easier to set up maybe) of JSFUnit would be great. Regards, Rudy. On 26 March 2010 12:38, Gerhard Petracek gerhard.petra...@gmail.comwrote: hi jakob, additions: #1: yesterday (in our discussion about it) we also talked about a replacement for shale-test (e.g. based on easymock or mockito or ...). #2: since we also need it for sub-projects like extval, codi,... we should create e.g. a new extensions- or myfaces-commons-module for it. regards, gerhard http://www.irian.at Your JSF powerhouse - JSF Consulting, Development and Courses in English and German Professional Support for Apache MyFaces 2010/3/26 Jakob Korherr jakob.korh...@gmail.com Hi, As we currently only have normal JUnit tests for automated testing in MyFaces Core, it would be really great to have a way to test MyFaces Core automatically in a real webapp at build time with maven. Of course, we currently have the test-webapp, but we still have to check each page manually here, if we want to test everything, which is long-winded. To accomplish something like that we could use test frameworks like e.g. Canoo WebTest or HttpUnit + Jetty or something similar. I also want to mention JSFUnit here, although we won't be able to use it since it is LGPL licensed. The goal of this GSoC project would be to find alternatives and also to find the best-fitting test framework for MyFaces Core. Then the goal would be to integrate it with MyFaces Core, to define rules and provide how-tos and to write a bunch of test cases. This would help us enormously in ensuring and improving the quality of MyFaces Core by getting a far bigger test coverage and more possibilities to test. What do you think? Are there any students who are interested in working on this? Regards, Jakob
Re: [GSoC] Proposal - Automated webapp tests
Frankly, I like MyFaces test. It just has to be improved, but we can totally use it (actually that's what we're doing right now). The only thing we can't use MyFaces test is for a real webapp-test, and that is were the GSoC project comes up! Furthermore I don't think we need a subproject for this. Everything which fits into automated testing fits into MyFaces test, so why not use the existing one and improve it instead of creating yet another thing. Regards, Jakob 2010/3/26 Gerhard Petracek gerhard.petra...@gmail.com yes - it's an improved version of shale test. however, it would be nice to have a more modern solution e.g. with a fluent api, better reporting, ... so we could compare it with the existing solution. regards, gerhard http://www.irian.at Your JSF powerhouse - JSF Consulting, Development and Courses in English and German Professional Support for Apache MyFaces 2010/3/26 Rudy De Busscher rdebussc...@gmail.com Isn't the Myfaces test (svn.apache.org/repos/asf/myfaces/test) not the successor of shale test ? Automated test are indeed very useful, an alternative (easier to set up maybe) of JSFUnit would be great. Regards, Rudy. On 26 March 2010 12:38, Gerhard Petracek gerhard.petra...@gmail.comwrote: hi jakob, additions: #1: yesterday (in our discussion about it) we also talked about a replacement for shale-test (e.g. based on easymock or mockito or ...). #2: since we also need it for sub-projects like extval, codi,... we should create e.g. a new extensions- or myfaces-commons-module for it. regards, gerhard http://www.irian.at Your JSF powerhouse - JSF Consulting, Development and Courses in English and German Professional Support for Apache MyFaces 2010/3/26 Jakob Korherr jakob.korh...@gmail.com Hi, As we currently only have normal JUnit tests for automated testing in MyFaces Core, it would be really great to have a way to test MyFaces Core automatically in a real webapp at build time with maven. Of course, we currently have the test-webapp, but we still have to check each page manually here, if we want to test everything, which is long-winded. To accomplish something like that we could use test frameworks like e.g. Canoo WebTest or HttpUnit + Jetty or something similar. I also want to mention JSFUnit here, although we won't be able to use it since it is LGPL licensed. The goal of this GSoC project would be to find alternatives and also to find the best-fitting test framework for MyFaces Core. Then the goal would be to integrate it with MyFaces Core, to define rules and provide how-tos and to write a bunch of test cases. This would help us enormously in ensuring and improving the quality of MyFaces Core by getting a far bigger test coverage and more possibilities to test. What do you think? Are there any students who are interested in working on this? Regards, Jakob
Re: [GSoC] Proposal - Automated webapp tests
You might want to consider Selenium http://seleniumhq.org/ Apache 2.0 license On Thu, Mar 25, 2010 at 8:25 PM, Jakob Korherr jakob.korh...@gmail.com wrote: Hi, As we currently only have normal JUnit tests for automated testing in MyFaces Core, it would be really great to have a way to test MyFaces Core automatically in a real webapp at build time with maven. Of course, we currently have the test-webapp, but we still have to check each page manually here, if we want to test everything, which is long-winded. To accomplish something like that we could use test frameworks like e.g. Canoo WebTest or HttpUnit + Jetty or something similar. I also want to mention JSFUnit here, although we won't be able to use it since it is LGPL licensed. The goal of this GSoC project would be to find alternatives and also to find the best-fitting test framework for MyFaces Core. Then the goal would be to integrate it with MyFaces Core, to define rules and provide how-tos and to write a bunch of test cases. This would help us enormously in ensuring and improving the quality of MyFaces Core by getting a far bigger test coverage and more possibilities to test. What do you think? Are there any students who are interested in working on this? Regards, Jakob
Re: [GSoC] Proposal - Automated webapp tests
Selenium is actually quite nice. I used it on a previous project. It is really easy to record scripts, but also integrates very well with a Maven build, for example using Selenium RC. But it's 100% client side, so you don't have the deep JSF insight as with JSFUnit. My only JSFUnit usage was the beta, which was like 2 years ago, so I don't know the current state. /JK 2010/3/26 Mike Kienenberger mkien...@gmail.com You might want to consider Selenium http://seleniumhq.org/ Apache 2.0 license On Thu, Mar 25, 2010 at 8:25 PM, Jakob Korherr jakob.korh...@gmail.com wrote: Hi, As we currently only have normal JUnit tests for automated testing in MyFaces Core, it would be really great to have a way to test MyFaces Core automatically in a real webapp at build time with maven. Of course, we currently have the test-webapp, but we still have to check each page manually here, if we want to test everything, which is long-winded. To accomplish something like that we could use test frameworks like e.g. Canoo WebTest or HttpUnit + Jetty or something similar. I also want to mention JSFUnit here, although we won't be able to use it since it is LGPL licensed. The goal of this GSoC project would be to find alternatives and also to find the best-fitting test framework for MyFaces Core. Then the goal would be to integrate it with MyFaces Core, to define rules and provide how-tos and to write a bunch of test cases. This would help us enormously in ensuring and improving the quality of MyFaces Core by getting a far bigger test coverage and more possibilities to test. What do you think? Are there any students who are interested in working on this? Regards, Jakob
Re: [GSoC] Proposal - Automated webapp tests
i just mention the most important issue (to keep it short): imo the current module is ~ok for basic myfaces-core tests. however, it doesn't fit e.g. for testing extensions. (the module uses too much mock implementations.) you won't see some important issues. so some tests aren't really reliable as soon as you are using it for testing something like extensions. imo it would be nice to have e.g. a jetty based test environment which we (and also our users) can use for testing extensions, (sample-) webapps, ... based on such an environment we can run unit tests (which shouldn't be as verbose as the current unit tests) with myfaces-core and also with mojarra. with the same environment we could also run jmeter- and something like httpunit-tests. the final solution should be a convenient test-suite with detailed and clear test-reports. regards, gerhard http://www.irian.at Your JSF powerhouse - JSF Consulting, Development and Courses in English and German Professional Support for Apache MyFaces 2010/3/26 Jakob Korherr jakob.korh...@gmail.com Frankly, I like MyFaces test. It just has to be improved, but we can totally use it (actually that's what we're doing right now). The only thing we can't use MyFaces test is for a real webapp-test, and that is were the GSoC project comes up! Furthermore I don't think we need a subproject for this. Everything which fits into automated testing fits into MyFaces test, so why not use the existing one and improve it instead of creating yet another thing. Regards, Jakob 2010/3/26 Gerhard Petracek gerhard.petra...@gmail.com yes - it's an improved version of shale test. however, it would be nice to have a more modern solution e.g. with a fluent api, better reporting, ... so we could compare it with the existing solution. regards, gerhard http://www.irian.at Your JSF powerhouse - JSF Consulting, Development and Courses in English and German Professional Support for Apache MyFaces 2010/3/26 Rudy De Busscher rdebussc...@gmail.com Isn't the Myfaces test (svn.apache.org/repos/asf/myfaces/test) not the successor of shale test ? Automated test are indeed very useful, an alternative (easier to set up maybe) of JSFUnit would be great. Regards, Rudy. On 26 March 2010 12:38, Gerhard Petracek gerhard.petra...@gmail.comwrote: hi jakob, additions: #1: yesterday (in our discussion about it) we also talked about a replacement for shale-test (e.g. based on easymock or mockito or ...). #2: since we also need it for sub-projects like extval, codi,... we should create e.g. a new extensions- or myfaces-commons-module for it. regards, gerhard http://www.irian.at Your JSF powerhouse - JSF Consulting, Development and Courses in English and German Professional Support for Apache MyFaces 2010/3/26 Jakob Korherr jakob.korh...@gmail.com Hi, As we currently only have normal JUnit tests for automated testing in MyFaces Core, it would be really great to have a way to test MyFaces Core automatically in a real webapp at build time with maven. Of course, we currently have the test-webapp, but we still have to check each page manually here, if we want to test everything, which is long-winded. To accomplish something like that we could use test frameworks like e.g. Canoo WebTest or HttpUnit + Jetty or something similar. I also want to mention JSFUnit here, although we won't be able to use it since it is LGPL licensed. The goal of this GSoC project would be to find alternatives and also to find the best-fitting test framework for MyFaces Core. Then the goal would be to integrate it with MyFaces Core, to define rules and provide how-tos and to write a bunch of test cases. This would help us enormously in ensuring and improving the quality of MyFaces Core by getting a far bigger test coverage and more possibilities to test. What do you think? Are there any students who are interested in working on this? Regards, Jakob
