Hi Caleb,

Caleb James DeLisle wrote:
> Two problems:
> 1. The selenium tests try to submit bad information but are stopped by
> LiveValidation causing a test failure.
> Responsible for:
> http://hudson.xwiki.org/job/xwiki-product-enterprise-tests/com.xpn.xwiki.products$xwiki-enterprise-test-selenium/412/testReport/com.xpn.xwiki.it.selenium/RegisterTest/testRegisterWithoutEnteringPassword/?
> http://hudson.xwiki.org/job/xwiki-product-enterprise-tests/com.xpn.xwiki.products$xwiki-enterprise-test-selenium/412/testReport/com.xpn.xwiki.it.selenium/RegisterTest/testRegisterWithoutEnteringUserName/?
> http://hudson.xwiki.org/job/xwiki-product-enterprise-tests/com.xpn.xwiki.products$xwiki-enterprise-test-selenium/412/testReport/com.xpn.xwiki.it.selenium/RegisterTest/testRegisterWithTwoDifferentPasswords/?
> Perhaps we can set up the test to bypass javascript, maybe it's a good idea to
> test LiveValidation too?

I don't think you can bypass/disable JavaScript in Selenium tests since 
they depend on it. The user actions are simulated using JavaScript. I 
think we should update the failing tests to take into account the 
presence of LiveValidation. I'm wondering though how can we write 
functional/integration tests for the scenario when the user has 
JavaScript disabled.

> 
> 2. Also selenium seems unable to solve the captcha. It wasn't a problem 
> because empty
> captchas were accepted as long as there was no 'mandatory' constraint on the 
> captcha
> field, fixed that.
> Expecting this to start being a problem again:
> http://hudson.xwiki.org/job/xwiki-product-enterprise-tests/com.xpn.xwiki.products$xwiki-enterprise-test-selenium/406/testReport/com.xpn.xwiki.it.selenium/RegisterTest/testRegisterJohnSmith/?
> Log in as Admin, set captcha to false, log out and then register?
> Turn off captcha by default?

Since Selenium allows you to automate user actions, if you could write 
an automated test that solves captchas then captchas wouldn't be useful 
at all. I think you can only test, with Selenium, that the captcha is 
displayed and that it cannot be bypassed with random answer (the chance 
of guessing the answer should be low enough).

Marius

> 
> I'd like to hear your thoughts,
> 
> Caleb
> 
> _______________________________________________
> devs mailing list
> [email protected]
> http://lists.xwiki.org/mailman/listinfo/devs
_______________________________________________
devs mailing list
[email protected]
http://lists.xwiki.org/mailman/listinfo/devs

Reply via email to