Hi Dinusha,
All the test cases failed when I use latest APPM
release(wso2appm-1.0.0-SNAPSHOT-20-04-2015.zip) due to app life cycle
enhancement in new releases. When I fixed app creation life cycle process I
got 3 test failures as below logs. All the test case were executed
successfully when I used earlier APPM releases(March or earlier ones). Web
driver instances creating issue is fixed as well. Now I'm working on these
test failures.
Tests run: 19, Failures: 3, Errors: 0, Skipped: 0, Time elapsed: 522.867
sec <<< FAILURE!
testApplicationSubscribe(org.wso2.carbon.appmanager.integration.ui.TestCases.LifeCycleTestCase)
Time elapsed: 1.898 sec <<< FAILURE!
java.lang.AssertionError: Application testApp is already subscribed
expected [false] but found [true]
at org.testng.Assert.fail(Assert.java:94)
at org.testng.Assert.failNotEquals(Assert.java:494)
at org.testng.Assert.assertFalse(Assert.java:63)
at
org.wso2.carbon.appmanager.integration.ui.TestCases.LifeCycleTestCase.testApplicationSubscribe(LifeCycleTestCase.java:97)
testApplicationDeletion(org.wso2.carbon.appmanager.integration.ui.TestCases.AppDeleteTestCase)
Time elapsed: 1.673 sec <<< FAILURE!
java.lang.Exception: App deletion failed>
at
org.wso2.carbon.appmanager.integration.ui.Util.APPMPublisherRestClient.deleteApp(APPMPublisherRestClient.java:461)
at
org.wso2.carbon.appmanager.integration.ui.TestCases.AppDeleteTestCase.testApplicationDeletion(AppDeleteTestCase.java:59)
testSelfSignUp(org.wso2.carbon.appmanager.integration.ui.TestCases.SelfSignUpTestCase)
Time elapsed: 33.006 sec <<< FAILURE!
org.openqa.selenium.TimeoutException: Timed out after 30 seconds waiting
for visibility of element located by By.id: inp-username
Build info: version: '2.37.0', revision:
'a7c61cbd68657e133ae96672cf995890bad2ee42', time: '2013-10-18 09:51:02'
System info: host: 'SajithA-MacBook', ip: '10.100.7.19', os.name: 'Mac OS
X', os.arch: 'x86_64', os.version: '10.9.5', java.version: '1.6.0_65'
Driver info: driver.version: unknown
at
org.openqa.selenium.support.ui.FluentWait.timeoutException(FluentWait.java:259)
at org.openqa.selenium.support.ui.FluentWait.until(FluentWait.java:228)
at
org.wso2.carbon.appmanager.integration.ui.Util.APPMStoreUIClient.selfSignUp(APPMStoreUIClient.java:241)
at
org.wso2.carbon.appmanager.integration.ui.TestCases.SelfSignUpTestCase.testSelfSignUp(SelfSignUpTestCase.java:53)
Caused by: org.openqa.selenium.NoSuchElementException: Unable to locate
element: {"method":"id","selector":"inp-username"}
Command duration or timeout: 2.03 seconds
For documentation on this error, please visit:
http://seleniumhq.org/exceptions/no_such_element.html
Build info: version: '2.37.0', revision:
'a7c61cbd68657e133ae96672cf995890bad2ee42', time: '2013-10-18 09:51:02'
System info: host: 'SajithA-MacBook', ip: '10.100.7.19', os.name: 'Mac OS
X', os.arch: 'x86_64', os.version: '10.9.5', java.version: '1.6.0_65'
Session ID: 7c109b4d-ed1b-2743-ad66-8e269d5b0f4d
Driver info: org.openqa.selenium.firefox.FirefoxDriver
Capabilities [{platform=MAC, acceptSslCerts=true, javascriptEnabled=true,
browserName=firefox, rotatable=false, locationContextEnabled=true,
version=24.0, cssSelectorsEnabled=true, databaseEnabled=true,
handlesAlerts=true, browserConnectionEnabled=true, nativeEvents=false,
webStorageEnabled=true, applicationCacheEnabled=true, takesScreenshot=true}]
at sun.reflect.NativeConstructorAccessorImpl.newInstance0(Native Method)
at
sun.reflect.NativeConstructorAccessorImpl.newInstance(NativeConstructorAccessorImpl.java:39)
at
sun.reflect.DelegatingConstructorAccessorImpl.newInstance(DelegatingConstructorAccessorImpl.java:27)
at java.lang.reflect.Constructor.newInstance(Constructor.java:513)
at
org.openqa.selenium.remote.ErrorHandler.createThrowable(ErrorHandler.java:193)
at
org.openqa.selenium.remote.ErrorHandler.throwIfResponseFailed(ErrorHandler.java:145)
at
org.openqa.selenium.remote.RemoteWebDriver.execute(RemoteWebDriver.java:554)
at
org.openqa.selenium.remote.RemoteWebDriver.findElement(RemoteWebDriver.java:307)
at
org.openqa.selenium.remote.RemoteWebDriver.findElementById(RemoteWebDriver.java:348)
at org.openqa.selenium.By$ById.findElement(By.java:220)
at
org.openqa.selenium.remote.RemoteWebDriver.findElement(RemoteWebDriver.java:299)
at
org.openqa.selenium.support.ui.ExpectedConditions.findElement(ExpectedConditions.java:579)
at
org.openqa.selenium.support.ui.ExpectedConditions.access$000(ExpectedConditions.java:39)
at
org.openqa.selenium.support.ui.ExpectedConditions$4.apply(ExpectedConditions.java:130)
at
org.openqa.selenium.support.ui.ExpectedConditions$4.apply(ExpectedConditions.java:126)
at org.openqa.selenium.support.ui.FluentWait.until(FluentWait.java:208)
... 35 more
Caused by: org.openqa.selenium.remote.ErrorHandler$UnknownServerException:
Unable to locate element: {"method":"id","selector":"inp-username"}
Build info: version: '2.37.0', revision:
'a7c61cbd68657e133ae96672cf995890bad2ee42', time: '2013-10-18 09:51:02'
System info: host: 'SajithA-MacBook', ip: '10.100.7.19', os.name: 'Mac OS
X', os.arch: 'x86_64', os.version: '10.9.5', java.version: '1.6.0_65'
Driver info: driver.version: unknown
at <anonymous
class>.FirefoxDriver.prototype.findElementInternal_(file:///var/folders/l1/3w8xmrd5211b1d0yk42548km0000gp/T/anonymous1351737437995765282webdriver-profile/extensions/
[email protected]/components/driver_component.js:8891)
at <anonymous
class>.fxdriver.Timer.prototype.setTimeout/<.notify(file:///var/folders/l1/3w8xmrd5211b1d0yk42548km0000gp/T/anonymous1351737437995765282webdriver-profile/extensions/
[email protected]/components/driver_component.js:396)
[2015-04-22 12:53:38,332] INFO
{org.wso2.carbon.automation.core.utils.serverutils.ServerUtils} - Shutting
down server..
Results :
Failed tests:
testApplicationSubscribe(org.wso2.carbon.appmanager.integration.ui.TestCases.LifeCycleTestCase):
Application testApp is already subscribed expected [false] but found [true]
testApplicationDeletion(org.wso2.carbon.appmanager.integration.ui.TestCases.AppDeleteTestCase):
App deletion failed>
testSelfSignUp(org.wso2.carbon.appmanager.integration.ui.TestCases.SelfSignUpTestCase):
Timed out after 30 seconds waiting for visibility of element located by
By.id: inp-username(..)
Tests run: 19, Failures: 3, Errors: 0, Skipped: 0
*Sajith Abeywardhana* | Software Engineer
WSO2, Inc | lean. enterprise. middleware.
#20, Palm Grove, Colombo 03, Sri Lanka.
Mobile: +94772260485
Email: [email protected] <[email protected]> | Web: www.wso2.com
On Tue, Apr 21, 2015 at 2:10 PM, Dinusha Senanayaka <[email protected]>
wrote:
> Hi Krishantha,
>
> Sajith is checking this.
>
> Regards,
> Dinusha.
>
> On Tue, Apr 21, 2015 at 1:23 PM, Krishantha Samaraweera <
> [email protected]> wrote:
>
>> Hi App Manager team,
>>
>> Ui integration tests are broken heavily.
>>
>> When running the UI tests more than 15 firefox instances get created.
>> This directly affect to test performance. Can you arrange a review with
>> Automation team after fixing failures.
>>
>> Also backend test module is excluded from build [1]. Aren't you guys add
>> test cases for new features ?
>>
>> Failed tests:
>> init(org.wso2.carbon.appmanager.integration.ui.TestCases.SAMLtoBackendTestCase):
>> Change state failed>
>>
>> destroy(org.wso2.carbon.appmanager.integration.ui.TestCases.SAMLtoBackendTestCase)
>>
>> init(org.wso2.carbon.appmanager.integration.ui.TestCases.JWTGenerationTestCase):
>> Change state failed>
>>
>> destroy(org.wso2.carbon.appmanager.integration.ui.TestCases.JWTGenerationTestCase)
>>
>> init(org.wso2.carbon.appmanager.integration.ui.TestCases.ResourceAuthXCMLTestCase):
>> Change state failed>
>>
>> destroy(org.wso2.carbon.appmanager.integration.ui.TestCases.ResourceAuthXCMLTestCase)
>>
>> init(org.wso2.carbon.appmanager.integration.ui.TestCases.ThrottlingTestCase):
>> Change state failed>
>>
>> destroy(org.wso2.carbon.appmanager.integration.ui.TestCases.ThrottlingTestCase)
>> init(org.wso2.carbon.appmanager.integration.ui.TestCases.TagsTestCase):
>> Change state failed>
>>
>> init(org.wso2.carbon.appmanager.integration.ui.TestCases.ResourceAuthRolesTestCase):
>> Change state failed>
>>
>> destroy(org.wso2.carbon.appmanager.integration.ui.TestCases.ResourceAuthRolesTestCase)
>>
>> init(org.wso2.carbon.appmanager.integration.ui.TestCases.LifeCycleTestCase):
>> Change state failed>
>>
>> destroy(org.wso2.carbon.appmanager.integration.ui.TestCases.LifeCycleTestCase)
>>
>> testApplicationDeletion(org.wso2.carbon.appmanager.integration.ui.TestCases.AppDeleteTestCase):
>> App deletion failed>
>>
>> testSelfSignUp(org.wso2.carbon.appmanager.integration.ui.TestCases.SelfSignUpTestCase):
>> Timed out after 30 seconds waiting for visibility of element located by
>> By.id: inp-username(..)
>>
>> init(org.wso2.carbon.appmanager.integration.ui.TestCases.DocumentTestCase):
>> Change state failed>
>>
>> init(org.wso2.carbon.appmanager.integration.ui.TestCases.GoogleAnalyticsTestCase):
>> Change state failed>
>>
>> init(org.wso2.carbon.appmanager.integration.ui.TestCases.RatingTestCase):
>> Change state failed>
>>
>> *Tests run: 36, Failures: 18, Errors: 0, Skipped: 16*
>>
>> [1]
>> https://github.com/wso2/product-app-manager/blob/master/modules/integration/tests/pom.xml
>>
>> Thanks,
>> Krishantha.
>> --
>> Krishantha Samaraweera
>> Senior Technical Lead - Test Automation
>> Mobile: +94 77 7759918
>> WSO2, Inc.; http://wso2.com/
>> lean . enterprise . middlewear.
>>
>
>
>
> --
> Dinusha Dilrukshi
> Senior Software Engineer
> WSO2 Inc.: http://wso2.com/
> Mobile: +94725255071
> Blog: http://dinushasblog.blogspot.com/
>
_______________________________________________
Dev mailing list
[email protected]
http://wso2.org/cgi-bin/mailman/listinfo/dev
