Quality Summary --------------------------------------- QA Conclusion: Not Recommend for Crosswalk Lite public release.
WRT and Embedding API Use cases Testing are totally blocked by one major regression: fail to pack crosswalk lite test suites(XWALK-4279<https://crosswalk-project.org/jira/browse/XWALK-4279>), feature verification of interface for initializing XWalkView asynchronously(XWLK-3971<https://crosswalk-project.org/jira/browse/XWALK-3971>) is blocked on crosswalk lite as well. Four additional Crosswalk Lite specific regression issues found:[REG]fail to get location information(XWALK-4280<https://crosswalk-project.org/jira/browse/XWALK-4280>), [REG]No response after clicking buttons of Presentation(XWALK-4281<https://crosswalk-project.org/jira/browse/XWALK-4281>), [REG]Fail to get navigator.system or xwalk.experimental.system property(XWALK-4282<https://crosswalk-project.org/jira/browse/XWALK-4282>), [REG]navigator.getUserMedia got undefined(XWALK-4283<https://crosswalk-project.org/jira/browse/XWALK-4283>). Feature for LZMA support backport(XWALK-3810<https://crosswalk-project.org/jira/browse/XWALK-3810>) works fine on Crosswalk lite. The overall test results: Test Scope Total TCs Run rate Pass Rate Pass Rate of Executed Diff W/ Lite 10.39.232.1 Diff W/ 15.43.347.0(canary) Comment Use Cases 148 41% 32% 78% -23% -56% Most tests are blocked by XWALK-4279<https://crosswalk-project.org/jira/browse/XWALK-4279> Total 148 41% 32% 78% -23% -56% New Issues: - XWALK-4279<https://crosswalk-project.org/jira/browse/XWALK-4279> P1 [REG][usecase]Failed to pack Crosswalk lite usecase suites by using make.py. - XWALK-4280<https://crosswalk-project.org/jira/browse/XWALK-4280> P2 [REG]Fail to get location informaiton of latitude and longitude position on android - XWALK-4281<https://crosswalk-project.org/jira/browse/XWALK-4281> P2 [REG]No response after clicking 'Request Show Presentation' button of webapi usecase/Presentation - XWALK-4282<https://crosswalk-project.org/jira/browse/XWALK-4282> P2 [REG]Fail to get navigator.system or xwalk.experimental.system property - XWALK-4283<https://crosswalk-project.org/jira/browse/XWALK-4283> P2 [REG]navigator.getUserMedia got undefined when running webapi usecase/CameraviaUserMedia User Experience Evaluation Table User experience check points App Source Test Result Diff W/ Lite 10.39.232.1 Smooth Installation Process http://html5test.com/ LZMA compression: compress 9.8M -- Progress bar UI: works fine -- Decompression time: 11 seconds -- HTML5 Support http://html5test.com/ Crosswalk Mini: 464 -- Crosswalk: 494 -- First Launch Time Comparison Crosswalk: Hangonman Crosswalk: 2 seconds -- Crosswalk Mini: Hangonman Crosswalk Mini: 11 seconds -- Native App: WeChat Native App: 1 second -- App Screen Rotation https://crosswalk-project.org/ The Rotation function works well, both for Apps with English and Chinese language. -- m.ctrip.com (in Chinese) m.mogujie.com (in Chinese) Frame Rate http://ie.microsoft.com/testdrive/performance/fishietank/ 58 FPS/100 fish: 48 FPS -- Crosswalk Lite Use Cases Testing Details Component Total TCs Android IA Diff W/ Lite 10.39.232.1 Diff W/ 15.43.347.0(canary) Comments WRT 48 0% -86% -90% Blocked by XWALK-4279<https://crosswalk-project.org/jira/browse/XWALK-4279> [REG][usecase]Failed to pack Crosswalk lite usecase suites by using make.py. W3C API 60 □□□□□□□78% +49% -11% XWALK-2660<https://crosswalk-project.org/jira/browse/XWALK-2660> [REG]It is not available for label type="file" which load resource file failed on Android OS XWALK-2663<https://crosswalk-project.org/jira/browse/XWALK-2663> flex-flow and justify-content attribute in flexbox can not completely finished rendering effect when running the "flexibleBox" component XWALK-837<https://crosswalk-project.org/jira/browse/XWALK-837> Security Error occurs when calling requestFilesystem method on Android OS XWALK-2666<https://crosswalk-project.org/jira/browse/XWALK-2666> Fail to get correct type of devicemotion.acceleration.x/y/z and devicemotion.rotationRate.alpha when running the "W3C/Deviceorientation" on some devices XWALK-1693<https://crosswalk-project.org/jira/browse/XWALK-1693> Fail to get correct value of “connection status” when running “Use Case/BrowserState” on Android OS XWALK-1457<https://crosswalk-project.org/jira/browse/XWALK-1457> No selection list displayed in the input when running “Use Case/Input” on Android OS Diff with Crosswalk Lite 10.39.232.1, Got improvement due to XWALK-3465<https://crosswalk-project.org/jira/browse/XWALK-3465> is not reproduced Diff with Crosswalk canary15.43.347.0,Got downgrade due to four new regression issues reported: XWALK-4280<https://crosswalk-project.org/jira/browse/XWALK-4280> [REG]Fail to get location informaiton of latitude and longitude position on android XWALK-4281<https://crosswalk-project.org/jira/browse/XWALK-4281> [REG]No response after clicking 'Request Show Presentation' button of webapi usecase/Presentation XWALK-4282<https://crosswalk-project.org/jira/browse/XWALK-4282> [REG]Fail to get navigator.system or xwalk.experimental.system property XWALK-4283<https://crosswalk-project.org/jira/browse/XWALK-4283> [REG]navigator.getUserMedia got undefined when running webapi usecase/CameraviaUserMedia Embedding API 20 0% -93% -85% Blocked by XWALK-4279<https://crosswalk-project.org/jira/browse/XWALK-4279> [REG][usecase]Failed to pack Crosswalk lite usecase suites by using make.py. Embedding API Async 20 0% -93% -85% Blocked by XWALK-4279<https://crosswalk-project.org/jira/browse/XWALK-4279> [REG][usecase]Failed to pack Crosswalk lite usecase suites by using make.py. Verify Issues: ----------------------- N/A Crosswalk Lite build for Android: https://download.01.org/crosswalk/releases/crosswalk-lite/android/canary/10.39.235.1/ Github Test Suite Links: https://github.com/crosswalk-project/crosswalk-test-suite/ Operating System: Android Image version: 4.2.2/4.4.4 Test Environment ----------------------- l Crosswalk Android: o IA phone: ZTE V975 o IA Tablet (Baytrail T): Asus Memo Pad8 Thanks Crosswalk QA
_______________________________________________ Crosswalk-dev mailing list [email protected] https://lists.crosswalk-project.org/mailman/listinfo/crosswalk-dev
