Hi, I propose that we branch Beta from 14.43.342.0 and cherry-pick the fix for XWALK-3953 once available in master.
Francesco From: <Wang>, LeiX Wang <[email protected]<mailto:[email protected]>> Date: Wednesday 6 May 2015 14:02 To: "<crosswalk-dev@lists. org>" <[email protected]<mailto:[email protected]>> Subject: [Crosswalk-dev] [canary] Fullpass test report for Crosswalk Project for Android 14.43.342.0 Quality Summary 14.43.342.0 ----------------------- QA Suggestion: one Release-Blocker can reproduce on this build: XWALK-3953<https://crosswalk-project.org/jira/browse/XWALK-3953>blue screen when launching shared app, QA suggest fixing it before promoting to Beta release. QA complete the Fullpass Testing on crosswalk 14.43.342.0 for Android. Good to see 3 Release-Blockers fixed:SIMD works fine(Fixed XWALK-4024<https://crosswalk-project.org/jira/browse/XWALK-4024>), --disk-cache-size command switch has an effect(Fixed XWALK-3821<https://crosswalk-project.org/jira/browse/XWALK-3821>),Embedding API: onCreateWindowRequested with ‘_blank’ works fine(Fixed XWALK-2754<https://crosswalk-project.org/jira/browse/XWALK-2754>). Release-Blockers XWALK-3953<https://crosswalk-project.org/jira/browse/XWALK-3953> can reproduce on thisbuild, and XWALK-3863<https://crosswalk-project.org/jira/browse/XWALK-3863> is waiting for developers’ feedback. One regression issue reported: "url"/"closeEventHandler" parameter should be readonly for Websocket in shared mode(XWALK-4123<https://crosswalk-project.org/jira/browse/XWALK-4123>). Additionally, QA added BatteryStatus APIs tests this time, and found one issue: fail to get the values of chargingTime/discha rgingTime attributes(XWALK-4111<https://crosswalk-project.org/jira/browse/XWALK-4111>). The overall test results: Test Scope Total TCs Run rate Pass Rate Pass Rate of Executed Diff W/ 14.43.338.0 Comments Sample Apps(Embedded) 94 100% 96% 96% +1% Got improvement due to SIMD works fine(FixedXWALK-4024<https://crosswalk-project.org/jira/browse/XWALK-4024>) Sample Apps(Shared) 94 100% 96% 96% +1% Got improvement due to SIMD works fine(FixedXWALK-4024<https://crosswalk-project.org/jira/browse/XWALK-4024>) WRT(Embedded) 758 100% 100% 100% -- Got good quality WRT(Shared) 22 100% 82% 82% -13% Got downgrade due toXWALK-3847<https://crosswalk-project.org/jira/browse/XWALK-3847> reproduce and XWALK-3332<https://crosswalk-project.org/jira/i#browse/XWALK-3332> randomly occur Web APIs (Embedded) 12215 97% 89% 92% +12% Got improvement due to SIMD works fine(FixedXWALK-4024<https://crosswalk-project.org/jira/browse/XWALK-4024>), and add BatteryStatus APIs tests this time Web APIs (Shared) 11976 97% 90% 92% +13% Got improvement due to SIMD works fine(FixedXWALK-4024<https://crosswalk-project.org/jira/browse/XWALK-4024>), and add BatteryStatus APIs tests this time Embedding APIs (Embedded) 195 100% 96% 96% +3% Got improvement due to XWALK-2754<https://crosswalk-project.org/jira/browse/XWALK-2754> fixed after update tests with ‘_blank’ Embedding APIs (Shared) 195 100% 96% 96% +3% Got improvement due to XWALK-2754<https://crosswalk-project.org/jira/browse/XWALK-2754> fixed after update tests with ‘_blank’ Use Cases 119 100% 83% 83% +1% Got improvement due to SIMD works fine(FixedXWALK-4024<https://crosswalk-project.org/jira/browse/XWALK-4024>) Stability 14 100% 86% 86% -- Stability issues:XWALK-2902<https://crosswalk-project.org/jira/browse/XWALK-2902>, XWALK-1289<https://crosswalk-project.org/jira/browse/XWALK-1289> Total 25494 97% 90% 93% +12% New Issues: - XWALK-4111<https://crosswalk-project.org/jira/browse/XWALK-4111> P2 Fails to get correct value of chargingTime/dischargingTime attributes in BatteryStatus API - XWALK-4123<https://crosswalk-project.org/jira/browse/XWALK-4123> P2 [REG] The "url"/"closeEventHandler" parameter of WebSocket interface should be readonly on crosswalk shared mode Crosswalk Sample Apps Testing Details Component Android Comments Total TCs 14.43.342.0 Diff W/ 14.43.338.0 Sample Apps(Embedded) 94 □□□□□□□□□96% +1% XWALK-2223<https://crosswalk-project.org/jira/i#browse/XWALK-2223> [REG] HangOnMan sample app doesn't display cloud background and "New Game"/"quit" button createDataChannel and onDataChannel issues(upstream issues, XWALK-1473<https://crosswalk-project.org/jira/browse/XWALK-1473>comment) install banners test failed(same as Chrome) XWALK-4010<https://crosswalk-project.org/jira/browse/XWALK-4010>Noise would be heard after connecting server Got improvement due toSIMD works fine(Fixed XWALK-4024<https://crosswalk-project.org/jira/browse/XWALK-4024>) Sample Apps(Shared) 94 □□□□□□□□□96% +1% XWALK-2223<https://crosswalk-project.org/jira/i#browse/XWALK-2223> [REG] HangOnMan sample app doesn't display cloud background and "New Game"/"quit" button createDataChannel and onDataChannel issues(upstream issues, XWALK-1473<https://crosswalk-project.org/jira/browse/XWALK-1473>comment) install banners test failed(same as Chrome) XWALK-4010<https://crosswalk-project.org/jira/browse/XWALK-4010>Noise would be heard after connecting server Got improvement due toSIMD works fine(Fixed XWALK-4024<https://crosswalk-project.org/jira/browse/XWALK-4024>) Crosswalk WRT(Embedded) Testing Details Component Android Comments Total TCs 14.43.342.0 Diff W/ 14.43.338.0 Crosswalk WRT/Core Shell 5 □□□□□□□□□□100% -- Crosswalk WRT/Extension System 5 □□□□□□□□□□100% -- Crosswalk WRT/Internet Standard/Cookie 9 □□□□□□□□□□100% -- Crosswalk WRT/Internet Standard/Scheme 24 □□□□□□□□□□100% -- Crosswalk WRT/Manifest 289 □□□□□□□□□□100% -- Crosswalk WRT/Package Management 14 □□□□□□□□□□100% -- Crosswalk WRT/Packer Tool 335 □□□□□□□□□□100% -- XWALK-2667<https://crosswalk-project.org/jira/browse/XWALK-2667> Fail to get correct status of DeviceCapabilities.onstorageattach/onstoragedetach event when attach and detach SD card on 'Asus Memo Pad8' device Crosswalk WRT/Runtime Core 11 □□□□□□□□□□100% -- Crosswalk WRT/Security 29 □□□□□□□□□97% -- XWALK-3993<https://crosswalk-project.org/jira/browse/XWALK-3993> [REG] Fail to get Location info with "Geolocation" permission in manifest on Nexus ARM device Crosswalk WRT/User Experience 37 □□□□□□□□□□100% -- Crosswalk WRT(Shared) Testing Details Component Android Comments Total TCs 14.43.342.0 Diff W/ 14.43.338.0 Crosswalk WRT/Packer Tool 3 □□□□□□□□□□100% -- Crosswalk WRT/Shared Mode 11 □□□□□□□□82% -18% Got downgrade due to XWALK-3847<https://crosswalk-project.org/jira/browse/XWALK-3847> reproduced again Crosswalk WRT/Upgrade 8 □□□□□□□75% -13% XWALK-3332<https://crosswalk-project.org/jira/i#browse/XWALK-3332> Can't get correct cookie value when upgrading apps Got downgrade due to XWALK-3332<https://crosswalk-project.org/jira/i#browse/XWALK-3332> randomly occur Crosswalk Web APIs Testing Details Web Spec Android Comments Total TCs 14.43.342.0 (Embedded Mode) 14.43.342.0 (Shared Mode) Diff W/ Base Webview Diff W/ Base Chrome Diff W/ 14.43.338.0 Crosswalk APIs/Native File System 52 □□□□□□□□88% □□□□□□□□88% N/A N/A -- XWALK-4040<https://crosswalk-project.org/jira/i#browse/XWALK-4040> [REG] The Entry.nativefilesystem/fullPath/isDirectory/isFile/name property doesn't exist when running "webapi-nativefilesystem-xwalk-tests" Crosswalk APIs/Screen Presentation APIs 15 □□□□□□□□□□100% □□□□□□□□□□100% +100% +100% -- Supplementary APIs/Fullscreen API - Mozilla (Partial) 9 □□□□□□□□□□100% □□□□□□□□□□100% +92% -- -- Supplementary APIs/Promises 4 □□□□□□□□□□100% □□□□□□□□□□100% +100% -- -- Supplementary APIs/SIMD 1627 □□□□□□□□□95% □□□□□□□□□95% N/A +95% +93% XWALK-3155<https://crosswalk-project.org/jira/browse/XWALK-3155> SIMD load and store operations with overaligned run failed on android device. XWALK-3517<https://crosswalk-project.org/jira/browse/XWALK-3517> SIMD float64x2_swizzle and float64x2_shuffle methods are not supported on android device Got improvement due to XWALK-4024<https://crosswalk-project.org/jira/browse/XWALK-4024> has been fixed. Supplementary APIs/Typed Arrays - Khronos (Partial) 446 □□□□□□□□□99% □□□□□□□□□99% -- +9% -- Failure reason is same as Chrome Supplementary APIs/WebGL - Khronos (Partial) 1597 □□□□□□□□□99% □□□□□□□□□99% -- +99% -- XWALK-3062<https://crosswalk-project.org/jira/browse/XWALK-3062> Fail to get correct value when invoking deleteBuffer() XWALK-3063<https://crosswalk-project.org/jira/browse/XWALK-3063> Fail to get correct value if no source has been defined when invoking getTranslatedShaderSource() method W3C_HTML5 APIs/Communication/HTML5 The session history of browsing contexts (Partial) 154 □□□□□□□□□□100% □□□□□□□□□□100% +81% +8% -- W3C_HTML5 APIs/Communication/HTML5 Web Messaging 175 □□□□□□□□□99% □□□□□□□□□99% +81% +4% -- Failure reason is same as Chrome W3C_HTML5 APIs/Communication/Server-Sent Events 67 □□□□□□□□82% □□□□□□□□82% +82% -2% -- Failure reason is same as Chrome W3C_HTML5 APIs/Communication/The WebSocket API 270 □□□□□□□□□97% □□□□□□□□□96% +97% +17% -- XWALK-1791<https://crosswalk-project.org/jira/browse/XWALK-1791> White screen occurs when running “WebAPI/WebSocket” on Android OS XWALK-4031<https://crosswalk-project.org/jira/i#browse/XWALK-4031> [REG] Missing "onopen" attribute in websocket object on crosswalk embedded mode XWALK-4123<https://crosswalk-project.org/jira/browse/XWALK-4123> [REG] The "url"/"closeEventHandler" parameter of WebSocket interface should be readonly on crosswalk shared mode W3C_HTML5 APIs/Communication/WebRTC 134 □□□□□□□□84% □□□□□□□□84% N/A +3% -- XWALK-942<https://crosswalk-project.org/jira/browse/XWALK-942> The setting of binaryType/maxRetransmits/ordered attributes of RTCDataChannel are abnormal on Android OS XWALK-1447<https://crosswalk-project.org/jira/browse/XWALK-1447> Crosswalk crashed when running “WebAPI/webrtc” on Android OS (upstream bug) XWALK-3232<https://crosswalk-project.org/jira/browse/XWALK-3232> [REG] The expected test purpose what is incorrect in webapi-webrtc-w3c-tests on Android XWALK-3241<https://crosswalk-project.org/jira/browse/XWALK-3241> [REG] Fail to get readonly attribute when testing webapi-webrtc-w3c-tests package on Android W3C_HTML5 APIs/Communication/XMLHttpRequest Level 2 291 □□□□□□□□□90% □□□□□□□□□93% +16% +1% -- XWALK-3074<https://crosswalk-project.org/jira/browse/XWALK-3074> Fail to trigger the onerror event when invoking XMLHttpRequest.getAllResponseHeaders() method W3C_HTML5 APIs/Device/Battery Status API 54 □□□□□□□□□91% □□□□□□□□□□100% +91% +91% N/A XWALK-4111<https://crosswalk-project.org/jira/i#browse/XWALK-4111> Fails to get correct value of chargingTime/dischargingTime attributes in BatteryStatus API W3C_HTML5 APIs/Device/DeviceOrientation Event Specification (Partial) 40 □□□□□□□□85% □□□□□□□□85% +85% -15% -- XWALK-2666<https://crosswalk-project.org/jira/browse/XWALK-2666> Fail to get correct type of devicemotion.acceleration.x/y/z and devicemotion.rotationRate.alpha when running the "W3C/Deviceorientation" on 'Asus Memo Pad8' device(Device limitation) W3C_HTML5 APIs/Device/HTML5 Browser state 3 □□□□□□□□□□100% □□□□□□□□□□100% -- -- -- W3C_HTML5 APIs/Device/The Network Information API 4 □□□□□50% □□□□□50% +20% -- -- Failure reason is same as Chrome W3C_HTML5 APIs/Device/The Screen Orientation API 12 □□□□□□□□□□100% □□□□□□□□□□100% +92% +14% -- W3C_HTML5 APIs/Device/Touch Events version 1 (Partial) 47 □□□□□□□□□□100% □□□□□□□□□□100% +2% -- -- W3C_HTML5 APIs/Device/Vibration API 20 □□□□□□□□□□100% □□□□□□□□□□100% +100% -- -- Vibration doesn’t support on Asus Memo Pad8, tested on ZTE Geek phone W3C_HTML5 APIs/DOM, Forms and Styles/CSS Animations Module Level 3 54 □□□□□□□□□□100% □□□□□□□□□□100% +9% +26% -- W3C_HTML5 APIs/DOM, Forms and Styles/CSS Backgrounds and Borders Module Level 3 612 □□□□□□□□□93% □□□□□□□□□94% +34% -6% -- XWALK-2735<https://crosswalk-project.org/jira/browse/XWALK-2735>Fail to dispose the border element of css style on Android XWALK-2659<https://crosswalk-project.org/jira/browse/XWALK-2659> Css line doesn't work on Crosswalk using the <![CDATA[ in <style> XWALK-3506<https://crosswalk-project.org/jira/i#browse/XWALK-3506> [REG]Cann't correctly display background-clip with content-box in visual when running tct-backgrounds-css3-tests by webdriver XWALK-3507<https://crosswalk-project.org/jira/i#browse/XWALK-3507> [REG] Cann't correctly display background-clip with inherit in visual when running tct-backgrounds-css3-tests by webdriver W3C_HTML5 APIs/DOM, Forms and Styles/CSS Basic User Interface Module Level 3 (CSS3 UI) (Partial) 44 □□□□□□□□□98% □□□□□□□□□98% +3% -2% -- XWALK-4019<https://crosswalk-project.org/jira/i#browse/XWALK-4019> [REG] The 'content' property doesn't exist when running "tct-ui-css3-tests". W3C_HTML5 APIs/DOM, Forms and Styles/CSS Color Module Level 3 103 □□□□□□□□85% □□□□□□□□86% -14% -15% -- XWALK-2735<https://crosswalk-project.org/jira/browse/XWALK-2735> Fail to dispose the border element of css style on Android W3C_HTML5 APIs/DOM, Forms and Styles/CSS Flexible Box Layout Module 67 □□□□40% □□□□40% +13% -50% -- XWALK-2735<https://crosswalk-project.org/jira/browse/XWALK-2735>Fail to dispose the border element of css style on Android XWALK-2663<https://crosswalk-project.org/jira/browse/XWALK-2663> The red background of flexbox div cannot be covered completely when running the "flexibleBox" component XWALK-3622<https://crosswalk-project.org/jira/i#browse/XWALK-3622> Fail to get the expect initial value of align-items/align-self property when running tct-flexiblebox-css3-tests. XWALK-3794<https://crosswalk-project.org/jira/i#browse/XWALK-3794> [REG]Fail to get correct the initial value of align-content when running tct-flexiblebox-css3-tests XWALK-3227<https://crosswalk-project.org/jira/i#browse/XWALK-3227> Fail to get correct the initial value of justify-content when testing tct-flexiblebox-css3-tests package by SharedMode mode W3C_HTML5 APIs/DOM, Forms and Styles/CSS Fonts Module Level 3 (Partial) 141 □□□□□□□□□90% □□□□□□□□□92% -4% -9% -- XWALK-2659<https://crosswalk-project.org/jira/browse/XWALK-2659> Css line doesn't work on Crosswalk using the <![CDATA[ in <style> XWALK-2735<https://crosswalk-project.org/jira/browse/XWALK-2735>Fail to dispose the border element of css style on Android W3C_HTML5 APIs/DOM, Forms and Styles/CSS Multi-column Layout Module (Partial) 159 □□□□□□□□□97% □□□□□□□□□97% +15% -2% -- XWALK-2735<https://crosswalk-project.org/jira/browse/XWALK-2735> Fail to dispose the border element of css style on Android W3C_HTML5 APIs/DOM, Forms and Styles/CSS Text Module Level 3 (Partial) 46 □□□□□□□□□98% □□□□□□□□□98% +6% +1% -- XWALK-2623<https://crosswalk-project.org/jira/browse/XWALK-2623> Failed to get correct value of "hyphens" when invoking the "GetCurrentStyle()" method which contains in the "W3C/Text" component on Android OS W3C_HTML5 APIs/DOM, Forms and Styles/CSS Transforms 78 □□□□□□□□85% □□□□□□□□85% N/A -15% -- XWALK-2639<https://crosswalk-project.org/jira/i#browse/XWALK-2639> Got the different test result depends on the scale of web page W3C_HTML5 APIs/DOM, Forms and Styles/CSS Transitions Module Level 3 (Partial) 45 □□□□□□□□82% □□□□□□□□80% -18% +9% -- XWALK-3006<https://crosswalk-project.org/jira/browse/XWALK-3006> Fail to get the correct calculated value of ‘transition-timing-function: ease’ when using window.getComputedStyle() method W3C_HTML5 APIs/DOM, Forms and Styles/HTML5 Forms (Partial) 147 □□□□□□□□□□100% □□□□□□□□□□100% +100% +27% -- W3C_HTML5 APIs/DOM, Forms and Styles/HTML5 telephone, email and URL state of input element 31 □□□□□□□□□□100% □□□□□□□□□□100% -- -- -- W3C_HTML5 APIs/DOM, Forms and Styles/DOM/JavaScript related HTML5 Enhancements 49 □□□□□□□□□□100% □□□□□□□□□□100% +19% +11% -- W3C_HTML5 APIs/DOM, Forms and Styles/Media Queries (Partial) 52 □□□□□□□□□□100% □□□□□□□□□□100% -- -- -- W3C_HTML5 APIs/DOM, Forms and Styles/Selectors API Level 1 72 □□□□□□□□□□100% □□□□□□□□□□100% -- +3% -- W3C_HTML5 APIs/DOM, Forms and Styles/Selectors API Level 2 (Partial) 85 □□□□41% □□□□41% +17% -26% -- Failure reason is same as Chrome W3C_HTML5 APIs/Graphics/HTML Canvas 2D Context (Partial) 866 □□□□□□□□□98% □□□□□□□□□98% +6% +1% -- XWALK-2121<https://crosswalk-project.org/jira/browse/XWALK-2121> Fail to throw DOMException "INDEX_SIZE_ERR" after invoking g.addColorStop(Infinity,'#000') when running “WebAPI/Canvas” on Android OS XWALK-3630<https://crosswalk-project.org/jira/i#browse/XWALK-3630>[REG] Crosswalk does not throw a typeError when call "New" as window.ImageData's constructor XWALK-2735<https://crosswalk-project.org/jira/browse/XWALK-2735> Fail to dispose the border element of css style on Android XWALK-3578<https://crosswalk-project.org/jira/i#browse/XWALK-3578> Fail to throw an INDEX_SIZE_ERR exception when offset parameter is out of allowed value range W3C_HTML5 APIs/Graphics/HTML5 SVG 12 □□□□□50% □□□□45% -50% -42% -- XWALK-2735<https://crosswalk-project.org/jira/browse/XWALK-2735> Fail to dispose the border element of css style on Android XWALK-2639<https://crosswalk-project.org/jira/i#browse/XWALK-2639> Got the different test result depends on the scale of web page W3C_HTML5 APIs/HTML5 Application caches 36 □□□□□□□□□□100% □□□□□□□□□□100% +4% -- -- W3C_HTML5 APIs/Location/Geolocation API Specification 217 □□□□□50% □□□□49% N/A -- -- Failure reason is same as Chrome W3C_HTML5 APIs/Media/getUserMedia (Partial) 26 □□□□□□65% □□□□□□□75% +58% +43% -- XWALK-2210<https://crosswalk-project.org/jira/browse/XWALK-2210> unable to get an unique value when invoking e.inputBuffer.getChannelData(0) several times on Android/WebAPI/getUsrMedia test W3C_HTML5 APIs/Media/HTML Media Capture 5 □□□□□□□□80% □□□□□□□□□□100% +20% -20% -- XWALK-2902<https://crosswalk-project.org/jira/browse/XWALK-2902>Fatal Exception occurred when invoking DOM Object.dispatchEvent on Android OS(Device limitation, won’t fix) W3C_HTML5 APIs/Media/HTML5 The audio element (Partial) 349 □□□□□□□76% □□□□□□□76% -3% +21% -- XWALK-1831<https://crosswalk-project.org/jira/i#browse/XWALK-1831> [REG]The audio.controller attribute does not exist when running "WebAPI/Audio" on Android OS XWALK-2201<https://crosswalk-project.org/jira/browse/XWALK-2201> Fail to get same test result between local mode and web service mode for Android/WebAPI/Audio/Video test XWALK-2906<https://crosswalk-project.org/jira/browse/XWALK-2906>Fail to set media.muted value when testing Audio/Video element XWALK-2953<https://crosswalk-project.org/jira/browse/XWALK-2953> Fail to set media.currentTime value when testing Audio/Video element XWALK-3106<https://crosswalk-project.org/jira/browse/XWALK-3106> The expected test purpose what is incorrect in tct-audio-html5-tests W3C_HTML5 APIs/Media/HTML5 The video element (Partial) 390 □□□□□□□78% □□□□□□□78% +1% +7% -- XWALK-1832<https://crosswalk-project.org/jira/i#browse/XWALK-1832> [REG]The video.controller attribute does not exist when running “WebAPI/Video” on Android OS XWALK-2201<https://crosswalk-project.org/jira/browse/XWALK-2201> Fail to get same test result between local mode and web service mode for Android/WebAPI/Audio/Video test XWALK-2906<https://crosswalk-project.org/jira/browse/XWALK-2906>Fail to set media.muted value when testing Audio/Video element XWALK-2953<https://crosswalk-project.org/jira/browse/XWALK-2953> Fail to set media.currentTime value when testing Audio/Video element XWALK-2960<https://crosswalk-project.org/jira/browse/XWALK-2960> Fail to get 'videoheight'and 'videowidth' value when loading a video media resource XWALK-3107<https://crosswalk-project.org/jira/browse/XWALK-3107> The expected test purpose what is incorrect in tct-video-html5-tests W3C_HTML5 APIs/Media/Web Audio API (Partial) 389 □□□□□□□□87% □□□□□□□□87% +87% -- -- XWALK-3242<https://crosswalk-project.org/jira/browse/XWALK-3242> [REG] Fail to get correct panningModel default value when testing tct-webaudio-w3c-tests on Android W3C_HTML5 APIs/Media/Web Speech API 221 □□□□□□□76% □□□□□□□76% N/A N/A -- XWALK-3732<https://crosswalk-project.org/jira/browse/XWALK-3732> The serviceURI attribute does not exist in SpeechRecognition interface XWALK-3745<https://crosswalk-project.org/jira/i#browse/XWALK-3745> The addFromURI method does not exist in SpeechGrammarList interface Speech Synthesis partly implement(XWALK-1105<https://crosswalk-project.org/jira/browse/XWALK-1105>) W3C_HTML5 APIs/Performance and Optimization/High Resolution Time 7 □□□□□□□□□□100% □□□□□□□□□□100% +100% +14% -- W3C_HTML5 APIs/Performance and Optimization/Navigation Timing 45 □□□□□□□□□□100% □□□□□□□□□□100% +60% -- -- W3C_HTML5 APIs/Performance and Optimization/Page Visibility 20 □□□□□□□□□□100% □□□□□□□□□□100% +75% +3% -- W3C_HTML5 APIs/Performance and Optimization/Performance Timeline 20 □□□□□□□□□□100% □□□□□□□□□□100% N/A +5% -- W3C_HTML5 APIs/Performance and Optimization/Resource Timing 70 □□□□□□66% □□□□□□66% +66% -20% -- XWALK-3546<https://crosswalk-project.org/jira/i#browse/XWALK-3546> CLONE - Fail to get correct PerformanceEntry.initiatorType value after loading the test resource on Android W3C_HTML5 APIs/Performance and Optimization/Timing control for script-based animations 18 □□□□□□□□□□100% □□□□□□□□□□100% N/A -- -- W3C_HTML5 APIs/Performance and Optimization/User Timing 22 □□□□□□□□□95% □□□□□□□□□95% N/A -4% -- XWALK-999<https://crosswalk-project.org/jira/browse/XWALK-999> The properties mark/clearMarks/measure/clearMeasures of Performance interface are not configurable when running “WebAPI/usertiming” component on Android OS W3C_HTML5 APIs/Performance and Optimization/Web Workers (Partial) 86 □□□□□□63% □□□□□□63% +63% +1% -- Failure reason is same as Chrome W3C_HTML5 APIs/Security/Content Security Policy 1.0 (Partial) 267 □□□□□□□□88% □□□□□□□□88% +43% +12% -- XWALK-501<https://crosswalk-project.org/jira/browse/XWALK-501> The two lines of strings "1234 ABCD" are different in font when running tct-csp-w3c-tests on Android OS XWALK-2767<https://crosswalk-project.org/jira/browse/XWALK-2767> Fails to obtain/apply CanvasTest.ttf font-face from server client when running the "tct-csp-w3c-tests" on Android XWALK-2735<https://crosswalk-project.org/jira/browse/XWALK-2735> Fail to dispose the border element of css style on Android W3C_HTML5 APIs/Security/Cross-Origin Resource Sharing 10 □□□□□□□□□□100% □□□□□□□□□□100% +40% +10% -- W3C_HTML5 APIs/Security/HTML5 The iframe element 59 □□□□□□□□□92% □□□□□□□□□92% +16% -2% -- XWALK-4017<https://crosswalk-project.org/jira/i#browse/XWALK-4017>[REG] Fail to get expect iframe.sandbox attribute value when running "tct-sandbox-html5-tests". W3C_HTML5 APIs/Storage/File API 122 □□□□□□□□89% □□□□□□□□□□100% +23% +3% -- XWALK-2902<https://crosswalk-project.org/jira/browse/XWALK-2902>Fatal Exception occurred when invoking DOM Object.dispatchEvent on Android OS(Device limitation, won’t fix) W3C_HTML5 APIs/Storage/File API: Directories and System 203 4% 4% +4% -95% -- XWALK-837<https://crosswalk-project.org/jira/browse/XWALK-837> Security Error occurs when calling requestFilesystem method on Android OS W3C_HTML5 APIs/Storage/File API: Writer (Partial) 48 □□□□44% □□□□44% +34% -4% -- XWALK-837<https://crosswalk-project.org/jira/browse/XWALK-837> Security Error occurs when calling requestFilesystem method on Android OS XWALK-3279<https://crosswalk-project.org/jira/browse/XWALK-3279> App crash occurred (Fatal signal 4) when running the 'tct-filewriterapi-w3c-tests' on Android W3C_HTML5 APIs/Storage/Indexed Database API (Partial) 392 □□□□□□□□□□100% □□□□□□□□□□100% +100% -- -- XWALK-3067<https://crosswalk-project.org/jira/browse/XWALK-3067> Fail to throws an NotSupportedError exception when invoking IDBObjectStore.createIndex() method W3C_HTML5 APIs/Storage/Web SQL Database 148 □□□□□□□□87% □□□□□□□□87% +81% +30% -- XWALK-2768<https://crosswalk-project.org/jira/browse/XWALK-2768> [REG] openDatabaseSync() got undefined when invoking WorkerUtilsDatabase W3C_HTML5 APIs/Storage/Web Storage 192 □□□□□□□□□96% □□□□□□□□□96% +31% -- -- XWALK-4036<https://crosswalk-project.org/jira/i#browse/XWALK-4036> [REG] Missing oldValue/key/url/newValue/storageArea attributes in StorageEvent object on crosswalk embedded mode W3C_HTML5 APIs/System Apps/App URI 7 □□□□□□□□86% □□□□□□□□86% +86% N/A -- XWALK-1941<https://crosswalk-project.org/jira/browse/XWALK-1941> Fail to get correct value of window.location.pathname when running “WebAPI/appuri” on Android W3C_HTML5 APIs/System Apps/Contacts Manager 144 □□□□□□□□□94% □□□□□□□□□94% +94% +94% -- XWALK-1716<https://crosswalk-project.org/jira/browse/XWALK-1716> Contact.phoneNumbers is undefined when running “WebAPI/contactsmanager” on Android OS XWALK-2947<https://crosswalk-project.org/jira/browse/XWALK-2947> Fails to get correct type of Contact.id when invoking find method of Contact Interface on Android OS XWALK-2946<https://crosswalk-project.org/jira/browse/XWALK-2946> Fails to trigger the callbacks when invoking "ContactsManager.remove" method on Android OS XWALK-2453<https://crosswalk-project.org/jira/browse/XWALK-2453> fails to get the correct time value which is setted in Contact birthday data unit when running "WebAPI/contactsmanager" on Android OS W3C_HTML5 APIs/System Apps/Device Capabilities 84 □□□□□□□□□94% □□□□□□□□□□100% +94% +94% -- XWALK-2667<https://crosswalk-project.org/jira/browse/XWALK-2667> Fail to get correct status of DeviceCapabilities.onstorageattach/onstoragedetach event when attach and detach SD card on 'Asus Memo Pad8' device W3C_HTML5 APIs/System Apps/Gamepad 3 □□□□□□□□□□100% □□□□□□□□□□100% N/A -- -- W3C_HTML5 APIs/System Apps/Messaging 172 □□20% □□20% +20% +12% -- XWALK-2140<https://crosswalk-project.org/jira/browse/XWALK-2140> [REG]Target origin is ' ' when executing 'postMessage' on 'Window' for Android/WebAPI/messaging Message/Telephone don’t support on Asus Memo Pad8, tested on ZTE Geek phone XWALK-2938<https://crosswalk-project.org/jira/browse/XWALK-2938> [REG] Fail to retrieve the messages when invoking findMessages method XWALK-2940<https://crosswalk-project.org/jira/browse/XWALK-2940> [REG] Fail to retrieve the messages when invoking getMessage method XWALK-862<https://crosswalk-project.org/jira/browse/XWALK-862> [WebAPI/Messaging]All properties and methods are not implemented on MmsManager W3C_HTML5 APIs/System Apps/Raw Sockets 90 □□□□□□□□88% □□□□□□□□88% +88% +88% -- XWALK-1728<https://crosswalk-project.org/jira/browse/XWALK-1728> TCPSocket.noDelay attribute cannot be set to false when running “WebAPI/rawsockets” on Android OS XWALK-2408<https://crosswalk-project.org/jira/browse/XWALK-2408> Fail to throw InvalidAccessError DOM exception when running "WebAPI/rawsockets" on Android OS XWALK-2414<https://crosswalk-project.org/jira/browse/XWALK-2414> Fail to set addressReuse value by the options argument in TCPServerSocket constructor when running "WebAPI/rawsockets" on Android OS XWALK-2420<https://crosswalk-project.org/jira/browse/XWALK-2420> TCPSocket fail to throw a InvalidStateError DOM Exception by send data after calling close/halfclose method when running "WebAPI/rawsockets" on Android OS XWALK-3484<https://crosswalk-project.org/jira/i#browse/XWALK-3484> TCPSocket.send() method send content with Blob or ArrayBuffer or ArrayBufferView type failed. XWALK-3485<https://crosswalk-project.org/jira/i#browse/XWALK-3485> The TCPSocket.onerror event can not be fired. W3C_HTML5 APIs/UI/HTML5 Drag and drop (Partial) 6 □□□□□□□□□□100% □□□□□□□□□□100% +17% -- -- W3C_HTML5 APIs/UI/Web Notifications (Partial) 17 □□□□□□□□□□100% □□□□□□□□□□100% +100% +71% -- W3C_HTML5 APIs/W3C_EXTRAHTML5 646 □□□□□□□□□99% □□□□□□□□□99% +99% +9% -- XWALK-1724<https://crosswalk-project.org/jira/browse/XWALK-1724> The window.external attribute does not exist when running “WebAPI/extra” on Android OS XWALK-1891<https://crosswalk-project.org/jira/browse/XWALK-1891> Datetime type does not support on input element when using string value to check input type="datetime" on Android Got improvement due to some tests got passed after rebased to M43 Crosswalk Embedding APIs Testing Details Component Total TCs Android Comments 14.43.342.0 (Embedded Mode) 14.43.342.0 (Shared Mode) Diff W/ 14.43.338.0 Embedding APIs 195 □□□□□□□□□96% □□□□□□□□□96% +3% XWALK-3508<https://crosswalk-project.org/jira/i#browse/XWALK-3508> The onLoadStarted method can't be called when load a local html file XWALK-3564<https://crosswalk-project.org/jira/i#browse/XWALK-3564> onPageLoadStopped can't be triggered when load a page using iframe.contentDocument.write. XWALK-3889<https://crosswalk-project.org/jira/i#browse/XWALK-3889> Fail to exit fullscreen when invoking the 'leaveFullScreen' method of embeddingAPI on Android XWALK-3964<https://crosswalk-project.org/jira/i#browse/XWALK-3964>Fails to trigger onReceivedTitle Callback after Navigation back on Android XWALK-3863<https://crosswalk-project.org/jira/i#browse/XWALK-3863> M42/M43 testOnRequestFocus test broken Got improvement due to XWALK-2754<https://crosswalk-project.org/jira/browse/XWALK-2754> fixed after update tests with ‘_blank’ Crosswalk Use Cases Testing Details Component Total TCs Android Comments 14.43.342.0 Diff W/ 14.43.338.0 WRT 32 □□□□□□□□84% -- XWALK-3330<https://crosswalk-project.org/jira/browse/XWALK-3330>Crosswalk sets input type date in US format even if the locale is FR XWALK-3108<https://crosswalk-project.org/jira/browse/XWALK-3108> E/chromium:[ERROR:runtime_javascript_dialog_manager.cc(64)] Not implemented reached in virtual void xwalk::RuntimeJavaScriptDialogManager::CancelActiveAndPendingDialogs(content::WebContents*) XWALK-3594<https://crosswalk-project.org/jira/browse/XWALK-3594> WIN DEATH when press "back" key from chrome://gpu link Got downgrade due to: XWALK-3593<https://crosswalk-project.org/jira/browse/XWALK-3593> Blue screen when first launching app after downloading xwalk shared lib from url XWALK-4057<https://crosswalk-project.org/jira/browse/XWALK-4057> [REG] Video paused when switch between the fullscreen and normal mode Web APIs 69 □□□□□□□□83% +2% XWALK-1457<https://crosswalk-project.org/jira/browse/XWALK-1457> No selection list displayed in the input when running “Usecase/Input” on Android OS XWALK-1693<https://crosswalk-project.org/jira/browse/XWALK-1693> Fail to get correct value of “connection status” when running “Usecase/BrowserState” on Android OS XWALK-2663<https://crosswalk-project.org/jira/browse/XWALK-2663> The red background of flexbox div cannot be covered completely when running the "flexibleBox" component XWALK-2666<https://crosswalk-project.org/jira/browse/XWALK-2666> Fail to get correct type of devicemotion.acceleration.x/y/z and devicemotion.rotationRate.alpha when running the "W3C/Deviceorientation" on 'Asus Memo Pad8' device(device limitation,won’t fix) XWALK-2902<https://crosswalk-project.org/jira/browse/XWALK-2902>Fatal Exception occurred when invoking DOM Object.dispatchEvent on Android OS(particular device issue ,won't fix) Vibration doesn’t support on Asus Memo Pad8, tested on ZTE Geek phone XWALK-2988<https://crosswalk-project.org/jira/i#browse/XWALK-2988> [REG] Transparency does not take effect if its value changes from 0%(or 100%) to other value when multicolumn is enabled Speech Synthesis partly implement(XWALK-1105<https://crosswalk-project.org/jira/browse/XWALK-1105>) XWALK-3844<https://crosswalk-project.org/jira/i#browse/XWALK-3844> [Webdriver] webdriver does not get correct div picture on pad 8 device in usecase-webapi-xwalk-tests XWALK-3639<https://crosswalk-project.org/jira/i#browse/XWALK-3639>[webdriver] Button binding event not trigger when button is covered by virtual keyboard XWALK-4044<https://crosswalk-project.org/jira/browse/XWALK-4044>[REG] Method pushState of Session history need two arguments in "Usecase/SessionHistory Got improvement due to SIMD works fine(Fixed XWALK-4024<https://crosswalk-project.org/jira/browse/XWALK-4024>) Embedding APIs 18 □□□□□□□□83% -- XWALK-2012<https://crosswalk-project.org/jira/browse/XWALK-2012> Incorrect z-order when using multiple Android XWalk webviews (won’t fix) XWALK-3889<https://crosswalk-project.org/jira/browse/XWALK-3889> Fail to exit fullscreen when invoking the 'leaveFullScreen' method of embeddingAPI on Android XWALK-3897<https://crosswalk-project.org/jira/browse/XWALK-3897> Fail to load the external link when clicking the link with '_blank' target on Android Crosswalk Stability Testing Details Usage Check Points Target Result Comments Iterative Testing Suspend/Resume system while playing HTML5 video 50 times Pass Install/uninstall Web app 50 times Pass Launch/terminate one Web app 50 times Pass Switch between activated native and Web app 50 times Pass Switch between multiple Web apps 50 times Pass Tap control buttons (FF/FB, Play/Pause, volume etc) during playing audio 50 times Pass Tap control buttons (FF/FB, Play/Pause, fullscreen, etc) during playing video 50 times Pass Long-lasting Testing Play html5 audio 4hrs Pass Average CPU: 13% Average Memory: 65.1MB Play html5 video 4hrs Pass Average CPU: 42.5% Average Memory: 76.6MB Capture Video in Web app 1hr Fail XWALK-2902<https://crosswalk-project.org/jira/browse/XWALK-2902> Fatal Exception occurred when invoking DOM Object.dispatchEvent on Android OS(won’t fix) Run Games of 2D graphics 24hrs Pass Average CPU: 13% Average Memory: 85.6MB Run Games of 3D graphics 24hrs Fail XWALK-1289<https://crosswalk-project.org/jira/browse/XWALK-1289>Crosswalk consume more resources compare with Chrome when running 3D games for a long time Average CPU: 137% Average Memory: 257.9MB Overload Testing Launch a mass of Web apps till system force to terminate System memory not enough Pass Recovery Testing Pause/resume sample app after a long time 2hrs Pass Verified Issue: ----------------------- XWALK-4024<https://crosswalk-project.org/jira/browse/XWALK-4024> [REG] SIMD.js is unable on build which based on M43 XWALK-3219<https://crosswalk-project.org/jira/browse/XWALK-3219> Fail to pack webapp by using crosswalk-11.40.*.* (embedded mode) when install SDK api levels lower than android-21 XWALK-3821<https://crosswalk-project.org/jira/browse/XWALK-3821>-disk-cache-size command line switch has no effect XWALK-2754<https://crosswalk-project.org/jira/browse/XWALK-2754>onCreateWindowRequested is not fired when window is opened Crosswalk Image Location Crosswalk for Android: 14.43.342.0 (https://download.01.org/crosswalk/releases/crosswalk/android/canary/14.43.342.0/crosswalk-14.43.342.0.zip) Crosswalk WebView: 14.43.342.0 (https://download.01.org/crosswalk/releases/crosswalk/android/canary/14.43.342.0/x86/crosswalk-webview-14.43.342.0-x86.zip) Github Test Suite Links https://github.com/crosswalk-project/crosswalk-test-suite/ Operating System Android Image version:4.2/4.4 Test Environment ----------------------- l Crosswalk Android: o IA Tablet (Baytrail T): Asus Memo Pad8 o IA Phone: ZTE Geek o ARM Device: Nexus 5 Thanks Crosswalk QA --------------------------------------------------------------------- Intel Finland Oy Registered Address: PL 281, 00181 Helsinki Business Identity Code: 0357606 - 4 Domiciled in Helsinki This e-mail and any attachments may contain confidential material for the sole use of the intended recipient(s). Any review or distribution by others is strictly prohibited. If you are not the intended recipient, please contact the sender and delete all copies. _______________________________________________ Crosswalk-dev mailing list [email protected] https://lists.crosswalk-project.org/mailman/listinfo/crosswalk-dev
