Quality Summary ------------------------------------------- QA complete the Crosswalk App Tools Testing based on Crosswalk-15.43.347.0. Good to see AppTools initially support for Linux now. 6 major issues got fixed and verified: 3 for iOS (XWALK-4104<https://crosswalk-project.org/jira/browse/XWALK-4104> Fixed,XWALK-3982<https://crosswalk-project.org/jira/browse/XWALK-3982> Fixed, XWALK-4048<https://crosswalk-project.org/jira/browse/XWALK-4048> Fixed), 3 for Android (XWALK-4088<https://crosswalk-project.org/jira/browse/XWALK-4088>, XWALK-4054<https://crosswalk-project.org/jira/browse/XWALK-4054>, XWALK-4053<https://crosswalk-project.org/jira/browse/XWALK-4053> Fixed). Totally 13 bugs got fixed and verified on this build. The overall test results: Test Scope
Android Linux iOS Comments Total TCs Pass Rate Total TCs Pass Rate Total TCs Pass Rate Crosswalk App Tools/CLI 43 91% 22 91% 25 96% Bugs on Android: XWALK-3779<https://crosswalk-project.org/jira/browse/XWALK-3779>, XWALK-3782<https://crosswalk-project.org/jira/browse/XWALK-3782>, XWALK-4056<https://crosswalk-project.org/jira/browse/XWALK-4056> Bugs on Linux: XWALK-4013<https://crosswalk-project.org/jira/browse/XWALK-4013>, XWALK-4129<https://crosswalk-project.org/jira/browse/XWALK-4129> Bugs on iOS: XWALK-4152<https://crosswalk-project.org/jira/browse/XWALK-4152> Crosswalk App Tools/Common Module 53 100% 27 100% 27 100% Got good quality Total 96 96% 49 96% 52 98% New Issues: - XWALK-4201<https://crosswalk-project.org/jira/browse/XWALK-4201> [app-tools] Log files are missing information for iOS - XWALK-4199<https://crosswalk-project.org/jira/browse/XWALK-4199> [app-tools] Log files are missing information for Deepin backend - XWALK-4129<https://crosswalk-project.org/jira/browse/XWALK-4129> Incorrect help info is displayed on linux platform - XWALK-4056<https://crosswalk-project.org/jira/browse/XWALK-4056> Duplicate to place download files when setup CROSSWALK_APP_TOOLS_CACHE_DIR - XWALK-4038<https://crosswalk-project.org/jira/browse/XWALK-4038> [app-tools] Location issues about test/main.js - XWALK-4013<https://crosswalk-project.org/jira/browse/XWALK-4013> Project folder should not be created if "create" command fails Command-line Interface Details: Component Android(ARM) Android(x86) Linux(Deepin) iOS Comments Total TCs Pass Rate Total TCs Pass Rate Total TCs Pass Rate Total TCs Pass Rate Build Project 5 20% 5 20% 1 100% 5 100% Android: XWALK-3779<https://crosswalk-project.org/jira/browse/XWALK-3779> Should not build an arm app successfully when the libxwalkcore.so for ARM is missing Android: XWALK-3782<https://crosswalk-project.org/jira/browse/XWALK-3782> Fail to install the app which is built with release option Android: XWALK-4056<https://crosswalk-project.org/jira/browse/XWALK-4056> Duplicate to place download files when setup CROSSWALK_APP_TOOLS_CACHE_DIR Create Project 25 100% 25 100% 19 95% 18 100% Linux: XWALK-4013<https://crosswalk-project.org/jira/browse/XWALK-4013> Project folder should not be created if "create" command fails Help Info 1 100% 1 100% 1 0% 1 0% Linux: XWALK-4129<https://crosswalk-project.org/jira/browse/XWALK-4129> Incorrect help info is displayed on linux platform iOS: XWALK-4152<https://crosswalk-project.org/jira/browse/XWALK-4152> Support specific help output for backends Update Project 11 100% 11 100% N/A N/A N/A N/A Version Info 1 100% 1 100% 1 100% 1 100% Common Module Details: Component Total TCs Android(ARM) Android(x86) Linux(Deepin) iOS Comments Android Platform 3 100% 100% N/A N/A Android Project Deps 2 100% 100% N/A N/A Android SDK 3 100% 100% N/A N/A Android Targets 3 100% 100% N/A N/A Application 7 100% 100% 100% 100% Command Parser 5 100% 100% N/A N/A Downloader 4 100% 100% N/A N/A Finite Progress 1 100% 100% 100% 100% Infinite Progress 1 100% 100% 100% 100% Log File Output 5 100% 100% 100% 100% Main 6 100% 100% N/A N/A Output Tee 6 100% 100% 100% 100% Platform Base 2 100% 100% 100% 100% Template File 2 100% 100% 100% 100% Test Util 3 100% 100% 100% 100% Verified Issues: ----------------------- XWALK-4130<https://crosswalk-project.org/jira/browse/XWALK-4130> Incorrect help info is displayed on iOS platform XWALK-4104<https://crosswalk-project.org/jira/browse/XWALK-4104> [REG]Got the "Android SDK should not be found" error when creating a project on iOS XWALK-4089<https://crosswalk-project.org/jira/browse/XWALK-4089> Truncated error when directory exists XWALK-4088<https://crosswalk-project.org/jira/browse/XWALK-4088> [app-tools] Download 'beta' Crosswalk is not lastest version when create project with beta channel XWALK-4054<https://crosswalk-project.org/jira/browse/XWALK-4054> [app-tools] Incorrect output info when update crosswalk with channel or without arguments XWALK-4053<https://crosswalk-project.org/jira/browse/XWALK-4053> [app-tools] Fail to update Crosswalk to latest version in canary channel XWALK-4048<https://crosswalk-project.org/jira/browse/XWALK-4048> App Tools build exited abnormally on iOS platform XWALK-3982<https://crosswalk-project.org/jira/browse/XWALK-3982> Error occurs while building iOS project XWALK-3968<https://crosswalk-project.org/jira/browse/XWALK-3968> [REG] The return code is incorrect after creating project failed XWALK-3893<https://crosswalk-project.org/jira/browse/XWALK-3893> Empty contents when "open prj/ios/apptool.xcworkspace"/ XWALK-3826<https://crosswalk-project.org/jira/browse/XWALK-3826> The package id style should not only for Android XWALK-3781<https://crosswalk-project.org/jira/browse/XWALK-3781> Useless cli "crosswalk-app" usage prompt for .deb packages on linux desktop XWALK-3734<https://crosswalk-project.org/jira/browse/XWALK-3734> More limitations needed in package name when create apps Crosswalk-app-tools Repositories: ----------------------- https://github.com/crosswalk-project/crosswalk-app-tools Release Tag or Commit ID: b5460441d2938003f84d3be63c4fb16d4533f5d7 Debian Backend: https://github.com/crosswalk-project/crosswalk-app-tools-deb Release Tag or Commit ID: b267a46aef6511c84e854113b02dd60d2f9cf677 iOS Backend: https://github.com/crosswalk-project/crosswalk-app-tools-ios Release Tag or Commit ID: f274c95f3eedd4348e74b5beda1ecb48fdcbc818 Test Suite Repositories: ----------------------- Command-line Interface: https://github.com/crosswalk-project/crosswalk-test-suite/tree/master/apptools/apptools-android-tests https://github.com/crosswalk-project/crosswalk-test-suite/tree/master/apptools/apptools-ios-tests Common module: https://github.com/crosswalk-project/crosswalk-app-tools/tree/master/test Crosswalk Binary on Android: https://download.01.org/crosswalk/releases/crosswalk/android/canary/15.43.347.0/crosswalk-15.43.347.0.zip Detailed Test Report: Android(ARM): http://wrt-qa-report.sh.intel.com/v2/Android/ARM%20Canary/Crosswalk%20App%20Tools/9180 Android(x86): http://wrt-qa-report.sh.intel.com/v2/Android/IA%20Canary/Crosswalk%20App%20Tools/9179 Linux: http://wrt-qa-report.sh.intel.com/v2/Linux/IA%20Canary/Crosswalk%20App%20Tools/9181 iOS: http://wrt-qa-report.sh.intel.com/v2/iOS/IA%20Canary/Crosswalk%20App%20Tools/9178 Test Environment: ----------------------- Android host: Ivy Bridge Desktop, Ubuntu 14 Android device: Android IA 4.2.2 ZTE Geek, Memopad 8, Nexus 4 iOS host: MacBook Pro 10.10 with XCode 6.3 iOS device: iPad mini 8.2 Linux/Deepin desktop: Deepin 2014.2 (http://www.linuxdeepin.com/download.cn.html) x86_64 with Chinese Thanks, Crosswalk QA team
_______________________________________________ Crosswalk-dev mailing list [email protected] https://lists.crosswalk-project.org/mailman/listinfo/crosswalk-dev
