Hi all,
This is test report for connman-1.3.1.gcebd23c-1.1.i586.
In this testing,we ran 84 cases. 78 cases passed and 5 cases failed
because of known/new bugs. The pass rate is 93%. We found 1 new bug,
reopen 0 bug and verify 1 bug. In this commit we found the bug that
HuaWei EC156 does not work on ConnMan also exists.
New bug
===============================================
25442 - Connman fail to surf internet through 3G after resume from s3
https://bugs.meego.com/show_bug.cgi?id=25442
Re-open bugs:
===============================================
N/A
Verified bugs:
===============================================
25304 - Can not get correct time form ntp server after set wrong time
https://bugs.meego.com/show_bug.cgi?id=25304
reproduced bugs:
===============================================
24431 - Fail to auto-connect to 3g service when resume from offlinemode
https://bugs.meego.com/show_bug.cgi?id=24431
24586 - CDMA2000 does not work in latest connman upstream
https://bugs.meego.com/show_bug.cgi?id=24586
24842 - HuaWei EC156 does not work on connman
https://bugs.meego.com/show_bug.cgi?id=24842
25112 - Fail to autoconnect to 3G service after reboot
https://bugs.meego.com/show_bug.cgi?id=25112
25128 - State of vpn service is still 'ready' after disconnect lower lever
network
https://bugs.meego.com/show_bug.cgi?id=25128
25244 - iw doesn't show the country code
https://bugs.meego.com/show_bug.cgi?id=25244
===============================================
Testing Environment
==============================================
Hardware: netbook Eeepc 1005PE / Cedar Trail / Ocktrail Green Ridge
Image: meego-netbook-ia32-1.2.0 / netbook-ia32-pinetrail-tizen_20120424.2
ConnMan: connman-1.3.1.gcebd23c-1.1.i586
wpa_supplicant: wpa_supplicant-0.7.3-1.6.i586
Ofono: ofono-1.8.7.g86b6991-1.1.i586
bluez: bluez-4.87-1.12.i586
3G: Unicom Sim card/ZTE MF190/HuaWei EC156
BT: Palm Pre/AnyCom AP/CSR dongle (disable the onboard BT device)
Wireless AP: netgear WNR2000/dlink
Test Execution Summary
==============================================
Category Total PASS FAIL N/A Comments
WiFi 12 12
bt 6 6
3G 20 16 3 1 24431 25112 25442 Block by #24586
Ethernet 16 15
Regulatory 1 1 25244
NTP 1 1
Openvpn 7 6 1 25128
surfing 3 3
proxy 8 8
tethering 10 10
Total 84 78 5 1
Bug referred here is bug at bugs.meego.com, for example, bug #23110 refer to
http://bugs.meego.com/show_bug.cgi?id=23110
For detailed test results, please see attached files
ConnMan Test Report List
Date:2012-7-6
---Ethernet---
CM_Eth_BigBroadcastPing PASS
CM_Eth_Conn PASS
CM_Eth_SmallBroadcastPing PASS
CM_Eth_Disconnect PASS
CM_Eth_Hotplug PASS
CM_Eth_HasIP PASS
CM_Eth_Connect PASS
CM_Advance_StaticIP_Wired PASS
CM_Advance_StaticIP PASS
CM_Eth_Upload PASS
CM_Eth_Download PASS
CM_Flt_eth_autoconn PASS
CM_Flt_EthNoPing PASS
CM_Flt_EthOnline PASS
CM_IPv6_LocalLinkBroadcast PASS
CM_IPv6_eth_ssh PASS
Total:16 Pass:16 Fail:0 N/A:0
---WiFi---
CM_WF_wps_pin PASS
CM_WF_wps_pbc PASS
CM_WS_WEP_Upload PASS
CM_WS_WEP_Download PASS
CM_WS_PSK2 PASS
CM_WS_RSN PASS
CM_WS_WEP64 PASS
CM_WS_SharedHiddenWEP128 PASS
CM_WS_WPA PASS
CM_WS_OpenBroadcastWEP40 PASS
CM_WS_WEP128 PASS
CM_WS_Open PASS
Total:12 Pass:12 Fail:0 N/A:0
---Bluetooth---
CM_BT_Connect PASS
CM_BT_SmallPing PASS
CM_BT_BigPing PASS
CM_BT_IsReEnableWorks PASS
CM_BT_Connect_PAN PASS
CM_Advance_StaticIP_BT PASS
Total:6 Pass:6 Fail:0 N/A:0
---Regulatory---
CM_Advance_Regulatory FAIL #25244
Total:1 Pass:0 Fail:1 N/A:0
---NTP---
CM_Advance_NTP PASS
Total:1 Pass:1 Fail:0 N/A:0
---3G---
CM_Advance_3G_WiFi_Handover PASS
CM_Flt_Conn3G FAIL #24431
CM_AutoConn_Reboot3G FAIL #25112
CM_AutoConn_SuspendMem3G FAIL #25442
CM_3G_Reconnect PASS
CM_3G_Replug PASS
CM_3G_PoweredOn PASS
CM_3G_DeviceIsExist PASS
CM_3G_HasIP PASS
CM_3G_HasFixedIP PASS
CM_3G_Coexist_Priority PASS
CM_3G_Disconnect PASS
CM_3G_BigPing PASS
CM_3G_PlugInEnabled PASS
CM_3G_CDMA2000 Block Block by #24586
CM_3G_Upload PASS
CM_3G_DeviceControl PASS
CM_3G_Download PASS
CM_3G_IsReady PASS
CM_3G_PPP PASS
Total:20 Pass:16 Fail:3 N/A:1
---OpenVPN---
CM_VPN_OpenVPN_Transfer PASS
CM_VPN_OpenVPN_Disconnect PASS
CM_VPN_OpenVPN_Ping PASS
CM_VPN_OpenVPN_Disconnect_lower Fail #25128
CM_VPN_OpenVPN_Reconnect PASS
CM_VPN_OpenVPN_Connect PASS
CM_VPN_OpenVPN_List PASS
Total:7 Pass:6 Fail:1 N/A:0
---Internet surfing---
CM_Advance_http_proxy PASS
CM_Advance_web_proxy PASS
CM_PR_broswer_internet PASS
Total:3 Pass:3 Fail:0 N/A:0
---Proxy---
CM_PR_intranet_direct_eth PASS
CM_PR_broswer_intranet PASS
CM_Advance_Proxy PASS
CM_Launch_reg PASS
CM_PR_intranet_proxy PASS
CM_PR_intranet_direct_eth PASS
CM_PR_intranet_wpad_url PASS
CM_PR_intranet_eth PASS
Total:8 Pass:8 Fail:0 N/A:0
---Tethering---
CM_Tethering_server_suspend PASS
CM_Tethering_BT_connection PASS
CM_Tethering_ping_clients PASS
CM_Tethering_surfing PASS
CM_Tethering_disabled PASS
CM_Tethering_multiple_connection PASS
CM_Tethering_wifi_connection PASS
CM_Tethering_ssh PASS
CM_Tethering_scp PASS
CM_Tethering_client_suspend PASS
Total:10 Pass:10 Fail:0 N/A:0
----------------------------------------------------
Total:84 Pass:78 Fail:5 N/A:1
PassRate of executed: 93%
FEAGroup Feature Score Comments
------------------------------------------------------------------------------
WiFI
EAP Good
Wpa-suplicant D-BUS Good
Manual switch connect Good
connect to Broadcast AP Good
connect to Hidden AP Good
Hidden Group AP Good
WPS Good
VPN
- - Not Test
OpenVPN
connect Buddy Bug 25128
ping Good
AutoConnect
reboot Buddy Bug 25112
offline Buddy Bug 24431
suspend Buddy Bug 25442
Advance
DNS Proxy Good
Proxy Good
NTP Good
regulatory Good
handover Good
Tethering
WiFi tethering Good
bluetooth tethering Good
usb tethering -
BT
Scan Good
Pair Good
Connect Good
Ethernet
connect Good
datatransfer Good
3G
PPP Good
3G Good
Datatransfer Good
CDMA2000 _ - Not ready
_______________________________________________
connman mailing list
[email protected]
http://lists.connman.net/listinfo/connman
