Hi all,
This is test report for connman-0.79.15.g8a9d36d-1.1.i586.
In this testing,we ran 258 cases. 250 cases passed and 8 cases
failed because of known/new bugs. The pass rate is 97%. We found 1 new bug,
reopen 0 bug and verify 3 bugs. In this commit we found the bug that
HuaWei EC156 does not work on ConnMan also exists.
New bugs
===============================================
25033 - Powered status of ethernet is wrong when restart connmand
https://bugs.meego.com/show_bug.cgi?id=25033
Re-open bugs:
===============================================
N/A
Verified bugs:
===============================================
20745 - Fail to re-connect to 3G network automatically when resume from S3
https://bugs.meego.com/show_bug.cgi?id=20745
23364 - Can't enable/disable 3g service manually after resume from s3
https://bugs.meego.com/show_bug.cgi?id=23364
24798 - Fail to surf internet on client when enable-tethering on MeeGo Box
https://bugs.meego.com/show_bug.cgi?id=24798
reproduced bugs:
===============================================
11860 - [REG]ConnMan does not autoconnect hidden wifi after reboot
https://bugs.meego.com/show_bug.cgi?id=11860
24372 - 3G service grab the default route
https://bugs.meego.com/show_bug.cgi?id=24372
24431 - Fail to auto-connect to 3g service when resume from offlinemode
https://bugs.meego.com/show_bug.cgi?id=24431
24586 - CDMA2000 does not work in latest connman upstream
https://bugs.meego.com/show_bug.cgi?id=24586
24842 - HuaWei EC156 does not work on connman
https://bugs.meego.com/show_bug.cgi?id=24842
24899 - Fail to enable wifi in the first time
https://bugs.meego.com/show_bug.cgi?id=24899
24902 - Fail to re-connect to bluetooth when disconnect
https://bugs.meego.com/show_bug.cgi?id=24902
24948 - Still see 3G service when disable cellular
https://bugs.meego.com/show_bug.cgi?id=24948
24994 - Connman fail to auto reconnect with AP when back to AP's signal
range
https://bugs.meego.com/show_bug.cgi?id=24994
===============================================
Testing Environment
==============================================
Hardware: netbook Eeepc 1005PE / Cedar Trail / Ocktrail Green Ridge
Image: meego-netbook-ia32-1.2.0 / tizen_20120302.1_netbook-ia32-pinetrail
ConnMan: connman-0.79.15.g8a9d36d-1.1.i586
wpa_supplicant:wpa_supplicant-0.7.3-2.1.i586
Ofono: ofono-1.5.9.g6b0880f-1.1.i586
bluez: bluez-4.97-3.1.i586
3G: Unicom Sim card/ZTE MF190/HuaWei EC156
BT: Palm Pre/AnyCom AP/CSR dongle (disable the onboard BT device)
Wireless AP: netgear WNR2000/dlink
Test Execution Summary
==============================================
Category Total PASS FAIL N/A Comments
WiFi 75 75
bt 15 14 1 24902
3G 23 23
Ethernet 15 15
Advance 35 34 1 24902
status 47 44 3 11860 24431 24948
API 38 38
Session 4 1 3 24957 25018
Openvpn 6 6
Total 258 250 8
Bug referred here is bug at bugs.meego.com, for example, bug #23110 refer
to http://bugs.meego.com/show_bug.cgi?id=23110
For detailed test results, please see attached files
ConnMan Test Report List
Date:2012-3-23
---Info---
CM_INFO_WiFiConnInfo PASS
CM_Info_EthConnInfo PASS
CM_Info_Sort_Default PASS
Total:3 Pass:3 Fail:0 N/A:0
---Dhcp---
CM_DHCP_Wried PASS
Total:1 Pass:1 Fail:0 N/A:0
---Advance---
CM_Advance_Proxy PASS
CM_Advance_MoveBefore PASS
CM_Advance_StaticIP_Reboot PASS
CM_Advance_StaticIP_WIFI PASS
CM_Advance_http_proxy PASS
CM_Advance_web_proxy PASS
CM_Advance_StaticIP_BT FAIL #24902
CM_Advance_StaticIP_Wired PASS
CM_Advance_NTP PASS
CM_Advance_DNS_Set PASS
CM_Advance_DNS_Positive PASS
CM_Advance_Regulatory PASS
Total:12 Pass:11 Fail:1 N/A:0
---Session---
CM_Session_Switch FAIL #24957
CM_Session_Enable PASS
CM_Session_Create FAIL #25018
CM_Session_Bearer FAIL #25018
Total:4 Pass:1 Fail:3 N/A:0
---Openvpn---
CM_VPN_OpenVPN_List PASS
CM_VPN_OpenVPN_Connect PASS
CM_VPN_OpenVPN_Disconnect PASS
CM_VPN_OpenVPN_Disconnect_lower PASS
CM_VPN_OpenVPN_Reconnect PASS
CM_VPN_OpenVPN_Ping PASS
Total:6 Pass:6 Fail:0 N/A:0
---Flight---
CM_Flt_eth_autoconn PASS
CM_Flt_ConnWired PASS
CM_FIT_3G_autoconn FAIL #24431
CM_FIT_WF_autoconn PASS
CM_Flt_WF_unset_rfkill PASS
CM_Flt_WF_rfkill PASS
CM_Flt_ConnWIFI PASS
CM_Flt_Conn3G FAIL #24431 24948
CM_Flt_WiFiIsPoweredOff PASS
CM_Flt_EthOnline PASS
CM_Flt_WiFiPoweredOff PASS
CM_Flt_EthPoweredOn PASS
CM_Flt_EthNoPing PASS
CM_Flt_Service PASS
CM_Flt_EthPoweredOff PASS
CM_Flt_WiFiNoPing PASS
CM_Flt_EthIsPoweredOff PASS
CM_Flt_WiFiPoweredOn PASS
CM_Flt_Online PASS
CM_Flt_WiFiOnline PASS
Total:20 Pass:18 Fail:2 N/A:0
---Tethering---
CM_Tethering_disabled PASS
CM_Tethering_scp PASS
CM_Tethering_multiple_connection PASS
CM_Tethering_server_suspend PASS
CM_Tethering_ping_clients PASS
CM_Tethering_ssh PASS
CM_Tethering_connection PASS
CM_Tethering_client_suspend PASS
CM_Tethering_wifi_connection PASS
CM_Tethering_surfing PASS
Total:10 Pass:10 Fail:0 N/A:0
---NetworkSel---
CM_NetworkSel_Best PASS
CM_NetworkSel_BroadcastNoSec PASS
CM_NetworkSel_HideWEP PASS
CM_NetworkSel_NoneToWPA PASS
CM_NetworkSel_HideNoSec PASS
CM_NetworkSel_BroadcastWEP PASS
CM_NetworkSel_HiddenWPAToNone PASS
CM_NetworkSel_HideWPA PASS
CM_NetworkSel_NoneToHiddenWEP PASS
CM_NetworkSel_WEPToNone PASS
CM_NetworkSel_HiddenWPAToWEP PASS
Total:11 Pass:11 Fail:0 N/A:0
---Signal---
CM_Signal_MoveWiFi PASS
CM_SS_AutoConnect PASS
CM_SC_ConnectedTechnologies PASS
CM_SC_Favorite PASS
CM_SC_IPv4 PASS
CM_SC_State PASS
CM_SM_State PASS
CM_SC_EnabledTechnologies PASS
CM_SM_ConnectedTechnologies PASS
CM_SS_Favorite PASS
CM_SC_Services PASS
CM_SC_DefaultTechnology PASS
CM_SS_IPv4 PASS
CM_SC_OfflineMode PASS
CM_SM_DefaultTechnology PASS
CM_SM_Services PASS
CM_SM_EnabledTechnologies PASS
CM_SC_Connected PASS
Total:18 Pass:18 Fail:0 N/A:0
---WiFi---
CM_WF_wps_pbc PASS
CM_WF_wps_pin PASS
CM_WF_Roaming_Broadcast PASS
CM_WF_CoExists_BT PASS
CM_WF_CoExists_3G PASS
CM_WF_CoExists_Wired PASS
CM_WG_HasDHCP PASS
CM_WG_IsReady PASS
CM_WG_IsPoweredOn PASS
CM_WG_IsReEnableWorks PASS
CM_WS_RSN_Upload PASS
CM_WG_PoweredOff PASS
CM_WG_HasIP PASS
CM_WG_Connect PASS
CM_WS_RSN_Download PASS
CM_WG_PoweredOn PASS
CM_WG_Disconnect PASS
CM_WS_Shared PASS
CM_WS_WEP_Upload PASS
CM_WG_BigBroadcastPing PASS
CM_WG_SmallBroadcastPing PASS
CM_WS_WEP_Download PASS
Total:22 Pass:22 Fail:0 N/A:0
---WiFiFeature---
CM_WA_ForgotPassword PASS
CM_WA_DetectSecurityWPA PASS
CM_WN_WEP64Wrong PASS
CM_WN_WEP64Short PASS
CM_WS_Hidden PASS
CM_WA_DetectSecurityWEP PASS
CM_WN_WEP64Long PASS
CM_WN_WEP128Short PASS
CM_WA_AutoConnectFromSuspend PASS
CM_WA_DetectSecurityRSN PASS
CM_WS_OpenBroadcastRSN PASS
CM_WA_DetectSecurityNone PASS
CM_WS_Open PASS
CM_WS_OpenHiddenTKIP PASS
CM_WS_PSK2 PASS
CM_WS_WEP128ascii PASS
CM_WS_OpenBroadcastTKIP PASS
CM_WS_RSN PASS
CM_WF_Channel6 PASS
CM_WF_Channel7 PASS
CM_WF_Channel4 PASS
CM_WF_Channel5 PASS
CM_WF_Channel2 PASS
CM_WF_Channel3 PASS
CM_WF_Channel8 PASS
CM_WF_Channel9 PASS
CM_WN_WEP128Long PASS
CM_WS_SharedHiddenWEP128 PASS
CM_WS_OpenBroadcastWEP128 PASS
CM_WS_PSK1 PASS
CM_WS_OpenHiddenWEP40 PASS
CM_WS_Broadcast PASS
CM_WN_WEP128Wrong PASS
CM_WA_RememberPasswd PASS
CM_WN_WEP128ascii PASS
CM_WS_OpenHiddenRSN PASS
CM_WS_OpenBroadcastWEP40 PASS
CM_WF_Channel10 PASS
CM_WF_Channel11 PASS
CM_WS_WPA PASS
CM_WS_OpenHiddenWEP128 PASS
CM_WS_WEP128 PASS
Total:42 Pass:42 Fail:0 N/A:0
---BT---
CM_BT_Connect_PAN PASS
CM_BT_Reconnect FAIL #24902
CM_BT_PoweredOff PASS
CM_BT_HasIP PASS
CM_BT_IsPoweredOn PASS
CM_BT_Disconnect PASS
CM_BT_Connect PASS
CM_BT_HasDHCP PASS
CM_BT_Download PASS
CM_BT_SmallPing PASS
CM_BT_Upload PASS
CM_BT_IsReady PASS
CM_BT_IsReEnableWorks PASS
CM_BT_BigPing PASS
CM_BT_PoweredOn PASS
Total:15 Pass:14 Fail:1 N/A:0
---State---
CM_State_WiFi_Available PASS
CM_State_Eth_Available PASS
CM_State_WIFI_IsolateAP PASS
CM_State_3G_Available PASS
Total:4 Pass:4 Fail:0 N/A:0
---AutoConn---
CM_AutoConn_FavoriteSetting PASS
CM_Autoconn_RememWPAPSKTKIP PASS
CM_AutoConn_RebootWIFI PASS
CM_AutoConn_SuspendMem3G PASS
CM_AutoConn_RememWEP64 PASS
CM_AutoConn_SuspendMemWired PASS
CM_AutoConn_LostConn PASS
CM_AutoConn_RebootWired PASS
CM_AutoConn_Reboot3G PASS
CM_Autoconn_HIDDEN_Rem FAIL #11860
CM_AutoConn_SuspendMemWIFI PASS
Total:11 Pass:10 Fail:1 N/A:0
---Pacrunner---
CM_PR_intranet_direct_wireless PASS
CM_PR_intranet_eth PASS
CM_PR_intranet_proxy PASS
Total:3 Pass:3 Fail:0 N/A:0
---IPv6---
CM_IPv6_eth_set_address PASS
CM_IPv6_ssh PASS
CM_IPv6_WF_set_address PASS
CM_IPv6_localhost PASS
CM_IPv6_LocalLink PASS
CM_IPv6_addr PASS
CM_IPv6_Ping PASS
CM_IPv6_kernel PASS
CM_IPv6_LocalLinkBroadcast PASS
Total:9 Pass:9 Fail:0 N/A:0
---Device---
CM_Device_WIFI_Reboot PASS
CM_Device_WIFI_Conn PASS
Total:2 Pass:2 Fail:0 N/A:0
---Ethernet---
CM_Eth_DNS_PROXY PASS
CM_Eth_Hotplug PASS
CM_Eth_SmallBroadcastPing PASS
CM_Eth_BigBroadcastPing PASS
CM_Eth_Disconnect PASS
CM_Eth_Download PASS
CM_Eth_HasDHCP PASS
CM_Eth_Connect PASS
CM_Eth_IsReEnableWorks PASS
CM_Eth_HasIP PASS
CM_Eth_IsPoweredOn PASS
CM_Eth_PoweredOn PASS
CM_Eth_Upload PASS
CM_Eth_IsReady PASS
CM_Eth_PoweredOff PASS
Total:15 Pass:15 Fail:0 N/A:0
---Launch---
CM_Launch_State_ethernet PASS
CM_Launch_State_WiFi PASS
CM_Launch_State_3G PASS
CM_Launch_State_bluetooth PASS
CM_Launch_OneConnmand PASS
CM_Launch_reg PASS
CM_Launch_State_offlinemode PASS
Total:7 Pass:7 Fail:0 N/A:0
---Property---
CM_PS_Error PASS
CM_PM_DefaultTechnology PASS
CM_PM_AvailableTechnologies PASS
CM_PS_Nameservers PASS
CM_PM_Technologies PASS
CM_PS_PassphraseRequired PASS
CM_PS_State PASS
CM_PS_Immutable PASS
CM_PS_Passphrase PASS
CM_PS_AutoConnect PASS
CM_PM_OfflineMode PASS
CM_PS_Favorite PASS
CM_PM_EnabledTechnologies PASS
CM_PS_Type PASS
CM_PS_Security PASS
CM_PS_Name PASS
CM_PS_Strength PASS
CM_PS_Domains PASS
CM_PS_Mode PASS
CM_PM_ConnectedTechnologies PASS
Total:20 Pass:20 Fail:0 N/A:0
---3G---
CM_3G_Reconnect PASS
CM_3G_DeviceControl PASS
CM_3G_Coexist_Priority PASS
CM_3G_PoweredOff PASS
CM_3G_BigPing PASS
CM_3G_Download PASS
CM_3G_Connect PASS
CM_3G_Service_Surf PASS
CM_3G_Replug PASS
CM_3G_PPP PASS
CM_3G_PlugInEnabled PASS
CM_3G_PlugInDisabled PASS
CM_3G_HasFixedIP PASS
CM_3G_Coexist PASS
CM_3G_SmallPing PASS
CM_3G_Disconnect PASS
CM_3G_Upload PASS
CM_3G_HasIP PASS
CM_3G_IsReEnableWorks PASS
CM_3G_PoweredOn PASS
CM_3G_DeviceIsExist PASS
CM_3G_IsReady PASS
CM_3G_IsPoweredOn PASS
Total:23 Pass:23 Fail:0 N/A:0
----------------------------------------------------
Total:258 Pass:250 Fail:8 N/A:0
PassRate of executed: 97%
FEAGroup Feature Score Comments
------------------------------------------------------------------------------
WiFI
EAP - Not Test
Network-sel Good
Wpa-suplicant D-BUS Good
Manual switch connect Good
connect to Broadcast AP Good
connect to Hidden AP Good
Hidden Group AP Good
WiFiFeature
WEP 40/128-bit key Good
WiFi Protected Setup pairing (WPS) Good
WEP 128-bit passphrase Good
WPA personal Good
WPA2 personal Good
Open system Good
Shared Key Good
Remember passwd Good
forgot password Good
AP security detect Good
auto del non-exist AP Good
VPN
- - Not Test
OpenVPN
connect Good
Session
create Buddy Bug 25018
switch Buddy Bug 24957
Status
coexist Good
State Good
Device Good
Info Good
Flight Good
AutoConnect
reboot Buddy Bug 11860
offline Good
suspend Good
favorite connection Good
auto connectivity order Good
Advance
DNS Proxy Good
Static IP Good
IPv6 Good
Proxy Good
DHCP Good
NTP Good
regulatory Good
Tethering
WiFi tethering Good
bluetooth tethering Good
usb tethering -
BT
Scan Good
Pair Good
Connect Buddy Bug 24902
dataTransfer Good
Ethernet
connect Good
datatransfer Good
3G
PPP Good
3G Buddy Bug 24948
Datatransfer Good
API
property Good
signal Good
CDMA2000 _ - Not ready
_______________________________________________
connman mailing list
[email protected]
http://lists.connman.net/listinfo/connman
