Hi all,
This is test report for ConnMan upstream connman-0.69.31 from In this
testing, we ran 320 cases. 291 cases passed and 29 case failed because
of known/new bug. The pass rate is 91%. We found 6 new bugs.
Verified Bugs
===============================================
None
New bugs
===============================================
[13573] 3G state is failure when disconnect 3G.
http://bugs.meego.com/show_bug.cgi?id=13573
[13577] Reconnect a hidden wifi AP causes net.connman.Error.
http://bugs.meego.com/show_bug.cgi?id=13577
[13584] Connman network priority will not update.
http://bugs.meego.com/show_bug.cgi?id=13584
[13624] Connman crashes sometimes when test-connman disable wifi.
http://bugs.meego.com/show_bug.cgi?id=13624
[13682] Huawei EM770: ConnMan 3G status wrong after resume from S3.
http://bugs.meego.com/show_bug.cgi?id=13682
[13681] Huawei EM770: GLib-CRITICAL and connman exits sometimes.
http://bugs.meego.com/show_bug.cgi?id=13681
Testing Environment
==============================================
Hardware: netbook ACER AspireOne NAV50/Eeepc 1005PE
Image: meego-netbook-ia32-1.1.90.2.20110204.90
ConnMan: connman-0.69.31.gbd4c11b-1.1.i586/connman-0.69.47.g5b91899-1.1.i586
Ofono: ofono-0.41-11.1.i586/ofono-0.43-12.1.i586
3G: Unicom Sim card/Dell 5540/HuaWei em770w
BT: Palm Pre/AnyCom AP/CSR dongle (disable the onboard BT device)
Wireless AP: Linksys/Asus/Cisco 1252
Test Execution Summary
==============================================
Feature Total Pass Fail Comments
Ethernet 18 18
WiFi 38 37 1 #13624
3G 27 25 2 #13017 #13573
BT 21 21
VPN - - - #Not Test
Switch 12 0 12 #13584
Signal 13 13
IPV6 23 20 3 #12698
Flight 34 34
Launch 8 8
Info 15 15
Device 12 12
NetworkSel 11 11
Autoconnect 13 8 5 #11860 #13407 #13408 #13682
Advance 17 16 1 #5194
State 11 9 2 #3376
DHCP 13 11 2 #4281 #5194
Profile 6 5 1 #2513
Property 28 28
Total 320 291 29
Bug refered hern is bug at bugs.meego.com, for example, bug #437 refer to
http://bugs.meego.com/show_bug.cgi?id=437
For detailed test results, please see attached file
Quality indicator
==============================================
Feature Score Comments
WiFi Good Bug 5241, 12696
Intel WiMAX N/A QA does not have WiMAX test environment
Bluetooth PAN Good Bug 6956
3G data Buggy Bug 6028, 10018, 10211, 13017, 13681, 13682
Wired (LAN) Good Bug 13460
State Buggy Bug 2514 3376
Flight Good
Network Selection Good
wpa-suplicant D-BUS Good
profile management Good Bug 2513
manual switch connect Good
Wired/WiFi co-exexist Good
Remember device status Good
connect to Broadcast AP Good
connect to Hidden AP Good
Hidden Group AP Good
auto connect reboot Good
auto connect Offline Good
auto connect suspend Good
favorite connection Good
auto connectivity order Good
WEP 40/128-bit key Good
WEP 128-bit passphrase Good
WPA personal Good
WPA2 personal Good
Open system Good
Shared Key Good
Remember passwd Good
forgot password Good
AP security detect Good
auto del non-exist AP Good
VPN Block 10018, 10555
Plugin to oFono Good
DNS Proxy Good
DNS support via DHCP Good
Static IP Good
PPP 3G Good
WPA-enterprise Good
dhcp-lib Good #4281
ipv6 Good #12698
pacrunner Good
OpenVPN Good
TTLS Good
3G
CM_3G_Coexist pass
CM_3G_Coexist_Priority pass
CM_3G_DeviceControl pass
CM_3G_DeviceControl_Offline pass
CM_3G_Item_Configuring pass
CM_3G_Item_Disconnect fail #13573
CM_3G_Service_Surf pass
CM_3G_Reconnect fail #13017
CM_3G_Item_Connect pass
CM_3G_Service_Download pass
CM_3G_Service_Roaming pass
CM_3G_BigPing pass
CM_3G_Connect pass
CM_3G_DeviceIsExist pass
CM_3G_Disconnect pass
CM_3G_Download pass
CM_3G_HasDHCP pass
CM_3G_HasIP pass
CM_3G_IfconfigDown pass
CM_3G_IfconfigUp pass
CM_3G_IsPoweredOn pass
CM_3G_IsReEnableWorks pass
CM_3G_IsReady pass
CM_3G_PoweredOff pass
CM_3G_PoweredOn pass
CM_3G_SmallPing pass
CM_3G_Upload pass
BT
CM_BT_CheckProp_Powered pass
CM_BT_Connect_PAN pass
CM_BT_List_PAN pass
CM_BT_Connect_Invalidnetwork pass
CM_BT_Check_State pass
CM_BT_BigPing pass
CM_BT_Connect pass
CM_BT_DeviceIsExist pass
CM_BT_Disconnect pass
CM_BT_Download pass
CM_BT_HasDHCP pass
CM_BT_HasIP pass
CM_BT_IfconfigDown pass
CM_BT_IfconfigUp pass
CM_BT_IsPoweredOn pass
CM_BT_IsReEnableWorks pass
CM_BT_IsReady pass
CM_BT_PoweredOff pass
CM_BT_PoweredOn pass
CM_BT_SmallPing pass
CM_BT_Upload pass
Advance
CM_Advance_StaticIP_reboot pass
CM_Advance_StaticIP_Wired pass
CM_Advance_StaticIP_WIFI pass
CM_Advance_Hostname fail #5194
CM_Advance_StaticIP_BT pass
CM_Advance_ProfileName pass
CM_profile_delete pass
CM_Advance_ProfileCreate pass
CM_Advance_DNS_Set pass
CM_Advance_DNS_Negative pass
CM_Advance_DNS_Positive pass
CM_Advance_http_proxy pass
CM_Advance_web_proxy pass
CM_Advance_eth_wpad pass
CM_Advance_WF_wpad pass
CM_Advance_BT_wpad pass
CM_Advance_3G_wpad pass
AutoConn
CM_AutoConn_FavoriteSetting pass
CM_AutoConn_Reboot3G fail #13407
CM_AutoConn_RebootWIFI pass
CM_AutoConn_RebootWired pass
CM_AutoConn_SuspendMem3G fail #13408 #13682
CM_AutoConn_SuspendMemWIFI pass
CM_AutoConn_SuspendMemWired pass
CM_Autoconn_RememWPAPSKTKIP pass
CM_AutoConn_RememWEP64 pass
CM_AutoConn_LostConn pass
CM_Autoconn_HIDDEN_Rem WEP128 fail #11860
CM_Autoconn_HIDDEN_Rem NoSecu fail #11860
CM_Autoconn_HIDDEN_Rem WPAPSKAES fail #11860
Device
CM_Device_Wired pass
CM_Device_3G_Conn pass
CM_Device_3G_Reboot pass
CM_Device_3G pass
CM_Device_BT_Conn pass
CM_Device_BT_Reboot pass
CM_Device_BT pass
CM_Device_WIFI_Conn pass
CM_Device_WIFI_Reboot pass
CM_Device_WIFI pass
CM_Device_Wired_Conn pass
CM_Device_Wired_Reboot pass
Info
CM_INFO_ManagerStateEthOnline pass
CM_INFO_ManagerStateEthOffline pass
CM_INFO_ManagerStateWiFiOnline pass
CM_INFO_ManagerStateWiFiOffline pass
CM_INFO_ManagerStateBTOnline pass
CM_INFO_ManagerStateBTOffline pass
CM_INFO_ProfileDefault pass
CM_INFO_EthConnInfo pass
CM_INFO_BtConnInfo pass
CM_INFO_WiFiConnInfo pass
CM_INFO_NoConnList pass
CM_INFO_SetIPBT pass
CM_INFO_TurnOn_FlightMode pass
CM_INFO_Exit_FlightMode pass
CM_INFO_MultiConnection pass
Launch
CM_Launch_boot pass
CM_Launch_BT pass
CM_Launch_WpaSupplicant pass
CM_Launch_reboot pass
CM_Launch_cpu pass
CM_Launch_profile pass
CM_Launch_OneConnmand pass
CM_Launch_with_profile pass
NetworkSel
CM_NetworkSel_BroadcastNoSec pass
CM_NetworkSel_HideWPA pass
CM_NetworkSel_HideWEP pass
CM_NetworkSel_HideNoSec pass
CM_NetworkSel_Best pass
CM_NetworkSel_BroadcastWEP pass
CM_NetworkSel_NoneToWPA pass
CM_NetworkSel_HiddenWPAToNone pass
CM_NetworkSel_NoneToHiddenWEP pass
CM_NetworkSel_WEPToNone pass
CM_NetworkSel_HiddenWPAToWEP pass
Flight
CM_Flt_Persistance pass
CM_Flt_Conn3G pass
CM_Flt_ConnWired pass
CM_Flt_set pass
CM_Flt_ConnWIFI pass
CM_Flt_set_eth_device pass
CM_Flt_eth_autoconn pass
CM_Flt_eth_remember_off pass
CM_Flt_WF_rfkill pass
CM_Flt_WF_unset_rfkill pass
CM_Flt_BT_rfkill pass
CM_Flt_BT_unset_rfkill pass
CM_Flt_set_BT_device pass
CM_Flt_BT_autoconn pass
CM_Flt_BT_remember_off pass
CM_Flt_set_WF_device pass
CM_Flt_WF_autoconn pass
CM_Flt_WF_remember_off pass
CM_Flt_set_3G_device pass
CM_Flt_3G_autoconn pass
CM_Flt_3G_remember_off pass
CM_Flt_EthIsPoweredOff pass
CM_Flt_EthNoPing pass
CM_Flt_EthOnline pass
CM_Flt_EthPoweredOff pass
CM_Flt_EthPoweredOn pass
CM_Flt_Offline pass
CM_Flt_Online pass
CM_Flt_Service pass
CM_Flt_WiFiIsPoweredOff pass
CM_Flt_WiFiNoPing pass
CM_Flt_WiFiOnline pass
CM_Flt_WiFiPoweredOff pass
CM_Flt_WiFiPoweredOn pass
Signal
CM_Signal_RmvEthCable pass
CM_Signal_DisableWiFiDev pass
CM_Signal_RmvBT pass
CM_Signal_MoveBT pass
CM_Signal_MoveWiFi pass
CM_Signal_Move3G pass
CM_Signal_State pass
CM_Signal_Error pass
CM_Signal_List_Networks pass
CM_Signal_Set_PassphraseRequired pass
CM_Signal_Change_Passphrase pass
CM_Signal_Set_Flightmode pass
CM_Signal_StaticIPEth pass
IPV6
CM_IPv6_set_address pass
CM_IPv6_set_address_addr pass
CM_IPv6_set_address_prefix pass
CM_IPv6_set_address_gateway pass
CM_IPv6_ping6_addr pass
CM_IPv6_ping6_local pass
CM_IPv6_ping6_gateway pass
CM_IPv6_route pass
CM_IPv6_scp pass
CM_IPv6_ssh pass
CM_IPv6_ssh_server pass
CM_IPv6_eth_set_address pass
CM_IPv6_eth_ping6_addr pass
CM_IPv6_eth_ssh pass
CM_IPv6_WF_set_address pass
CM_IPv6_BT_set_address fail #12698
CM_IPv6_WF_ping6_addr pass
CM_IPv6_BT_ping6_addr fail #12698
CM_IPv6_WF_ssh pass
CM_IPv6_BT_ssh fail #12698
State
CM_State_ETHENET_idle pass
CM_State_ETHENET_online pass
CM_State_3G_Unavailable pass
CM_State_3G_Available pass
CM_State_WIFI_IsolateAP pass
CM_State_WIFI_AvialableAP pass
CM_State_Accountneeded_network pass
CM_State_PROXY_Ready pass
CM_State_PROXY_Online fail #3376
CM_State_NOPROXY_READY fail #3376
CM_State_BT_Isolate_PANU pass
Switch
CM_Switch_WiFiToEth fail #13584
CM_Switch_EthToWiFi fail #13584
CM_Switch_WiFiToBT fail #13584
CM_Switch_WiFiTo3G fail #13584
CM_Switch_EthToBT fail #13584
CM_Switch_EthTo3G fail #13584
CM_Switch_BTToEth fail #13584
CM_Switch_3GToEth fail #13584
CM_Switch_BTToWiFi fail #13584
CM_Switch_BTTo3G fail #13584
CM_Switch_3GToWiFi fail #13584
CM_Switch_3GToBT fail #13584
VPN
CM_VPN_WEP N/A
CM_VPN_WPA N/A
CM_VPN_WPA2 N/A
CM_VPN_3G N/A
CM_VPN_Hidden N/A
CM_VPN_Wired N/A
CM_VPN_Disconnect N/A
CM_VPN_Reconnect N/A
CM_VPN_Autodisconnect N/A
CM_VPN_list_service N/A
CM_VPN_Disconnect_service N/A
Ethernet
CM_Eth_Hotplug pass
CM_Eth_Conn pass
CM_Eth_BigBroadcastPing pass
CM_Eth_Connect pass
CM_Eth_DeviceIsExist pass
CM_Eth_Disconnect pass
CM_Eth_Download pass
CM_Eth_HasDHCP pass
CM_Eth_HasIP pass
CM_Eth_IfconfigDown pass
CM_Eth_IfconfigUp pass
CM_Eth_IsPoweredOn pass
CM_Eth_IsReEnableWorks pass
CM_Eth_IsReady pass
CM_Eth_PoweredOff pass
CM_Eth_PoweredOn pass
CM_Eth_SmallBroadcastPing pass
CM_Eth_Upload pass
WIFI
CM_WF_Refresh_Disable fail #13624
CM_WF_Refresh_Enable pass
CM_WF_CoExists_Wired pass
CM_WF_CoExists_Wired2 pass
CM_WF_CoExists_BT pass
CM_WF_CoExists_3G pass
CM_WF_Roaming_Broadcast pass
CM_WF_Roaming_Hidden pass
CM_WF_Refresh pass
CM_WG_BigBroadcastPing pass
CM_WG_Connect pass
CM_WG_DeviceIsExist pass
CM_WG_Disconnect pass
CM_WG_HasDHCP pass
CM_WG_HasIP pass
CM_WG_IfconfigDown pass
CM_WG_IfconfigUp pass
CM_WG_IsPoweredOn pass
CM_WG_IsReEnableWorks pass
CM_WG_IsReady pass
CM_WG_PoweredOff pass
CM_WG_PoweredOn pass
CM_WG_SmallBroadcastPing pass
CM_WS_RSN_Download pass
CM_WS_RSN_Upload pass
CM_WS_WEP_Download pass
CM_WS_WEP_Upload pass
WiFiFeature
CM_WA_AutoDelete pass
CM_WF_Connect_WPAPSKTKIPHide pass
CM_WF_Connect_WPA2 pass
CM_WF_Connect_WPAEnterprise pass
CM_WF_Connect_SharedWEP128Hide pass
CM_WF_Connect_OpenWEP64 pass
CM_WS_Shared pass
CM_WS_SharedHiddenWEP128 pass
CM_WS_SharedBroadcastWEP128 pass
CM_WS_SharedHiddenWEP40 pass
CM_WS_SharedBroadcastWEP40 pass
DHCP
CM_DHCP_Wried pass
CM_DHCP_3G pass
CM_DHCP_BT pass
CM_DHCP_WIFI_NoSecuBroadcast pass
CM_DHCP_WIFI_OpenWEP128 pass
CM_DHCP_WIFI_SharedWEP64 pass
CM_DHCP_WIFI_WPAPSKTKIP pass
CM_DHCP_WIFI_WPA2Hide pass
CM_DHCP_Coexit pass
CM_DHCP_Optional_list pass
CM_DHCP_Hostname fail #5194
CM_DHCP_IP_Conflict fail #4281
CM_DHCP_Suspend pass
Profile
CM_Prof_ActiveProfile Fail #2513
CM_Prof_Add pass
CM_Prof_AddExist pass
CM_Prof_List pass
CM_Prof_Remove pass
CM_Prof_RemoveNoExist pass
Property
CM_PM_ActiveProfile pass
CM_PM_AvailableTechnologies pass
CM_PM_ConnectedTechnologies pass
CM_PM_DefaultTechnology pass
CM_PM_EnabledTechnologies pass
CM_PM_OfflineMode pass
CM_PM_Profiles pass
CM_PM_State pass
CM_PM_Technologies pass
CM_PS_APN pass
CM_PS_AutoConnect pass
CM_PS_Domains pass
CM_PS_Error pass
CM_PS_Favorite pass
CM_PS_Immutable pass
CM_PS_MCC pass
CM_PS_MNC pass
CM_PS_Mode pass
CM_PS_Name pass
CM_PS_Nameservers pass
CM_PS_Passphrase pass
CM_PS_PassphraseRequired pass
CM_PS_Roaming pass
CM_PS_Security pass
CM_PS_SetupRequired pass
CM_PS_State pass
CM_PS_Strength pass
CM_PS_Type pass
_______________________________________________
connman mailing list
connman@connman.net
http://lists.connman.net/listinfo/connman
