Hi all,
This is test report for ConnMan upstream connman-0.65.34. In this testing,
we ran 217 cases. 205 cases passed and 12 case failed because of known/new
bug. The pass rate is 95%. We found 1 new bugs
Verified Bugs
=============================================
NA
New bugs
===============================================
[12104] [REG]ConnMan does not autoconnect wifi while rewithin the wifi AP's
signal range.
http://bugs.meego.com/show_bug.cgi?id=12104
Testing Environment
==============================================
Hardware: netbook ACER AspireOne NAV50/Eeepc 1005PE
Image: meego-netbook-trunktesting-ia32-1.1.80.20101229.1013
ConnMan: connman-0.65.34.g9f2baff-1.1.i586.rpm
Ofono: ofono-0.37.16.ge5120c9-1.1.i586.rpm
3G: Unicom Sim card/Dell 5540/Dell 5530
BT: Palm Pre/AnyCom AP/CSR dongle (disable the onboard BT device)
Wireless AP: Linksys/Asus/Cisco 1252
Test Execution Summary
==============================================
Manual test with connmand -W nl80211,wext:
Feature Total Pass Fail Comments
Wired 2 2
WiFi 20 20
3G 11 11 #6944
BT 5 5
VPN 11 11
Switch 12 12
Signal 13 13
IPV6 23 23
Flight 21 21
Launch 8 8
Info 15 15
Device 12 12
NetworkSel 11 11
Autoconnect 13 6 7 #11860 #12104
Advance 17 16 1 #5194
State 11 8 3 #3376
DHCP 13 11 2 #4281#5194
Total 217 205 12
Bug refered here is bug at bugs.meego.com, for example, bug #437 refer to
http://bugs.meego.com/show_bug.cgi?id=437
For detailed test results, please see attached file
Quality indicator
==============================================
Feature Score Comments
WiFi Good Bug 5241, 10454
Intel WiMAX N/A QA does not have WiMAX test environment
Bluetooth PAN Good Bug 6956
3G data Buggy Bug 6028, 10016, 10018, 10211, 10844
Wired (LAN) Good
State Buggy Bug 2514 3376
Flight Good
Network Selection Good
wpa-suplicant D-BUS Good
profile management Good Bug 2513
manual switch connect Good
Wired/WiFi co-exexist Good
Remember device status Good
connect to Broadcast AP Good
connect to Hidden AP Good
Hidden Group AP Good
auto connect reboot Good
auto connect Offline Good
auto connect suspend Good
favorite connection Good
auto connectivity order Good
WEP 40/128-bit key Good
WEP 128-bit passphrase Good
WPA personal Good
WPA2 personal Good
Open system Good
Shared Key Good
Remember passwd Good
forgot password Good
AP security detect Good
auto del non-exist AP Good
VPN Good 10018, 10555
Plugin to oFono Good
DNS Proxy Good
DNS support via DHCP Good
Static IP Good
PPP 3G Good
WPA-enterprise Good
dhcp-lib Good #4281
ipv6 Good
wpad Good #10008
3G
CM_3G_Coexist pass
CM_3G_Coexist_Priority pass
CM_3G_DeviceControl pass
CM_3G_DeviceControl_Offline pass
CM_3G_Item_Configuring pass
CM_3G_Item_Disconnect pass
CM_3G_Service_Surf pass
CM_3G_Reconnect pass
CM_3G_Item_Connect pass
CM_3G_Service_Download pass
CM_3G_Service_Roaming pass
BT
CM_BT_CheckProp_Powered pass
CM_BT_Connect_PAN pass
CM_BT_List_PAN pass
CM_BT_Connect_Invalidnetwork pass
CM_BT_Check_State pass
Advance
CM_Advance_StaticIP_reboot pass
CM_Advance_StaticIP_Wired pass
CM_Advance_StaticIP_WIFI pass
CM_Advance_Hostname fail #5194
CM_Advance_StaticIP_BT pass
CM_Advance_ProfileName pass
CM_profile_delete pass
CM_Advance_ProfileCreate pass
CM_Advance_DNS_Set pass
CM_Advance_DNS_Negative pass
CM_Advance_DNS_Positive pass
CM_Advance_http_proxy pass
CM_Advance_web_proxy pass
CM_Advance_eth_wpad pass
CM_Advance_WF_wpad pass
CM_Advance_BT_wpad pass
CM_Advance_3G_wpad pass
AutoConn
CM_AutoConn_FavoriteSetting pass
CM_AutoConn_Reboot3G pass
CM_AutoConn_RebootWIFI fail #11860
CM_AutoConn_RebootWired pass
CM_AutoConn_SuspendMem3G pass
CM_AutoConn_SuspendMemWIFI pass
CM_AutoConn_SuspendMemWired pass
CM_Autoconn_RememWPAPSKTKIP fail #11860
CM_AutoConn_RememWEP64 fail #11860
CM_AutoConn_LostConn fail #12104
CM_Autoconn_HIDDEN_Rem WEP128 fail #11860
CM_Autoconn_HIDDEN_Rem NoSecu fail #11860
CM_Autoconn_HIDDEN_Rem WPAPSKAES fail #11860
Device
CM_Device_Wired pass
CM_Device_3G_Conn pass
CM_Device_3G_Reboot pass
CM_Device_3G pass
CM_Device_BT_Conn pass
CM_Device_BT_Reboot
CM_Device_BT pass
CM_Device_WIFI_Conn pass
CM_Device_WIFI_Reboot pass
CM_Device_WIFI pass
CM_Device_Wired_Conn pass
CM_Device_Wired_Reboot pass
Info
CM_INFO_ManagerStateEthOnline pass
CM_INFO_ManagerStateEthOffline pass
CM_INFO_ManagerStateWiFiOnline pass
CM_INFO_ManagerStateWiFiOffline pass
CM_INFO_ManagerStateBTOnline pass
CM_INFO_ManagerStateBTOffline pass
CM_INFO_ProfileDefault pass
CM_INFO_EthConnInfo pass
CM_INFO_BtConnInfo pass
CM_INFO_WiFiConnInfo pass
CM_INFO_NoConnList pass
CM_INFO_SetIPBT pass
CM_INFO_TurnOn_FlightMode pass
CM_INFO_Exit_FlightMode pass
CM_INFO_MultiConnection pass
Launch
CM_Launch_boot pass
CM_Launch_BT pass
CM_Launch_WpaSupplicant pass
CM_Launch_reboot pass
CM_Launch_cpu pass
CM_Launch_profile pass
CM_Launch_OneConnmand pass
CM_Launch_with_profile pass
NetworkSel
CM_NetworkSel_BroadcastNoSec pass
CM_NetworkSel_HideWPA pass
CM_NetworkSel_HideWEP pass
CM_NetworkSel_HideNoSec pass
CM_NetworkSel_Best pass
CM_NetworkSel_BroadcastWEP pass
CM_NetworkSel_NoneToWPA pass
CM_NetworkSel_HiddenWPAToNone pass
CM_NetworkSel_NoneToHiddenWEP pass
CM_NetworkSel_WEPToNone pass
CM_NetworkSel_HiddenWPAToWEP pass
Flight
CM_Flt_Persistance pass
CM_Flt_Conn3G pass
CM_Flt_ConnWired pass
CM_Flt_set pass
CM_Flt_ConnWIFI pass
CM_Flt_set_eth_device pass
CM_Flt_eth_autoconn pass
CM_Flt_eth_remember_off pass
CM_Flt_WF_rfkill pass
CM_Flt_WF_unset_rfkill pass
CM_Flt_BT_rfkill pass
CM_Flt_BT_unset_rfkill pass
CM_Flt_set_BT_device pass
CM_Flt_BT_autoconn pass
CM_Flt_BT_remember_off pass
CM_Flt_set_WF_device pass
CM_Flt_WF_autoconn pass
CM_Flt_WF_remember_off pass
CM_Flt_set_3G_device pass
CM_Flt_3G_autoconn pass
CM_Flt_3G_remember_off pass
Signal
CM_Signal_RmvEthCable pass
CM_Signal_DisableWiFiDev pass
CM_Signal_RmvBT pass
CM_Signal_MoveBT pass
CM_Signal_MoveWiFi pass
CM_Signal_Move3G pass
CM_Signal_State pass
CM_Signal_Error pass
CM_Signal_List_Networks pass
CM_Signal_Set_PassphraseRequired pass
CM_Signal_Change_Passphrase pass
CM_Signal_Set_Flightmode pass
CM_Signal_StaticIPEth pass
IPV6
CM_IPv6_set_address pass
CM_IPv6_set_address_addr pass
CM_IPv6_set_address_prefix pass
CM_IPv6_set_address_gateway pass
CM_IPv6_ping6_addr pass
CM_IPv6_ping6_local pass
CM_IPv6_ping6_gateway pass
CM_IPv6_route pass
CM_IPv6_scp pass
CM_IPv6_ssh pass
CM_IPv6_ssh_server pass
CM_IPv6_eth_set_address pass
CM_IPv6_eth_ping6_addr pass
CM_IPv6_eth_ssh pass
CM_IPv6_WF_set_address pass
CM_IPv6_BT_set_address pass
CM_IPv6_WF_ping6_addr pass
CM_IPv6_BT_ping6_addr pass
CM_IPv6_WF_ssh pass
CM_IPv6_BT_ssh pass
State
CM_State_ETHENET_idle pass
CM_State_ETHENET_online pass
CM_State_3G_Unavailable pass
CM_State_3G_Available pass
CM_State_WIFI_IsolateAP pass
CM_State_WIFI_AvialableAP pass
CM_State_Accountneeded_network pass
CM_State_PROXY_Ready pass
CM_State_PROXY_Online fail #3376
CM_State_NOPROXY_READY fail #3376
CM_State_BT_Isolate_PANU pass
Switch
CM_Switch_WiFiToEth pass
CM_Switch_EthToWiFi pass
CM_Switch_WiFiToBT pass
CM_Switch_WiFiTo3G pass
CM_Switch_EthToBT pass
CM_Switch_EthTo3G pass
CM_Switch_BTToEth pass
CM_Switch_3GToEth pass
CM_Switch_BTToWiFi pass
CM_Switch_BTTo3G pass
CM_Switch_3GToWiFi pass
CM_Switch_3GToBT pass
VPN
CM_VPN_WEP pass
CM_VPN_WPA pass
CM_VPN_WPA2 pass
CM_VPN_3G pass
CM_VPN_Hidden pass
CM_VPN_Wired pass
CM_VPN_Disconnect pass
CM_VPN_Reconnect pass
CM_VPN_Autodisconnect pass
CM_VPN_list_service pass
CM_VPN_Disconnect_service pass
Ethernet
CM_Eth_Hotplug pass
CM_Eth_Conn pass
WIFI
CM_WF_Refresh_Disable pass
CM_WF_Refresh_Enable pass
CM_WF_CoExists_Wired pass
CM_WF_CoExists_Wired2 pass
CM_WF_CoExists_BT pass
CM_WF_CoExists_3G pass
CM_WF_Roaming_Broadcast pass
CM_WF_Roaming_Hidden pass
CM_WF_Refresh pass
WiFiFeature
CM_WA_AutoDelete pass
CM_WF_Connect_WPAPSKTKIPHide pass
CM_WF_Connect_WPA2 pass
CM_WF_Connect_WPAEnterprise pass
CM_WF_Connect_SharedWEP128Hide pass
CM_WF_Connect_OpenWEP64 pass
CM_WS_Shared pass
CM_WS_SharedHiddenWEP128 pass
CM_WS_SharedBroadcastWEP128 pass
CM_WS_SharedHiddenWEP40 pass
CM_WS_SharedBroadcastWEP40 pass
DHCP
CM_DHCP_Wried pass
CM_DHCP_3G pass
CM_DHCP_BT pass
CM_DHCP_WIFI_NoSecuBroadcast pass
CM_DHCP_WIFI_OpenWEP128 pass
CM_DHCP_WIFI_SharedWEP64 pass
CM_DHCP_WIFI_WPAPSKTKIP pass
CM_DHCP_WIFI_WPA2Hide pass
CM_DHCP_Coexit pass
CM_DHCP_Optional_list pass
CM_DHCP_Hostname fail #5194
CM_DHCP_IP_Conflict fail #4281
CM_DHCP_Suspend pass
_______________________________________________
connman mailing list
[email protected]
http://lists.connman.net/listinfo/connman
