Hi all,
This is test report for ConnMan upstream connman-0.67.5gaf54367. In this
testing, we ran 331 cases. 293 cases passed and 38 case failed because
of known/new bug. The pass rate is 89%. We found 3 new bugs and verified
3 bugs
Verified Bugs
===============================================
[10844] [REG] 3G technology is "available" after ConnMan killed/restart.
http://bugs.meego.com/show_bug.cgi?id=10844
[12576] Connman and wpa_supplicant should go through all the supported drivers
in wpa_s
http://bugs.meego.com/show_bug.cgi?id=12576
[12505] Connect to AP with TTLS failed
http://bugs.meego.com/show_bug.cgi?id=10505
New bugs
===============================================
[13017] Connman crash when connecting to 3G after set apn for 3G service.(Dell
5540 modem)
http://bugs.meego.com/show_bug.cgi?id=13017
[13038] Connman crash suddenly.
http://bugs.meego.com/show_bug.cgi?id=13038
[13039] VPN doesn't work.
http://bugs.meego.com/show_bug.cgi?id=13039
Testing Environment
==============================================
Hardware: netbook ACER AspireOne NAV50/Eeepc 1005PE
Image: meego-netbook-trunktesting-ia32-1.1.80.20110117.0919
ConnMan: connman-0.67.5.gaf54367-1.1.i586
Ofono: ofono-0.39.51.gf49f0ad-1.1.i586
3G: Unicom Sim card/Dell 5540/Dell 5530
BT: Palm Pre/AnyCom AP/CSR dongle (disable the onboard BT device)
Wireless AP: Linksys/Asus/Cisco 1252
Test Execution Summary
==============================================
Feature Total Pass Fail Comments
Ethernet 18 18
WiFi 38 38
3G 27 26 1 #13017
BT 21 21
VPN 11 0 11 #13039 #10018
Switch 12 12
Signal 13 13
IPV6 23 20 3 #12698
Flight 34 34
Launch 8 8
Info 15 15
Device 12 12
NetworkSel 11 1 10 #12696
Autoconnect 13 6 7 #11860 #12104
Advance 17 16 1 #5194
State 11 9 2 #3376
DHCP 13 11 2 #4281 #5194
Profile 6 5 1 #2513
Property 28 28
Pacrunner 13 13
Total 331 293 38
Bug refered here is bug at bugs.meego.com, for example, bug #437 refer to
http://bugs.meego.com/show_bug.cgi?id=437
For detailed test results, please see attached file
Quality indicator
==============================================
Feature Score Comments
WiFi Good Bug 5241, 12696
Intel WiMAX N/A QA does not have WiMAX test environment
Bluetooth PAN Good Bug 6956
3G data Buggy Bug 6028, 10016, 10018, 10211, 13017
Wired (LAN) Good
State Buggy Bug 2514 3376
Flight Good
Network Selection Good
wpa-suplicant D-BUS Good
profile management Good Bug 2513
manual switch connect Good
Wired/WiFi co-exexist Good
Remember device status Good
connect to Broadcast AP Good
connect to Hidden AP Good
Hidden Group AP Good
auto connect reboot Good
auto connect Offline Good
auto connect suspend Good
favorite connection Good
auto connectivity order Good
WEP 40/128-bit key Good
WEP 128-bit passphrase Good
WPA personal Good
WPA2 personal Good
Open system Good
Shared Key Good
Remember passwd Good
forgot password Good
AP security detect Good
auto del non-exist AP Good
VPN Block 10018, 10555, 13039
Plugin to oFono Good
DNS Proxy Good
DNS support via DHCP Good
Static IP Good
PPP 3G Good
WPA-enterprise Good
dhcp-lib Good #4281
ipv6 Good #12698
pacrunner Good
OpenVPN Buggy #12508
TTLS Good
3G
CM_3G_Coexist pass
CM_3G_Coexist_Priority pass
CM_3G_DeviceControl pass
CM_3G_DeviceControl_Offline pass
CM_3G_Item_Configuring pass
CM_3G_Item_Disconnect pass
CM_3G_Service_Surf pass
CM_3G_Reconnect fail #13017
CM_3G_Item_Connect pass
CM_3G_Service_Download pass
CM_3G_Service_Roaming pass
CM_3G_BigPing pass
CM_3G_Connect pass
CM_3G_DeviceIsExist pass
CM_3G_Disconnect pass
CM_3G_Download pass
CM_3G_HasDHCP pass
CM_3G_HasIP pass
CM_3G_IfconfigDown pass
CM_3G_IfconfigUp pass
CM_3G_IsPoweredOn pass
CM_3G_IsReEnableWorks pass
CM_3G_IsReady pass
CM_3G_PoweredOff pass
CM_3G_PoweredOn pass
CM_3G_SmallPing pass
CM_3G_Upload pass
BT
CM_BT_CheckProp_Powered pass
CM_BT_Connect_PAN pass
CM_BT_List_PAN pass
CM_BT_Connect_Invalidnetwork pass
CM_BT_Check_State pass
CM_BT_BigPing pass
CM_BT_Connect pass
CM_BT_DeviceIsExist pass
CM_BT_Disconnect pass
CM_BT_Download pass
CM_BT_HasDHCP pass
CM_BT_HasIP pass
CM_BT_IfconfigDown pass
CM_BT_IfconfigUp pass
CM_BT_IsPoweredOn pass
CM_BT_IsReEnableWorks pass
CM_BT_IsReady pass
CM_BT_PoweredOff pass
CM_BT_PoweredOn pass
CM_BT_SmallPing pass
CM_BT_Upload pass
Advance
CM_Advance_StaticIP_reboot pass
CM_Advance_StaticIP_Wired pass
CM_Advance_StaticIP_WIFI pass
CM_Advance_Hostname fail #5194
CM_Advance_StaticIP_BT pass
CM_Advance_ProfileName pass
CM_profile_delete pass
CM_Advance_ProfileCreate pass
CM_Advance_DNS_Set pass
CM_Advance_DNS_Negative pass
CM_Advance_DNS_Positive pass
CM_Advance_http_proxy pass
CM_Advance_web_proxy pass
CM_Advance_eth_wpad pass
CM_Advance_WF_wpad pass
CM_Advance_BT_wpad pass
CM_Advance_3G_wpad pass
AutoConn
CM_AutoConn_FavoriteSetting pass
CM_AutoConn_Reboot3G pass
CM_AutoConn_RebootWIFI fail #11860
CM_AutoConn_RebootWired pass
CM_AutoConn_SuspendMem3G pass
CM_AutoConn_SuspendMemWIFI pass
CM_AutoConn_SuspendMemWired pass
CM_Autoconn_RememWPAPSKTKIP fail #11860
CM_AutoConn_RememWEP64 fail #11860
CM_AutoConn_LostConn fail #12104
CM_Autoconn_HIDDEN_Rem WEP128 fail #11860
CM_Autoconn_HIDDEN_Rem NoSecu fail #11860
CM_Autoconn_HIDDEN_Rem WPAPSKAES fail #11860
Device
CM_Device_Wired pass
CM_Device_3G_Conn pass
CM_Device_3G_Reboot pass
CM_Device_3G pass
CM_Device_BT_Conn pass
CM_Device_BT_Reboot pass
CM_Device_BT pass
CM_Device_WIFI_Conn pass
CM_Device_WIFI_Reboot pass
CM_Device_WIFI pass
CM_Device_Wired_Conn pass
CM_Device_Wired_Reboot pass
Info
CM_INFO_ManagerStateEthOnline pass
CM_INFO_ManagerStateEthOffline pass
CM_INFO_ManagerStateWiFiOnline pass
CM_INFO_ManagerStateWiFiOffline pass
CM_INFO_ManagerStateBTOnline pass
CM_INFO_ManagerStateBTOffline pass
CM_INFO_ProfileDefault pass
CM_INFO_EthConnInfo pass
CM_INFO_BtConnInfo pass
CM_INFO_WiFiConnInfo pass
CM_INFO_NoConnList pass
CM_INFO_SetIPBT pass
CM_INFO_TurnOn_FlightMode pass
CM_INFO_Exit_FlightMode pass
CM_INFO_MultiConnection pass
Launch
CM_Launch_boot pass
CM_Launch_BT pass
CM_Launch_WpaSupplicant pass
CM_Launch_reboot pass
CM_Launch_cpu pass
CM_Launch_profile pass
CM_Launch_OneConnmand pass
CM_Launch_with_profile pass
NetworkSel
CM_NetworkSel_BroadcastNoSec fail #12696
CM_NetworkSel_HideWPA fail #12696
CM_NetworkSel_HideWEP fail #12696
CM_NetworkSel_HideNoSec fail #12696
CM_NetworkSel_Best pass
CM_NetworkSel_BroadcastWEP fail #12696
CM_NetworkSel_NoneToWPA fail #12696
CM_NetworkSel_HiddenWPAToNone fail #12696
CM_NetworkSel_NoneToHiddenWEP fail #12696
CM_NetworkSel_WEPToNone fail #12696
CM_NetworkSel_HiddenWPAToWEP fail #12696
Flight
CM_Flt_Persistance pass
CM_Flt_Conn3G pass
CM_Flt_ConnWired pass
CM_Flt_set pass
CM_Flt_ConnWIFI pass
CM_Flt_set_eth_device pass
CM_Flt_eth_autoconn pass
CM_Flt_eth_remember_off pass
CM_Flt_WF_rfkill pass
CM_Flt_WF_unset_rfkill pass
CM_Flt_BT_rfkill pass
CM_Flt_BT_unset_rfkill pass
CM_Flt_set_BT_device pass
CM_Flt_BT_autoconn pass
CM_Flt_BT_remember_off pass
CM_Flt_set_WF_device pass
CM_Flt_WF_autoconn pass
CM_Flt_WF_remember_off pass
CM_Flt_set_3G_device pass
CM_Flt_3G_autoconn pass
CM_Flt_3G_remember_off pass
CM_Flt_EthIsPoweredOff pass
CM_Flt_EthNoPing pass
CM_Flt_EthOnline pass
CM_Flt_EthPoweredOff pass
CM_Flt_EthPoweredOn pass
CM_Flt_Offline pass
CM_Flt_Online pass
CM_Flt_Service pass
CM_Flt_WiFiIsPoweredOff pass
CM_Flt_WiFiNoPing pass
CM_Flt_WiFiOnline pass
CM_Flt_WiFiPoweredOff pass
CM_Flt_WiFiPoweredOn pass
Signal
CM_Signal_RmvEthCable pass
CM_Signal_DisableWiFiDev pass
CM_Signal_RmvBT pass
CM_Signal_MoveBT pass
CM_Signal_MoveWiFi pass
CM_Signal_Move3G pass
CM_Signal_State pass
CM_Signal_Error pass
CM_Signal_List_Networks pass
CM_Signal_Set_PassphraseRequired pass
CM_Signal_Change_Passphrase pass
CM_Signal_Set_Flightmode pass
CM_Signal_StaticIPEth pass
IPV6
CM_IPv6_set_address pass
CM_IPv6_set_address_addr pass
CM_IPv6_set_address_prefix pass
CM_IPv6_set_address_gateway pass
CM_IPv6_ping6_addr pass
CM_IPv6_ping6_local pass
CM_IPv6_ping6_gateway pass
CM_IPv6_route pass
CM_IPv6_scp pass
CM_IPv6_ssh pass
CM_IPv6_ssh_server pass
CM_IPv6_eth_set_address pass
CM_IPv6_eth_ping6_addr pass
CM_IPv6_eth_ssh pass
CM_IPv6_WF_set_address pass
CM_IPv6_BT_set_address fail #12698
CM_IPv6_WF_ping6_addr pass
CM_IPv6_BT_ping6_addr fail #12698
CM_IPv6_WF_ssh pass
CM_IPv6_BT_ssh fail #12698
State
CM_State_ETHENET_idle pass
CM_State_ETHENET_online pass
CM_State_3G_Unavailable pass
CM_State_3G_Available pass
CM_State_WIFI_IsolateAP pass
CM_State_WIFI_AvialableAP pass
CM_State_Accountneeded_network pass
CM_State_PROXY_Ready pass
CM_State_PROXY_Online fail #3376
CM_State_NOPROXY_READY fail #3376
CM_State_BT_Isolate_PANU pass
Switch
CM_Switch_WiFiToEth pass
CM_Switch_EthToWiFi pass
CM_Switch_WiFiToBT pass
CM_Switch_WiFiTo3G pass
CM_Switch_EthToBT pass
CM_Switch_EthTo3G pass
CM_Switch_BTToEth pass
CM_Switch_3GToEth pass
CM_Switch_BTToWiFi pass
CM_Switch_BTTo3G pass
CM_Switch_3GToWiFi pass
CM_Switch_3GToBT pass
VPN
CM_VPN_WEP fail #13039
CM_VPN_WPA fail #13039
CM_VPN_WPA2 fail #13039
CM_VPN_3G fail #13039 #10018
CM_VPN_Hidden fail #13039
CM_VPN_Wired fail #13039
CM_VPN_Disconnect fail #13039
CM_VPN_Reconnect fail #13039
CM_VPN_Autodisconnect fail #13039
CM_VPN_list_service fail #13039
CM_VPN_Disconnect_service fail #13039
Ethernet
CM_Eth_Hotplug pass
CM_Eth_Conn pass
CM_Eth_BigBroadcastPing pass
CM_Eth_Connect pass
CM_Eth_DeviceIsExist pass
CM_Eth_Disconnect pass
CM_Eth_Download pass
CM_Eth_HasDHCP pass
CM_Eth_HasIP pass
CM_Eth_IfconfigDown pass
CM_Eth_IfconfigUp pass
CM_Eth_IsPoweredOn pass
CM_Eth_IsReEnableWorks pass
CM_Eth_IsReady pass
CM_Eth_PoweredOff pass
CM_Eth_PoweredOn pass
CM_Eth_SmallBroadcastPing pass
CM_Eth_Upload pass
WIFI
CM_WF_Refresh_Disable pass
CM_WF_Refresh_Enable pass
CM_WF_CoExists_Wired pass
CM_WF_CoExists_Wired2 pass
CM_WF_CoExists_BT pass
CM_WF_CoExists_3G pass
CM_WF_Roaming_Broadcast pass
CM_WF_Roaming_Hidden pass
CM_WF_Refresh pass
CM_WG_BigBroadcastPing pass
CM_WG_Connect pass
CM_WG_DeviceIsExist pass
CM_WG_Disconnect pass
CM_WG_HasDHCP pass
CM_WG_HasIP pass
CM_WG_IfconfigDown pass
CM_WG_IfconfigUp pass
CM_WG_IsPoweredOn pass
CM_WG_IsReEnableWorks pass
CM_WG_IsReady pass
CM_WG_PoweredOff pass
CM_WG_PoweredOn pass
CM_WG_SmallBroadcastPing pass
CM_WS_RSN_Download pass
CM_WS_RSN_Upload pass
CM_WS_WEP_Download pass
CM_WS_WEP_Upload pass
WiFiFeature
CM_WA_AutoDelete pass
CM_WF_Connect_WPAPSKTKIPHide pass
CM_WF_Connect_WPA2 pass
CM_WF_Connect_WPAEnterprise pass
CM_WF_Connect_SharedWEP128Hide pass
CM_WF_Connect_OpenWEP64 pass
CM_WS_Shared pass
CM_WS_SharedHiddenWEP128 pass
CM_WS_SharedBroadcastWEP128 pass
CM_WS_SharedHiddenWEP40 pass
CM_WS_SharedBroadcastWEP40 pass
DHCP
CM_DHCP_Wried pass
CM_DHCP_3G pass
CM_DHCP_BT pass
CM_DHCP_WIFI_NoSecuBroadcast pass
CM_DHCP_WIFI_OpenWEP128 pass
CM_DHCP_WIFI_SharedWEP64 pass
CM_DHCP_WIFI_WPAPSKTKIP pass
CM_DHCP_WIFI_WPA2Hide pass
CM_DHCP_Coexit pass
CM_DHCP_Optional_list pass
CM_DHCP_Hostname fail #5194
CM_DHCP_IP_Conflict fail #4281
CM_DHCP_Suspend pass
Profile
CM_Prof_ActiveProfile Fail #2513
CM_Prof_Add pass
CM_Prof_AddExist pass
CM_Prof_List pass
CM_Prof_Remove pass
CM_Prof_RemoveNoExist pass
Property
CM_PM_ActiveProfile pass
CM_PM_AvailableTechnologies pass
CM_PM_ConnectedTechnologies pass
CM_PM_DefaultTechnology pass
CM_PM_EnabledTechnologies pass
CM_PM_OfflineMode pass
CM_PM_Profiles pass
CM_PM_State pass
CM_PM_Technologies pass
CM_PS_APN pass
CM_PS_AutoConnect pass
CM_PS_Domains pass
CM_PS_Error pass
CM_PS_Favorite pass
CM_PS_Immutable pass
CM_PS_MCC pass
CM_PS_MNC pass
CM_PS_Mode pass
CM_PS_Name pass
CM_PS_Nameservers pass
CM_PS_Passphrase pass
CM_PS_PassphraseRequired pass
CM_PS_Roaming pass
CM_PS_Security pass
CM_PS_SetupRequired pass
CM_PS_State pass
CM_PS_Strength pass
CM_PS_Type pass
_______________________________________________
connman mailing list
[email protected]
http://lists.connman.net/listinfo/connman
