Hi all,
This is test report for ConnMan upstream connman-0.72.71.g16fec4d. In this
testing, we ran 352 cases. 332 cases passed and 20 case failed because
of known/new bug. The pass rate is 94%. We found 4 new bugs and verify 7 bug
http://bugs.meego.com/show_bug.cgi?id=
Verified Bugs
===============================================
Bug 15026 - wrong state "ready" instead of "online" when connect to internet
through ADSL ethernet cable.
http://bugs.meego.com/show_bug.cgi?id=15026
Bug 14753 - wrong state "ready" instead of "online" when connect to an ADSL
wifi.
http://bugs.meego.com/show_bug.cgi?id=14753
Bug 1993 - 3G state is ready instead of online when we can surf web through 3G
connection.
http://bugs.meego.com/show_bug.cgi?id=1993
Bug 14940 - ConnMan crashes when connect to openvpn service with "connect-vpn".
http://bugs.meego.com/show_bug.cgi?id=14940
Bug 14518 - ConnMan crashes when upload a 10MB file through 3G.
http://bugs.meego.com/show_bug.cgi?id=14518
Bug 13460 - The Wired switcher is useless after set ifconfig eth0 down.
http://bugs.meego.com/show_bug.cgi?id=13460
Bug 14204 - ConnMan crashes when resume from S3 with 3G connected.
http://bugs.meego.com/show_bug.cgi?id=14204
New bugs
===============================================
Bug 16306 - cannot automatically connect the previous BT service when resume
from offlinemode.
http://bugs.meego.com/show_bug.cgi?id=16306
Bug 16187 - openconnect needs input to connmand.
http://bugs.meego.com/show_bug.cgi?id=16187
Bug 16425 - the bluetooth tethering service can not be scanned frequently by
client.
http://bugs.meego.com/show_bug.cgi?id=16425
Bug 16424 - bluetooth tethering connection cannot resume when meego resumes
from S3.
http://bugs.meego.com/show_bug.cgi?id=16424
Testing Environment
==============================================
Hardware: netbook ACER AspireOne NAV50/Eeepc 1005PE
Image: meego-netbook-ia32-1.1.99.1.20110405.3
ConnMan: connman-0.72.71.g16fec4d-1.1.i586
Ofono: ofono-0.47-1.1.i586
3G: Unicom Sim card/HuaWei em770w
BT: Palm Pre/AnyCom AP/CSR dongle
Wireless AP: Linksys/Asus/Cisco 1252/netgear
Test Execution Summary
==============================================
Feature Total Pass Fail Comments
Ethernet 19 19
WiFi 40 40
3G 29 28 1 #13017
BT 21 21
VPN - - - #Not Test
Switch 12 12 0
Signal 13 13
IPV6 18 15 3 #12698
Flight 34 33 1 #16306
Launch 8 8
Info 15 15
Device 12 12
NetworkSel 11 11
Autoconnect 13 10 3 #11860
Advance 17 16 1 #5194
State 9 9 0
DHCP 13 11 2 #4281 #5194
Profile 6 5 1 #2513
Property 28 28
Pacrunner 11 7 4 #14744
OpenVPN 7 7 0 #14940
EAP 6 6 0
Tethering 10 6 4 #15048
Total 352 332 20
Bug refered hern is bug at bugs.meego.com, for example, bug #16306 refer to
http://bugs.meego.com/show_bug.cgi?id=16306.
For detailed test results, please see attached file.
Quality indicator
==============================================
Feature Score Comments
WiFi Good Bug 5241,10768
Intel WiMAX N/A QA does not have WiMAX test environment
Bluetooth PAN Good Bug 6956
3G data Buggy Bug 6028, 10211, 13017, 13681, 13682
Wired (LAN) Good
State Buggy Bug 13904
Flight Good
Network Selection Good
wpa-suplicant D-BUS Good
profile management Good Bug 2513
manual switch connect Good
Wired/WiFi co-exexist Good
Remember device status Good
connect to Broadcast AP Good
connect to Hidden AP Good
Hidden Group AP Good
auto connect reboot Good
auto connect Offline Good
auto connect suspend Good
favorite connection Good
auto connectivity order Good
WEP 40/128-bit key Good
WEP 128-bit passphrase Good
WPA personal Good
WPA2 personal Good Bug 14524
Open system Good
Shared Key Good
Remember passwd Good
forgot password Good
AP security detect Good
auto del non-exist AP Good
VPN Block #10555
Plugin to oFono Good
DNS Proxy Good
DNS support via DHCP Good
Static IP Good #12698
PPP 3G Good
WPA-enterprise Good
dhcp-lib Good #4281
ipv6 Good #12698
pacrunner Buggy #14744
OpenVPN Good
Tethering Good #15048
TTLS Good
3G
CM_3G_Coexist pass
CM_3G_Coexist_Priority pass
CM_3G_DeviceControl pass
CM_3G_DeviceControl_Offline pass
CM_3G_Item_Configuring pass
CM_3G_Item_Disconnect pass
CM_3G_Service_Surf pass
CM_3G_Reconnect pass
CM_3G_Item_Connect fail #13017
CM_3G_Service_Download pass
CM_3G_Service_Roaming pass
CM_3G_BigPing pass
CM_3G_Connect pass
CM_3G_DeviceIsExist pass
CM_3G_Disconnect pass
CM_3G_Download pass
CM_3G_HasDHCP pass
CM_3G_HasIP pass
CM_3G_IfconfigDown pass
CM_3G_IfconfigUp pass
CM_3G_IsPoweredOn pass
CM_3G_IsReEnableWorks pass
CM_3G_IsReady pass
CM_3G_PoweredOff pass
CM_3G_PoweredOn pass
CM_3G_SmallPing pass
CM_3G_Upload pass
CM_3G_TCP_DNS pass
CM_3G_PPP pass
BT
CM_BT_CheckProp_Powered pass
CM_BT_Connect_PAN pass
CM_BT_List_PAN pass
CM_BT_Connect_Invalidnetwork pass
CM_BT_Check_State pass
CM_BT_BigPing pass
CM_BT_Connect pass
CM_BT_DeviceIsExist pass
CM_BT_Disconnect pass
CM_BT_Download pass
CM_BT_HasDHCP pass
CM_BT_HasIP pass
CM_BT_IfconfigDown pass
CM_BT_IfconfigUp pass
CM_BT_IsPoweredOn pass
CM_BT_IsReEnableWorks pass
CM_BT_IsReady pass
CM_BT_PoweredOff pass
CM_BT_PoweredOn pass
CM_BT_SmallPing pass
CM_BT_Upload pass
Advance
CM_Advance_StaticIP_reboot pass
CM_Advance_StaticIP_Wired pass
CM_Advance_StaticIP_WIFI pass
CM_Advance_Hostname fail #5194
CM_Advance_StaticIP_BT pass
CM_Advance_ProfileName pass
CM_profile_delete pass
CM_Advance_ProfileCreate pass
CM_Advance_DNS_Set pass
CM_Advance_DNS_Negative pass
CM_Advance_DNS_Positive pass
CM_Advance_http_proxy pass
CM_Advance_web_proxy pass
CM_Advance_eth_wpad pass
CM_Advance_WF_wpad pass
CM_Advance_BT_wpad pass
CM_Advance_3G_wpad pass
AutoConn
CM_AutoConn_FavoriteSetting pass
CM_AutoConn_Reboot3G pass
CM_AutoConn_RebootWIFI pass
CM_AutoConn_RebootWired pass
CM_AutoConn_SuspendMem3G pass
CM_AutoConn_SuspendMemWIFI pass
CM_AutoConn_SuspendMemWired pass
CM_Autoconn_RememWPAPSKTKIP pass
CM_AutoConn_RememWEP64 pass
CM_AutoConn_LostConn pass
CM_Autoconn_HIDDEN_Rem WEP128 fail #11860
CM_Autoconn_HIDDEN_Rem NoSecu fail #11860
CM_Autoconn_HIDDEN_Rem WPAPSKAES fail #11860
Device
CM_Device_Wired pass
CM_Device_3G_Conn pass
CM_Device_3G_Reboot pass
CM_Device_3G pass
CM_Device_BT_Conn pass
CM_Device_BT_Reboot pass
CM_Device_BT pass
CM_Device_WIFI_Conn pass
CM_Device_WIFI_Reboot pass
CM_Device_WIFI pass
CM_Device_Wired_Conn pass
CM_Device_Wired_Reboot pass
Info
CM_INFO_ManagerStateEthOnline pass
CM_INFO_ManagerStateEthOffline pass
CM_INFO_ManagerStateWiFiOnline pass
CM_INFO_ManagerStateWiFiOffline pass
CM_INFO_ManagerStateBTOnline pass
CM_INFO_ManagerStateBTOffline pass
CM_INFO_ProfileDefault pass
CM_INFO_EthConnInfo pass
CM_INFO_BtConnInfo pass
CM_INFO_WiFiConnInfo pass
CM_INFO_NoConnList pass
CM_INFO_SetIPBT pass
CM_INFO_TurnOn_FlightMode pass
CM_INFO_Exit_FlightMode pass
CM_INFO_MultiConnection pass
Launch
CM_Launch_boot pass
CM_Launch_BT pass
CM_Launch_WpaSupplicant pass
CM_Launch_reboot pass
CM_Launch_cpu pass
CM_Launch_profile pass
CM_Launch_OneConnmand pass
CM_Launch_with_profile pass
NetworkSel
CM_NetworkSel_BroadcastNoSec pass
CM_NetworkSel_HideWPA pass
CM_NetworkSel_HideWEP pass
CM_NetworkSel_HideNoSec pass
CM_NetworkSel_Best pass
CM_NetworkSel_BroadcastWEP pass
CM_NetworkSel_NoneToWPA pass
CM_NetworkSel_HiddenWPAToNone pass
CM_NetworkSel_NoneToHiddenWEP pass
CM_NetworkSel_WEPToNone pass
CM_NetworkSel_HiddenWPAToWEP pass
Flight
CM_Flt_Persistance pass
CM_Flt_Conn3G pass
CM_Flt_ConnWired pass
CM_Flt_set pass
CM_Flt_ConnWIFI pass
CM_Flt_set_eth_device pass
CM_Flt_eth_autoconn pass
CM_Flt_eth_remember_off pass
CM_Flt_WF_rfkill pass
CM_Flt_WF_unset_rfkill pass
CM_Flt_BT_rfkill pass
CM_Flt_BT_unset_rfkill pass
CM_Flt_set_BT_device pass
CM_Flt_BT_autoconn fail #16306
CM_Flt_BT_remember_off pass
CM_Flt_set_WF_device pass
CM_Flt_WF_autoconn pass
CM_Flt_WF_remember_off pass
CM_Flt_set_3G_device pass
CM_Flt_3G_autoconn pass
CM_Flt_3G_remember_off pass
CM_Flt_EthIsPoweredOff pass
CM_Flt_EthNoPing pass
CM_Flt_EthOnline pass
CM_Flt_EthPoweredOff pass
CM_Flt_EthPoweredOn pass
CM_Flt_Offline pass
CM_Flt_Online pass
CM_Flt_Service pass
CM_Flt_WiFiIsPoweredOff pass
CM_Flt_WiFiNoPing pass
CM_Flt_WiFiOnline pass
CM_Flt_WiFiPoweredOff pass
CM_Flt_WiFiPoweredOn pass
Signal
CM_Signal_RmvEthCable pass
CM_Signal_DisableWiFiDev pass
CM_Signal_RmvBT pass
CM_Signal_MoveBT pass
CM_Signal_MoveWiFi pass
CM_Signal_Move3G pass
CM_Signal_State pass
CM_Signal_Error pass
CM_Signal_List_Networks pass
CM_Signal_Set_PassphraseRequired pass
CM_Signal_Change_Passphrase pass
CM_Signal_Set_Flightmode pass
CM_Signal_StaticIPEth pass
IPV6
CM_IPv6_set_address pass
CM_IPv6_set_address_addr pass
CM_IPv6_set_address_prefix pass
CM_IPv6_set_address_gateway pass
CM_IPv6_ping6_addr pass
CM_IPv6_ping6_local pass
CM_IPv6_ping6_gateway N/A
CM_IPv6_route pass
CM_IPv6_scp pass
CM_IPv6_ssh pass
CM_IPv6_ssh_server pass
CM_IPv6_eth_set_address pass
CM_IPv6_eth_ping6_addr pass
CM_IPv6_eth_ssh pass
CM_IPv6_WF_set_address pass
CM_IPv6_BT_set_address fail #12698
CM_IPv6_WF_ping6_addr pass
CM_IPv6_BT_ping6_addr fail #12698
CM_IPv6_WF_ssh pass
CM_IPv6_BT_ssh fail #12698
State
CM_State_ETHENET_idle pass
CM_State_ETHENET_online pass
CM_State_3G_Unavailable pass
CM_State_3G_Available pass
CM_State_WIFI_IsolateAP pass
CM_State_WIFI_AvialableAP pass
CM_State_Accountneeded_network pass
CM_State_PROXY_Ready pass
CM_State_PROXY_Online N/A
CM_State_NOPROXY_READY N/A
CM_State_BT_Isolate_PANU pass
Switch
CM_Switch_WiFiToEth pass
CM_Switch_EthToWiFi pass
CM_Switch_WiFiToBT pass
CM_Switch_WiFiTo3G pass
CM_Switch_EthToBT pass
CM_Switch_EthTo3G pass
CM_Switch_BTToEth pass
CM_Switch_3GToEth pass
CM_Switch_BTToWiFi pass
CM_Switch_BTTo3G pass
CM_Switch_3GToWiFi pass
CM_Switch_3GToBT pass
VPN
CM_VPN_WEP N/A
CM_VPN_WPA N/A
CM_VPN_WPA2 N/A
CM_VPN_3G N/A
CM_VPN_Hidden N/A
CM_VPN_Wired N/A
CM_VPN_Disconnect N/A
CM_VPN_Reconnect N/A
CM_VPN_Autodisconnect N/A
CM_VPN_list_service N/A
CM_VPN_Disconnect_service N/A
Ethernet
CM_Eth_Hotplug pass
CM_Eth_Conn pass
CM_Eth_BigBroadcastPing pass
CM_Eth_Connect pass
CM_Eth_DeviceIsExist pass
CM_Eth_Disconnect pass
CM_Eth_Download pass
CM_Eth_HasDHCP pass
CM_Eth_HasIP pass
CM_Eth_IfconfigDown pass
CM_Eth_IfconfigUp pass
CM_Eth_IsPoweredOn pass
CM_Eth_IsReEnableWorks pass
CM_Eth_IsReady pass
CM_Eth_PoweredOff pass
CM_Eth_PoweredOn pass
CM_Eth_SmallBroadcastPing pass
CM_Eth_Upload pass
CM_Eth_TCP_DNS pass
WIFI
CM_WF_Refresh_Disable pass
CM_WF_Refresh_Enable pass
CM_WF_CoExists_Wired pass
CM_WF_CoExists_Wired2 pass
CM_WF_CoExists_BT pass
CM_WF_CoExists_3G pass
CM_WF_Roaming_Broadcast pass
CM_WF_Roaming_Hidden pass
CM_WF_Refresh pass
CM_WG_BigBroadcastPing pass
CM_WG_Connect pass
CM_WG_DeviceIsExist pass
CM_WG_Disconnect pass
CM_WG_HasDHCP pass
CM_WG_HasIP pass
CM_WG_IfconfigDown pass
CM_WG_IfconfigUp pass
CM_WG_IsPoweredOn pass
CM_WG_IsReEnableWorks pass
CM_WG_IsReady pass
CM_WG_PoweredOff pass
CM_WG_PoweredOn pass
CM_WG_SmallBroadcastPing pass
CM_WS_RSN_Download pass
CM_WS_RSN_Upload pass
CM_WS_WEP_Download pass
CM_WS_WEP_Upload pass
CM_WF_wps_pbc pass
CM_WF_wps_pin pass
WiFiFeature
CM_WA_AutoDelete pass
CM_WF_Connect_WPAPSKTKIPHide pass
CM_WF_Connect_WPA2 pass
CM_WF_Connect_WPAEnterprise pass
CM_WF_Connect_SharedWEP128Hide pass
CM_WF_Connect_OpenWEP64 pass
CM_WS_Shared pass
CM_WS_SharedHiddenWEP128 pass
CM_WS_SharedBroadcastWEP128 pass
CM_WS_SharedHiddenWEP40 pass
CM_WS_SharedBroadcastWEP40 pass
DHCP
CM_DHCP_Wried pass
CM_DHCP_3G pass
CM_DHCP_BT pass
CM_DHCP_WIFI_NoSecuBroadcast pass
CM_DHCP_WIFI_OpenWEP128 pass
CM_DHCP_WIFI_SharedWEP64 pass
CM_DHCP_WIFI_WPAPSKTKIP pass
CM_DHCP_WIFI_WPA2Hide pass
CM_DHCP_Coexit pass
CM_DHCP_Optional_list pass
CM_DHCP_Hostname fail #5194
CM_DHCP_IP_Conflict fail #4281
CM_DHCP_Suspend pass
Profile
CM_Prof_ActiveProfile Fail #2513
CM_Prof_Add pass
CM_Prof_AddExist pass
CM_Prof_List pass
CM_Prof_Remove pass
CM_Prof_RemoveNoExist pass
Property
CM_PM_ActiveProfile pass
CM_PM_AvailableTechnologies pass
CM_PM_ConnectedTechnologies pass
CM_PM_DefaultTechnology pass
CM_PM_EnabledTechnologies pass
CM_PM_OfflineMode pass
CM_PM_Profiles pass
CM_PM_State pass
CM_PM_Technologies pass
CM_PS_APN pass
CM_PS_AutoConnect pass
CM_PS_Domains pass
CM_PS_Error pass
CM_PS_Favorite pass
CM_PS_Immutable pass
CM_PS_MCC pass
CM_PS_MNC pass
CM_PS_Mode pass
CM_PS_Name pass
CM_PS_Nameservers pass
CM_PS_Passphrase pass
CM_PS_PassphraseRequired pass
CM_PS_Roaming pass
CM_PS_Security pass
CM_PS_SetupRequired pass
CM_PS_State pass
CM_PS_Strength pass
CM_PS_Type pass
Tethering
CM_Tethering_BT_surfing fail #15048
CM_Tethering_BT_connection pass
CM_Tethering_BT_mult_connection fail #15048
CM_Tethering_BT_ping_clients pass
CM_Tethering_BT_ssh pass
CM_Tethering_BT_scp pass
CM_Tethering_BT_server_suspend fail #16424
CM_Tethering_BT_client_suspend fail #16424
CM_Tethering_BT_disabled pass
CM_Tethering_wifi_connection pass
CM_Tethering_usb_connection N/A
Pacrunner
CM_PR_intranet_wpad_url pass
CM_PR_intranet_proxy pass
CM_PR_intranet_wireless N/A
CM_PR_intranet_eth pass
CM_PR_intranet_direct_wireless N/A
CM_PR_intranet_direct_eth pass
CM_PR_internet_direct_wireless pass
CM_PR_internet_direct_3g pass
CM_PR_intranet_manual_set_proxy pass
CM_PR_broswer_intranet fail #14744
CM_PR_broswer_internet fail #14744
CM_PR_broswer_switch fail #14744
CM_PR_device_switch fail #14744
OpenVPN
CM_VPN_OpenVPN_Connect pass
CM_VPN_OpenVPN_Ping pass
CM_VPN_OpenVPN_Transfer pass
CM_VPN_OpenVPN_Disconnect pass
CM_VPN_OpenVPN_Reconnect pass
CM_VPN_OpenVPN_List pass
CM_VPN_OpenVPN_Disconnect_lower pass
EAP
CM_WS_EAP_TLS pass
CM_WS_EAP_PEAP pass
CM_WS_EAP_TTLS_MSCHAPV2 pass
CM_WS_EAP_TTLS_MSCHAP pass
CM_WS_EAP_TTLS_CHAP pass
CM_WS_EAP_TTLS_MD5 pass
CM_WS_EAP_TTLS_PAP N/A
_______________________________________________
connman mailing list
[email protected]
http://lists.connman.net/listinfo/connman
