Hi all,
This is test report for ConnMan upstream connman-0.77.35.g66d7e91-1.1. In
this testing, we ran 217 cases. 186 cases passed , 15 cases failed and 16
cases blocked because of known/new bug. The pass rate was 86%. We found new
5 bugs, reopen 1 bug and verify 7 bugs. In this commit we found the bugs
that bluetooth hci0 was down after booting up system, so all the cases about
bluetooth were blocked. Connman didn't crash but there was DBusException
when set-address for IPv6 in 3G network. And we failed to ping ipv6 gateway
by the command "ping6 ::4" after set-address for IPv6 in wired or wifi
network, so we can't ssh or scp files between devices by IPv6.
New bugs
===============================================
22865 - Fail to ping ipv6 gateway by the command "ping6 ::4"
https://bugs.meego.com/show_bug.cgi?id=22865
22863 - DBusException when set-address for IPv6 in 3G network.
https://bugs.meego.com/show_bug.cgi?id=22863
22848 - can't turn wifi-connection on/off freely after disable-tethering.
https://bugs.meego.com/show_bug.cgi?id=22848
22844 - WiFi can connect with wrong WEP64 and allocate invalid IP.
https://bugs.meego.com/show_bug.cgi?id=22844
22809 - Bluetooth hci0 is down after booting up system.
https://bugs.meego.com/show_bug.cgi?id=22809
Re-open bugs:
===============================================
18743 - [REG] wifi device turns to be down when restart connmand and
wpa_supplicant or reboot.
https://bugs.meego.com/show_bug.cgi?id=18743
Verified bugs:
===============================================
22767 - Fail to set-address for IPv6 in WIFI network.
https://bugs.meego.com/show_bug.cgi?id=22767
22766 - ConnMan crashes when set_address for IPv6 in 3G network
https://bugs.meego.com/show_bug.cgi?id=22766
22765 - No gateway exists when 3g connection created
https://bugs.meego.com/show_bug.cgi?id=22765
22376 - [REG]connmand crash when set offlinemode
https://bugs.meego.com/show_bug.cgi?id=22376
22808 - power on wifi device can not make offlinemode off.
https://bugs.meego.com/show_bug.cgi?id=22808
18208 - Fail to re-connect to 3G network after disconnect
https://bugs.meego.com/show_bug.cgi?id=18208
17738 - Fail to re-connect the wifi service with static IP set
https://bugs.meego.com/show_bug.cgi?id=17738
===============================================
Testing Environment
==============================================
Hardware: netbook Eeepc 1005PE / SamSung NC110 / Ocktrail Green Ridge
Image: meego-netbook-ia32-1.2.0 / meego-netbook-ia32-1.2.0.90.12.20110809.2
/meego-tablet-ia32-oaktrail-1.2.0.90.12.20110809.2
ConnMan: connman-0.77.35.g66d7e91-1.1
Wpa_supplicant: wpa_supplicant-0.7.3-1.6
Ofono: ofono-0.53.184.g059a5c8-1.1
3G: Unicom Sim card/HuaWei e180
BT: Palm Pre/AnyCom AP/CSR dongle (disable the onboard BT device)
Wireless AP: netgear WNR2000/dlink
Test Execution Summary
==============================================
Category Total PASS FAIL N/A Comments
WiFi 70 67 3 22844
bt 14 14 22809
3G 15 15
ethernet 14 14
Advance 27 20 6 1 17826 22765 22848 22863 22865
status 35 28 6 1 11860 13407 18743 20745 22745
API 42 42
Total 216 186 15 16
Bug referred here is bug at bugs.meego.com, for example, bug #22865 refer to
http://bugs.meego.com/show_bug.cgi?id=22865
For detailed test results, please see attached files
---------------------------------------------------------------------------------------------------
Confidentiality Notice: The information contained in this e-mail and any
accompanying attachment(s)
is intended only for the use of the intended recipient and may be confidential
and/or privileged of
Neusoft Corporation, its subsidiaries and/or its affiliates. If any reader of
this communication is
not the intended recipient, unauthorized use, forwarding, printing, storing,
disclosure or copying
is strictly prohibited, and may be unlawful.If you have received this
communication in error,please
immediately notify the sender by return e-mail, and delete the original message
and all copies from
your system. Thank you.
---------------------------------------------------------------------------------------------------
ConnMan Test Report List
Date:2011-09-02
---Info---
CM_INFO_WiFiConnInfo PASS
Total:1 Pass:1, Fail:0, N/A:0
---Advance---
CM_Advance_StaticIP_Reboot PASS
CM_Advance_StaticIP_WIFI PASS
CM_Advance_http_proxy PASS
CM_Advance_web_proxy PASS
CM_Advance_StaticIP_Wired PASS
CM_Advance_NTP PASS
CM_Advance_DNS_Positive PASS
CM_Advance_Regulatory PASS
Total:8 Pass:8, Fail:0, N/A:0
---Flight---
CM_Flt_eth_autoconn PASS
CM_Flt_ConnWired PASS
CM_Flt_3G_autoconn FAIL #13407
CM_Flt_WF_autoconn PASS
CM_Flt_WF_unset_rfkill PASS
CM_Flt_WF_rfkill PASS
CM_Flt_ConnWIFI PASS
CM_Flt_Conn3G FAIL #22745
CM_Flt_WiFiIsPoweredOff PASS
CM_Flt_EthOnline PASS
CM_Flt_WiFiPoweredOff PASS
CM_Flt_EthPoweredOn PASS
CM_Flt_EthNoPing PASS
CM_Flt_Service FAIL #22745
CM_Flt_EthPoweredOff PASS
CM_Flt_WiFiNoPing PASS
CM_Flt_EthIsPoweredOff PASS
CM_Flt_WiFiPoweredOn PASS
CM_Flt_Online PASS
CM_Flt_WiFiOnline PASS
Total:20 Pass:17, Fail:3, N/A:0
---Tethering---
CM_Tethering_disabled FAIL #22756 22848
CM_Tethering_scp PASS
CM_Tethering_multiple_connection PASS
CM_Tethering_server_suspend PASS
CM_Tethering_ping_clients PASS
CM_Tethering_ssh PASS
CM_Tethering_connection PASS
CM_Tethering_client_suspend PASS
CM_Tethering_wifi_connection PASS
CM_Tethering_surfing PASS
Total:10 Pass:9, Fail:1, N/A:0
---NetworkSel---
CM_NetworkSel_Best PASS
CM_NetworkSel_BroadcastNoSec PASS
CM_NetworkSel_HideWEP PASS
CM_NetworkSel_NoneToWPA PASS
CM_NetworkSel_HideNoSec PASS
CM_NetworkSel_BroadcastWEP PASS
CM_NetworkSel_HiddenWPAToNone PASS
CM_NetworkSel_HideWPA PASS
CM_NetworkSel_NoneToHiddenWEP PASS
CM_NetworkSel_WEPToNone PASS
CM_NetworkSel_HiddenWPAToWEP PASS
Total:11 Pass:11, Fail:0, N/A:0
---Signal---
CM_Signal_MoveWiFi PASS
CM_SS_AutoConnect PASS
CM_SC_ConnectedTechnologies PASS
CM_SC_Favorite PASS
CM_SC_IPv4 PASS
CM_SC_State PASS
CM_SC_Powered PASS
CM_SM_State PASS
CM_SC_EnabledTechnologies PASS
CM_SM_ConnectedTechnologies PASS
CM_SC_Scanning PASS
CM_SS_Favorite PASS
CM_SC_Services PASS
CM_SC_DefaultTechnology PASS
CM_SS_IPv4 PASS
CM_SS_Passphrase PASS
CM_SC_OfflineMode PASS
CM_SM_DefaultTechnology PASS
CM_SM_Services PASS
CM_SM_EnabledTechnologies PASS
CM_SC_Connected PASS
CM_SM_Strength PASS
Total:22 Pass:22, Fail:0, N/A:0
---WiFi---
CM_WF_wps_pbc PASS
CM_WF_wps_pin PASS
CM_WF_Roaming_Broadcast PASS
CM_WG_HasDHCP PASS
CM_WG_IsReady PASS
CM_WG_IsPoweredOn PASS
CM_WG_IsReEnableWorks PASS
CM_WS_RSN_Upload PASS
CM_WG_PoweredOff PASS
CM_WG_HasIP PASS
CM_WG_Connect PASS
CM_WS_RSN_Download PASS
CM_WG_PoweredOn PASS
CM_WG_Disconnect PASS
CM_WS_WEP_Upload PASS
CM_WG_BigBroadcastPing PASS
CM_WG_SmallBroadcastPing PASS
CM_WS_WEP_Download PASS
Total:18 Pass:18, Fail:0, N/A:0
---WiFiFeature---
CM_WA_ForgotPassword FAIL #22844
CM_WA_DetectSecurityWPA PASS
CM_WN_WEP64Wrong FAIL #22844
CM_WN_WEP64Short PASS
CM_WS_Hidden PASS
CM_WA_DetectSecurityWEP PASS
CM_WN_WEP64Long FAIL #22844
CM_WN_WEP128Short PASS
CM_WA_AutoConnectFromSuspend PASS
CM_WA_DetectSecurityRSN PASS
CM_WS_OpenBroadcastRSN PASS
CM_WA_DetectSecurityNone PASS
CM_WS_Open PASS
CM_WS_OpenHiddenTKIP PASS
CM_WS_PSK2 PASS
CM_WS_WEP128ascii PASS
CM_WS_OpenBroadcastTKIP PASS
CM_WS_RSN PASS
CM_WF_Channel6 PASS
CM_WF_Channel7 PASS
CM_WF_Channel4 PASS
CM_WF_Channel5 PASS
CM_WF_Channel2 PASS
CM_WF_Channel3 PASS
CM_WF_Channel8 PASS
CM_WF_Channel9 PASS
CM_WN_WEP128Long PASS
CM_WS_OpenBroadcastWEP128 PASS
CM_WS_PSK1 PASS
CM_WS_OpenHiddenWEP40 PASS
CM_WS_Broadcast PASS
CM_WN_WEP128Wrong PASS
CM_WA_RememberPasswd PASS
CM_WN_WEP128ascii PASS
CM_WS_OpenHiddenRSN PASS
CM_WS_OpenBroadcastWEP40 PASS
CM_WF_Channel10 PASS
CM_WF_Channel11 PASS
CM_WS_WPA PASS
CM_WS_OpenHiddenWEP128 PASS
CM_WS_WEP128 PASS
Total:41 Pass:38, Fail:3, N/A:0
---BT---
CM_BT_Connect_PAN N/A block by 22809
CM_BT_PoweredOff N/A block by 22809
CM_BT_HasIP N/A block by 22809
CM_BT_IsPoweredOn N/A block by 22809
CM_BT_Disconnect N/A block by 22809
CM_BT_Connect N/A block by 22809
CM_BT_HasDHCP N/A block by 22809
CM_BT_Download N/A block by 22809
CM_BT_SmallPing N/A block by 22809
CM_BT_Upload N/A block by 22809
CM_BT_IsReady N/A block by 22809
CM_BT_IsReEnableWorks N/A block by 22809
CM_BT_BigPing N/A block by 22809
CM_BT_PoweredOn N/A block by 22809
Total:14 Pass:0, Fail:0, N/A:14
---State---
CM_State_3G_Available PASS
Total:1 Pass:1, Fail:0, N/A:0
---AutoConn---
CM_AutoConn_FavoriteSetting PASS
CM_Autoconn_RememWPAPSKTKIP PASS
CM_AutoConn_RebootWIFI PASS
CM_AutoConn_SuspendMem3G FAIL #20745
CM_AutoConn_RememWEP64 PASS
CM_AutoConn_SuspendMemWired PASS
CM_AutoConn_LostConn PASS
CM_AutoConn_RebootWired PASS
CM_AutoConn_Reboot3G N/A block by 18743
CM_Autoconn_HIDDEN_Rem FAIL #11860
CM_AutoConn_SuspendMemWIFI PASS
Total:11 Pass:8, Fail:2, N/A:1
---Pacrunner---
CM_PR_internet_direct_3g FAIL #17826
CM_PR_intranet_eth FAIL #17826
CM_PR_intranet_proxy FAIL #17826
Total:3 Pass:0, Fail:3, N/A:0
---IPv6---
CM_IPv6_eth_set_address PASS
CM_IPv6_ping6_gateway FAIL #22865
CM_IPv6_route PASS
CM_IPv6_ssh N/A block by 22865
CM_IPv6_WF_set_address PASS
CM_IPv6_3G_set_address FAIL #22863
Total:6 Pass:3, Fail:2, N/A:1
---Device---
CM_Device_WIFI_Reboot FAIL #18743
CM_Device_WIFI_Conn PASS
Total:2 Pass:1, Fail:1, N/A:0
---Ethernet---
CM_Eth_DNS_PROXY PASS
CM_Eth_SmallBroadcastPing PASS
CM_Eth_BigBroadcastPing PASS
CM_Eth_Disconnect PASS
CM_Eth_Download PASS
CM_Eth_HasDHCP PASS
CM_Eth_Connect PASS
CM_Eth_IsReEnableWorks PASS
CM_Eth_HasIP PASS
CM_Eth_IsPoweredOn PASS
CM_Eth_PoweredOn PASS
CM_Eth_Upload PASS
CM_Eth_IsReady PASS
CM_Eth_PoweredOff PASS
Total:14 Pass:14, Fail:0, N/A:0
---Property---
CM_PS_Error PASS
CM_PM_DefaultTechnology PASS
CM_PM_AvailableTechnologies PASS
CM_PS_Nameservers PASS
CM_PM_Technologies PASS
CM_PS_PassphraseRequired PASS
CM_PS_State PASS
CM_PS_Immutable PASS
CM_PS_Passphrase PASS
CM_PS_AutoConnect PASS
CM_PM_OfflineMode PASS
CM_PS_Favorite PASS
CM_PM_EnabledTechnologies PASS
CM_PS_Type PASS
CM_PS_Security PASS
CM_PS_Name PASS
CM_PS_Strength PASS
CM_PS_Domains PASS
CM_PS_Mode PASS
CM_PM_ConnectedTechnologies PASS
Total:20 Pass:20, Fail:0, N/A:0
---3G---
CM_3G_Reconnect PASS
CM_3G_DeviceControl PASS
CM_3G_PoweredOff PASS
CM_3G_BigPing PASS
CM_3G_Download PASS
CM_3G_Connect PASS
CM_3G_SmallPing PASS
CM_3G_Disconnect PASS
CM_3G_Upload PASS
CM_3G_HasIP PASS
CM_3G_IsReEnableWorks PASS
CM_3G_PoweredOn PASS
CM_3G_DeviceIsExist PASS
CM_3G_IsReady PASS
CM_3G_IsPoweredOn PASS
Total:15 Pass:15, Fail:0, N/A:0
----------------------------------------------------
Total: 217, Pass: 186, Fail: 15, N/A: 16
PassRate of executed: 86%
FEAGroup Feature Score Comments
------------------------------------------------------------------------------
WiFI
EAP - Not Test
Network-sel Good
Wpa-suplicant D-BUS Good
Manual switch connect Good
connect to Broadcast AP Good
connect to Hidden AP Good
Hidden Group AP Good
WiFiFeature
WEP 40/128-bit key Good
WiFi Protected Setup pairing (WPS) Good
WEP 128-bit passphrase Good
WPA personal Good
WPA2 personal Good
Open system Good
Shared Key Good
Remember passwd Good
forgot password Good Bug 22844
AP security detect Good
auto del non-exist AP Good
VPN
- - Not Test
OpenVPN
- - Not Test
Status
coexist Good
State Good
Device Good
Info Good
Flight Good Bug 13407
22745
AutoConnect
reboot Good Bug 11860
offline Good
suspend Buggy Bug 17925
20745
favorite connection Good
auto connectivity order Good
Advance
DNS Proxy Good
Static IP Good
IPv6 Buggy Bug 22863
22865
Pacrunner Buggy Bug 17826
Proxy Good
DHCP Good
NTP Good
regulatory Good
Tethering
WiFi tethering Buggy Bug
22756,22848
bluetooth tethering Good
usb tethering -
BT
Scan Buggy Bug 22809
Pair Buggy Bug 22809
Connect Buggy Bug 22809
dataTransfer Buggy Bug 22809
Ethernet
connect Good
datatransfer Good
3G
PPP Buggy Bug 22745
3G Buggy Bug 22745
Datatransfer Buggy
API
property Good
signal Good
_______________________________________________
connman mailing list
[email protected]
http://lists.connman.net/listinfo/connman
