Re: RUNFULLTESTS results

2018-09-23 Thread Bart Van Assche

On 9/23/18 8:15 AM, Mark Christiansen wrote:
What do these test results tell me is wrong about my build and system 
configuration? I assume they should all pass.


All regression tests pass on Linux. Most of the regression tests but not 
all of them work correctly on other platforms. Porting these tests to 
MinGW is challenging because the path syntax used by the MSYS shell 
(/c/msys/...) differs from the path syntax used by the MSYS C library 
open() function (c:\msys\...). If you search for if [ "x$OSTYPE" = 
"xmsys" ] in testing/ you will see that it took a significant effort to 
port the test scripts to MinGW.


If a test fails the first step is to figure out whether the root cause 
is in the Net-SNMP code or in the test script. Analyzing this usually 
starts with examining the files under /tmp/snmp-test-... Rerunning a 
test script with SNMP_VERBOSE=1 added to the environment may help.


Bart.


___
Net-snmp-coders mailing list
Net-snmp-coders@lists.sourceforge.net
https://lists.sourceforge.net/lists/listinfo/net-snmp-coders


RUNFULLTESTS results

2018-09-23 Thread Mark Christiansen
What do these test results tell me is wrong about my build and system
configuration? I assume they should all pass.

$ ./RUNFULLTESTS
/home/markw/net-snmp-code/testing/fulltests/temptests/T000configure_simple..ok
2/0
/home/markw/net-snmp-code/testing/fulltests/temptests/T001snmpv1get_simple..ok
5/0
/home/markw/net-snmp-code/testing/fulltests/temptests/T0141snmpv2cset_simpleok
4/0
/home/markw/net-snmp-code/testing/fulltests/temptests/T014snmpv2cget_simple.ok
2/0
/home/markw/net-snmp-code/testing/fulltests/temptests/T015snmpv2cgetnext_simple.ok
2/0
/home/markw/net-snmp-code/testing/fulltests/temptests/T0160snmpv2cbulkget_simpleok
6/0
/home/markw/net-snmp-code/testing/fulltests/temptests/T016snmpv2cgetfail_simple.ok
2/0
/home/markw/net-snmp-code/testing/fulltests/temptests/T017snmpv2ctov1getfail_simple.ok
2/0
/home/markw/net-snmp-code/testing/fulltests/temptests/T018snmpv1tov2cgetfail_simple.ok
2/0
/home/markw/net-snmp-code/testing/fulltests/temptests/T019snmpv2cnosuch_simple..ok
1/0
/home/markw/net-snmp-code/testing/fulltests/temptests/T020snmpv3get_simple..ok
1/0
/home/markw/net-snmp-code/testing/fulltests/temptests/T021snmpv3getnext_simple..ok
1/0
/home/markw/net-snmp-code/testing/fulltests/temptests/T0220snmpv3bulkget_simple.ok
6/0
/home/markw/net-snmp-code/testing/fulltests/temptests/T022snmpv3getMD5_simple...ok
1/0
/home/markw/net-snmp-code/testing/fulltests/temptests/T023snmpv3getMD5AES_simpleskipped
all skipped: HAVE_OPENSSL_AES_H is not defined
/home/markw/net-snmp-code/testing/fulltests/temptests/T023snmpv3getMD5DES_simpleok
1/0
/home/markw/net-snmp-code/testing/fulltests/temptests/T024snmpv3getSHA1_simple..ok
1/0
/home/markw/net-snmp-code/testing/fulltests/temptests/T024snmpv3getSHA512_simpleskipped
all skipped: HAVE_EVP_SHA384 is not defined
/home/markw/net-snmp-code/testing/fulltests/temptests/T025snmpv3getSHADES_simpleok
1/0
/home/markw/net-snmp-code/testing/fulltests/temptests/T026snmpv3getSHAAES_simpleFAILED
test 1
Failed 1/2 tests, 50.00% okay
/home/markw/net-snmp-code/testing/fulltests/temptests/T027snmpv3Defaults_simple.FAILED
test 1
Failed 1/2 tests, 50.00% okay
/home/markw/net-snmp-code/testing/fulltests/temptests/T028snmpv3getfail_simple..ok
1/0
/home/markw/net-snmp-code/testing/fulltests/temptests/T030snmpv3usercreation_simple.FAILED
tests 1-12
Failed 12/13 tests, 7.69% okay
/home/markw/net-snmp-code/testing/fulltests/temptests/T035snmpv3trapdusermgmt_simpleskipped
all skipped: NETSNMP_USE_OPENSSL is not defined
/home/markw/net-snmp-code/testing/fulltests/temptests/T049snmpv3inform_simple...ok
2/0
/home/markw/net-snmp-code/testing/fulltests/temptests/T049snmpv3informauth_simple...ok
1/0
/home/markw/net-snmp-code/testing/fulltests/temptests/T049snmpv3informpriv_simple...FAILED
test 1
Failed 1/2 tests, 50.00% okay
/home/markw/net-snmp-code/testing/fulltests/temptests/T050snmpv3trap_simple.FAILED
test 3
Failed 1/4 tests, 75.00% okay
/home/markw/net-snmp-code/testing/fulltests/temptests/T051snmpv2ctrap_simpleok
2/0
/home/markw/net-snmp-code/testing/fulltests/temptests/T052snmpv2cinform_simple..ok
1/0
/home/markw/net-snmp-code/testing/fulltests/temptests/T053agentv1trap_simpleskipped
all skipped: HAVE_SIGHUP is not defined
/home/markw/net-snmp-code/testing/fulltests/temptests/T054agentv2ctrap_simple...ok
2/0
/home/markw/net-snmp-code/testing/fulltests/temptests/T055agentv1mintrap_simple.ok
2/0
/home/markw/net-snmp-code/testing/fulltests/temptests/T056agentv2cmintrap_simpleok
2/0
/home/markw/net-snmp-code/testing/fulltests/temptests/T057trapdauthtest2_simple.ok
1/0
/home/markw/net-snmp-code/testing/fulltests/temptests/T057trapdauthtest3_simple.ok
2/0
/home/markw/net-snmp-code/testing/fulltests/temptests/T057trapdauthtest_simple..ok
2/0
/home/markw/net-snmp-code/testing/fulltests/temptests/T058agentauthtrap_simple..ok
2/0
/home/markw/net-snmp-code/testing/fulltests/temptests/T059trapdtraphandle_simpleskipped
all skipped: HAVE_SIGHUP is not defined
/home/markw/net-snmp-code/testing/fulltests/temptests/T060trapdperl_simple..skipped
all skipped: NETSNMP_EMBEDDED_PERL is not defined
/home/markw/net-snmp-code/testing/fulltests/temptests/T061agentperl_simple..skipped
all skipped: NETSNMP_EMBEDDED_PERL is not defined
/home/markw/net-snmp-code/testing/fulltests/temptests/T065agentextend_sh_simple.FAILED
tests 2-6
Failed 5/7 tests, 28.57% okay
/home/markw/net-snmp-code/testing/fulltests/temptests/T065agentextend_simpleFAILED
tests 1-3, 5
Failed 4/6 tests, 33.33% okay