On Fri, Oct 29, 2010 at 10:58 AM, David Peverley <[email protected]> wrote:
> On 29 Oct 2010, at 18:04, Garrett Cooper wrote:
>>> On my board, if I run an unsupported test (e.g. one where the kernel
>>> has not been configured) I get the following :
> ...
>
>>> Connectors 0 CONF : system doesn't support execution of the test
> ...
>
>>> INFO: ltp-pan reported all tests PASS
>>> LTP Version: LTP-20100831
>> CONF -> expected failure due to lack of support -> ok to ignore if
>> your system doesn't meet the preconditions :). tst_res(3) (yes,
>> there's a manpage) describes this in more detail, as well as a few
>> documents in LTP; they might be a bit stale though.
> Hi Garett - not quite what I was wondering about! I understand the result of 
> CONF which is expected. However this is reported by ltp-pan as a PASS at the 
> end of the test as quoted above (as well as in the results/LTP_xxxxxxx log 
> file). From my understanding and what bits of other peoples logs I could find 
> via google this should also be logged as a CONF or a WARN?
>
> I also noticed some other tests that failed as some scripts that were 
> depended on weren't present and these were being represented as a PASS in the 
> results too...

    The only thing that is reported as "errors" at the top-level
runltp scripts are TFAIL and TBROK. Everything else passes (because if
you dig through lib/tst_res.c you'll soon discover that the exit code
that's used in tst_exit is dependent on those inputs). This is by
design.
    If people abused the APIs, then the API calls need to be fixed.
Thanks,
-Garrett

------------------------------------------------------------------------------
Nokia and AT&T present the 2010 Calling All Innovators-North America contest
Create new apps & games for the Nokia N8 for consumers in  U.S. and Canada
$10 million total in prizes - $4M cash, 500 devices, nearly $6M in marketing
Develop with Nokia Qt SDK, Web Runtime, or Java and Publish to Ovi Store 
http://p.sf.net/sfu/nokia-dev2dev
_______________________________________________
Ltp-list mailing list
[email protected]
https://lists.sourceforge.net/lists/listinfo/ltp-list

Reply via email to