On Nov 13 15:29, Subrata Modak wrote:
> Sorry for not looking into this. And still did not find time to look
> into this. May be somebody will be willing to analyze this and put over
> the advantages of using it over PAN. 

Collie has many advantages over pan, but the heart of it is to make
it easier to design test scenarios.  Using one XML document, you can
describe the setup steps, multiple parallel loads, and the cleanup steps
for a complex workload.  For instance, running a memory pressure load
along side 100 tests which run in a random order, N at a time.  Collie
will capture all of the output for each command and can run specific
commands if a test passes or fails.

Another benefit of the XML format is that you can add whatever you want
to herd files without breaking collie.  That means metadata can live
beside the commands and you can use XML tools like XSLT to process herd
files.

> And as you said that it has evolved
> from pan, i would be interested to know if we can integrate this to LTP,
> which will:
> 1) Keep the base what pan has been doing,
> 2) Bring in more features in test execution and reporting results,

I think it would be better to keep collie as a stand-alone project.  I
think pan has been lost inside LTP and that's why people haven't really
used it for other things.  It's much easier to package a little tool and
get it into distributions.

> Having said that, i would also be interested to know, if this could
> perform the following, which i had posted in this mailing list some time
> back:
>       -- A mechanism to generate kernel faults before provisioning tests, the
> test case being made intelligent that the expected failure is because of
> kernel fault, and then resuming the test again. Basically trying to
> execute the same test(s) twice or more:
> i) With a faulty kernel,
> ii) Without a faulty kernel.
> 
> I hope this would help to increase the code coverage a bit. What do you
> say ?

You still need the mechanism to generate the fault and the test needs an
option to test the fault.  Collie would allow you to group those
commands into a herd.

Nate
http://fedorahosted.org/collie/

-------------------------------------------------------------------------
This SF.Net email is sponsored by the Moblin Your Move Developer's challenge
Build the coolest Linux based applications with Moblin SDK & win great prizes
Grand prize is a trip for two to an Open Source event anywhere in the world
http://moblin-contest.org/redirect.php?banner_id=100&url=/
_______________________________________________
Ltp-list mailing list
[email protected]
https://lists.sourceforge.net/lists/listinfo/ltp-list

Reply via email to