----- Original Message ----- > From: [email protected] > To: "Jan Stancek" <[email protected]> > Cc: [email protected] > Sent: Thursday, 6 December, 2012 3:13:36 PM > Subject: Re: [LTP] open posix testsuite and names of testcases > > Hi! > > this testsuite has many testcases, where binary name is in format: > > [number]-[number].run-test > > This is not very helpful when trying to find out, which one > > actually > > crashed or which one is responsible for kernel oops/hung tasks. > > For example if I get in dmesg: > > [ 702.018706] 1-5.run-test[10140]: segfault at 7f84e724bed8 ip > > 0000000000402208 sp 00007f84e724bed0 error 6 in > > 1-5.run-test[400000+4000] > > it's not clear, which testcase is responsible. > > Here in suse we use CTCS2 to run the testcases and we have a perl > script > that generates the the test names accordingly to the directory > structure > which doesn't help when looking into the kernel log but the segfault > is logged into the test results anyway. > > And mostly because of that the current test execution framework both > for > LTP and Open Posix Testsuite is a little out of my radar, although I > would like to have them fixed too. > > > Does anyone have some ideas? > > > > I had these two: > > 1. rename all testcases - lot of work, they are also referenced in > > some .sh scripts > > 2. modify run-tests.sh to copy it under more verbose name and run > > that one > > Well I don't think that the option one is that hard, at least I'm not > aware of much cases of hardcoded names in the Open Posix Testsuite. > On > the other hand having better test driver that executes the tests and > presents the result in more convinient way would be more appealing. > Or > we can do both of them.
I think we should do the renaming anyway. Would the following format work for everyone? "testdirname-[number]-[number].c" For example: pthread_create-1-5.c It's unique, and it's easy to tell what old name was. > I was thinking of creating a relatively simply test driver that runs > the > tests, takes care of timeouts (and anything else) and logs > information > in some reasonable format (I used JSON in similar case). And then > about > some tools that could compare the results, print list of failed > testcases and so on. Does that sound reasonable? How would this be related to ltp-pan? Would this be only for open posix testsuite or also for LTP? Regards, Jan ------------------------------------------------------------------------------ LogMeIn Rescue: Anywhere, Anytime Remote support for IT. Free Trial Remotely access PCs and mobile devices and provide instant support Improve your efficiency, and focus on delivering more value-add services Discover what IT Professionals Know. Rescue delivers http://p.sf.net/sfu/logmein_12329d2d _______________________________________________ Ltp-list mailing list [email protected] https://lists.sourceforge.net/lists/listinfo/ltp-list
