Mark,
To make sure I understand the purpose of the license test suite....
I'm assuming you have a 'groundtruth' set of source that contain known licenses
and you are verifying that fossology correctly detects and identifies the
license(s)?
So wouldn't a report on the exceptions (i.e. missed or incorrectly identified
licenses) be the most relevant data?
Thanks,
Tom Murray
Senior Systems Engineer
Eastman Kodak Company
2400 Mt. Read Blvd
Rochester, NY 14650-3020
[email protected]
Office: (585) 726-2075 (this phone does not have voicemail)
Pager: 1-888-711-1808
[email protected] wrote: -----
To: "oslo.tools-team" <[email protected]>
From: Mark Donohoe <[email protected]>
Sent by: [email protected]
Date: 06/22/2009 06:03PM
cc: "[email protected]" <[email protected]>
Subject: [FOSSology] License Test Results
Folks,
I'm looking for some feedback, ideas. I have been working on creating a
license test suite using the eddy data. That is all working fine.
Where I have slowed down is reporting the results. (For those of you on
the list, eddy is what we call our license test data set, and a web
application that runs the tests & reports on the results).
1. I can easily create a table like eddy does that displays the results
of each test. When I did that I was overwhelmed with data! Just too
many results.
2. So I stepped back from that and was designing some smaller summary
tables, when I realized that maybe tables were just the wrong reporting
method. (just reporting the summarized results for each test type
directory would be 84 lines long (42 directories, 2 agents)).
3. I am currently looking into creating some charts. I can and will
still generate the tables, as that's what folks are used to (and that is
almost all working).
During all of this I kept asking myself, what do folks want to know
about the results?
So I'm asking you. What do you want to see in the results?
I think the following are needed:
- Reporting all of the results
- Reporting the totals could be useful. E.g. FoNomos had 50 passes and
0 failures, Bsam had 35 passes and 34 failures.
The results can be grouped by test directory, there are currently 42
'test types' used by eddy (that is there are 42 directories). I know
that the eddy tests are not all that we will ever test on. It's what we
have now. Totals per test type or test directory, is that interesting?
What else?
Thanks for your ideas.
--
Mark Donohoe
MOST/OSTT, Cupertino CA.
fossology.org
_______________________________________________
fossology mailing list
[email protected]
http://fossology.org/mailman/listinfo/fossology
_______________________________________________
fossology mailing list
[email protected]
http://fossology.org/mailman/listinfo/fossology
