Jeffrey,
Jeffrey Huang wrote: > Hi, Ethan, > > Ethan Quach ??: >> Jeffrey, >> >> I'm filling in for Sundar this week, so just catching up. I have >> a couple of questions/comments about the test results ... >> >> 1. What does the result code of "Uninitialized" mean? Are >> these failures we need to look at and address as bugs? >> What does the result code of "Other" mean? > > Thanks very much to look into the report details. > The "Uninitialized" of this test suite happened when adding a test > manifest to > AI service, caused by 2 reasons: > 1. product bugs that failed to add certain manifest to service. > 2. Test env of last execution is not very well cleaned > Now, I am manually verifying above cases if "Uninitialized" happened, > I will improve the > clean up process so only manifest bugs will cause uninitialized. It would good to know the cases where (1) happened as well. > > "Other" caused by 2 reasons: > 1. Test case aborted by unexpected reason. ( We will improve > individual case to avoid them) > 2. Disk partition features not supported on SPARC platform. These > cases should be reported > as Unsupported, unfortunately, the TET/CTI report harness can not > identify it.) Thanks for the explanation. > >> >> 2. In the summary.html Details section, it would be nice if the >> Fail/Other column was split out into three columns -- >> Fail, Unintialized, and Other so that we can quickly find the >> kind we're looking for. > > Yes, 3 columns would be much better, we plan to improve the report in > 2 two ways: > 1. Enhance TET/CTI report harness to list category in different > columns and also identify > unsupported cases. > 2. We also manually add notation to the failed cases with further > detailed info in next > test report. I had one more question below from the previous mail ... >> >> >>> BTW, in build 111, I see AI manifest supports install package other >>> than >>> default build in repo, >>> seems this feature is not from the design doc, also it is not >>> covered by >>> our test plan and test suite right >>> now. >>> >> >> Need clarification. Are you referring to the list of packages which >> are now in the default manifest? i.e: >> >> <ai_install_packages> >> <pkg name="SUNWcsd"/> >> <pkg name="SUNWcs"/> >> <pkg name="babel_install"/> >> <pkg name="entire"/> >> </ai_install_packages> >> <ai_uninstall_packages> >> <pkg name="babel_install"/> >> <pkg name="slim_install"/> >> </ai_uninstall_packages> >> >> >> >> thanks, >> -ethan >> >
