For the record, these problems surrounding conformance are the reason
that I am generally unwilling to sponsor integration of these projects
-- I don't know anything about the test suites or how to run them, and I
really don't have the time to learn unless they were shown to be really
straight-forward.
Conversely, I *can* sponsor ARC cases for these, because for the most
part, we don't have to worry about testing of conformance at ARC --
that's an "implementation detail" (albeit an important one.)
- Garrett
On 03/12/10 04:51 PM, Alan Burlison wrote:
> On 13/03/2010 00:43, Don Cragun wrote:
>
>> I realize that. I was just trying to reassure Alan and Garrett that
>> the project team that has been replacing "closed", "standard" utilities
>> with AST code (whether stand-alone or built into ksh93 has always made
>> sure that the code passes the VSC tests by fixing the code or by
>> getting TOG to fix the test suite (with Sun's help) before integrating
>> into the ON source base.
>
> Yes, that's what I was getting at, thanks for the confirmation.
>
>> From the discussion on PSARC-ext it looks like Alan and Garrett might
>> not know that you are unable to run VSC yourself due to test suite
>> licensing restrictions. Someone inside Sun (now Oracle) has to run
>> the test suite because it is Sun that has the license to use the UNIX
>> branding test suites. Someone inside Sun also has to provide the
>> project
>> team with a test case that shows any failure (without showing you the
>> test suite source) and describe what the test suite claims is not
>> working correctly.
>
> No, I know that the test suites aren't public, which was part of the
> reason I asked the question, I was wondering how it was being handled.
>
>> I also know that IBM is funding development for a UNIX test suite for
>> the current version of the standard. (And we all know that that means
>> that IBM is about ready to apply for a UNIX "next" brand.) As far as
>> I know, Sun/Oracle is not planning to develop any product conforming
>> to the current version of the standard (IEEE Std 1003.1-2008 == SUSv4
>> == ISO/IEC IS 9945:2008). ;-{
>
> Thanks for the information,
>
