"Rajiv Mordani [CONTRACTOR]" wrote: > > We here use the OASIS test suite for xml conformance. That is freely available > from oasis-open. I believe that we should not duplicate efforts with those on > going at oasis.
Also: http://www.nist.gov/xml ... note the DOM testing. Mary Brady (at NIST) has been key to getting the OASIS suite published. Note that both Sun and IBM have contributed to the OASIS efforts, as have several key members of the XML community. If there's any XML conformance work representing industry consensus, that's it. > So it would be nice to know what is being done there and what we > can do here so that we all can come up with a comprehensive test suite. I > believe they aren't looking at API testing as of now. I suggest reading the second section of my first XML.COM article giving background for that testing work ... it's got a reasonable overview of what OASIS had delivered, plus links to the OASIS info as well as my open source test harness: http://www.xml.com/pub/1999/09/conformance/testing.html The suite structure sketched there involves the OASIS/NIST catalogue of test cases, usable with any testing harness; and separate harnesses using particular parser APIs. The harness used by that article tests SAX parsers, in Java. Coverage of SAX API calls is probably near the 80% level. There's a recent article (see www.xml.com, today's cover) that uses the same test catalogue with Microsoft's parser. New harness needed, due to the new parser API. Presumably the Apache XML project needs a C test harness too; it should use the same testcase catalogue document as input. > So maybe DOM conformance > is what can be taken up by someone. Don't duplicate the NIST efforts though. > But as a start I would say that we take > their test suite and for the driver it would be nice to even take a look at > http://home.pacbell.net/david-b/xml/ for the efforts that he is putting into > it > and use them. This one too is open source. More tests can come as we go > along. In particular, there's a need for tests which cover all the classifications of Letter/NameChar in XML ... the OASIS tests have a big gap in that area. That does happen to be an area where Sun could make a direct contribution, since its harness does a good job there. It reads directly from the XML spec and uses the data from that spaec -- it's in XML, after all! -- to generate about 128,000 test cases dynamically. Those cases could be saved, and the output donated to the OASIS/NIST effort along with an appropriate test catalog description. That'd let all parsers -- Java, C, JavaScript, Python, TCL, or whatever -- use the same testcases. - Dave p.s. Re the IBM test suite below ... what is its relationship to IBM's contributions to the OASIS work? > - Rajiv > > >Mailing-List: contact [EMAIL PROTECTED]; run by ezmlm > >X-No-Archive: yes > >list-help: <mailto:[EMAIL PROTECTED]> > >list-unsubscribe: <mailto:[EMAIL PROTECTED]> > >list-post: <mailto:[EMAIL PROTECTED]> > >Delivered-To: mailing list [EMAIL PROTECTED] > >Date: Thu, 18 Nov 1999 18:21:01 -0800 > >From: Mike Pogue <[EMAIL PROTECTED]> > >X-Accept-Language: en > >MIME-Version: 1.0 > >To: [EMAIL PROTECTED] > >Subject: Re: Test package AND/OR test cases for Java XML > >Content-Transfer-Encoding: 7bit > > > >Sun mentioned in the past that they had a test suite and harness > >for Project X. IBM has one, too (I'm checking to see if IBM can > >contribute > >it), that is used to test every release before it goes out. > >I'd love to combine these together as Open Source, if possible! > > > >Mike > > > >"Arnold, Curt" wrote: > >> > >> Shaoping Zhou [mailto:[EMAIL PROTECTED] wrote > >> >>I have noticed that there are currently no systemetic test cases or > >> >>approaches as to how we test the Apache XML classes. > >> > >> I definitely don't like the idea of writing main() methods in the classes. > >> > >> I bought, but never seriously used, a couple of licences of SunTest's > >> JavaSpec tool which would seem ideal for this type of role. Unfortunately, > >> the product has been discontinued by Sun and was pretty expensive at couple > >> of K at seat. For the time being there is a short description at > >> http://www.sun.com/workshop/testingtools/javaspec.html. > >> > >> However, when I was looking for I couldn't find anything quite like it and > >> bought to use as a test harness for COM objects (back when Microsoft was > >> going to make Java and COM one). > >> > >> That said, I'm wondering if there are any Sun lurkers out there that know > >> if > >> it could be made available for Apache work (or open-sourced). What are you > >> guys doing for your in-house testing? > >> > >> Or is there another testing tool that lapped JavaSpec?
