> Separate question -- any interest/discussions internally about
> creating a set of unit tests for the various pieces of Xalan?
> XPath functions, stylesheet elements, etc. are all good candidates.

Paul, please refer to http://xml.apache.org/xalan-j/test/overview.html.
Xalan has a rather large test suite, including all the things you named
(though we would always be *very* glad for more help).  We take testing
very seriously, and have viewed it as a fundemental part of both
development and quality assurance.  Note that it is required that every
Xalan developer run at least the "smoketest" before they check in, which
includes basic API tests, conformence tests (in stream-to-stream mode),
some configuration tests, some extensions test, and various other tests.

In spite of this, many more bugs slip through our release process than we
would like.  Xalan is a hard bugger to test, both because of the large
number of conformance issues (including error handling), and because of the
broad number of configurations we allow (SAX-to-SAX, DOM-to-DOM, XPath API,
Tooling API, etc.).  It's a bit of on ongoing battle.... further
complicated by the fact that we've been working on various architectural
improvements to increase performance.

What we're weak on is a) good integration tests, i.e. real stylesheets that
stress Xalan in various ways that go beyond atomic functionality (the Xalan
community can help a lot with this), and b) bugzilla regression testing.
We have a system for when a developer makes a fix for a bug, they're
supposed to create a unit test and put in in the bugzilla directory of our
test suite.  But, for whatever reasons, this system hasn't been followed
through as well as it could be.  So, we'll work on these two issues.

You should be able to download the tests and run them at will.

-scott




                                                                                       
                                                
                      "Paul Brown"                                                     
                                                
                      <[EMAIL PROTECTED]        To:       <[EMAIL PROTECTED]>    
                                                
                      m>                       cc:       (bcc: Scott 
Boag/Cambridge/IBM)                                               
                                               Subject:  RE: Proposal for Xalan-Java 
2.4 release                                       
                      07/27/2002 06:03                                                 
                                                
                      PM                                                               
                                                
                      Please respond to                                                
                                                
                      xalan-dev                                                        
                                                
                                                                                       
                                                
                                                                                       
                                                






> Since building and publishing the last developer's release (Xalan Java
> 2.4.D1), I've been asked when the next offical Xalan Java release will
> be.

One thing that I would love to see (personnally) is the ability to download
and run the tests against a from-scratch build.  We've never had any
outrageous quality issues with Xalan, but it would provide significant
utility to anyone who modifies Xalan for specific purposes.

Separate question -- any interest/discussions internally about creating a
set of unit tests for the various pieces of Xalan?  XPath functions,
stylesheet elements, etc. are all good candidates.

             -- Paul





Reply via email to