Hi Gary & all,
    I've analyzed, the below two issues (that seems to raise, real
doubts about the integrity of XalanJ 2.7.3 release tests) mentioned by
you for the XalanJ 2.7.3 RC9, and my findings (this time more
completely, and confirmed from my side) are mentioned inline below.

On Mon, Jan 9, 2023 at 9:19 PM Gary D. Gregory <ggreg...@apache.org> wrote:

> Also, out of "build smoketest", I see:
>
> scan:
>      [java] ResultScanner error on: results-api
>      [java] java.io.FileNotFoundException: ResultScanner: resultDir 
> results-api does not exist!
>      [java]     at 
> org.apache.qetest.xsl.ResultScanner.scanResults(ResultScanner.java:67)
>      [java]     at 
> org.apache.qetest.xsl.ResultScanner.main(ResultScanner.java:326)
>      [echo] About to execute XalanJ2 extensions tests...
>
> Is that something to worry about?

When we run the XalanJ tests build command "build smoketest", that
runs the ant target smoketest-execute as part of itself. The ant
target smoketest-execute, runs following ant targets in sequence as
part of itself,

"conf", "accept", "api" and "extensions".

The "api" ant target seems to have, few issues when run as part of ant
target smoketest-execute (and that's why, we get errors like above
that you've cited).

To debug this, I've made few changes locally to XalanJ tests build
configuration, and when I run XalanJ's ant target "api" separately, it
runs fine and produces tests results success for the XalanJ ant "api"
target.

My local changes, to improve XalanJ ant target "api" runs following
sets of tests (I've selected the following sets of tests. These are
large in numbers, and ensure sufficient quality of the ant target
"api"),

# Various tests, that run for ant build.xml's "api" target
qetest.dtm.tests=TestDTM;TestDTMIter;TestDTMTrav;TimeDTMIterDeep;TimeDTMTravDeep
qetest.rwapi.tests=XPathASTTestlet
qetest.trax.dom.tests=DOMResultAPITest;DOMSourceAPITest
qetest.trax.sax.tests=SAXResultAPITest;SAXSourceAPITest;SAXTransformerFactoryAPITest;TemplatesHandlerAPITest;TransformerHandlerAPITest;TransformerHandlerTest
qetest.trax.stream.tests=StreamResultAPITest;StreamSourceAPITest
qetest.trax.tests=EmbeddedStylesheetTest;ErrorListenerAPITest;ErrorListenerTest;Minitest;OutputPropertiesTest;ParameterTest;SystemIdImpInclTest;SystemIdTest;TemplatesAPITest;TransformerAPITest;TransformerFactoryAPITest;URIResolverTest
qetest.xalanj2.tests=DTMDumpTest;FactoryFeatureTest;OutputSettingsTest;PrefixResolverAPITest;ProgrammaticDOMTest;SerializedStylesheetTest;SmoketestOuttakes;SystemIDResolverAPITest;TestXPathAPI;TraceListenerTest;TransformStateAPITest;TransformStateTest

>
> During "build conf.xsltc", I see a couple of:
>
> [xalantest]     ERROR  StylesheetTestlet{trax} attribset15.xsl threw: 
> javax.xml.transform.TransformerConfigurationException: Could not compile 
> stylesheet
>
> But again, I do not know if this is normal or not. Are we testing actual 
> compiling errors?

My findings shows that, with XalanJ tests ant target conf.xsltc, the
error "javax.xml.transform.TransformerConfigurationException: Could
not compile stylesheet" is due to only 2-3 XSLT tests stylesheets, and
all these 2-3 XSLT stylesheets have legitimate compilation errors.
i.e, the error messages "Could not compile stylesheet" indicates the
related tests success. I've fixed this issue as well on my local.

I'd suggest one of following two approaches going forward, for these issues,

1) We fix the XalanJ tests build to solve these issues, and make a new
XalanJ 2.7.3 RC. If I've to do this, it'll take me few more days to
complete this task.

2) We can ignore these issues for now (and we can make improvements,
to XalanJ tests build after XalanJ 2.7.3 release), and try to approve
the XalanJ 2.7.3 RC9.

Please advise as appropriate.


-- 
Regards,
Mukul Gandhi

---------------------------------------------------------------------
To unsubscribe, e-mail: dev-unsubscr...@xalan.apache.org
For additional commands, e-mail: dev-h...@xalan.apache.org

Reply via email to