Ha! Thanks for filing the issue, Wolfgang.

D.

On Tue, Dec 3, 2013 at 12:01 PM, Wolfgang Hoschek <[email protected]> wrote:
> Actually, Mike's opinion has changed because now Saxon doesn't need to 
> support Java5 anymore - https://saxonica.plan.io/issues/1944
>
> Wolfgang.
>
> On Dec 3, 2013, at 2:07 AM, Dawid Weiss wrote:
>
>>> I'll file a bug with saxon and see what Mike Kay's take is
>>
>> I think Mike has already expressed his opinion on the subject in that
>> stack overflow topic... :)
>>
>> Dawid
>>
>>
>> On Tue, Dec 3, 2013 at 9:52 AM, Wolfgang Hoschek <[email protected]> 
>> wrote:
>>>
>>> On Dec 3, 2013, at 12:11 AM, Uwe Schindler wrote:
>>>
>>>>> Looks like Java's service loader lookup impl has become more strict in 
>>>>> Java8.
>>>>> This issue on Java 8 is kind of unfortunate because morphlines and solr-mr
>>>>> doesn't actually use JAXP at all.
>>>>>
>>>>> For the time being might be best to disable testing on Java8 for this 
>>>>> contrib,
>>>>> in order to get a stable build and make progress on other issues.
>>>>>
>>>>> A couple of options that come to mind in how to deal with this longer 
>>>>> term:
>>>>>
>>>>> 1) Remove the dependency on cdk-morphlines-saxon (which pulls in the
>>>>> saxon jar)
>>>>>
>>>>
>>>> What ist he effect of this? I would prefer this!
>>>
>>> The effect is that the convertHTML, xquery and xslt commands won't be 
>>> available anymore:
>>>
>>> http://cloudera.github.io/cdk/docs/current/cdk-morphlines/morphlinesReferenceGuide.html#/cdk-morphlines-saxon
>>>
>>>>
>>>>> 2) Replace all Solr calls to JAXP XPathFactory.newInstance() with a little
>>>>> helper that first tries to use one of a list of well known XPathFactory
>>>>> subclasses, and only if that fails falls back to the generic
>>>>> XPathFactory.newInstance(). E.g. use something like
>>>>>
>>>>> XPathFactory.newInstance(XPathFactory.DEFAULT_OBJECT_MODEL_URI,
>>>>> "com.sun.org.apache.xpath.internal.jaxp.XPathFactoryImpl",
>>>>> ClassLoader.getSystemClassLoader());
>>>>
>>>> This is a hack, just because of this craziness, I don't want to have non 
>>>> conformant code in Solr Core!
>>>
>>> This is actually quite common practice because the JAXP service loader 
>>> mechanism is a bit flawed. Also, most XSLT and XPath and StaX 
>>> implementations have serious bugs in various areas. Thus many XML intensive 
>>> apps that require reliability and predictable behavior explicitly choose 
>>> one of the JAXP implementation that's known to work for them, rather than 
>>> hoping for the best with some potentially buggy default impl. JAXP 
>>> plug-ability really only exists for simple XPath use cases. The good news 
>>> is that Solr Config et al seems to fit into that simple pluggable bucket.
>>>
>>>>
>>>>> There are 14 such XPathFactory.newInstance() calls in the Solr codebase.
>>>>
>>>> Definite -1
>>>>
>>>>> 3) Somehow remove the META-INF/services/javax.xml.xpath.XPathFactory
>>>>> file from the saxon jar (this is what's causing this, and we don't need 
>>>>> that file,
>>>>> but it's not clear how to remove it, realistically)
>>>>
>>>> The only correct way to solve this: File a bug in Jackson and apply (1). 
>>>> Jackson violates the standards. And this violation fails in a number of 
>>>> JVMs (not only in Java 8, also IBM J9 is affected).
>>>
>>> I'll file a bug with saxon and see what Mike Kay's take is. Meanwhile, we 
>>> could remove the saxon jar or disable tests on java8 & J9 to be able to 
>>> move forward on this.
>>>
>>>> Because of this I don't want to have Jackson in Solr at all (you have to 
>>>> know, I am a fan of XSLT and XPath, but Jackson is the worst 
>>>> implementation I have seen and I avoid it whenever possible - Only if you 
>>>> need XPath2 / XSLT 2 you may want to use it).
>>>
>>> All XML libs have bugs but most XML intensive apps use saxon in production 
>>> rather than other impls, at least from what I've seen over the years. 
>>> Anyway, just my 2 cents.
>>>
>>> Wolfgang.
>>>
>>>>
>>>> Uwe
>>>>
>>>>> On Dec 2, 2013, at 4:41 PM, Mark Miller wrote:
>>>>>
>>>>>> Uwe mentioned this in IRC - I guess Saxon doesn’t play nice with java 8.
>>>>>>
>>>>>> http://stackoverflow.com/questions/7914915/syntax-error-in-javax-xml-x
>>>>>> path-xpathfactory-provider-configuration-file-of-saxo
>>>>>>
>>>>>> - Mark
>>>>>>
>>>>>> On Dec 2, 2013, at 7:06 PM, Policeman Jenkins Server
>>>>> <[email protected]> wrote:
>>>>>>
>>>>>>> Build: http://jenkins.thetaphi.de/job/Lucene-Solr-trunk-Linux/8549/
>>>>>>> Java: 32bit/jdk1.8.0-ea-b117 -server -XX:+UseSerialGC
>>>>>>>
>>>>>>> 3 tests failed.
>>>>>>> FAILED:
>>>>>>>
>>>>> junit.framework.TestSuite.org.apache.solr.hadoop.MorphlineReducerTest
>>>>>>>
>>>>>>> Error Message:
>>>>>>> 1 thread leaked from SUITE scope at
>>>>> org.apache.solr.hadoop.MorphlineReducerTest:     1) Thread[id=17,
>>>>> name=Thread-4, state=TIMED_WAITING, group=TGRP-
>>>>> MorphlineReducerTest]         at sun.misc.Unsafe.park(Native Method)      
>>>>>    at
>>>>> java.util.concurrent.locks.LockSupport.parkNanos(LockSupport.java:215)
>>>>> at
>>>>> java.util.concurrent.locks.AbstractQueuedSynchronizer.doAcquireSharedNa
>>>>> nos(AbstractQueuedSynchronizer.java:1037)         at
>>>>> java.util.concurrent.locks.AbstractQueuedSynchronizer.tryAcquireSharedNa
>>>>> nos(AbstractQueuedSynchronizer.java:1328)         at
>>>>> java.util.concurrent.CountDownLatch.await(CountDownLatch.java:277)
>>>>> at org.apache.solr.hadoop.HeartBeater.run(HeartBeater.java:108)
>>>>>>>
>>>>>>> Stack Trace:
>>>>>>> com.carrotsearch.randomizedtesting.ThreadLeakError: 1 thread leaked
>>>>> from SUITE scope at org.apache.solr.hadoop.MorphlineReducerTest:
>>>>>>> 1) Thread[id=17, name=Thread-4, state=TIMED_WAITING, group=TGRP-
>>>>> MorphlineReducerTest]
>>>>>>>      at sun.misc.Unsafe.park(Native Method)
>>>>>>>      at
>>>>> java.util.concurrent.locks.LockSupport.parkNanos(LockSupport.java:215)
>>>>>>>      at
>>>>> java.util.concurrent.locks.AbstractQueuedSynchronizer.doAcquireSharedNa
>>>>> nos(AbstractQueuedSynchronizer.java:1037)
>>>>>>>      at
>>>>> java.util.concurrent.locks.AbstractQueuedSynchronizer.tryAcquireSharedNa
>>>>> nos(AbstractQueuedSynchronizer.java:1328)
>>>>>>>      at
>>>>> java.util.concurrent.CountDownLatch.await(CountDownLatch.java:277)
>>>>>>>      at org.apache.solr.hadoop.HeartBeater.run(HeartBeater.java:108)
>>>>>>>   at __randomizedtesting.SeedInfo.seed([FA8A1D94A2BB2925]:0)
>>>>>>>
>>>>>>>
>>>>>>> FAILED:
>>>>>>>
>>>>> junit.framework.TestSuite.org.apache.solr.hadoop.MorphlineReducerTest
>>>>>>>
>>>>>>> Error Message:
>>>>>>> There are still zombie threads that couldn't be terminated:    1)
>>>>> Thread[id=17, name=Thread-4, state=TIMED_WAITING, group=TGRP-
>>>>> MorphlineReducerTest]         at sun.misc.Unsafe.park(Native Method)      
>>>>>    at
>>>>> java.util.concurrent.locks.LockSupport.parkNanos(LockSupport.java:215)
>>>>> at
>>>>> java.util.concurrent.locks.AbstractQueuedSynchronizer.doAcquireSharedNa
>>>>> nos(AbstractQueuedSynchronizer.java:1037)         at
>>>>> java.util.concurrent.locks.AbstractQueuedSynchronizer.tryAcquireSharedNa
>>>>> nos(AbstractQueuedSynchronizer.java:1328)         at
>>>>> java.util.concurrent.CountDownLatch.await(CountDownLatch.java:277)
>>>>> at org.apache.solr.hadoop.HeartBeater.run(HeartBeater.java:108)
>>>>>>>
>>>>>>> Stack Trace:
>>>>>>> com.carrotsearch.randomizedtesting.ThreadLeakError: There are still
>>>>> zombie threads that couldn't be terminated:
>>>>>>> 1) Thread[id=17, name=Thread-4, state=TIMED_WAITING, group=TGRP-
>>>>> MorphlineReducerTest]
>>>>>>>      at sun.misc.Unsafe.park(Native Method)
>>>>>>>      at
>>>>> java.util.concurrent.locks.LockSupport.parkNanos(LockSupport.java:215)
>>>>>>>      at
>>>>> java.util.concurrent.locks.AbstractQueuedSynchronizer.doAcquireSharedNa
>>>>> nos(AbstractQueuedSynchronizer.java:1037)
>>>>>>>      at
>>>>> java.util.concurrent.locks.AbstractQueuedSynchronizer.tryAcquireSharedNa
>>>>> nos(AbstractQueuedSynchronizer.java:1328)
>>>>>>>      at
>>>>> java.util.concurrent.CountDownLatch.await(CountDownLatch.java:277)
>>>>>>>      at org.apache.solr.hadoop.HeartBeater.run(HeartBeater.java:108)
>>>>>>>   at __randomizedtesting.SeedInfo.seed([FA8A1D94A2BB2925]:0)
>>>>>>>
>>>>>>>
>>>>>>> FAILED:  org.apache.solr.hadoop.MorphlineReducerTest.testReducer
>>>>>>>
>>>>>>> Error Message:
>>>>>>>
>>>>>>>
>>>>>>> Stack Trace:
>>>>>>> java.lang.ExceptionInInitializerError
>>>>>>>   at
>>>>> __randomizedtesting.SeedInfo.seed([FA8A1D94A2BB2925:8E2E7A5608ED286
>>>>> 5]:0)
>>>>>>>   at
>>>>> org.apache.solr.core.ConfigSolr.fromInputStream(ConfigSolr.java:85)
>>>>>>>   at org.apache.solr.core.ConfigSolr.fromFile(ConfigSolr.java:64)
>>>>>>>   at org.apache.solr.core.ConfigSolr.fromSolrHome(ConfigSolr.java:94)
>>>>>>>   at
>>>>> org.apache.solr.core.CoreContainer.<init>(CoreContainer.java:132)
>>>>>>>   at
>>>>> org.apache.solr.hadoop.SolrRecordWriter.createEmbeddedSolrServer(SolrR
>>>>> ecordWriter.java:162)
>>>>>>>   at
>>>>> org.apache.solr.hadoop.SolrRecordWriter.<init>(SolrRecordWriter.java:118)
>>>>>>>   at
>>>>> org.apache.solr.hadoop.SolrOutputFormat.getRecordWriter(SolrOutputForm
>>>>> at.java:161)
>>>>>>>   at
>>>>> org.apache.hadoop.mrunit.internal.mapreduce.MockMapreduceOutputFor
>>>>> mat.collect(MockMapreduceOutputFormat.java:100)
>>>>>>>   at
>>>>> org.apache.hadoop.mrunit.internal.mapreduce.AbstractMockContextWrapp
>>>>> er$4.answer(AbstractMockContextWrapper.java:90)
>>>>>>>   at
>>>>> org.mockito.internal.stubbing.StubbedInvocationMatcher.answer(StubbedI
>>>>> nvocationMatcher.java:34)
>>>>>>>   at
>>>>> org.mockito.internal.handler.MockHandlerImpl.handle(MockHandlerImpl.jav
>>>>> a:91)
>>>>>>>   at
>>>>> org.mockito.internal.handler.NullResultGuardian.handle(NullResultGuardian.
>>>>> java:29)
>>>>>>>   at
>>>>> org.mockito.internal.handler.InvocationNotifierHandler.handle(InvocationN
>>>>> otifierHandler.java:38)
>>>>>>>   at
>>>>> org.mockito.internal.creation.MethodInterceptorFilter.intercept(MethodInt
>>>>> erceptorFilter.java:51)
>>>>>>>   at
>>>>> org.apache.hadoop.mapreduce.Reducer$Context$$EnhancerByMockitoWith
>>>>> CGLIB$$26219b0.write(<generated>)
>>>>>>>   at
>>>>> org.apache.hadoop.mapreduce.Reducer.reduce(Reducer.java:150)
>>>>>>>   at org.apache.solr.hadoop.SolrReducer.reduce(SolrReducer.java:80)
>>>>>>>   at org.apache.solr.hadoop.SolrReducer.reduce(SolrReducer.java:45)
>>>>>>>   at org.apache.hadoop.mapreduce.Reducer.run(Reducer.java:171)
>>>>>>>   at
>>>>> org.apache.hadoop.mrunit.mapreduce.ReduceDriver.run(ReduceDriver.java
>>>>> :143)
>>>>>>>   at
>>>>> org.apache.solr.hadoop.MorphlineReducerTest.testReducer(MorphlineRedu
>>>>> cerTest.java:106)
>>>>>>>   at sun.reflect.NativeMethodAccessorImpl.invoke0(Native Method)
>>>>>>>   at
>>>>> sun.reflect.NativeMethodAccessorImpl.invoke(NativeMethodAccessorImpl.j
>>>>> ava:62)
>>>>>>>   at
>>>>> sun.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAcces
>>>>> sorImpl.java:43)
>>>>>>>   at java.lang.reflect.Method.invoke(Method.java:483)
>>>>>>>   at
>>>>> com.carrotsearch.randomizedtesting.RandomizedRunner.invoke(Randomize
>>>>> dRunner.java:1559)
>>>>>>>   at
>>>>> com.carrotsearch.randomizedtesting.RandomizedRunner.access$600(Rando
>>>>> mizedRunner.java:79)
>>>>>>>   at
>>>>> com.carrotsearch.randomizedtesting.RandomizedRunner$6.evaluate(Rando
>>>>> mizedRunner.java:737)
>>>>>>>   at
>>>>> com.carrotsearch.randomizedtesting.RandomizedRunner$7.evaluate(Rando
>>>>> mizedRunner.java:773)
>>>>>>>   at
>>>>> com.carrotsearch.randomizedtesting.RandomizedRunner$8.evaluate(Rando
>>>>> mizedRunner.java:787)
>>>>>>>   at
>>>>> com.carrotsearch.randomizedtesting.rules.SystemPropertiesRestoreRule$1.
>>>>> evaluate(SystemPropertiesRestoreRule.java:53)
>>>>>>>   at
>>>>> org.apache.lucene.util.TestRuleSetupTeardownChained$1.evaluate(TestRule
>>>>> SetupTeardownChained.java:50)
>>>>>>>   at
>>>>> org.apache.lucene.util.TestRuleFieldCacheSanity$1.evaluate(TestRuleFieldCa
>>>>> cheSanity.java:51)
>>>>>>>   at
>>>>> org.apache.lucene.util.AbstractBeforeAfterRule$1.evaluate(AbstractBeforeA
>>>>> fterRule.java:46)
>>>>>>>   at
>>>>> com.carrotsearch.randomizedtesting.rules.SystemPropertiesInvariantRule$1
>>>>> .evaluate(SystemPropertiesInvariantRule.java:55)
>>>>>>>   at
>>>>> org.apache.lucene.util.TestRuleThreadAndTestName$1.evaluate(TestRuleTh
>>>>> readAndTestName.java:49)
>>>>>>>   at
>>>>> org.apache.lucene.util.TestRuleIgnoreAfterMaxFailures$1.evaluate(TestRule
>>>>> IgnoreAfterMaxFailures.java:70)
>>>>>>>   at
>>>>> org.apache.lucene.util.TestRuleMarkFailure$1.evaluate(TestRuleMarkFailure
>>>>> .java:48)
>>>>>>>   at
>>>>> com.carrotsearch.randomizedtesting.rules.StatementAdapter.evaluate(Stat
>>>>> ementAdapter.java:36)
>>>>>>>   at
>>>>> com.carrotsearch.randomizedtesting.ThreadLeakControl$StatementRunner.
>>>>> run(ThreadLeakControl.java:358)
>>>>>>>   at
>>>>> com.carrotsearch.randomizedtesting.ThreadLeakControl.forkTimeoutingTask
>>>>> (ThreadLeakControl.java:782)
>>>>>>>   at
>>>>> com.carrotsearch.randomizedtesting.ThreadLeakControl$3.evaluate(ThreadL
>>>>> eakControl.java:442)
>>>>>>>   at
>>>>> com.carrotsearch.randomizedtesting.RandomizedRunner.runSingleTest(Ran
>>>>> domizedRunner.java:746)
>>>>>>>   at
>>>>> com.carrotsearch.randomizedtesting.RandomizedRunner$3.evaluate(Rando
>>>>> mizedRunner.java:648)
>>>>>>>   at
>>>>> com.carrotsearch.randomizedtesting.RandomizedRunner$4.evaluate(Rando
>>>>> mizedRunner.java:682)
>>>>>>>   at
>>>>> com.carrotsearch.randomizedtesting.RandomizedRunner$5.evaluate(Rando
>>>>> mizedRunner.java:693)
>>>>>>>   at
>>>>> com.carrotsearch.randomizedtesting.rules.StatementAdapter.evaluate(Stat
>>>>> ementAdapter.java:36)
>>>>>>>   at
>>>>> com.carrotsearch.randomizedtesting.rules.SystemPropertiesRestoreRule$1.
>>>>> evaluate(SystemPropertiesRestoreRule.java:53)
>>>>>>>   at
>>>>> org.apache.lucene.util.AbstractBeforeAfterRule$1.evaluate(AbstractBeforeA
>>>>> fterRule.java:46)
>>>>>>>   at
>>>>> org.apache.lucene.util.TestRuleStoreClassName$1.evaluate(TestRuleStoreCl
>>>>> assName.java:42)
>>>>>>>   at
>>>>> com.carrotsearch.randomizedtesting.rules.SystemPropertiesInvariantRule$1
>>>>> .evaluate(SystemPropertiesInvariantRule.java:55)
>>>>>>>   at
>>>>> com.carrotsearch.randomizedtesting.rules.NoShadowingOrOverridesOnMet
>>>>> hodsRule$1.evaluate(NoShadowingOrOverridesOnMethodsRule.java:39)
>>>>>>>   at
>>>>> com.carrotsearch.randomizedtesting.rules.NoShadowingOrOverridesOnMet
>>>>> hodsRule$1.evaluate(NoShadowingOrOverridesOnMethodsRule.java:39)
>>>>>>>   at
>>>>> com.carrotsearch.randomizedtesting.rules.StatementAdapter.evaluate(Stat
>>>>> ementAdapter.java:36)
>>>>>>>   at
>>>>> org.apache.lucene.util.TestRuleAssertionsRequired$1.evaluate(TestRuleAss
>>>>> ertionsRequired.java:43)
>>>>>>>   at
>>>>> org.apache.lucene.util.TestRuleMarkFailure$1.evaluate(TestRuleMarkFailure
>>>>> .java:48)
>>>>>>>   at
>>>>> org.apache.lucene.util.TestRuleIgnoreAfterMaxFailures$1.evaluate(TestRule
>>>>> IgnoreAfterMaxFailures.java:70)
>>>>>>>   at
>>>>> org.apache.lucene.util.TestRuleIgnoreTestSuites$1.evaluate(TestRuleIgnore
>>>>> TestSuites.java:55)
>>>>>>>   at
>>>>> com.carrotsearch.randomizedtesting.rules.StatementAdapter.evaluate(Stat
>>>>> ementAdapter.java:36)
>>>>>>>   at
>>>>> com.carrotsearch.randomizedtesting.ThreadLeakControl$StatementRunner.
>>>>> run(ThreadLeakControl.java:358)
>>>>>>>   at java.lang.Thread.run(Thread.java:744)
>>>>>>> Caused by: java.lang.RuntimeException: XPathFactory#newInstance()
>>>>> failed to create an XPathFactory for the default object model:
>>>>> http://java.sun.com/jaxp/xpath/dom with the
>>>>> XPathFactoryConfigurationException:
>>>>> javax.xml.xpath.XPathFactoryConfigurationException:
>>>>> java.util.ServiceConfigurationError: javax.xml.xpath.XPathFactory:
>>>>> jar:file:/mnt/ssd/jenkins/workspace/Lucene-Solr-trunk-
>>>>> Linux/solr/contrib/solr-mr/lib/Saxon-HE-9.5.1-2.jar!/META-
>>>>> INF/services/javax.xml.xpath.XPathFactory:2: Illegal configuration-file 
>>>>> syntax
>>>>>>>   at
>>>>> javax.xml.xpath.XPathFactory.newInstance(XPathFactory.java:102)
>>>>>>>   at org.apache.solr.core.Config.<clinit>(Config.java:68)
>>>>>>>   ... 61 more
>>>>>>>
>>>>>>>
>>>>>>>
>>>>>>>
>>>>>>> Build Log:
>>>>>>> [...truncated 18859 lines...]
>>>>>>> [junit4] Suite: org.apache.solr.hadoop.MorphlineReducerTest
>>>>>>> [junit4]   1> 0    [TEST-MorphlineReducerTest.testReducer-
>>>>> seed#[FA8A1D94A2BB2925]] INFO  org.apache.solr.SolrTestCaseJ4  -
>>>>> ###Starting testReducer
>>>>>>> [junit4]   1> 1446 [TEST-MorphlineReducerTest.testReducer-
>>>>> seed#[FA8A1D94A2BB2925]] INFO  org.apache.solr.hadoop.HeartBeater  -
>>>>> Heart beat reporting class is
>>>>> org.apache.hadoop.mapreduce.Reducer$Context$$EnhancerByMockitoWith
>>>>> CGLIB$$26219b0
>>>>>>> [junit4]   1> 1446 [Thread-2] INFO  org.apache.solr.hadoop.HeartBeater  
>>>>>>> -
>>>>> HeartBeat thread running
>>>>>>> [junit4]   1> 1447 [Thread-2] INFO  org.apache.solr.hadoop.HeartBeater  
>>>>>>> -
>>>>> heartbeat skipped count 0
>>>>>>> [junit4]   1> 1700 [TEST-MorphlineReducerTest.testReducer-
>>>>> seed#[FA8A1D94A2BB2925]] WARN
>>>>> org.apache.hadoop.util.NativeCodeLoader  - Unable to load native-hadoop
>>>>> library for your platform... using builtin-java classes where applicable
>>>>>>> [junit4]   1> 1871 [TEST-MorphlineReducerTest.testReducer-
>>>>> seed#[FA8A1D94A2BB2925]] INFO  org.apache.solr.hadoop.HeartBeater  -
>>>>> Heart beat reporting class is
>>>>> org.apache.hadoop.mapreduce.Reducer$Context$$EnhancerByMockitoWith
>>>>> CGLIB$$26219b0
>>>>>>> [junit4]   1> 1875 [TEST-MorphlineReducerTest.testReducer-
>>>>> seed#[FA8A1D94A2BB2925]] INFO  org.apache.solr.hadoop.SolrRecordWriter
>>>>> - Using this unpacked directory as solr home: mrunit-2d20ae5b-6ad2-47a5-
>>>>> a7e5-a6fab88c0a48/solr8152945807876480818.zip
>>>>>>> [junit4]   1> 1877 [TEST-MorphlineReducerTest.testReducer-
>>>>> seed#[FA8A1D94A2BB2925]] INFO  org.apache.solr.hadoop.SolrRecordWriter
>>>>> - Creating embedded Solr server with solrHomeDir: mrunit-2d20ae5b-6ad2-
>>>>> 47a5-a7e5-a6fab88c0a48/solr8152945807876480818.zip, fs:
>>>>> org.apache.hadoop.fs.LocalFileSystem@35dc38, outputShardDir: mrunit-
>>>>> 0.17047939478652196/_temporary/0/_temporary/attempt_000000000000_0
>>>>> 000_m_000000_0/part-m-00000
>>>>>>> [junit4]   1> 1882 [Thread-4] INFO  org.apache.solr.hadoop.HeartBeater  
>>>>>>> -
>>>>> HeartBeat thread running
>>>>>>> [junit4]   1> 1885 [Thread-4] INFO  org.apache.solr.hadoop.HeartBeater  
>>>>>>> -
>>>>> Issuing heart beat for 1 threads
>>>>>>> [junit4]   1> 1922 [TEST-MorphlineReducerTest.testReducer-
>>>>> seed#[FA8A1D94A2BB2925]] INFO  org.apache.solr.core.SolrResourceLoader
>>>>> - new SolrResourceLoader for directory: 'mrunit-2d20ae5b-6ad2-47a5-a7e5-
>>>>> a6fab88c0a48/solr8152945807876480818.zip/'
>>>>>>> [junit4]   1> 2090 [TEST-MorphlineReducerTest.testReducer-
>>>>> seed#[FA8A1D94A2BB2925]] INFO  org.apache.solr.hadoop.SolrRecordWriter
>>>>> - Constructed instance information solr.home mrunit-2d20ae5b-6ad2-47a5-
>>>>> a7e5-a6fab88c0a48/solr8152945807876480818.zip (mrunit-2d20ae5b-6ad2-
>>>>> 47a5-a7e5-a6fab88c0a48/solr8152945807876480818.zip), instance dir mrunit-
>>>>> 2d20ae5b-6ad2-47a5-a7e5-a6fab88c0a48/solr8152945807876480818.zip/, conf
>>>>> dir mrunit-2d20ae5b-6ad2-47a5-a7e5-
>>>>> a6fab88c0a48/solr8152945807876480818.zip/conf/, writing index to
>>>>> solr.data.dir mrunit-
>>>>> 0.17047939478652196/_temporary/0/_temporary/attempt_000000000000_0
>>>>> 000_m_000000_0/part-m-00000/data, with permdir mrunit-
>>>>> 0.17047939478652196/_temporary/0/_temporary/attempt_000000000000_0
>>>>> 000_m_000000_0/part-m-00000
>>>>>>> [junit4]   1> 2096 [TEST-MorphlineReducerTest.testReducer-
>>>>> seed#[FA8A1D94A2BB2925]] INFO  org.apache.solr.core.ConfigSolr  - Loading
>>>>> container configuration from /mnt/ssd/jenkins/workspace/Lucene-Solr-
>>>>> trunk-Linux/solr/build/contrib/solr-mr/test/J1/mrunit-2d20ae5b-6ad2-47a5-
>>>>> a7e5-a6fab88c0a48/solr8152945807876480818.zip/solr.xml
>>>>>>> [junit4]   1> 2245 [TEST-MorphlineReducerTest.testReducer-
>>>>> seed#[FA8A1D94A2BB2925]] INFO  org.apache.solr.SolrTestCaseJ4  -
>>>>> ###Ending testReducer
>>>>>>> [junit4]   2> NOTE: reproduce with: ant test  -
>>>>> Dtestcase=MorphlineReducerTest -Dtests.method=testReducer -
>>>>> Dtests.seed=FA8A1D94A2BB2925 -Dtests.multiplier=3 -Dtests.slow=true -
>>>>> Dtests.locale=ar_QA -Dtests.timezone=America/Yellowknife -
>>>>> Dtests.file.encoding=US-ASCII
>>>>>>> [junit4] ERROR   2.32s J1 | MorphlineReducerTest.testReducer <<<
>>>>>>> [junit4]    > Throwable #1: java.lang.ExceptionInInitializerError
>>>>>>> [junit4]    >     at
>>>>> __randomizedtesting.SeedInfo.seed([FA8A1D94A2BB2925:8E2E7A5608ED286
>>>>> 5]:0)
>>>>>>> [junit4]    >     at
>>>>> org.apache.solr.core.ConfigSolr.fromInputStream(ConfigSolr.java:85)
>>>>>>> [junit4]    >     at
>>>>> org.apache.solr.core.ConfigSolr.fromFile(ConfigSolr.java:64)
>>>>>>> [junit4]    >     at
>>>>> org.apache.solr.core.ConfigSolr.fromSolrHome(ConfigSolr.java:94)
>>>>>>> [junit4]    >     at
>>>>> org.apache.solr.core.CoreContainer.<init>(CoreContainer.java:132)
>>>>>>> [junit4]    >     at
>>>>> org.apache.solr.hadoop.SolrRecordWriter.createEmbeddedSolrServer(SolrR
>>>>> ecordWriter.java:162)
>>>>>>> [junit4]    >     at
>>>>> org.apache.solr.hadoop.SolrRecordWriter.<init>(SolrRecordWriter.java:118)
>>>>>>> [junit4]    >     at
>>>>> org.apache.solr.hadoop.SolrOutputFormat.getRecordWriter(SolrOutputForm
>>>>> at.java:161)
>>>>>>> [junit4]    >     at
>>>>> org.apache.hadoop.mrunit.internal.mapreduce.MockMapreduceOutputFor
>>>>> mat.collect(MockMapreduceOutputFormat.java:100)
>>>>>>> [junit4]    >     at
>>>>> org.apache.hadoop.mrunit.internal.mapreduce.AbstractMockContextWrapp
>>>>> er$4.answer(AbstractMockContextWrapper.java:90)
>>>>>>> [junit4]    >     at
>>>>> org.mockito.internal.stubbing.StubbedInvocationMatcher.answer(StubbedI
>>>>> nvocationMatcher.java:34)
>>>>>>> [junit4]    >     at
>>>>> org.mockito.internal.handler.MockHandlerImpl.handle(MockHandlerImpl.jav
>>>>> a:91)
>>>>>>> [junit4]    >     at
>>>>> org.mockito.internal.handler.NullResultGuardian.handle(NullResultGuardian.
>>>>> java:29)
>>>>>>> [junit4]    >     at
>>>>> org.mockito.internal.handler.InvocationNotifierHandler.handle(InvocationN
>>>>> otifierHandler.java:38)
>>>>>>> [junit4]    >     at
>>>>> org.mockito.internal.creation.MethodInterceptorFilter.intercept(MethodInt
>>>>> erceptorFilter.java:51)
>>>>>>> [junit4]    >     at
>>>>> org.apache.hadoop.mapreduce.Reducer$Context$$EnhancerByMockitoWith
>>>>> CGLIB$$26219b0.write(<generated>)
>>>>>>> [junit4]    >     at
>>>>> org.apache.hadoop.mapreduce.Reducer.reduce(Reducer.java:150)
>>>>>>> [junit4]    >     at
>>>>> org.apache.solr.hadoop.SolrReducer.reduce(SolrReducer.java:80)
>>>>>>> [junit4]    >     at
>>>>> org.apache.solr.hadoop.SolrReducer.reduce(SolrReducer.java:45)
>>>>>>> [junit4]    >     at
>>>>> org.apache.hadoop.mapreduce.Reducer.run(Reducer.java:171)
>>>>>>> [junit4]    >     at
>>>>> org.apache.hadoop.mrunit.mapreduce.ReduceDriver.run(ReduceDriver.java
>>>>> :143)
>>>>>>> [junit4]    >     at
>>>>> org.apache.solr.hadoop.MorphlineReducerTest.testReducer(MorphlineRedu
>>>>> cerTest.java:106)
>>>>>>> [junit4]    >     at java.lang.Thread.run(Thread.java:744)
>>>>>>> [junit4]    > Caused by: java.lang.RuntimeException:
>>>>> XPathFactory#newInstance() failed to create an XPathFactory for the 
>>>>> default
>>>>> object model: http://java.sun.com/jaxp/xpath/dom with the
>>>>> XPathFactoryConfigurationException:
>>>>> javax.xml.xpath.XPathFactoryConfigurationException:
>>>>> java.util.ServiceConfigurationError: javax.xml.xpath.XPathFactory:
>>>>> jar:file:/mnt/ssd/jenkins/workspace/Lucene-Solr-trunk-
>>>>> Linux/solr/contrib/solr-mr/lib/Saxon-HE-9.5.1-2.jar!/META-
>>>>> INF/services/javax.xml.xpath.XPathFactory:2: Illegal configuration-file 
>>>>> syntax
>>>>>>> [junit4]    >     at
>>>>> javax.xml.xpath.XPathFactory.newInstance(XPathFactory.java:102)
>>>>>>> [junit4]    >     at 
>>>>>>> org.apache.solr.core.Config.<clinit>(Config.java:68)
>>>>>>> [junit4]    >     ... 61 more
>>>>>>> [junit4]   1> 2299 [SUITE-MorphlineReducerTest-
>>>>> seed#[FA8A1D94A2BB2925]-worker] INFO  org.apache.solr.SolrTestCaseJ4  -
>>>>> ###deleteCore
>>>>>>> [junit4]   2> 2711 T11 ccr.ThreadLeakControl.checkThreadLeaks
>>>>> WARNING Will linger awaiting termination of 1 leaked thread(s).
>>>>>>> [junit4]   2> 22773 T11 ccr.ThreadLeakControl.checkThreadLeaks SEVERE 1
>>>>> thread leaked from SUITE scope at
>>>>> org.apache.solr.hadoop.MorphlineReducerTest:
>>>>>>> [junit4]   2>        1) Thread[id=17, name=Thread-4,
>>>>> state=TIMED_WAITING, group=TGRP-MorphlineReducerTest]
>>>>>>> [junit4]   2>             at sun.misc.Unsafe.park(Native Method)
>>>>>>> [junit4]   2>             at
>>>>> java.util.concurrent.locks.LockSupport.parkNanos(LockSupport.java:215)
>>>>>>> [junit4]   2>             at
>>>>> java.util.concurrent.locks.AbstractQueuedSynchronizer.doAcquireSharedNa
>>>>> nos(AbstractQueuedSynchronizer.java:1037)
>>>>>>> [junit4]   2>             at
>>>>> java.util.concurrent.locks.AbstractQueuedSynchronizer.tryAcquireSharedNa
>>>>> nos(AbstractQueuedSynchronizer.java:1328)
>>>>>>> [junit4]   2>             at
>>>>> java.util.concurrent.CountDownLatch.await(CountDownLatch.java:277)
>>>>>>> [junit4]   2>             at
>>>>> org.apache.solr.hadoop.HeartBeater.run(HeartBeater.java:108)
>>>>>>> [junit4]   2> 22774 T11 ccr.ThreadLeakControl.tryToInterruptAll 
>>>>>>> Starting to
>>>>> interrupt leaked threads:
>>>>>>> [junit4]   2>        1) Thread[id=17, name=Thread-4,
>>>>> state=TIMED_WAITING, group=TGRP-MorphlineReducerTest]
>>>>>>> [junit4]   1> 22402 [Thread-4] ERROR
>>>>> org.apache.solr.hadoop.HeartBeater  - HeartBeat throwable
>>>>>>> [junit4]   1> java.lang.InterruptedException
>>>>>>> [junit4]   1>     at
>>>>> java.util.concurrent.locks.AbstractQueuedSynchronizer.doAcquireSharedNa
>>>>> nos(AbstractQueuedSynchronizer.java:1039)
>>>>>>> [junit4]   1>     at
>>>>> java.util.concurrent.locks.AbstractQueuedSynchronizer.tryAcquireSharedNa
>>>>> nos(AbstractQueuedSynchronizer.java:1328)
>>>>>>> [junit4]   1>     at
>>>>> java.util.concurrent.CountDownLatch.await(CountDownLatch.java:277)
>>>>>>> [junit4]   1>     at
>>>>> org.apache.solr.hadoop.HeartBeater.run(HeartBeater.java:108)
>>>>>>> [junit4]   1> 22405 [Thread-4] INFO  org.apache.solr.hadoop.HeartBeater
>>>>> - heartbeat skipped count 0
>>>>>>> [junit4]   1> 22901 [Thread-4] ERROR
>>>>> org.apache.solr.hadoop.HeartBeater  - HeartBeat throwable
>>>>>>> [junit4]   1> java.lang.InterruptedException
>>>>>>> [junit4]   1>     at
>>>>> java.util.concurrent.locks.AbstractQueuedSynchronizer.doAcquireSharedNa
>>>>> nos(AbstractQueuedSynchronizer.java:1039)
>>>>>>> [junit4]   1>     at
>>>>> java.util.concurrent.locks.AbstractQueuedSynchronizer.tryAcquireSharedNa
>>>>> nos(AbstractQueuedSynchronizer.java:1328)
>>>>>>> [junit4]   1>     at
>>>>> java.util.concurrent.CountDownLatch.await(CountDownLatch.java:277)
>>>>>>> [junit4]   1>     at
>>>>> org.apache.solr.hadoop.HeartBeater.run(HeartBeater.java:108)
>>>>>>> [junit4]   1> 22903 [Thread-4] INFO  org.apache.solr.hadoop.HeartBeater
>>>>> - heartbeat skipped count 0
>>>>>>> [junit4]   1> 23402 [Thread-4] ERROR
>>>>> org.apache.solr.hadoop.HeartBeater  - HeartBeat throwable
>>>>>>> [junit4]   1> java.lang.InterruptedException
>>>>>>> [junit4]   1>     at
>>>>> java.util.concurrent.locks.AbstractQueuedSynchronizer.doAcquireSharedNa
>>>>> nos(AbstractQueuedSynchronizer.java:1039)
>>>>>>> [junit4]   1>     at
>>>>> java.util.concurrent.locks.AbstractQueuedSynchronizer.tryAcquireSharedNa
>>>>> nos(AbstractQueuedSynchronizer.java:1328)
>>>>>>> [junit4]   1>     at
>>>>> java.util.concurrent.CountDownLatch.await(CountDownLatch.java:277)
>>>>>>> [junit4]   1>     at
>>>>> org.apache.solr.hadoop.HeartBeater.run(HeartBeater.java:108)
>>>>>>> [junit4]   1> 23402 [Thread-4] INFO  org.apache.solr.hadoop.HeartBeater
>>>>> - heartbeat skipped count 0
>>>>>>> [junit4]   1> 23902 [Thread-4] ERROR
>>>>> org.apache.solr.hadoop.HeartBeater  - HeartBeat throwable
>>>>>>> [junit4]   1> java.lang.InterruptedException
>>>>>>> [junit4]   1>     at
>>>>> java.util.concurrent.locks.AbstractQueuedSynchronizer.doAcquireSharedNa
>>>>> nos(AbstractQueuedSynchronizer.java:1039)
>>>>>>> [junit4]   1>     at
>>>>> java.util.concurrent.locks.AbstractQueuedSynchronizer.tryAcquireSharedNa
>>>>> nos(AbstractQueuedSynchronizer.java:1328)
>>>>>>> [junit4]   1>     at
>>>>> java.util.concurrent.CountDownLatch.await(CountDownLatch.java:277)
>>>>>>> [junit4]   1>     at
>>>>> org.apache.solr.hadoop.HeartBeater.run(HeartBeater.java:108)
>>>>>>> [junit4]   1> 23903 [Thread-4] INFO  org.apache.solr.hadoop.HeartBeater
>>>>> - heartbeat skipped count 0
>>>>>>> [junit4]   1> 24402 [Thread-4] ERROR
>>>>> org.apache.solr.hadoop.HeartBeater  - HeartBeat throwable
>>>>>>> [junit4]   1> java.lang.InterruptedException
>>>>>>> [junit4]   1>     at
>>>>> java.util.concurrent.locks.AbstractQueuedSynchronizer.doAcquireSharedNa
>>>>> nos(AbstractQueuedSynchronizer.java:1039)
>>>>>>> [junit4]   1>     at
>>>>> java.util.concurrent.locks.AbstractQueuedSynchronizer.tryAcquireSharedNa
>>>>> nos(AbstractQueuedSynchronizer.java:1328)
>>>>>>> [junit4]   1>     at
>>>>> java.util.concurrent.CountDownLatch.await(CountDownLatch.java:277)
>>>>>>> [junit4]   1>     at
>>>>> org.apache.solr.hadoop.HeartBeater.run(HeartBeater.java:108)
>>>>>>> [junit4]   1> 24403 [Thread-4] INFO  org.apache.solr.hadoop.HeartBeater
>>>>> - heartbeat skipped count 0
>>>>>>> [junit4]   1> 24902 [Thread-4] ERROR
>>>>> org.apache.solr.hadoop.HeartBeater  - HeartBeat throwable
>>>>>>> [junit4]   1> java.lang.InterruptedException
>>>>>>> [junit4]   1>     at
>>>>> java.util.concurrent.locks.AbstractQueuedSynchronizer.doAcquireSharedNa
>>>>> nos(AbstractQueuedSynchronizer.java:1039)
>>>>>>> [junit4]   1>     at
>>>>> java.util.concurrent.locks.AbstractQueuedSynchronizer.tryAcquireSharedNa
>>>>> nos(AbstractQueuedSynchronizer.java:1328)
>>>>>>> [junit4]   1>     at
>>>>> java.util.concurrent.CountDownLatch.await(CountDownLatch.java:277)
>>>>>>> [junit4]   1>     at
>>>>> org.apache.solr.hadoop.HeartBeater.run(HeartBeater.java:108)
>>>>>>> [junit4]   1> 24903 [Thread-4] INFO  org.apache.solr.hadoop.HeartBeater
>>>>> - heartbeat skipped count 0
>>>>>>> [junit4]   2> 25776 T11 ccr.ThreadLeakControl.tryToInterruptAll SEVERE
>>>>> There are still zombie threads that couldn't be terminated:
>>>>>>> [junit4]   2>        1) Thread[id=17, name=Thread-4,
>>>>> state=TIMED_WAITING, group=TGRP-MorphlineReducerTest]
>>>>>>> [junit4]   2>             at sun.misc.Unsafe.park(Native Method)
>>>>>>> [junit4]   2>             at
>>>>> java.util.concurrent.locks.LockSupport.parkNanos(LockSupport.java:215)
>>>>>>> [junit4]   2>             at
>>>>> java.util.concurrent.locks.AbstractQueuedSynchronizer.doAcquireSharedNa
>>>>> nos(AbstractQueuedSynchronizer.java:1037)
>>>>>>> [junit4]   2>             at
>>>>> java.util.concurrent.locks.AbstractQueuedSynchronizer.tryAcquireSharedNa
>>>>> nos(AbstractQueuedSynchronizer.java:1328)
>>>>>>> [junit4]   2>             at
>>>>> java.util.concurrent.CountDownLatch.await(CountDownLatch.java:277)
>>>>>>> [junit4]   2>             at
>>>>> org.apache.solr.hadoop.HeartBeater.run(HeartBeater.java:108)
>>>>>>> [junit4]   2> NOTE: test params are: codec=Lucene40,
>>>>> sim=DefaultSimilarity, locale=ar_QA, timezone=America/Yellowknife
>>>>>>> [junit4]   2> NOTE: Linux 3.8.0-33-generic i386/Oracle Corporation 
>>>>>>> 1.8.0-
>>>>> ea (32-bit)/cpus=8,threads=2,free=50593472,total=64880640
>>>>>>> [junit4]   2> NOTE: All tests run in this JVM: [MorphlineReducerTest]
>>>>>>> [junit4]   2> NOTE: reproduce with: ant test  -
>>>>> Dtestcase=MorphlineReducerTest -Dtests.seed=FA8A1D94A2BB2925 -
>>>>> Dtests.multiplier=3 -Dtests.slow=true -Dtests.locale=ar_QA -
>>>>> Dtests.timezone=America/Yellowknife -Dtests.file.encoding=US-ASCII
>>>>>>> [junit4] ERROR   0.00s J1 | MorphlineReducerTest (suite) <<<
>>>>>>> [junit4]    > Throwable #1:
>>>>> com.carrotsearch.randomizedtesting.ThreadLeakError: 1 thread leaked from
>>>>> SUITE scope at org.apache.solr.hadoop.MorphlineReducerTest:
>>>>>>> [junit4]    >    1) Thread[id=17, name=Thread-4, state=TIMED_WAITING,
>>>>> group=TGRP-MorphlineReducerTest]
>>>>>>> [junit4]    >         at sun.misc.Unsafe.park(Native Method)
>>>>>>> [junit4]    >         at
>>>>> java.util.concurrent.locks.LockSupport.parkNanos(LockSupport.java:215)
>>>>>>> [junit4]    >         at
>>>>> java.util.concurrent.locks.AbstractQueuedSynchronizer.doAcquireSharedNa
>>>>> nos(AbstractQueuedSynchronizer.java:1037)
>>>>>>> [junit4]    >         at
>>>>> java.util.concurrent.locks.AbstractQueuedSynchronizer.tryAcquireSharedNa
>>>>> nos(AbstractQueuedSynchronizer.java:1328)
>>>>>>> [junit4]    >         at
>>>>> java.util.concurrent.CountDownLatch.await(CountDownLatch.java:277)
>>>>>>> [junit4]    >         at
>>>>> org.apache.solr.hadoop.HeartBeater.run(HeartBeater.java:108)
>>>>>>> [junit4]    >     at
>>>>> __randomizedtesting.SeedInfo.seed([FA8A1D94A2BB2925]:0)Throwable #2:
>>>>> com.carrotsearch.randomizedtesting.ThreadLeakError: There are still zombie
>>>>> threads that couldn't be terminated:
>>>>>>> [junit4]    >    1) Thread[id=17, name=Thread-4, state=TIMED_WAITING,
>>>>> group=TGRP-MorphlineReducerTest]
>>>>>>> [junit4]    >         at sun.misc.Unsafe.park(Native Method)
>>>>>>> [junit4]    >         at
>>>>> java.util.concurrent.locks.LockSupport.parkNanos(LockSupport.java:215)
>>>>>>> [junit4]    >         at
>>>>> java.util.concurrent.locks.AbstractQueuedSynchronizer.doAcquireSharedNa
>>>>> nos(AbstractQueuedSynchronizer.java:1037)
>>>>>>> [junit4]    >         at
>>>>> java.util.concurrent.locks.AbstractQueuedSynchronizer.tryAcquireSharedNa
>>>>> nos(AbstractQueuedSynchronizer.java:1328)
>>>>>>> [junit4]    >         at
>>>>> java.util.concurrent.CountDownLatch.await(CountDownLatch.java:277)
>>>>>>> [junit4]    >         at
>>>>> org.apache.solr.hadoop.HeartBeater.run(HeartBeater.java:108)
>>>>>>> [junit4]    >     at
>>>>> __randomizedtesting.SeedInfo.seed([FA8A1D94A2BB2925]:0)
>>>>>>> [junit4] Completed on J1 in 26.64s, 1 test, 3 errors <<< FAILURES!
>>>>>>>
>>>>>>> [...truncated 14 lines...]
>>>>>>> BUILD FAILED
>>>>>>> /mnt/ssd/jenkins/workspace/Lucene-Solr-trunk-Linux/build.xml:420: The
>>>>> following error occurred while executing this line:
>>>>>>> /mnt/ssd/jenkins/workspace/Lucene-Solr-trunk-Linux/build.xml:400: The
>>>>> following error occurred while executing this line:
>>>>>>> /mnt/ssd/jenkins/workspace/Lucene-Solr-trunk-Linux/build.xml:39: The
>>>>> following error occurred while executing this line:
>>>>>>> /mnt/ssd/jenkins/workspace/Lucene-Solr-trunk-Linux/extra-
>>>>> targets.xml:37: The following error occurred while executing this line:
>>>>>>> /mnt/ssd/jenkins/workspace/Lucene-Solr-trunk-Linux/solr/build.xml:209:
>>>>> The following error occurred while executing this line:
>>>>>>> /mnt/ssd/jenkins/workspace/Lucene-Solr-trunk-Linux/solr/common-
>>>>> build.xml:441: The following error occurred while executing this line:
>>>>>>> /mnt/ssd/jenkins/workspace/Lucene-Solr-trunk-Linux/solr/common-
>>>>> build.xml:491: The following error occurred while executing this line:
>>>>>>> /mnt/ssd/jenkins/workspace/Lucene-Solr-trunk-Linux/lucene/common-
>>>>> build.xml:1276: The following error occurred while executing this line:
>>>>>>> /mnt/ssd/jenkins/workspace/Lucene-Solr-trunk-Linux/lucene/common-
>>>>> buil
>>>>>>> d.xml:909: There were test failures: 6 suites, 34 tests, 2
>>>>>>> suite-level errors, 1 error, 5 ignored
>>>>>>>
>>>>>>> Total time: 51 minutes 40 seconds
>>>>>>> Build step 'Invoke Ant' marked build as failure Description set:
>>>>>>> Java: 32bit/jdk1.8.0-ea-b117 -server -XX:+UseSerialGC Archiving
>>>>>>> artifacts Recording test results Email was triggered for: Failure
>>>>>>> Sending email for trigger: Failure
>>>>>>>
>>>>>>>
>>>>>>>
>>>>>>> ---------------------------------------------------------------------
>>>>>>> To unsubscribe, e-mail: [email protected] For
>>>>>>> additional commands, e-mail: [email protected]
>>>>>>
>>>>>
>>>>>
>>>>> ---------------------------------------------------------------------
>>>>> To unsubscribe, e-mail: [email protected] For additional
>>>>> commands, e-mail: [email protected]
>>>>
>>>>
>>>> ---------------------------------------------------------------------
>>>> To unsubscribe, e-mail: [email protected]
>>>> For additional commands, e-mail: [email protected]
>>>>
>>>
>>>
>>> ---------------------------------------------------------------------
>>> To unsubscribe, e-mail: [email protected]
>>> For additional commands, e-mail: [email protected]
>>>
>>
>> ---------------------------------------------------------------------
>> To unsubscribe, e-mail: [email protected]
>> For additional commands, e-mail: [email protected]
>>
>
>
> ---------------------------------------------------------------------
> To unsubscribe, e-mail: [email protected]
> For additional commands, e-mail: [email protected]
>

---------------------------------------------------------------------
To unsubscribe, e-mail: [email protected]
For additional commands, e-mail: [email protected]

Reply via email to