Re: [JENKINS] Lucene-Solr-SmokeRelease-4.x - Build # 125 - Failure
This seems like a serious problem: something is really broken with the build? I setup a jenkins job to run this in a loop against the 4.6 branch. On Tue, Nov 12, 2013 at 11:19 PM, Apache Jenkins Server jenk...@builds.apache.org wrote: Build: https://builds.apache.org/job/Lucene-Solr-SmokeRelease-4.x/125/ No tests ran. Build Log: [...truncated 36610 lines...] BUILD FAILED /usr/home/hudson/hudson-slave/workspace/Lucene-Solr-SmokeRelease-4.x/build.xml:333: The following error occurred while executing this line: /usr/home/hudson/hudson-slave/workspace/Lucene-Solr-SmokeRelease-4.x/solr/build.xml:589: The following error occurred while executing this line: /usr/home/hudson/hudson-slave/workspace/Lucene-Solr-SmokeRelease-4.x/solr/build.xml:580: The following error occurred while executing this line: /usr/home/hudson/hudson-slave/workspace/Lucene-Solr-SmokeRelease-4.x/solr/common-build.xml:439: The following error occurred while executing this line: /usr/home/hudson/hudson-slave/workspace/Lucene-Solr-SmokeRelease-4.x/solr/common-build.xml:314: java.lang.OutOfMemoryError: PermGen space at java.lang.ClassLoader.defineClass1(Native Method) at java.lang.ClassLoader.defineClass(ClassLoader.java:634) at org.apache.tools.ant.AntClassLoader.defineClassFromData(AntClassLoader.java:1124) at org.apache.tools.ant.AntClassLoader.getClassFromStream(AntClassLoader.java:1295) at org.apache.tools.ant.AntClassLoader.findClassInComponents(AntClassLoader.java:1351) at org.apache.tools.ant.AntClassLoader.findClass(AntClassLoader.java:1311) at org.apache.tools.ant.AntClassLoader.loadClass(AntClassLoader.java:1064) at java.lang.ClassLoader.loadClass(ClassLoader.java:266) at org.codehaus.groovy.classgen.asm.BytecodeHelper.clinit(BytecodeHelper.java:37) at org.codehaus.groovy.classgen.Verifier.visitClass(Verifier.java:152) at org.codehaus.groovy.control.CompilationUnit$15.call(CompilationUnit.java:757) at org.codehaus.groovy.control.CompilationUnit.applyToPrimaryClassNodes(CompilationUnit.java:1036) at org.codehaus.groovy.control.CompilationUnit.doPhaseOperation(CompilationUnit.java:572) at org.codehaus.groovy.control.CompilationUnit.processPhaseOperations(CompilationUnit.java:550) at org.codehaus.groovy.control.CompilationUnit.compile(CompilationUnit.java:527) at groovy.lang.GroovyClassLoader.doParseClass(GroovyClassLoader.java:279) at groovy.lang.GroovyClassLoader.parseClass(GroovyClassLoader.java:258) at groovy.lang.GroovyShell.parseClass(GroovyShell.java:613) at groovy.lang.GroovyShell.parse(GroovyShell.java:625) at groovy.lang.GroovyShell.parse(GroovyShell.java:652) at org.codehaus.groovy.ant.Groovy.parseAndRunScript(Groovy.java:485) at org.codehaus.groovy.ant.Groovy.execGroovy(Groovy.java:444) at org.codehaus.groovy.ant.Groovy.execute(Groovy.java:309) at org.apache.tools.ant.UnknownElement.execute(UnknownElement.java:291) at sun.reflect.GeneratedMethodAccessor450.invoke(Unknown Source) at sun.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorImpl.java:43) at java.lang.reflect.Method.invoke(Method.java:616) at org.apache.tools.ant.dispatch.DispatchUtils.execute(DispatchUtils.java:106) at org.apache.tools.ant.Task.perform(Task.java:348) at org.apache.tools.ant.Target.execute(Target.java:390) at org.apache.tools.ant.Target.performTasks(Target.java:411) at org.apache.tools.ant.Project.executeSortedTargets(Project.java:1399) Total time: 23 minutes 44 seconds Build step 'Invoke Ant' marked build as failure Email was triggered for: Failure Sending email for trigger: Failure - To unsubscribe, e-mail: dev-unsubscr...@lucene.apache.org For additional commands, e-mail: dev-h...@lucene.apache.org - To unsubscribe, e-mail: dev-unsubscr...@lucene.apache.org For additional commands, e-mail: dev-h...@lucene.apache.org
Re: [JENKINS] Lucene-Solr-SmokeRelease-4.x - Build # 125 - Failure
Robert, I chatted with Uwe on IRC about it earlier today - this is a permgen OOM - he thinks the issue is that Groovy is being loaded multiple times in order to define the lucene.javadoc.url - the LUCENE-5322 changes I backported to branch_4x yesterday are the cause. I did not backport LUCENE-5322 or LUCENE-5217 to the 4.6 release branch, so this issue should not affect the loop you’re running. I’m working on a fix, nightly-smoke was puking because Solr CHANGES.txt didn’t have a 4.7 section, which I’ve added now. Waiting for nightly-smoke to succeed locally. Steve On Nov 13, 2013, at 12:35 PM, Robert Muir rcm...@gmail.com wrote: This seems like a serious problem: something is really broken with the build? I setup a jenkins job to run this in a loop against the 4.6 branch. On Tue, Nov 12, 2013 at 11:19 PM, Apache Jenkins Server jenk...@builds.apache.org wrote: Build: https://builds.apache.org/job/Lucene-Solr-SmokeRelease-4.x/125/ No tests ran. Build Log: [...truncated 36610 lines...] BUILD FAILED /usr/home/hudson/hudson-slave/workspace/Lucene-Solr-SmokeRelease-4.x/build.xml:333: The following error occurred while executing this line: /usr/home/hudson/hudson-slave/workspace/Lucene-Solr-SmokeRelease-4.x/solr/build.xml:589: The following error occurred while executing this line: /usr/home/hudson/hudson-slave/workspace/Lucene-Solr-SmokeRelease-4.x/solr/build.xml:580: The following error occurred while executing this line: /usr/home/hudson/hudson-slave/workspace/Lucene-Solr-SmokeRelease-4.x/solr/common-build.xml:439: The following error occurred while executing this line: /usr/home/hudson/hudson-slave/workspace/Lucene-Solr-SmokeRelease-4.x/solr/common-build.xml:314: java.lang.OutOfMemoryError: PermGen space at java.lang.ClassLoader.defineClass1(Native Method) at java.lang.ClassLoader.defineClass(ClassLoader.java:634) at org.apache.tools.ant.AntClassLoader.defineClassFromData(AntClassLoader.java:1124) at org.apache.tools.ant.AntClassLoader.getClassFromStream(AntClassLoader.java:1295) at org.apache.tools.ant.AntClassLoader.findClassInComponents(AntClassLoader.java:1351) at org.apache.tools.ant.AntClassLoader.findClass(AntClassLoader.java:1311) at org.apache.tools.ant.AntClassLoader.loadClass(AntClassLoader.java:1064) at java.lang.ClassLoader.loadClass(ClassLoader.java:266) at org.codehaus.groovy.classgen.asm.BytecodeHelper.clinit(BytecodeHelper.java:37) at org.codehaus.groovy.classgen.Verifier.visitClass(Verifier.java:152) at org.codehaus.groovy.control.CompilationUnit$15.call(CompilationUnit.java:757) at org.codehaus.groovy.control.CompilationUnit.applyToPrimaryClassNodes(CompilationUnit.java:1036) at org.codehaus.groovy.control.CompilationUnit.doPhaseOperation(CompilationUnit.java:572) at org.codehaus.groovy.control.CompilationUnit.processPhaseOperations(CompilationUnit.java:550) at org.codehaus.groovy.control.CompilationUnit.compile(CompilationUnit.java:527) at groovy.lang.GroovyClassLoader.doParseClass(GroovyClassLoader.java:279) at groovy.lang.GroovyClassLoader.parseClass(GroovyClassLoader.java:258) at groovy.lang.GroovyShell.parseClass(GroovyShell.java:613) at groovy.lang.GroovyShell.parse(GroovyShell.java:625) at groovy.lang.GroovyShell.parse(GroovyShell.java:652) at org.codehaus.groovy.ant.Groovy.parseAndRunScript(Groovy.java:485) at org.codehaus.groovy.ant.Groovy.execGroovy(Groovy.java:444) at org.codehaus.groovy.ant.Groovy.execute(Groovy.java:309) at org.apache.tools.ant.UnknownElement.execute(UnknownElement.java:291) at sun.reflect.GeneratedMethodAccessor450.invoke(Unknown Source) at sun.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorImpl.java:43) at java.lang.reflect.Method.invoke(Method.java:616) at org.apache.tools.ant.dispatch.DispatchUtils.execute(DispatchUtils.java:106) at org.apache.tools.ant.Task.perform(Task.java:348) at org.apache.tools.ant.Target.execute(Target.java:390) at org.apache.tools.ant.Target.performTasks(Target.java:411) at org.apache.tools.ant.Project.executeSortedTargets(Project.java:1399) Total time: 23 minutes 44 seconds Build step 'Invoke Ant' marked build as failure Email was triggered for: Failure Sending email for trigger: Failure - To unsubscribe, e-mail: dev-unsubscr...@lucene.apache.org For additional commands, e-mail: dev-h...@lucene.apache.org - To unsubscribe, e-mail: dev-unsubscr...@lucene.apache.org For additional commands, e-mail: dev-h...@lucene.apache.org - To unsubscribe, e-mail:
Re: [JENKINS] Lucene-Solr-SmokeRelease-4.x - Build # 125 - Failure
oh i see. you already have a patch or you need help? Ill keep the smoketest-loop against 4.6 running just in case, because this jenkins job runs rarely at builds.apache.org but is really useful at times like this :) On Wed, Nov 13, 2013 at 12:46 PM, Steve Rowe sar...@gmail.com wrote: Robert, I chatted with Uwe on IRC about it earlier today - this is a permgen OOM - he thinks the issue is that Groovy is being loaded multiple times in order to define the lucene.javadoc.url - the LUCENE-5322 changes I backported to branch_4x yesterday are the cause. I did not backport LUCENE-5322 or LUCENE-5217 to the 4.6 release branch, so this issue should not affect the loop you’re running. I’m working on a fix, nightly-smoke was puking because Solr CHANGES.txt didn’t have a 4.7 section, which I’ve added now. Waiting for nightly-smoke to succeed locally. Steve On Nov 13, 2013, at 12:35 PM, Robert Muir rcm...@gmail.com wrote: This seems like a serious problem: something is really broken with the build? I setup a jenkins job to run this in a loop against the 4.6 branch. On Tue, Nov 12, 2013 at 11:19 PM, Apache Jenkins Server jenk...@builds.apache.org wrote: Build: https://builds.apache.org/job/Lucene-Solr-SmokeRelease-4.x/125/ No tests ran. Build Log: [...truncated 36610 lines...] BUILD FAILED /usr/home/hudson/hudson-slave/workspace/Lucene-Solr-SmokeRelease-4.x/build.xml:333: The following error occurred while executing this line: /usr/home/hudson/hudson-slave/workspace/Lucene-Solr-SmokeRelease-4.x/solr/build.xml:589: The following error occurred while executing this line: /usr/home/hudson/hudson-slave/workspace/Lucene-Solr-SmokeRelease-4.x/solr/build.xml:580: The following error occurred while executing this line: /usr/home/hudson/hudson-slave/workspace/Lucene-Solr-SmokeRelease-4.x/solr/common-build.xml:439: The following error occurred while executing this line: /usr/home/hudson/hudson-slave/workspace/Lucene-Solr-SmokeRelease-4.x/solr/common-build.xml:314: java.lang.OutOfMemoryError: PermGen space at java.lang.ClassLoader.defineClass1(Native Method) at java.lang.ClassLoader.defineClass(ClassLoader.java:634) at org.apache.tools.ant.AntClassLoader.defineClassFromData(AntClassLoader.java:1124) at org.apache.tools.ant.AntClassLoader.getClassFromStream(AntClassLoader.java:1295) at org.apache.tools.ant.AntClassLoader.findClassInComponents(AntClassLoader.java:1351) at org.apache.tools.ant.AntClassLoader.findClass(AntClassLoader.java:1311) at org.apache.tools.ant.AntClassLoader.loadClass(AntClassLoader.java:1064) at java.lang.ClassLoader.loadClass(ClassLoader.java:266) at org.codehaus.groovy.classgen.asm.BytecodeHelper.clinit(BytecodeHelper.java:37) at org.codehaus.groovy.classgen.Verifier.visitClass(Verifier.java:152) at org.codehaus.groovy.control.CompilationUnit$15.call(CompilationUnit.java:757) at org.codehaus.groovy.control.CompilationUnit.applyToPrimaryClassNodes(CompilationUnit.java:1036) at org.codehaus.groovy.control.CompilationUnit.doPhaseOperation(CompilationUnit.java:572) at org.codehaus.groovy.control.CompilationUnit.processPhaseOperations(CompilationUnit.java:550) at org.codehaus.groovy.control.CompilationUnit.compile(CompilationUnit.java:527) at groovy.lang.GroovyClassLoader.doParseClass(GroovyClassLoader.java:279) at groovy.lang.GroovyClassLoader.parseClass(GroovyClassLoader.java:258) at groovy.lang.GroovyShell.parseClass(GroovyShell.java:613) at groovy.lang.GroovyShell.parse(GroovyShell.java:625) at groovy.lang.GroovyShell.parse(GroovyShell.java:652) at org.codehaus.groovy.ant.Groovy.parseAndRunScript(Groovy.java:485) at org.codehaus.groovy.ant.Groovy.execGroovy(Groovy.java:444) at org.codehaus.groovy.ant.Groovy.execute(Groovy.java:309) at org.apache.tools.ant.UnknownElement.execute(UnknownElement.java:291) at sun.reflect.GeneratedMethodAccessor450.invoke(Unknown Source) at sun.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorImpl.java:43) at java.lang.reflect.Method.invoke(Method.java:616) at org.apache.tools.ant.dispatch.DispatchUtils.execute(DispatchUtils.java:106) at org.apache.tools.ant.Task.perform(Task.java:348) at org.apache.tools.ant.Target.execute(Target.java:390) at org.apache.tools.ant.Target.performTasks(Target.java:411) at org.apache.tools.ant.Project.executeSortedTargets(Project.java:1399) Total time: 23 minutes 44 seconds Build step 'Invoke Ant' marked build as failure Email was triggered for: Failure Sending email for trigger: Failure - To unsubscribe, e-mail: dev-unsubscr...@lucene.apache.org For additional commands, e-mail: dev-h...@lucene.apache.org
Re: [JENKINS] Lucene-Solr-SmokeRelease-4.x - Build # 125 - Failure
I have a patch I’m testing now, thanks. I agree, it is useful to have more testing around a release. Looks like you should be running your smoketest-looper with java 6 instead of java 7 - build #3 is complaining about jar metadata. Steve On Nov 13, 2013, at 12:49 PM, Robert Muir rcm...@gmail.com wrote: oh i see. you already have a patch or you need help? Ill keep the smoketest-loop against 4.6 running just in case, because this jenkins job runs rarely at builds.apache.org but is really useful at times like this :) On Wed, Nov 13, 2013 at 12:46 PM, Steve Rowe sar...@gmail.com wrote: Robert, I chatted with Uwe on IRC about it earlier today - this is a permgen OOM - he thinks the issue is that Groovy is being loaded multiple times in order to define the lucene.javadoc.url - the LUCENE-5322 changes I backported to branch_4x yesterday are the cause. I did not backport LUCENE-5322 or LUCENE-5217 to the 4.6 release branch, so this issue should not affect the loop you’re running. I’m working on a fix, nightly-smoke was puking because Solr CHANGES.txt didn’t have a 4.7 section, which I’ve added now. Waiting for nightly-smoke to succeed locally. Steve On Nov 13, 2013, at 12:35 PM, Robert Muir rcm...@gmail.com wrote: This seems like a serious problem: something is really broken with the build? I setup a jenkins job to run this in a loop against the 4.6 branch. On Tue, Nov 12, 2013 at 11:19 PM, Apache Jenkins Server jenk...@builds.apache.org wrote: Build: https://builds.apache.org/job/Lucene-Solr-SmokeRelease-4.x/125/ No tests ran. Build Log: [...truncated 36610 lines...] BUILD FAILED /usr/home/hudson/hudson-slave/workspace/Lucene-Solr-SmokeRelease-4.x/build.xml:333: The following error occurred while executing this line: /usr/home/hudson/hudson-slave/workspace/Lucene-Solr-SmokeRelease-4.x/solr/build.xml:589: The following error occurred while executing this line: /usr/home/hudson/hudson-slave/workspace/Lucene-Solr-SmokeRelease-4.x/solr/build.xml:580: The following error occurred while executing this line: /usr/home/hudson/hudson-slave/workspace/Lucene-Solr-SmokeRelease-4.x/solr/common-build.xml:439: The following error occurred while executing this line: /usr/home/hudson/hudson-slave/workspace/Lucene-Solr-SmokeRelease-4.x/solr/common-build.xml:314: java.lang.OutOfMemoryError: PermGen space at java.lang.ClassLoader.defineClass1(Native Method) at java.lang.ClassLoader.defineClass(ClassLoader.java:634) at org.apache.tools.ant.AntClassLoader.defineClassFromData(AntClassLoader.java:1124) at org.apache.tools.ant.AntClassLoader.getClassFromStream(AntClassLoader.java:1295) at org.apache.tools.ant.AntClassLoader.findClassInComponents(AntClassLoader.java:1351) at org.apache.tools.ant.AntClassLoader.findClass(AntClassLoader.java:1311) at org.apache.tools.ant.AntClassLoader.loadClass(AntClassLoader.java:1064) at java.lang.ClassLoader.loadClass(ClassLoader.java:266) at org.codehaus.groovy.classgen.asm.BytecodeHelper.clinit(BytecodeHelper.java:37) at org.codehaus.groovy.classgen.Verifier.visitClass(Verifier.java:152) at org.codehaus.groovy.control.CompilationUnit$15.call(CompilationUnit.java:757) at org.codehaus.groovy.control.CompilationUnit.applyToPrimaryClassNodes(CompilationUnit.java:1036) at org.codehaus.groovy.control.CompilationUnit.doPhaseOperation(CompilationUnit.java:572) at org.codehaus.groovy.control.CompilationUnit.processPhaseOperations(CompilationUnit.java:550) at org.codehaus.groovy.control.CompilationUnit.compile(CompilationUnit.java:527) at groovy.lang.GroovyClassLoader.doParseClass(GroovyClassLoader.java:279) at groovy.lang.GroovyClassLoader.parseClass(GroovyClassLoader.java:258) at groovy.lang.GroovyShell.parseClass(GroovyShell.java:613) at groovy.lang.GroovyShell.parse(GroovyShell.java:625) at groovy.lang.GroovyShell.parse(GroovyShell.java:652) at org.codehaus.groovy.ant.Groovy.parseAndRunScript(Groovy.java:485) at org.codehaus.groovy.ant.Groovy.execGroovy(Groovy.java:444) at org.codehaus.groovy.ant.Groovy.execute(Groovy.java:309) at org.apache.tools.ant.UnknownElement.execute(UnknownElement.java:291) at sun.reflect.GeneratedMethodAccessor450.invoke(Unknown Source) at sun.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorImpl.java:43) at java.lang.reflect.Method.invoke(Method.java:616) at org.apache.tools.ant.dispatch.DispatchUtils.execute(DispatchUtils.java:106) at org.apache.tools.ant.Task.perform(Task.java:348) at org.apache.tools.ant.Target.execute(Target.java:390) at org.apache.tools.ant.Target.performTasks(Target.java:411) at org.apache.tools.ant.Project.executeSortedTargets(Project.java:1399) Total time: 23 minutes 44 seconds Build step 'Invoke
Re: [JENKINS] Lucene-Solr-SmokeRelease-4.x - Build # 125 - Failure
I set JAVA_HOME to a 1.6 compiler, but this still trips: I actually think something is seriously broken with the build? I set this up because Simon was trying to make a RC manually and pinged me about wrong compiler being used, OOMs, etc. [lucene-solr-46-smoker] $ ant -DJAVA7_HOME=/usr/local/jdk1.7.0_25 -DJAVA6_HOME=/usr/local/jdk1.6.0_37 -DJAVA_HOME=/usr/local/jdk1.6.0_37 nightly-smoke On Wed, Nov 13, 2013 at 12:53 PM, Steve Rowe sar...@gmail.com wrote: I have a patch I’m testing now, thanks. I agree, it is useful to have more testing around a release. Looks like you should be running your smoketest-looper with java 6 instead of java 7 - build #3 is complaining about jar metadata. Steve On Nov 13, 2013, at 12:49 PM, Robert Muir rcm...@gmail.com wrote: oh i see. you already have a patch or you need help? Ill keep the smoketest-loop against 4.6 running just in case, because this jenkins job runs rarely at builds.apache.org but is really useful at times like this :) On Wed, Nov 13, 2013 at 12:46 PM, Steve Rowe sar...@gmail.com wrote: Robert, I chatted with Uwe on IRC about it earlier today - this is a permgen OOM - he thinks the issue is that Groovy is being loaded multiple times in order to define the lucene.javadoc.url - the LUCENE-5322 changes I backported to branch_4x yesterday are the cause. I did not backport LUCENE-5322 or LUCENE-5217 to the 4.6 release branch, so this issue should not affect the loop you’re running. I’m working on a fix, nightly-smoke was puking because Solr CHANGES.txt didn’t have a 4.7 section, which I’ve added now. Waiting for nightly-smoke to succeed locally. Steve On Nov 13, 2013, at 12:35 PM, Robert Muir rcm...@gmail.com wrote: This seems like a serious problem: something is really broken with the build? I setup a jenkins job to run this in a loop against the 4.6 branch. On Tue, Nov 12, 2013 at 11:19 PM, Apache Jenkins Server jenk...@builds.apache.org wrote: Build: https://builds.apache.org/job/Lucene-Solr-SmokeRelease-4.x/125/ No tests ran. Build Log: [...truncated 36610 lines...] BUILD FAILED /usr/home/hudson/hudson-slave/workspace/Lucene-Solr-SmokeRelease-4.x/build.xml:333: The following error occurred while executing this line: /usr/home/hudson/hudson-slave/workspace/Lucene-Solr-SmokeRelease-4.x/solr/build.xml:589: The following error occurred while executing this line: /usr/home/hudson/hudson-slave/workspace/Lucene-Solr-SmokeRelease-4.x/solr/build.xml:580: The following error occurred while executing this line: /usr/home/hudson/hudson-slave/workspace/Lucene-Solr-SmokeRelease-4.x/solr/common-build.xml:439: The following error occurred while executing this line: /usr/home/hudson/hudson-slave/workspace/Lucene-Solr-SmokeRelease-4.x/solr/common-build.xml:314: java.lang.OutOfMemoryError: PermGen space at java.lang.ClassLoader.defineClass1(Native Method) at java.lang.ClassLoader.defineClass(ClassLoader.java:634) at org.apache.tools.ant.AntClassLoader.defineClassFromData(AntClassLoader.java:1124) at org.apache.tools.ant.AntClassLoader.getClassFromStream(AntClassLoader.java:1295) at org.apache.tools.ant.AntClassLoader.findClassInComponents(AntClassLoader.java:1351) at org.apache.tools.ant.AntClassLoader.findClass(AntClassLoader.java:1311) at org.apache.tools.ant.AntClassLoader.loadClass(AntClassLoader.java:1064) at java.lang.ClassLoader.loadClass(ClassLoader.java:266) at org.codehaus.groovy.classgen.asm.BytecodeHelper.clinit(BytecodeHelper.java:37) at org.codehaus.groovy.classgen.Verifier.visitClass(Verifier.java:152) at org.codehaus.groovy.control.CompilationUnit$15.call(CompilationUnit.java:757) at org.codehaus.groovy.control.CompilationUnit.applyToPrimaryClassNodes(CompilationUnit.java:1036) at org.codehaus.groovy.control.CompilationUnit.doPhaseOperation(CompilationUnit.java:572) at org.codehaus.groovy.control.CompilationUnit.processPhaseOperations(CompilationUnit.java:550) at org.codehaus.groovy.control.CompilationUnit.compile(CompilationUnit.java:527) at groovy.lang.GroovyClassLoader.doParseClass(GroovyClassLoader.java:279) at groovy.lang.GroovyClassLoader.parseClass(GroovyClassLoader.java:258) at groovy.lang.GroovyShell.parseClass(GroovyShell.java:613) at groovy.lang.GroovyShell.parse(GroovyShell.java:625) at groovy.lang.GroovyShell.parse(GroovyShell.java:652) at org.codehaus.groovy.ant.Groovy.parseAndRunScript(Groovy.java:485) at org.codehaus.groovy.ant.Groovy.execGroovy(Groovy.java:444) at org.codehaus.groovy.ant.Groovy.execute(Groovy.java:309) at org.apache.tools.ant.UnknownElement.execute(UnknownElement.java:291) at sun.reflect.GeneratedMethodAccessor450.invoke(Unknown Source) at sun.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorImpl.java:43) at
Re: [JENKINS] Lucene-Solr-SmokeRelease-4.x - Build # 125 - Failure
This isn't how its supposed to work though :) JAVA_HOME should work. I'm 99% positive if i switch my exact same jenkins task to a previous release branch it will pass. On Wed, Nov 13, 2013 at 1:07 PM, Steve Rowe sar...@gmail.com wrote: I don’t think it’s JAVA_HOME that’s consulted to produce the fake release, but rather the first javac on the PATH. (That’s true for a real release too of course.) So you should do $ JAVA_HOME=/usr/local/jdk1.6.0_37 PATH=$JAVA_HOME/bin:$PATH ant -DJAVA7_HOME=/usr/local/jdk1.7.0_25 -DJAVA6_HOME=$JAVA_HOME -DJAVA_HOME=$JAVA_HOME nightly-smoke Steve On Nov 13, 2013, at 1:01 PM, Robert Muir rcm...@gmail.com wrote: I set JAVA_HOME to a 1.6 compiler, but this still trips: I actually think something is seriously broken with the build? I set this up because Simon was trying to make a RC manually and pinged me about wrong compiler being used, OOMs, etc. [lucene-solr-46-smoker] $ ant -DJAVA7_HOME=/usr/local/jdk1.7.0_25 -DJAVA6_HOME=/usr/local/jdk1.6.0_37 -DJAVA_HOME=/usr/local/jdk1.6.0_37 nightly-smoke On Wed, Nov 13, 2013 at 12:53 PM, Steve Rowe sar...@gmail.com wrote: I have a patch I’m testing now, thanks. I agree, it is useful to have more testing around a release. Looks like you should be running your smoketest-looper with java 6 instead of java 7 - build #3 is complaining about jar metadata. Steve On Nov 13, 2013, at 12:49 PM, Robert Muir rcm...@gmail.com wrote: oh i see. you already have a patch or you need help? Ill keep the smoketest-loop against 4.6 running just in case, because this jenkins job runs rarely at builds.apache.org but is really useful at times like this :) On Wed, Nov 13, 2013 at 12:46 PM, Steve Rowe sar...@gmail.com wrote: Robert, I chatted with Uwe on IRC about it earlier today - this is a permgen OOM - he thinks the issue is that Groovy is being loaded multiple times in order to define the lucene.javadoc.url - the LUCENE-5322 changes I backported to branch_4x yesterday are the cause. I did not backport LUCENE-5322 or LUCENE-5217 to the 4.6 release branch, so this issue should not affect the loop you’re running. I’m working on a fix, nightly-smoke was puking because Solr CHANGES.txt didn’t have a 4.7 section, which I’ve added now. Waiting for nightly-smoke to succeed locally. Steve On Nov 13, 2013, at 12:35 PM, Robert Muir rcm...@gmail.com wrote: This seems like a serious problem: something is really broken with the build? I setup a jenkins job to run this in a loop against the 4.6 branch. On Tue, Nov 12, 2013 at 11:19 PM, Apache Jenkins Server jenk...@builds.apache.org wrote: Build: https://builds.apache.org/job/Lucene-Solr-SmokeRelease-4.x/125/ No tests ran. Build Log: [...truncated 36610 lines...] BUILD FAILED /usr/home/hudson/hudson-slave/workspace/Lucene-Solr-SmokeRelease-4.x/build.xml:333: The following error occurred while executing this line: /usr/home/hudson/hudson-slave/workspace/Lucene-Solr-SmokeRelease-4.x/solr/build.xml:589: The following error occurred while executing this line: /usr/home/hudson/hudson-slave/workspace/Lucene-Solr-SmokeRelease-4.x/solr/build.xml:580: The following error occurred while executing this line: /usr/home/hudson/hudson-slave/workspace/Lucene-Solr-SmokeRelease-4.x/solr/common-build.xml:439: The following error occurred while executing this line: /usr/home/hudson/hudson-slave/workspace/Lucene-Solr-SmokeRelease-4.x/solr/common-build.xml:314: java.lang.OutOfMemoryError: PermGen space at java.lang.ClassLoader.defineClass1(Native Method) at java.lang.ClassLoader.defineClass(ClassLoader.java:634) at org.apache.tools.ant.AntClassLoader.defineClassFromData(AntClassLoader.java:1124) at org.apache.tools.ant.AntClassLoader.getClassFromStream(AntClassLoader.java:1295) at org.apache.tools.ant.AntClassLoader.findClassInComponents(AntClassLoader.java:1351) at org.apache.tools.ant.AntClassLoader.findClass(AntClassLoader.java:1311) at org.apache.tools.ant.AntClassLoader.loadClass(AntClassLoader.java:1064) at java.lang.ClassLoader.loadClass(ClassLoader.java:266) at org.codehaus.groovy.classgen.asm.BytecodeHelper.clinit(BytecodeHelper.java:37) at org.codehaus.groovy.classgen.Verifier.visitClass(Verifier.java:152) at org.codehaus.groovy.control.CompilationUnit$15.call(CompilationUnit.java:757) at org.codehaus.groovy.control.CompilationUnit.applyToPrimaryClassNodes(CompilationUnit.java:1036) at org.codehaus.groovy.control.CompilationUnit.doPhaseOperation(CompilationUnit.java:572) at org.codehaus.groovy.control.CompilationUnit.processPhaseOperations(CompilationUnit.java:550) at org.codehaus.groovy.control.CompilationUnit.compile(CompilationUnit.java:527) at groovy.lang.GroovyClassLoader.doParseClass(GroovyClassLoader.java:279) at groovy.lang.GroovyClassLoader.parseClass(GroovyClassLoader.java:258) at
Re: [JENKINS] Lucene-Solr-SmokeRelease-4.x - Build # 125 - Failure
I don’t think it’s JAVA_HOME that’s consulted to produce the fake release, but rather the first javac on the PATH. (That’s true for a real release too of course.) So you should do $ JAVA_HOME=/usr/local/jdk1.6.0_37 PATH=$JAVA_HOME/bin:$PATH ant -DJAVA7_HOME=/usr/local/jdk1.7.0_25 -DJAVA6_HOME=$JAVA_HOME -DJAVA_HOME=$JAVA_HOME nightly-smoke Steve On Nov 13, 2013, at 1:01 PM, Robert Muir rcm...@gmail.com wrote: I set JAVA_HOME to a 1.6 compiler, but this still trips: I actually think something is seriously broken with the build? I set this up because Simon was trying to make a RC manually and pinged me about wrong compiler being used, OOMs, etc. [lucene-solr-46-smoker] $ ant -DJAVA7_HOME=/usr/local/jdk1.7.0_25 -DJAVA6_HOME=/usr/local/jdk1.6.0_37 -DJAVA_HOME=/usr/local/jdk1.6.0_37 nightly-smoke On Wed, Nov 13, 2013 at 12:53 PM, Steve Rowe sar...@gmail.com wrote: I have a patch I’m testing now, thanks. I agree, it is useful to have more testing around a release. Looks like you should be running your smoketest-looper with java 6 instead of java 7 - build #3 is complaining about jar metadata. Steve On Nov 13, 2013, at 12:49 PM, Robert Muir rcm...@gmail.com wrote: oh i see. you already have a patch or you need help? Ill keep the smoketest-loop against 4.6 running just in case, because this jenkins job runs rarely at builds.apache.org but is really useful at times like this :) On Wed, Nov 13, 2013 at 12:46 PM, Steve Rowe sar...@gmail.com wrote: Robert, I chatted with Uwe on IRC about it earlier today - this is a permgen OOM - he thinks the issue is that Groovy is being loaded multiple times in order to define the lucene.javadoc.url - the LUCENE-5322 changes I backported to branch_4x yesterday are the cause. I did not backport LUCENE-5322 or LUCENE-5217 to the 4.6 release branch, so this issue should not affect the loop you’re running. I’m working on a fix, nightly-smoke was puking because Solr CHANGES.txt didn’t have a 4.7 section, which I’ve added now. Waiting for nightly-smoke to succeed locally. Steve On Nov 13, 2013, at 12:35 PM, Robert Muir rcm...@gmail.com wrote: This seems like a serious problem: something is really broken with the build? I setup a jenkins job to run this in a loop against the 4.6 branch. On Tue, Nov 12, 2013 at 11:19 PM, Apache Jenkins Server jenk...@builds.apache.org wrote: Build: https://builds.apache.org/job/Lucene-Solr-SmokeRelease-4.x/125/ No tests ran. Build Log: [...truncated 36610 lines...] BUILD FAILED /usr/home/hudson/hudson-slave/workspace/Lucene-Solr-SmokeRelease-4.x/build.xml:333: The following error occurred while executing this line: /usr/home/hudson/hudson-slave/workspace/Lucene-Solr-SmokeRelease-4.x/solr/build.xml:589: The following error occurred while executing this line: /usr/home/hudson/hudson-slave/workspace/Lucene-Solr-SmokeRelease-4.x/solr/build.xml:580: The following error occurred while executing this line: /usr/home/hudson/hudson-slave/workspace/Lucene-Solr-SmokeRelease-4.x/solr/common-build.xml:439: The following error occurred while executing this line: /usr/home/hudson/hudson-slave/workspace/Lucene-Solr-SmokeRelease-4.x/solr/common-build.xml:314: java.lang.OutOfMemoryError: PermGen space at java.lang.ClassLoader.defineClass1(Native Method) at java.lang.ClassLoader.defineClass(ClassLoader.java:634) at org.apache.tools.ant.AntClassLoader.defineClassFromData(AntClassLoader.java:1124) at org.apache.tools.ant.AntClassLoader.getClassFromStream(AntClassLoader.java:1295) at org.apache.tools.ant.AntClassLoader.findClassInComponents(AntClassLoader.java:1351) at org.apache.tools.ant.AntClassLoader.findClass(AntClassLoader.java:1311) at org.apache.tools.ant.AntClassLoader.loadClass(AntClassLoader.java:1064) at java.lang.ClassLoader.loadClass(ClassLoader.java:266) at org.codehaus.groovy.classgen.asm.BytecodeHelper.clinit(BytecodeHelper.java:37) at org.codehaus.groovy.classgen.Verifier.visitClass(Verifier.java:152) at org.codehaus.groovy.control.CompilationUnit$15.call(CompilationUnit.java:757) at org.codehaus.groovy.control.CompilationUnit.applyToPrimaryClassNodes(CompilationUnit.java:1036) at org.codehaus.groovy.control.CompilationUnit.doPhaseOperation(CompilationUnit.java:572) at org.codehaus.groovy.control.CompilationUnit.processPhaseOperations(CompilationUnit.java:550) at org.codehaus.groovy.control.CompilationUnit.compile(CompilationUnit.java:527) at groovy.lang.GroovyClassLoader.doParseClass(GroovyClassLoader.java:279) at groovy.lang.GroovyClassLoader.parseClass(GroovyClassLoader.java:258) at groovy.lang.GroovyShell.parseClass(GroovyShell.java:613) at groovy.lang.GroovyShell.parse(GroovyShell.java:625) at groovy.lang.GroovyShell.parse(GroovyShell.java:652) at
Re: [JENKINS] Lucene-Solr-SmokeRelease-4.x - Build # 125 - Failure
I can't find anywhere in the build that looks up JAVA_HOME (other than smokeTestRelease.py) - through what mechanism should a JAVA_HOME sysprop affect which javac and javadoc binaries are used to build a release? On Nov 13, 2013, at 1:11 PM, Robert Muir rcm...@gmail.com wrote: This isn't how its supposed to work though :) JAVA_HOME should work. I'm 99% positive if i switch my exact same jenkins task to a previous release branch it will pass. On Wed, Nov 13, 2013 at 1:07 PM, Steve Rowe sar...@gmail.com wrote: I don’t think it’s JAVA_HOME that’s consulted to produce the fake release, but rather the first javac on the PATH. (That’s true for a real release too of course.) So you should do $ JAVA_HOME=/usr/local/jdk1.6.0_37 PATH=$JAVA_HOME/bin:$PATH ant -DJAVA7_HOME=/usr/local/jdk1.7.0_25 -DJAVA6_HOME=$JAVA_HOME -DJAVA_HOME=$JAVA_HOME nightly-smoke Steve On Nov 13, 2013, at 1:01 PM, Robert Muir rcm...@gmail.com wrote: I set JAVA_HOME to a 1.6 compiler, but this still trips: I actually think something is seriously broken with the build? I set this up because Simon was trying to make a RC manually and pinged me about wrong compiler being used, OOMs, etc. [lucene-solr-46-smoker] $ ant -DJAVA7_HOME=/usr/local/jdk1.7.0_25 -DJAVA6_HOME=/usr/local/jdk1.6.0_37 -DJAVA_HOME=/usr/local/jdk1.6.0_37 nightly-smoke On Wed, Nov 13, 2013 at 12:53 PM, Steve Rowe sar...@gmail.com wrote: I have a patch I’m testing now, thanks. I agree, it is useful to have more testing around a release. Looks like you should be running your smoketest-looper with java 6 instead of java 7 - build #3 is complaining about jar metadata. Steve On Nov 13, 2013, at 12:49 PM, Robert Muir rcm...@gmail.com wrote: oh i see. you already have a patch or you need help? Ill keep the smoketest-loop against 4.6 running just in case, because this jenkins job runs rarely at builds.apache.org but is really useful at times like this :) On Wed, Nov 13, 2013 at 12:46 PM, Steve Rowe sar...@gmail.com wrote: Robert, I chatted with Uwe on IRC about it earlier today - this is a permgen OOM - he thinks the issue is that Groovy is being loaded multiple times in order to define the lucene.javadoc.url - the LUCENE-5322 changes I backported to branch_4x yesterday are the cause. I did not backport LUCENE-5322 or LUCENE-5217 to the 4.6 release branch, so this issue should not affect the loop you’re running. I’m working on a fix, nightly-smoke was puking because Solr CHANGES.txt didn’t have a 4.7 section, which I’ve added now. Waiting for nightly-smoke to succeed locally. Steve On Nov 13, 2013, at 12:35 PM, Robert Muir rcm...@gmail.com wrote: This seems like a serious problem: something is really broken with the build? I setup a jenkins job to run this in a loop against the 4.6 branch. On Tue, Nov 12, 2013 at 11:19 PM, Apache Jenkins Server jenk...@builds.apache.org wrote: Build: https://builds.apache.org/job/Lucene-Solr-SmokeRelease-4.x/125/ No tests ran. Build Log: [...truncated 36610 lines...] BUILD FAILED /usr/home/hudson/hudson-slave/workspace/Lucene-Solr-SmokeRelease-4.x/build.xml:333: The following error occurred while executing this line: /usr/home/hudson/hudson-slave/workspace/Lucene-Solr-SmokeRelease-4.x/solr/build.xml:589: The following error occurred while executing this line: /usr/home/hudson/hudson-slave/workspace/Lucene-Solr-SmokeRelease-4.x/solr/build.xml:580: The following error occurred while executing this line: /usr/home/hudson/hudson-slave/workspace/Lucene-Solr-SmokeRelease-4.x/solr/common-build.xml:439: The following error occurred while executing this line: /usr/home/hudson/hudson-slave/workspace/Lucene-Solr-SmokeRelease-4.x/solr/common-build.xml:314: java.lang.OutOfMemoryError: PermGen space at java.lang.ClassLoader.defineClass1(Native Method) at java.lang.ClassLoader.defineClass(ClassLoader.java:634) at org.apache.tools.ant.AntClassLoader.defineClassFromData(AntClassLoader.java:1124) at org.apache.tools.ant.AntClassLoader.getClassFromStream(AntClassLoader.java:1295) at org.apache.tools.ant.AntClassLoader.findClassInComponents(AntClassLoader.java:1351) at org.apache.tools.ant.AntClassLoader.findClass(AntClassLoader.java:1311) at org.apache.tools.ant.AntClassLoader.loadClass(AntClassLoader.java:1064) at java.lang.ClassLoader.loadClass(ClassLoader.java:266) at org.codehaus.groovy.classgen.asm.BytecodeHelper.clinit(BytecodeHelper.java:37) at org.codehaus.groovy.classgen.Verifier.visitClass(Verifier.java:152) at org.codehaus.groovy.control.CompilationUnit$15.call(CompilationUnit.java:757) at org.codehaus.groovy.control.CompilationUnit.applyToPrimaryClassNodes(CompilationUnit.java:1036) at org.codehaus.groovy.control.CompilationUnit.doPhaseOperation(CompilationUnit.java:572) at
Re: [JENKINS] Lucene-Solr-SmokeRelease-4.x - Build # 125 - Failure
JAVA_HOME still works: its what the ant 'javac' target uses. My problem was related to jenkins only, and I think Uwe already logged in and fixed it. Sorry for the noise. On Wed, Nov 13, 2013 at 2:03 PM, Steve Rowe sar...@gmail.com wrote: I can't find anywhere in the build that looks up JAVA_HOME (other than smokeTestRelease.py) - through what mechanism should a JAVA_HOME sysprop affect which javac and javadoc binaries are used to build a release? On Nov 13, 2013, at 1:11 PM, Robert Muir rcm...@gmail.com wrote: This isn't how its supposed to work though :) JAVA_HOME should work. I'm 99% positive if i switch my exact same jenkins task to a previous release branch it will pass. On Wed, Nov 13, 2013 at 1:07 PM, Steve Rowe sar...@gmail.com wrote: I don’t think it’s JAVA_HOME that’s consulted to produce the fake release, but rather the first javac on the PATH. (That’s true for a real release too of course.) So you should do $ JAVA_HOME=/usr/local/jdk1.6.0_37 PATH=$JAVA_HOME/bin:$PATH ant -DJAVA7_HOME=/usr/local/jdk1.7.0_25 -DJAVA6_HOME=$JAVA_HOME -DJAVA_HOME=$JAVA_HOME nightly-smoke Steve On Nov 13, 2013, at 1:01 PM, Robert Muir rcm...@gmail.com wrote: I set JAVA_HOME to a 1.6 compiler, but this still trips: I actually think something is seriously broken with the build? I set this up because Simon was trying to make a RC manually and pinged me about wrong compiler being used, OOMs, etc. [lucene-solr-46-smoker] $ ant -DJAVA7_HOME=/usr/local/jdk1.7.0_25 -DJAVA6_HOME=/usr/local/jdk1.6.0_37 -DJAVA_HOME=/usr/local/jdk1.6.0_37 nightly-smoke On Wed, Nov 13, 2013 at 12:53 PM, Steve Rowe sar...@gmail.com wrote: I have a patch I’m testing now, thanks. I agree, it is useful to have more testing around a release. Looks like you should be running your smoketest-looper with java 6 instead of java 7 - build #3 is complaining about jar metadata. Steve On Nov 13, 2013, at 12:49 PM, Robert Muir rcm...@gmail.com wrote: oh i see. you already have a patch or you need help? Ill keep the smoketest-loop against 4.6 running just in case, because this jenkins job runs rarely at builds.apache.org but is really useful at times like this :) On Wed, Nov 13, 2013 at 12:46 PM, Steve Rowe sar...@gmail.com wrote: Robert, I chatted with Uwe on IRC about it earlier today - this is a permgen OOM - he thinks the issue is that Groovy is being loaded multiple times in order to define the lucene.javadoc.url - the LUCENE-5322 changes I backported to branch_4x yesterday are the cause. I did not backport LUCENE-5322 or LUCENE-5217 to the 4.6 release branch, so this issue should not affect the loop you’re running. I’m working on a fix, nightly-smoke was puking because Solr CHANGES.txt didn’t have a 4.7 section, which I’ve added now. Waiting for nightly-smoke to succeed locally. Steve On Nov 13, 2013, at 12:35 PM, Robert Muir rcm...@gmail.com wrote: This seems like a serious problem: something is really broken with the build? I setup a jenkins job to run this in a loop against the 4.6 branch. On Tue, Nov 12, 2013 at 11:19 PM, Apache Jenkins Server jenk...@builds.apache.org wrote: Build: https://builds.apache.org/job/Lucene-Solr-SmokeRelease-4.x/125/ No tests ran. Build Log: [...truncated 36610 lines...] BUILD FAILED /usr/home/hudson/hudson-slave/workspace/Lucene-Solr-SmokeRelease-4.x/build.xml:333: The following error occurred while executing this line: /usr/home/hudson/hudson-slave/workspace/Lucene-Solr-SmokeRelease-4.x/solr/build.xml:589: The following error occurred while executing this line: /usr/home/hudson/hudson-slave/workspace/Lucene-Solr-SmokeRelease-4.x/solr/build.xml:580: The following error occurred while executing this line: /usr/home/hudson/hudson-slave/workspace/Lucene-Solr-SmokeRelease-4.x/solr/common-build.xml:439: The following error occurred while executing this line: /usr/home/hudson/hudson-slave/workspace/Lucene-Solr-SmokeRelease-4.x/solr/common-build.xml:314: java.lang.OutOfMemoryError: PermGen space at java.lang.ClassLoader.defineClass1(Native Method) at java.lang.ClassLoader.defineClass(ClassLoader.java:634) at org.apache.tools.ant.AntClassLoader.defineClassFromData(AntClassLoader.java:1124) at org.apache.tools.ant.AntClassLoader.getClassFromStream(AntClassLoader.java:1295) at org.apache.tools.ant.AntClassLoader.findClassInComponents(AntClassLoader.java:1351) at org.apache.tools.ant.AntClassLoader.findClass(AntClassLoader.java:1311) at org.apache.tools.ant.AntClassLoader.loadClass(AntClassLoader.java:1064) at java.lang.ClassLoader.loadClass(ClassLoader.java:266) at org.codehaus.groovy.classgen.asm.BytecodeHelper.clinit(BytecodeHelper.java:37) at org.codehaus.groovy.classgen.Verifier.visitClass(Verifier.java:152) at org.codehaus.groovy.control.CompilationUnit$15.call(CompilationUnit.java:757) at