Sure. Lets look at this more tomorrow. Bryan
-------- Original message -------- From: Peter Firmstone <[email protected]> Date: To: Bryan Thompson <[email protected]> Cc: [email protected] Subject: Re: Test failures - concurrency bugs or Socket problems? Thanks Bryan, It's way past my bedtime, I'll have a proper look at this in about 18 hours. Basically these test failures appear to be due to (issues that immediately jump out anyway): 1. The test suite is getting an IP address in some cases when it assumes it will get a host name string (will need to look further into that) and it appends a string to the host name, producing a non compliant URI which throws a URISyntaxException during parsing in LookupLocator. 2. Insufficient permissions. If you're happy to run the failed tests again ( I'll provide a file that will allow you to run only the tests that fail), we can run these tests with security debugging enabled, so we can see which protection domain failed the permission check. Off to bed now. Thanks again, Peter. On 20/02/2013 11:28 PM, Bryan Thompson wrote: > Here is the compressed output of the test run. I didn't want to spam > the list with this. > Bryan > > From: Peter <[email protected] <mailto:[email protected]>> > Reply-To: Peter <[email protected] <mailto:[email protected]>> > Date: Wednesday, February 20, 2013 7:17 AM > To: Bryan Thompson <[email protected] <mailto:[email protected]>> > Subject: Re: Test failures - concurrency bugs or Socket problems? > > Cool thanks :) > > ----- Original message ----- > > :-) > > > > I should have asked before I started it on my laptop. Does not seem > to hog that > > much resources. We have several minis here, but they are mostly > running ubantu. > > There is one at another site that is still running OSX. If I run > into problems > > here I'll ask someone to set it up there. > > > > Thanks, > > Bryan > > > > From: Peter <[email protected] > <mailto:[email protected]><mailto:[email protected]>> > > Reply-To: Peter <[email protected] > <mailto:[email protected]><mailto:[email protected]>> > > Date: Tuesday, February 19, 2013 4:07 PM > > To: Bryan Thompson <[email protected] > <mailto:[email protected]><mailto:[email protected]>> > > Subject: Re: Test failures - concurrency bugs or Socket problems? > > > > > > Approximately 18 hours, give or take an hour. > > > > > > ----- Original message ----- > > > Peter, I am trying this on an airbook (4gb ram). Running now. > > > How long is a test run? > > > Thanks > > > Bryan > > > > > > > > > > > > -------- Original message -------- > > > From: Peter <[email protected] > <mailto:[email protected]><mailto:[email protected]>> > > > Date: > > > To: [email protected] > <mailto:[email protected]><mailto:[email protected]> > > > Subject: Re: Test failures - concurrency bugs or Socket problems? > > > > > > > > > From memory, there's not too much required to set up. > > > > > > You need to set your env variable JAVA_HOME and export it, if it > isn't already > > > set. > > > > > > After checking out, execute > > > > > > ant qa.run > > > > > > from the command line. > > > > > > Hopefully that should do it. > > > > > > You've got plenty of memory. If some tests fail, I'll explain how > to execute > > > individual tests with debugging enabled, then you can step through > or dump > > > thread stacks. > > > > > > Thank you, > > > > > > Peter. > > > > > > ----- Original message ----- > > > > We have a 10.8.2 on a recent intel mini with 16G RAM. Does the > test suite > > > > require much memory to run? If not, we also have some other > machines with > > > > less memory and earlier OS revisions. > > > > > > > > Are there specific tests to run? > > > > > > > > Any guidance on running the test suite? > > > > > > > > Thanks, > > > > Bryan > > > > > > > > On 2/19/13 6:28 AM, "Peter Firmstone" > > > > <[email protected] > <mailto:[email protected]><mailto:[email protected]>> wrote: > > > > > > > > > Any chance of checking out and giving her a run? > > > > > > > > > > checkout: > > > > > > > > > > http://svn.apache.org/repos/asf/river/jtsk/skunk/qa_refactor/trunk > > > > > > > > > > > > > > > Be much appreciated if you can. > > > > > > > > > > Cheers, > > > > > > > > > > Peter. > > > > > > > > > > > > > > > On 19/02/2013 9:19 PM, Dan Creswell wrote: > > > > > > Mmm, well I have intel kit but all of mine is on 10.8.x, > actually > > > > > > might be time to revise our minimum support platforms... > > > > > > > > > > > > On 19 February 2013 11:08, Peter > > > > > > Firmstone<[email protected] > <mailto:[email protected]><mailto:[email protected]>> wrote: > > > > > > > On 19/02/2013 8:27 PM, Dan Creswell wrote: > > > > > > > > Which variety of OS X are we talking? > > > > > > > OSX 10.6.8 little endian, so it's Intel arch. > > > > > > > > > > > > > > [diagnostics] System properties > > > > > > > [diagnostics] ------------------------------------------- > > > > > > > [diagnostics] java.runtime.name : Java(TM) SE Runtime > Environment > > > > > > > [diagnostics] sun.boot.library.path : > > > > > > > > /System/Library/Java/JavaVirtualMachines/1.6.0.jdk/Contents/Libraries > > > > > > > [diagnostics] java.vm.version : 20.1-b02-384 > > > > > > > [diagnostics] awt.nativeDoubleBuffering : true > > > > > > > [diagnostics] ant.library.dir : > > > > > > > > > > > > > > > /Users/hudson/hudson-slave/tools/hudson.tasks.Ant_AntInstallation/ant-1. > > > > > > > 8.4/lib > > > > > > > [diagnostics] gopherProxySet : false > > > > > > > [diagnostics] mrj.build : 10M3425 > > > > > > > [diagnostics] java.vm.vendor : Apple Inc. > > > > > > > [diagnostics] java.vendor.url :http://www.apple.com/ > > > > > > > [diagnostics] path.separator : : > > > > > > > [diagnostics] java.vm.name : Java HotSpot(TM) 64-Bit Server VM > > > > > > > [diagnostics] file.encoding.pkg : sun.io > > > > > > > [diagnostics] user.country : US > > > > > > > [diagnostics] sun.java.launcher : SUN_STANDARD > > > > > > > [diagnostics] sun.os.patch.level : unknown > > > > > > > [diagnostics] java.vm.specification.name : Java Virtual > Machine > > > > > > > Specification > > > > > > > [diagnostics] user.dir : > > > > > > > > /Users/hudson/hudson-slave/workspace/river-qa-refactor-osx/trunk > > > > > > > [diagnostics] java.runtime.version : 1.6.0_26-b03-384-10M3425 > > > > > > > [diagnostics] java.awt.graphicsenv : > apple.awt.CGraphicsEnvironment > > > > > > > [diagnostics] java.endorsed.dirs : > > > > > > > > > > > > > > > /System/Library/Java/JavaVirtualMachines/1.6.0.jdk/Contents/Home/lib/end > > > > > > > orsed > > > > > > > [diagnostics] os.arch : x86_64 > > > > > > > [diagnostics] java.io.tmpdir : > > > > > > > /var/folders/aq/aqP130n7Eua3MGAcL598bE+++TY/-Tmp-/ > > > > > > > [diagnostics] line.separator : > > > > > > > [diagnostics] > > > > > > > [diagnostics] java.vm.specification.vendor : Sun > Microsystems Inc. > > > > > > > [diagnostics] os.name : Mac OS X > > > > > > > [diagnostics] ant.home : > > > > > > > > > > > > > > > /Users/hudson/hudson-slave/tools/hudson.tasks.Ant_AntInstallation/ant-1. > > > > > > > 8.4 > > > > > > > [diagnostics] sun.jnu.encoding : MacRoman > > > > > > > [diagnostics] java.library.path : > > > > > > > > > > > > > > > .:/Library/Java/Extensions:/System/Library/Java/Extensions:/usr/lib/java > > > > > > > [diagnostics] java.specification.name : Java Platform API > Specification > > > > > > > [diagnostics] java.class.version : 50.0 > > > > > > > [diagnostics] sun.management.compiler : HotSpot 64-Bit > Tiered Compilers > > > > > > > [diagnostics] os.version : 10.6.8 > > > > > > > [diagnostics] http.nonProxyHosts : > > > > > > > local|*.local|169.254/16|*.169.254/16 > > > > > > > [diagnostics] user.home : /Users/hudson > > > > > > > [diagnostics] user.timezone : America/Los_Angeles > > > > > > > [diagnostics] java.awt.printerjob : apple.awt.CPrinterJob > > > > > > > [diagnostics] java.specification.version : 1.6 > > > > > > > [diagnostics] file.encoding : MacRoman > > > > > > > [diagnostics] user.name : hudson > > > > > > > [diagnostics] java.class.path : > > > > > > > > > > > > > > > /Users/hudson/hudson-slave/tools/hudson.tasks.Ant_AntInstallation/ant-1. > > > > > > > > 8.4/lib/ant-launcher.jar:/Users/hudson/hudson-slave/tools/hudson.tasks.A > > > > > > > > nt_AntInstallation/ant-1.8.4/lib/ant-antlr.jar:/Users/hudson/hudson-slav > > > > > > > > e/tools/hudson.tasks.Ant_AntInstallation/ant-1.8.4/lib/ant-apache-bcel.j > > > > > > > > ar:/Users/hudson/hudson-slave/tools/hudson.tasks.Ant_AntInstallation/ant > > > > > > > > -1.8.4/lib/ant-apache-bsf.jar:/Users/hudson/hudson-slave/tools/hudson.ta > > > > > > > > sks.Ant_AntInstallation/ant-1.8.4/lib/ant-apache-log4j.jar:/Users/hudson > > > > > > > > /hudson-slave/tools/hudson.tasks.Ant_AntInstallation/ant-1.8.4/lib/ant-a > > > > > > > > pache-oro.jar:/Users/hudson/hudson-slave/tools/hudson.tasks.Ant_AntInsta > > > > > > > > llation/ant-1.8.4/lib/ant-apache-regexp.jar:/Users/hudson/hudson-slave/t > > > > > > > > ools/hudson.tasks.Ant_AntInstallation/ant-1.8.4/lib/ant-apache-resolver. > > > > > > > > jar:/Users/hudson/hudson-slave/tools/hudson.tasks.Ant_AntInstallation/an > > > > > > > > t-1.8.4/lib/ant-apache-xalan2.jar:/Users/hudson/hudson-slave/tools/hudso > > > > > > > > n.tasks.Ant_AntInstallation/ant-1.8.4/lib/ant-commons-logging.jar:/Users > > > > > > > > /hudson/hudson-slave/tools/hudson.tasks.Ant_AntInstallation/ant-1.8.4/li > > > > > > > > b/ant-commons-net.jar:/Users/hudson/hudson-slave/tools/hudson.tasks.Ant_ > > > > > > > > AntInstallation/ant-1.8.4/lib/ant-jai.jar:/Users/hudson/hudson-slave/too > > > > > > > > ls/hudson.tasks.Ant_AntInstallation/ant-1.8.4/lib/ant-javamail.jar:/User > > > > > > > > s/hudson/hudson-slave/tools/hudson.tasks.Ant_AntInstallation/ant-1.8.4/l > > > > > > > > ib/ant-jdepend.jar:/Users/hudson/hudson-slave/tools/hudson.tasks.Ant_Ant > > > > > > > > Installation/ant-1.8.4/lib/ant-jmf.jar:/Users/hudson/hudson-slave/tools/ > > > > > > > > hudson.tasks.Ant_AntInstallation/ant-1.8.4/lib/ant-jsch.jar:/Users/hudso > > > > > > > > n/hudson-slave/tools/hudson.tasks.Ant_AntInstallation/ant-1.8.4/lib/ant- > > > > > > > > junit.jar:/Users/hudson/hudson-slave/tools/hudson.tasks.Ant_AntInstallat > > > > > > > > ion/ant-1.8.4/lib/ant-junit4.jar:/Users/hudson/hudson-slave/tools/hudson > > > > > > > > .tasks.Ant_AntInstallation/ant-1.8.4/lib/ant-launcher.jar:/Users/hudson/ > > > > > > > > hudson-slave/tools/hudson.tasks.Ant_AntInstallation/ant-1.8.4/lib/ant-ne > > > > > > > > trexx.jar:/Users/hudson/hudson-slave/tools/hudson.tasks.Ant_AntInstallat > > > > > > > > ion/ant-1.8.4/lib/ant-swing.jar:/Users/hudson/hudson-slave/tools/hudson. > > > > > > > > tasks.Ant_AntInstallation/ant-1.8.4/lib/ant-testutil.jar:/Users/hudson/h > > > > > > > > udson-slave/tools/hudson.tasks.Ant_AntInstallation/ant-1.8.4/lib/ant.jar > > > > > > > [diagnostics] java.vm.specification.version : 1.0 > > > > > > > [diagnostics] sun.arch.data.model : 64 > > > > > > > [diagnostics] java.home : > > > > > > > > /System/Library/Java/JavaVirtualMachines/1.6.0.jdk/Contents/Home > > > > > > > [diagnostics] sun.java.command : > org.apache.tools.ant.launch.Launcher > > > > > > > -cp > > > > > > > hudson-qa > > > > > > > [diagnostics] java.specification.vendor : Sun Microsystems > Inc. > > > > > > > [diagnostics] user.language : en > > > > > > > [diagnostics] awt.toolkit : apple.awt.CToolkit > > > > > > > [diagnostics] java.vm.info : mixed mode > > > > > > > [diagnostics] java.version : 1.6.0_26 > > > > > > > [diagnostics] java.ext.dirs : > > > > > > > > > > > > > > > /Library/Java/Extensions:/System/Library/Java/Extensions:/System/Library > > > > > > > /Java/JavaVirtualMachines/1.6.0.jdk/Contents/Home/lib/ext > > > > > > > [diagnostics] sun.boot.class.path : > > > > > > > > > > > > > > > /System/Library/Java/JavaVirtualMachines/1.6.0.jdk/Contents/Classes/jsfd > > > > > > > > .jar:/System/Library/Java/JavaVirtualMachines/1.6.0.jdk/Contents/Classes > > > > > > > > /classes.jar:/System/Library/Frameworks/JavaVM.framework/Frameworks/Java > > > > > > > > RuntimeSupport.framework/Resources/Java/JavaRuntimeSupport.jar:/System/L > > > > > > > > ibrary/Java/JavaVirtualMachines/1.6.0.jdk/Contents/Classes/ui.jar:/Syste > > > > > > > > m/Library/Java/JavaVirtualMachines/1.6.0.jdk/Contents/Classes/laf.jar:/S > > > > > > > > ystem/Library/Java/JavaVirtualMachines/1.6.0.jdk/Contents/Classes/sunrsa > > > > > > > > sign.jar:/System/Library/Java/JavaVirtualMachines/1.6.0.jdk/Contents/Cla > > > > > > > > sses/jsse.jar:/System/Library/Java/JavaVirtualMachines/1.6.0.jdk/Content > > > > > > > > s/Classes/jce.jar:/System/Library/Java/JavaVirtualMachines/1.6.0.jdk/Con > > > > > > > tents/Classes/charsets.jar > > > > > > > [diagnostics] java.vendor : Apple Inc. > > > > > > > [diagnostics] file.separator : / > > > > > > > [diagnostics] java.vendor.url.bug :http://bugreport.apple.com/ > > > > > > > [diagnostics] sun.cpu.endian : little > > > > > > > [diagnostics] sun.io.unicode.encoding : UnicodeLittle > > > > > > > [diagnostics] mrj.version : 1060.1.6.0_26-384 > > > > > > > [diagnostics] socksNonProxyHosts : > > > > > > > local|*.local|169.254/16|*.169.254/16 > > > > > > > [diagnostics] jikes.class.path : > > > > > > > > > > > > > > > :/System/Library/Frameworks/JavaVM.framework/Home/../Classes/alt-rt.jar: > > > > > > > > /System/Library/Frameworks/JavaVM.framework/Home/../Classes/alt-string.j > > > > > > > > ar:/System/Library/Frameworks/JavaVM.framework/Home/../Classes/charsets. > > > > > > > > jar:/System/Library/Frameworks/JavaVM.framework/Home/../Classes/classes. > > > > > > > > jar:/System/Library/Frameworks/JavaVM.framework/Home/../Classes/dt.jar:/ > > > > > > > > System/Library/Frameworks/JavaVM.framework/Home/../Classes/jce.jar:/Syst > > > > > > > > em/Library/Frameworks/JavaVM.framework/Home/../Classes/jconsole.jar:/Sys > > > > > > > > tem/Library/Frameworks/JavaVM.framework/Home/../Classes/jsse.jar:/System > > > > > > > > /Library/Frameworks/JavaVM.framework/Home/../Classes/management-agent.ja > > > > > > > > r:/System/Library/Frameworks/JavaVM.framework/Home/../Classes/ui.jar > > > > > > > [diagnostics] ftp.nonProxyHosts > <ftp://ftp.nonProxyHosts><ftp://ftp.nonProxyHosts> > <ftp://ftp.nonProxyHosts%3E>; : > > > > > > > local|*.local|169.254/16|*.169.254/16 [diagnostics] > sun.cpu.isalist : > > > > > > > > > > > > > > > > > > > > > > > > > > > > > On 19 February 2013 10:14, Peter > > > > > > > > Firmstone<[email protected] > <mailto:[email protected]><mailto:[email protected]>> wrote: > > > > > > > > > Before I get into the details, let me just say that I'm > unable to > > > > > > > > > reproduce > > > > > > > > > the test failures seen on OSX and Solaris x64 on local > hardware, I > > > > > > > > > don't > > > > > > > > > have access to a debugger or thread dumps. > > > > > > > > > > > > > > > > > > The tests that fail on OSX and Solaris x64 (the tests > pass on > > > > > > > > > sparc), are > > > > > > > > > practically identical. The basic problem is discovery > event's are > > > > > > > > > either > > > > > > > > > not received or only some discovery events are > received. The > > > > > > > > > tests allow > > > > > > > > > very long time frames for these events to be received, > on other > > > > > > > > > OS's these > > > > > > > > > tests pass rapidly. > > > > > > > > > > > > > > > > > > Increasing debugging output has the effect of > increasing the number > > > > > > > > > of > > > > > > > > > events received. > > > > > > > > > > > > > > > > > > The tests and their details can be viewed on Jenkins. > > > > > > > > > > > > > > > > > > Over the last few months I've been inspecting code > manually and > > > > > > > > > fixing > > > > > > > > > synchronization issues. > > > > > > > > > > > > > > > > > > River has a large legacy codebase, there are many > examples of > > > > > > > > > inadequate > > > > > > > > > synchronization. > > > > > > > > > > > > > > > > > > Ironically some of the changes I've made, although > reducing test > > > > > > > > > failures > > > > > > > > > on > > > > > > > > > Linux and Windows has exacerbated test failures on OSX > and Solaris > > > > > > > > > x64. > > > > > > > > > > > > > > > > > > Is there anyone on this list with access to this > hardware who can > > > > > > > > > reproduce > > > > > > > > > these bugs? > > > > > > > > > > > > > > > > > > Regards, > > > > > > > > > > > > > > > > > > Peter. > > > > > > > > > > > > > > > > > > > > > > > > > > > > > > > > > > > > > > > > > > > > > > > > > > > > > > > > > > > > > > >
