Re: Test failures - concurrency bugs or Socket problems?

Wed, 20 Feb 2013 07:28:52 -0800 

Thanks Bryan,

It's way past my bedtime, I'll have a proper look at this in about 18 hours.
Basically these test failures appear to be due to (issues that immediately jump out anyway): 

  1. The test suite is getting an IP address in some cases when it
     assumes it will get a host name string (will need to look further
     into that) and it appends a string to the host name, producing a
     non compliant URI which throws a URISyntaxException during parsing
     in LookupLocator.
  2. Insufficient permissions.  If you're happy to run the failed tests
     again ( I'll provide a file that will allow you to run only the
     tests that fail), we can run these tests with security debugging
     enabled, so we can see which protection domain failed the
     permission check.

Off to bed now.

Thanks again,

Peter.

On 20/02/2013 11:28 PM, Bryan Thompson wrote:
Here is the compressed output of the test run. I didn't want to spam the list with this. 
Bryan

From: Peter <[email protected] <mailto:[email protected]>>
Reply-To: Peter <[email protected] <mailto:[email protected]>>
Date: Wednesday, February 20, 2013 7:17 AM
To: Bryan Thompson <[email protected] <mailto:[email protected]>>
Subject: Re: Test failures - concurrency bugs or Socket problems?

Cool thanks :)

----- Original message -----
> :-)
>
> I should have asked before I started it on my laptop. Does not seem to hog that > much resources. We have several minis here, but they are mostly running ubantu. > There is one at another site that is still running OSX. If I run into problems 
> here I'll ask someone to set it up there.
>
> Thanks,
> Bryan
>
> From: Peter <[email protected] <mailto:[email protected]><mailto:[email protected]>> > Reply-To: Peter <[email protected] <mailto:[email protected]><mailto:[email protected]>> 
> Date: Tuesday, February 19, 2013 4:07 PM
> To: Bryan Thompson <[email protected] <mailto:[email protected]><mailto:[email protected]>> 
> Subject: Re: Test failures - concurrency bugs or Socket problems?
>
>
> Approximately 18 hours, give or take an hour.
>
>
> ----- Original message -----
> > Peter, I am trying this on an airbook (4gb ram). Running now.
> >  How long is a test run?
> > Thanks
> > Bryan
> >
> >
> >
> > -------- Original message --------
> > From: Peter <[email protected] <mailto:[email protected]><mailto:[email protected]>> 
> > Date:
> > To: [email protected] <mailto:[email protected]><mailto:[email protected]> 
> > Subject: Re: Test failures - concurrency bugs or Socket problems?
> >
> >
> > From memory, there's not too much required to set up.
> >
> > You need to set your env variable JAVA_HOME and export it, if it isn't already 
> > set.
> >
> > After checking out, execute
> >
> > ant qa.run
> >
> > from the command line.
> >
> > Hopefully that should do it.
> >
> > You've got plenty of memory. If some tests fail, I'll explain how to execute > > individual tests with debugging enabled, then you can step through or dump 
> > thread stacks.
> >
> > Thank you,
> >
> > Peter.
> >
> > ----- Original message -----
> > > We have a 10.8.2 on a recent intel mini with 16G RAM. Does the test suite > > > require much memory to run? If not, we also have some other machines with 
> > > less memory and earlier OS revisions.
> > >
> > > Are there specific tests to run?
> > >
> > > Any guidance on running the test suite?
> > >
> > > Thanks,
> > > Bryan
> > >
> > > On 2/19/13 6:28 AM, "Peter Firmstone"
> > > <[email protected] <mailto:[email protected]><mailto:[email protected]>> wrote: 
> > >
> > > > Any chance of checking out and giving her a run?
> > > >
> > > > checkout:
> > > >
> > > > http://svn.apache.org/repos/asf/river/jtsk/skunk/qa_refactor/trunk
> > > >
> > > >
> > > > Be much appreciated if you can.
> > > >
> > > > Cheers,
> > > >
> > > > Peter.
> > > >
> > > >
> > > > On 19/02/2013 9:19 PM, Dan Creswell wrote:
> > > > > Mmm, well I have intel kit but all of mine is on 10.8.x, actually 
> > > > > might be time to revise our minimum support platforms...
> > > > >
> > > > > On 19 February 2013 11:08, Peter
> > > > > Firmstone<[email protected] <mailto:[email protected]><mailto:[email protected]>> wrote: 
> > > > > > On 19/02/2013 8:27 PM, Dan Creswell wrote:
> > > > > > > Which variety of OS X are we talking?
> > > > > > OSX 10.6.8 little endian, so it's Intel arch.
> > > > > >
> > > > > > [diagnostics]  System properties
> > > > > > [diagnostics] -------------------------------------------
> > > > > > [diagnostics] java.runtime.name : Java(TM) SE Runtime Environment 
> > > > > > [diagnostics] sun.boot.library.path :
> > > > > > /System/Library/Java/JavaVirtualMachines/1.6.0.jdk/Contents/Libraries 
> > > > > > [diagnostics] java.vm.version : 20.1-b02-384
> > > > > > [diagnostics] awt.nativeDoubleBuffering : true
> > > > > > [diagnostics] ant.library.dir :
> > > > > >
> > > > > > /Users/hudson/hudson-slave/tools/hudson.tasks.Ant_AntInstallation/ant-1. 
> > > > > > 8.4/lib
> > > > > > [diagnostics] gopherProxySet : false
> > > > > > [diagnostics] mrj.build : 10M3425
> > > > > > [diagnostics] java.vm.vendor : Apple Inc.
> > > > > > [diagnostics] java.vendor.url :http://www.apple.com/
> > > > > > [diagnostics] path.separator : :
> > > > > > [diagnostics] java.vm.name : Java HotSpot(TM) 64-Bit Server VM
> > > > > > [diagnostics] file.encoding.pkg : sun.io
> > > > > > [diagnostics] user.country : US
> > > > > > [diagnostics] sun.java.launcher : SUN_STANDARD
> > > > > > [diagnostics] sun.os.patch.level : unknown
> > > > > > [diagnostics] java.vm.specification.name : Java Virtual Machine 
> > > > > > Specification
> > > > > > [diagnostics] user.dir :
> > > > > > /Users/hudson/hudson-slave/workspace/river-qa-refactor-osx/trunk 
> > > > > > [diagnostics] java.runtime.version : 1.6.0_26-b03-384-10M3425
> > > > > > [diagnostics] java.awt.graphicsenv : apple.awt.CGraphicsEnvironment 
> > > > > > [diagnostics] java.endorsed.dirs :
> > > > > >
> > > > > > /System/Library/Java/JavaVirtualMachines/1.6.0.jdk/Contents/Home/lib/end 
> > > > > > orsed
> > > > > > [diagnostics] os.arch : x86_64
> > > > > > [diagnostics] java.io.tmpdir :
> > > > > > /var/folders/aq/aqP130n7Eua3MGAcL598bE+++TY/-Tmp-/
> > > > > > [diagnostics] line.separator :
> > > > > > [diagnostics]
> > > > > > [diagnostics] java.vm.specification.vendor : Sun Microsystems Inc. 
> > > > > > [diagnostics] os.name : Mac OS X
> > > > > > [diagnostics] ant.home :
> > > > > >
> > > > > > /Users/hudson/hudson-slave/tools/hudson.tasks.Ant_AntInstallation/ant-1. 
> > > > > > 8.4
> > > > > > [diagnostics] sun.jnu.encoding : MacRoman
> > > > > > [diagnostics] java.library.path :
> > > > > >
> > > > > > .:/Library/Java/Extensions:/System/Library/Java/Extensions:/usr/lib/java > > > > > > [diagnostics] java.specification.name : Java Platform API Specification 
> > > > > > [diagnostics] java.class.version : 50.0
> > > > > > [diagnostics] sun.management.compiler : HotSpot 64-Bit Tiered Compilers 
> > > > > > [diagnostics] os.version : 10.6.8
> > > > > > [diagnostics] http.nonProxyHosts :
> > > > > > local|*.local|169.254/16|*.169.254/16
> > > > > > [diagnostics] user.home : /Users/hudson
> > > > > > [diagnostics] user.timezone : America/Los_Angeles
> > > > > > [diagnostics] java.awt.printerjob : apple.awt.CPrinterJob
> > > > > > [diagnostics] java.specification.version : 1.6
> > > > > > [diagnostics] file.encoding : MacRoman
> > > > > > [diagnostics] user.name : hudson
> > > > > > [diagnostics] java.class.path :
> > > > > >
> > > > > > /Users/hudson/hudson-slave/tools/hudson.tasks.Ant_AntInstallation/ant-1. > > > > > > 8.4/lib/ant-launcher.jar:/Users/hudson/hudson-slave/tools/hudson.tasks.A > > > > > > nt_AntInstallation/ant-1.8.4/lib/ant-antlr.jar:/Users/hudson/hudson-slav > > > > > > e/tools/hudson.tasks.Ant_AntInstallation/ant-1.8.4/lib/ant-apache-bcel.j > > > > > > ar:/Users/hudson/hudson-slave/tools/hudson.tasks.Ant_AntInstallation/ant > > > > > > -1.8.4/lib/ant-apache-bsf.jar:/Users/hudson/hudson-slave/tools/hudson.ta > > > > > > sks.Ant_AntInstallation/ant-1.8.4/lib/ant-apache-log4j.jar:/Users/hudson > > > > > > /hudson-slave/tools/hudson.tasks.Ant_AntInstallation/ant-1.8.4/lib/ant-a > > > > > > pache-oro.jar:/Users/hudson/hudson-slave/tools/hudson.tasks.Ant_AntInsta > > > > > > llation/ant-1.8.4/lib/ant-apache-regexp.jar:/Users/hudson/hudson-slave/t > > > > > > ools/hudson.tasks.Ant_AntInstallation/ant-1.8.4/lib/ant-apache-resolver. > > > > > > jar:/Users/hudson/hudson-slave/tools/hudson.tasks.Ant_AntInstallation/an > > > > > > t-1.8.4/lib/ant-apache-xalan2.jar:/Users/hudson/hudson-slave/tools/hudso > > > > > > n.tasks.Ant_AntInstallation/ant-1.8.4/lib/ant-commons-logging.jar:/Users > > > > > > /hudson/hudson-slave/tools/hudson.tasks.Ant_AntInstallation/ant-1.8.4/li > > > > > > b/ant-commons-net.jar:/Users/hudson/hudson-slave/tools/hudson.tasks.Ant_ > > > > > > AntInstallation/ant-1.8.4/lib/ant-jai.jar:/Users/hudson/hudson-slave/too > > > > > > ls/hudson.tasks.Ant_AntInstallation/ant-1.8.4/lib/ant-javamail.jar:/User > > > > > > s/hudson/hudson-slave/tools/hudson.tasks.Ant_AntInstallation/ant-1.8.4/l > > > > > > ib/ant-jdepend.jar:/Users/hudson/hudson-slave/tools/hudson.tasks.Ant_Ant > > > > > > Installation/ant-1.8.4/lib/ant-jmf.jar:/Users/hudson/hudson-slave/tools/ > > > > > > hudson.tasks.Ant_AntInstallation/ant-1.8.4/lib/ant-jsch.jar:/Users/hudso > > > > > > n/hudson-slave/tools/hudson.tasks.Ant_AntInstallation/ant-1.8.4/lib/ant- > > > > > > junit.jar:/Users/hudson/hudson-slave/tools/hudson.tasks.Ant_AntInstallat > > > > > > ion/ant-1.8.4/lib/ant-junit4.jar:/Users/hudson/hudson-slave/tools/hudson > > > > > > .tasks.Ant_AntInstallation/ant-1.8.4/lib/ant-launcher.jar:/Users/hudson/ > > > > > > hudson-slave/tools/hudson.tasks.Ant_AntInstallation/ant-1.8.4/lib/ant-ne > > > > > > trexx.jar:/Users/hudson/hudson-slave/tools/hudson.tasks.Ant_AntInstallat > > > > > > ion/ant-1.8.4/lib/ant-swing.jar:/Users/hudson/hudson-slave/tools/hudson. > > > > > > tasks.Ant_AntInstallation/ant-1.8.4/lib/ant-testutil.jar:/Users/hudson/h > > > > > > udson-slave/tools/hudson.tasks.Ant_AntInstallation/ant-1.8.4/lib/ant.jar 
> > > > > > [diagnostics] java.vm.specification.version : 1.0
> > > > > > [diagnostics] sun.arch.data.model : 64
> > > > > > [diagnostics] java.home :
> > > > > > /System/Library/Java/JavaVirtualMachines/1.6.0.jdk/Contents/Home > > > > > > [diagnostics] sun.java.command : org.apache.tools.ant.launch.Launcher 
> > > > > > -cp
> > > > > > hudson-qa
> > > > > > [diagnostics] java.specification.vendor : Sun Microsystems Inc. 
> > > > > > [diagnostics] user.language : en
> > > > > > [diagnostics] awt.toolkit : apple.awt.CToolkit
> > > > > > [diagnostics] java.vm.info : mixed mode
> > > > > > [diagnostics] java.version : 1.6.0_26
> > > > > > [diagnostics] java.ext.dirs :
> > > > > >
> > > > > > /Library/Java/Extensions:/System/Library/Java/Extensions:/System/Library 
> > > > > > /Java/JavaVirtualMachines/1.6.0.jdk/Contents/Home/lib/ext
> > > > > > [diagnostics] sun.boot.class.path :
> > > > > >
> > > > > > /System/Library/Java/JavaVirtualMachines/1.6.0.jdk/Contents/Classes/jsfd > > > > > > .jar:/System/Library/Java/JavaVirtualMachines/1.6.0.jdk/Contents/Classes > > > > > > /classes.jar:/System/Library/Frameworks/JavaVM.framework/Frameworks/Java > > > > > > RuntimeSupport.framework/Resources/Java/JavaRuntimeSupport.jar:/System/L > > > > > > ibrary/Java/JavaVirtualMachines/1.6.0.jdk/Contents/Classes/ui.jar:/Syste > > > > > > m/Library/Java/JavaVirtualMachines/1.6.0.jdk/Contents/Classes/laf.jar:/S > > > > > > ystem/Library/Java/JavaVirtualMachines/1.6.0.jdk/Contents/Classes/sunrsa > > > > > > sign.jar:/System/Library/Java/JavaVirtualMachines/1.6.0.jdk/Contents/Cla > > > > > > sses/jsse.jar:/System/Library/Java/JavaVirtualMachines/1.6.0.jdk/Content > > > > > > s/Classes/jce.jar:/System/Library/Java/JavaVirtualMachines/1.6.0.jdk/Con 
> > > > > > tents/Classes/charsets.jar
> > > > > > [diagnostics] java.vendor : Apple Inc.
> > > > > > [diagnostics] file.separator : /
> > > > > > [diagnostics] java.vendor.url.bug :http://bugreport.apple.com/
> > > > > > [diagnostics] sun.cpu.endian : little
> > > > > > [diagnostics] sun.io.unicode.encoding : UnicodeLittle
> > > > > > [diagnostics] mrj.version : 1060.1.6.0_26-384
> > > > > > [diagnostics] socksNonProxyHosts :
> > > > > > local|*.local|169.254/16|*.169.254/16
> > > > > > [diagnostics] jikes.class.path :
> > > > > >
> > > > > > :/System/Library/Frameworks/JavaVM.framework/Home/../Classes/alt-rt.jar: > > > > > > /System/Library/Frameworks/JavaVM.framework/Home/../Classes/alt-string.j > > > > > > ar:/System/Library/Frameworks/JavaVM.framework/Home/../Classes/charsets. > > > > > > jar:/System/Library/Frameworks/JavaVM.framework/Home/../Classes/classes. > > > > > > jar:/System/Library/Frameworks/JavaVM.framework/Home/../Classes/dt.jar:/ > > > > > > System/Library/Frameworks/JavaVM.framework/Home/../Classes/jce.jar:/Syst > > > > > > em/Library/Frameworks/JavaVM.framework/Home/../Classes/jconsole.jar:/Sys > > > > > > tem/Library/Frameworks/JavaVM.framework/Home/../Classes/jsse.jar:/System > > > > > > /Library/Frameworks/JavaVM.framework/Home/../Classes/management-agent.ja > > > > > > r:/System/Library/Frameworks/JavaVM.framework/Home/../Classes/ui.jar > > > > > > [diagnostics] ftp.nonProxyHosts <ftp://ftp.nonProxyHosts><ftp://ftp.nonProxyHosts> <ftp://ftp.nonProxyHosts%3E>; : > > > > > > local|*.local|169.254/16|*.169.254/16 [diagnostics] sun.cpu.isalist : 
> > > > > >
> > > > > >
> > > > > >
> > > > > > > On 19 February 2013 10:14, Peter
> > > > > > > Firmstone<[email protected] <mailto:[email protected]><mailto:[email protected]>> wrote: > > > > > > > > Before I get into the details, let me just say that I'm unable to 
> > > > > > > > reproduce
> > > > > > > > the test failures seen on OSX and Solaris x64 on local hardware, I 
> > > > > > > > don't
> > > > > > > > have access to a debugger or thread dumps.
> > > > > > > >
> > > > > > > > The tests that fail on OSX and Solaris x64 (the tests pass on 
> > > > > > > > sparc), are
> > > > > > > > practically identical. The basic problem is discovery event's are 
> > > > > > > > either
> > > > > > > > not received or only some discovery events are received. The 
> > > > > > > > tests allow
> > > > > > > > very long time frames for these events to be received, on other 
> > > > > > > > OS's these
> > > > > > > > tests pass rapidly.
> > > > > > > >
> > > > > > > > Increasing debugging output has the effect of increasing the number 
> > > > > > > > of
> > > > > > > > events received.
> > > > > > > >
> > > > > > > > The tests and their details can be viewed on Jenkins.
> > > > > > > >
> > > > > > > > Over the last few months I've been inspecting code manually and 
> > > > > > > > fixing
> > > > > > > > synchronization issues.
> > > > > > > >
> > > > > > > > River has a large legacy codebase, there are many examples of 
> > > > > > > > inadequate
> > > > > > > > synchronization.
> > > > > > > >
> > > > > > > > Ironically some of the changes I've made, although reducing test 
> > > > > > > > failures
> > > > > > > > on
> > > > > > > > Linux and Windows has exacerbated test failures on OSX and Solaris 
> > > > > > > > x64.
> > > > > > > >
> > > > > > > > Is there anyone on this list with access to this hardware who can 
> > > > > > > > reproduce
> > > > > > > > these bugs?
> > > > > > > >
> > > > > > > > Regards,
> > > > > > > >
> > > > > > > > Peter.
> > > > > > > >
> > > > > > > >
> > > > > > > >
> > > > > > > >
> > > > > >
> > > >
> > > >
> > >
> >
>

Reply via email to