Re: Test failures - concurrency bugs or Socket problems?

Thu, 21 Feb 2013 06:54:39 -0800 

Bryan,
I've fixed the tests that assumed the host is a string, where an IP address causes failure. 


I'll provide a patch over the weekend that'll enable security debugging 
output, so we can see which protection domains are failing.


Thanks again,

Peter.

On 21/02/2013 1:33 AM, Bryan Thompson wrote:

Sure. Lets look at this more tomorrow.  Bryan


-------- Original message --------
From: Peter Firmstone<[email protected]>
Date:
To: Bryan Thompson<[email protected]>
Cc: [email protected]
Subject: Re: Test failures - concurrency bugs or Socket problems?


Thanks Bryan,

It's way past my bedtime, I'll have a proper look at this in about 18 hours.

Basically these test failures appear to be due to (issues that
immediately jump out anyway):

    1. The test suite is getting an IP address in some cases when it
       assumes it will get a host name string (will need to look further
       into that) and it appends a string to the host name, producing a
       non compliant URI which throws a URISyntaxException during parsing
       in LookupLocator.
    2. Insufficient permissions.  If you're happy to run the failed tests
       again ( I'll provide a file that will allow you to run only the
       tests that fail), we can run these tests with security debugging
       enabled, so we can see which protection domain failed the
       permission check.

Off to bed now.

Thanks again,

Peter.

On 20/02/2013 11:28 PM, Bryan Thompson wrote:

Here is the compressed output of the test run.  I didn't want to spam
the list with this.
Bryan

From: Peter<[email protected]<mailto:[email protected]>>
Reply-To: Peter<[email protected]<mailto:[email protected]>>
Date: Wednesday, February 20, 2013 7:17 AM
To: Bryan Thompson<[email protected]<mailto:[email protected]>>
Subject: Re: Test failures - concurrency bugs or Socket problems?

Cool thanks :)

----- Original message -----

:-)

I should have asked before I started it on my laptop.  Does not seem

to hog that

much resources.  We have several minis here, but they are mostly

running ubantu.

  There is one at another site that is still running OSX.  If I run

into problems

here I'll ask someone to set it up there.

Thanks,
Bryan

From: Peter<[email protected]

<mailto:[email protected]><mailto:[email protected]>>

Reply-To: Peter<[email protected]

<mailto:[email protected]><mailto:[email protected]>>

Date: Tuesday, February 19, 2013 4:07 PM
To: Bryan Thompson<[email protected]

<mailto:[email protected]><mailto:[email protected]>>

Subject: Re: Test failures - concurrency bugs or Socket problems?


Approximately 18 hours, give or take an hour.


----- Original message -----

Peter, I am trying this on an airbook (4gb ram). Running now.
  How long is a test run?
Thanks
Bryan



-------- Original message --------
From: Peter<[email protected]

<mailto:[email protected]><mailto:[email protected]>>

Date:
To: [email protected]

<mailto:[email protected]><mailto:[email protected]>

Subject: Re: Test failures - concurrency bugs or Socket problems?


 From memory, there's not too much required to set up.

You need to set your env variable JAVA_HOME and export it, if it

isn't already

set.

After checking out, execute

ant qa.run

from the command line.

Hopefully that should do it.

You've got plenty of memory.  If some tests fail, I'll explain how

to execute

individual tests with debugging enabled, then you can step through

or dump

thread stacks.

Thank you,

Peter.

----- Original message -----

We have a 10.8.2 on a recent intel mini with 16G RAM.  Does the

test suite

require much memory to run?  If not, we also have some other

machines with

less memory and earlier OS revisions.

Are there specific tests to run?

Any guidance on running the test suite?

Thanks,
Bryan

On 2/19/13 6:28 AM, "Peter Firmstone"
<[email protected]

<mailto:[email protected]><mailto:[email protected]>>  wrote:

Any chance of checking out and giving her a run?

checkout:

http://svn.apache.org/repos/asf/river/jtsk/skunk/qa_refactor/trunk


Be much appreciated if you can.

Cheers,

Peter.


On 19/02/2013 9:19 PM, Dan Creswell wrote:

Mmm, well I have intel kit but all of mine is on 10.8.x,

actually

might be time to revise our minimum support platforms...

On 19 February 2013 11:08, Peter
Firmstone<[email protected]

<mailto:[email protected]><mailto:[email protected]>>   wrote:

On 19/02/2013 8:27 PM, Dan Creswell wrote:

Which variety of OS X are we talking?

OSX 10.6.8 little endian, so it's Intel arch.

[diagnostics]  System properties
[diagnostics] -------------------------------------------
[diagnostics] java.runtime.name : Java(TM) SE Runtime

Environment

[diagnostics] sun.boot.library.path :


/System/Library/Java/JavaVirtualMachines/1.6.0.jdk/Contents/Libraries

[diagnostics] java.vm.version : 20.1-b02-384
[diagnostics] awt.nativeDoubleBuffering : true
[diagnostics] ant.library.dir :



/Users/hudson/hudson-slave/tools/hudson.tasks.Ant_AntInstallation/ant-1.

8.4/lib
[diagnostics] gopherProxySet : false
[diagnostics] mrj.build : 10M3425
[diagnostics] java.vm.vendor : Apple Inc.
[diagnostics] java.vendor.url :http://www.apple.com/
[diagnostics] path.separator : :
[diagnostics] java.vm.name : Java HotSpot(TM) 64-Bit Server VM
[diagnostics] file.encoding.pkg : sun.io
[diagnostics] user.country : US
[diagnostics] sun.java.launcher : SUN_STANDARD
[diagnostics] sun.os.patch.level : unknown
[diagnostics] java.vm.specification.name : Java Virtual

Machine

Specification
[diagnostics] user.dir :


/Users/hudson/hudson-slave/workspace/river-qa-refactor-osx/trunk

[diagnostics] java.runtime.version : 1.6.0_26-b03-384-10M3425
[diagnostics] java.awt.graphicsenv :

apple.awt.CGraphicsEnvironment

[diagnostics] java.endorsed.dirs :



/System/Library/Java/JavaVirtualMachines/1.6.0.jdk/Contents/Home/lib/end

orsed
[diagnostics] os.arch : x86_64
[diagnostics] java.io.tmpdir :
/var/folders/aq/aqP130n7Eua3MGAcL598bE+++TY/-Tmp-/
[diagnostics] line.separator :
[diagnostics]
[diagnostics] java.vm.specification.vendor : Sun

Microsystems Inc.

[diagnostics] os.name : Mac OS X
[diagnostics] ant.home :



/Users/hudson/hudson-slave/tools/hudson.tasks.Ant_AntInstallation/ant-1.

8.4
[diagnostics] sun.jnu.encoding : MacRoman
[diagnostics] java.library.path :



.:/Library/Java/Extensions:/System/Library/Java/Extensions:/usr/lib/java

[diagnostics] java.specification.name : Java Platform API

Specification

[diagnostics] java.class.version : 50.0
[diagnostics] sun.management.compiler : HotSpot 64-Bit

Tiered Compilers

[diagnostics] os.version : 10.6.8
[diagnostics] http.nonProxyHosts :
local|*.local|169.254/16|*.169.254/16
[diagnostics] user.home : /Users/hudson
[diagnostics] user.timezone : America/Los_Angeles
[diagnostics] java.awt.printerjob : apple.awt.CPrinterJob
[diagnostics] java.specification.version : 1.6
[diagnostics] file.encoding : MacRoman
[diagnostics] user.name : hudson
[diagnostics] java.class.path :



/Users/hudson/hudson-slave/tools/hudson.tasks.Ant_AntInstallation/ant-1.
8.4/lib/ant-launcher.jar:/Users/hudson/hudson-slave/tools/hudson.tasks.A
nt_AntInstallation/ant-1.8.4/lib/ant-antlr.jar:/Users/hudson/hudson-slav
e/tools/hudson.tasks.Ant_AntInstallation/ant-1.8.4/lib/ant-apache-bcel.j
ar:/Users/hudson/hudson-slave/tools/hudson.tasks.Ant_AntInstallation/ant
-1.8.4/lib/ant-apache-bsf.jar:/Users/hudson/hudson-slave/tools/hudson.ta
sks.Ant_AntInstallation/ant-1.8.4/lib/ant-apache-log4j.jar:/Users/hudson
/hudson-slave/tools/hudson.tasks.Ant_AntInstallation/ant-1.8.4/lib/ant-a
pache-oro.jar:/Users/hudson/hudson-slave/tools/hudson.tasks.Ant_AntInsta
llation/ant-1.8.4/lib/ant-apache-regexp.jar:/Users/hudson/hudson-slave/t
ools/hudson.tasks.Ant_AntInstallation/ant-1.8.4/lib/ant-apache-resolver.
jar:/Users/hudson/hudson-slave/tools/hudson.tasks.Ant_AntInstallation/an
t-1.8.4/lib/ant-apache-xalan2.jar:/Users/hudson/hudson-slave/tools/hudso
n.tasks.Ant_AntInstallation/ant-1.8.4/lib/ant-commons-logging.jar:/Users
/hudson/hudson-slave/tools/hudson.tasks.Ant_AntInstallation/ant-1.8.4/li
b/ant-commons-net.jar:/Users/hudson/hudson-slave/tools/hudson.tasks.Ant_
AntInstallation/ant-1.8.4/lib/ant-jai.jar:/Users/hudson/hudson-slave/too
ls/hudson.tasks.Ant_AntInstallation/ant-1.8.4/lib/ant-javamail.jar:/User
s/hudson/hudson-slave/tools/hudson.tasks.Ant_AntInstallation/ant-1.8.4/l
ib/ant-jdepend.jar:/Users/hudson/hudson-slave/tools/hudson.tasks.Ant_Ant
Installation/ant-1.8.4/lib/ant-jmf.jar:/Users/hudson/hudson-slave/tools/
hudson.tasks.Ant_AntInstallation/ant-1.8.4/lib/ant-jsch.jar:/Users/hudso
n/hudson-slave/tools/hudson.tasks.Ant_AntInstallation/ant-1.8.4/lib/ant-
junit.jar:/Users/hudson/hudson-slave/tools/hudson.tasks.Ant_AntInstallat
ion/ant-1.8.4/lib/ant-junit4.jar:/Users/hudson/hudson-slave/tools/hudson
.tasks.Ant_AntInstallation/ant-1.8.4/lib/ant-launcher.jar:/Users/hudson/
hudson-slave/tools/hudson.tasks.Ant_AntInstallation/ant-1.8.4/lib/ant-ne
trexx.jar:/Users/hudson/hudson-slave/tools/hudson.tasks.Ant_AntInstallat
ion/ant-1.8.4/lib/ant-swing.jar:/Users/hudson/hudson-slave/tools/hudson.
tasks.Ant_AntInstallation/ant-1.8.4/lib/ant-testutil.jar:/Users/hudson/h
udson-slave/tools/hudson.tasks.Ant_AntInstallation/ant-1.8.4/lib/ant.jar

[diagnostics] java.vm.specification.version : 1.0
[diagnostics] sun.arch.data.model : 64
[diagnostics] java.home :


/System/Library/Java/JavaVirtualMachines/1.6.0.jdk/Contents/Home

[diagnostics] sun.java.command :

org.apache.tools.ant.launch.Launcher

-cp
hudson-qa
[diagnostics] java.specification.vendor : Sun Microsystems

Inc.

[diagnostics] user.language : en
[diagnostics] awt.toolkit : apple.awt.CToolkit
[diagnostics] java.vm.info : mixed mode
[diagnostics] java.version : 1.6.0_26
[diagnostics] java.ext.dirs :



/Library/Java/Extensions:/System/Library/Java/Extensions:/System/Library

/Java/JavaVirtualMachines/1.6.0.jdk/Contents/Home/lib/ext
[diagnostics] sun.boot.class.path :



/System/Library/Java/JavaVirtualMachines/1.6.0.jdk/Contents/Classes/jsfd
.jar:/System/Library/Java/JavaVirtualMachines/1.6.0.jdk/Contents/Classes
/classes.jar:/System/Library/Frameworks/JavaVM.framework/Frameworks/Java
RuntimeSupport.framework/Resources/Java/JavaRuntimeSupport.jar:/System/L
ibrary/Java/JavaVirtualMachines/1.6.0.jdk/Contents/Classes/ui.jar:/Syste
m/Library/Java/JavaVirtualMachines/1.6.0.jdk/Contents/Classes/laf.jar:/S
ystem/Library/Java/JavaVirtualMachines/1.6.0.jdk/Contents/Classes/sunrsa
sign.jar:/System/Library/Java/JavaVirtualMachines/1.6.0.jdk/Contents/Cla
sses/jsse.jar:/System/Library/Java/JavaVirtualMachines/1.6.0.jdk/Content
s/Classes/jce.jar:/System/Library/Java/JavaVirtualMachines/1.6.0.jdk/Con

tents/Classes/charsets.jar
[diagnostics] java.vendor : Apple Inc.
[diagnostics] file.separator : /
[diagnostics] java.vendor.url.bug :http://bugreport.apple.com/
[diagnostics] sun.cpu.endian : little
[diagnostics] sun.io.unicode.encoding : UnicodeLittle
[diagnostics] mrj.version : 1060.1.6.0_26-384
[diagnostics] socksNonProxyHosts :
local|*.local|169.254/16|*.169.254/16
[diagnostics] jikes.class.path :



:/System/Library/Frameworks/JavaVM.framework/Home/../Classes/alt-rt.jar:
/System/Library/Frameworks/JavaVM.framework/Home/../Classes/alt-string.j
ar:/System/Library/Frameworks/JavaVM.framework/Home/../Classes/charsets.
jar:/System/Library/Frameworks/JavaVM.framework/Home/../Classes/classes.
jar:/System/Library/Frameworks/JavaVM.framework/Home/../Classes/dt.jar:/
System/Library/Frameworks/JavaVM.framework/Home/../Classes/jce.jar:/Syst
em/Library/Frameworks/JavaVM.framework/Home/../Classes/jconsole.jar:/Sys
tem/Library/Frameworks/JavaVM.framework/Home/../Classes/jsse.jar:/System
/Library/Frameworks/JavaVM.framework/Home/../Classes/management-agent.ja
r:/System/Library/Frameworks/JavaVM.framework/Home/../Classes/ui.jar

[diagnostics] ftp.nonProxyHosts

<ftp://ftp.nonProxyHosts><ftp://ftp.nonProxyHosts>
<ftp://ftp.nonProxyHosts%3E>; :

local|*.local|169.254/16|*.169.254/16 [diagnostics]

sun.cpu.isalist :




On 19 February 2013 10:14, Peter
Firmstone<[email protected]

<mailto:[email protected]><mailto:[email protected]>>           wrote:

Before I get into the details, let me just say that I'm

unable to

reproduce
the test failures seen on OSX and Solaris x64 on local

hardware, I

don't
have access to a debugger or thread dumps.

The tests that fail on OSX and Solaris x64 (the tests

pass on

sparc), are
practically identical.  The basic problem is discovery

event's are

either
not received or only some discovery events are

received.          The

tests allow
very long time frames for these events to be received,

on other

OS's these
tests pass rapidly.

Increasing debugging output has the effect of

increasing the number

of
events received.

The tests and their details can be viewed on Jenkins.

Over the last few months I've been inspecting code

manually and

fixing
synchronization issues.

River has a large legacy codebase, there are many

examples of

inadequate
synchronization.

Ironically some of the changes I've made, although

reducing test

failures
on
Linux and Windows has exacerbated test failures on OSX

and Solaris

x64.

Is there anyone on this list with access to this

hardware who can

reproduce
these bugs?

Regards,

Peter.
































					Reply via email to