I've pinpointed the problem to a single test, namely TestAPI
(TestGoraStorage seems to work fine, I guess the failure at my home
workstation was a memory issue). This is what happends after I do a
clean checkout Nutchgora from my regular workstation.
"ant test"
TestAPI fails, see extracted lines from TEST-TestAPI.txt:
Caused by: java.io.IOException:
java.sql.SQLTransientConnectionException: java.net.ConnectException:
Connection refused
...
java.lang.IllegalStateException: Job in state DEFINE instead of RUNNING
...
junit.framework.AssertionFailedError: expected:<[FAILED]> but
was:<[RUNNING]>
at org.apache.nutch.api.TestAPI.testJobsAPI(TestAPI.java:118)
The insane part is the fact that I had a working copy of Nutchgora just
a few moments ago, from which I reverted the local workspace changes
(that could have absolutely nothing to do with these issues) whereafter
the test failed again. I re-applied the changes, but TestAPI just does
not work anymore. This working copy is 3 revisions behind head (that is
head minus 1 commit of Markus and 2 commits of Lewis). Then, "rm build/
runtime/ -r" followed by "ant runtime" and "ant test" and suddenly
TestAPI worked! But, this is not reproducible because rerunning the
tests just failed it again. So I guess the test just randomly succeeds.
I'm sorry if this is becoming a really vague description, but it
certainly is a real vague problem. It's driving me nuts.
So the underlying question is, what is TestAPI (NutchServer/NutchApp)
and what purpose does it serve? I'm just not familiar enough with these
components.
By the way, could somebody explain what the difference is between the
following two build jobs?
https://builds.apache.org/job/Nutch-nutchgora-ant/
https://builds.apache.org/job/Nutch-nutchgora/
Because in Nutch-nutchgora-ant, TestAPI also fails:
[junit] Tests run: 4, Failures: 1, Errors: 0, Time elapsed: 11.081 sec
[junit] Test org.apache.nutch.api.TestAPI FAILED
In Nutch-nutchgora, it works perfectly fine.
Ferdy.
On 11/12/2011 08:57 PM, Andrzej Bialecki wrote:
On 12/11/2011 19:12, Ferdy Galema wrote:
Hi,
I cannot get a grasp on this. I cleanly checked out Nutchgora, but the
tests just fail. It's TestAPI and TestGoraStorage. I noticed this
problem before a while ago but then it seemed cleaning caches and build
folders resolved it. Now it is rearing it's ugly head again.
Logs indicate that TestAPI failes because of assert failures (RUNNING
job status vs something else) and also connection failures to SQL.
TestGoraStorage failes with the multi process test throwing "to many
open files" (but I can migitate the latter problem by setting lowering
loop times).
Then when I enable building with HBase (decomment lines in ivy) I get
compile errors in TestGoraStorage (at setDeamon call). This has
something to do with multiple version of the HSQL libs?
I'm completely clueless about what this might be. I tried everything,
also using different versions of JDK. Monday I might have more info, as
I will be back on my pc at work where I should have a working copy. Any
help in the meantime would be great.
Hmmm, I vaguely recall that either Hadoop or HBase comes with an
incompatible version of HSQL lib. This is a transitive dependency of
Gora, and when it's pulled in it conflicts with the version we use in
Nutch.
