Re: Build failed in Jenkins: Nutch-trunk #1706
Hi Guys, Pretty strange compilation failure, this test class hasn't been hacked in months, and from the surface, having looked at the test case there appears to be no obvious reasons for it failing to compile. I've kick started another build on Jenkins to see if it will resolve itself. On Wed, Dec 28, 2011 at 4:58 AM, Apache Jenkins Server jenk...@builds.apache.org wrote: See https://builds.apache.org/job/Nutch-trunk/1706/changes Changes: [lewismc] trivial commit to completely remove LogUtil from the codebase. [lewismc] commit to address NUTCH-1138 and update to CHANGES.txt [markus] NUTCH-1230 and NUTCH-1231 Upgrade to Tika 1.0 and using new Tika detect API [markus] NUTCH-1235, added Jackson ASL mapper as dep [markus] NUTCH-1235 Upgrade to new Hadoop 0.20.205.0 [markus] Reverting Nutch-1125 CrawlDBScanner -- [...truncated 2406 lines...] [echo] Compiling plugin: scoring-opic [javac] /zonestorage/hudson_solaris/home/hudson/hudson-slave/workspace/Nutch-trunk/trunk/src/plugin/build-plugin.xml:117: warning: 'includeantruntime' was not set, defaulting to build.sysclasspath=last; set to false for repeatable builds [javac] Compiling 1 source file to /zonestorage/hudson_solaris/home/hudson/hudson-slave/workspace/Nutch-trunk/trunk/build/scoring-opic/classes jar: [jar] Building jar: /zonestorage/hudson_solaris/home/hudson/hudson-slave/workspace/Nutch-trunk/trunk/build/scoring-opic/scoring-opic.jar deps-test: init: init-plugin: clean-lib: resolve-default: [ivy:resolve] :: loading settings :: file = /zonestorage/hudson_solaris/home/hudson/hudson-slave/workspace/Nutch-trunk/trunk/ivy/ivysettings.xml compile: jar: deps-test: deploy: copy-generated-lib: deploy: [copy] Copying 1 file to /zonestorage/hudson_solaris/home/hudson/hudson-slave/workspace/Nutch-trunk/trunk/build/plugins/scoring-opic copy-generated-lib: [copy] Copying 1 file to /zonestorage/hudson_solaris/home/hudson/hudson-slave/workspace/Nutch-trunk/trunk/build/plugins/scoring-opic init: [mkdir] Created dir: /zonestorage/hudson_solaris/home/hudson/hudson-slave/workspace/Nutch-trunk/trunk/build/scoring-link [mkdir] Created dir: /zonestorage/hudson_solaris/home/hudson/hudson-slave/workspace/Nutch-trunk/trunk/build/scoring-link/classes [mkdir] Created dir: /zonestorage/hudson_solaris/home/hudson/hudson-slave/workspace/Nutch-trunk/trunk/build/scoring-link/test [mkdir] Created dir: /zonestorage/hudson_solaris/home/hudson/hudson-slave/workspace/Nutch-trunk/trunk/build/plugins/scoring-link init-plugin: deps-jar: clean-lib: resolve-default: [ivy:resolve] :: loading settings :: file = /zonestorage/hudson_solaris/home/hudson/hudson-slave/workspace/Nutch-trunk/trunk/ivy/ivysettings.xml compile: [echo] Compiling plugin: scoring-link [javac] /zonestorage/hudson_solaris/home/hudson/hudson-slave/workspace/Nutch-trunk/trunk/src/plugin/build-plugin.xml:117: warning: 'includeantruntime' was not set, defaulting to build.sysclasspath=last; set to false for repeatable builds [javac] Compiling 1 source file to /zonestorage/hudson_solaris/home/hudson/hudson-slave/workspace/Nutch-trunk/trunk/build/scoring-link/classes jar: [jar] Building jar: /zonestorage/hudson_solaris/home/hudson/hudson-slave/workspace/Nutch-trunk/trunk/build/scoring-link/scoring-link.jar deps-test: init: init-plugin: clean-lib: resolve-default: [ivy:resolve] :: loading settings :: file = /zonestorage/hudson_solaris/home/hudson/hudson-slave/workspace/Nutch-trunk/trunk/ivy/ivysettings.xml compile: jar: deps-test: deploy: copy-generated-lib: deploy: [copy] Copying 1 file to /zonestorage/hudson_solaris/home/hudson/hudson-slave/workspace/Nutch-trunk/trunk/build/plugins/scoring-link copy-generated-lib: [copy] Copying 1 file to /zonestorage/hudson_solaris/home/hudson/hudson-slave/workspace/Nutch-trunk/trunk/build/plugins/scoring-link init: [mkdir] Created dir: /zonestorage/hudson_solaris/home/hudson/hudson-slave/workspace/Nutch-trunk/trunk/build/subcollection [mkdir] Created dir: /zonestorage/hudson_solaris/home/hudson/hudson-slave/workspace/Nutch-trunk/trunk/build/subcollection/classes [mkdir] Created dir: /zonestorage/hudson_solaris/home/hudson/hudson-slave/workspace/Nutch-trunk/trunk/build/subcollection/test [mkdir] Created dir: /zonestorage/hudson_solaris/home/hudson/hudson-slave/workspace/Nutch-trunk/trunk/build/plugins/subcollection init-plugin: deps-jar: clean-lib: resolve-default: [ivy:resolve] :: loading settings :: file = /zonestorage/hudson_solaris/home/hudson/hudson-slave/workspace/Nutch-trunk/trunk/ivy/ivysettings.xml compile: [echo] Compiling plugin: subcollection [javac] /zonestorage/hudson_solaris/home/hudson/hudson-slave/workspace/Nutch-trunk/trunk/src/plugin/build-plugin.xml:117: warning: 'includeantruntime' was
Re: Build failed in Jenkins: Nutch-trunk #1706
On 28/12/2011 12:00, Lewis John Mcgibbney wrote: Hi Guys, Pretty strange compilation failure, this test class hasn't been hacked in months, and from the surface, having looked at the test case there appears to be no obvious reasons for it failing to compile. I've kick started another build on Jenkins to see if it will resolve itself. I don't think it will - I can reproduce this failure locally. Here's what fixed the failure for me (I'm pretty ignorant about ivy/maven so there's likely a more correct fix for this): Index: ivy/ivy.xml === --- ivy/ivy.xml (revision 1225046) +++ ivy/ivy.xml (working copy) @@ -69,7 +69,7 @@ !--Configuration: test -- !--artifacts needed for testing -- - dependency org=junit name=junit rev=3.8.1 conf=test-default / + dependency org=junit name=junit rev=3.8.1 conf=*-default / dependency org=org.apache.hadoop name=hadoop-test rev=0.20.205.0 conf=test-default / -- Best regards, Andrzej Bialecki ___. ___ ___ ___ _ _ __ [__ || __|__/|__||\/| Information Retrieval, Semantic Web ___|||__|| \| || | Embedded Unix, System Integration http://www.sigram.com Contact: info at sigram dot com
Re: Build failed in Jenkins: Nutch-trunk #1706
Hi Andrzej, Can anyone confirm? I've tried this patch locally and although I couldn't reproduce the original issue, it seems to be working fine for me as well. Thanks Andrzej On Wed, Dec 28, 2011 at 1:06 PM, Andrzej Bialecki a...@getopt.org wrote: On 28/12/2011 12:00, Lewis John Mcgibbney wrote: Hi Guys, Pretty strange compilation failure, this test class hasn't been hacked in months, and from the surface, having looked at the test case there appears to be no obvious reasons for it failing to compile. I've kick started another build on Jenkins to see if it will resolve itself. I don't think it will - I can reproduce this failure locally. Here's what fixed the failure for me (I'm pretty ignorant about ivy/maven so there's likely a more correct fix for this): Index: ivy/ivy.xml === --- ivy/ivy.xml (revision 1225046) +++ ivy/ivy.xml (working copy) @@ -69,7 +69,7 @@ !--Configuration: test -- !--artifacts needed for testing -- - dependency org=junit name=junit rev=3.8.1 conf=test-default / + dependency org=junit name=junit rev=3.8.1 conf=*-default / dependency org=org.apache.hadoop name=hadoop-test rev=0.20.205.0 conf=test-default / -- Best regards, Andrzej Bialecki ___. ___ ___ ___ _ _ __ [__ || __|__/|__||\/| Information Retrieval, Semantic Web ___|||__|| \| || | Embedded Unix, System Integration http://www.sigram.com Contact: info at sigram dot com -- Lewis
Re: Build failed in Jenkins: Nutch-trunk #1706
On 28/12/2011 14:15, Lewis John Mcgibbney wrote: Hi Andrzej, Can anyone confirm? I've tried this patch locally and although I couldn't reproduce the original issue, it seems to be working fine for me as well. Check your lib/ dir, maybe you have a local copy of junit jar that gets pulled on the classpath and masks the issue? this happened to me once or twice... -- Best regards, Andrzej Bialecki ___. ___ ___ ___ _ _ __ [__ || __|__/|__||\/| Information Retrieval, Semantic Web ___|||__|| \| || | Embedded Unix, System Integration http://www.sigram.com Contact: info at sigram dot com
Re: Build failed in Jenkins: Nutch-trunk #1706
Some more problems here... Firstly, when I apply NUTCH-1237, I am seeing a mountain of javac warnings ranging right the way through from deprecation such as [javac] Compiling 169 source files to /home/lewis/ASF/trunk/build/classes [javac] warning: [path] bad path element /home/lewis/ASF/trunk/build/lib/activation.jar: no such file or directory [javac] CrawlDbReader.java:36: warning: [deprecation] org.apache.hadoop.io.Closeable in org.apache.hadoop.io has been deprecated [javac] import org.apache.hadoop.io.Closeable; to [javac] URLNormalizers.java:103: warning: [unchecked] unchecked conversion [javac] found : java.util.List [javac] required: java.util.Listorg.apache.nutch.plugin.Extension [javac] private final ListExtension EMPTY_EXTENSION_LIST = Collections.EMPTY_LIST; to [javac] CrawlDbReader.java:179: warning: [cast] redundant cast to org.apache.hadoop.io.Text [javac] String k = ((Text)key).toString(); [javac] ^ This relates back to my reasoning for opening NUTCH-1176, there seem to be quite a few issues here, just to confirm, I'm using trunk @ revision 1225183 (nightly). Further to this, I have two failing tests TestCrawlDBMerger and TestSegmentMerger... Can anyone confirm any of this so I can rule out my local environment messing things up? Thanks On Wed, Dec 28, 2011 at 1:15 PM, Lewis John Mcgibbney lewis.mcgibb...@gmail.com wrote: Hi Andrzej, Can anyone confirm? I've tried this patch locally and although I couldn't reproduce the original issue, it seems to be working fine for me as well. Thanks Andrzej On Wed, Dec 28, 2011 at 1:06 PM, Andrzej Bialecki a...@getopt.org wrote: On 28/12/2011 12:00, Lewis John Mcgibbney wrote: Hi Guys, Pretty strange compilation failure, this test class hasn't been hacked in months, and from the surface, having looked at the test case there appears to be no obvious reasons for it failing to compile. I've kick started another build on Jenkins to see if it will resolve itself. I don't think it will - I can reproduce this failure locally. Here's what fixed the failure for me (I'm pretty ignorant about ivy/maven so there's likely a more correct fix for this): Index: ivy/ivy.xml === --- ivy/ivy.xml (revision 1225046) +++ ivy/ivy.xml (working copy) @@ -69,7 +69,7 @@ !--Configuration: test -- !--artifacts needed for testing -- - dependency org=junit name=junit rev=3.8.1 conf=test-default / + dependency org=junit name=junit rev=3.8.1 conf=*-default / dependency org=org.apache.hadoop name=hadoop-test rev=0.20.205.0 conf=test-default / -- Best regards, Andrzej Bialecki ___. ___ ___ ___ _ _ __ [__ || __|__/|__||\/| Information Retrieval, Semantic Web ___|||__|| \| || | Embedded Unix, System Integration http://www.sigram.com Contact: info at sigram dot com -- Lewis -- Lewis
Re: Build failed in Jenkins: Nutch-trunk #1706
Some more problems here... Firstly, when I apply NUTCH-1237, I am seeing a mountain of javac warnings ranging right the way through from deprecation such as [javac] Compiling 169 source files to /home/lewis/ASF/trunk/build/classes [javac] warning: [path] bad path element /home/lewis/ASF/trunk/build/lib/activation.jar: no such file or directory [javac] CrawlDbReader.java:36: warning: [deprecation] org.apache.hadoop.io.Closeable in org.apache.hadoop.io has been deprecated [javac] import org.apache.hadoop.io.Closeable; to [javac] URLNormalizers.java:103: warning: [unchecked] unchecked conversion [javac] found : java.util.List [javac] required: java.util.Listorg.apache.nutch.plugin.Extension [javac] private final ListExtension EMPTY_EXTENSION_LIST = Collections.EMPTY_LIST; to [javac] CrawlDbReader.java:179: warning: [cast] redundant cast to org.apache.hadoop.io.Text [javac] String k = ((Text)key).toString(); [javac] ^ This relates back to my reasoning for opening NUTCH-1176, there seem to be quite a few issues here, just to confirm, I'm using trunk @ revision 1225183 (nightly). Further to this, I have two failing tests TestCrawlDBMerger and TestSegmentMerger... That's nothing new and has been going on for quite some time. Can anyone confirm any of this so I can rule out my local environment messing things up? Thanks On Wed, Dec 28, 2011 at 1:15 PM, Lewis John Mcgibbney lewis.mcgibb...@gmail.com wrote: Hi Andrzej, Can anyone confirm? I've tried this patch locally and although I couldn't reproduce the original issue, it seems to be working fine for me as well. Thanks Andrzej On Wed, Dec 28, 2011 at 1:06 PM, Andrzej Bialecki a...@getopt.org wrote: On 28/12/2011 12:00, Lewis John Mcgibbney wrote: Hi Guys, Pretty strange compilation failure, this test class hasn't been hacked in months, and from the surface, having looked at the test case there appears to be no obvious reasons for it failing to compile. I've kick started another build on Jenkins to see if it will resolve itself. I don't think it will - I can reproduce this failure locally. Here's what fixed the failure for me (I'm pretty ignorant about ivy/maven so there's likely a more correct fix for this): Index: ivy/ivy.xml === --- ivy/ivy.xml (revision 1225046) +++ ivy/ivy.xml (working copy) @@ -69,7 +69,7 @@ !--Configuration: test -- !--artifacts needed for testing -- - dependency org=junit name=junit rev=3.8.1 conf=test-default / + dependency org=junit name=junit rev=3.8.1 conf=*-default / dependency org=org.apache.hadoop name=hadoop-test rev=0.20.205.0 conf=test-default / -- Best regards, Andrzej Bialecki ___. ___ ___ ___ _ _ __ [__ || __|__/|__||\/| Information Retrieval, Semantic Web ___|||__|| \| || | Embedded Unix, System Integration http://www.sigram.com Contact: info at sigram dot com -- Lewis
Re: Build failed in Jenkins: Nutch-trunk #1706
Yeah your right Markus, I realise this. What about the tests and the problem with the build. What kind of behaviour are you getting? On Wed, Dec 28, 2011 at 1:46 PM, Markus Jelsma markus.jel...@openindex.io wrote: Some more problems here... Firstly, when I apply NUTCH-1237, I am seeing a mountain of javac warnings ranging right the way through from deprecation such as [javac] Compiling 169 source files to /home/lewis/ASF/trunk/build/classes [javac] warning: [path] bad path element /home/lewis/ASF/trunk/build/lib/activation.jar: no such file or directory [javac] CrawlDbReader.java:36: warning: [deprecation] org.apache.hadoop.io.Closeable in org.apache.hadoop.io has been deprecated [javac] import org.apache.hadoop.io.Closeable; to [javac] URLNormalizers.java:103: warning: [unchecked] unchecked conversion [javac] found : java.util.List [javac] required: java.util.Listorg.apache.nutch.plugin.Extension [javac] private final ListExtension EMPTY_EXTENSION_LIST = Collections.EMPTY_LIST; to [javac] CrawlDbReader.java:179: warning: [cast] redundant cast to org.apache.hadoop.io.Text [javac] String k = ((Text)key).toString(); [javac] ^ This relates back to my reasoning for opening NUTCH-1176, there seem to be quite a few issues here, just to confirm, I'm using trunk @ revision 1225183 (nightly). Further to this, I have two failing tests TestCrawlDBMerger and TestSegmentMerger... That's nothing new and has been going on for quite some time. Can anyone confirm any of this so I can rule out my local environment messing things up? Thanks On Wed, Dec 28, 2011 at 1:15 PM, Lewis John Mcgibbney lewis.mcgibb...@gmail.com wrote: Hi Andrzej, Can anyone confirm? I've tried this patch locally and although I couldn't reproduce the original issue, it seems to be working fine for me as well. Thanks Andrzej On Wed, Dec 28, 2011 at 1:06 PM, Andrzej Bialecki a...@getopt.org wrote: On 28/12/2011 12:00, Lewis John Mcgibbney wrote: Hi Guys, Pretty strange compilation failure, this test class hasn't been hacked in months, and from the surface, having looked at the test case there appears to be no obvious reasons for it failing to compile. I've kick started another build on Jenkins to see if it will resolve itself. I don't think it will - I can reproduce this failure locally. Here's what fixed the failure for me (I'm pretty ignorant about ivy/maven so there's likely a more correct fix for this): Index: ivy/ivy.xml === --- ivy/ivy.xml (revision 1225046) +++ ivy/ivy.xml (working copy) @@ -69,7 +69,7 @@ !--Configuration: test -- !--artifacts needed for testing -- - dependency org=junit name=junit rev=3.8.1 conf=test-default / + dependency org=junit name=junit rev=3.8.1 conf=*-default / dependency org=org.apache.hadoop name=hadoop-test rev=0.20.205.0 conf=test-default / -- Best regards, Andrzej Bialecki ___. ___ ___ ___ _ _ __ [__ || __|__/|__||\/| Information Retrieval, Semantic Web ___|||__|| \| || | Embedded Unix, System Integration http://www.sigram.com Contact: info at sigram dot com -- Lewis -- Lewis
