Re: Build failed in Hudson: Nutch-Nightly #123
On 6/20/07, [EMAIL PROTECTED] [EMAIL PROTECTED] wrote: See http://lucene.zones.apache.org:8080/hudson/job/Nutch-Nightly/123/changes -- [...truncated 5950 lines...] init-plugin: deps-jar: compile: [echo] Compiling plugin: lib-regex-filter jar: init: init-plugin: deps-jar: compile: [echo] Compiling plugin: lib-regex-filter compile-test: compile: [echo] Compiling plugin: urlfilter-automaton [junit] Tests run: 1, Failures: 0, Errors: 0, Time elapsed: 1.585 sec Overriding previous definition of reference to plugin.deps init: Overriding previous definition of reference to plugin.deps init-plugin: deps-jar: init: init-plugin: deps-jar: compile: [echo] Compiling plugin: lib-regex-filter jar: init: init-plugin: deps-jar: compile: [echo] Compiling plugin: lib-regex-filter compile-test: compile: [echo] Compiling plugin: urlfilter-regex compile-test: compile-test: [javac] Compiling 1 source file to http://lucene.zones.apache.org:8080/hudson/job/Nutch-Nightly/ws/trunk/build/urlfilter-automaton/test [javac] Compiling 1 source file to http://lucene.zones.apache.org:8080/hudson/job/Nutch-Nightly/ws/trunk/build/urlfilter-regex/test jar: deps-test: init: init-plugin: deps-jar: compile: [echo] Compiling plugin: lib-regex-filter jar: jar: deps-test: deps-test: deploy: init: copy-generated-lib: deploy: init-plugin: deps-jar: compile: [echo] Compiling plugin: lib-regex-filter Overriding previous definition of reference to plugin.deps jar: copy-generated-lib: deps-test: deploy: test: [echo] Testing plugin: urlfilter-automaton [junit] Running org.apache.nutch.urlfilter.automaton.TestAutomatonURLFilter copy-generated-lib: deploy: Overriding previous definition of reference to plugin.deps copy-generated-lib: test: [echo] Testing plugin: urlfilter-regex [junit] Running org.apache.nutch.urlfilter.regex.TestRegexURLFilter [junit] Tests run: 1, Failures: 0, Errors: 0, Time elapsed: 2.812 sec init: init-plugin: deps-jar: compile: [echo] Compiling plugin: urlfilter-suffix compile-test: [javac] Compiling 1 source file to http://lucene.zones.apache.org:8080/hudson/job/Nutch-Nightly/ws/trunk/build/urlfilter-suffix/test jar: deps-test: deploy: copy-generated-lib: test: [echo] Testing plugin: urlfilter-suffix [junit] Running org.apache.nutch.urlfilter.suffix.TestSuffixURLFilter [junit] Tests run: 6, Failures: 0, Errors: 0, Time elapsed: 0.174 sec init: init-plugin: deps-jar: compile: [echo] Compiling plugin: urlnormalizer-basic compile-test: [javac] Compiling 1 source file to http://lucene.zones.apache.org:8080/hudson/job/Nutch-Nightly/ws/trunk/build/urlnormalizer-basic/test jar: deps-test: deploy: copy-generated-lib: test: [echo] Testing plugin: urlnormalizer-basic [junit] Running org.apache.nutch.net.urlnormalizer.basic.TestBasicURLNormalizer [junit] Tests run: 1, Failures: 0, Errors: 0, Time elapsed: 0.024 sec init: init-plugin: deps-jar: compile: [echo] Compiling plugin: urlnormalizer-pass compile-test: [javac] Compiling 1 source file to http://lucene.zones.apache.org:8080/hudson/job/Nutch-Nightly/ws/trunk/build/urlnormalizer-pass/test jar: deps-test: deploy: copy-generated-lib: test: [echo] Testing plugin: urlnormalizer-pass [junit] Running org.apache.nutch.net.urlnormalizer.pass.TestPassURLNormalizer [junit] Tests run: 1, Failures: 0, Errors: 0, Time elapsed: 0.15 sec init: init-plugin: deps-jar: compile: [echo] Compiling plugin: urlnormalizer-regex compile-test: [javac] Compiling 1 source file to http://lucene.zones.apache.org:8080/hudson/job/Nutch-Nightly/ws/trunk/build/urlnormalizer-regex/test [javac] Note: http://lucene.zones.apache.org:8080/hudson/job/Nutch-Nightly/ws/trunk/src/plugin/urlnormalizer-regex/src/test/org/apache/nutch/net/urlnormalizer/regex/TestRegexURLNormalizer.java uses unchecked or unsafe operations. [javac] Note: Recompile with -Xlint:unchecked for details. jar: deps-test: init: init-plugin: compile: jar: deps-test: deploy: copy-generated-lib: deploy: copy-generated-lib: test: [echo] Testing plugin: urlnormalizer-regex [junit] Running org.apache.nutch.net.urlnormalizer.regex.TestRegexURLNormalizer [junit] Tests run: 2, Failures: 0, Errors: 0, Time elapsed: 0.016 sec [junit] Tests run: 1, Failures: 0, Errors: 0, Time elapsed: 7.454 sec BUILD FAILED http://lucene.zones.apache.org:8080/hudson/job/Nutch-Nightly/ws/trunk/build.xml :302: The following error occurred while executing this line: http://lucene.zones.apache.org:8080/hudson/job/Nutch-Nightly/ws/trunk/src/plugin/build.xml :98: The following error occurred while executing this line: http://lucene.zones.apache.org:8080/hudson/job/Nutch-Nightly/ws/trunk/src/plugin/build-plugin.xml :200: Tests failed! Total time: 4 minutes 23 seconds
Re: Build failed in Hudson: Nutch-Nightly #123
On 6/20/07, Doğacan Güney [EMAIL PROTECTED] wrote: This is rather strange. Here is part of the console output: test: [echo] Testing plugin: parse-swf [junit] Running org.apache.nutch.parse.swf.TestSWFParser [junit] Tests run: 1, Failures: 0, Errors: 0, Time elapsed: 2.315 sec [junit] Tests run: 1, Failures: 1, Errors: 0, Time elapsed: 5.387 sec init: [junit] Test org.apache.nutch.parse.feed.TestFeedParser FAILED SWFParser fails one of the unit tests but the report says that FeedParser has failed even though it has actually passed its test: test: [echo] Testing plugin: feed [junit] Running org.apache.nutch.parse.feed.TestFeedParser [junit] Tests run: 1, Failures: 0, Errors: 0, Time elapsed: 1.304 sec (ant test forks processes to test code, that's why we are seeing test outputs out of order.) Anyway, it is not TestSWFParser but TestFeedParser that fails. I am trying to understand why it fails. Chris, can you lend me a hand here? -- Doğacan Güney
Re: Build failed in Hudson: Nutch-Nightly #123
Doğacan, This is strange indeed. I noticed this during my testing of parse-feed, however, thought it was an anomaly. I got this same strange cryptic unit test error message, and then after some frustration figuring it out, I did ant clean, then ant compile-core test, and miraculously the error seemed to go away. Also, if you go into $NUTCH/src/plugin/feed/ and run ant clean test (of course after running ant compile-core from the top-level $NUTCH dir), the unit tests seem to pass? [XXX:src/plugin/feed] mattmann% pwd /Users/mattmann/src/nutch/src/plugin/feed [XXX:src/plugin/feed] mattmann% ant clean test Searching for build.xml ... Buildfile: /Users/mattmann/src/nutch/src/plugin/feed/build.xml clean: [delete] Deleting directory /Users/mattmann/src/nutch/build/feed [delete] Deleting directory /Users/mattmann/src/nutch/build/plugins/feed init: [mkdir] Created dir: /Users/mattmann/src/nutch/build/feed [mkdir] Created dir: /Users/mattmann/src/nutch/build/feed/classes [mkdir] Created dir: /Users/mattmann/src/nutch/build/feed/test [mkdir] Created dir: /Users/mattmann/src/nutch/build/feed/test/data [copy] Copying 1 file to /Users/mattmann/src/nutch/build/feed/test/data init-plugin: deps-jar: compile: [echo] Compiling plugin: feed [javac] Compiling 2 source files to /Users/mattmann/src/nutch/build/feed/classes compile-test: [javac] Compiling 1 source file to /Users/mattmann/src/nutch/build/feed/test jar: [jar] Building jar: /Users/mattmann/src/nutch/build/feed/feed.jar deps-test: init: init-plugin: compile: jar: deps-test: deploy: copy-generated-lib: init: init-plugin: deps-jar: compile: [echo] Compiling plugin: protocol-file jar: deps-test: deploy: copy-generated-lib: deploy: [mkdir] Created dir: /Users/mattmann/src/nutch/build/plugins/feed [copy] Copying 1 file to /Users/mattmann/src/nutch/build/plugins/feed copy-generated-lib: [copy] Copying 1 file to /Users/mattmann/src/nutch/build/plugins/feed [copy] Copying 2 files to /Users/mattmann/src/nutch/build/plugins/feed test: [echo] Testing plugin: feed [junit] Running org.apache.nutch.parse.feed.TestFeedParser [junit] Tests run: 1, Failures: 0, Errors: 0, Time elapsed: 0.663 sec BUILD SUCCESSFUL Total time: 3 seconds [XXX:src/plugin/feed] mattmann% Any ideas? Cheers, Chris On 6/20/07 6:04 AM, Doğacan Güney [EMAIL PROTECTED] wrote: On 6/20/07, Doğacan Güney [EMAIL PROTECTED] wrote: This is rather strange. Here is part of the console output: test: [echo] Testing plugin: parse-swf [junit] Running org.apache.nutch.parse.swf.TestSWFParser [junit] Tests run: 1, Failures: 0, Errors: 0, Time elapsed: 2.315 sec [junit] Tests run: 1, Failures: 1, Errors: 0, Time elapsed: 5.387 sec init: [junit] Test org.apache.nutch.parse.feed.TestFeedParser FAILED SWFParser fails one of the unit tests but the report says that FeedParser has failed even though it has actually passed its test: test: [echo] Testing plugin: feed [junit] Running org.apache.nutch.parse.feed.TestFeedParser [junit] Tests run: 1, Failures: 0, Errors: 0, Time elapsed: 1.304 sec (ant test forks processes to test code, that's why we are seeing test outputs out of order.) Anyway, it is not TestSWFParser but TestFeedParser that fails. I am trying to understand why it fails. Chris, can you lend me a hand here? -- Doğacan Güney __ Chris A. Mattmann [EMAIL PROTECTED] Key Staff Member Modeling and Data Management Systems Section (387) Data Management Systems and Technologies Group _ Jet Propulsion LaboratoryPasadena, CA Office: 171-266BMailstop: 171-246 ___ Disclaimer: The opinions presented within are my own and do not reflect those of either NASA, JPL, or the California Institute of Technology.
Re: Build failed in Hudson: Nutch-Nightly #123
Is this the same java 6 error that was popping up a while back? For some reason with java 6 the XML is being parsed differently in the SWF parser and therefore unit tests looking for exact strings were failing. Could this be happening in the feed parser as well? Dennis Kubes Chris Mattmann wrote: Doğacan, This is strange indeed. I noticed this during my testing of parse-feed, however, thought it was an anomaly. I got this same strange cryptic unit test error message, and then after some frustration figuring it out, I did ant clean, then ant compile-core test, and miraculously the error seemed to go away. Also, if you go into $NUTCH/src/plugin/feed/ and run ant clean test (of course after running ant compile-core from the top-level $NUTCH dir), the unit tests seem to pass? [XXX:src/plugin/feed] mattmann% pwd /Users/mattmann/src/nutch/src/plugin/feed [XXX:src/plugin/feed] mattmann% ant clean test Searching for build.xml ... Buildfile: /Users/mattmann/src/nutch/src/plugin/feed/build.xml clean: [delete] Deleting directory /Users/mattmann/src/nutch/build/feed [delete] Deleting directory /Users/mattmann/src/nutch/build/plugins/feed init: [mkdir] Created dir: /Users/mattmann/src/nutch/build/feed [mkdir] Created dir: /Users/mattmann/src/nutch/build/feed/classes [mkdir] Created dir: /Users/mattmann/src/nutch/build/feed/test [mkdir] Created dir: /Users/mattmann/src/nutch/build/feed/test/data [copy] Copying 1 file to /Users/mattmann/src/nutch/build/feed/test/data init-plugin: deps-jar: compile: [echo] Compiling plugin: feed [javac] Compiling 2 source files to /Users/mattmann/src/nutch/build/feed/classes compile-test: [javac] Compiling 1 source file to /Users/mattmann/src/nutch/build/feed/test jar: [jar] Building jar: /Users/mattmann/src/nutch/build/feed/feed.jar deps-test: init: init-plugin: compile: jar: deps-test: deploy: copy-generated-lib: init: init-plugin: deps-jar: compile: [echo] Compiling plugin: protocol-file jar: deps-test: deploy: copy-generated-lib: deploy: [mkdir] Created dir: /Users/mattmann/src/nutch/build/plugins/feed [copy] Copying 1 file to /Users/mattmann/src/nutch/build/plugins/feed copy-generated-lib: [copy] Copying 1 file to /Users/mattmann/src/nutch/build/plugins/feed [copy] Copying 2 files to /Users/mattmann/src/nutch/build/plugins/feed test: [echo] Testing plugin: feed [junit] Running org.apache.nutch.parse.feed.TestFeedParser [junit] Tests run: 1, Failures: 0, Errors: 0, Time elapsed: 0.663 sec BUILD SUCCESSFUL Total time: 3 seconds [XXX:src/plugin/feed] mattmann% Any ideas? Cheers, Chris On 6/20/07 6:04 AM, Doğacan Güney [EMAIL PROTECTED] wrote: On 6/20/07, Doğacan Güney [EMAIL PROTECTED] wrote: This is rather strange. Here is part of the console output: test: [echo] Testing plugin: parse-swf [junit] Running org.apache.nutch.parse.swf.TestSWFParser [junit] Tests run: 1, Failures: 0, Errors: 0, Time elapsed: 2.315 sec [junit] Tests run: 1, Failures: 1, Errors: 0, Time elapsed: 5.387 sec init: [junit] Test org.apache.nutch.parse.feed.TestFeedParser FAILED SWFParser fails one of the unit tests but the report says that FeedParser has failed even though it has actually passed its test: test: [echo] Testing plugin: feed [junit] Running org.apache.nutch.parse.feed.TestFeedParser [junit] Tests run: 1, Failures: 0, Errors: 0, Time elapsed: 1.304 sec (ant test forks processes to test code, that's why we are seeing test outputs out of order.) Anyway, it is not TestSWFParser but TestFeedParser that fails. I am trying to understand why it fails. Chris, can you lend me a hand here? -- Doğacan Güney __ Chris A. Mattmann [EMAIL PROTECTED] Key Staff Member Modeling and Data Management Systems Section (387) Data Management Systems and Technologies Group _ Jet Propulsion LaboratoryPasadena, CA Office: 171-266BMailstop: 171-246 ___ Disclaimer: The opinions presented within are my own and do not reflect those of either NASA, JPL, or the California Institute of Technology.
Re: Build failed in Hudson: Nutch-Nightly #123
On 6/20/07, Chris Mattmann [EMAIL PROTECTED] wrote: Doğacan, This is strange indeed. I noticed this during my testing of parse-feed, however, thought it was an anomaly. I got this same strange cryptic unit test error message, and then after some frustration figuring it out, I did ant clean, then ant compile-core test, and miraculously the error seemed to go away. Also, if you go into $NUTCH/src/plugin/feed/ and run ant clean test (of course after running ant compile-core from the top-level $NUTCH dir), the unit tests seem to pass? [XXX:src/plugin/feed] mattmann% pwd /Users/mattmann/src/nutch/src/plugin/feed [XXX:src/plugin/feed] mattmann% ant clean test Searching for build.xml ... Buildfile: /Users/mattmann/src/nutch/src/plugin/feed/build.xml clean: [delete] Deleting directory /Users/mattmann/src/nutch/build/feed [delete] Deleting directory /Users/mattmann/src/nutch/build/plugins/feed init: [mkdir] Created dir: /Users/mattmann/src/nutch/build/feed [mkdir] Created dir: /Users/mattmann/src/nutch/build/feed/classes [mkdir] Created dir: /Users/mattmann/src/nutch/build/feed/test [mkdir] Created dir: /Users/mattmann/src/nutch/build/feed/test/data [copy] Copying 1 file to /Users/mattmann/src/nutch/build/feed/test/data init-plugin: deps-jar: compile: [echo] Compiling plugin: feed [javac] Compiling 2 source files to /Users/mattmann/src/nutch/build/feed/classes compile-test: [javac] Compiling 1 source file to /Users/mattmann/src/nutch/build/feed/test jar: [jar] Building jar: /Users/mattmann/src/nutch/build/feed/feed.jar deps-test: init: init-plugin: compile: jar: deps-test: deploy: copy-generated-lib: init: init-plugin: deps-jar: compile: [echo] Compiling plugin: protocol-file jar: deps-test: deploy: copy-generated-lib: deploy: [mkdir] Created dir: /Users/mattmann/src/nutch/build/plugins/feed [copy] Copying 1 file to /Users/mattmann/src/nutch/build/plugins/feed copy-generated-lib: [copy] Copying 1 file to /Users/mattmann/src/nutch/build/plugins/feed [copy] Copying 2 files to /Users/mattmann/src/nutch/build/plugins/feed test: [echo] Testing plugin: feed [junit] Running org.apache.nutch.parse.feed.TestFeedParser [junit] Tests run: 1, Failures: 0, Errors: 0, Time elapsed: 0.663 sec BUILD SUCCESSFUL Total time: 3 seconds [XXX:src/plugin/feed] mattmann% Any ideas? It never passes for me (not even when I do it in src/plugin/feed). If you check the output, parseResult only contains a single entry which is rsstest.rss. I think what causes this bug is (surprise, surprise) PrefixURLFilter. We don't have a template for prefix-urlfilter.txt in conf, so it doesn't get properly initialized and (I can't figure out why but) randomly filters out stuff. When I put a sample prefix-urlfilter.txt(*) under conf, all tests seem to pass. (*) As your friendly neighborhood Nutch developer, I even put up a sample file at: http://www.ceng.metu.edu.tr/~e1345172/prefix-urlfilter.txt Cheers, Chris On 6/20/07 6:04 AM, Doğacan Güney [EMAIL PROTECTED] wrote: On 6/20/07, Doğacan Güney [EMAIL PROTECTED] wrote: This is rather strange. Here is part of the console output: test: [echo] Testing plugin: parse-swf [junit] Running org.apache.nutch.parse.swf.TestSWFParser [junit] Tests run: 1, Failures: 0, Errors: 0, Time elapsed: 2.315 sec [junit] Tests run: 1, Failures: 1, Errors: 0, Time elapsed: 5.387 sec init: [junit] Test org.apache.nutch.parse.feed.TestFeedParser FAILED SWFParser fails one of the unit tests but the report says that FeedParser has failed even though it has actually passed its test: test: [echo] Testing plugin: feed [junit] Running org.apache.nutch.parse.feed.TestFeedParser [junit] Tests run: 1, Failures: 0, Errors: 0, Time elapsed: 1.304 sec (ant test forks processes to test code, that's why we are seeing test outputs out of order.) Anyway, it is not TestSWFParser but TestFeedParser that fails. I am trying to understand why it fails. Chris, can you lend me a hand here? -- Doğacan Güney __ Chris A. Mattmann [EMAIL PROTECTED] Key Staff Member Modeling and Data Management Systems Section (387) Data Management Systems and Technologies Group _ Jet Propulsion LaboratoryPasadena, CA Office: 171-266BMailstop: 171-246 ___ Disclaimer: The opinions presented within are my own and do not reflect those of either NASA, JPL, or the California Institute of Technology. -- Doğacan Güney
Re: Build failed in Hudson: Nutch-Nightly #123
On 6/20/07, Dennis Kubes [EMAIL PROTECTED] wrote: Is this the same java 6 error that was popping up a while back? For some reason with java 6 the XML is being parsed differently in the SWF parser and therefore unit tests looking for exact strings were failing. Could this be happening in the feed parser as well? I ran into some other issues with Java 6 (backward compatibility, right...), so I actually switched my Java back to 5, at least for this computer. Dennis Kubes Chris Mattmann wrote: Doğacan, This is strange indeed. I noticed this during my testing of parse-feed, however, thought it was an anomaly. I got this same strange cryptic unit test error message, and then after some frustration figuring it out, I did ant clean, then ant compile-core test, and miraculously the error seemed to go away. Also, if you go into $NUTCH/src/plugin/feed/ and run ant clean test (of course after running ant compile-core from the top-level $NUTCH dir), the unit tests seem to pass? [XXX:src/plugin/feed] mattmann% pwd /Users/mattmann/src/nutch/src/plugin/feed [XXX:src/plugin/feed] mattmann% ant clean test Searching for build.xml ... Buildfile: /Users/mattmann/src/nutch/src/plugin/feed/build.xml clean: [delete] Deleting directory /Users/mattmann/src/nutch/build/feed [delete] Deleting directory /Users/mattmann/src/nutch/build/plugins/feed init: [mkdir] Created dir: /Users/mattmann/src/nutch/build/feed [mkdir] Created dir: /Users/mattmann/src/nutch/build/feed/classes [mkdir] Created dir: /Users/mattmann/src/nutch/build/feed/test [mkdir] Created dir: /Users/mattmann/src/nutch/build/feed/test/data [copy] Copying 1 file to /Users/mattmann/src/nutch/build/feed/test/data init-plugin: deps-jar: compile: [echo] Compiling plugin: feed [javac] Compiling 2 source files to /Users/mattmann/src/nutch/build/feed/classes compile-test: [javac] Compiling 1 source file to /Users/mattmann/src/nutch/build/feed/test jar: [jar] Building jar: /Users/mattmann/src/nutch/build/feed/feed.jar deps-test: init: init-plugin: compile: jar: deps-test: deploy: copy-generated-lib: init: init-plugin: deps-jar: compile: [echo] Compiling plugin: protocol-file jar: deps-test: deploy: copy-generated-lib: deploy: [mkdir] Created dir: /Users/mattmann/src/nutch/build/plugins/feed [copy] Copying 1 file to /Users/mattmann/src/nutch/build/plugins/feed copy-generated-lib: [copy] Copying 1 file to /Users/mattmann/src/nutch/build/plugins/feed [copy] Copying 2 files to /Users/mattmann/src/nutch/build/plugins/feed test: [echo] Testing plugin: feed [junit] Running org.apache.nutch.parse.feed.TestFeedParser [junit] Tests run: 1, Failures: 0, Errors: 0, Time elapsed: 0.663 sec BUILD SUCCESSFUL Total time: 3 seconds [XXX:src/plugin/feed] mattmann% Any ideas? Cheers, Chris On 6/20/07 6:04 AM, Doğacan Güney [EMAIL PROTECTED] wrote: On 6/20/07, Doğacan Güney [EMAIL PROTECTED] wrote: This is rather strange. Here is part of the console output: test: [echo] Testing plugin: parse-swf [junit] Running org.apache.nutch.parse.swf.TestSWFParser [junit] Tests run: 1, Failures: 0, Errors: 0, Time elapsed: 2.315 sec [junit] Tests run: 1, Failures: 1, Errors: 0, Time elapsed: 5.387 sec init: [junit] Test org.apache.nutch.parse.feed.TestFeedParser FAILED SWFParser fails one of the unit tests but the report says that FeedParser has failed even though it has actually passed its test: test: [echo] Testing plugin: feed [junit] Running org.apache.nutch.parse.feed.TestFeedParser [junit] Tests run: 1, Failures: 0, Errors: 0, Time elapsed: 1.304 sec (ant test forks processes to test code, that's why we are seeing test outputs out of order.) Anyway, it is not TestSWFParser but TestFeedParser that fails. I am trying to understand why it fails. Chris, can you lend me a hand here? -- Doğacan Güney __ Chris A. Mattmann [EMAIL PROTECTED] Key Staff Member Modeling and Data Management Systems Section (387) Data Management Systems and Technologies Group _ Jet Propulsion LaboratoryPasadena, CA Office: 171-266BMailstop: 171-246 ___ Disclaimer: The opinions presented within are my own and do not reflect those of either NASA, JPL, or the California Institute of Technology. -- Doğacan Güney
Re: Build failed in Hudson: Nutch-Nightly #123
On 6/20/07, Chris Mattmann [EMAIL PROTECTED] wrote: On 6/20/07 7:17 AM, Doğacan Güney [EMAIL PROTECTED] wrote: It never passes for me (not even when I do it in src/plugin/feed). If you check the output, parseResult only contains a single entry which is rsstest.rss. Okay, please tell me I'm not crazy here. I'm on Mac OS X 10.4, Java version: # java -version java version 1.5.0_07 Java(TM) 2 Runtime Environment, Standard Edition (build 1.5.0_07-164) Java HotSpot(TM) Client VM (build 1.5.0_07-87, mixed mode, sharing) I did a fresh checkout of the Nutch trunk. Then, from that dir, I run: # ant compile-core # cd src/plugin/feed # ant clean test All tests pass? Here is a log: [XXX:~/src/nutch] mattmann% ant compile-core Searching for build.xml ... Buildfile: /Users/mattmann/src/nutch/build.xml init: [mkdir] Created dir: /Users/mattmann/src/nutch/build [mkdir] Created dir: /Users/mattmann/src/nutch/build/classes [mkdir] Created dir: /Users/mattmann/src/nutch/build/test [mkdir] Created dir: /Users/mattmann/src/nutch/build/test/classes [mkdir] Created dir: /Users/mattmann/src/nutch/build/hadoop [unjar] Expanding: /Users/mattmann/src/nutch/lib/hadoop-0.12.2-core.jar into /Users/mattmann/src/nutch/build/hadoop [untar] Expanding: /Users/mattmann/src/nutch/build/hadoop/bin.tgz into /Users/mattmann/src/nutch/bin [mkdir] Created dir: /Users/mattmann/src/nutch/build/webapps [unjar] Expanding: /Users/mattmann/src/nutch/lib/hadoop-0.12.2-core.jar into /Users/mattmann/src/nutch/build compile-core: [javac] Compiling 172 source files to /Users/mattmann/src/nutch/build/classes [javac] Note: Some input files use or override a deprecated API. [javac] Note: Recompile with -Xlint:deprecation for details. [javac] Note: Some input files use unchecked or unsafe operations. [javac] Note: Recompile with -Xlint:unchecked for details. BUILD SUCCESSFUL Total time: 3 seconds [XXX:~/src/nutch] mattmann% cd src/plugin/feed [XXX:src/plugin/feed] mattmann% ant clean test Searching for build.xml ... Buildfile: /Users/mattmann/src/nutch/src/plugin/feed/build.xml [mkdir] Created dir: /Users/mattmann/src/nutch/build/feed/test/data [copy] Copying 1 file to /Users/mattmann/src/nutch/build/feed/test/data clean: [delete] Deleting directory /Users/mattmann/src/nutch/build/feed init: [mkdir] Created dir: /Users/mattmann/src/nutch/build/feed [mkdir] Created dir: /Users/mattmann/src/nutch/build/feed/classes [mkdir] Created dir: /Users/mattmann/src/nutch/build/feed/test [mkdir] Created dir: /Users/mattmann/src/nutch/build/feed/test/data [copy] Copying 1 file to /Users/mattmann/src/nutch/build/feed/test/data init-plugin: deps-jar: compile: [echo] Compiling plugin: feed [javac] Compiling 2 source files to /Users/mattmann/src/nutch/build/feed/classes compile-test: [javac] Compiling 1 source file to /Users/mattmann/src/nutch/build/feed/test jar: [jar] Building jar: /Users/mattmann/src/nutch/build/feed/feed.jar deps-test: init: [mkdir] Created dir: /Users/mattmann/src/nutch/build/nutch-extensionpoints [mkdir] Created dir: /Users/mattmann/src/nutch/build/nutch-extensionpoints/classes [mkdir] Created dir: /Users/mattmann/src/nutch/build/nutch-extensionpoints/test init-plugin: compile: jar: [jar] Building MANIFEST-only jar: /Users/mattmann/src/nutch/build/nutch-extensionpoints/nutch-extensionpoints. jar deps-test: deploy: [mkdir] Created dir: /Users/mattmann/src/nutch/build/plugins/nutch-extensionpoints [copy] Copying 1 file to /Users/mattmann/src/nutch/build/plugins/nutch-extensionpoints copy-generated-lib: [copy] Copying 1 file to /Users/mattmann/src/nutch/build/plugins/nutch-extensionpoints init: [mkdir] Created dir: /Users/mattmann/src/nutch/build/protocol-file [mkdir] Created dir: /Users/mattmann/src/nutch/build/protocol-file/classes [mkdir] Created dir: /Users/mattmann/src/nutch/build/protocol-file/test init-plugin: deps-jar: compile: [echo] Compiling plugin: protocol-file [javac] Compiling 4 source files to /Users/mattmann/src/nutch/build/protocol-file/classes jar: [jar] Building jar: /Users/mattmann/src/nutch/build/protocol-file/protocol-file.jar deps-test: deploy: [mkdir] Created dir: /Users/mattmann/src/nutch/build/plugins/protocol-file [copy] Copying 1 file to /Users/mattmann/src/nutch/build/plugins/protocol-file copy-generated-lib: [copy] Copying 1 file to /Users/mattmann/src/nutch/build/plugins/protocol-file deploy: [mkdir] Created dir: /Users/mattmann/src/nutch/build/plugins/feed [copy] Copying 1 file to /Users/mattmann/src/nutch/build/plugins/feed copy-generated-lib: [copy] Copying 1 file to /Users/mattmann/src/nutch/build/plugins/feed [copy] Copying 2 files to /Users/mattmann/src/nutch/build/plugins/feed test: [echo] Testing plugin: feed [junit] Running org.apache.nutch.parse.feed.TestFeedParser
Re: Build failed in Hudson: Nutch-Nightly #123
On 6/20/07 8:17 AM, Doğacan Güney [EMAIL PROTECTED] wrote: Since you are doing compile-core, no plugins get compiled (say, urlfilter-prefix), then when you do a ant test in feed only protocol-file gets compiled. So, no urlfilter-prefix, no problem :). I have to say that I am certain that I am not sure of what I just said. Can you retry with just 'ant' instead of 'ant compile-core'? Heh, yep, that replicated the issue. Okay, so I agree with you with regards to the fix that you suggested, however the larger issue here is one of annoyance. Why should I have to have a version of the urlfilter-prefix plugin compiled for this issue to manifest itself? Plugin development is supposed to be independent, i.e., while developing the feed plugin I shouldn't need to care about how others have developed the urlfilter plugin, etc., or whether or not there is an appropriate test file there to use in unit testing. I have 2 suggestions: 1. We should make the urlfilter-prefix use more of a sensible default for its filters (e.g., a default filter perhaps) that takes effect when the plugin cannot find the specified .txt file. 2. We should think about this more general issue and come up with a way that plugin development in Nutch supports the use case that I was trying, which I find to be highly representative of what many other folks using Nutch are doing as well (i.e., why should I have to do a full rebuild/test of other plugins when I'm simply working on a single one? For my part in the interim, I will ensure that next time before I commit a plugin I make sure that it passes with the full ant clean compile-core test cycle. Doğacan, thanks for your help in tracking this down. Could you please commit an example test urlfilter file to make the unit test pass since you are going to make that change to use lib-xml anyways? Let me know okay, thanks! Cheers, Chris
Re: Build failed in Hudson: Nutch-Nightly #123
On Jun 20, 2007, at 12:07 AM, Doğacan Güney wrote: On 6/20/07, [EMAIL PROTECTED] [EMAIL PROTECTED] wrote: See http://lucene.zones.apache.org:8080/hudson/job/Nutch-Nightly/ 123/changes -- [...truncated 5950 lines...] init-plugin: deps-jar: compile: [echo] Compiling plugin: lib-regex-filter jar: init: init-plugin: deps-jar: compile: [echo] Compiling plugin: lib-regex-filter compile-test: compile: [echo] Compiling plugin: urlfilter-automaton [junit] Tests run: 1, Failures: 0, Errors: 0, Time elapsed: 1.585 sec Overriding previous definition of reference to plugin.deps init: Overriding previous definition of reference to plugin.deps init-plugin: deps-jar: init: init-plugin: deps-jar: compile: [echo] Compiling plugin: lib-regex-filter jar: init: init-plugin: deps-jar: compile: [echo] Compiling plugin: lib-regex-filter compile-test: compile: [echo] Compiling plugin: urlfilter-regex compile-test: compile-test: [javac] Compiling 1 source file to http:// lucene.zones.apache.org:8080/hudson/job/Nutch-Nightly/ws/trunk/ build/urlfilter-automaton/test [javac] Compiling 1 source file to http:// lucene.zones.apache.org:8080/hudson/job/Nutch-Nightly/ws/trunk/ build/urlfilter-regex/test jar: deps-test: init: init-plugin: deps-jar: compile: [echo] Compiling plugin: lib-regex-filter jar: jar: deps-test: deps-test: deploy: init: copy-generated-lib: deploy: init-plugin: deps-jar: compile: [echo] Compiling plugin: lib-regex-filter Overriding previous definition of reference to plugin.deps jar: copy-generated-lib: deps-test: deploy: test: [echo] Testing plugin: urlfilter-automaton [junit] Running org.apache.nutch.urlfilter.automaton.TestAutomatonURLFilter copy-generated-lib: deploy: Overriding previous definition of reference to plugin.deps copy-generated-lib: test: [echo] Testing plugin: urlfilter-regex [junit] Running org.apache.nutch.urlfilter.regex.TestRegexURLFilter [junit] Tests run: 1, Failures: 0, Errors: 0, Time elapsed: 2.812 sec init: init-plugin: deps-jar: compile: [echo] Compiling plugin: urlfilter-suffix compile-test: [javac] Compiling 1 source file to http:// lucene.zones.apache.org:8080/hudson/job/Nutch-Nightly/ws/trunk/ build/urlfilter-suffix/test jar: deps-test: deploy: copy-generated-lib: test: [echo] Testing plugin: urlfilter-suffix [junit] Running org.apache.nutch.urlfilter.suffix.TestSuffixURLFilter [junit] Tests run: 6, Failures: 0, Errors: 0, Time elapsed: 0.174 sec init: init-plugin: deps-jar: compile: [echo] Compiling plugin: urlnormalizer-basic compile-test: [javac] Compiling 1 source file to http:// lucene.zones.apache.org:8080/hudson/job/Nutch-Nightly/ws/trunk/ build/urlnormalizer-basic/test jar: deps-test: deploy: copy-generated-lib: test: [echo] Testing plugin: urlnormalizer-basic [junit] Running org.apache.nutch.net.urlnormalizer.basic.TestBasicURLNormalizer [junit] Tests run: 1, Failures: 0, Errors: 0, Time elapsed: 0.024 sec init: init-plugin: deps-jar: compile: [echo] Compiling plugin: urlnormalizer-pass compile-test: [javac] Compiling 1 source file to http:// lucene.zones.apache.org:8080/hudson/job/Nutch-Nightly/ws/trunk/ build/urlnormalizer-pass/test jar: deps-test: deploy: copy-generated-lib: test: [echo] Testing plugin: urlnormalizer-pass [junit] Running org.apache.nutch.net.urlnormalizer.pass.TestPassURLNormalizer [junit] Tests run: 1, Failures: 0, Errors: 0, Time elapsed: 0.15 sec init: init-plugin: deps-jar: compile: [echo] Compiling plugin: urlnormalizer-regex compile-test: [javac] Compiling 1 source file to http:// lucene.zones.apache.org:8080/hudson/job/Nutch-Nightly/ws/trunk/ build/urlnormalizer-regex/test [javac] Note: http://lucene.zones.apache.org:8080/hudson/job/ Nutch-Nightly/ws/trunk/src/plugin/urlnormalizer-regex/src/test/org/ apache/nutch/net/urlnormalizer/regex/TestRegexURLNormalizer.java uses unchecked or unsafe operations. [javac] Note: Recompile with -Xlint:unchecked for details. jar: deps-test: init: init-plugin: compile: jar: deps-test: deploy: copy-generated-lib: deploy: copy-generated-lib: test: [echo] Testing plugin: urlnormalizer-regex [junit] Running org.apache.nutch.net.urlnormalizer.regex.TestRegexURLNormalizer [junit] Tests run: 2, Failures: 0, Errors: 0, Time elapsed: 0.016 sec [junit] Tests run: 1, Failures: 0, Errors: 0, Time elapsed: 7.454 sec BUILD FAILED http://lucene.zones.apache.org:8080/hudson/job/Nutch-Nightly/ws/ trunk/build.xml :302: The following error occurred while executing this line: http://lucene.zones.apache.org:8080/hudson/job/Nutch-Nightly/ws/ trunk/src/plugin/build.xml :98: The following error occurred while executing this line:
