On 6/20/07, Chris Mattmann <[EMAIL PROTECTED]> wrote:
Doğacan,
This is strange indeed. I noticed this during my testing of parse-feed,
however, thought it was an anomaly. I got this same strange cryptic unit
test error message, and then after some frustration figuring it out, I did
ant clean, then ant compile-core test, and miraculously the error seemed to
go away. Also, if you go into $NUTCH/src/plugin/feed/ and run ant clean test
(of course after running ant compile-core from the top-level $NUTCH dir),
the unit tests seem to pass?
[XXX:src/plugin/feed] mattmann% pwd
/Users/mattmann/src/nutch/src/plugin/feed
[XXX:src/plugin/feed] mattmann% ant clean test
Searching for build.xml ...
Buildfile: /Users/mattmann/src/nutch/src/plugin/feed/build.xml
clean:
[delete] Deleting directory /Users/mattmann/src/nutch/build/feed
[delete] Deleting directory /Users/mattmann/src/nutch/build/plugins/feed
init:
[mkdir] Created dir: /Users/mattmann/src/nutch/build/feed
[mkdir] Created dir: /Users/mattmann/src/nutch/build/feed/classes
[mkdir] Created dir: /Users/mattmann/src/nutch/build/feed/test
[mkdir] Created dir: /Users/mattmann/src/nutch/build/feed/test/data
[copy] Copying 1 file to /Users/mattmann/src/nutch/build/feed/test/data
init-plugin:
deps-jar:
compile:
[echo] Compiling plugin: feed
[javac] Compiling 2 source files to
/Users/mattmann/src/nutch/build/feed/classes
compile-test:
[javac] Compiling 1 source file to
/Users/mattmann/src/nutch/build/feed/test
jar:
[jar] Building jar: /Users/mattmann/src/nutch/build/feed/feed.jar
deps-test:
init:
init-plugin:
compile:
jar:
deps-test:
deploy:
copy-generated-lib:
init:
init-plugin:
deps-jar:
compile:
[echo] Compiling plugin: protocol-file
jar:
deps-test:
deploy:
copy-generated-lib:
deploy:
[mkdir] Created dir: /Users/mattmann/src/nutch/build/plugins/feed
[copy] Copying 1 file to /Users/mattmann/src/nutch/build/plugins/feed
copy-generated-lib:
[copy] Copying 1 file to /Users/mattmann/src/nutch/build/plugins/feed
[copy] Copying 2 files to /Users/mattmann/src/nutch/build/plugins/feed
test:
[echo] Testing plugin: feed
[junit] Running org.apache.nutch.parse.feed.TestFeedParser
[junit] Tests run: 1, Failures: 0, Errors: 0, Time elapsed: 0.663 sec
BUILD SUCCESSFUL
Total time: 3 seconds
[XXX:src/plugin/feed] mattmann%
Any ideas?
It never passes for me (not even when I do it in src/plugin/feed). If
you check the output, parseResult only contains a single entry which
is rsstest.rss.
I think what causes this bug is (surprise, surprise) PrefixURLFilter.
We don't have a template for prefix-urlfilter.txt in conf, so it
doesn't get properly initialized and (I can't figure out why but)
randomly filters out stuff.
When I put a sample prefix-urlfilter.txt(*) under conf, all tests seem to pass.
(*) As your friendly neighborhood Nutch developer, I even put up a
sample file at:
http://www.ceng.metu.edu.tr/~e1345172/prefix-urlfilter.txt
Cheers,
Chris
On 6/20/07 6:04 AM, "Doğacan Güney" <[EMAIL PROTECTED]> wrote:
> On 6/20/07, Doğacan Güney <[EMAIL PROTECTED]> wrote:
>
> This is rather
> strange. Here is part of the console output:
>
> test:
> [echo] Testing
> plugin: parse-swf
> [junit] Running
> org.apache.nutch.parse.swf.TestSWFParser
> [junit] Tests run: 1, Failures:
> 0, Errors: 0, Time elapsed: 2.315 sec
> [junit] Tests run: 1, Failures: 1,
> Errors: 0, Time elapsed: 5.387 sec
>
> init:
> [junit] Test
> org.apache.nutch.parse.feed.TestFeedParser FAILED
>
>
> SWFParser fails one of
> the unit tests but the report says that
> FeedParser has failed even though it
> has actually passed its test:
>
> test:
> [echo] Testing plugin: feed
>
> [junit] Running org.apache.nutch.parse.feed.TestFeedParser
> [junit] Tests
> run: 1, Failures: 0, Errors: 0, Time elapsed: 1.304 sec
>
>
(ant test forks
> processes to test code, that's why we are seeing test
outputs out of
> order.)
Anyway, it is not TestSWFParser but TestFeedParser that fails. I
> am
trying to understand why it fails. Chris, can you lend me a hand here?
--
>
Doğacan Güney
______________________________________________
Chris A. Mattmann
[EMAIL PROTECTED]
Key Staff Member
Modeling and Data Management Systems Section (387)
Data Management Systems and Technologies Group
_________________________________________________
Jet Propulsion Laboratory Pasadena, CA
Office: 171-266B Mailstop: 171-246
_______________________________________________________
Disclaimer: The opinions presented within are my own and do not reflect
those of either NASA, JPL, or the California Institute of Technology.
--
Doğacan Güney