Re: [Nutch-dev] bug in tutorial or fetcher?

Doug Cutting Mon, 17 May 2004 13:22:07 -0700

In a multi-threaded application like the fetcher you cannot throw an exception to stop processing, nor is it polite to exit() the JVM. So the log level SEVERE is used for fatal errors, and the fetcher checks hasLoggedSevere() do decide if it should exit.

Stefan Groschupf wrote:

Hi,

sorry i fixed the problem. It was a LOG.servere call in some lines code i had add. But I still do not understand what the Log.servere and hasLoggedSevere means. Can someone give me a hint whats the concept behind that? Thanks a lot!


Stefan


Am 16.05.2004 um 01:10 schrieb Stefan Groschupf:

    Hi nutch developer,

    I'm may be wrong but there is a bug in the fetcher and the tutorial.
    I spend around 5 hours today to search for a solution.

    In case I run the intranet tutorial with depth of 10 there will be a
    url link included:
    http://www.nutch.org/conf/nutch-default.xml
    Since this is no known content type a IOException will be thrown. (I
    was wondering why here is a IOException used, since in the
    OutPutThread is a UnknownContentTypeException)

    I do not understand following lines code in the Fetcher.java.

    if (LogFormatter.hasLoggedSevere())

    throw new RuntimeException("SEVERE error logged. Exiting fetcher.");

    Can someone please tell me what this do? Why a LogFormatter handle
    any Logic of the Fetcher????

    I ad tried to catch the IOException but still the RuntimeException
    will be thrown and the crawling stop.

    Thanks for any hints,
    Stefan


    ---------------------------------------------------------------
    open technology: http://www.media-style.com
    open source: http://www.weta-group.net
    open discussion: http://www.text-mining.org

---------------------------------------------------------------
open technology: http://www.media-style.com
open source: http://www.weta-group.net
open discussion: http://www.text-mining.org

-------------------------------------------------------
This SF.Net email is sponsored by: SourceForge.net Broadband
Sign-up now for SourceForge Broadband and get the fastest
6.0/768 connection for only $19.95/mo for the first 3 months!
http://ads.osdn.com/?ad_id=2562&alloc_id=6184&op=click
_______________________________________________
Nutch-developers mailing list
[EMAIL PROTECTED]
https://lists.sourceforge.net/lists/listinfo/nutch-developers

Re: [Nutch-dev] bug in tutorial or fetcher?

Reply via email to