[ http://issues.apache.org/jira/browse/NUTCH-258?page=comments#action_12414598 ]
Chris A. Mattmann commented on NUTCH-258: ----------------------------------------- Hi there, I believe that the fetcher halting on a LOG.Severe is the intended behavior of the system. The use of this SEVERE error in Nutch is pretty consistent with Sun's documentation (http://java.sun.com/j2se/1.4.2/docs/guide/util/logging/overview.html#1.2), including its javadoc for JDK 5 (http://java.sun.com/j2se/1.5.0/docs/api/java/util/logging/Level.html). A SEVERE error is defined as "a message level indicating a serious failure.". So I think that in the case of the Fetcher, that this behavior is actually warranted, considering if anything got logged to the SEVERE level, then there was some serious, un-recoverable error while fetching. If you believe that there is an inappropriate use of LOG.severe, however, in the Fetcher, for instance, if an informational message is being logged to the SEVERE level, then that's a separate issue, and please indicate where this is happening, However, as I stated, I believe SEVERE errors causing the fetcher to halt is indeed the intended behavior of Nutch, so, if there are no objections, I would like to close this issue. Thanks, Chris > Once Nutch logs a SEVERE log item, Nutch fails forevermore > ---------------------------------------------------------- > > Key: NUTCH-258 > URL: http://issues.apache.org/jira/browse/NUTCH-258 > Project: Nutch > Type: Bug > Components: fetcher > Versions: 0.8-dev > Environment: All > Reporter: Scott Ganyo > Priority: Critical > Attachments: dumbfix.patch > > Once a SEVERE log item is written, Nutch shuts down any fetching forevermore. > This is from the run() method in Fetcher.java: > public void run() { > synchronized (Fetcher.this) {activeThreads++;} // count threads > > try { > UTF8 key = new UTF8(); > CrawlDatum datum = new CrawlDatum(); > > while (true) { > if (LogFormatter.hasLoggedSevere()) // something bad happened > break; // exit > > Notice the last 2 lines. This will prevent Nutch from ever Fetching again > once this is hit as LogFormatter is storing this data as a static. > (Also note that "LogFormatter.hasLoggedSevere()" is also checked in > org.apache.nutch.net.URLFilterChecker and will disable this class as well.) > This must be fixed or Nutch cannot be run as any kind of long-running > service. Furthermore, I believe it is a poor decision to rely on a logging > event to determine the state of the application - this could have any number > of side-effects that would be extremely difficult to track down. (As it has > already for me.) -- This message is automatically generated by JIRA. - If you think it was sent incorrectly contact one of the administrators: http://issues.apache.org/jira/secure/Administrators.jspa - For more information on JIRA, see: http://www.atlassian.com/software/jira _______________________________________________ Nutch-developers mailing list [email protected] https://lists.sourceforge.net/lists/listinfo/nutch-developers
