Ok, So I was working with nutch a while back and then got sidetracked for about a month and am coming back to it now. I am using Nutch 0.6 and I have a bash script I wrote that calls the basic nutch commands neccessary for a basic "whole-web crawl." As far as I can remember, the script worked fine last time I ran it (about a month ago). However, when I run the script now, it seems like the fetching, db update and indexing ran correctly, but then I start tomcat and go to my search page (thats where things go amok). If I type in a search term that returns zero results, nutch seems to be working correctly and states that my search returned zero results:
Hits *0-0* (out of about 0 total matching pages): However, when I type in a search term that matches one or more pages in my index, I get a completely blank page. Additionally, when this occurs an exception is generated and recorded in my /jakarta-tomcat-4.1.31 /logs/localhost_log.2005-10-24.txt file. Here is the contents of my /jakarta-tomcat-4.1.31/logs/localhost_log.2005- 10-24.txt file when: (i) I start tomcat; and (ii) when I type in a search term that should return 1 or more results, but instead returns a blank page. When I enter a search term that correctly returns zero results, nothing is added to this log file. Any guidance is much appreciated!! -Bryan I. Starting Tomcat 2005-10-24 22:37:23 StandardHost[localhost]: Removing web application at context path /admin 2005-10-24 22:37:23 StandardHost[localhost]: Removing web application at context path /webdav 2005-10-24 22:37:23 StandardHost[localhost]: Removing web application at context path /examples 2005-10-24 22:37:23 StandardHost[localhost]: Removing web application at context path /tomcat-docs 2005-10-24 22:37:23 StandardHost[localhost]: Removing web application at context path /nutch-0.6 2005-10-24 22:37:23 StandardHost[localhost]: Removing web application at context path 2005-10-24 22:37:23 StandardHost[localhost]: Removing web application at context path /manager 2005-10-24 22:37:32 HostConfig[localhost]: Deploying configuration descriptor admin.xml 2005-10-24 22:37:35 HostConfig[localhost]: Deploying configuration descriptor manager.xml 2005-10-24 22:37:35 WebappLoader[/manager]: Deploying class repositories to work directory /usr/local/jakarta-tomcat-4.1.31 /work/Standalone/localhost/manager 2005-10-24 22:37:35 ContextConfig[/manager]: Configured an authenticator for method BASIC 2005-10-24 22:37:35 StandardManager[/manager]: Seeding random number generator class java.security.SecureRandom 2005-10-24 22:37:35 StandardManager[/manager]: Seeding of random number generator has been completed 2005-10-24 22:37:35 StandardWrapper[/manager:default]: Loading container servlet default 2005-10-24 22:37:35 StandardWrapper[/manager:invoker]: Loading container servlet invoker 2005-10-24 22:37:35 HostConfig[localhost]: Expanding web application archive ROOT.war 2005-10-24 22:37:35 StandardHost[localhost]: Installing web application at context path from URL file:/usr/local/jakarta-tomcat-4.1.31/webapps/ROOT 2005-10-24 22:37:35 WebappLoader[]: Deploying class repositories to work directory /usr/local/jakarta-tomcat-4.1.31/work/Standalone/localhost/_ 2005-10-24 22:37:35 WebappLoader[]: Deploy class files /WEB-INF/classes to /usr/local/jakarta-tomcat-4.1.31/webapps/ROOT/WEB-INF/classes 2005-10-24 22:37:35 WebappLoader[]: Deploy JAR /WEB-INF/lib/dom4j-1.4.jar to /usr/local/jakarta-tomcat-4.1.31/webapps/ROOT/WEB-INF/lib/dom4j-1.4.jar 2005-10-24 22:37:35 WebappLoader[]: Deploy JAR /WEB-INF/lib/lucene-1.4.2.jarto /usr/local/jakarta- tomcat-4.1.31/webapps/ROOT/WEB-INF/lib/lucene-1.4.2.jar 2005-10-24 22:37:35 WebappLoader[]: Deploy JAR /WEB-INF/lib/taglibs-i18n.jarto /usr/local/jakarta- tomcat-4.1.31/webapps/ROOT/WEB-INF/lib/taglibs-i18n.jar 2005-10-24 22:37:35 WebappLoader[]: Deploy JAR /WEB-INF/lib/xerces-2_6_2- apis.jar to /usr/local/jakarta-tomcat-4.1.31 /webapps/ROOT/WEB-INF/lib/xerces-2_6_2-apis.jar 2005-10-24 22:37:35 WebappLoader[]: Deploy JAR /WEB-INF/lib/xerces-2_6_2.jar to /usr/local/jakarta-tomcat-4.1.31 /webapps/ROOT/WEB-INF/lib/xerces-2_6_2.jar 2005-10-24 22:37:35 StandardManager[]: Seeding random number generator class java.security.SecureRandom 2005-10-24 22:37:35 StandardManager[]: Seeding of random number generator has been completed 2005-10-24 22:37:35 StandardWrapper[:default]: Loading container servlet default 2005-10-24 22:37:35 StandardWrapper[:invoker]: Loading container servlet invoker 2005-10-24 22:37:35 HostConfig[localhost]: Deploying web application directory tomcat-docs 2005-10-24 22:37:35 StandardHost[localhost]: Installing web application at context path /tomcat-docs from URL file:/usr/local/jakarta-tomcat-4.1.31 /webapps/tomcat-docs 2005-10-24 22:37:35 WebappLoader[/tomcat-docs]: Deploying class repositories to work directory /usr/local/jakarta-tomcat-4.1.31 /work/Standalone/localhost/tomcat-docs 2005-10-24 22:37:35 StandardManager[/tomcat-docs]: Seeding random number generator class java.security.SecureRandom 2005-10-24 22:37:35 StandardManager[/tomcat-docs]: Seeding of random number generator has been completed 2005-10-24 22:37:35 StandardWrapper[/tomcat-docs:default]: Loading container servlet default 2005-10-24 22:37:35 StandardWrapper[/tomcat-docs:invoker]: Loading container servlet invoker 2005-10-24 22:37:35 HostConfig[localhost]: Deploying web application directory webdav 2005-10-24 22:37:35 StandardHost[localhost]: Installing web application at context path /webdav from URL file:/usr/local/jakarta-tomcat-4.1.31 /webapps/webdav 2005-10-24 22:37:35 WebappLoader[/webdav]: Deploying class repositories to work directory /usr/local/jakarta-tomcat-4.1.31 /work/Standalone/localhost/webdav 2005-10-24 22:37:35 StandardManager[/webdav]: Seeding random number generator class java.security.SecureRandom 2005-10-24 22:37:35 StandardManager[/webdav]: Seeding of random number generator has been completed 2005-10-24 22:37:35 StandardWrapper[/webdav:default]: Loading container servlet default 2005-10-24 22:37:35 StandardWrapper[/webdav:invoker]: Loading container servlet invoker 2005-10-24 22:37:35 HostConfig[localhost]: Deploying web application directory nutch-0.6 2005-10-24 22:37:35 StandardHost[localhost]: Installing web application at context path /nutch-0.6 from URL file:/usr/local/jakarta-tomcat-4.1.31 /webapps/nutch-0.6 2005-10-24 22:37:35 WebappLoader[/nutch-0.6]: Deploying class repositories to work directory /usr/local/jakarta-tomcat-4.1.31 /work/Standalone/localhost/nutch-0.6 2005-10-24 22:37:35 WebappLoader[/nutch-0.6]: Deploy class files /WEB-INF/classes to /usr/local/jakarta-tomcat-4.1.31/webapps/nutch-0.6 /WEB-INF/classes 2005-10-24 22:37:35 WebappLoader[/nutch-0.6]: Deploy JAR /WEB-INF/lib/dom4j- 1.4.jar to /usr/local/jakarta-tomcat-4.1.31/webapps/nutch-0.6 /WEB-INF/lib/dom4j-1.4.jar 2005-10-24 22:37:35 WebappLoader[/nutch-0.6]: Deploy JAR /WEB-INF/lib/lucene-1.4.2.jar to /usr/local/jakarta-tomcat-4.1.31 /webapps/nutch-0.6/WEB-INF/lib/lucene-1.4.2.jar 2005-10-24 22:37:35 WebappLoader[/nutch-0.6]: Deploy JAR /WEB-INF/lib/nutch- 0.6.jar to /usr/local/jakarta-tomcat-4.1.31/webapps/nutch-0.6 /WEB-INF/lib/nutch-0.6.jar 2005-10-24 22:37:35 WebappLoader[/nutch-0.6]: Deploy JAR /WEB-INF/lib/taglibs-i18n.jar to /usr/local/jakarta-tomcat-4.1.31 /webapps/nutch-0.6/WEB-INF/lib/taglibs-i18n.jar 2005-10-24 22:37:35 WebappLoader[/nutch-0.6]: Deploy JAR /WEB-INF/lib/xerces-2_6_2-apis.jar to /usr/local/jakarta-tomcat-4.1.31 /webapps/nutch-0.6/WEB-INF/lib/xerces-2_6_2-apis.jar 2005-10-24 22:37:35 WebappLoader[/nutch-0.6]: Deploy JAR /WEB-INF/lib/xerces-2_6_2.jar to /usr/local/jakarta-tomcat-4.1.31 /webapps/nutch-0.6/WEB-INF/lib/xerces-2_6_2.jar 2005-10-24 22:37:35 StandardManager[/nutch-0.6]: Seeding random number generator class java.security.SecureRandom 2005-10-24 22:37:35 StandardManager[/nutch-0.6]: Seeding of random number generator has been completed 2005-10-24 22:37:35 StandardWrapper[/nutch-0.6:default]: Loading container servlet default 2005-10-24 22:37:35 StandardWrapper[/nutch-0.6:invoker]: Loading container servlet invoker II. When I type in a search term that should return 1 or more results, but instead returns a blank page org.apache.jasper.JasperException at org.apache.jasper.servlet.JspServletWrapper.service( JspServletWrapper.java:207) at org.apache.jasper.servlet.JspServlet.serviceJspFile(JspServlet.java:240) at org.apache.jasper.servlet.JspServlet.service(JspServlet.java:187) at javax.servlet.http.HttpServlet.service(HttpServlet.java:809) at org.apache.catalina.core.ApplicationFilterChain.internalDoFilter( ApplicationFilterChain.java:200) at org.apache.catalina.core.ApplicationFilterChain.doFilter( ApplicationFilterChain.java:146) at org.apache.catalina.core.StandardWrapperValve.invoke( StandardWrapperValve.java:209) at org.apache.catalina.core.StandardPipeline$StandardPipelineValveContext.invokeNext (StandardPipeline.java:596) at org.apache.catalina.core.StandardPipeline.invoke(StandardPipeline.java :433) at org.apache.catalina.core.ContainerBase.invoke(ContainerBase.java:948) at org.apache.catalina.core.StandardContextValve.invoke( StandardContextValve.java:144) at org.apache.catalina.core.StandardPipeline$StandardPipelineValveContext.invokeNext (StandardPipeline.java:596) at org.apache.catalina.core.StandardPipeline.invoke(StandardPipeline.java :433) at org.apache.catalina.core.ContainerBase.invoke(ContainerBase.java:948) at org.apache.catalina.core.StandardContext.invoke(StandardContext.java :2358) at org.apache.catalina.core.StandardHostValve.invoke(StandardHostValve.java :133) at org.apache.catalina.core.StandardPipeline$StandardPipelineValveContext.invokeNext (StandardPipeline.java:596) at org.apache.catalina.valves.ErrorDispatcherValve.invoke( ErrorDispatcherValve.java:118) at org.apache.catalina.core.StandardPipeline$StandardPipelineValveContext.invokeNext (StandardPipeline.java:594) at org.apache.catalina.valves.ErrorReportValve.invoke(ErrorReportValve.java:116) at org.apache.catalina.core.StandardPipeline$StandardPipelineValveContext.invokeNext (StandardPipeline.java:594) at org.apache.catalina.core.StandardPipeline.invoke(StandardPipeline.java :433) at org.apache.catalina.core.ContainerBase.invoke(ContainerBase.java:948) at org.apache.catalina.core.StandardEngineValve.invoke( StandardEngineValve.java:127) at org.apache.catalina.core.StandardPipeline$StandardPipelineValveContext.invokeNext (StandardPipeline.java:596) at org.apache.catalina.core.StandardPipeline.invoke(StandardPipeline.java :433) at org.apache.catalina.core.ContainerBase.invoke(ContainerBase.java:948) at org.apache.coyote.tomcat4.CoyoteAdapter.service(CoyoteAdapter.java:152) at org.apache.coyote.http11.Http11Processor.process(Http11Processor.java :799) at org.apache.coyote.http11.Http11Protocol$Http11ConnectionHandler.processConnection (Http11Protocol.java:705) at org.apache.tomcat.util.net.TcpWorkerThread.runIt(PoolTcpEndpoint.java:577) at org.apache.tomcat.util.threads.ThreadPool$ControlRunnable.run( ThreadPool.java:683) at java.lang.Thread.run(Thread.java:534) ----- Root Cause ----- java.lang.NullPointerException at net.nutch.searcher.FetchedSegments.getSummary(FetchedSegments.java:131) at net.nutch.searcher.FetchedSegments.getSummary(FetchedSegments.java:140) at net.nutch.searcher.NutchBean.getSummary(NutchBean.java:236) at org.apache.jsp.search_jsp._jspService(search_jsp.java:261) at org.apache.jasper.runtime.HttpJspBase.service(HttpJspBase.java:92) at javax.servlet.http.HttpServlet.service(HttpServlet.java:809) at org.apache.jasper.servlet.JspServletWrapper.service( JspServletWrapper.java:162) at org.apache.jasper.servlet.JspServlet.serviceJspFile(JspServlet.java:240) at org.apache.jasper.servlet.JspServlet.service(JspServlet.java:187) at javax.servlet.http.HttpServlet.service(HttpServlet.java:809) at org.apache.catalina.core.ApplicationFilterChain.internalDoFilter( ApplicationFilterChain.java:200) at org.apache.catalina.core.ApplicationFilterChain.doFilter( ApplicationFilterChain.java:146) at org.apache.catalina.core.StandardWrapperValve.invoke( StandardWrapperValve.java:209) at org.apache.catalina.core.StandardPipeline$StandardPipelineValveContext.invokeNext (StandardPipeline.java:596) at org.apache.catalina.core.StandardPipeline.invoke(StandardPipeline.java :433) at org.apache.catalina.core.ContainerBase.invoke(ContainerBase.java:948) at org.apache.catalina.core.StandardContextValve.invoke( StandardContextValve.java:144) at org.apache.catalina.core.StandardPipeline$StandardPipelineValveContext.invokeNext (StandardPipeline.java:596) at org.apache.catalina.core.StandardPipeline.invoke(StandardPipeline.java :433) at org.apache.catalina.core.ContainerBase.invoke(ContainerBase.java:948) at org.apache.catalina.core.StandardContext.invoke(StandardContext.java :2358) at org.apache.catalina.core.StandardHostValve.invoke(StandardHostValve.java :133) at org.apache.catalina.core.StandardPipeline$StandardPipelineValveContext.invokeNext (StandardPipeline.java:596) at org.apache.catalina.valves.ErrorDispatcherValve.invoke( ErrorDispatcherValve.java:118) at org.apache.catalina.core.StandardPipeline$StandardPipelineValveContext.invokeNext (StandardPipeline.java:594) at org.apache.catalina.valves.ErrorReportValve.invoke(ErrorReportValve.java :116) at org.apache.catalina.core.StandardPipeline$StandardPipelineValveContext.invokeNext (StandardPipeline.java:594) at org.apache.catalina.core.StandardPipeline.invoke(StandardPipeline.java :433) at org.apache.catalina.core.ContainerBase.invoke(ContainerBase.java:948) at org.apache.catalina.core.StandardEngineValve.invoke( StandardEngineValve.java:127) at org.apache.catalina.core.StandardPipeline$StandardPipelineValveContext.invokeNext (StandardPipeline.java:596) at org.apache.catalina.core.StandardPipeline.invoke(StandardPipeline.java :433) at org.apache.catalina.core.ContainerBase.invoke(ContainerBase.java:948) at org.apache.coyote.tomcat4.CoyoteAdapter.service(CoyoteAdapter.java:152) at org.apache.coyote.http11.Http11Processor.process(Http11Processor.java :799) at org.apache.coyote.http11.Http11Protocol$Http11ConnectionHandler.processConnection (Http11Protocol.java:705) at org.apache.tomcat.util.net.TcpWorkerThread.runIt(PoolTcpEndpoint.java:577) at org.apache.tomcat.util.threads.ThreadPool$ControlRunnable.run( ThreadPool.java:683) at java.lang.Thread.run(Thread.java:534)
