Hi,
I am working on Nutch-0.9, and trying to enable Ontology plug-in.
Changes I made to existing Nutch to enable Ontology Plug-in are as
fallows,
1)Added 'ontology' to property 'plugin.includes' in
nutch-0.9\conf\nutch-site.xml
<name>plugin.includes</name>
<value>recommended|ontology|protocol-http|urlfilter-regex|parse-(text|html|js|mspowerpoint)|index-(basic|more)|query-(basic|site|url)|summary-basic|scoring-opic|urlnormalizer-(pass|regex|basic)</value>
2)Uncommented refine-query-init.jsp and refine-query.jsp in search.jsp
3)specify url(s) of owl files to property extension.ontology.urls in
./conf/nutch-default.xml
4)inserted the following to ./bin/nutch:
elif [ "$COMMAND" = "ontology" ] ; then
for f in $NUTCH_HOME/build/plugins/ontology/*.jar; do
CLASSPATH=${CLASSPATH}:$f;
done
CLASS='org.apache.nutch.ontology.OntologyImpl'
Error I faced is as follows:
An error occurred at line: 32 in the jsp file: /./refine-query-init.jsp
Duplicate local variable nutchConf
29: // being loaded into the JVM. Need improvement in future.
30:
31: try {
32: Configuration nutchConf = NutchConfiguration.get(application);
33: String urls = nutchConf.get("extension.ontology.urls");
34: ontology = new
org.apache.nutch.ontology.OntologyFactory(nutchConf).getOntology();
35: if (urls==null || urls.trim().equals("")) {
//Configuration nutchConf = NutchConfiguration.get(application);
When commented the line 32 in refine-query-init.jsp as above, the
following warnings are seen (and the search didnot implement Ontology.)
logyImpl.load(OntologyImpl.java:101)
2008-04-03 13:20:32,265 WARN OwlParser - at
org.apache.jsp.search_jsp._jspServi
ce(search_jsp.java:136)
2008-04-03 13:20:32,265 WARN OwlParser - at
org.apache.jasper.runtime.HttpJspBa
se.service(HttpJspBase.java:70)
2008-04-03 13:20:32,265 WARN OwlParser - at
javax.servlet.http.HttpServlet.serv
ice(HttpServlet.java:803)
2008-04-03 13:20:32,265 WARN OwlParser - at
org.apache.jasper.servlet.JspServle
tWrapper.service(JspServletWrapper.java:393)
2008-04-03 13:20:32,265 WARN OwlParser - at
org.apache.jasper.servlet.JspServle
t.serviceJspFile(JspServlet.java:320)
2008-04-03 13:20:32,265 WARN OwlParser - at
org.apache.jasper.servlet.JspServle
t.service(JspServlet.java:266)
2008-04-03 13:20:32,265 WARN OwlParser - at
javax.servlet.http.HttpServlet.serv
ice(HttpServlet.java:803)
2008-04-03 13:20:32,265 WARN OwlParser - at
org.apache.catalina.core.Applicatio
nFilterChain.internalDoFilter(ApplicationFilterChain.java:290)
2008-04-03 13:20:32,265 WARN OwlParser - at
org.apache.catalina.core.Applicatio
nFilterChain.doFilter(ApplicationFilterChain.java:206)
2008-04-03 13:20:32,265 WARN OwlParser - at
org.apache.catalina.core.StandardWr
apperValve.invoke(StandardWrapperValve.java:230)
2008-04-03 13:20:32,265 WARN OwlParser - at
org.apache.catalina.core.StandardCo
ntextValve.invoke(StandardContextValve.java:175)
2008-04-03 13:20:32,265 WARN OwlParser - at
org.apache.catalina.core.StandardHo
stValve.invoke(StandardHostValve.java:128)
2008-04-03 13:20:32,265 WARN OwlParser - at
org.apache.catalina.valves.ErrorRep
ortValve.invoke(ErrorReportValve.java:104)
2008-04-03 13:20:32,265 WARN OwlParser - at
org.apache.catalina.core.StandardEn
gineValve.invoke(StandardEngineValve.java:109)
2008-04-03 13:20:32,265 WARN OwlParser - at
org.apache.catalina.connector.Coyot
eAdapter.service(CoyoteAdapter.java:261)
2008-04-03 13:20:32,265 WARN OwlParser - at
org.apache.coyote.http11.Http11Proc
essor.process(Http11Processor.java:844)
2008-04-03 13:20:32,265 WARN OwlParser - at
org.apache.coyote.http11.Http11Prot
ocol$Http11ConnectionHandler.process(Http11Protocol.java:581)
2008-04-03 13:20:32,265 WARN OwlParser - at
org.apache.tomcat.util.net.JIoEndpo
int$Worker.run(JIoEndpoint.java:447)
2008-04-03 13:20:32,265 WARN OwlParser - at
java.lang.Thread.run(Thread.java:61
9)
2008-04-03 13:20:32,265 WARN OwlParser -
com.hp.hpl.jena.ontology.ConversionExc
eption: Cannot convert node
http://161.6.105.103:8084/testontology/time.owl#Seas
on to OntClass
2008-04-03 13:20:32,265 WARN OwlParser - at
com.hp.hpl.jena.ontology.impl.OntCl
assImpl$1.wrap(OntClassImpl.java:73)
2008-04-03 13:20:32,265 WARN OwlParser - at
com.hp.hpl.jena.enhanced.EnhNode.co
nvertTo(EnhNode.java:113)
2008-04-03 13:20:32,265 WARN OwlParser - at
com.hp.hpl.jena.enhanced.Polymorphi
c.asInternal(Polymorphic.java:65)
2008-04-03 13:20:32,265 WARN OwlParser - at
com.hp.hpl.jena.enhanced.EnhNode.vi
ewAs(EnhNode.java:64)
2008-04-03 13:20:32,265 WARN OwlParser - at
com.hp.hpl.jena.enhanced.EnhNode.as
(EnhNode.java:69)
2008-04-03 13:20:32,265 WARN OwlParser - at
com.hp.hpl.jena.ontology.impl.OntRe
sourceImpl$ObjectAsMapper.map1(OntResourceImpl.java:1357)
2008-04-03 13:20:32,265 WARN OwlParser - at
com.hp.hpl.jena.util.iterator.Map1I
terator.next(Map1Iterator.java:33)
2008-04-03 13:20:32,265 WARN OwlParser - at
com.hp.hpl.jena.util.iterator.Wrapp
edIterator.next(WrappedIterator.java:42)
2008-04-03 13:20:32,265 WARN OwlParser - at
com.hp.hpl.jena.util.iterator.Filte
rIterator.hasNext(FilterIterator.java:63)
2008-04-03 13:20:32,265 WARN OwlParser - at
com.hp.hpl.jena.util.iterator.Wrapp
edIterator.hasNext(WrappedIterator.java:38)
2008-04-03 13:20:32,265 WARN OwlParser - at
com.hp.hpl.jena.util.iterator.Uniqu
eExtendedIterator.hasNext(UniqueExtendedIterator.java:69)
2008-04-03 13:20:32,265 WARN OwlParser - at
com.hp.hpl.jena.util.ResourceUtils.
maximalLowerElements(ResourceUtils.java:100)
2008-04-03 13:20:32,265 WARN OwlParser - at
com.hp.hpl.jena.ontology.impl.OntCl
assImpl.hasSuperClassDirect(OntClassImpl.java:798)
2008-04-03 13:20:32,265 WARN OwlParser - at
com.hp.hpl.jena.ontology.impl.OntCl
assImpl.hasSuperClass(OntClassImpl.java:236)
2008-04-03 13:20:32,265 WARN OwlParser - at
org.apache.nutch.ontology.jena.OwlP
arser.rootClasses(OwlParser.java:128)
2008-04-03 13:20:32,265 WARN OwlParser - at
org.apache.nutch.ontology.jena.OwlP
arser.parse(OwlParser.java:53)
2008-04-03 13:20:32,265 WARN OwlParser - at
org.apache.nutch.ontology.jena.Onto
logyImpl.load(OntologyImpl.java:101)
2008-04-03 13:20:32,265 WARN OwlParser - at
org.apache.jsp.search_jsp._jspServi
ce(search_jsp.java:136)
2008-04-03 13:20:32,265 WARN OwlParser - at
org.apache.jasper.runtime.HttpJspBa
se.service(HttpJspBase.java:70)
2008-04-03 13:20:32,265 WARN OwlParser - at
javax.servlet.http.HttpServlet.serv
ice(HttpServlet.java:803)
2008-04-03 13:20:32,265 WARN OwlParser - at
org.apache.jasper.servlet.JspServle
tWrapper.service(JspServletWrapper.java:393)
2008-04-03 13:20:32,265 WARN OwlParser - at
org.apache.jasper.servlet.JspServle
t.serviceJspFile(JspServlet.java:320)
2008-04-03 13:20:32,265 WARN OwlParser - at
org.apache.jasper.servlet.JspServle
t.service(JspServlet.java:266)
2008-04-03 13:20:32,265 WARN OwlParser - at
javax.servlet.http.HttpServlet.serv
ice(HttpServlet.java:803)
2008-04-03 13:20:32,265 WARN OwlParser - at
org.apache.catalina.core.Applicatio
nFilterChain.internalDoFilter(ApplicationFilterChain.java:290)
2008-04-03 13:20:32,265 WARN OwlParser - at
org.apache.catalina.core.Applicatio
nFilterChain.doFilter(ApplicationFilterChain.java:206)
2008-04-03 13:20:32,265 WARN OwlParser - at
org.apache.catalina.core.StandardWr
apperValve.invoke(StandardWrapperValve.java:230)
2008-04-03 13:20:32,265 WARN OwlParser - at
org.apache.catalina.core.StandardCo
ntextValve.invoke(StandardContextValve.java:175)
2008-04-03 13:20:32,265 WARN OwlParser - at
org.apache.catalina.core.StandardHo
stValve.invoke(StandardHostValve.java:128)
2008-04-03 13:20:32,265 WARN OwlParser - at
org.apache.catalina.valves.ErrorRep
ortValve.invoke(ErrorReportValve.java:104)
2008-04-03 13:20:32,265 WARN OwlParser - at
org.apache.catalina.core.StandardEn
gineValve.invoke(StandardEngineValve.java:109)
2008-04-03 13:20:32,265 WARN OwlParser - at
org.apache.catalina.connector.Coyot
eAdapter.service(CoyoteAdapter.java:261)
2008-04-03 13:20:32,265 WARN OwlParser - at
org.apache.coyote.http11.Http11Proc
essor.process(Http11Processor.java:844)
2008-04-03 13:20:32,265 WARN OwlParser - at
org.apache.coyote.http11.Http11Prot
ocol$Http11ConnectionHandler.process(Http11Protocol.java:581)
2008-04-03 13:20:32,265 WARN OwlParser - at
org.apache.tomcat.util.net.JIoEndpo
int$Worker.run(JIoEndpoint.java:447)
2008-04-03 13:20:32,265 WARN OwlParser - at
java.lang.Thread.run(Thread.java:61
9)
2008-04-03 13:20:32,265 WARN OwlParser -
com.hp.hpl.jena.ontology.ConversionExc
eption: Cannot convert node
http://161.6.105.103:8084/testontology/time.owl#Seas
on to OntClass
2008-04-03 13:20:32,265 WARN OwlParser - at
com.hp.hpl.jena.ontology.impl.OntCl
assImpl$1.wrap(OntClassImpl.java:73)
2008-04-03 13:20:32,265 WARN OwlParser - at
com.hp.hpl.jena.enhanced.EnhNode.co
nvertTo(EnhNode.java:113)
2008-04-03 13:20:32,265 WARN OwlParser - at
com.hp.hpl.jena.enhanced.Polymorphi
c.asInternal(Polymorphic.java:65)
2008-04-03 13:20:32,265 WARN OwlParser - at
com.hp.hpl.jena.enhanced.EnhNode.vi
ewAs(EnhNode.java:64)
2008-04-03 13:20:32,265 WARN OwlParser - at
com.hp.hpl.jena.enhanced.EnhNode.as
(EnhNode.java:69)
2008-04-03 13:20:32,265 WARN OwlParser - at
com.hp.hpl.jena.ontology.impl.OntRe
sourceImpl$ObjectAsMapper.map1(OntResourceImpl.java:1357)
2008-04-03 13:20:32,265 WARN OwlParser - at
com.hp.hpl.jena.util.iterator.Map1I
terator.next(Map1Iterator.java:33)
2008-04-03 13:20:32,265 WARN OwlParser - at
com.hp.hpl.jena.util.iterator.Wrapp
edIterator.next(WrappedIterator.java:42)
2008-04-03 13:20:32,265 WARN OwlParser - at
com.hp.hpl.jena.util.iterator.Filte
rIterator.hasNext(FilterIterator.java:63)
2008-04-03 13:20:32,265 WARN OwlParser - at
com.hp.hpl.jena.util.iterator.Wrapp
edIterator.hasNext(WrappedIterator.java:38)
2008-04-03 13:20:32,265 WARN OwlParser - at
com.hp.hpl.jena.util.iterator.Uniqu
eExtendedIterator.hasNext(UniqueExtendedIterator.java:69)
2008-04-03 13:20:32,265 WARN OwlParser - at
com.hp.hpl.jena.util.ResourceUtils.
maximalLowerElements(ResourceUtils.java:100)
2008-04-03 13:20:32,265 WARN OwlParser - at
com.hp.hpl.jena.ontology.impl.OntCl
assImpl.hasSuperClassDirect(OntClassImpl.java:798)
2008-04-03 13:20:32,265 WARN OwlParser - at
com.hp.hpl.jena.ontology.impl.OntCl
assImpl.hasSuperClass(OntClassImpl.java:236)
2008-04-03 13:20:32,265 WARN OwlParser - at
org.apache.nutch.ontology.jena.OwlP
arser.rootClasses(OwlParser.java:128)
2008-04-03 13:20:32,265 WARN OwlParser - at
org.apache.nutch.ontology.jena.OwlP
arser.parse(OwlParser.java:53)
2008-04-03 13:20:32,265 WARN OwlParser - at
org.apache.nutch.ontology.jena.Onto
logyImpl.load(OntologyImpl.java:101)
2008-04-03 13:20:32,265 WARN OwlParser - at
org.apache.jsp.search_jsp._jspServi
ce(search_jsp.java:136)
2008-04-03 13:20:32,265 WARN OwlParser - at
org.apache.jasper.runtime.HttpJspBa
se.service(HttpJspBase.java:70)
2008-04-03 13:20:32,265 WARN OwlParser - at
javax.servlet.http.HttpServlet.serv
ice(HttpServlet.java:803)
2008-04-03 13:20:32,265 WARN OwlParser - at
org.apache.jasper.servlet.JspServle
tWrapper.service(JspServletWrapper.java:393)
2008-04-03 13:20:32,265 WARN OwlParser - at
org.apache.jasper.servlet.JspServle
t.serviceJspFile(JspServlet.java:320)
2008-04-03 13:20:32,265 WARN OwlParser - at
org.apache.jasper.servlet.JspServle
t.service(JspServlet.java:266)
2008-04-03 13:20:32,265 WARN OwlParser - at
javax.servlet.http.HttpServlet.serv
ice(HttpServlet.java:803)
2008-04-03 13:20:32,265 WARN OwlParser - at
org.apache.catalina.core.Applicatio
nFilterChain.internalDoFilter(ApplicationFilterChain.java:290)
2008-04-03 13:20:32,265 WARN OwlParser - at
org.apache.catalina.core.Applicatio
nFilterChain.doFilter(ApplicationFilterChain.java:206)
2008-04-03 13:20:32,265 WARN OwlParser - at
org.apache.catalina.core.StandardWr
apperValve.invoke(StandardWrapperValve.java:230)
2008-04-03 13:20:32,265 WARN OwlParser - at
org.apache.catalina.core.StandardCo
ntextValve.invoke(StandardContextValve.java:175)
2008-04-03 13:20:32,265 WARN OwlParser - at
org.apache.catalina.core.StandardHo
stValve.invoke(StandardHostValve.java:128)
2008-04-03 13:20:32,265 WARN OwlParser - at
org.apache.catalina.valves.ErrorRep
ortValve.invoke(ErrorReportValve.java:104)
2008-04-03 13:20:32,265 WARN OwlParser - at
org.apache.catalina.core.StandardEn
gineValve.invoke(StandardEngineValve.java:109)
2008-04-03 13:20:32,265 WARN OwlParser - at
org.apache.catalina.connector.Coyot
eAdapter.service(CoyoteAdapter.java:261)
2008-04-03 13:20:32,265 WARN OwlParser - at
org.apache.coyote.http11.Http11Proc
essor.process(Http11Processor.java:844)
2008-04-03 13:20:32,265 WARN OwlParser - at
org.apache.coyote.http11.Http11Prot
ocol$Http11ConnectionHandler.process(Http11Protocol.java:581)
2008-04-03 13:20:32,265 WARN OwlParser - at
org.apache.tomcat.util.net.JIoEndpo
int$Worker.run(JIoEndpoint.java:447)
2008-04-03 13:20:32,265 WARN OwlParser - at
java.lang.Thread.run(Thread.java:61
9)
2008-04-03 13:20:32,265 WARN OwlParser -
com.hp.hpl.jena.ontology.ConversionExc
eption: Cannot convert node
http://161.6.105.103:8084/testontology/time.owl#Seas
on to OntClass
2008-04-03 13:20:32,265 WARN OwlParser - at
com.hp.hpl.jena.ontology.impl.OntCl
assImpl$1.wrap(OntClassImpl.java:73)
2008-04-03 13:20:32,265 WARN OwlParser - at
com.hp.hpl.jena.enhanced.EnhNode.co
nvertTo(EnhNode.java:113)
2008-04-03 13:20:32,281 WARN OwlParser - at
com.hp.hpl.jena.enhanced.Polymorphi
c.asInternal(Polymorphic.java:65)
2008-04-03 13:20:32,281 WARN OwlParser - at
com.hp.hpl.jena.enhanced.EnhNode.vi
ewAs(EnhNode.java:64)
2008-04-03 13:20:32,281 WARN OwlParser - at
com.hp.hpl.jena.enhanced.EnhNode.as
(EnhNode.java:69)
2008-04-03 13:20:32,281 WARN OwlParser - at
com.hp.hpl.jena.ontology.impl.OntRe
sourceImpl$ObjectAsMapper.map1(OntResourceImpl.java:1357)
2008-04-03 13:20:32,281 WARN OwlParser - at
com.hp.hpl.jena.util.iterator.Map1I
terator.next(Map1Iterator.java:33)
2008-04-03 13:20:32,281 WARN OwlParser - at
com.hp.hpl.jena.util.iterator.Wrapp
edIterator.next(WrappedIterator.java:42)
2008-04-03 13:20:32,281 WARN OwlParser - at
com.hp.hpl.jena.util.iterator.Filte
rIterator.hasNext(FilterIterator.java:63)
2008-04-03 13:20:32,281 WARN OwlParser - at
com.hp.hpl.jena.util.iterator.Wrapp
edIterator.hasNext(WrappedIterator.java:38)
2008-04-03 13:20:32,281 WARN OwlParser - at
com.hp.hpl.jena.util.iterator.Uniqu
eExtendedIterator.hasNext(UniqueExtendedIterator.java:69)
2008-04-03 13:20:32,281 WARN OwlParser - at
com.hp.hpl.jena.util.ResourceUtils.
maximalLowerElements(ResourceUtils.java:100)
2008-04-03 13:20:32,281 WARN OwlParser - at
com.hp.hpl.jena.ontology.impl.OntCl
assImpl.hasSuperClassDirect(OntClassImpl.java:798)
2008-04-03 13:20:32,281 WARN OwlParser - at
com.hp.hpl.jena.ontology.impl.OntCl
assImpl.hasSuperClass(OntClassImpl.java:236)
2008-04-03 13:20:32,281 WARN OwlParser - at
org.apache.nutch.ontology.jena.OwlP
arser.rootClasses(OwlParser.java:128)
2008-04-03 13:20:32,281 WARN OwlParser - at
org.apache.nutch.ontology.jena.OwlP
arser.parse(OwlParser.java:53)
2008-04-03 13:20:32,281 WARN OwlParser - at
org.apache.nutch.ontology.jena.Onto
logyImpl.load(OntologyImpl.java:101)
2008-04-03 13:20:32,281 WARN OwlParser - at
org.apache.jsp.search_jsp._jspServi
ce(search_jsp.java:136)
2008-04-03 13:20:32,281 WARN OwlParser - at
org.apache.jasper.runtime.HttpJspBa
se.service(HttpJspBase.java:70)
2008-04-03 13:20:32,281 WARN OwlParser - at
javax.servlet.http.HttpServlet.serv
ice(HttpServlet.java:803)
2008-04-03 13:20:32,281 WARN OwlParser - at
org.apache.jasper.servlet.JspServle
tWrapper.service(JspServletWrapper.java:393)
2008-04-03 13:20:32,281 WARN OwlParser - at
org.apache.jasper.servlet.JspServle
t.serviceJspFile(JspServlet.java:320)
2008-04-03 13:20:32,281 WARN OwlParser - at
org.apache.jasper.servlet.JspServle
t.service(JspServlet.java:266)
2008-04-03 13:20:32,281 WARN OwlParser - at
javax.servlet.http.HttpServlet.serv
ice(HttpServlet.java:803)
2008-04-03 13:20:32,281 WARN OwlParser - at
org.apache.catalina.core.Applicatio
nFilterChain.internalDoFilter(ApplicationFilterChain.java:290)
2008-04-03 13:20:32,281 WARN OwlParser - at
org.apache.catalina.core.Applicatio
nFilterChain.doFilter(ApplicationFilterChain.java:206)
2008-04-03 13:20:32,281 WARN OwlParser - at
org.apache.catalina.core.StandardWr
apperValve.invoke(StandardWrapperValve.java:230)
2008-04-03 13:20:32,281 WARN OwlParser - at
org.apache.catalina.core.StandardCo
ntextValve.invoke(StandardContextValve.java:175)
2008-04-03 13:20:32,281 WARN OwlParser - at
org.apache.catalina.core.StandardHo
stValve.invoke(StandardHostValve.java:128)
2008-04-03 13:20:32,281 WARN OwlParser - at
org.apache.catalina.valves.ErrorRep
ortValve.invoke(ErrorReportValve.java:104)
2008-04-03 13:20:32,281 WARN OwlParser - at
org.apache.catalina.core.StandardEn
gineValve.invoke(StandardEngineValve.java:109)
2008-04-03 13:20:32,281 WARN OwlParser - at
org.apache.catalina.connector.Coyot
eAdapter.service(CoyoteAdapter.java:261)
2008-04-03 13:20:32,281 WARN OwlParser - at
org.apache.coyote.http11.Http11Proc
essor.process(Http11Processor.java:844)
2008-04-03 13:20:32,281 WARN OwlParser - at
org.apache.coyote.http11.Http11Prot
ocol$Http11ConnectionHandler.process(Http11Protocol.java:581)
2008-04-03 13:20:32,281 WARN OwlParser - at
org.apache.tomcat.util.net.JIoEndpo
int$Worker.run(JIoEndpoint.java:447)
2008-04-03 13:20:32,281 WARN OwlParser - at
java.lang.Thread.run(Thread.java:61
9)
2008-04-03 13:20:32,296 INFO NutchBean - creating new bean
2008-04-03 13:20:32,312 INFO NutchBean - opening merged index in
c:/nutch-0.9/c
rawl1/index
2008-04-03 13:20:32,375 INFO Configuration - found resource
common-terms.utf8 a
t
file:/C:/apache-tomcat-6.0.13/webapps/nutch-0.9/WEB-INF/classes/common-terms.u
tf8
2008-04-03 13:20:32,375 INFO NutchBean - opening segments in
c:/nutch-0.9/crawl
1/segments
2008-04-03 13:20:32,390 INFO SummarizerFactory - Using the first
summarizer ext
ension found: Basic Summarizer
2008-04-03 13:20:32,390 INFO NutchBean - opening linkdb in
c:/nutch-0.9/crawl1/
linkdb
2008-04-03 13:20:32,390 INFO NutchBean - query request from 127.0.0.1
2008-04-03 13:20:32,406 INFO NutchBean - query: summer
2008-04-03 13:20:32,406 INFO NutchBean - lang: en
2008-04-03 13:20:32,437 INFO NutchBean - Outputting refine query list
2008-04-03 13:20:32,437 INFO NutchBean - searching for 20 raw hits
2008-04-03 13:20:32,500 WARN NativeCodeLoader - Unable to load
native-hadoop li
brary for your platform... using builtin-java classes where applicable
2008-04-03 13:20:32,515 INFO NutchBean - total hits: 1
Can someone please help me get rid of this problem.
Thanks & Regards,
Satish.
---------------------------------
Bollywood, fun, friendship, sports and more. You name it, we have it.
