Hello Talat,
First of all, Thank you, thank you and one thousand thank you. :)
Finally I get nutch 1.7 and apache solr 4.4.0 working together, this can't  
happened without the help of people from Nutch's mailing list, especially 
Talat, :)
The reason of the success, in effect is that nutch-site needs the 
urlfilter-validator plugin :)
Yeap I know that I'm using smileys to much, I'm very glad, this is a great step 
to get working with Nutch in the University that I work.


About writing Nutch and Solr integration document, I'm new with this softs, If 
you have the time and patience to guide me, I accept the challenge!!!
Best regards,
Luis Armando

________________________________________
De: Talat UYARER [[email protected]]
Enviado el: lunes, 21 de octubre de 2013 06:43 p.m.
Para: [email protected]
Asunto: Re: RV: Nutch 1.7 and Solr 4.4.0 Integrate

Hi Luis,

the reason of issue is understood very hard. I have a solution but I am
not sure :) When I looked your nutch-site.xml. You activated less
plugins. If you dont use urlfilter-validator, when you parse websites,
Parser generate unvalidate urls like as http://# or ???###eee etc. When
I try to get your error. I am getting your issue, if my document has not
valdiate url. Because of your issue, your unvalidate urls. Can you add
urlfilter-validator plugin in your nutch-site.xml, drop your db and solr
collection start again crawling.

Little tips:

For delete your table in hbase shell:
truncate "webpage"

For deleting your solr index :
localhost:8983/solr/update?stream.body=<delete><query>*:*</query></delete>
(This delete your index)
localhost:8983/solr/update?commit=true ( sometimes need For afffect your
request )

Your second question is solr mail list question. I believe they can give
more information about solr. But if you want to look your index, you can
use this url:
http://localhost:8983/solr/collection1/select?q=*%3A*&start=0&rows=30&wt=xml&indent=true

Actually you rgiht we need solr integration document. I learn very well.
Can you write document about Solr Integration with nutch. I can review
it and we will publish our wiki. What about you ?
I hope I will hear your good news :)
Hava a nice day
Talat


La Universidad Central "Marta Abreu" de Las Villas en su 60 Aniversario. 
Fundada el 30 de noviembre de 1952. Visítenos en:  http://www.uclv.edu.cu
Participe en Universidad 2014, del 10 al 14 de febrero de 2014. Habana. Cuba. 
http://www.congresouniversidad.cu/


Reply via email to