Hi,
With 1.5 or lower you have two options, either you skip the record in a
simple custom indexing filter or you skip it in a custom UpdateProcessor
in Solr. You can also try NUTCH-1300, it has a patch enabling filtering
and normalizing for the indexer job. With the RegexURLFilter enabled and
filter rules specifically for the indexer you can skip the URL. It
hasn't been fully tested but it should work. It's likely to be committed
for trunk in the next month.
https://issues.apache.org/jira/browse/NUTCH-1300
Cheers
On Tue, 24 Apr 2012 12:44:56 -0700 (PDT), atul <[email protected]>
wrote:
Hi,
We have a nutch-solr combination in place to built up a web page.
We are reading a source index.html file which contains links to other
web
pages.
Our code is working fine, we are getting rest of the web pages
indexed
following the URL's on index.html.
However we don't want index.html file to get indexed in solr. We want
rest
all the internal URL's (web pages)
indexed except the root page.
Please advice, how this can be achieved?
Thanks,
Atul
--
View this message in context:
http://lucene.472066.n3.nabble.com/Skipping-Root-File-from-Indexing-tp3936375p3936375.html
Sent from the Nutch - Dev mailing list archive at Nabble.com.
--
Markus Jelsma - CTO - Openindex
http://www.linkedin.com/in/markus17
050-8536600 / 06-50258350