Hello ,
I have some problems with fetching redirected pages. I set the property
as follows:
<property>
<name>http.redirect.max</name>
<value>3</value>
<description>The maximum number of redirects the fetcher will
follow when
trying to fetch a page. If set to negative or 0, fetcher won't
immediately
follow redirected URLs, instead it will record them for later fetching.
</description>
</property>
But the fetching procces does not follow. When i dump the crawldb, there
are many Documents, which are on status 5 ( db_redir_perm).
I don know exactly, where the problem is. can you please help me?
With friendly regards
Stefan Scheffler
--
Stefan Scheffler
Avantgarde Labs GmbH
Löbauer Straße 19, 01099 Dresden
Telefon: + 49 (0) 351 21590834
Email: [email protected]
