On 13.08.2012 12:00, Ferdy Galema wrote:
Thanks for your reply.
I found the problem xd: *db.ignore.external.links* was set to true :).
By any chance on 2.0? This is a known bug.
On Mon, Aug 13, 2012 at 11:46 AM, Stefan Scheffler <
[email protected]> wrote:
Hello ,
I have some problems with fetching redirected pages. I set the property as
follows:
<property>
<name>http.redirect.max</name>
<value>3</value>
<description>The maximum number of redirects the fetcher will follow
when
trying to fetch a page. If set to negative or 0, fetcher won't
immediately
follow redirected URLs, instead it will record them for later fetching.
</description>
</property>
But the fetching procces does not follow. When i dump the crawldb, there
are many Documents, which are on status 5 ( db_redir_perm).
I don know exactly, where the problem is. can you please help me?
With friendly regards
Stefan Scheffler
--
Stefan Scheffler
Avantgarde Labs GmbH
Löbauer Straße 19, 01099 Dresden
Telefon: + 49 (0) 351 21590834
Email: [email protected]
--
Stefan Scheffler
Avantgarde Labs GmbH
Löbauer Straße 19, 01099 Dresden
Telefon: + 49 (0) 351 21590834
Email: [email protected]
