Hi, just in case there was no reply yet.
Nutch does have some handling depending on the HTTP response code (e.g. 302 redirection ...). For more detail, check the source code HttpBase.java. Remi Nutch supports redirection On Tue, Jul 17, 2012 at 11:21 AM, IT_ailen <[email protected]>wrote: > Hi, > If nutch fetches a page and get a HTTP status which is not 200(e.g. 203 > 307 404 ...), what will it do? For example, when we get a reply with 307, > we > may be requested to input a check code for verification, but how will the > nutch do? Fetching it anyway and parse it like a correct one (that may not > contain any links we want), or just missing it? > > ----- > I'm what I am. > -- > View this message in context: > http://lucene.472066.n3.nabble.com/How-does-nutch-reflect-with-HTTP-status-not-200-tp3995444.html > Sent from the Nutch - User mailing list archive at Nabble.com. >
