Hello - there is no way to do this with just configuration. You can, however, modify the protocol-* plugin you're using. That is the spot to add a custom header for a given condition.
Markus -----Original message----- > From:[email protected] <[email protected]> > Sent: Sunday 1st January 2017 16:47 > To: [email protected] > Subject: Help on adding custom headers > > Hi, > > > Is there a way to add headers, whenever the url to be fetched matches a > condition. > > Ex: http://www.abc123.com,<http://www.abc123.com> if url contains (abc) then > something like, addheader("username", "nutch") > > ?I think we can add headers for all requests in config. But is this condition > check and adding custom header while crawling urls possible? > > > Thanks in advance, > > -Ashok. > > This e-mail and any files transmitted with it are for the sole use of the > intended recipient(s) and may contain confidential and privileged > information. If you are not the intended recipient(s), please reply to the > sender and destroy all copies of the original message. Any unauthorized > review, use, disclosure, dissemination, forwarding, printing or copying of > this email, and/or any action taken in reliance on the contents of this > e-mail is strictly prohibited and may be unlawful. Where permitted by > applicable law, this e-mail and other e-mail communications sent to and from > Cognizant e-mail addresses may be monitored. >
