rzo1 opened a new issue, #2162:
URL: https://github.com/apache/stormcrawler/issues/2162

   Follow-up to #2089.
   
   The PR for #2089 limits `http.basicauth.*` credentials to the hosts listed 
in `http.basicauth.hosts`. Credential headers configured through 
`http.custom.headers` (`Authorization`, `Cookie`, `X-Api-Key`, anything in 
`http.credentials.headers`) are still sent to every host; only a startup WARN 
was added.
   
   Scoping them needs its own design, e.g. a per-host form of 
`http.custom.headers`, and is a separate breaking change. Today the only 
per-site alternative is `protocol.set-header` metadata, which is awkward for 
seed-based crawls.


-- 
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.

To unsubscribe, e-mail: [email protected]

For queries about this service, please contact Infrastructure at:
[email protected]

Reply via email to