rzo1 opened a new issue, #2299: URL: https://github.com/apache/stormcrawler/issues/2299
`SelfURLFilter` compares the source URL and the target with `equalsIgnoreCase`, so a target which differs from the source only in the case of the path or query is removed as a link to self. Only the scheme and the host are case-insensitive (RFC 3986, 6.2.2.1). Seen in a test crawl for #2268: `https://whimsy.apache.org/board/minutes/ace.html` redirects to `.../ACE.html`, a different resource. The redirect target is rejected by the URL filters, and the page isn't fetched. -- This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use the URL above to go to the specific comment. To unsubscribe, e-mail: [email protected] For queries about this service, please contact Infrastructure at: [email protected]
