Atmuri-SatyaPrakash commented on PR #2050: URL: https://github.com/apache/stormcrawler/pull/2050#issuecomment-5283999046
Thanks Davide! I’ve addressed both points. 1. Permanent HTTP redirects (301/308) are now emitted to the deletion stream, while temporary redirects such as 302 are not. JSoup meta-refresh redirects are still handled separately through the 200 + _redirTo case. 2. I also expanded the regression tests to verify 301, 308, 302, meta-refresh, ERROR, and FETCHED behavior. For the emitted metadata, I’m asserting the relevant metadata keys rather than relying on Metadata.equals(). The updated test suite passes with 6 tests, 0 failures, and 0 errors. -- This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use the URL above to go to the specific comment. To unsubscribe, e-mail: [email protected] For queries about this service, please contact Infrastructure at: [email protected]
