GitMehdi-sys opened a new pull request, #2260: URL: https://github.com/apache/stormcrawler/pull/2260
Fixes #2199 BasicURLNormalizer parsed the query with URLEncodedUtils.parse(query, UTF_8), which treats both & and ; as separators, so a ; used as ordinary data (e.g. ?q=a;b) was split into two parameters. It now passes '&' as the only separator, following the URL Standard. Behaviour note: the query is still rebuilt with URLEncodedUtils.format(), which percent-encodes ';' like the other characters the normaliser already canonicalises, so q=a;b becomes q=a%3Bb (a single parameter that decodes to the same value) instead of being split into b&q=a. Existing tests all expect re-encoding (e.g. ! -> %21), so I kept that. Tests: added testSemicolonIsNotAQuerySeparator, which fails without the fix. All 719 core tests pass. -- This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use the URL above to go to the specific comment. To unsubscribe, e-mail: [email protected] For queries about this service, please contact Infrastructure at: [email protected]
