The GitHub Actions job "Java CI with Maven" on stormcrawler.git/issue-2082-host-canonicalisation has failed. Run started by GitHub user abhinav-phi (triggered by rzo1).
Head commit for run: df4670521658eb86a658212e2d563253bd2753cd / abhinav-phi <[email protected]> Canonicalise hosts for politeness queues and the robots.txt cache (#2082) okhttp percent-decodes and lowercases the host when it parses the URL, but FetchItem.create, SimpleFetcherBolt.getPolitenessKey and HttpRobotRulesParser.getCacheKey keyed on the raw host string, so http://exampl%65.org/ and http://example.org/ were one origin at connect time and two queue ids and two robots.txt cache entries in the bolt. One server could end up with several delay clocks running in parallel and its robots.txt fetched once per spelling. URLUtil.getCanonicalHost percent-decodes the host, strips a trailing dot and lowercases it, and all three call sites now use it. Report URL: https://github.com/apache/stormcrawler/actions/runs/33996708563 With regards, GitHub Actions via GitBox
