The GitHub Actions job "Java CI with Maven" on stormcrawler.git/issue-2082-host-canonicalisation has failed. Run started by GitHub user abhinav-phi (triggered by dpol1).
Head commit for run: 77a75c29cf55527438555f2f70414cd2e9d8037a / abhinav-phi <[email protected]> Canonicalise host-derived partition keys in the partitioners (#2082) The fetcher canonicalised the host, but the shipped topology derives the politeness key one bolt earlier: URLPartitionerBolt (and the URLPartitioner the URL buffer uses) keyed on the raw hostname, and FetchItem.create accepts an explicitly provided key without touching it, so http://example.org/ and http://exampl%65.org/ kept separate politeness queues and could even be routed to different fetcher tasks. Both partitioners now derive host, domain and IP keys from URLUtil.getCanonicalHost in every mode; an explicitly supplied ip metadata value is used unchanged. Regression tests cover the utility for all three modes and the partitioner bolt end to end, including the unchanged-URL guarantee. Report URL: https://github.com/apache/stormcrawler/actions/runs/34213798765 With regards, GitHub Actions via GitBox
