The GitHub Actions job "Java CI with Maven" on stormcrawler.git/issue-2081-file-protocol-root has failed. Run started by GitHub user abhinav-phi (triggered by rzo1).
Head commit for run: 907fa6ef2c38908f07943cc8fde9316adc2d4516 / abhinav-phi <[email protected]> File scheme off by default; reads confined to file.protocol.root (#2081) crawler-default.yaml enabled the file scheme in every topology built on the library defaults, and FileProtocol read whatever path the worker user could read: a fetched page can put a file:// URL into the frontier and the response body - including the topology configuration - went on to be parsed and indexed. The shipped protocols list is now http,https, and the file scheme has to be enabled deliberately. FileProtocol gains a file.protocol.root key: when it is set, only paths canonicalising below that directory are served (symlinks included), everything else returns 403; when it is not set, the file scheme serves nothing. An operator crawling a local corpus sets both keys. Report URL: https://github.com/apache/stormcrawler/actions/runs/33997071382 With regards, GitHub Actions via GitBox
