The GitHub Actions job "Java CI with Maven" on 
stormcrawler.git/issue-2080-private-address-default has failed.
Run started by GitHub user abhinav-phi (triggered by rzo1).

Head commit for run:
30ba69011d8342646414523fac9a03133360f3d4 / abhinav-phi <[email protected]>
Keep the fetcher off private address space by default (#2080)

The IP address filter was the only check that looked at the address the
fetcher actually connects to, and both of its keys shipped commented
out, so the interceptor was never installed at library defaults. The
regex exclusion list in the archetypes matched literal localhost and
four dotted-quad ranges and nothing else: link-local, CGNAT, IPv6
unique-local and the abbreviated and integer IPv4 forms the resolver
maps to 127.0.0.1 all passed it.

- crawler-default.yaml ships http.filter.ipaddress.exclude enabled
  (loopback, RFC1918, link-local, CGNAT, IPv6 unique-local); a fetched
  page decides which hosts the fetcher connects to, and these ranges
  host unauthenticated services a public index must not leak into.
  Crawling an intranet needs an explicit opt-out, documented in the
  comment next to the key
- the archetype default-regex-filters.txt (and its opensearch/solr
  copies) gains rules for 169.254.0.0/16, 100.64.0.0/10, 0.0.0.0/8,
  IPv6 fc00::/7 and fe80::/10, the abbreviated loopback forms (127.1)
  and integer IPv4 hosts (2130706433), and says in its comment that a
  regex list judges the bytes of the URL only, so the IP filter stays
  the authoritative check

Report URL: https://github.com/apache/stormcrawler/actions/runs/33998813190

With regards,
GitHub Actions via GitBox

Reply via email to