[
https://issues.apache.org/jira/browse/NUTCH-2769?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
]
Sebastian Nagel updated NUTCH-2769:
-----------------------------------
Summary: parse-html unable to parse certain outlinks (was: Nutch 1.15
unable to parse certain outlinks )
> parse-html unable to parse certain outlinks
> --------------------------------------------
>
> Key: NUTCH-2769
> URL: https://issues.apache.org/jira/browse/NUTCH-2769
> Project: Nutch
> Issue Type: Bug
> Components: parser
> Affects Versions: 1.15, 1.16
> Reporter: Prajeeth Emanuel
> Priority: Major
>
> Nutch is unable to parse certain outlinks in pages.
> For example:
> Crawling [http://d4fdot.com/pbfdot/PBC-North_index.asp] does not parse the
> outlinks:
> [congress_avenue_lighting_improvements.asp|http://www.d4fdot.com/pbfdot/congress_avenue_lighting_improvements.asp]
> [blue_heron_boulevard_bridge_fender_replacement.asp|http://www.d4fdot.com/pbfdot/blue_heron_boulevard_bridge_fender_replacement.asp]
> [indiantown_road_intersection_improvements.asp|http://www.d4fdot.com/pbfdot/indiantown_road_intersection_improvements.asp]
>
> Crawling [http://www.d4fdot.com/pbfdot/index.asp] however, parses
> [congress_avenue_lighting_improvements.asp|http://www.d4fdot.com/pbfdot/congress_avenue_lighting_improvements.asp]
> correctly even though the Anchor element is structured similarly.
>
> URL filters and normalizers have been modified to barely operate and no URLs
> or outlinks are being ignored in the current config and the error still
> occurs.
>
>
>
--
This message was sent by Atlassian Jira
(v8.3.4#803005)
