[
https://issues.apache.org/jira/browse/CONNECTORS-214?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=13068583#comment-13068583
]
David Broadfoot commented on CONNECTORS-214:
--------------------------------------------
http://lists.ifas.ufl.edu/cgi-bin/wa.exe?A0=sanet-mg
Its an email archive. I need to spider the whole tree, but only urls with A2=
in the query string actually need to be ingested.
Now if xpath selectors could be applied too.... :)
> Add post-extraction inclusions and exclusions into the web connector
> --------------------------------------------------------------------
>
> Key: CONNECTORS-214
> URL: https://issues.apache.org/jira/browse/CONNECTORS-214
> Project: ManifoldCF
> Issue Type: Improvement
> Components: Web connector
> Affects Versions: ManifoldCF 0.1, ManifoldCF 0.2
> Reporter: Erlend Garåsen
> Assignee: Karl Wright
> Fix For: ManifoldCF next
>
>
> If html files are excluded for a job, links in these files will not be
> followed. If we add inclusion and exclusion filters based on post-extraction,
> it will be possible to fetch only certain types of documents, such as PDFs.
--
This message is automatically generated by JIRA.
For more information on JIRA, see: http://www.atlassian.com/software/jira
