[
https://issues.apache.org/jira/browse/CONNECTORS-214?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=13054355#comment-13054355
]
Karl Wright commented on CONNECTORS-214:
----------------------------------------
Thinking about this further. The mime-type (and length-based) filtering
clearly belongs with the Solr connector in my mind. An output connector should
also have a say in what URLs it will accept. Unless there are objections, I'm
going to change this ticket to make it cover all three of these output
filtering criteria.
> Add post-extraction inclusions and exclusions into the web connector
> --------------------------------------------------------------------
>
> Key: CONNECTORS-214
> URL: https://issues.apache.org/jira/browse/CONNECTORS-214
> Project: ManifoldCF
> Issue Type: Improvement
> Components: Web connector
> Affects Versions: ManifoldCF 0.1, ManifoldCF 0.2
> Reporter: Erlend Garåsen
> Assignee: Erlend Garåsen
> Fix For: ManifoldCF next
>
>
> If html files are excluded for a job, links in these files will not be
> followed. If we add inclusion and exclusion filters based on post-extraction,
> it will be possible to fetch only certain types of documents, such as PDFs.
--
This message is automatically generated by JIRA.
For more information on JIRA, see: http://www.atlassian.com/software/jira
