[
https://issues.apache.org/jira/browse/CONNECTORS-1392?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=15891161#comment-15891161
]
Markus Schuch edited comment on CONNECTORS-1392 at 3/1/17 10:12 PM:
--------------------------------------------------------------------
attached 3rd patch
- fixes the mismatched colums in viewSpecification
- adds a small junit test
- adds a small extension for the uitest
- adds the CHANGES.txt entry
- updates end-user documentation (image supplied separately)
[[email protected]] how do we translate the message resources and the
end-user documentation?
was (Author: schuchm):
attached 3rd patch
- fixes the mismatched colums in viewSpecification
- adds a small junit test
- adds the CHANGES.txt entry
- updates end-user documentation (image supplied separately)
[[email protected]] how do we translate the message resources and the
end-user documentation?
> Add option for Web connector to ignore robots instructions in meta tags
> -----------------------------------------------------------------------
>
> Key: CONNECTORS-1392
> URL: https://issues.apache.org/jira/browse/CONNECTORS-1392
> Project: ManifoldCF
> Issue Type: New Feature
> Components: Web connector
> Reporter: Markus Schuch
> Attachments: CONNECTORS-1392-2.patch, CONNECTORS-1392-3.patch,
> CONNECTORS-1392.patch, web-configure-robots.PNG
>
>
> The Web connectors already allows to ignore robots.txt by option.
> With this ticket, another option is added, to allow the connector to ignore
> robots instructions in {{<meta name="robots ...}} tags.
> *Proposal (to be discussed)*
> Add a new option list "Page level robots instructions" to the "Robots" Tab.
> List entries:
> # Obey meta robots tags (the default)
> # Don't took at meta robots tags
> The end user doc needs to be updated.
> Google ressources on robot instructions in HTML pages:
> [0]
> https://support.google.com/webmasters/answer/79812?hl=en&ctx=cb&src=cb&cbid=tnnsjq5jcodt&cbrank=4
> [1]
> https://support.google.com/webmasters/answer/96569?hl=en&ctx=cb&src=cb&cbid=-5rmggrfsp2rq&cbrank=3
> [2]
> https://developers.google.com/webmasters/control-crawl-index/docs/robots_meta_tag?csw=1
> Thread on the mailing list
> [3] https://www.mail-archive.com/[email protected]/msg03258.html
--
This message was sent by Atlassian JIRA
(v6.3.15#6346)
