[ 
https://issues.apache.org/jira/browse/HDFS-9651?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=15971175#comment-15971175
 ] 

Hudson commented on HDFS-9651:
------------------------------

SUCCESS: Integrated in Jenkins build Hadoop-trunk-Commit #11591 (See 
[https://builds.apache.org/job/Hadoop-trunk-Commit/11591/])
HDFS-9651. All web UIs should include a robots.txt file. Contributed by 
(aajisaka: rev 09e6caec3dbba257f11fe7246d4c25ee8fc95d8b)
* (edit) hadoop-hdfs-project/hadoop-hdfs/pom.xml
HDFS-9651. Add missing robots.txt files. (aajisaka: rev 
8cb73255274bd46ea8aedbb28f25fa13b38723ad)
* (add) hadoop-hdfs-project/hadoop-hdfs/src/main/webapps/hdfs/robots.txt
* (add) hadoop-hdfs-project/hadoop-hdfs/src/main/webapps/secondary/robots.txt
* (add) hadoop-hdfs-project/hadoop-hdfs/src/main/webapps/journal/robots.txt


> All web UIs should include a robots.txt file
> --------------------------------------------
>
>                 Key: HDFS-9651
>                 URL: https://issues.apache.org/jira/browse/HDFS-9651
>             Project: Hadoop HDFS
>          Issue Type: Improvement
>            Reporter: Lars Francke
>            Assignee: Lars Francke
>            Priority: Minor
>             Fix For: 2.9.0, 3.0.0-alpha3
>
>         Attachments: HDFS-9651.1.patch, HDFS-9651.2.patch
>
>
> Similar to HDFS-330. So that public UIs don't get crawled.
> I can provide a patch that includes a simple robots.txt. Another alternative 
> is probably a Filter that provides one automatically for all UIs but I don't 
> have time to do that.
> If anyone wants to take over please go ahead.



--
This message was sent by Atlassian JIRA
(v6.3.15#6346)

---------------------------------------------------------------------
To unsubscribe, e-mail: [email protected]
For additional commands, e-mail: [email protected]

Reply via email to