[ https://issues.apache.org/jira/browse/FLINK-9541?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=16691512#comment-16691512 ]
Fabian Hueske commented on FLINK-9541: -------------------------------------- Hi Ken, Thanks for driving this! Yes, the {{flink-docs-master}} directory holds the docs for the master branch, i.e., typically for the next version (in the last few weeks before a release after the release branch was forked off, the master branch holds the over-next version). I don't think we should index them (or give a smaller weight) as they might collide with other versions. {{flink-docs-stable)) always points to the latest stable version and I agree that these should get the highest priority. Not sure to what extend it is possible to assign weights, but maybe we can decrease weights for releases as they age, i.e., update the sitemap with every release? > Add robots.txt and sitemap.xml to Flink website > ----------------------------------------------- > > Key: FLINK-9541 > URL: https://issues.apache.org/jira/browse/FLINK-9541 > Project: Flink > Issue Type: Improvement > Components: Project Website > Reporter: Fabian Hueske > Priority: Major > > From the [dev mailing > list|https://lists.apache.org/thread.html/71ce1bfbed1cf5f0069b27a46df1cd4dccbe8abefa75ac85601b088b@%3Cdev.flink.apache.org%3E]: > {quote} > It would help to add a sitemap (and the robots.txt required to reference it) > for flink.apache.org and ci.apache.org (for /projects/flink) > You can see what Tomcat did along these lines - > http://tomcat.apache.org/robots.txt references > http://tomcat.apache.org/sitemap.xml, which is a sitemap index file pointing > to http://tomcat.apache.org/sitemap-main.xml > By doing this, you can emphasize more recent versions of docs. There are > other benefits, but reducing poor Google search results (to me) is the > biggest win. > E.g. https://www.google.com/search?q=flink+reducingstate > <https://www.google.com/search?q=flink+reducingstate> (search on flink > reducing state) shows the 1.3 Javadocs (hit #1), master (1.6-SNAPSHOT) > Javadocs (hit #2), and then many pages of other results. > Whereas the Javadocs for 1.5 > <https://ci.apache.org/projects/flink/flink-docs-release-1.5/api/java/org/apache/flink/api/common/state/ReducingState.html> > and 1.4 > <https://ci.apache.org/projects/flink/flink-docs-release-1.4/api/java/org/apache/flink/api/common/state/ReducingState.html> > are nowhere to be found. > {quote} -- This message was sent by Atlassian JIRA (v7.6.3#76005)