If you're planning on using Google to index and search the maven generated site, you should be using a sitemap.xml for the best performance and most control. See https://support.google.com/webmasters/answer/156184?hl=en for details.
The robots.txt is honored, but really doesn't provide any control over indexing. Also if you want to be indexed on a regular schedule you'll need to register your sitemap.xml with Google using the Webmaster Tools. Jim Klo Senior Software Engineer SRI International t: @nsomnac On Jul 14, 2017, at 12:43 AM, "g.h...@aurenz.de<mailto:g.h...@aurenz.de>" <g.h...@aurenz.de<mailto:g.h...@aurenz.de>> wrote: Hello Guang, as far as I know you need a robot.txt only if you want to control the behavior of web search engines. Otherwise your website will be indexed just by the algorithm if the search engine. Another point is the <head> tag and the information there. I know that there are some tags which help you controlling the behavior of web search engines, too. One of my projects has the Google search included: http://javadpkg.sourceforge.net/ So you can try using it by yourself. Maybe I should add that the project doesn't have a robot.txt as well as any search engine specific teags in the <head> tag of the pages. Regards, Gerrit -----Ursprüngliche Nachricht----- Von: Guang Chao [mailto:guang.chao.1...@gmail.com] Gesendet: Freitag, 14. Juli 2017 07:02 An: Maven Users List Betreff: Re: Is it possible to search maven site? On Thu, Jul 13, 2017 at 8:29 PM, <g.h...@aurenz.de<mailto:g.h...@aurenz.de>> wrote: Hello Bruce, depends on what you mean. You can use the Google search: https://maven.apache.org/skins/maven-fluido-skin/#GoogleSearch Of course this only works if your Maven site is accessible from the Internet. I think some parts of the website is not searchable because of robots.txt So far I haven't seen any plugin or whatsoever which enables some kind of offline search. Regards, Gerrit -----Ursprüngliche Nachricht----- Von: Bruce Wen [mailto:crest....@gmail.com] Gesendet: Donnerstag, 13. Juli 2017 13:53 An: users@maven.apache.org<mailto:users@maven.apache.org> Betreff: Is it possible to search maven site? Hi All, Is there any existing solution to search maven site? Any maven plugin to do that? Bruce Wen (GuangMing) --------------------------------------------------------------------- To unsubscribe, e-mail: users-unsubscr...@maven.apache.org<mailto:users-unsubscr...@maven.apache.org> For additional commands, e-mail: users-h...@maven.apache.org<mailto:users-h...@maven.apache.org> -- Guang <http://javadevnotes.com/java-left-pad-string-with-spaces-examples/>
