Hello Guang, as far as I know you need a robot.txt only if you want to control the behavior of web search engines. Otherwise your website will be indexed just by the algorithm if the search engine. Another point is the <head> tag and the information there. I know that there are some tags which help you controlling the behavior of web search engines, too.
One of my projects has the Google search included: http://javadpkg.sourceforge.net/ So you can try using it by yourself. Maybe I should add that the project doesn't have a robot.txt as well as any search engine specific teags in the <head> tag of the pages. Regards, Gerrit -----Ursprüngliche Nachricht----- Von: Guang Chao [mailto:[email protected]] Gesendet: Freitag, 14. Juli 2017 07:02 An: Maven Users List Betreff: Re: Is it possible to search maven site? On Thu, Jul 13, 2017 at 8:29 PM, <[email protected]> wrote: > Hello Bruce, > > depends on what you mean. You can use the Google search: > https://maven.apache.org/skins/maven-fluido-skin/#GoogleSearch > Of course this only works if your Maven site is accessible from the > Internet. > I think some parts of the website is not searchable because of robots.txt > > So far I haven't seen any plugin or whatsoever which enables some kind > of offline search. > > Regards, > Gerrit > -----Ursprüngliche Nachricht----- > Von: Bruce Wen [mailto:[email protected]] > Gesendet: Donnerstag, 13. Juli 2017 13:53 > An: [email protected] > Betreff: Is it possible to search maven site? > > Hi All, > > Is there any existing solution to search maven site? Any maven plugin > to do that? > > Bruce Wen (GuangMing) > > --------------------------------------------------------------------- > To unsubscribe, e-mail: [email protected] > For additional commands, e-mail: [email protected] > -- Guang <http://javadevnotes.com/java-left-pad-string-with-spaces-examples/>
