Re: [osg-users] Remove old wiki from Google?
Hi Paul, Sounds like a reasonable thing to do i.e. stop google bots from indexing the old wiki. I'd be happy for others to go chase this one as my inbox is chock full of other tasks. Cheers, Robert. On Sat, May 24, 2008 at 11:21 AM, Paul Melis [EMAIL PROTECTED] wrote: It seems the old pmwiki is still being indexed by Google. Isn't time to clean this up? Currently searching for openscenegraph download returns as top hit the download page for 2.0 on the previous wiki! I seem to recall that Google has an option to retire a set of URLs from their database. This would at least make sure that nobody can find the old website anymore through Google. After googling a bit on uh google it seems you can place a robots.txt file with some required parameters in it to control how google crawls your site. Another option would be to request the pmwiki URL to be removed from the google index through the Google Webmaster Tools. Paul ___ osg-users mailing list osg-users@lists.openscenegraph.org http://lists.openscenegraph.org/listinfo.cgi/osg-users-openscenegraph.org ___ osg-users mailing list osg-users@lists.openscenegraph.org http://lists.openscenegraph.org/listinfo.cgi/osg-users-openscenegraph.org
Re: [osg-users] Remove old wiki from Google?
Hi, Robert Osfield schrieb: Sounds like a reasonable thing to do i.e. stop google bots from indexing the old wiki. I'd be happy for others to go chase this one as my inbox is chock full of other tasks. I submitted a modified robots.txt to osg-submission. Hopefully this will remove the old wiki from the google-index (and from other search-engines) cheers, Stephan ___ osg-users mailing list osg-users@lists.openscenegraph.org http://lists.openscenegraph.org/listinfo.cgi/osg-users-openscenegraph.org
Re: [osg-users] Remove old wiki from Google?
Stephan Huber wrote: Hi, Robert Osfield schrieb: Sounds like a reasonable thing to do i.e. stop google bots from indexing the old wiki. I'd be happy for others to go chase this one as my inbox is chock full of other tasks. I submitted a modified robots.txt to osg-submission. Hopefully this will remove the old wiki from the google-index (and from other search-engines) I don't understand why the file only disallows /data, the old wiki is under /osgwiki/*pmwiki*.php Paul ___ osg-users mailing list osg-users@lists.openscenegraph.org http://lists.openscenegraph.org/listinfo.cgi/osg-users-openscenegraph.org
Re: [osg-users] Remove old wiki from Google?
Paul Melis wrote: Stephan Huber wrote: Hi, Robert Osfield schrieb: Sounds like a reasonable thing to do i.e. stop google bots from indexing the old wiki. I'd be happy for others to go chase this one as my inbox is chock full of other tasks. I submitted a modified robots.txt to osg-submission. Hopefully this will remove the old wiki from the google-index (and from other search-engines) I don't understand why the file only disallows /data, the old wiki is under /osgwiki/*pmwiki*.php Apologies for the bold-makers, that's when you get when you copy-paste from google. Should have been simply /osgwiki/pmwiki.php Paul ___ osg-users mailing list osg-users@lists.openscenegraph.org http://lists.openscenegraph.org/listinfo.cgi/osg-users-openscenegraph.org
Re: [osg-users] Remove old wiki from Google?
Hi Paul, Paul Melis schrieb: I don't understand why the file only disallows /data, the old wiki is under /osgwiki/*pmwiki*.php Robert did not upload the new robots.txt files till yet (I have no access to the web-server), what you are seeing is the old one. This is the new one: -- 8 -- snip -- User-agent: * Disallow: /data Disallow: /osgwiki Disallow: /index.php?* -- 8 -- snip -- cheers, Stephan ___ osg-users mailing list osg-users@lists.openscenegraph.org http://lists.openscenegraph.org/listinfo.cgi/osg-users-openscenegraph.org
[osg-users] Remove old wiki from Google?
It seems the old pmwiki is still being indexed by Google. Isn't time to clean this up? Currently searching for openscenegraph download returns as top hit the download page for 2.0 on the previous wiki! I seem to recall that Google has an option to retire a set of URLs from their database. This would at least make sure that nobody can find the old website anymore through Google. After googling a bit on uh google it seems you can place a robots.txt file with some required parameters in it to control how google crawls your site. Another option would be to request the pmwiki URL to be removed from the google index through the Google Webmaster Tools. Paul ___ osg-users mailing list osg-users@lists.openscenegraph.org http://lists.openscenegraph.org/listinfo.cgi/osg-users-openscenegraph.org
