I did not modify the robots.txt file - it still has Disallow for all folders, including Components. I am confused how Google was able to find those pages without visible links to them, since those links require logon.
Kirill
Stephen Britton ---09/14/2012 10:14:57 AM---Did you edit the robots.txt file? Joomla's default robots file restricts access to several directori
From: Stephen Britton <sbrit...@gmail.com>
To: "NYPHP SIG: Joomla" <joomla@lists.nyphp.org>,
Date: 09/14/2012 10:14 AM
Subject: Re: [joomla] Controling google bots and restricting component access
Sent by: joomla-boun...@lists.nyphp.org
Did you edit the robots.txt file? Joomla's default robots file restricts access to several directories, including components and templates.
On Sep 14, 2012 9:00 AM, "Kirill Poliakov" <kir...@hostnetservices.com> wrote:
- Hello everyone,
I have an issue with a site. Most content requires a logon, so I am confused how Google bot was able to crawl the site to restricted menu options without access to them.
Here is a link to logon page
http://www.campwinnetaska.com/camp/index.php?option=com_content&view=featured&Itemid=435
Here is a link to Google search result that shows restricted conten
https://www.google.com/search?q=1957+Inaweke&ie=utf-8&oe=utf-8&aq=t&rls=org.mozilla:en-US:official&client=firefox-a
First, can anybody advise how to restrict Google bot from scanning the full site.
Then, how do I restrict access to a component to registered users only - I am controlling access through menu restriction. Now that Google exposed restricted pages I need to restrict access to the component to registered users only
Any help would be appreciated.
Kirill
_______________________________________________
New York PHP SIG: Joomla! Mailing List
http://lists.nyphp.org/mailman/listinfo/joomla
NYPHPCon 2006 Presentations Online
http://www.nyphpcon.com
Show Your Participation in New York PHP
http://www.nyphp.org/show_participation.php_______________________________________________
New York PHP SIG: Joomla! Mailing List
http://lists.nyphp.org/mailman/listinfo/joomla
NYPHPCon 2006 Presentations Online
http://www.nyphpcon.com
Show Your Participation in New York PHP
http://www.nyphp.org/show_participation.php
<<inline: graycol.gif>>
_______________________________________________ New York PHP SIG: Joomla! Mailing List http://lists.nyphp.org/mailman/listinfo/joomla
NYPHPCon 2006 Presentations Online http://www.nyphpcon.com Show Your Participation in New York PHP http://www.nyphp.org/show_participation.php
