On Tue, Oct 13, 2009 at 6:44 PM, abhishek jain <[email protected]>wrote:
> > I found the ip was 75.101.221.99 and the useragent was "ia_archiver (+ > http://www.alexa.com/site/help/webmasters; [email protected]) > > Can anyone suggest what to do now, have someone else faced a similar > problem > before, > AFAIK, the Alexa crawler must be determining your website statistics like page views per day, number of visitors etc. to determine your page rank, website rank etc. Check out www.alexa.com for more information. And if you want to block robots to your website, modify your robots.txt file. I dont know the exact settings.. just search for them. -- Regards Chirag Anand Junior Systems Architect E2E Networks | <http://www.e2enetworks.com> [email protected] Blog :http://techfreaks4u.com/blog anything weird is worth a try... _______________________________________________ ilugd mailinglist -- [email protected] http://frodo.hserus.net/mailman/listinfo/ilugd Archives at: http://news.gmane.org/gmane.user-groups.linux.delhi http://www.mail-archive.com/[email protected]/
