Thanks Vinit for the information.
I checked the sitemap files under DSPACE/sitemaps and found that the handles Google crawler keep on accessing do not exist in any of the files there. Or there are sitemap files elsewhere?

How do I include the sitemap files in robot.txt? Sorry if this is a stupid question.

Panyarak Ngamsritragul
Khunying Long Athakravisunthorn Learning Resources Center
Prince of Songkla University
Hat Yai, Songkhla, Thailand

Dear Panyarak,

Check ur sitemaps file. Find out the non existing pages and delete the URLs.

Plus in robots.txt file you have to give the location of the sitemaps.xml file.

Regards
Vinit Kumar 
Senior Research Fellow
Documentation Research and Training Centre
Bangalore
MLISc   (BHU)
Varanasi, India 
Alt email: [email protected]
--
This message has been scanned for viruses and
dangerous content by MailScanner, and is
believed to be clean.

------------------------------------------------------------------------------
Nokia and AT&T present the 2010 Calling All Innovators-North America contest
Create new apps & games for the Nokia N8 for consumers in  U.S. and Canada
$10 million total in prizes - $4M cash, 500 devices, nearly $6M in marketing
Develop with Nokia Qt SDK, Web Runtime, or Java and Publish to Ovi Store 
http://p.sf.net/sfu/nokia-dev2dev
_______________________________________________
DSpace-tech mailing list
[email protected]
https://lists.sourceforge.net/lists/listinfo/dspace-tech

Reply via email to