Hi Monika, the sitemap helps spiders discover the site, but is not limiting them from crawling other URLs. robots.txt serves that purpose.
Therefore, DSpace feeds the spider a list of all item pages, but spiders will index the links from those pages, too. In our case - bistreams. Recently there were even certain improvements in how bitstreams are listed in item page meta headers based on feedback and best practices from Google Scholar. So you don't have to worry that because you're using a sitemap your bitstreams will be ignored. Regards, ~~helix84 Compulsory reading: DSpace Mailing List Etiquette https://wiki.duraspace.org/display/DSPACE/Mailing+List+Etiquette ------------------------------------------------------------------------------ Comprehensive Server Monitoring with Site24x7. Monitor 10 servers for $9/Month. Get alerted through email, SMS, voice calls or mobile push notifications. Take corrective actions from your mobile device. http://pubads.g.doubleclick.net/gampad/clk?id=154624111&iu=/4140/ostg.clktrk _______________________________________________ DSpace-tech mailing list [email protected] https://lists.sourceforge.net/lists/listinfo/dspace-tech List Etiquette: https://wiki.duraspace.org/display/DSPACE/Mailing+List+Etiquette
