Why are you crawling those? Do they contain hyperlinks to datapages? If you must crawl indexpages but don't want to index then you must create a custom indexing filter.
> hi all, > I'm crawling these 2 url's: > mysite/indexpages > mysite/datapages > and than index them to solr. > how do I prevent indexpages getting to index? > Can it be done via config files ? at what point? > > thanks.
