Hello, I found a situation that generates error when I run the crawler, for example in the url directory I have a *. txt in the interior contains: http://www.opentechlearning.com/ and inside the folder conf file 'crawl-urlfilter' must have: + ^ Http:// ([a-z0-9] * \.) * Opentechlearning.com /
My question is how (I put the pages in the crawl-urlfilter file) to the following pages: http://cnx.org/lenses/ccotp/endorsements/atom http://ocw.nd.edu/courselist/rss http://openlearn.open.ac.uk/file.php/1/learningspace.xml .... and not starting with www. and that causes me problems
