Author: Alexander Barkov Email: [email protected] Message: Hi, > Hi Guys, > > It's a long since my udm-gw script in Y2K. > I am back on mnoGosearch and face a newbie issue I cant solve. > > I want to index a server but not some specific regex on it. > I tried disallow with server, all fails.
Can you please clarify what fails? Does it crawl the entire site? Or does it crawl nothing? > Server disallow with pattern is not possible to me, no try. > > Here I want to index www.a.com/ > without www.a.com/news/*/2000/* > and www.a.com/index.html?*setlang=za > > I did: > Disallow regex www.a.com/news/*/2000/* > Disallow regex www.a.com/index.html\?*setlang=za > Server allow www.a.com/ The correct command is: Server http://www.a.com/ Notice the "http://"; prefix. > > I also tried using .* as pattern for any instead of *, no success. ".*" is correct. Btw, which version are you using? > > Any help appreciated :-) > > Thanks Reply: <http://www.mnogosearch.org/board/message.php?id=21577> _______________________________________________ General mailing list [email protected] http://lists.mnogosearch.org/listinfo/general
