Author: Alexander Barkov Email: b...@mnogosearch.org Message: > I want to index all the sites, about "template" > Indexing posting in the forum categories and categories on the website > > current indexer setup like this, but I'm confused a lot of link wikipedia and > amazon are indexed by crawl > > Realm http://*.com/* > Realm http://*.org/* > Realm http://*.net/* > Realm http://*.info/* > > Tag template > Server http://www.templatesite.com/ > Server http://www.template.com/ > Server http://www.alltemplate.com/ > > I tried to use IndexIf *template* but this is bad, only categories that can > index (not post) and all search results contained the phrase "template" in > the title > I do not use maxhops, because I want to index as many sites that found by the > crawl, only post about template > > I tried using this setup, Realm http://*.com/*template* but I'm not sure > that's true because I saw just delete the url of the database that is not > defined by Server >
Is my understanding correct: you want to find all pages on the Internet that contain the word "template"? I'm afraid mnoGoSearch crawler is not very suitable for that purposes. There are about 190 million active sites in the world, according to the latest surveys. Every site has usually several documents (some sites have hundreds and thousands documents). It will take forever to crawl all these volumes of data. Reply: <http://www.mnogosearch.org/board/message.php?id=21525> _______________________________________________ General mailing list General@mnogosearch.org http://lists.mnogosearch.org/listinfo/general
