On 12/5/07, Matt Mahoney <[EMAIL PROTECTED]> wrote: > > > [snip] Centralized search is limited to a few big players that > can keep a copy of the Internet on their servers. Google is certainly > useful, > but imagine if it searched a space 1000 times larger and if posts were > instantly added to its index, without having to wait days for its spider > to > find them. Imagine your post going to persistent queries posted days > earlier. > Imagine your queries being answered by real human beings in addition to > other > peers. > > I probably won't be the one writing this program, but where there is a > need, I > expect it will happen.
Wikia, the company run by Wikipedia founder Jimmy Wales, is tackling the Internet-scale distributed search problem - http://search.wikia.com/wiki/Atlas Connecting to related threads (some recent, some not-so-recent), the Grub distributed crawler ( http://search.wikia.com/wiki/Grub ) is intended to be one of many plug-in Atlas Factories. A development goal for Grub is to enhance it with a NL toolkit (e.g. the soon-to-be-released RelEx), so it can do more than parse simple keywords and calculate statistical word relationships. -dave ----- This list is sponsored by AGIRI: http://www.agiri.org/email To unsubscribe or change your options, please go to: http://v2.listbox.com/member/?member_id=8660244&id_secret=72165246-397899
