code4lib  

Re: [CODE4LIB] a brief summary of the Google App Engine

Godmar Back
Wed, 16 Jul 2008 06:34:17 -0700

On Wed, Jul 16, 2008 at 6:29 AM, Keith Jenkins <[EMAIL PROTECTED]> wrote:
> But for anything larger, you'd probably want to figure
> out a way to manually build an index within the Google datastore, or
> else keep the indexing outside GAE, and just use GAE for fetching
> specified records.  Any ideas on how that might work?
>

Presumably, it would work the same way Google's primary web index does
- which after all uses the same infrastructure; you chop each fields
into words, create an index of these words from their ids that maps
them to a list of records (in Google: pages) that contains them. See
Brin/Page's only paper for details:
http://infolab.stanford.edu/~backrub/google.html

 - Godmar