Jonathan I see no other simpler way than the google base thing. Of course, you can get yourself a sql instance in amazon cloud (or set up lucene, etc), etc but if you are here is because don't want to be a sys admin guy :-)
In terms of efficient use of resource and control I would go with the remote api (which is wonderful, btw) I've only used it indirectly, via bulk uploader. http://code.google.com/appengine/articles/remote_api.html Since there is no lightweight queuing in GAE, I think you (we :-) are going to need to keep track of what has been processed (although tracking could be done in the client side, just as well) Off the top of my head, I'd think that the ordering by primary key should be the best way to query the data you'll dump to google base. BTW, google base is very fast, and even let's you do geo queries. In gae, geo queries are a nightmare because of the one inequality operator in queries, so I had to fight with the mercator projection, store tiles ids per zoom level, etc. That's way I though of outsourcing bounding box queries to google base a while back. Didn't end up doing it because it's yet another moving part, and the latency would have ruined the user experience. Anyhow, maybe there will be, at last, a legitimate use case for google base :-) It'd be nice to hear how it goes if you decide to look further or if you figure out another way to support full text search. BTW, did you check whether the base api tos allow it? It'll also be nice to hear the opinion of gea moderators. -U On Apr 10, 9:35 pm, Jonathan Feinberg <[email protected]> wrote: > On Apr 9, 1:21 pm, Adam Sah <[email protected]> wrote: > > > In the meantime, you might consider Google Base > > You know, I was going to tell you to get real, but that's not so > crazy. I have two questions for you: > > Google base correctly handles unstructured text in its index, with > stemming and legitimate scoring, etc.? > > Will there be a pragmatic way for me to get the text data from my > existing 720,000 data items into Google base without blowing through > my CPU quotas? --~--~---------~--~----~------------~-------~--~----~ You received this message because you are subscribed to the Google Groups "Google App Engine" group. To post to this group, send email to [email protected] To unsubscribe from this group, send email to [email protected] For more options, visit this group at http://groups.google.com/group/google-appengine?hl=en -~----------~----~----~----~------~----~------~--~---
