So I probably should've done at least some digging in the code before posting away.
It seems that the datastore would need to be in the form of a Protocol Buffer consumer, ala google/appengine/api/datastore_file.stub.py (http://code.google.com/p/googleappengine/source/browse/trunk/google/appengine/api/datastore_file_stub.py ) The _Dynamic_* calls look like the ones to emulate - as called by MakeSyncCall(). Not having particularly good Python eyes (yet), I can't really tell how much magic is going on there that would be hard to reproduce with HBase/Hypertable/etc. It seems that quite a lot is slotted into memory and then written in large chunks and it looks like whichever datastore was chosen would need to support transaction handles and possibly cursors of some sort. I'm not sure how much the filters and queries handled by _Dynamic_RunQuery would need to be refined either. On 18/09/2008, at 4:35 PM, Michael Hart wrote: > Is anyone aware of any projects to integrate the development app > server with any BigTable-like persistence solutions? > > I've seen people throwing the idea around in various threads, but I > haven't seen anything concrete yet. > > The main advantage to users of such an integration is obviously the > ability to scalably run their app anywhere (that is, assuming that > the datastore is the main bottleneck of the development app server). > > One of the advantages for Google would be that dev_appserver would > be a closer approximation to production than what it currently is > with flat files - an issue that has raised its head a few times on > this list when it comes to testing volumes of data locally. > > So how big a project would it be to replace the flat-file approach > with an interface to HBase or Hypertable? What are the major > stumbling blocks? > > It's something that I'd be interested in looking into - but I'd like > to gauge how big a task it is first, and where the nasty bits are > likely to be. > > Cheers, > > Michael --~--~---------~--~----~------------~-------~--~----~ You received this message because you are subscribed to the Google Groups "Google App Engine" group. To post to this group, send email to [email protected] To unsubscribe from this group, send email to [EMAIL PROTECTED] For more options, visit this group at http://groups.google.com/group/google-appengine?hl=en -~----------~----~----~----~------~----~------~--~---
