Hi Michael, You have to do some test with your data to figure it out. I have small entities but use transactions (no groups), to save i havely use taskqueues and tune how often they run per minute to keep inside the quota. With http://code.google.com/intl/nl/appengine/docs/python/tools/appstats.html you can see how it is going gr wim
2011/1/26 Michael McClain <[email protected]>: > So I can only insert 4 items per second in the database? > > I need to insert 1000 items simultaneously for each new document I'm > inserting in the system... > Is there a way to do this? > > Thank you, > Michael > > On Jan 26, 5:36 pm, Wim den Ouden <[email protected]> wrote: >> Hi Michael, >> You need to spread the load as much as possible (parallel taskqueues), >> keep processor load without extreme spikes. >> Datastore writes max to about 4 per second (master/slave), 1 per >> second high replication datastore. >> When writing the app (triall and error) divide every load as much as >> possible in smaller chunks, don't load to much libraries etc. (load >> time) >> gr >> wim >> >> 2011/1/26 Michael McClain <[email protected]>: >> >> >> >> > Hi everybody, >> >> > I am new to Google Apps Engine. >> > I'm interested in using a cloud storage service for a large scale database >> > system. >> >> > I have to store billions of keys. Where each key has a 12 bytes value. >> > During query time I need to perfome one thousand simultaneous queries to >> > retrieve 5000 thousand keys for each query. So I need to retrieve >> > 5000*1000*12 bytes = 60 megabytes each time my application is run. >> >> > I would like to understand if this is feasible using Google Datastore. >> > What would be the latency in performing one thousand simultaneous queries? >> >> > Is there a Google representative that could assist me in understanding if >> > my app is feasible for deployment in Google Datastore? >> > I'm interested in Google Datastore because it can scale usage growth and >> > peak time traffic. >> >> > Thank you, >> > Michael >> >> > -- >> > You received this message because you are subscribed to the Google Groups >> > "Google App Engine" group. >> > To post to this group, send email to [email protected]. >> > To unsubscribe from this group, send email to >> > [email protected]. >> > For more options, visit this group at >> >http://groups.google.com/group/google-appengine?hl=en. >> >> -- >> gr >> Wim den Ouden >> Custom applications,https://e-comm.appspot.com/ >> Free open source E-commerce framework (web) >> apps,http://code.google.com/p/relat/ >> Gae developer tips,http://code.google.com/p/relat/wiki/gaetips > > -- > You received this message because you are subscribed to the Google Groups > "Google App Engine" group. > To post to this group, send email to [email protected]. > To unsubscribe from this group, send email to > [email protected]. > For more options, visit this group at > http://groups.google.com/group/google-appengine?hl=en. > > -- gr Wim den Ouden Custom applications, https://e-comm.appspot.com/ Free open source E-commerce/E-bookkeeping/E-business framework (web) apps, http://code.google.com/p/relat/ Gae developer tips, http://code.google.com/p/relat/wiki/gaetips -- You received this message because you are subscribed to the Google Groups "Google App Engine" group. To post to this group, send email to [email protected]. To unsubscribe from this group, send email to [email protected]. For more options, visit this group at http://groups.google.com/group/google-appengine?hl=en.
