Total data stored shows now 150MB, not exactly 50% reduction, but still sounds more reasonable.
Conclusion: total stored data takes at least 24Hrs to be fully updated and indexes gives high overhead on total stored data. On Jul 23, 9:15 am, ivarconr <[email protected]> wrote: > I have now deleted almost 50% of the data stored, and my application > now have 83K entities using 24MB raw data. Total stored data has only > been lowered to 220MB. It might just be that I have to wait a little > longer for the stats to be updated (all the other statistics where > just updated). I will report back the status after 24Hrs. > > On Jul 22, 11:21 pm, ivarconr <[email protected]> wrote: > > > I will definitively look in to how the data store works. I use Python > > myself which give me the same type-name possibilities. As the primary > > concern for my application is fresh data I don’t need all the > > historically stored data and can easily get rid of most of it. Thanks > > for your appreciated feedback. > > > On Jul 22, 10:56 pm, Nate Bauernfeind <[email protected]> > > wrote: > > > > If you want to use less space you will need to obfuscate your type's > > > names. > > > > I'm using Java/Scala and my type's name is "U" and the parameter is "n" > > > (in > > > scala I can easily import U as User). This made a 200mb+ difference by > > > reducing the names to one character. You may want to watch some of the > > > "How > > > the Datastore works" Google IO videos. All of the indexes include full > > > parameter names on every entry, so it might be worth investigating if > > > you're > > > already in the process of repopulating your datastore. > > > > On Thu, Jul 22, 2010 at 3:34 PM, ivarconr <[email protected]> wrote: > > > > Ok, sounds like mine. I got 153k entities taking about 45MB raw data > > > > with 6 different indexes. The total stored data is reported to be > > > > 280MB, which sounds a bit high to me, but might be correct depending > > > > on how much overhead you get on each index. > > > > > On Jul 22, 10:15 pm, Nate Bauernfeind <[email protected]> > > > > wrote: > > > > > I have a type that has 1.45 million instances using a total of 27mb of > > > > raw > > > > > data but uses a total of 340mb in the datastore including *only* the > > > > default > > > > > indexes (on the key and on a string field). > > > > > > On Thu, Jul 22, 2010 at 3:10 PM, ivarconr <[email protected]> wrote: > > > > > > I have been waiting a few days. Would expect it to be updated by > > > > > > now. > > > > > > > On Jul 22, 9:21 pm, Nate Bauernfeind <[email protected]> > > > > > > wrote: > > > > > > > It takes about 24 hours to update the "real" stored data counter. > > > > (The > > > > > > > indexes are slow to update their portion of total stored data.) > > > > > > > > On Thu, Jul 22, 2010 at 9:57 AM, ivarconr <[email protected]> > > > > wrote: > > > > > > > > I just deleted most of the old data for my application and the > > > > > > > > size > > > > of > > > > > > > > all entities are now reported to be 44 MBytes. I have 6 indexes > > > > (where > > > > > > > > 3 are over 99% of the data). Shouldn't the total stored data > > > > counter > > > > > > > > be updated? It says I'm still using 280 MB, which sounds a lot > > > > > > > > to > > > > me, > > > > > > > > even with additional data for indexes. > > > > > > > > > Application id: bikeoslo > > > > > > > > > -- > > > > > > > > You received this message because you are subscribed to the > > > > > > > > Google > > > > > > Groups > > > > > > > > "Google App Engine" group. > > > > > > > > To post to this group, send email to > > > > [email protected] > > > > > > . > > > > > > > > To unsubscribe from this group, send email to > > > > > > > > [email protected]<google-appengine%[email protected]> > > > > <google-appengine%[email protected]<google-appengine%[email protected]> > > > > > > > <google-appengine%[email protected]<google-appengine%[email protected]> > > > > <google-appengine%[email protected]<google-appengine%[email protected]> > > > > > > > > > . > > > > > > > > For more options, visit this group at > > > > > > > >http://groups.google.com/group/google-appengine?hl=en. > > > > > > > -- > > > > > > You received this message because you are subscribed to the Google > > > > Groups > > > > > > "Google App Engine" group. > > > > > > To post to this group, send email to > > > > > > [email protected] > > > > . > > > > > > To unsubscribe from this group, send email to > > > > > > [email protected]<google-appengine%[email protected]> > > > > <google-appengine%[email protected]<google-appengine%[email protected]> > > > > > > > . > > > > > > For more options, visit this group at > > > > > >http://groups.google.com/group/google-appengine?hl=en. > > > > > -- > > > > You received this message because you are subscribed to the Google > > > > Groups > > > > "Google App Engine" group. > > > > To post to this group, send email to [email protected]. > > > > To unsubscribe from this group, send email to > > > > [email protected]<google-appengine%[email protected]> > > > > . > > > > For more options, visit this group at > > > >http://groups.google.com/group/google-appengine?hl=en. -- You received this message because you are subscribed to the Google Groups "Google App Engine" group. To post to this group, send email to [email protected]. To unsubscribe from this group, send email to [email protected]. For more options, visit this group at http://groups.google.com/group/google-appengine?hl=en.
