And as Robert said, keeping your property names short will also help. I use 3-4 character property names myself. Most are only 3 characters except for one entity kind. Also, entity names (kinds) are also kept in every key so you should use short entity (kind) names. I use 2 character names myself. The app id is also in every key so ideally that should be short but since there isn't yet custom support for https and the user will see the appspot.com url trying to keep that short isn't as easy as the other things since you want your users to see a descriptive url. Also, I keep my own relationships and don't store KEYs in my fields since these keys have the overhead of app Id, namespace, etc. Using some of these tricks may help you get your storage usage down. Stephen
On Fri, May 6, 2011 at 11:44 AM, Edward Hartwell Goose <[email protected]>wrote: > Brilliant, thanks Stephen. > > > > On May 6, 6:18 pm, Stephen Johnson <[email protected]> wrote: > > Hi Ed, > > To use a property in an explicitly written index that property must also > be > > individually indexed. > > Stephen > > > > On Fri, May 6, 2011 at 10:10 AM, Edward Hartwell Goose > > <[email protected]>wrote: > > > > > > > > > > > > > > > > > Thanks Robert, I've starred that issue. > > > > > I wouldn't say each of the property names is particularly long > > > (probably 10-15 chars) but I suppose over a huge index this multiplies > > > up. I'm surprised that its 7GB for only one entity and it's property > > > names. Very surprised. > > > > > Other than naming every property a one letter char (a, b, c etc), is > > > there any other solution? > > > > > As for the unindexing - how does that affect explicitly written > > > indexes in the datastore-indexes file? If I remove indexing on all the > > > properties, but explicitly write the 5 queries in datastore-indexes, > > > will that still work? > > > > > Thanks for the help, > > > Ed > > > > > On May 6, 4:28 pm, Robert Kluin <[email protected]> wrote: > > > > Hey Edward, > > > > First, you should probably star issue 2740. Space used by indexes > > > > is *not* included in your datastore statistics. > > > > http://code.google.com/p/googleappengine/issues/detail?id=2740 > > > > > > Every property name is stored in every entity. So if you use long > > > > descriptive property names you'll have lots of metadata. The > property > > > > names are also stored in your indexes, which can really multiply your > > > > data! So the difference between your stored data on the quota page > > > > and the size of all entities in the statistics, less your blobstore > > > > and stored tasks, is probably pretty close to the size of your > > > > indexes. If we could see stats on our indexes we'd know for sure > > > > though, so star 2740. > > > > > > You can reduce the space by explicitly disabling indexes on any > > > > fields you're not querying or ordering by. You'll have to reput all > > > > of your data to reclaim the space already used. > > > > > > Also, don't forget, stored tasks also count against the stored data > > > quota. > > > > > > Robert > > > > > > On Fri, May 6, 2011 at 08:44, Edward Hartwell Goose < > [email protected]> > > > wrote: > > > > > > > I've partially answered my own question: > > > > > "The "Metadata" property type represents space consumed by storing > > > > > properties inside an entry that is not used by the properties > > > directly." > > > > > But I don't quite follow what this means? > > > > > The entity that has the most meta data consists of several > booleans, > > > between > > > > > 2 and 3 keys, a list of up to 60 Strings and an accompanying list > of up > > > to > > > > > 13 Strings, and it is a child of a parent entity. > > > > > What does the above statement mean in this context? > > > > > > > -- > > > > > You received this message because you are subscribed to the Google > > > Groups > > > > > "Google App Engine" group. > > > > > To post to this group, send email to > [email protected] > > > . > > > > > To unsubscribe from this group, send email to > > > > > [email protected]. > > > > > For more options, visit this group at > > > > >http://groups.google.com/group/google-appengine?hl=en. > > > > > -- > > > You received this message because you are subscribed to the Google > Groups > > > "Google App Engine" group. > > > To post to this group, send email to [email protected] > . > > > To unsubscribe from this group, send email to > > > [email protected]. > > > For more options, visit this group at > > >http://groups.google.com/group/google-appengine?hl=en. > > -- > You received this message because you are subscribed to the Google Groups > "Google App Engine" group. > To post to this group, send email to [email protected]. > To unsubscribe from this group, send email to > [email protected]. > For more options, visit this group at > http://groups.google.com/group/google-appengine?hl=en. > > -- You received this message because you are subscribed to the Google Groups "Google App Engine" group. To post to this group, send email to [email protected]. To unsubscribe from this group, send email to [email protected]. For more options, visit this group at http://groups.google.com/group/google-appengine?hl=en.
