It still sounds somewhat unlikely since with 15MB we're talking of a more than 60x total expansion. The application has about 15 unindexed properties (I had already set a lot of properties to unindexed, precisely to save storage quota) and according to the datastore statistics, most of the data is on the large properties.
Is there anywhere where you can see the space effectively being consumed by indexes? One thing I noticed -- when I'm "500 server errors" from the dashboard -- is that on the Logs section it says that the app's using 100% of logs storage (which is not true, because I'm using only ~115MB and the first 1GB are supposed to be free -- http://googleappengine.blogspot.pt/2012/02/app-engine-163-released.html). I can't find the logs storage size anywhere else on the dashboard, quota details or billing history. Could this be the reason? On Friday, March 23, 2012 4:45:17 PM UTC, Jeff Schnitzer wrote: > > If you have not optimized your indexes, they will almost always > account for the bulk of your data storage. > > Most of the datastore APIs (python db, ndb, java low-level, jdo/jpa, > etc) default to creating two indexes (asc and desc) on every property. > Each of these index entries represents another row in a BigTable > tablet; for small entities, each of these rows are only slightly > smaller than the master blob. So 5 indexed properties could easily > cause a 5-10X expansion in your total stored data volume. > > You can't vacuum these indexes; unlike multi-property indexes defined > in datastore-indexes.xml/yaml, single-property indexes are established > when you save an entity and are only deleted by resaving the entity. > > If you are concerned about space (or datastore write operations), you > should go through your data model and flag any properties you aren't > querying on as unindexed. Then you will need to resave your entities > to reclaim index space. > > Jeff > > > -- You received this message because you are subscribed to the Google Groups "Google App Engine" group. To view this discussion on the web visit https://groups.google.com/d/msg/google-appengine/-/tH1GjO7dBo8J. To post to this group, send email to [email protected]. To unsubscribe from this group, send email to [email protected]. For more options, visit this group at http://groups.google.com/group/google-appengine?hl=en.
