Hi,

On Mon, Mar 22, 2010 at 8:45 PM, homunq <[email protected]> wrote:

> OK, after hashing it out on IRC, I see that I have to erase my data
> and start again.


Why is that? Wouldn't updating the data be a better option?


> Since it took me 3 days of CPU quota to add the data,
> I want to know if I can erase it quickly.
>
> 1. Is the overhead for erasing data (and thus whittling down indexes)
> over half the overhead from adding it? Under 10%? Or what? (I don't
> need exact numbers, just approximates.
>

It should be significantly lower - you can do a keys-only query, and delete
the returned keys.

-Nick Johnson


>
> 2. If it's more like half - is there some way to just nuke all my data
> and start over?
>
> Thanks,
> Jameson
>
>
> On 22 mar, 03:42, "Nick Johnson (Google)" <[email protected]>
> wrote:
> > Hi,
> >
> > The discrepancy between datastore stats volume and stored data is
> generally
> > due to indexing overhead, which is not included in the datastore stats.
> This
> > can be very high for entities with many properties, or with long entity
> and
> > property names or entity keys. Do you have reason to suppose that's not
> the
> > case in your situation?
> >
> > -Nick Johnson
> >
> >
> >
> >
> >
> > On Sun, Mar 21, 2010 at 3:39 AM, homunq <[email protected]> wrote:
> > > Something is wrong. My app is showing with 7.42GB of total stored
> > > data, but only 615 MB of datastore. There is only one version string
> > > uploaded, which is almost 150MB, and nothing in the blobstore. This
> > > discrepancy has been getting worse - several hours ago (longer than
> > > the period since datastore statistics were updated, if you're
> > > wondering), there were the same 615 MB in the datastore, and only
> > > 3.09GB of "total stored data". (at that time, my theory was that it
> > > was old uploads of tweaks to the same "version" - but the numbers have
> > > gone far, far beyond that explanation now.) It's not some exploding
> > > index; the only non-default index I have is on an entity type with
> > > just 33 entities.
> >
> > > Here's the line from my dashboard:
> > > Total Stored Data        $0.005/GByte-day                82%     7.42
> of
> > > 9.00 GBytes
> > > $0.04 / $0.04
> >
> > > And here is the word from my datastore statistics:
> > > Last updated    Total number of entities        Size of all entities
> > > 1:32:13 ago     232,867 615 MBytes
> > > (metadata 11%, if that matters)
> >
> > > Please, can someone help me figure out this issue? I'd be happy to
> > > share any info or code which would help track this down. My app id is
> > > vulahealth.
> >
> > > --
> > > You received this message because you are subscribed to the Google
> Groups
> > > "Google App Engine" group.
> > > To post to this group, send email to [email protected]
> .
> > > To unsubscribe from this group, send email to
> > > [email protected]<google-appengine%[email protected]><google-appengine%2Bunsubscrib
> [email protected]>
> > > .
> > > For more options, visit this group at
> > >http://groups.google.com/group/google-appengine?hl=en.
> >
> > --
> > Nick Johnson, Developer Programs Engineer, App Engine
> > Google Ireland Ltd. :: Registered in Dublin, Ireland, Registration
> Number:
> > 368047
>
> --
> You received this message because you are subscribed to the Google Groups
> "Google App Engine" group.
> To post to this group, send email to [email protected].
> To unsubscribe from this group, send email to
> [email protected]<google-appengine%[email protected]>
> .
> For more options, visit this group at
> http://groups.google.com/group/google-appengine?hl=en.
>
>


-- 
Nick Johnson, Developer Programs Engineer, App Engine
Google Ireland Ltd. :: Registered in Dublin, Ireland, Registration Number:
368047

-- 
You received this message because you are subscribed to the Google Groups 
"Google App Engine" group.
To post to this group, send email to [email protected].
To unsubscribe from this group, send email to 
[email protected].
For more options, visit this group at 
http://groups.google.com/group/google-appengine?hl=en.

Reply via email to