It is about the same speed. I've just uploaded 500,000 entities in
about 4 hours (over a very slow connection) but my batch size was only
50 - perhaps larger batches would be faster.
The new Mapping API sounds like the ideal solution but it is python
only at the moment. You could use the Blobstore to roll your own
using the Deferred class to process a byte range at a time.
On 11 Jul 2010, at 01:35, Peter Ondruska wrote:
John, is Remote Datastore faster than Python bulk insert? I tried to
load millions of entities using Python but had to give up as it took
about an hour to load just 100K. Peter
On Jul 10, 4:22 pm, John Patterson <[email protected]> wrote:
You can use the RemoteDatastore to do bulk puts directly from your
desktop to the live datastore. It is extremely fast as it simply
forwards on the binary protocol buffer data from one environment to
another.
http://code.google.com/p/remote-datastore/
On 10 Jul 2010, at 20:06, Robert Lancer wrote:
What I would do is create a servlet that accepts a row or rows of
the
spreadsheet as params, and then create a local java app to read from
the spreadsheet and gradually feed the spreadsheet to the servlet,
app
engine accepts up to 500 entities in a put.
On Jul 10, 7:56 am, Ice13ill <[email protected]> wrote:
I want to upload big number of objects (from an xls file) into
datastore. What is the best way (least time consuming) for
inserting
and deleting a collection of entities ?
--
You received this message because you are subscribed to the Google
Groups "Google App Engine for Java" group.
To post to this group, send email to [email protected]
.
To unsubscribe from this group, send email to
[email protected]
.
For more options, visit this group
athttp://groups.google.com/group/google-appengine-java?hl=en
.
--
You received this message because you are subscribed to the Google
Groups "Google App Engine for Java" group.
To post to this group, send email to [email protected]
.
To unsubscribe from this group, send email to [email protected]
.
For more options, visit this group at http://groups.google.com/group/google-appengine-java?hl=en
.
--
You received this message because you are subscribed to the Google Groups "Google
App Engine for Java" group.
To post to this group, send email to [email protected].
To unsubscribe from this group, send email to
[email protected].
For more options, visit this group at
http://groups.google.com/group/google-appengine-java?hl=en.
