Hi Larry
I am wondering about writing a Servlet that would form/multi-part
upload large files and cache them in memcache then use the
cron API to trickle persist them into the DS over time ...
I've been thinking about using something like this as well. I think
you could likely cache the
Exactly!
I was hoping this update (
http://code.google.com/p/datanucleus-appengine/issues/detail?id=7
) would seriously improve bulk inserts. As it seems in practice you
can now do roughly 2-3 times as many inserts in the same ammount of
real and CPU time.
However this is still poor compared
I am wondering about writing a Servlet that would form/multi-part
upload large files and cache them in memcache then use the
cron API to trickle persist them into the DS over time ...
could maybe even get adventurous and put a filesystem-like API
over the cache ...
lemme know if anyone would be
I tried doing a bulk load with the JDO makePersistentAll(..) call
yesterday ...
by default what I did was created a List of size 2048, filled it to
capacity and then called makePersistentAll() ... I got an
IllegalArgumentException out of that call stating that you could
only persist at most 500
So now, I am hitting Datastore timeouts and Request timeouts ...
I really really think you guys need to add a mechanism that allows
developers to simply do bulk uploads of data into their GAE
applications (from Java thank you).
:)
On Sep 11, 9:06 am, Larry Cable larry.ca...@gmail.com wrote:
I
Yes. If you need to be able to rollback in case one or more entities don't
get written, you'll need to use transactions. If you use transactions, your
entities must belong to the same entity group or else an exception will be
thrown. You'll get better performance if you do this outside of a
Your two quick notes seem to be contradictory. In order to use
transactions, don't all of the entities have to be in the same entity
group?
Vince
On Fri, Sep 4, 2009 at 8:24 PM, Jason (Google)apija...@google.com wrote:
Batch puts are supported, yes, and as of yesterday's release, calling
Batch puts are supported, yes, and as of yesterday's release, calling
makePersistentAll (JDO) and the equivalent JPA call will take advantage of
this support (previously, you had to use the low-level API).
Two quick notes:
1) All of the entities that you're persisting should be in separate
