[google-appengine] Datastore contention on bulkloader upload.

2010-08-19 Thread zachary militage
Hi, I have been getting contention errors when uploading data into the datastore (note I have tuned the defaults which have worked for other Kinds): Note: I am using app engine release 1.3.6 for Mac OS X. --- Uploading data records. [INFO] Logging to bulkloader-log-20100819.113509 [INFO

[google-appengine] Datastore contention

2010-03-13 Thread vivpuri
Error rate on my app is way way too high for the past 16 hours. Getting tons of: too much contention on these datastore entities. please try again. Appengine status page does show Anamoly for datastore. AppEngine team, please let know what's going on there. Any estimates on fix for this issue

Re: [google-appengine] Datastore contention on indexes?

2010-03-10 Thread Nick Johnson (Google)
Hi Nickolas, On Wed, Mar 10, 2010 at 12:28 AM, Nickolas Daskalou n...@daskalou.comwrote: I remember reading a thread not long ago ( http://groups.google.com/group/google-appengine/browse_thread/thread/f69fe7dc4a9bc2ec) about how put()'ing entities with near-sequential key names or IDs could

Re: [google-appengine] Datastore contention on indexes?

2010-03-10 Thread Nickolas Daskalou
Hi Nick, Thanks for the reply. I've got a few question below that I'm hoping you can answer. On 10 March 2010 22:10, Nick Johnson (Google) nick.john...@google.comwrote: Hi Nickolas, On Wed, Mar 10, 2010 at 12:28 AM, Nickolas Daskalou n...@daskalou.comwrote: I remember reading a thread not

Re: [google-appengine] Datastore contention on indexes?

2010-03-10 Thread Nick Johnson (Google)
On Wed, Mar 10, 2010 at 12:35 PM, Nickolas Daskalou n...@daskalou.comwrote: Hi Nick, Thanks for the reply. I've got a few question below that I'm hoping you can answer. On 10 March 2010 22:10, Nick Johnson (Google) nick.john...@google.comwrote: Hi Nickolas, On Wed, Mar 10, 2010 at 12:28

Re: [google-appengine] Datastore contention on indexes?

2010-03-10 Thread Nickolas Daskalou
Great, thanks again Nick! On 10 March 2010 23:47, Nick Johnson (Google) nick.john...@google.comwrote: On Wed, Mar 10, 2010 at 12:35 PM, Nickolas Daskalou n...@daskalou.comwrote: Hi Nick, Thanks for the reply. I've got a few question below that I'm hoping you can answer. On 10 March 2010

[google-appengine] Datastore contention

2009-12-11 Thread Nickolas Daskalou
After reading these two articles: Avoiding datastore contention: http://code.google.com/appengine/articles/scaling/contention.html Sharding counters: http://code.google.com/appengine/articles/sharding_counters.html I'm a little confused at to what causes datastore contention, and how to design

Re: [google-appengine] Datastore contention

2009-12-11 Thread Jeff Schnitzer
An entity group is a group of objects, not classes. If Article#1237 and its comments are in a single entity group, then yes you'll have trouble with more 100 comments per second. Simple solution: Don't put the comments in the article's entity group. Jeff On Fri, Dec 11, 2009 at 12:31 AM,