Re: [google-appengine] Re: Billing Blanace

2012-04-23 Thread Ikai Lan (Google)
That's right. It's a credit we gave to customers after we enabled the new billing a few months ago. -- Ikai Lan Developer Programs Engineer, Google App Engine plus.ikailan.com On Mon, Apr 23, 2012 at 3:13 AM, foxyf fnv...@yahoo.com wrote: Ok, I see, so Google will charge me automatically ?

[google-appengine] 1.6.5 Prerelease SDKs now available!

2012-04-17 Thread Ikai Lan (Google)
Hey everyone, The App Engine 1.6.5 prerelease SDKs are now available. You can get them here: Python: http://code.google.com/p/googleappengine/downloads/detail?name=google_appengine_1.6.5_prerelease.zip Java:

Re: [google-appengine] Possible to upload static files separately?

2012-04-10 Thread Ikai Lan (Google)
No, this isn't currently possible. One thing you might want to look into would be to write a script that downloads the latest revision and pushes the code via appcfg.sh. When you do an upload, the script looks for files that have changed (via hashing contents) and only uploads those files.

Re: [google-appengine] Re: 1.6.4 App Engine Release is Out!

2012-04-05 Thread Ikai Lan (Google)
Hey everyone, We pushed a new version of this SDK, Java version 1.6.4.1: http://code.google.com/p/googleappengine/downloads/detail?name=appengine-java-sdk-1.6.4.1.zip This version fixes a performance regression in the Java SDK on dev_appserver startup. We're updating the downloads page as I

[google-appengine] Early access to Page Speed Service for Google App Engine

2012-03-21 Thread Ikai Lan (Google)
Hey App Engine developers, We’re working on a new feature to help out your front-end development efforts. We’ve been working with the Google Page Speed team ( https://developers.google.com/pagespeed/service) to bring Page Speed Service to your App Engine applications. When enabled, this feature

Re: [google-appengine] Re: Fwd: 1.6.4 Prerelease Now Available

2012-03-20 Thread Ikai Lan (Google)
I'm hoping you guys saw this: - Billed applications which have specified additional logs storage over 1 GB are now being charged for that storage at $0.24/GB/month. What's actually happening is that we are hiding logs, but once 1.6.4 is released, we will be deleting logs greater than 1gb. With

Re: [google-appengine] Re: timed out on datastore operations!

2012-03-15 Thread Ikai Lan (Google)
Deployment issues are generally independent of datastore issues. Are you running on high replication datastore or master/slave datastore? -- Ikai Lan Developer Programs Engineer, Google App Engine plus.ikailan.com On Thu, Mar 15, 2012 at 10:54 AM, Tom Davis t...@recursivedream.com wrote:

Re: [google-appengine] Very high latency since March 13th

2012-03-15 Thread Ikai Lan (Google)
I see. Let's continue watching this to look for trends. Please post if it fluctuates either higher or lower. -- Ikai Lan Developer Programs Engineer, Google App Engine plus.ikailan.com On Thu, Mar 15, 2012 at 4:19 AM, andidol andreas.dolin...@gmail.com wrote: I'm doing a

Re: [appengine-java] Re: datastore

2012-03-14 Thread Ikai Lan (Google)
Hi, I've sort of soft closed this group. I was supposed to put it into read-only mode a week ago, but I wanted to see if questions would still trickle in. This type of question seems pretty good for StackOverflow, where we're increasing our efforts to grow the community there. Try posting it and

Re: [appengine-java] How to initialize class guestbook.PMF ?

2012-03-14 Thread Ikai Lan (Google)
Hi, This might be a good question for StackOverflow. We're trying to migrate these types of questions over there: https://groups.google.com/forum/#!topic/google-appengine/Z6XN_64cA7w Likely: 1. It doesn't exist 2. You are importing it incorrectly -- Ikai Lan Developer Programs Engineer,

Re: [google-appengine] Re: Memcache issues 3/14

2012-03-14 Thread Ikai Lan (Google)
Can you describe the issues and post an app ID? Ex: Expected: Memcache performs with under a 0.1% error rate typically on GET Observed: Memcache times out after 5 seconds on 10% of GETs If there are specific reproduction steps, those are very useful too (we're all software engineers too, so it

Re: [google-appengine] SITE SLOW AND DOWN

2012-03-14 Thread Ikai Lan (Google)
Tony, A stack trace is usually not enough information. I've seen you post in another thread. Can you follow those steps? -- Ikai Lan Developer Programs Engineer, Google App Engine plus.ikailan.com On Wed, Mar 14, 2012 at 8:45 AM, agp tonypar...@gmail.com wrote: I am getting a ton of issues

Re: [google-appengine] Re: How to secure the SDK

2012-03-14 Thread Ikai Lan (Google)
This is a great question for StackOverflow because you'll get a lot more responses if you tag it correctly. On Linux you have a lot of options. One of the easiest ones is iptables. Well ... easiest. PERSONAL OPINION ALERT: I highly recommend learning Linux or working with a *nix system. I find

Re: [google-appengine] Re: Outages?

2012-03-14 Thread Ikai Lan (Google)
We've been working on addressing the issues with HRD apps. Your experience is probably a coincidence. There is a very small section of apps that will have a few requests (very small %) that will be a LOT slower. We've scheduled a maintenance period for March 19th that will attempt to address

Re: [google-appengine] High Replication latencies and it's related costs.

2012-03-14 Thread Ikai Lan (Google)
Can you post the code about what you are doing? Simple read and write isn't descriptive enough. There have been issues with High Replication, but these are/have been addressed. -- Ikai Lan Developer Programs Engineer, Google App Engine plus.ikailan.com On Tue, Mar 13, 2012 at 9:17 PM,

Re: [google-appengine] Very high latency since March 13th

2012-03-14 Thread Ikai Lan (Google)
We're addressing issues with high replication datastore applications. In the future, however, this information is typically not enough. What are you doing? Are you making datastore calls? Are you doing URLFetch? Are you making XMPP or email API calls? Are CPU intensive tasks slower? This is

Re: [google-appengine] Design problem - How to avoid datastore contention

2012-03-14 Thread Ikai Lan (Google)
Looks like it was answered, and pretty well, too. In general, it's not really necessary to post both to StackOverflow and groups. -- Ikai Lan Developer Programs Engineer, Google App Engine plus.ikailan.com On Wed, Mar 14, 2012 at 3:48 AM, Sahid Orentino Ferdjaoui sahid.ferdja...@gmail.com

Re: [google-appengine] Re: Datastore offline as of 3:40pm PST

2012-03-14 Thread Ikai Lan (Google)
I've updated the status page for the network disruption yesterday: http://code.google.com/status/appengine Dishonesty is not the intention. There's been talk about rebuilding the status site from scratch because a lot of the reporting could use improvement - there's a view some team members

Re: [google-appengine] Java Error code 104: A problem was encountered with the process that handled this request, causing it to exit

2012-03-14 Thread Ikai Lan (Google)
Matt, There was definitely an issue with Java HRD when you posted this. We've been addressing these issues. Are you still seeing issues? -- Ikai Lan Developer Programs Engineer, Google App Engine plus.ikailan.com On Mon, Mar 12, 2012 at 3:43 PM, Matt Mastracci m...@chee.rs wrote: Hey all,

Re: [google-appengine] using GAE with javascript

2012-03-14 Thread Ikai Lan (Google)
I wouldn't say dancing - we just don't provide that kind of access. Even if we ever did in the future, we would likely wrap an auth layer around it (probably OAuth 2.0). This might be the closest thing you are looking for: http://code.google.com/p/google-protorpc/ But I don't have any thoughts

Re: [google-appengine] Channel API not working in production

2012-03-14 Thread Ikai Lan (Google)
Praveen, Try asking this question on StackOverflow: https://groups.google.com/forum/?fromgroups#!topic/google-appengine/Z6XN_64cA7w Also, it would be helpful to provide more details when you do. It sucks is terrible information. That kind of feedback is not actionable. -- Ikai Lan Developer

Re: [google-appengine] Is it possible to query Datastore by parameter of Date?

2012-03-14 Thread Ikai Lan (Google)
Tony, Try asking this question on StackOverflow with the google-app-engine tag: https://groups.google.com/forum/?fromgroups#!topic/google-appengine/Z6XN_64cA7w -- Ikai Lan Developer Programs Engineer, Google App Engine plus.ikailan.com On Sun, Mar 11, 2012 at 6:50 PM, Tony Yang

Re: [google-appengine] Do maintentance periods really have to be during core working hours?

2012-03-14 Thread Ikai Lan (Google)
Our next maintenance period is from 6-8pm, but that's a coincidence more than any other reason. First off, we really want to encourage you to migrate to High Replication. I can't stress this enough. This allows us to do lots of work to App Engine without impacting your application's service. I

Re: [google-appengine] Re: Memcache issues 3/14

2012-03-14 Thread Ikai Lan (Google)
What do you expect to happen? What are you putting? What percentage of errors are you seeing? Is this still happening? -- Ikai Lan Developer Programs Engineer, Google App Engine plus.ikailan.com On Wed, Mar 14, 2012 at 1:10 PM, Sekhar allur...@gmail.com wrote: Sure, thanks for responding.

Re: [google-appengine] More then 100 complains and no feedback from Google. Was: Outages?

2012-03-14 Thread Ikai Lan (Google)
Mos, There have been several responses posted to various threads. I'll go back to those threads and update if there is new information. The disruption to HRD has been posted to the System Status site, and a new maintenance period has been announced on Monday to deal with Master/Slave serving

Re: [google-appengine] Re: Memcache issues 3/14

2012-03-14 Thread Ikai Lan (Google)
entities) on the log between 8:06am and 8:12am today, and no errors since. Thanks, -Sekhar On Wed, Mar 14, 2012 at 1:31 PM, Ikai Lan (Google) ika...@google.comwrote: What do you expect to happen? What are you putting? What percentage of errors are you seeing? Is this still happening

Re: [google-appengine] Re: using GAE with javascript

2012-03-14 Thread Ikai Lan (Google)
javascript and HTML5. Is there a reason that I've missed? Help me out here - I just don't understand the omission... On Mar 14, 1:40 pm, Ikai Lan (Google) ika...@google.com wrote: I wouldn't say dancing - we just don't provide that kind of access. Even if we ever did in the future, we

Re: [google-appengine] Re: Outages?

2012-03-12 Thread Ikai Lan (Google)
Hi Riley, That's a legitimate question, and one that we haven't officially answered yet. It's certainly the direction that things have been moving simply due to the nature of production management. Given that the SLA applies to HRD and not master/slave applications, you are definitely going to

Re: [google-appengine] Re: Outages?

2012-03-12 Thread Ikai Lan (Google)
On Mon, Mar 12, 2012 at 11:52 AM, Ikai Lan (Google) ika...@google.comwrote: Hi Riley, That's a legitimate question, and one that we haven't officially answered yet. It's certainly the direction that things have been moving simply due to the nature of production management. Given that the SLA

Re: [google-appengine] Re: Error code 202

2012-03-12 Thread Ikai Lan (Google)
for the next request to your application. (Error code 202) On Sat, Mar 10, 2012 at 12:04 AM, Ikai Lan (Google) ika...@google.com wrote: I've taken a look at some of the High Replication app IDs posted publicly and haven't found instances of this (instances exiting because

Re: [google-appengine] Re: Outages?

2012-03-12 Thread Ikai Lan (Google)
...@gmail.comwrote: Thanks a lot. FYI: That post says Wednesday the 19th instead of Monday the 19th. Riley On Mon, Mar 12, 2012 at 3:52 PM, Ikai Lan (Google) ika...@google.comwrote: Regarding that maintenance period: https://groups.google.com/forum/?fromgroups#!topic/google-appengine-downtime-notify

Re: [google-appengine] Re: Outages?

2012-03-12 Thread Ikai Lan (Google)
HRD is not 3x more expensive. We lowered the cost to make it match the master/slave cost. -- Ikai Lan Developer Programs Engineer, Google App Engine plus.ikailan.com On Mon, Mar 12, 2012 at 2:33 PM, Amit Sangani amit.sang...@gmail.comwrote: Hi Ikan, We wouldn't mind moving to HRD from M/S,

Re: [google-appengine] Re: Outages?

2012-03-12 Thread Ikai Lan (Google)
at 1:59 PM, Ikai Lan (Google) ika...@google.comwrote: GAH, it's like no matter how many times I read these things over I always make at least one mistake. And that's why code review is a Good Thing. -- Ikai Lan Developer Programs Engineer, Google App Engine plus.ikailan.com On Mon, Mar

Re: [google-appengine] Re: Error code 202

2012-03-12 Thread Ikai Lan (Google)
:57 PM, Ikai Lan (Google) ika...@google.comwrote: Okay, separating two topics here: Java HRD applications: we've been working on the issue with instance deaths. Ideally, these issues will be resolved very shortly. Thanks to everyone who provided information. I know there's been some discussion

Re: [google-appengine] Feature request: stable version

2012-03-09 Thread Ikai Lan (Google)
Hi Richard, Thanks for bringing this up. This is something that we've talked about doing. What's really great about this idea is that if we do the work for this, we could also have an experimental cluster that doesn't provide an SLA or serving guarantees but provides new features - this would

Re: [google-appengine] Re: Outages?

2012-03-09 Thread Ikai Lan (Google)
Hey everyone, Here are a few things that will help: 1. Application IDs (--- if you have nothing else, at least provide this) 2. What is your QPS? 3. What % of your requests are errors? -- Ikai Lan Developer Programs Engineer, Google App Engine plus.ikailan.com On Fri, Mar 9, 2012 at 7:24 AM,

Re: [google-appengine] Re: 500 errors + high latency + please communicate with us

2012-03-09 Thread Ikai Lan (Google)
Are you guys seeing any particular errors in the logs or other observed strange behavior? Thanks for providing an application ID, it'll make it easier for us to look into this. There seem to be several parallel issues occurring. It's still unclear to me whether or not they are related. We need to

Re: [google-appengine] Re: Outages?

2012-03-09 Thread Ikai Lan (Google)
Alex, to answer that question: yes. We are looking to revamp the production issues tracker which is far from optimal. When users can join or aggregate issues, it allows us to quickly separate actual infrastructure hiccups from user code issues. Thanks for the info! Is there any other behavior you

Re: [google-appengine] Re: 500 errors + high latency + please communicate with us

2012-03-09 Thread Ikai Lan (Google)
are using master/slave Thanks, Luis On 9 mar, 20:18, Ikai Lan (Google) ika...@google.com wrote: Are you guys seeing any particular errors in the logs or other observed strange behavior? Thanks for providing an application ID, it'll make it easier for us to look into this. There seem

Re: [google-appengine] Re: Outages?

2012-03-09 Thread Ikai Lan (Google)
I forgot to ask if these were master/slave or high replication apps. I can always check by going to the admin console, but I'm hoping to separate them out. We're looking into the HR apps first (one I figure out which is which). -- Ikai Lan Developer Programs Engineer, Google App Engine

Re: [google-appengine] Re: Outages?

2012-03-09 Thread Ikai Lan (Google)
On Fri, Mar 9, 2012 at 2:12 PM, Amit Sangani amit.sang...@gmail.com wrote: textyserver is on master/slave. On Fri, Mar 9, 2012 at 2:07 PM, Ikai Lan (Google) ika...@google.comwrote: I forgot to ask if these were master/slave or high replication apps. I can always check by going to the admin

Re: [google-appengine] Re: Outages?

2012-03-09 Thread Ikai Lan (Google)
. -- Ikai Lan Developer Programs Engineer, Google App Engine plus.ikailan.com On Fri, Mar 9, 2012 at 2:14 PM, Ikai Lan (Google) ika...@google.com wrote: Yep, I figured it out (when you look at an app in the admin console, if the app ID has a s~ prefix, that means it runs in High Replication). I

Re: [google-appengine] Re: Error code 202

2012-03-09 Thread Ikai Lan (Google)
I've taken a look at some of the High Replication app IDs posted publicly and haven't found instances of this (instances exiting because of error code 202) recently. It looks to have stabilized as of ~15 hours ago. If you have a master/slave application that continues to exhibit this behavior,

Re: [google-appengine] Reminder: maintenance period from 4pm-8pm PST today (7th March)

2012-03-07 Thread Ikai Lan (Google)
Would you be satisfied with a maybe? ;) -- Ikai Lan Developer Programs Engineer, Google App Engine plus.ikailan.com On Wed, Mar 7, 2012 at 11:50 AM, Jeff Schnitzer j...@infohazard.org wrote: On Wed, Mar 7, 2012 at 1:58 PM, Amy Unruh amyu+gro...@google.com wrote: 4:30pm-8:00pm PST - The

Re: [appengine-java] RestMQ on GAE

2012-03-05 Thread Ikai Lan (Google)
A quick search digs up this: https://github.com/gleicon/restmq-appengine Warning: I haven't tried the app yet. Also - just a quick note: we will be turning this group (google-appengine-java) read-only very soon as part of our migration of QA to StackOverflow. See more details here:

Re: [appengine-java] RestMQ on GAE

2012-03-05 Thread Ikai Lan (Google)
, Google App Engine plus.ikailan.com On Mon, Mar 5, 2012 at 5:00 PM, Ikai Lan (Google) ika...@google.com wrote: A quick search digs up this: https://github.com/gleicon/restmq-appengine Warning: I haven't tried the app yet. Also - just a quick note: we will be turning this group (google

Re: [google-appengine] Appengine 1.6.3 Python 2.7 - Error 404

2012-03-02 Thread Ikai Lan (Google)
There shouldn't be. If you go over quota GAE should return a 503 error. This is a long shot, but any chance you have accidentally enabled traffic splitting? This is a new feature that allows you to very easily do A/B testing:

Re: [appengine-java] how to beata open to certain country

2012-02-21 Thread Ikai Lan (Google)
App Engine provides a geolocation header. Check this out: http://googleappengine.blogspot.com/2011/06/app-engine-151-release.html It's a best effort geo-IP mapping. Give it a try. -- Ikai Lan Developer Programs Engineer, Google App Engine plus.ikailan.com On Mon, Feb 20, 2012 at 6:12 PM,

Re: [appengine-java] GAE + Cloud SQL + Hibernate

2012-02-14 Thread Ikai Lan (Google)
On Tue, Feb 14, 2012 at 10:12 AM, Paul Ford paul.f...@mavenwave.com wrote: Ikai, This is great so Hibernate on GAE works for Cloud SQL but not Datastore. I understand. Thanks paul On Tue, Feb 14, 2012 at 11:57 AM, Ikai Lan (Google) ika...@google.comwrote: Hibernate works. I've gotten Cloud

Re: [appengine-java] max keys for memcache

2012-02-13 Thread Ikai Lan (Google)
There isn't a limit per se (that I know of), but our implementation of Memcache has two LRU (least recently used) queues that are used to expire content based on recency of access: a global LRU for that particular Memcache instance, and an LRU for your app. The amount of memory used is subject to

Re: [google-appengine] Re: Google App Engine community support is moving to Stack Overflow

2012-02-13 Thread Ikai Lan (Google)
Supercobra, I share your concerns about streamlining the user experience. As it stands, the user experience isn't great: you have groups, StackOverflow, billing issues forms, abuse forms, the public issues tracker, Google Groups, Reddit ... I could probably go on. The move to StackOverflow isn't

Re: [google-appengine] Full Text Search Options

2012-02-10 Thread Ikai Lan (Google)
Jon, How do you feel about backends? I don't know how big the word documents are, but at that scale you might be able to get away with a small backend that you run persistently with an in-memory Lucene or Whoosh instance. Alternatively, about a year ago I did a couple of experiments hosting Solr

Re: [google-appengine] Re: Google App Engine community support is moving to Stack Overflow

2012-02-09 Thread Ikai Lan (Google)
Brandon, can you set your font back to normal? For some reason I find that my eyes tend to scan past the blue Times New Roman (that is Times, right?). I don't want to miss your messages because the more you post, the more ammunition I can collect for trolling you =P. Jeff, a few of us are using

Re: [google-appengine] Python Devs near Phoenix AZ (or remote)

2012-02-09 Thread Ikai Lan (Google)
Hey, congrats, Brandon! Best of luck. I'm guessing you're posting here because this is launching on GAE? It wasn't clear in the original email. -- Ikai Lan Developer Programs Engineer, Google App Engine plus.ikailan.com On Wed, Feb 8, 2012 at 11:36 PM, Brandon Wirtz drak...@digerat.com wrote:

Re: [google-appengine] Re: Problem with mail quota

2012-02-09 Thread Ikai Lan (Google)
We're running a batch job right now to fix the issue. Stay tuned. -- Ikai Lan Developer Programs Engineer, Google App Engine plus.ikailan.com On Thu, Feb 9, 2012 at 2:07 PM, Greg g.fawc...@gmail.com wrote: I have a large (paid) quota for email, and got a quota exception two hours ago. I'm

Re: [google-appengine] check number of users (sessions) using my sight

2012-02-09 Thread Ikai Lan (Google)
You should be able to look at the number of sessions in the datastore (this uses the _ah_session Kind), but I don't know how useful this information will be for you. What information are you trying to find? -- Ikai Lan Developer Programs Engineer, Google App Engine plus.ikailan.com On Thu, Feb

Re: [appengine-java] Batch puts

2012-02-08 Thread Ikai Lan (Google)
App Engine plus.ikailan.com On Tue, Feb 7, 2012 at 4:53 PM, Andrew Myers am2...@gmail.com wrote: Thanks Ikai. Appreciate the clarification! All the best, Andrew. On 8 February 2012 11:42, Ikai Lan (Google) ika...@google.com wrote: Andrew, multiple writes of entities in a single batch

Re: [google-appengine] Re: ADWords Support/ Unified Login Are Still Idiots

2012-02-08 Thread Ikai Lan (Google)
Jeff, I was just talking about payment problems with a friend the other day. A mutual acquaintance is starting a company to try to solve some of the problems with the payment world, and I commented about how hard of a problem it would be. His response? Paul Graham essay.

Re: [google-appengine] Re: and this, kids, is why we use app engine...

2012-02-08 Thread Ikai Lan (Google)
my tester profile, but I didn't receive any documentation on how to use it. Does it need to be activated somewhere? On Feb 7, 3:27 pm, Ikai Lan (Google) ika...@google.com wrote: http://www.quickmeme.com/meme/35xwv3/(great series if you haven't read it before, my highest recommendations

Re: [appengine-java] Batch puts

2012-02-07 Thread Ikai Lan (Google)
Andrew, multiple writes of entities in a single batch put to the same entity group count as 1 entity group write (but many more datastore write ops - this might be confusing), so you won't run into contention issues. -- Ikai Lan Developer Programs Engineer, Google App Engine plus.ikailan.com

Re: [google-appengine] Re: Google App Engine community support is moving to Stack Overflow

2012-02-07 Thread Ikai Lan (Google)
I think it's unfair to compare groups to StackOverflow. There's still nothing better in my book for a good ol' fashioned, directed discussion. But as it turns out, groups is really less than optimal for asking questions about code. And that's okay: StackOverflow is a highly specialized tool that

Re: [google-appengine] and this, kids, is why we use app engine...

2012-02-07 Thread Ikai Lan (Google)
http://www.quickmeme.com/meme/35xwv3/ (great series if you haven't read it before, my highest recommendations - thank you Nick Johnson for consistently good book recommendations) Did you sign up for the trusted tester program? Now with less deleting of data (please don't index data that you don't

Re: [appengine-java] Google App Engine community support is moving to Stack Overflow

2012-02-06 Thread Ikai Lan (Google)
It looks like your question has already been answered: http://stackoverflow.com/questions/9124564/datastore-access-is-horribly-slow-on-dev-server-if-you-have-more-than-few-object The datastore stub is that: a stub. You cannot reliable depend on it for performance data. -- Ikai Lan Developer

Re: [appengine-java] writing then reading entity does not fetch entity from datastore

2012-02-03 Thread Ikai Lan (Google)
Can you post the code? Are you reading by key? If you are using a query, you might be exposed to the eventually consistent nature of global queries in the datastore. Or is this only in the dev appserver? -- Ikai Lan Developer Programs Engineer, Google App Engine plus.ikailan.com On Fri, Feb 3,

Re: [google-appengine] Re: Is App Engine suitable for write intensive applications?

2012-02-02 Thread Ikai Lan (Google)
Thanks for the answers, Robert. Shard size isn't determined by amount of data, but by access patterns. An example of an anti-pattern that will cause a shard size imbalance would be an entity write every time a user takes an action - but you never do anything with this data. Since the data just

Re: [google-appengine] Re: Report

2012-02-02 Thread Ikai Lan (Google)
Nadia, can you describe the steps you have taken? Have you contacted the site owner? http://showsiteinfor.appspot.com/privacy-policy.jsp Have you called your credit card company to dispute the payment? Have you spoken to law enforcement (note: I don't know if local law enforcement can do

Re: [google-appengine] Re: Is App Engine suitable for write intensive applications?

2012-02-02 Thread Ikai Lan (Google)
into it, it is a writing thousands of entities per second type of thing -- which is not very common. It is interesting that sharding is determined by access patterns. Is that something you can elaborate on at all? ;) Robert On Thu, Feb 2, 2012 at 16:14, Ikai Lan (Google) ika...@google.com

Re: [google-appengine] Re: Is App Engine suitable for write intensive applications?

2012-02-02 Thread Ikai Lan (Google)
Okay, looks like these whitepapers are at research.google.com now: http://research.google.com/archive/bigtable.html -- Ikai Lan Developer Programs Engineer, Google App Engine plus.ikailan.com On Thu, Feb 2, 2012 at 7:03 PM, Ikai Lan (Google) ika...@google.com wrote: Robert, I'll see what I

Re: [google-appengine] Re: Is App Engine suitable for write intensive applications?

2012-02-02 Thread Ikai Lan (Google)
MB in size by default. Also: 100-200 MB is the default configuration. It might not be what we have configured. This is *really really* detailed, though. -- Ikai Lan Developer Programs Engineer, Google App Engine plus.ikailan.com On Thu, Feb 2, 2012 at 7:04 PM, Ikai Lan (Google) ika

Re: [google-appengine] Re: Datastore restore failure

2012-02-01 Thread Ikai Lan (Google)
Hi Francois, I was just talking to Arie about this. So some implementation details (for anyone who is curious): The way the backup tool works is by iterating over all of your data in a mapper job. The number of shards is determined by the number of Kinds * Entities per kind. Entities are

Re: [google-appengine] Re: 1.6.2 Pre-Release SDKs Out

2012-01-31 Thread Ikai Lan (Google)
It's out right now. I'm putting together an announcement email. Blog post is here: http://googleappengine.blogspot.com/2012/01/app-engine-162-released.html -- Ikai Lan Developer Programs Engineer, Google App Engine plus.ikailan.com On Tue, Jan 31, 2012 at 2:00 PM, pdknsk pdk...@googlemail.com

[google-appengine] App Engine SDK 1.6.2 is out!

2012-01-31 Thread Ikai Lan (Google)
Hey everyone, Just wanted to announce that App Engine 1.6.2 is out! You can check out the blog post here: http://googleappengine.blogspot.com/2012/01/app-engine-162-released.html Note that if you're getting an import error for task queues, you're probably still using the old labs import. You'll

Re: [google-appengine] Re: Is Cost Per Million Estimate Based On New Pricing?

2012-01-27 Thread Ikai Lan (Google)
suggestions on a good way to estimate costs using information that is currently available? On Jan 26, 3:13 pm, Ikai Lan (Google) ika...@google.com wrote: Those should be based on the old pricing. The old pricing is based on CPU milliseconds. That number is less meaningful (not meaningful

Re: [google-appengine] How to think about the Datastore

2012-01-27 Thread Ikai Lan (Google)
So, I am considering serialising each dictionary entry and storing them as Blobs (or Texts) Going to go out on a limb here ... what about storing the entire dictionary as a single Blob? Or at least the index as a single Blob? You read the index into local instance memory and lazily load the extra

Re: [google-appengine] Report

2012-01-27 Thread Ikai Lan (Google)
I'm not sure what the violation is. Here's my domain: http://showsiteinfor.appspot.com/sites/ikaisays.com You will want to find out where the website violates the GAE terms of service and make a case. You can find the terms of service here: http://code.google.com/appengine/terms.html We don't

Re: [google-appengine] Re: Migration 'stuck'

2012-01-27 Thread Ikai Lan (Google)
Oh, bummer. Yeah, there's an RPC size limit, and when an entity gets bigger and bigger it creeps up such that it gets too big to update anymore. There are a few more cases when migrations will appear to be stuck or run forever, but they tend to be symptoms of the same underlying issue: -

Re: [google-appengine] Report

2012-01-27 Thread Ikai Lan (Google)
that will drive valuable traffic to your site from Bing and Yahoo Search. ** ** *From:* google-appengine@googlegroups.com [mailto: google-appengine@googlegroups.com] *On Behalf Of *Ikai Lan (Google) *Sent:* Friday, January 27, 2012 3:45 PM *To:* google-appengine@googlegroups.com *Subject:* Re

Re: [google-appengine] Is App Engine suitable for write intensive applications?

2012-01-27 Thread Ikai Lan (Google)
Yes, 1 post a minute is fine. Even 1 write a second is fine. Where you will run into issues is when your application does something like ~hundreds of writes a second. There are very few systems that will do this well, and you will have to start looking into sharding your writes - but for now this

Re: [google-appengine] Re: 11 apps but 4 are mine

2012-01-26 Thread Ikai Lan (Google)
Yep, I see that the OP is an OWNER on most of the apps. I didn't count them one-by-one, however. There should not be a limit of the number of billing enabled apps available, however. You should be able to create these as needed and they will not count against the number of free apps you have. We

Re: [google-appengine] Java Sessions

2012-01-26 Thread Ikai Lan (Google)
They're backed with Memcache and Datastore so you won't lose session data when the instance shuts down. I can't find the default, but it looks like the session code respects HttpSession's maxInactiveInterval() method:

Re: [google-appengine] speed up fetching of larger data set

2012-01-26 Thread Ikai Lan (Google)
Between the way the datastore works and deserialization, fetching 6000 entities is never going to be efficient. What problem are you trying to solve? Is it possible to reduce the number of entities? For instance, can you store data for 1000 entities in 6 entities and fetch only 6 big entities?

Re: [google-appengine] Re: Is Cost Per Million Estimate Based On New Pricing?

2012-01-26 Thread Ikai Lan (Google)
Those should be based on the old pricing. The old pricing is based on CPU milliseconds. That number is less meaningful (not meaningful anymore?) because you are billed for instance hours, and you have concurrent requests. Datastore ops are also not included. At some point we should get rid of

Re: [appengine-java] lost trying to understand JDO on BigTable: please help coding example

2012-01-24 Thread Ikai Lan (Google)
You don't need to implement a Primary Key class. Specify the primary field as a Key and generate the key using KeyFactory: http://code.google.com/appengine/docs/java/javadoc/com/google/appengine/api/datastore/KeyFactory.Builder.html You can autogenerate IDs with this method:

Re: [google-appengine] Re: Key features review before choosing Google App Engine for mission critical application

2012-01-19 Thread Ikai Lan (Google)
Greg, thanks for answering. Pretty much every answer has been nailed. In general, Google doesn't provide consulting services, but there are people in this group such as Greg and Brandon who have been longtime community members and are more than happy to offer consulting services. What Google does

Re: [appengine-java] OAuth and google chrome

2012-01-18 Thread Ikai Lan (Google)
This is strange - there should be nothing browser specific about the session. Try to isolate the behavior by removing OAuth out of the equation. What happens when you store a variable in session scope without the OAuth flow? Does it change each time? -- Ikai Lan Developer Programs Engineer,

Re: [appengine-java] JPA and Entity Groups

2012-01-18 Thread Ikai Lan (Google)
Answers below. -- Ikai Lan Developer Programs Engineer, Google App Engine plus.ikailan.com On Tue, Jan 17, 2012 at 9:24 AM, Paul Bartosik paulhbarto...@gmail.comwrote: I have spent a bit of time banging up against Entity Group issues. In all cases, the problem was with my JPA. I had made

Re: [appengine-java] JPA and Entity Groups

2012-01-18 Thread Ikai Lan (Google)
that as of a recent release, you can do cross entity-group transactions. -- Ikai Lan Developer Programs Engineer, Google App Engine plus.ikailan.com On Wed, Jan 18, 2012 at 11:22 AM, Ikai Lan (Google) ika...@google.comwrote: Answers below. -- Ikai Lan Developer Programs Engineer, Google App Engine

Re: [appengine-java] JPA and Entity Groups

2012-01-18 Thread Ikai Lan (Google)
plus.ikailan.com On Wed, Jan 18, 2012 at 11:48 AM, Ikai Lan (Google) ika...@google.comwrote: On second examination, I could be wrong about JPA. I'll need to test this and see. http://stackoverflow.com/questions/4909012/how-to-create-an-object-in-a-specific-entity-group-with-jpa-google-appengine-j If you

Re: [google-appengine] Not able to deploy application with GAE 1.6.1

2012-01-18 Thread Ikai Lan (Google)
believe that production server must be using the latest version of GAE. Right? Thanks Deepak On Wed, Jan 18, 2012 at 12:20 AM, Ikai Lan (Google) ika...@google.comwrote: What's the version number you are using? -- Ikai Lan Developer Programs Engineer, Google App Engine plus.ikailan.com

Re: [google-appengine] Not able to deploy application with GAE 1.6.1

2012-01-17 Thread Ikai Lan (Google)
What's the version number you are using? -- Ikai Lan Developer Programs Engineer, Google App Engine plus.ikailan.com On Mon, Jan 16, 2012 at 9:24 AM, Deepak Singh deepaksingh...@gmail.comwrote: Hi All, I recently upgraded to GAE 1.6.1. When i deploy my app through Eclipse deploy option,

Re: [appengine-java] Abridged summary of google-appengine-java@googlegroups.com - 8 Messages in 5 Topics

2012-01-13 Thread Ikai Lan (Google)
] proxying datastore request [3 Updates] how to get the correct time for germany? [2 Updates] problem with Content-type: null with css files Ikai Lan (Google) ika...@google.com Jan 11 05:22PM -0800 We have an SDK update that resolves this issue on upload (I've also posted

Re: [appengine-java] Abridged summary of google-appengine-java@googlegroups.com - 8 Messages in 5 Topics

2012-01-13 Thread Ikai Lan (Google)
transaction. We'd definitely like to improve these docs, however. Do you have any suggestions or areas where this documentation seems confusing? -- Ikai Lan Developer Programs Engineer, Google App Engine plus.ikailan.com | twitter.com/ikai On Fri, Jan 13, 2012 at 12:23 PM, Ikai Lan (Google) ika

Re: [appengine-java] Re: problem with Content-type: null with css files

2012-01-13 Thread Ikai Lan (Google)
, Ikai Lan (Google) ika...@google.comwrote: We have an SDK update that resolves this issue on upload (I've also posted in a separate thread about this): http://code.google.com/p/googleappengine/downloads/detail?name=appengine-java-sdk-1.6.1.1.zip -- Ikai Lan Developer Programs Engineer

[appengine-java] Announcing - Java Threads Trusted Tester program

2012-01-13 Thread Ikai Lan (Google)
Hey everyone, We're announcing a new trusted tester program for Java developers: Java threads. This is a feature we’d like to release sometime in one of the next upcoming versions. You’d be able to create Threads using a ThreadFactory (so existing libraries that create threads through other means

Re: [google-appengine] Emails sent by Appengine Java marked as SPAM in GMAIL

2012-01-13 Thread Ikai Lan (Google)
What email address did you use? -- Ikai Lan Developer Programs Engineer, Google App Engine plus.ikailan.com | twitter.com/ikai On Fri, Jan 13, 2012 at 7:17 AM, aloo aleem.maw...@gmail.com wrote: I'm trying to send notification emails to the users of my appengine application. Gmail is

Re: [google-appengine] Emails sent by Appengine Java marked as SPAM in GMAIL

2012-01-13 Thread Ikai Lan (Google)
Thanks for replying. I don't have an answer for this, and it really sucks to get flagged as a false positive if you aren't sending spam. My suggestion is to try some other addresses, given that the email went through via the @appspotmail address, it was likely not the content that got it flagged

[google-appengine] Announcing - Java Threads Trusted Tester program

2012-01-13 Thread Ikai Lan (Google)
Hey everyone, We're announcing a new trusted tester program for Java developers: Java threads. This is a feature we’d like to release sometime in one of the next upcoming versions. You’d be able to create Threads using a ThreadFactory (so existing libraries that create threads through other means

Re: [appengine-java] proxying datastore request

2012-01-12 Thread Ikai Lan (Google)
This seems like something you might do in a servlet filter. Have you considered user specific namespaces if you completely want user data in silos? You can set the namespace in the servlet filter: http://code.google.com/appengine/docs/java/multitenancy/multitenancy.html -- Ikai Lan Developer

Re: [appengine-java] proxying datastore request

2012-01-11 Thread Ikai Lan (Google)
Hi there! - a logged in user could manipulate the RPC call (he could for example exchange his userID by the ID of someone else and access the data of this user) - to avoid that I need to verify that the user ID matches the session ID assigned when he logged in. Can you describe how

[appengine-java] Minor update to Java SDK: 1.6.1.1

2012-01-11 Thread Ikai Lan (Google)
Hey everyone, There's a new version of the Java SDK available for download. You can get it here: http://code.google.com/p/googleappengine/downloads/detail?name=appengine-java-sdk-1.6.1.1.zip It's a minor version bump. We had to address an issue with the Java SDK that was causing CSS files to

  1   2   3   4   5   6   7   8   9   10   >