[appengine-java] Re: Problem in the datastore
Hello Aruna, You might find that the date-time-stamp of your log entry is 30 seconds after the start date-time mentioned in the entry. GAE normally requires that web requests return within 30s. If you have exceeded this time limit, then you will need to change your code (perhaps by breaking the work into smaller pieces). Cheers, Ian On Feb 1, 4:09 am, M.W. Aruna Withanage deltaar...@gmail.com wrote: Hi Marshal, Thank you for your reply. I am can see following exception in the log Uncaught exception from servlet com.google.apphosting.runtime.HardDeadlineExceededError: This request (61e5c9c622d01075) started at 2012/02/01 04:0What is that mean? How can I overcome that? Please someone help me. Regards Aruna On 31 January 2012 02:10, Ian Marshall ianmarshall...@gmail.com wrote: Have you looked at your application's log in the Google App Engine Administration Console? Do you see anything relevant? On Jan 31, 8:35 am, deltaaruna deltaar...@gmail.com wrote: Hi all, My app has about 6 records. I uploaded the bulk data to the local datastore using xml files. It was working well in the local cloud. Then I uploaded the app in to cloud. Now I can't upload my data in the google cloud. when I try to do it following messege comes Error: Server Error The server encountered an error and could not complete your request. If the problem persists, please report http://code.google.com/appengine/community.htmlyour problem and mention this error message and the query that caused it. How can I solve this problem? -- You received this message because you are subscribed to the Google Groups Google App Engine for Java group. To post to this group, send email to google-appengine-java@googlegroups.com. To unsubscribe from this group, send email to google-appengine-java+unsubscr...@googlegroups.com. For more options, visit this group at http://groups.google.com/group/google-appengine-java?hl=en. -- You received this message because you are subscribed to the Google Groups Google App Engine for Java group. To post to this group, send email to google-appengine-java@googlegroups.com. To unsubscribe from this group, send email to google-appengine-java+unsubscr...@googlegroups.com. For more options, visit this group at http://groups.google.com/group/google-appengine-java?hl=en.
Re: [appengine-java] Re: Problem in the datastore
Dear Ian, Thank you for your reply. Using backends I was able to overcome the proble. On 1 February 2012 01:43, Ian Marshall ianmarshall...@gmail.com wrote: Correction. The 30s deadline which I mentioned has been increased. Why not look at http://code.google.com/appengine/docs/java/runtime.html#The_Request_Timer for the new limit? Cheers, Ian On Feb 1, 9:35 am, Ian Marshall ianmarshall...@gmail.com wrote: Hello Aruna, You might find that the date-time-stamp of your log entry is 30 seconds after the start date-time mentioned in the entry. GAE normally requires that web requests return within 30s. If you have exceeded this time limit, then you will need to change your code (perhaps by breaking the work into smaller pieces). Cheers, Ian On Feb 1, 4:09 am, M.W. Aruna Withanage deltaar...@gmail.com wrote: Hi Marshal, Thank you for your reply. I am can see following exception in the log Uncaught exception from servlet com.google.apphosting.runtime.HardDeadlineExceededError: This request (61e5c9c622d01075) started at 2012/02/01 04:0What is that mean? How can I overcome that? Please someone help me. Regards Aruna On 31 January 2012 02:10, Ian Marshall ianmarshall...@gmail.com wrote: Have you looked at your application's log in the Google App Engine Administration Console? Do you see anything relevant? On Jan 31, 8:35 am, deltaaruna deltaar...@gmail.com wrote: Hi all, My app has about 6 records. I uploaded the bulk data to the local datastore using xml files. It was working well in the local cloud. Then I uploaded the app in to cloud. Now I can't upload my data in the google cloud. when I try to do it following messege comes Error: Server Error The server encountered an error and could not complete your request. If the problem persists, please report http://code.google.com/appengine/community.htmlyour problem and mention this error message and the query that caused it. How can I solve this problem? -- You received this message because you are subscribed to the Google Groups Google App Engine for Java group. To post to this group, send email to google-appengine-java@googlegroups.com. To unsubscribe from this group, send email to google-appengine-java+unsubscr...@googlegroups.com. For more options, visit this group at http://groups.google.com/group/google-appengine-java?hl=en. -- You received this message because you are subscribed to the Google Groups Google App Engine for Java group. To post to this group, send email to google-appengine-java@googlegroups.com. To unsubscribe from this group, send email to google-appengine-java+unsubscr...@googlegroups.com. For more options, visit this group at http://groups.google.com/group/google-appengine-java?hl=en. -- You received this message because you are subscribed to the Google Groups Google App Engine for Java group. To post to this group, send email to google-appengine-java@googlegroups.com. To unsubscribe from this group, send email to google-appengine-java+unsubscr...@googlegroups.com. For more options, visit this group at http://groups.google.com/group/google-appengine-java?hl=en.
Re: [appengine-java] Re: Resource is currently experiencing a short-term quota limit
Dear Simon, In my app each entitiy have about 14 properties. I haven't configured any indexes and composite indexes. Also I am not using indexes in this app. Do I have any option except turn the billing on? I am not using indexes. So will configuring per-property indexes and composite indexes help me? I am very new to GAE and can someone help me? Thank You Aruna On 1 February 2012 02:50, Simon Knott knott.si...@gmail.com wrote: If you can't upload it in stages, then you have the following options: - Turn billing on - Properly configure your per-property indexes and composite indexes (assuming that you haven't). If you are exceeding your datastore writes by only uploading 200 entities, then you must either have a lot of properties, use a lot of list-based properties, or have a lot of composite indexes. Cheers, Simon -- You received this message because you are subscribed to the Google Groups Google App Engine for Java group. To view this discussion on the web visit https://groups.google.com/d/msg/google-appengine-java/-/KiQ-jVSph0sJ. To post to this group, send email to google-appengine-java@googlegroups.com. To unsubscribe from this group, send email to google-appengine-java+unsubscr...@googlegroups.com. For more options, visit this group at http://groups.google.com/group/google-appengine-java?hl=en. -- You received this message because you are subscribed to the Google Groups Google App Engine for Java group. To post to this group, send email to google-appengine-java@googlegroups.com. To unsubscribe from this group, send email to google-appengine-java+unsubscr...@googlegroups.com. For more options, visit this group at http://groups.google.com/group/google-appengine-java?hl=en.
[appengine-java] Very high latency lately.
Over the past 4 days, the application I'm working on started experiencing terrible latency issues. Yesterday, the problem seemed to have resolved itself for a short period of time. Today, however, the issue is back. Page loads that used to take 200 ms are now taking 3 to 4 seconds. Looking over my request logs, I see some requests taking 11 seconds. The bad part, these pages are using memcache. I'm not sure if I'm getting on good/bad VMs/hosts or what, but this is not good. The last 3 long requets (within the last 2 minutes - all on the same VM) took: 7,635ms 20,685ms 11,761ms 2,929ms 2,728ms The faster requests barely finished in under 1000 ms. -- You received this message because you are subscribed to the Google Groups Google App Engine for Java group. To post to this group, send email to google-appengine-java@googlegroups.com. To unsubscribe from this group, send email to google-appengine-java+unsubscr...@googlegroups.com. For more options, visit this group at http://groups.google.com/group/google-appengine-java?hl=en.
Re: [appengine-java] Re: Resource is currently experiencing a short-term quota limit
Hi, The calculation for datastore writes for new entities is: 2 Writes + 2 Writes per indexed property value + 1 Write per composite index value (see http://code.google.com/appengine/docs/billing.html#Billable_Resource_Unit_Cost for more information). If you have 14 simple properties, then storing each entity will currently consume 30 datastore writes, since per-property indexes are on by default. If you turn off all of the per-property indexes each entity will take 2 datastore writes, so you will still have to batch your upload over a few days (you'll be able to upload ~25,000 entities per day, with no other traffic to your app). I'm a little confused though, as you say that you're only able to upload ~200 a day at the moment - are all of those properties simple, or do you have some list properties? What framework are you using for persisting your data? Each persistence framework has a different way of turning off the per-property indexes. It should be noted that if you remove a per-property index, you can no longer query on that property. Cheers, Simon -- You received this message because you are subscribed to the Google Groups Google App Engine for Java group. To view this discussion on the web visit https://groups.google.com/d/msg/google-appengine-java/-/yrK37ElTl2YJ. To post to this group, send email to google-appengine-java@googlegroups.com. To unsubscribe from this group, send email to google-appengine-java+unsubscr...@googlegroups.com. For more options, visit this group at http://groups.google.com/group/google-appengine-java?hl=en.
[appengine-java] Re: BaseFeed versus DocumentListFeed
Looks like you are using paging... On Jan 31, 11:41 am, Paul Ford paul.f...@mavenwave.com wrote: ok guys could not find a google docs api group so posting this here. I'm trying to list out all documents within a domain companyabc.com. If I use DocumentListFeed I get a 100 docs. If I use the same exact code and use BaseFeed instead I get all docs 1080 returned. Why? I understand BaseFeed is an abstract of DocumentListFeed and have read the javadoc. But in plain english what is basefeed giving me that documentlistfeed does not? I thought that documentlistfeed may only be returning my 'google docs' and basefeed everything (i.e. pdfs, docx, etc;) but that is not the case. DocumentListFeed also is by authenticated user. I'm using the same request and access tokens and just changing the class type when the above results are seen. Thoughts? Your urgently paul -- You received this message because you are subscribed to the Google Groups Google App Engine for Java group. To post to this group, send email to google-appengine-java@googlegroups.com. To unsubscribe from this group, send email to google-appengine-java+unsubscr...@googlegroups.com. For more options, visit this group at http://groups.google.com/group/google-appengine-java?hl=en.
[appengine-java] Re: OpenId Provider using java
I tried to create a project with the example of openid-provider in http://code.google.com/p/joid/source/browse/#svn%2Ftrunk%2Fexamples%2Fopenid-provider but I got the error *The requested resource (/authenticate) is not available.* in *http://localhost:8080/authenticate* * * What I have to do? Do I ha to do the server installation? http://code.google.com/p/joid/wiki/ServerInstallation * * I'm running on Tomcat in Eclipse. * * * * -- You received this message because you are subscribed to the Google Groups Google App Engine for Java group. To view this discussion on the web visit https://groups.google.com/d/msg/google-appengine-java/-/q7FjScAdGjwJ. To post to this group, send email to google-appengine-java@googlegroups.com. To unsubscribe from this group, send email to google-appengine-java+unsubscr...@googlegroups.com. For more options, visit this group at http://groups.google.com/group/google-appengine-java?hl=en.
Re: [appengine-java] Re: OpenId Provider using java
You are supposed to have something like this in your application web.xml : servlet-mapping servlet-nameproviderServlet/servlet-name url-pattern/authenticate/url-pattern /servlet-mapping http://code.google.com/p/joid/source/browse/trunk/examples/openid-provider/src/main/webapp/WEB-INF/web.xml On Wed, Feb 1, 2012 at 14:12, TG gae.ic2...@gmail.com wrote: I tried to create a project with the example of openid-provider in http://code.google.com/p/joid/source/browse/#svn%2Ftrunk%2Fexamples%2Fopenid-provider but I got the error *The requested resource (/authenticate) is not available.* in *http://localhost:8080/authenticate* * * What I have to do? Do I ha to do the server installation? http://code.google.com/p/joid/wiki/ServerInstallation * * I'm running on Tomcat in Eclipse. * * * * -- You received this message because you are subscribed to the Google Groups Google App Engine for Java group. To view this discussion on the web visit https://groups.google.com/d/msg/google-appengine-java/-/q7FjScAdGjwJ. To post to this group, send email to google-appengine-java@googlegroups.com. To unsubscribe from this group, send email to google-appengine-java+unsubscr...@googlegroups.com. For more options, visit this group at http://groups.google.com/group/google-appengine-java?hl=en. -- You received this message because you are subscribed to the Google Groups Google App Engine for Java group. To post to this group, send email to google-appengine-java@googlegroups.com. To unsubscribe from this group, send email to google-appengine-java+unsubscr...@googlegroups.com. For more options, visit this group at http://groups.google.com/group/google-appengine-java?hl=en.
[appengine-java] Re: Datastore Admin and federated login
In fact, it seems that my browser blocked the openid url for some security reasons related to being in an iframe. I just had to open this url in a new tab to solve the problem. Francois -- You received this message because you are subscribed to the Google Groups Google App Engine for Java group. To view this discussion on the web visit https://groups.google.com/d/msg/google-appengine-java/-/Uh7r6u5b0JIJ. To post to this group, send email to google-appengine-java@googlegroups.com. To unsubscribe from this group, send email to google-appengine-java+unsubscr...@googlegroups.com. For more options, visit this group at http://groups.google.com/group/google-appengine-java?hl=en.
Re: [appengine-java] Re: makePersistent failing every second time since server restart
Hi, I've raised the issue with a test case in google's issue tracker: http://code.google.com/p/datanucleus-appengine/issues/detail?id=259 I am hoping someone can kindly have a look at it and get back to me as I cannot see how I can make use of JDO on app engine without this fixed. In the meantime any suggestions on how to work around the problem would be greatly appreciated. Kind Regards, John Goche On Wed, Feb 1, 2012 at 9:21 AM, datanucleus andy_jeffer...@yahoo.com wrote: So it can't find a related Entity. You could obviously use the DB viewer (or a low level API call) to check whether it is present (with that Key), and look in the log for whether it was PUT. Can't speak for Google but I'm sure nobody has interest in private code, though I'm sure that it ought to be perfectly simple to generate a testcase something akin to the format used by DataNucleus http://www.datanucleus.org/project/problem_jdo_testcase.html if the issue is as clear as you say in terms of reproducing it. And then you can raise an issue in Googles issue tracker with the testcase; obviously without the testcase then nobody, other than you, can see it. -- You received this message because you are subscribed to the Google Groups Google App Engine for Java group. To post to this group, send email to google-appengine-java@googlegroups.com. To unsubscribe from this group, send email to google-appengine-java+unsubscr...@googlegroups.com. For more options, visit this group at http://groups.google.com/group/google-appengine-java?hl=en. -- You received this message because you are subscribed to the Google Groups Google App Engine for Java group. To post to this group, send email to google-appengine-java@googlegroups.com. To unsubscribe from this group, send email to google-appengine-java+unsubscr...@googlegroups.com. For more options, visit this group at http://groups.google.com/group/google-appengine-java?hl=en.
[appengine-java] how upload files to google cloud storage
Hi. I can't upload files to google cloud storage with java. I can upload the aplication to google App but I can't create a AppEngineFile. I used the example in the google storage api for java but it not work. I appreciate your help thanks -- You received this message because you are subscribed to the Google Groups Google App Engine for Java group. To view this discussion on the web visit https://groups.google.com/d/msg/google-appengine-java/-/4ezaqem-5hcJ. To post to this group, send email to google-appengine-java@googlegroups.com. To unsubscribe from this group, send email to google-appengine-java+unsubscr...@googlegroups.com. For more options, visit this group at http://groups.google.com/group/google-appengine-java?hl=en.
[appengine-java] Can't see new objects in the same transaction
Hi all, I'm new in JPA / JDO and I'm totally sure I'm doing something wrong. I don't know why I can't see children objects in the same transactions using the same PM // Here I got the DatastoreEntityManager (id=92) DAO dao = DAO.getInstance(DAO.JPA, requestor); // Here I got the DatastoreEntityTransactionImpl (id=94) dao.startTransaction() // Then I create and maker persistent a new Department (id=114) // It uses the same DatastoreEntityManager (id=92) and DatastoreEntityTransactionImpl (id=94) Department department = new Department() department.setName(New department); dao.persist(department); dao.refresh(department); // Then I create and make persistent a new Account (id=224) Account account = new Account(); account.setNumber(12345); account.setDepartment(department); // Owned relationship working fine dao.persist(account); dao.refresh(account); // Now I'm testing it department.getId() // returns Department(22) account.getId() // returns Department(22)/Account(24) department.getAccounts(); // Returns an empty list __ At some point down the line I gotta get the accounts in the same transaction to use in another entity. I've tried to add manually the new Account to the* Department.accounts* field but when I tried to do it I get *javax.jdo.JDODetachedFieldAccessException:* You have just attempted to access property accounts yet this property was not detached when you detached the object. Either dont access this property, or detach it when detaching the object. Does someone faced the same?? I'm loosing my hair with this!! Thanks guys! -- You received this message because you are subscribed to the Google Groups Google App Engine for Java group. To view this discussion on the web visit https://groups.google.com/d/msg/google-appengine-java/-/ukeIAZZOS0MJ. To post to this group, send email to google-appengine-java@googlegroups.com. To unsubscribe from this group, send email to google-appengine-java+unsubscr...@googlegroups.com. For more options, visit this group at http://groups.google.com/group/google-appengine-java?hl=en.
[appengine-java] map-reduce
Hi All! I catch the following exception when trying to launch map-reduce job in maven project: AccessControlException: access denied (javax.security.auth.AuthPermission getSubject) at java.security.AccessControlContext.checkPermission(AccessControlContext.java: 355) at java.security.AccessController.checkPermission(AccessController.java: 567) at java.lang.SecurityManager.checkPermission(SecurityManager.java: 549) at com.google.apphosting.runtime.security.CustomSecurityManager.checkPermission(CustomSecurityManager.java: 56) at javax.security.auth.Subject.getSubject(Subject.java:288) at org.apache.hadoop.security.UserGroupInformation.getCurrentUser(UserGroupInformation.java: 394) at org.apache.hadoop.mapreduce.JobContext.init(JobContext.java:80) at com.google.appengine.tools.mapreduce.AppEngineJobContext.init(AppEngineJobContext.java: 132) at com.google.appengine.tools.mapreduce.AppEngineJobContext.init(AppEngineJobContext.java: 124) at com.google.appengine.tools.mapreduce.MapReduceServlet.handleStart(MapReduceServlet.java: 799) at com.google.appengine.tools.mapreduce.MapReduceServlet.handleStartJob(MapReduceServlet.java: 423) at com.google.appengine.tools.mapreduce.MapReduceServlet.handleCommand(MapReduceServlet.java: 301) at com.google.appengine.tools.mapreduce.MapReduceServlet.doPost(MapReduceServlet.java: 238) at javax.servlet.http.HttpServlet.service(HttpServlet.java:637) What can be the cause? -- You received this message because you are subscribed to the Google Groups Google App Engine for Java group. To post to this group, send email to google-appengine-java@googlegroups.com. To unsubscribe from this group, send email to google-appengine-java+unsubscr...@googlegroups.com. For more options, visit this group at http://groups.google.com/group/google-appengine-java?hl=en.
Re: [appengine-java] Re: Resource is currently experiencing a short-term quota limit
Hi, I don't have any complex properties. 12 String type and two Date type. I reupload the app with another name. This time I only did the data uploading task. Now I can upload 2000 records before my quota limit expires. I am using JDO and locally I can store all 6 data without any trouble. On 1 February 2012 03:42, Simon Knott knott.si...@gmail.com wrote: Hi, The calculation for datastore writes for new entities is: 2 Writes + 2 Writes per indexed property value + 1 Write per composite index value (see http://code.google.com/appengine/docs/billing.html#Billable_Resource_Unit_Cost for more information). If you have 14 simple properties, then storing each entity will currently consume 30 datastore writes, since per-property indexes are on by default. If you turn off all of the per-property indexes each entity will take 2 datastore writes, so you will still have to batch your upload over a few days (you'll be able to upload ~25,000 entities per day, with no other traffic to your app). I'm a little confused though, as you say that you're only able to upload ~200 a day at the moment - are all of those properties simple, or do you have some list properties? What framework are you using for persisting your data? Each persistence framework has a different way of turning off the per-property indexes. It should be noted that if you remove a per-property index, you can no longer query on that property. Cheers, Simon -- You received this message because you are subscribed to the Google Groups Google App Engine for Java group. To view this discussion on the web visit https://groups.google.com/d/msg/google-appengine-java/-/yrK37ElTl2YJ. To post to this group, send email to google-appengine-java@googlegroups.com. To unsubscribe from this group, send email to google-appengine-java+unsubscr...@googlegroups.com. For more options, visit this group at http://groups.google.com/group/google-appengine-java?hl=en. -- You received this message because you are subscribed to the Google Groups Google App Engine for Java group. To post to this group, send email to google-appengine-java@googlegroups.com. To unsubscribe from this group, send email to google-appengine-java+unsubscr...@googlegroups.com. For more options, visit this group at http://groups.google.com/group/google-appengine-java?hl=en.
