I often find that things lie about their encoding. I ended up doing some of my parsing of stuff in byte mode so that I didn't have errors doing find and replaces.
-----Original Message----- From: [email protected] [mailto:[email protected]] On Behalf Of Tirrell Payton Sent: Sunday, June 26, 2011 11:55 PM To: Google App Engine Subject: [google-appengine] Re: App Engine 1.5.1 is out! Hrm, interesting. Im parsing a French RSS feed. xml.dom.minidom takes the encoding from the header (in this case, utf-8) and puts it into the db. I wonder where ascii encoding is sneaking in... On Jun 26, 8:48 pm, "Ikai Lan (Google)" <[email protected]> wrote: > Doh, yeah, looks like there is a character in this entity we can't encode: > > UnicodeEncodeError: 'ascii' codec can't encode character u'\xe9' in > position 63: ordinal not in range(128) > > But we still aren't catching this exception. I'll find out of the > release was supposed to address this, and if not, to get it back on the bugfix list. > > Ikai Lan > Developer Programs Engineer, Google App Engine > Blog:http://googleappengine.blogspot.com > Twitter:http://twitter.com/app_engine > Reddit:http://www.reddit.com/r/appengine > > On Mon, Jun 27, 2011 at 11:12 AM, Tirrell Payton <[email protected]>wrote: > > > > > > > > > Here you go. > > >https://appengine.google.com/datastore/edit?app_id=streamingservicesp... > > > On Jun 26, 7:27 pm, "Ikai Lan (Google)" <[email protected]> wrote: > > > Can you link me to your admin console URL that causes this error? > > > > Ikai Lan > > > Developer Programs Engineer, Google App Engine > > > Blog:http://googleappengine.blogspot.com > > > Twitter:http://twitter.com/app_engine > > > Reddit:http://www.reddit.com/r/appengine > > > > On Mon, Jun 27, 2011 at 9:22 AM, Tirrell Payton > > ><[email protected] > > >wrote: > > > > > Hi Ikai, > > > > > Im having what I think is a corrupt data issue, so I was > > > > wondering what to expect from this: ' When displaying corrupt > > > > data in the Admin Console dataviewer, a useful error will be > > > > displayed, instead of a 500. ' > > > > Because right now, the only error I am getting is 'Server Error. > > > > A server error has occurred.' > > > > > -Tirrell Payton > > > > > On Jun 21, 2:10 am, "Ikai Lan (Google)" > > > > <[email protected]> > > > > wrote: > > > > > Hey guys, > > > > > > App Engine 1.5.1 is out! Get it while it's hot! Blog post: > > >http://googleappengine.blogspot.com/2011/06/app-engine-151-release.ht > >ml > > > > > > Release notes: > > > > > > Python > > > > > > - ProtoRPC is a new experimental library that provides a > > > > > simple > > method > > > > > for creating a well-defined and easy-to-use web-based RPC service. > > > > > - The development server's datastore implementation now > > > > > contains > > logic > > > > > that closely replicates the consistency guarantees of the > > > > > High > > > > Replication > > > > > datastore. To use, run the dev_appserver with the flag > > > > --high_replication > > > > > set to True. > > > > > - All user request have an > > > > > X-AppEngine?< > >http://code.google.com/p/googleappengine/w/edit/AppEngine > > > > >-Country > > > > > header which contains the ISO-3166-1 alpha-2 country code > > > > >for the > > > > user, > > > > > based on the IP address of the client request. > > > > > - Applications are now associated with an app_identity, > > > > > which can > > be > > > > used > > > > > to authenticate requests originating from the app to other > > services. > > > > > - The Channel API can now provide user presence, this can > > > > > be > > > > configured > > > > > by adding channel_presence to the list of inbound services > > > > > for > > your > > > > > application. > > > > > - The Images API now supports the WebP format. Due to > > > > > limitations > > in > > > > PIL, > > > > > the SDK does not support the WebP format. > > > > > - You can switch the timezone for App Engine logs in the > > > > > Admin > > > > Console. > > > > > > > > > > -http://code.google.com/p/googleappengine/issues/detail?id=734 > > > > > - Fixed an issue in the SDK where leased tasks had the POST > > method. > > > > They > > > > > now have a PULL method. > > > > > - Fixed an issue where the Channel API didn't work with > > non-default > > > > > versions of applications using the High Replication datastore. > > > > > - When displaying corrupt data in the Admin Console > > > > > dataviewer, a > > > > useful > > > > > error will be displayed, instead of a 500. > > > > > - > >http://code.google.com/p/googleappengine/issues/detail?id=4945 > > > > > > Java > > > > > > - The development server's datastore and testing service > > > > implementations > > > > > now contains logic that closely replicates the consistency > > guarantees > > > > of the > > > > > High Replication datastore. To use, run the dev_appserver > > > > > with the > > > > flag > > > > > -Ddatastore.default_high_rep_job_policy_unapplied_job_pct=20. > > > > > - All user request have an > > > > > X-AppEngine?< > >http://code.google.com/p/googleappengine/w/edit/AppEngine > > > > >-Country > > > > > header which contains the ISO-3166-1 alpha-2 country code > > > > >for the > > > > user, > > > > > based on the IP address of the client request. > > > > > - Applications are now associated with an app_identity, > > > > > which can > > be > > > > used > > > > > to authenticate requests originating from the app to other > > services. > > > > > - The Channel API can now provide user presence, this can > > > > > be > > > > configured > > > > > by adding channel_presence to the list of inbound services > > > > > for > > your > > > > > application. > > > > > - The Images API now supports the WebP format. > > > > > - You can switch the timezone for App Engine logs in the > > > > > Admin > > > > Console. > > > > > > > > > > -http://code.google.com/p/googleappengine/issues/detail?id=734 > > > > > - Added javax.xml.ws.Service$Mode to the whitelist. > > > > > - > >http://code.google.com/p/googleappengine/issues/detail?id=4770 > > > > > - You can configure your application to asynchronously > > > > > write https > > > > > session data by adding <async-session-persistence > > > > enabled="true"/> to > > > > > your appengine-web.xml. > > > > > - > >http://code.google.com/p/googleappengine/issues/detail?id=1692 > > > > > - The local task queue unit testing API now supports > > > > > Deferred > > Tasks. > > > > > - Fixed an issue where using reserved URLs did not cause an > > > > > error > > in > > > > the > > > > > SDK. > > > > > - Fixed an issue where having a backends.xml configuration > > > > > file > > caused > > > > > logging to stdout to fail in the SDK. > > > > > - Fixed an issue where the Channel API didn't work with > > non-default > > > > > versions of applications using the High Replication datastore. > > > > > - Fixed an issue where the Remote API rtok comparison was > > > > > broken > > for > > > > some > > > > > users, causing appfcg download data to fail. > > > > > - Fixed an issue with the SDK where you could not apply a > > transform to > > > > > PNG images. > > > >http://code.google.com/p/googleappengine/issues/detail?id=3458 > > > > > - When displaying corrupt data in the Admin Console > > > > > dataviewer, a > > > > useful > > > > > error will be displayed, instead of a 500. > > > > > - > >http://code.google.com/p/googleappengine/issues/detail?id=4945 > > > > > - Fixed an issue with the SDK where non-string index names > > > > > caused > > an > > > > > error upon upload. > > > > > > > > > > http://code.google.com/p/googleappengine/issues/detail?id=5004 > > > > > - Datanucleus now supports polymorphic relationships. > > > > > - > > > >http://code.google.com/p/datanucleus-appengine/issues/detail?id=1 > > > >53 > > > > > - Datanucleus now supports > > > > > PreparedQuery?< > > > >http://code.google.com/p/googleappengine/w/edit/PreparedQuery> > > > > > #countEntities(FetchOptions?< > > > >http://code.google.com/p/googleappengine/w/edit/FetchOptions> > > > > > ). > > > > > - > > > >http://code.google.com/p/datanucleus-appengine/issues/detail?id=2 > > > >25 > > > > > - Fixed an issue with datanucleus where recursive relation > > > > > did not > > > > work. > > > > > - > > > >http://code.google.com/p/datanucleus-appengine/issues/detail?id=8 > > > >0 > > > > > > -- > > > > > Ikai Lan > > > > > Developer Programs Engineer, Google App Engine > > > > > Blogger:http://googleappengine.blogspot.com > > > > > Reddit:http://www.reddit.com/r/appengine > > > > > Twitter:http://twitter.com/app_engine > > > > > -- > > > > You received this message because you are subscribed to the > > > > Google > > Groups > > > > "Google App Engine" group. > > > > To post to this group, send email to > > > > [email protected] > > . > > > > To unsubscribe from this group, send email to > > > > [email protected]. > > > > For more options, visit this group at > > > >http://groups.google.com/group/google-appengine?hl=en. > > > -- > > You received this message because you are subscribed to the Google > > Groups "Google App Engine" group. > > To post to this group, send email to [email protected]. > > To unsubscribe from this group, send email to > > [email protected]. > > For more options, visit this group at > >http://groups.google.com/group/google-appengine?hl=en. -- You received this message because you are subscribed to the Google Groups "Google App Engine" group. To post to this group, send email to [email protected]. To unsubscribe from this group, send email to [email protected]. For more options, visit this group at http://groups.google.com/group/google-appengine?hl=en. -- You received this message because you are subscribed to the Google Groups "Google App Engine" group. To post to this group, send email to [email protected]. To unsubscribe from this group, send email to [email protected]. For more options, visit this group at http://groups.google.com/group/google-appengine?hl=en.
