Just a note in case anyone is thinking about similar questions. I'm trying out CloudSQL for this, in part because of Alex's issue of no updates, but also because of all the nice known-entity toys that SQL gives us. I'll likely keep all my main data in the datastore, but the no-joins and no-aggregates and no ad-hoc queries stories have soaked up enough of my time.
I imagine a good approach is: Datastore for base data Copy oft-updated entities to SQL for intra-day queries When data becomes fixed (e.g. closed-off months), move it to BigQuery for multi-month/year querying. This I'll likely not do until I feel there's a need for it. If you have alternate approaches that work well, I'd appreciate a reply. On Monday, October 15, 2012 3:48:59 PM UTC+2, Richard Watson wrote: > > Thanks, Alex, I saw that article and I've taken a look at their source. > Good to see that people are using BQ, I'm just hoping to get some > first-hand pros and cons from GAE devs. > > On Monday, October 15, 2012 2:58:49 PM UTC+2, alex wrote: >> >> I don't personally believe there exist a "default" in this kind of >> work without giving any specifics but you should definitely try it. If >> you haven't seen it, here's a recent post related to your questions. >> You might find some answers there: >> >> http://googleappengine.blogspot.it/2012/10/streak-brings-crm-to-inbox-with-google.html >> >> >> The only feature that's not there and I'd love to see it being >> implemented, is existing rows/data updates. Currently you can only >> append to existing table. Other than that, BigQuery is really awesome >> for all sorts of adhoc data analysis, dashboards, charts, etc. >> >> -- alex >> >> On Mon, Oct 15, 2012 at 12:31 PM, Richard Watson >> <[email protected]> wrote: >> > One of the issues of the datastore is a lack of SQL-like aggregates, or >> easy >> > ad-hoc queries in general. This adds a lot of cost to reporting, >> > dashboards, etc. Is BigQuery the default choice for this type of work, >> now? >> > For those who have used it, what kinds of things should we watch out >> for? >> > What types of result do you cache back in the datastore, or do you just >> run >> > all that from BigQuery? >> > >> > -- >> > You received this message because you are subscribed to the Google >> Groups >> > "Google App Engine" group. >> > To view this discussion on the web visit >> > https://groups.google.com/d/msg/google-appengine/-/tb9HEW70DM4J. >> > To post to this group, send email to [email protected]. >> > To unsubscribe from this group, send email to >> > [email protected]. >> > For more options, visit this group at >> > http://groups.google.com/group/google-appengine?hl=en. >> > -- You received this message because you are subscribed to the Google Groups "Google App Engine" group. To view this discussion on the web visit https://groups.google.com/d/msg/google-appengine/-/zbOXH_YHKkwJ. To post to this group, send email to [email protected]. To unsubscribe from this group, send email to [email protected]. For more options, visit this group at http://groups.google.com/group/google-appengine?hl=en.
