You can also set up streaming <https://cloud.google.com/bigquery/streaming-data-into-bigquery> of your logs <https://cloud.google.com/solutions/real-time/fluentd-bigquery> directly into BigQuery. Just wanted to add that link in case you hadn't seen it, Manikanta.
Cheers, Nick Cloud Platform Community Support On Tuesday, March 22, 2016 at 11:39:22 AM UTC-4, Nick (Cloud Platform Support) wrote: > > Seconding @troberti here, BigQuery is definitely a better match for logs > storage and analysis. Datastore would have an advantage if you wanted to > update records, but logs are immutable and write-once, so BigQuery, which > doesn't support UPDATE queries, is the best match, also because it can > query large amounts of data very quickly (the central design premise of > BigQuery). > > On Tuesday, March 22, 2016 at 4:52:14 AM UTC-4, Manikanta Kondeti wrote: >> >> Hello, >> >> We are just one of the groups that uses app engine for hosting. I have a >> few questions related to storing logs (logging of various actions that >> happen in the app) . Currently we are storing all the information in form >> of entities in datastore. If I want to do a behavioral analytics on a >> particular group of users I have to fetch all of them from app engine and >> run queries. It takes lots of time to fetch those data and do analytics. >> Are there any good tools on google cloud platform that help us to make this >> entire process better? >> >> Regards, >> Manikanta >> > -- You received this message because you are subscribed to the Google Groups "Google App Engine" group. To unsubscribe from this group and stop receiving emails from it, send an email to [email protected]. To post to this group, send email to [email protected]. Visit this group at https://groups.google.com/group/google-appengine. To view this discussion on the web visit https://groups.google.com/d/msgid/google-appengine/a05f47f2-bb11-4652-afaf-ff2bb88cd51d%40googlegroups.com. For more options, visit https://groups.google.com/d/optout.
