what does a few extra seconds matter? presumably you have time lags while your 250MB log segments are being collected, and you're going to have time lag as BigQuery indexes the data after you upload it, and you're going to have time lag while you upload the 250MB files. So you have a few seconds for an instance to spin up before you upload. Your end users will never know the difference, will they? or am I missing something?
On Friday, September 19, 2014 12:27:49 PM UTC-5, Parinya'Pum' Hiranpanthaporn wrote: > > Hi all, > > We are implementing App Engine script. The idea is to read log file and > load it into BigQuery. Our log files are uploaded from local logstash with > cutoff every 250 MB per file. We want the App engine script to stay alive > and wait for new log file to process. Any solution for this? > > Thanks. > -- You received this message because you are subscribed to the Google Groups "Google App Engine" group. To unsubscribe from this group and stop receiving emails from it, send an email to [email protected]. To post to this group, send email to [email protected]. Visit this group at http://groups.google.com/group/google-appengine. For more options, visit https://groups.google.com/d/optout.
