On Fri, Sep 19, 2014 at 12:27 PM, Parinya'Pum' Hiranpanthaporn <
[email protected]> wrote:

> We are implementing App Engine script. The idea is to read log file and
> load it into BigQuery. Our log files are uploaded from local logstash with
> cutoff every 250 MB per file. We want the App engine script to stay alive
> and wait for new log file to process. Any solution for this?
>



The easiest way would be to configure a cron job to repeatedly send a
request to your application
<https://developers.google.com/appengine/docs/java/config/cron> and keep an
instance awake.

With that said, does keeping an instance alive really add much time to your
data processing? In most cases the upload from your local logstash and the
loading into BigQuery will take much more time than instance startup. Can
you share some performance metrics?


-----------------
-Vinny P
Technology & Media Consultant
Chicago, IL

App Engine Code Samples: http://www.learntogoogleit.com

-- 
You received this message because you are subscribed to the Google Groups 
"Google App Engine" group.
To unsubscribe from this group and stop receiving emails from it, send an email 
to [email protected].
To post to this group, send email to [email protected].
Visit this group at http://groups.google.com/group/google-appengine.
For more options, visit https://groups.google.com/d/optout.

Reply via email to