Demo is here: http://log2bq.appspot.com/
Source code is here: http://code.google.com/p/log2bq/ It is inspecting its own logs :) On Fri, May 4, 2012 at 3:18 PM, someone1 <[email protected]> wrote: > Do you have a link to the log analysis demo? I'd be interested in learning > more about it. (My Google-Fu didn't turn up any results) > > > On Wednesday, April 18, 2012 1:13:37 PM UTC-4, Jason Collins wrote: >> >> Thanks Greg - it totally makes sense and explains why something that >> is even quite recent does not appear on a "high-rate" application. >> >> Proppy just demo'd a BigQuery-based log analysis in the App Engine >> Chat - you should just go straight to that solution under the hood... >> >> j >> >> On Apr 18, 12:45 am, "Gregory D'alesandre" <[email protected]> wrote: >> > Hey Jason, >> > >> > Please do fill out an issue but this is indeed a known issue. We don't >> do >> > currently index for regex and labels so when you do a search across >> your >> > records it will take quite a while and we stop and return whatever >> results >> > we've found after 10 seconds. We are looking to improve this at some >> point >> > but it does mean right now you'll get inconsistent results when trying >> to >> > search across a lot of logs. >> > >> > Hope that makes sense! >> > >> > Greg >> > >> > >> > >> > >> > >> > >> > >> > On Tue, Apr 17, 2012 at 9:59 PM, Takashi Matsuo <[email protected]> >> wrote: >> > > Hi Jason, >> > >> > > Do you mind filing an issue on the issue tracker with some details? >> > > (e.g. app-id, example queries, etc) >> > >> > > If you mind making the info public, you can also send it directly to >> me. >> > >> > > Thanks, >> > >> > > -- Takashi >> > >> > > On Wed, Apr 18, 2012 at 7:33 AM, Jason Collins >> > > <[email protected]> wrote: >> > > > Is it just me, or does the Log Viewer searching basically not work? >> > >> > > > I have my log storage configured to give me about 11 days of logs, >> but >> > > > I can rarely actually find stuff (that I _know_ occurred within my >> > > > window) by searching - both regex- and label-based searching. We >> run >> > > > at about 100+QPS, so trying to catch something in action is >> basically >> > > > impossible. >> > >> > > > I'm guessing the log indexing runs async to the log entries >> > > > themselves, and it's just not able to keep pace, or the indexing >> jobs >> > > > themselves are just failing. >> > >> > > > Does anyone actually have any luck searching the logs in the Log >> > > > Viewer on a reasonably high rate application? >> > >> > > > j >> > >> > > > -- >> > > > You received this message because you are subscribed to the Google >> > > Groups "Google App Engine" group. >> > > > To post to this group, send email to google-appengine@googlegroups. >> **com <[email protected]>. >> > > > To unsubscribe from this group, send email to >> > > google-appengine+unsubscribe@**googlegroups.com<google-appengine%[email protected]>. >> >> > > > For more options, visit this group at >> > >http://groups.google.com/**group/google-appengine?hl=en<http://groups.google.com/group/google-appengine?hl=en>. >> >> > >> > > -- >> > > Takashi Matsuo | Developer Advocate | [email protected] | >> 03-6384-9224 >> > >> > > -- >> > > You received this message because you are subscribed to the Google >> Groups >> > > "Google App Engine" group. >> > > To post to this group, send email to google-appengine@googlegroups.** >> com <[email protected]>. >> > > To unsubscribe from this group, send email to >> > > google-appengine+unsubscribe@**googlegroups.com<google-appengine%[email protected]>. >> >> > > For more options, visit this group at >> > >http://groups.google.com/**group/google-appengine?hl=en<http://groups.google.com/group/google-appengine?hl=en> >> . > > -- > You received this message because you are subscribed to the Google Groups > "Google App Engine" group. > To view this discussion on the web visit > https://groups.google.com/d/msg/google-appengine/-/-RSMoQIbKt0J. > > To post to this group, send email to [email protected]. > To unsubscribe from this group, send email to > [email protected]. > For more options, visit this group at > http://groups.google.com/group/google-appengine?hl=en. > -- Johan Euphrosine (proppy) Developer Programs Engineer Google Developer Relations -- You received this message because you are subscribed to the Google Groups "Google App Engine" group. To post to this group, send email to [email protected]. To unsubscribe from this group, send email to [email protected]. For more options, visit this group at http://groups.google.com/group/google-appengine?hl=en.
