Re: [openstack-dev] Proposed Logging Standards

2014-01-31 Thread Macdonald-Wallace, Matthew
> -Original Message- > From: Ben Nemec [mailto:openst...@nemebean.com] > Sent: 31 January 2014 16:01 > To: openstack-dev@lists.openstack.org > Subject: Re: [openstack-dev] Proposed Logging Standards > > I'd just love to see the ability in the python logger to i

Re: [openstack-dev] Proposed Logging Standards

2014-01-31 Thread Ben Nemec
On 2014-01-31 07:00, Macdonald-Wallace, Matthew wrote: -Original Message- From: Sean Dague [mailto:s...@dague.net] Sent: 31 January 2014 12:29 To: OpenStack Development Mailing List (not for usage questions) Subject: Re: [openstack-dev] Proposed Logging Standards On 01/30/2014 07:15 PM

Re: [openstack-dev] Proposed Logging Standards

2014-01-31 Thread Macdonald-Wallace, Matthew
> -Original Message- > From: Sean Dague [mailto:s...@dague.net] > Sent: 31 January 2014 12:29 > To: OpenStack Development Mailing List (not for usage questions) > Subject: Re: [openstack-dev] Proposed Logging Standards > > On 01/30/2014 07:15 PM, John Dickinson wr

Re: [openstack-dev] Proposed Logging Standards

2014-01-31 Thread Sean Dague
On 01/30/2014 07:15 PM, John Dickinson wrote: > I've been keeping an eye on this thread, and it seems I actually have a few > minutes to spend on a response today. > > To first answer the specific question, while there are some minor technical > concerns about oslo logging, the bigger concerns a

Re: [openstack-dev] Proposed Logging Standards

2014-01-30 Thread John Dickinson
Message- >>>> From: Sanchez, Cristian A [mailto:cristian.a.sanc...@intel.com] >>>> Sent: 30 January 2014 13:44 >>>> To: OpenStack Development Mailing List (not for usage questions) >>>> Subject: Re: [openstack-dev] Proposed Logging Standards >>>&g

Re: [openstack-dev] Proposed Logging Standards

2014-01-30 Thread Sanchez, Cristian A
a.sanc...@intel.com] >>> Sent: 30 January 2014 13:44 >>> To: OpenStack Development Mailing List (not for usage questions) >>> Subject: Re: [openstack-dev] Proposed Logging Standards >>> >>> Hi Matt, >>> What about the rest of the componen

Re: [openstack-dev] Proposed Logging Standards

2014-01-30 Thread Sean Dague
On 01/28/2014 06:28 PM, Scott Devoid wrote: > > A big part of my interest here is to make INFO a useful informational > level for operators. That means getting a bunch of messages out of it > that don't belong. > > > +1 to that! How should I open / tag bugs for this? I'm thinking ri

Re: [openstack-dev] Proposed Logging Standards

2014-01-30 Thread Sean Dague
On 01/27/2014 11:03 AM, Macdonald-Wallace, Matthew wrote: >>> I've also noticed just now that we appear to be "re-inventing" some parts of >> the logging framework (openstack.common.log.WriteableLogger for example >> appears to be a "catchall" when we should just be handing off to the default >> lo

Re: [openstack-dev] Proposed Logging Standards

2014-01-30 Thread Sean Dague
ssage- >> From: Sanchez, Cristian A [mailto:cristian.a.sanc...@intel.com] >> Sent: 30 January 2014 13:44 >> To: OpenStack Development Mailing List (not for usage questions) >> Subject: Re: [openstack-dev] Proposed Logging Standards >> >> Hi Matt, >> W

Re: [openstack-dev] Proposed Logging Standards

2014-01-30 Thread Macdonald-Wallace, Matthew
-Original Message- > >> From: Sanchez, Cristian A [mailto:cristian.a.sanc...@intel.com] > >> Sent: 29 January 2014 17:57 > >> To: OpenStack Development Mailing List (not for usage questions) > >> Subject: Re: [openstack-dev] Proposed Logging Stand

Re: [openstack-dev] Proposed Logging Standards

2014-01-30 Thread Sanchez, Cristian A
Module's "ini" configuration format. > >Hope that helps, > >Matt > >> -Original Message- >> From: Sanchez, Cristian A [mailto:cristian.a.sanc...@intel.com] >> Sent: 29 January 2014 17:57 >> To: OpenStack Development Mailing List

Re: [openstack-dev] Proposed Logging Standards

2014-01-30 Thread Macdonald-Wallace, Matthew
gt; To: OpenStack Development Mailing List (not for usage questions) > Subject: Re: [openstack-dev] Proposed Logging Standards > > Hi Matthew, > I¹m interested to help in this switch to python logging framework for > shipping to > logstash/etc. Are you working on a blueprint f

Re: [openstack-dev] Proposed Logging Standards

2014-01-29 Thread Sanchez, Cristian A
ltiple lines" >perspective! > >Cheers, > >Matt > >P.S. FWIW, I'd also welcome details on what the "Audit" level gives us >that the others don't... :) > >> -Original Message- >> From: Sean Dague [mailto:s...@dague.net] >

Re: [openstack-dev] Proposed Logging Standards

2014-01-29 Thread Sean Dague
On 01/28/2014 10:53 PM, Vishvananda Ishaya wrote: > > On Jan 27, 2014, at 6:57 PM, Christopher Yeoh > wrote: > >> On Tue, Jan 28, 2014 at 12:55 AM, Sean Dague > > wrote: >> >> On 01/27/2014 09:07 AM, Macdonald-Wallace, Matthew wrote: >> >

Re: [openstack-dev] Proposed Logging Standards

2014-01-28 Thread Vishvananda Ishaya
On Jan 27, 2014, at 6:57 PM, Christopher Yeoh wrote: > On Tue, Jan 28, 2014 at 12:55 AM, Sean Dague wrote: > On 01/27/2014 09:07 AM, Macdonald-Wallace, Matthew wrote: > > Hi Sean, > > > > I'm currently working on moving away from the "built-in" logging to use > > log_config= and the python log

Re: [openstack-dev] Proposed Logging Standards

2014-01-28 Thread Scott Devoid
> A big part of my interest here is to make INFO a useful informational > level for operators. That means getting a bunch of messages out of it > that don't belong. +1 to that! How should I open / tag bugs for this? We should be logging user / tenant on every wsgi request, so that should > be pa

Re: [openstack-dev] Proposed Logging Standards

2014-01-28 Thread Sean Dague
On 01/28/2014 05:56 PM, Jay Pipes wrote: > On Tue, 2014-01-28 at 16:25 -0500, Brad Topol wrote: >> So we are starting to add more cloud audit (aka CADF) support to >> OpenStack. We have support in Nova and infrastructure added to >> Ceilometer and I am starting to add this capability to keystone.

Re: [openstack-dev] Proposed Logging Standards

2014-01-28 Thread Jay Pipes
On Tue, 2014-01-28 at 16:25 -0500, Brad Topol wrote: > So we are starting to add more cloud audit (aka CADF) support to > OpenStack. We have support in Nova and infrastructure added to > Ceilometer and I am starting to add this capability to keystone. This > work is based on sending events to cei

Re: [openstack-dev] Proposed Logging Standards

2014-01-28 Thread Brad Topol
e: 01/28/2014 12:47 PM Subject: Re: [openstack-dev] Proposed Logging Standards For the uses I've seen of it in the nova api code INFO would be perfectly fine in place of AUDIT. We've found the AUDIT logs in nova useful for tracking which user initiated a particular reque

Re: [openstack-dev] Proposed Logging Standards

2014-01-28 Thread Sean Dague
On 01/28/2014 12:41 PM, Scott Devoid wrote: > For the uses I've seen of it in the nova api code INFO would be > perfectly fine in place of AUDIT. > > > We've found the AUDIT logs in nova useful for tracking which user > initiated a particular request (e.g. delete this instance). AUDIT had

Re: [openstack-dev] Proposed Logging Standards

2014-01-28 Thread Scott Devoid
> > For the uses I've seen of it in the nova api code INFO would be perfectly > fine in place of AUDIT. > We've found the AUDIT logs in nova useful for tracking which user initiated a particular request (e.g. delete this instance). AUDIT had a much better signal to noise ratio than INFO or DEBUG.

Re: [openstack-dev] Proposed Logging Standards

2014-01-28 Thread Everett Toews
Hi Sean, Could 1.1.1 "Every Inbound WSGI request should be logged Exactly Once" be used to track API call data in order to discover which API calls are being made most frequently? It certainly seems like it could but I want to confirm. I ask because this came up as B "Get aggregate API call da

Re: [openstack-dev] Proposed Logging Standards

2014-01-28 Thread iKhan
I haven't started contributing to openstack, looks like this might be good opportunity. Count me in. I had the same doubt about AUDIT level log in cinder. On Tue, Jan 28, 2014 at 8:16 PM, Alexander Tivelkov wrote: > Very interested, thanks a lot for this topic. > Will work on bringing all of thi

Re: [openstack-dev] Proposed Logging Standards

2014-01-28 Thread Alexander Tivelkov
Very interested, thanks a lot for this topic. Will work on bringing all of this to Murano -- Regards, Alexander Tivelkov On Tue, Jan 28, 2014 at 6:45 AM, Sergey Lukjanov wrote: > FYI it was added to the project meeting agenda - > https://wiki.openstack.org/wiki/Meetings/ProjectMeeting > > > On

Re: [openstack-dev] Proposed Logging Standards

2014-01-28 Thread Sergey Lukjanov
FYI it was added to the project meeting agenda - https://wiki.openstack.org/wiki/Meetings/ProjectMeeting On Tue, Jan 28, 2014 at 3:42 PM, Sergey Lukjanov wrote: > Hi Sean, > > it's great that you're catching this up. > > I'd like to participate. I don't know how much time I'll be able to > dedic

Re: [openstack-dev] Proposed Logging Standards

2014-01-28 Thread Sergey Lukjanov
Hi Sean, it's great that you're catching this up. I'd like to participate. I don't know how much time I'll be able to dedicate on it, but at least I'm ready for reviews and pushing it to Savanna. Thanks! On Tue, Jan 28, 2014 at 3:21 PM, Sean Dague wrote: > On 01/27/2014 09:57 PM, Christopher

Re: [openstack-dev] Proposed Logging Standards

2014-01-28 Thread Sean Dague
On 01/27/2014 09:57 PM, Christopher Yeoh wrote: > On Tue, Jan 28, 2014 at 12:55 AM, Sean Dague > wrote: > > On 01/27/2014 09:07 AM, Macdonald-Wallace, Matthew wrote: > > Hi Sean, > > > > I'm currently working on moving away from the "built-in" logging >

Re: [openstack-dev] Proposed Logging Standards

2014-01-28 Thread Thierry Carrez
Sean Dague wrote: > Back at the beginning of the cycle, I pushed for the idea of doing some > log harmonization, so that the OpenStack logs, across services, made > sense. I've pushed a proposed changes to Nova and Keystone over the past > couple of days. > > This is going to be a long process, so

Re: [openstack-dev] Proposed Logging Standards

2014-01-27 Thread Christopher Yeoh
On Tue, Jan 28, 2014 at 12:55 AM, Sean Dague wrote: > On 01/27/2014 09:07 AM, Macdonald-Wallace, Matthew wrote: > > Hi Sean, > > > > I'm currently working on moving away from the "built-in" logging to use > log_config= and the python logging framework so that we can start > shipping to logstash/s

Re: [openstack-dev] Proposed Logging Standards

2014-01-27 Thread Jay S Bryant
John Griffith To: "OpenStack Development Mailing List (not for usage questions)" , Date: 01/27/2014 02:52 PM Subject: Re: [openstack-dev] Proposed Logging Standards On Mon, Jan 27, 2014 at 6:07 AM, Sean Dague wrote: > Back at the beginning of the cycle, I pushed for t

Re: [openstack-dev] Proposed Logging Standards

2014-01-27 Thread John Griffith
On Mon, Jan 27, 2014 at 6:07 AM, Sean Dague wrote: > Back at the beginning of the cycle, I pushed for the idea of doing some > log harmonization, so that the OpenStack logs, across services, made > sense. I've pushed a proposed changes to Nova and Keystone over the past > couple of days. > > This

Re: [openstack-dev] Proposed Logging Standards

2014-01-27 Thread Jay Pipes
On Mon, 2014-01-27 at 08:07 -0500, Sean Dague wrote: > Back at the beginning of the cycle, I pushed for the idea of doing some > log harmonization, so that the OpenStack logs, across services, made > sense. I've pushed a proposed changes to Nova and Keystone over the past > couple of days. > > Thi

Re: [openstack-dev] Proposed Logging Standards

2014-01-27 Thread Susanne Balle
What I'd like to find out now: 1) who's interested in this topic? Please include me. 2) who's interested in helping flesh out the guidelines for various log levels? Please include me. 3) who's interested in helping get these kinds of patches into various projects in OpenStack? 4) which project

Re: [openstack-dev] Proposed Logging Standards

2014-01-27 Thread Macdonald-Wallace, Matthew
> > I've also noticed just now that we appear to be "re-inventing" some parts of > the logging framework (openstack.common.log.WriteableLogger for example > appears to be a "catchall" when we should just be handing off to the default > logger and letting the python logging framework decide what to

Re: [openstack-dev] Proposed Logging Standards

2014-01-27 Thread Sean Dague
On 01/27/2014 09:44 AM, Macdonald-Wallace, Matthew wrote: >> -Original Message- >> From: Sean Dague [mailto:s...@dague.net] >> Sent: 27 January 2014 14:26 >> To: OpenStack Development Mailing List (not for usage questions) >> Subject: Re: [openstack-dev] Propo

Re: [openstack-dev] Proposed Logging Standards

2014-01-27 Thread Macdonald-Wallace, Matthew
> -Original Message- > From: Sean Dague [mailto:s...@dague.net] > Sent: 27 January 2014 14:26 > To: OpenStack Development Mailing List (not for usage questions) > Subject: Re: [openstack-dev] Proposed Logging Standards > > On 01/27/2014 09:07 AM, Macdonald-Wallace,

Re: [openstack-dev] Proposed Logging Standards

2014-01-27 Thread Macdonald-Wallace, Matthew
> -Original Message- > From: Sean Dague [mailto:s...@dague.net] > Sent: 27 January 2014 14:26 > To: OpenStack Development Mailing List (not for usage questions) > Subject: Re: [openstack-dev] Proposed Logging Standards > > On 01/27/2014 09:07 AM, Macdonald-Wallace,

Re: [openstack-dev] Proposed Logging Standards

2014-01-27 Thread Peter Portante
On Mon, Jan 27, 2014 at 8:07 AM, Sean Dague wrote: > Back at the beginning of the cycle, I pushed for the idea of doing some > log harmonization, so that the OpenStack logs, across services, made > sense. I've pushed a proposed changes to Nova and Keystone over the past > couple of days. > > This

Re: [openstack-dev] Proposed Logging Standards

2014-01-27 Thread Sean Dague
On 01/27/2014 09:07 AM, Macdonald-Wallace, Matthew wrote: > Hi Sean, > > I'm currently working on moving away from the "built-in" logging to use > log_config= and the python logging framework so that we can start > shipping to logstash/sentry/. > > I'd be very interested in getting involved in

Re: [openstack-dev] Proposed Logging Standards

2014-01-27 Thread Macdonald-Wallace, Matthew
January 2014 13:08 > To: OpenStack Development Mailing List > Subject: [openstack-dev] Proposed Logging Standards > > Back at the beginning of the cycle, I pushed for the idea of doing some log > harmonization, so that the OpenStack logs, across services, made sense. I've > pushed

[openstack-dev] Proposed Logging Standards

2014-01-27 Thread Sean Dague
Back at the beginning of the cycle, I pushed for the idea of doing some log harmonization, so that the OpenStack logs, across services, made sense. I've pushed a proposed changes to Nova and Keystone over the past couple of days. This is going to be a long process, so right now I want to just focu