Hi Our debug log file size is getting pretty huge....a typical py26 jenkins run produces a whisker under 50Mb of log - which is problematic for at least the reason that our current jenkins setup consider the test run a failure if the log file is > 50 Mb. (see http://logs.openstack.org/14/74214/40/check/gate-keystone-python26/1714702/subunit_log.txt.gz as an example for a recent patch I am working on). Obviously we could just raise the limit, but we should probably also look at how effective our logging is. Reviewing of the log file listed above shows:
1) Some odd corruption. I think this is related to the subunit concatenation
of output files, but haven't been able to find the exact cause (looking a local
subunit file shows some weird characters, but not as bad as when as part of
jenkins). It may be that this corruption is dumping more data than we need
into the log file.
2) There are some spectacularly uninteresting log entries, e.g. 25 lines of :
Initialized with method overriding = True, and path info altering = True
as part of each unit test call that uses routes! (This is generated as part of
the routes.middleware init)
3) Some seemingly over zealous logging, e.g. the following happens multiple
times per call:
Parsed 2014-07-06T14:47:46.850145Z into {'tz_sign': None, 'second_fraction':
'850145', 'hour': '14', 'daydash': '06', 'tz_hour': None, 'month': None,
'timezone': 'Z', 'second': '46', 'tz_minute': None, 'year': '2014',
'separator': 'T', 'monthdash': '07', 'day': None, 'minute': '47'} with default
timezone <iso8601.iso8601.Utc object at 0x1a02fd0>
Got '2014' for 'year' with default None
Got '07' for 'monthdash' with default 1
Got 7 for 'month' with default 7
Got '06' for 'daydash' with default 1
Got 6 for 'day' with default 6
Got '14' for 'hour' with default None
Got '47' for 'minute' with default None
3) LDAP is VERY verbose, e.g. 30-50 lines of debug per call to the driver.
I'm happy to work to trim back some of worst excesses....but open to ideas as
to whether we need a more formal approach to this...perhaps a good topic for
our hackathon this week?
Henry
signature.asc
Description: Message signed with OpenPGP using GPGMail
_______________________________________________ OpenStack-dev mailing list [email protected] http://lists.openstack.org/cgi-bin/mailman/listinfo/openstack-dev
