#464: BibAuthorID: clean log/err output files
-------------------------+--------------------------------------------------
 Reporter:  simko        |       Owner:      
     Type:  enhancement  |      Status:  new 
 Priority:  critical     |   Milestone:  v1.0
Component:  BibAuthorID  |     Version:      
 Keywords:               |  
-------------------------+--------------------------------------------------
 1) BibAuthorID daemon process currently generates huge log files: for
 the demo sites, the log file generated is 1MB long and contains too
 much low-level information like:

 {{{
 2011-01-30 11:38:19 --> Done with queue initialization.
 2011-01-30 11:38:19 --> Initializing processing queue
 2011-01-30 11:38:19 --> Done with queue initialization.
 2011-01-30 11:38:19 --> |> Inserting VA: 1 Orig. name: Abdalla, E.
 2011-01-30 11:38:20 --> |-> Creating NEW real author for this Virtual
 Author (currently, no real author exists)
 2011-01-30 11:38:20 --> | Reading affiliations for va 1: Abdalla, E.
 recid 74
 2011-01-30 11:38:20 --> |-> No Affiliation for this record. Set to None
 }}}

 The default verbose levels should be tweak in order to fit the usual
 verbose style (0)=silent, 1=default, 3=profile, 9=maximal verbose
 output).  The default verbose level should produce small number of
 reasonable messages, no debugging information.  For example, see
 BibIndex.

 If ~100 demo records produce ~1M of log files, production sites trying
 to run BibAuthorID may get into disk space issues perhaps, so this should
 be fixed soon. (Setting priority as critical.)

 2) The separation of log/err output streams should be improved.
 E.g. the error stream contains info-like messages:

 {{{
 2011-01-30 11:38:16 --> Processing all names...
 2011-01-30 11:38:18 --> Populating Authornames table. It's Empty.
 2011-01-30 11:38:19 --> Populating Bibrefs lookup. It's Empty.
 }}}

 that should normally be emitted in the log stream.  The error output
 stream should contain only real errors, otherwise admin may think the
 bibsched task produced some errors that must be inspected.

-- 
Ticket URL: <http://invenio-software.org/ticket/464>
Invenio <http://invenio-software.org>

Reply via email to