Log slow parse entries
----------------------

                 Key: NUTCH-1107
                 URL: https://issues.apache.org/jira/browse/NUTCH-1107
             Project: Nutch
          Issue Type: Improvement
          Components: parser
            Reporter: Markus Jelsma
            Assignee: Markus Jelsma
            Priority: Trivial
             Fix For: 1.4, 2.0


Parse mapper and outputformat should have a facility to log (configurable) slow 
entries. This is useful for debugging slow parses. Logging parser keys only is 
not good enough, especially in a distributed environment.

Sometimes the actual parse (mapper) is very slow and sometimes the 
normalization and filtering of an entry's outlinks is slow.

--
This message is automatically generated by JIRA.
For more information on JIRA, see: http://www.atlassian.com/software/jira

        

Reply via email to