Option to disable fixing of embedded params in DomContentUtils
--------------------------------------------------------------

                 Key: NUTCH-1115
                 URL: https://issues.apache.org/jira/browse/NUTCH-1115
             Project: Nutch
          Issue Type: Improvement
          Components: parser
    Affects Versions: 1.3
            Reporter: Markus Jelsma
            Assignee: Markus Jelsma
             Fix For: 1.4


Add option to disable fixing of embedded params:
http://lucene.472066.n3.nabble.com/Outlinks-with-embedded-params-td3332396.html

When enabled, millions of crap url's are output as outlink. This results in 
many 404 in the DB and many very long URL's that actually lead to the same page.

--
This message is automatically generated by JIRA.
For more information on JIRA, see: http://www.atlassian.com/software/jira

        

Reply via email to