If no one has any objections, I will go ahead and commit this.

Dennis Kubes

Dennis Kubes (JIRA) wrote:
>      [ 
> https://issues.apache.org/jira/browse/NUTCH-497?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
>  ]
> 
> Dennis Kubes updated NUTCH-497:
> -------------------------------
> 
>     Attachment: nested-tags-trap3.patch
> 
> added nested-tags-trap3.patch with apache grant
> 
>> Extreme Nested Tags causes StackOverflowException in 
>> DomContentUtils...Spider Trap
>> ----------------------------------------------------------------------------------
>>
>>                 Key: NUTCH-497
>>                 URL: https://issues.apache.org/jira/browse/NUTCH-497
>>             Project: Nutch
>>          Issue Type: Bug
>>          Components: fetcher
>>    Affects Versions: 0.8.1, 0.9.0, 1.0.0
>>         Environment: all
>>            Reporter: Dennis Kubes
>>            Assignee: Dennis Kubes
>>             Fix For: 1.0.0
>>
>>         Attachments: ExtremeNestedTags.patch, nested-tags-trap.patch, 
>> nested-tags-trap2.patch, nested-tags-trap3.patch
>>
>>
>> Some webpages have a form of a spider trap that causes a 
>> StackOverflowException in DomContentUtils by having nested tags with 
>> thousands of layers deep.  DomContentUtils when trying to get outlinks uses 
>> a recursive method to parse the html.  With this type of nesting it errors 
>> out.
> 

-------------------------------------------------------------------------
This SF.net email is sponsored by DB2 Express
Download DB2 Express C - the FREE version of DB2 express and take
control of your XML. No limits. Just data. Click to get it now.
http://sourceforge.net/powerbar/db2/
_______________________________________________
Nutch-developers mailing list
Nutch-developers@lists.sourceforge.net
https://lists.sourceforge.net/lists/listinfo/nutch-developers

Reply via email to