[
https://issues.apache.org/jira/browse/NUTCH-497?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel#action_12506894
]
Dennis Kubes commented on NUTCH-497:
------------------------------------
I agree, I think it would be better to have something generic if we are having
this same issue (or at least the possibility) in multiple places. Let's hold
off on committing this right now and let me see if I can make this more
general. Besides, if anyone needs the workaround immediately they can still
get the current patch from here.
> Extreme Nested Tags causes StackOverflowException in DomContentUtils...Spider
> Trap
> ----------------------------------------------------------------------------------
>
> Key: NUTCH-497
> URL: https://issues.apache.org/jira/browse/NUTCH-497
> Project: Nutch
> Issue Type: Bug
> Components: fetcher
> Affects Versions: 0.8.1, 0.9.0, 1.0.0
> Environment: all
> Reporter: Dennis Kubes
> Assignee: Dennis Kubes
> Fix For: 1.0.0
>
> Attachments: ExtremeNestedTags.patch, nested-tags-trap.patch,
> nested-tags-trap2.patch
>
>
> Some webpages have a form of a spider trap that causes a
> StackOverflowException in DomContentUtils by having nested tags with
> thousands of layers deep. DomContentUtils when trying to get outlinks uses a
> recursive method to parse the html. With this type of nesting it errors out.
--
This message is automatically generated by JIRA.
-
You can reply to this email to add a comment to the issue online.
-------------------------------------------------------------------------
This SF.net email is sponsored by DB2 Express
Download DB2 Express C - the FREE version of DB2 express and take
control of your XML. No limits. Just data. Click to get it now.
http://sourceforge.net/powerbar/db2/
_______________________________________________
Nutch-developers mailing list
Nutch-developers@lists.sourceforge.net
https://lists.sourceforge.net/lists/listinfo/nutch-developers
