[
https://issues.apache.org/jira/browse/NUTCH-1531?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
]
Sebastian Nagel updated NUTCH-1531:
-----------------------------------
Fix Version/s: 1.8
> URL filtering takes long time for very long URLs
> ------------------------------------------------
>
> Key: NUTCH-1531
> URL: https://issues.apache.org/jira/browse/NUTCH-1531
> Project: Nutch
> Issue Type: Improvement
> Affects Versions: 1.6, 2.1, 1.7, 2.2
> Reporter: Fırat KÜÇÜK
> Priority: Minor
> Fix For: 2.3, 1.8
>
> Attachments: max_url_length.diff, test_case.txt
>
>
> Filtering very long urls (such as base64 image generators) take long time
> (hours). On reducing phase it locks down all the system for hours. Therefore
> some URL length limitation needed. We attached a little patch for this
> improvement.
--
This message is automatically generated by JIRA.
If you think it was sent incorrectly, please contact your JIRA administrators
For more information on JIRA, see: http://www.atlassian.com/software/jira
