[
https://issues.apache.org/jira/browse/NUTCH-489?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel#action_12498113
]
Doğacan Güney commented on NUTCH-489:
-------------------------------------
Hmm.. Won't it now cause Nutch to filter on path on a line like this:
-(jpg|JPG)
Because, you just check if line contains a 'P', and line above does.
Perhaps, a better option would be to require P and I be the only characters on
their line, like:
+I
+P
# but not +IP
> URLFilter-suffix management of the url path when the url contains some query
> parameters
> ---------------------------------------------------------------------------------------
>
> Key: NUTCH-489
> URL: https://issues.apache.org/jira/browse/NUTCH-489
> Project: Nutch
> Issue Type: Improvement
> Affects Versions: 0.9.0
> Environment: Windows, Java 1.5
> Reporter: Emmanuel Joke
> Attachments: suffix-urlfilter.txt.patch, SuffixURLFilter.java.patch,
> SuffixURLFilter_v2.java.patch
>
>
> The current filter compares only on string level. It try to apply the filter
> to the full URL (path + query parameters).
> So, even if we have define in our filter to exclude all js extension, it
> won't exclude this URL http://www.toto.com/from.js?id=5.
> I've added a new parameter in the filter which can be use to configure the
> filter to exclude URL based on the url path.
--
This message is automatically generated by JIRA.
-
You can reply to this email to add a comment to the issue online.
-------------------------------------------------------------------------
This SF.net email is sponsored by DB2 Express
Download DB2 Express C - the FREE version of DB2 express and take
control of your XML. No limits. Just data. Click to get it now.
http://sourceforge.net/powerbar/db2/
_______________________________________________
Nutch-developers mailing list
Nutch-developers@lists.sourceforge.net
https://lists.sourceforge.net/lists/listinfo/nutch-developers
