[
https://issues.apache.org/jira/browse/NUTCH-1414?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
]
Markus Jelsma updated NUTCH-1414:
---------------------------------
Attachment: NUTCH-1414-1.6-1.patch
Here's a first draft with unit tests and a command line test tool.
{code}bin/nutch plugin org.apache.nutch.parse.date{code}
This plugin extracts a fragment that's likely to contain the page's creation
date. The fragment is then passed through a series of regular expressions that
the user can configure. The extracted date candidates are then passed through a
configurable list of DateFormat formats in an attempt to get a parsed date.
The date format is locale sensitive so the language provided by the
language-identifier is passed as well. With it, parsing dates in various
languages is possible with a single date format.
Please comment.
> Date extraction parse filter
> ----------------------------
>
> Key: NUTCH-1414
> URL: https://issues.apache.org/jira/browse/NUTCH-1414
> Project: Nutch
> Issue Type: New Feature
> Components: parser
> Reporter: Markus Jelsma
> Assignee: Markus Jelsma
> Fix For: 1.6
>
> Attachments: NUTCH-1414-1.6-1.patch
>
>
> Date extraction parse filter for Nutch to provide means to extract an
> arbitrary page date (article date) from the parse text.
--
This message is automatically generated by JIRA.
If you think it was sent incorrectly, please contact your JIRA administrators:
https://issues.apache.org/jira/secure/ContactAdministrators!default.jspa
For more information on JIRA, see: http://www.atlassian.com/software/jira
