[
https://issues.apache.org/jira/browse/NUTCH-1644?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14181899#comment-14181899
]
Lewis John McGibbney edited comment on NUTCH-1644 at 10/23/14 8:26 PM:
-----------------------------------------------------------------------
bq. extract embedded content (single elements, attributes) from DOM tree, or
AFAIK, this is the aim here.
With work we have done over the summer, we noticed two things
* sometimes people want easily configurable (dare I say it) scraping
capabilities
* if they cannot get that, then not only do they use a different piece of
software (scrapy) they are also prepared to use an entirely different language
(Python) in order to achieve the task at hand.
.. an XPath plugin is a huge step towards addressing both of the above and it
is important that we make the functionality available for users.
was (Author: lewismc):
bq. extract embedded content (single elements, attributes) from DOM tree, or
AFAIK, this is the aim here.
With work we have done over the summer, we noticed two things
* sometimes people want easily configurable (dare I say it) scraping
capabilities
* if they cannot get that, then not only do they use a different piece of
software (scrapy) they are also prepared to use an entirely different language
(Python) in order to achieve the task at hand.
.. an XPath plugin is a huge step towards addressing both of the above and it
is important that we make the functionality available for users.
> Should have a parser that uses xpath
> ------------------------------------
>
> Key: NUTCH-1644
> URL: https://issues.apache.org/jira/browse/NUTCH-1644
> Project: Nutch
> Issue Type: New Feature
> Components: parser
> Affects Versions: 2.2.1
> Reporter: cihad güzel
> Assignee: Lewis John McGibbney
> Labels: parser, xpath
> Fix For: 2.3
>
> Attachments: NUTCH-1644.patch
>
>
> May want to parse some url via xpath. May be blog or news web sites. Should
> be a plugin using xpath parse.
--
This message was sent by Atlassian JIRA
(v6.3.4#6332)
