Hi Chris,

 Thank you for your post and I've read it through.
  So, you mean I should also add these lines to the plugin.xml in most
cases:

       <implementation id="org.apache.nutch.parse.rss.RSSParser"
                       class="org.apache.nutch.parse.rss.RSSParser"
                       contentType="application/rss+xml"
                       pathSuffix="rss"/>
         ...
       <implementation id="org.apache.nutch.parse.rss.RSSParser"
                       class="org.apache.nutch.parse.rss.RSSParser"
                       contentType="text/xml"
                       pathSuffix="xml"/>
       <implementation id="org.apache.nutch.parse.rss.RSSParser"
                       class="org.apache.nutch.parse.rss.RSSParser"
                       contentType="text/xml"
                       pathSuffix="rss"/>

在06-2-6,Chris Mattmann <[EMAIL PROTECTED]> 写道:
>
> Hi there,
>
>   That should work: however, the biggest problem will be making sure that
> "text/xml" is actually the content type of the RSS that you are parsing,
> which you'll have little or no control over.
>
> Check out this previous post of mine on the list to get a better idea of
> what the real issue is:
>
> http://www.nabble.com/Re:-Crawling-blogs-and-RSS-p1153844.html
>
> G'luck!
>
> Cheers,
> Chris
>
>
> ______________________________________________
> Chris A. Mattmann
> [EMAIL PROTECTED]
> Staff Member
> Modeling and Data Management Systems Section (387)
> Data Management Systems and Technologies Group
>
> _________________________________________________
> Jet Propulsion Laboratory            Pasadena, CA
> Office: 171-266B                        Mailstop:  171-246
> Phone:  818-354-8810
> _______________________________________________________
>
> Disclaimer:  The opinions presented within are my own and do not reflect
> those of either NASA, JPL, or the California Institute of Technology.
>
> > -----Original Message-----
> > From: 盖世豪侠 [mailto:[EMAIL PROTECTED]
> > Sent: Saturday, February 04, 2006 11:40 PM
> > To: [email protected]
> > Subject: Re: Which version of rss does parse-rss plugin support?
> >
> > Hi Chris
> >
> >
> > How do I change the plugin.xml? For example, if I want to crawl rss
> files
> > end with "xml", just add a new element?
> >
> >       <implementation id="org.apache.nutch.parse.rss.RSSParser"
> >                       class="org.apache.nutch.parse.rss.RSSParser"
> >                       contentType="application/rss+xml"
> >                       pathSuffix="rss"/>
> >       <implementation id="org.apache.nutch.parse.rss.RSSParser"
> >                       class="org.apache.nutch.parse.rss.RSSParser"
> >                       contentType="application/rss+xml"
> >                       pathSuffix="xml"/>
> >
> > Am I right?
> >
> >
> >
> > 在06-2-3,Chris Mattmann <[EMAIL PROTECTED]> 写道:
> > >
> > > Hi there,
> > > Sure it will, you just have to configure it to do that. Pop over to
> > > $NUTCH_HOME/src/plugin/parse-rss/ and open up plugin.xml. In there
> there
> > > is
> > > an attribute called "pathSuffix". Change that to handle whatever type
> of
> > > rss
> > > file you want to crawl. That will work locally. For web-based crawls,
> > you
> > > need to make sure that the content type being returned for your RSS
> > > content
> > > matches the content type specified in the plugin.xml file that
> parse-rss
> > > claims to support.
> > >
> > > Note that you might not have * a lot * of success with being able to
> > > control the content type for rss files returned by web servers. I've
> > seen
> > > a
> > > LOT of inconsistency among the way that they're configured by the
> > > administrators, etc. However, just to let you know, there are some
> > people
> > > in
> > > the group that are working on a solution to addressing this.
> > >
> > > Hope that helps.
> > >
> > > Cheers,
> > > Chris
> > >
> > >
> > >
> > > On 2/3/06 7:16 AM, "盖世豪侠" <[EMAIL PROTECTED]> wrote:
> > >
> > > > Hi *Chris,*
> > > >
> > > > The files of RSS 1.0 have a postfix of rdf. So willthe parser
> > recognize
> > > it
> > > > automatically as a rss file?
> > > >
> > > >
> > > > 在06-2-3,Chris Mattmann <[EMAIL PROTECTED]> 写道:
> > > >>
> > > >> Hi there,
> > > >>
> > > >> parse-rss is based on commons-feedparser
> > > >> (http://jakarta.apache.org/commons/sandbox/feedparser). From the
> > > >> feedparser
> > > >> website:
> > > >>
> > > >> "...commons-feedparser supports all versions of RSS (0.9, 0.91,
> 0.92,
> > > 1.0,
> > > >> and 2.0), Atom 0.5 (and future versions) as well as easy ad hoc
> > > extension
> > > >> and RSS 1.0 modules capability..."
> > > >>
> > > >> Hope that helps.
> > > >>
> > > >> Thanks,
> > > >> Chris
> > > >>
> > > >>
> > > >> On 2/3/06 6:46 AM, "盖世豪侠" <[EMAIL PROTECTED]> wrote:
> > > >>
> > > >>> I see the test file is of version 0.91.
> > > >>> Does the plugin support higher versions like 1.0 or 2.0?
> > > >>>
> > > >>> --
> > > >>> 《盖世豪侠》好评如潮,让无线收视居高不下,无线高兴之余,仍未重用。周
> 星驰岂是池中物,喜剧天
> > > 分>>> 既
> > > >>> 然崭露,当然不甘心受冷落,于是转投电影界,在大银幕上一展风采。无线既
> 得千里马,又失千里马,
> > > 当>>> 然
> > > >>> 后悔莫及。
> > > >>
> > > >>
> > > >>
> > > >
> > > >
> > > > --
> > > > 《盖世豪侠》好评如潮,让无线收视居高不下,无线高兴之余,仍未重用。周星
> 驰岂是池中物,喜剧天分既
> > > > 然崭露,当然不甘心受冷落,于是转投电影界,在大银幕上一展风采。无线既得
> 千里马,又失千里马,当然
> > > > 后悔莫及。
> > >
> > >
> > >
> >
> >
> > --
> > 《盖世豪侠》好评如潮,让无线收视居高不下,无线高兴之余,仍未重用。周星驰岂
> 是池中物,喜剧天分既然崭露,当然不甘心受冷落,于是转投电影界,在大银幕上一
> > 展风采。无线既得千里马,又失千里马,当然后悔莫及。
>
>


--
《盖世豪侠》好评如潮,让无线收视居高不下,无线高兴之余,仍未重用。周星驰岂是池中物,喜剧天分既然崭露,当然不甘心受冷落,于是转投电影界,在大银幕上一展风采。无线既得千里马,又失千里马,当然后悔莫及。

Reply via email to