[ https://issues.apache.org/jira/browse/NUTCH-444?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel#action_12494764 ]
Chris A. Mattmann commented on NUTCH-444: ----------------------------------------- Hi Doğacan, Well I must say, with all the discussion that's gone on w.r.t. this issue, I am leaning towards your suggestion. Could you please bring this patch up to date against the latest trunk? Just to clarify. Does your patch include a new feed parser that uses Rome? If so, I'd like to suggest you and me working closely together on the following: 1. Bring the existing patch up-to-date against latest trunk 2. Take nutch newbie's seed list of RSS urls to use as our benchmark 3. Run through one or two full tests 4. Attach a new patch, call for objects 5. Go ahead and commit Sound good? If so, let's work on this. Cheers, Chris > Possibly use a different library to parse RSS feed for improved performance > and compatibility > --------------------------------------------------------------------------------------------- > > Key: NUTCH-444 > URL: https://issues.apache.org/jira/browse/NUTCH-444 > Project: Nutch > Issue Type: Improvement > Components: fetcher > Affects Versions: 0.9.0 > Reporter: Renaud Richardet > Assigned To: Chris A. Mattmann > Priority: Minor > Fix For: 1.0.0 > > Attachments: parse-feed-v2.tar.bz2, parse-feed.tar.bz2 > > > As discussed by Nutch Newbie, Gal, and Chris on NUTCH-443, the current > library (feedparser) has the following issues: > - OutOfMemory when parsing > 100k feeds, since it has to convert the feed to > jdom first > - no support for Atom 1.0 > - there has been no development in the last year > Alternatives are: > - Rome > - Informa > - custom implementation based on Stax > - ?? -- This message is automatically generated by JIRA. - You can reply to this email to add a comment to the issue online. ------------------------------------------------------------------------- This SF.net email is sponsored by DB2 Express Download DB2 Express C - the FREE version of DB2 express and take control of your XML. No limits. Just data. Click to get it now. http://sourceforge.net/powerbar/db2/ _______________________________________________ Nutch-developers mailing list Nutch-developers@lists.sourceforge.net https://lists.sourceforge.net/lists/listinfo/nutch-developers