I have made some changes to the nutchbase branch indeed. Mostly porting missing plugins to the new API but also retrofitting recent modifications from the trunk to nutchbase in order to facilitate the later merge from nutchbase to trunk later.
I also removed some old Nutch objects which were not actively used in nutchbase in order to check that it had no influence on the code but also to facilitate the review and merging of the NutchBase code. If we remove these, it will be impossible to be able to update nutch 1.1 > data into 2.0. It is already difficult, but I think at least for standard > crawls we can offer an upgrade path. indeed the conversion from 1.x to 2.0 has not been discussed so far. Bear in mind that we will merge the changes from NutchBase to the trunk - so these objects are not lost and will be kept in the trunk if we decide that this is what we should do. Doing some clearing in the NutchBase branch allowed to improve the code by finding references to old Writable classes that we won't necessarily keep in the trunk. Now that you mention upgrade solutions from 1.x to 2.0 I suggest that we open a JIRA to discuss this. IMHO we probably don't want to keep the 'old' code in src/java when we merge but could have the code for the conversion utilities and the Nutch 1.x jars in a the contrib/ directory instead. > > Also, I realize that I am the last person to talk about this, but can we > get some reviews for these changes? > I could have filed a JIRA for the branch NutchBase indeed (but haven't). Again, NutchBase is a transitional / test / development repository before we merge things into trunk. Changes to the trunk are made properly i.e. through JIRA with patches and peer review. Or maybe I should indeed open a JIRA for NutchBase every time I do a bit of cleanup or port new plugins to the 2.0 API? Do you want to open a JIRa for discussing how we will upgrade from 1.x to 2.0? J. > > On Tue, Jul 20, 2010 at 14:47, <[email protected]> wrote: > >> Author: jnioche >> Date: Tue Jul 20 11:47:23 2010 >> New Revision: 965815 >> >> URL: http://svn.apache.org/viewvc?rev=965815&view=rev >> Log: >> remove deprecated objects ParseText and ParseStatus >> >> Removed: >> >> nutch/branches/nutchbase/src/java/org/apache/nutch/parse/ParseStatus.java >> nutch/branches/nutchbase/src/java/org/apache/nutch/parse/ParseText.java >> >> nutch/branches/nutchbase/src/test/org/apache/nutch/parse/TestParseText.java >> >> > > > -- > Doğacan Güney > > -- DigitalPebble Ltd Open Source Solutions for Text Engineering http://www.digitalpebble.com
