On Tue, Jun 15, 2004 at 09:04:57AM -0700, Doug Cutting wrote: > [EMAIL PROTECTED] wrote: > >Attached is a patch for file:// scheme. It will be useful for > >(1) local/personal search > >(2) development/testing > >(3) a starting point of "desktop search"? > >It's done on linux. If breaks on ms windows, please let me know > >or provide a patch. > > Thanks for providing this. I just committed it. > > I'm not sure that we need to model each protocol on HTTP. What are the
These http headers provide convenience at various stages, especially handy when presenting search results (uniform for all protocols). As we progress, I can retrofit if there are better ways. > advantages of doing this now that we have an abstract protocol API? Which one specifically? I may have missed something. > > >It can be downloaded at http://nutch.neasys.com/patch/, together with > >a REQUIRED jar file jaf-1.0.2.jar. Check under 20040605. > >The jar file needs to be in ./nutch/lib. > > Why does this need to be in the top-level lib directory? Can't it go in > the plugin's lib directory instead? It only appears to be used in the > plugin. I would prefer that we keep as few libraries as possible in the > top-level lib, and try to keep most things with plugins. Yes, libs used by nutch core should be kept at minimum. In fact, ./nutch/src/plugin/lib would be the best place for jaf-1.0.2.jar, which both protocol-file and protocol-ftp depend on. Since I wasn't so sure how libs are searched by plugin code, just dump it in ./nutch/lib and leave it to you for a fix. We might experience similar problem again as more plugins are added. Log4j is another one. Related, two quesitons about plugin code for you and Stephan: (1) Does the plugin code provide mechanism for running external program (separate process, not written in java)? This capability would be very useful, since there are many parsers out as standalone tools. Core issue would be pipe stdin, stdout and stderr properly. Byron has expressed the same interest before. (2) If two plugins A and B depend on different versions of lib C, how does the plugin code handle it? I might face this possiblity in the future. John ------------------------------------------------------- This SF.Net email is sponsored by The 2004 JavaOne(SM) Conference Learn from the experts at JavaOne(SM), Sun's Worldwide Java Developer Conference, June 28 - July 1 at the Moscone Center in San Francisco, CA REGISTER AND SAVE! http://java.sun.com/javaone/sf Priority Code NWMGYKND _______________________________________________ Nutch-developers mailing list [EMAIL PROTECTED] https://lists.sourceforge.net/lists/listinfo/nutch-developers
