Re: 0.7 branch

2005-08-23 Thread Andrzej Bialecki
Piotr Kosiorowski wrote: Andrzej wanted to commit latest clustering code there - is it still a valid plan? Do others have any plans for 0.7.1 release? Or objections against it? Or against release date? The release date sounds fine. Yes, I plan to commit the new clustering plugin. -- Best r

RE: Fetcher for constrained crawls

2005-08-23 Thread Nick Lothian
> > An implementation detail - have you considered using HiveMind > rather than Spring? This would be much more compatible > license-wise with Nutch and be easier to integrate into the > ASF repository. Further - I wonder if the existing plugin > mechanism would work well as a HiveMind-bas

Re: 0.7 branch

2005-08-23 Thread Jérôme Charron
> > I am going to create a Nutch 0.7 maintenance branch. I would like to > > make 0.7.1 release about 15th of September. > > I would like to add some simple bugfixes there (e.g. README.txt bad > > content, bad targets in plugin build.xml and maybe a couple of > > others). OK for 15.9 for me. What

Re: 0.7 branch

2005-08-23 Thread ogjunk-nutch
15.9. is almost a month away. I think it would be good to take a look at Kelvin's modifications and include it either in 0.7.1, or maybe 0.8 (without map-reduce, which would then be in 0.9). Kelvin, you should put your code in Jira. Otis --- Piotr Kosiorowski <[EMAIL PROTECTED]> wrote: > Hell

Re: Searching NDFS with Tomcat

2005-08-23 Thread Bill Down
The NutchBeans looks to see if your using multiple search servers or a local index/segment set up. Code below. If using NDFS it would have to connect to the namenode, and query the fs through there. public NutchBean(File dir) throws IOException { File servers = new File(

Re: Searching NDFS with Tomcat

2005-08-23 Thread Fredrik Andersson
I don't get why the servlet/tomcat even needs to be aware of the filesystem? I've just used custom-made search interfaces to Lucene/Nutch indices, but I figured that the actual searching and fetching of the results, in the general Nutch interface, was conducted through an abstraction layer, bean or

0.7 branch

2005-08-23 Thread Piotr Kosiorowski
Hello, I am going to create a Nutch 0.7 maintenance branch. I would like to make 0.7.1 release about 15th of September. I would like to add some simple bugfixes there (e.g. README.txt bad content, bad targets in plugin build.xml and maybe a couple of others). Andrzej wanted to commit latest clus

Re: Searching NDFS with Tomcat

2005-08-23 Thread Jay Pound
your right, tomcat cannot see the nutch filesystem!!! -J - Original Message - From: "Bill Down" <[EMAIL PROTECTED]> To: Sent: Tuesday, August 23, 2005 2:07 PM Subject: Re: Searching NDFS with Tomcat > >From what I gathered, there is currently no support to > search an NDFS file system f

Re: Searching NDFS with Tomcat

2005-08-23 Thread Bill Down
>From what I gathered, there is currently no support to search an NDFS file system from a browser. You can only search a local or distributed search server. Can someone verify this for me? Thanks --- lucene_nutch_ lucene_nutch_2005 <[EMAIL PROTECTED]> wrote: > Hi, > > I know NDFS is in still

Searching NDFS with Tomcat

2005-08-23 Thread lucene_nutch_ lucene_nutch_2005
Hi, I know NDFS is in still under development, but can someone please tell me how I would go about launching Tomcat to search and index in NDFS? My NDFS is set up with a namenode and 2 datanodes. I want to launch Tomcat to search within the namenode. Has anyone done this? If I'm on the wrong t

Re: Fetcher for constrained crawls

2005-08-23 Thread ogjunk-nutch
>From what I heard from Kelvin, the Spring part could be thrown out and replaced with classes with main(). I think there is a need for having the Fetcher component more separated from the rest of Nutch. The Fetcher alone is well done and quite powerful on its own - it has host-based queues, doesn

Re: Fetcher for constrained crawls

2005-08-23 Thread Piotr Kosiorowski
Hi, I think it is an interesting idea but from technical pespective decision to use HiveMind or Spring should be taken for the whole project in my opinion. The same goes for JDK 5.0. So right now it is not a best match for Nutch. On the functionality side I am not the best person to judge it a

Re: Mapred/0.7

2005-08-23 Thread Stefan Groschupf
Hi, interesting... 1. How do you see the 0.7 version evolving beside maintenance update? Will it have a life of its own? I mean 0.7 is very good for intranet use or mid-size public site. Why would you want to use mapred version when you don't need it? (Maybe I don't know enough :-) Using Map

Re: Fetcher for constrained crawls

2005-08-23 Thread Erik Hatcher
Kelvin, Big +1!!! I'm working on focused crawling as well, and your work fits well with my needs. An implementation detail - have you considered using HiveMind rather than Spring? This would be much more compatible license-wise with Nutch and be easier to integrate into the ASF reposito