A script that automates repetitive tasks would be great. The only reason I haven't gone beyond just playing with Nutch is because it requires a number of steps which require dynamic input, and I haven't had time to automate repetitive steps. If you have something, I'd be interested.
Otis --- Byron Miller <[EMAIL PROTECTED]> wrote: > Oh, and that is with about 35%-45% cpu load.. i think > if i add more ram i could bump up the thread count, > but its fast enough that i have enough cycles to be > fetching one segment while importing another and > creating indexes. Goal is to get a script together to > just have the server go hog heaven grabbing urls and > processing them for the next 2-3 weeks. > > > ------------------------------------------------------- > This SF.net email is sponsored by: The Robotic Monkeys at ThinkGeek > For a limited time only, get FREE Ground shipping on all orders of > $35 > or more. Hurry up and shop folks, this offer expires April 30th! > http://www.thinkgeek.com/freeshipping/?cpg=12297 > _______________________________________________ > Nutch-developers mailing list > [EMAIL PROTECTED] > https://lists.sourceforge.net/lists/listinfo/nutch-developers ------------------------------------------------------- This SF.net email is sponsored by: The Robotic Monkeys at ThinkGeek For a limited time only, get FREE Ground shipping on all orders of $35 or more. Hurry up and shop folks, this offer expires April 30th! http://www.thinkgeek.com/freeshipping/?cpg=12297 _______________________________________________ Nutch-developers mailing list [EMAIL PROTECTED] https://lists.sourceforge.net/lists/listinfo/nutch-developers
