Greetings Chris, As I recall, you listed the patterns in a file, and included that file in the htdig.conf file using backquotes. It just occurred to me that the file listing the patterns is probably being read in each time the attribute is read (each time a url is parsed).
What happens to the speed if you list the patterns explicitly in the htdig.conf file? If that is the problem, one solution would be for HtConfig::Find() to replace any `file` argument by the contents of the file the first time it is read. That may chew up some memory for things like long lists for start_url, but it would only use memory for attributes that are actually used. (Of course, it would still be better not to re-parse the attributes unnecessarily.) Opinions? Cheers, Lachlan On Tue, 13 Apr 2004 22:04, Christopher Murtagh wrote: > On Sun, 2004-04-11 at 22:50, Lachlan Andrew wrote: > > Greetings Chris, > > > > What are the actual 30 patterns that cause problems? It could > > well be a single pattern which is giving the regular-expression > > handler grief. > > Yeah, I had thought the same as well. However, I tried changing > the patterns, and also leaving very simple patterns. They all ended > up the same. Also, the more patterns I added, the slower the > performance was. > > Cheers, > > Chris -- [EMAIL PROTECTED] ht://Dig developer DownUnder (http://www.htdig.org) ------------------------------------------------------- This SF.Net email is sponsored by: IBM Linux Tutorials Free Linux tutorial presented by Daniel Robbins, President and CEO of GenToo technologies. Learn everything from fundamentals to system administration.http://ads.osdn.com/?ad_id70&alloc_id638&op=click _______________________________________________ ht://Dig Developer mailing list: [EMAIL PROTECTED] List information (subscribe/unsubscribe, etc.) https://lists.sourceforge.net/lists/listinfo/htdig-dev
