Re: Generate is very slow

[Karol Rybak]

Well actually it's the same thing i noticed crawldb operations are slooow,
actually generating and then updating the database takes almost as long as
crawling. I'm not sure if there's something i can do about it. I tried
generating huge segments like 500 000 urls each but that's not very good if
the crawl fails for some reason.