Have anybody thought of replacing CrawlDb with any kind of Rational DB,mysql,for example?
Crawldb is so difficult to manipulate. I often have the requirements to edit several entries in crawdb; But that would cost too much waiting for the mapReduce.
Have anybody thought of replacing CrawlDb with any kind of Rational DB,mysql,for example?
Crawldb is so difficult to manipulate. I often have the requirements to edit several entries in crawdb; But that would cost too much waiting for the mapReduce.