Dear Matthias!
Thanks, for fast, and useable answer!
Matthias Jaekle wrote:
Hi,
- When I refetch pages (after 30 days), I think if the pages is modified, these will put into new segments, and the old version will be live in the old segments dir.
Run dedup to remove dupes or merge segments to avoid this.
And the db will be larger and larger in every new page versions? It is live problem or only I think this is problem?
The db is growing with each new Link you find. Each link is stored once.
Matthias
