Author: fasfuuiios
Email:
Message:
Currently it looks like there is no way to stop indexing of spammed
sites. Link spammers even spam this board automatically from time to
time. That software is very pluggable and can be adapted for any type
of cms and submit forms.
I thought about global
Author: fasfuuiios
Email:
Message:
I'm not completely sure that it's good idea but probably it is better
than nothing at all to stop this. Of course, it needs tests and
analysis. I believe that normal html page has no more than 5 external
links. Currently even paid links are usually limited to
Author: fasfuuiios
Email:
Message:
I have noted that even if I start indexer with 5 or 10 or 20 or 40
threads with CrawlerThreads option in indexer.conf, top command is
always showing not more than 40% of cpu and very rarely it can rise up
to 55%. With more threads it can slightly ddos some
