Hey There,my DSpace (6.3) Site usually gets around 10k/h requests. This is handled quite well. But sometimes there are multiple bots/crawlers/spiders/indexers/harvester/whatevers throwing each up to 15k/h request at me at the same time and that on top of my 10k/h standart traffic. This my DSpace cannot handle and it becomes unresponsive, making the site seem offline to my users. I performance tuned my Apache and Postgres to handle more request/connections and gave the system plenty ram/cpu but DSpace gives up, I think, it's the hibernate layer breaking down.
I was thinking of using fail2ban to get a lid on exessive requesting. Anyone experience with that, or are there some best practice guides for fail2ban with DSpace? I don't wanna block/drop legit harvesters/indexers...
Also I came across mod_apache_rate_limit. Would that do any good for my case?
Are there other guides/ideas how to handle these amounts of traffic? THX and Regards Florian -- All messages to this mailing list should adhere to the Code of Conduct: https://www.lyrasis.org/about/Pages/Code-of-Conduct.aspx--- You received this message because you are subscribed to the Google Groups "DSpace Technical Support" group.
To unsubscribe from this group and stop receiving emails from it, send an email to [email protected]. To view this discussion on the web visit https://groups.google.com/d/msgid/dspace-tech/547030ca-d34a-b96f-635a-0e5968d8b849%40ub.fu-berlin.de.
smime.p7s
Description: S/MIME Cryptographic Signature
