The Public search call can take between 5s and 30s to respond depending on the specificity of the request. When I see 50 requests in 1 minute from the same IP address, for example, I know this is someone abusing the system - it is clearly not a human being interacting normally with the service.
In this case I want to limit 5 requests in 1 minute from the same IP address to the following URL: https://<FQDN>/datamart/searchByName.do Norman Branitsky Senior Cloud Architect P: 416-916-1752 -----Original Message----- From: Aleksandar Lazic <[email protected]> Sent: Tuesday, November 22, 2022 7:44 PM To: Branitsky, Norman <[email protected]> Cc: HAProxy <[email protected]> Subject: Re: Rate Limit a specific HTML request Hi. On 22.11.22 23:19, Branitsky, Norman wrote: > A "computationally expensive" request is a request sent to our Public > Search service - no login required so it seems to be the target of abuse. > For example: > https://<FQDN>/datamart/searchByName.do?anchor=169a72e.0 Okay, let me rephrase your question. How can be a IP blocked which creates a request which takes $too_much_time to response. Where could be the $too_much_time defined? Could it be the "timeout server ..." config parameter? Could the "%Tr" or "%TR" be used from logformat for that? https://urldefense.com/v3/__https://docs.haproxy.org/2.6/configuration.html*8.2.6__;Iw!!A69Ausm6DtA!b3LTpCREJRN2Hj4NoBfjNEPkQJOByCMuzvxqRf8ovSBUZcwltPnqTF65sAGIyVpGWJLD55QNtJo9nh_zUwuWiz39dFlj$ or the request get a 504 for internal state. Idea: backend block_bad_client stick-table type ip size 100k expire 30s store http_req_rate(10s) http-request track-sc0 src unless { $too_much_time } and call the table block_bad_client in the frontend config. Is this what you would like to do? I'm not sure if this is possible with HAProxy. Regards Alex > Norman Branitsky > Senior Cloud Architect > P: 416-916-1752 > > -----Original Message----- > From: Aleksandar Lazic <[email protected]> > Sent: Tuesday, November 22, 2022 4:27 PM > To: Branitsky, Norman <[email protected]> > Cc: HAProxy <[email protected]> > Subject: Re: Rate Limit a specific HTML request > > Hi. > > On 22.11.22 21:57, Branitsky, Norman wrote: >> I have the following "generic" rate limit defined - 150 requests in >> 10s from the same IP address: >> >> stick-table type ip size 100k expire 30s store >> http_req_rate(10s) >> http-request track-sc0 src unless { src -f >> /etc/CONFIG/haproxy/cidr.lst } >> http-request deny deny_status 429 if { sc_http_req_rate(0) gt >> 150 } >> >> Is it possible to rate limit a specific "computationally expensive" >> HTML request from the same IP address to a much smaller number? > > What do you define as a "computationally expensive" request? > > Maybe you could draw a bigger Picture and tell us what version of HAProxy do > you use. > > In the upcoming 2.7 is also a "Bandwidth limitation", maybe this could help > to solve your issue. > https://urldefense.com/v3/__https://docs.haproxy.org/dev/configuration > .html*9.7__;Iw!!A69Ausm6DtA!cXofLVgdVtpc37THsFRU0XMLkddQpViT0iPILErgEs > XJ5Ij0hkHgjayqKAMX3sQrCOK74wbouLMjDkb0ZJe5a08n2NK9$ > > HTML is a Description Language therefore I think you want to restrict HTTP > Request/Response, isn't it? > > https://urldefense.com/v3/__https://www.rfc-editor.org/rfc/rfc1866__;! > !A69Ausm6DtA!cXofLVgdVtpc37THsFRU0XMLkddQpViT0iPILErgEsXJ5Ij0hkHgjayqK > AMX3sQrCOK74wbouLMjDkb0ZJe5a55k2_bp$ > >> *Norman Branitsky* >> Senior Cloud Architect >> Tyler Technologies, Inc. > > Regards > Alex > >> P: 416-916-1752 >> C: 416.843.0670 >> http://www.tylertech.com >> Tyler Technologies >

